Protection from intelligent threats

Artificial intelligence is becoming part of everyday business operations. From automating routine tasks and analysing large volumes of information to supporting customer service, software development, and decision-making, AI presents significant opportunities for businesses of almost every size. The same technologies are also available to threat actors.

Cybercriminals can use AI to improve phishing campaigns, research potential targets, create convincing fraudulent communications, and impersonate real people. Attacks that once required considerable time, technical ability, or knowledge of an organisation can increasingly be created and adapted at speed.

This does not mean that AI has completely reinvented cybercrime. Phishing, social engineering, impersonation, and fraud have existed for decades. What AI changes is the potential speed, scale, and sophistication of these attacks.

For organisations, the challenge is therefore not simply deploying better cybersecurity technology. It is ensuring that employees can recognise increasingly convincing threats, that appropriate controls exist to verify important decisions, and that AI itself is used responsibly throughout the business.

How AI is being weaponised in the workplace

One of the clearest examples of AI-enabled cybercrime is phishing. In the past, many phishing emails contained obvious warning signs: poor spelling, unusual grammar, generic greetings, or language that did not quite fit the organisation supposedly sending the message. Generative AI can remove many of these clues.

A threat actor can combine publicly available information from company websites, professional networking platforms, social media, and other sources with generative AI to create highly personalised messages. An employee might receive an email referring to a genuine colleague, supplier, project, or event, written in professional language and apparently providing a perfectly reasonable explanation for the request being made.

The objective, however, remains familiar: persuade somebody to click a malicious link, disclose credentials, open an attachment, transfer money, or provide confidential information. AI can also make impersonation significantly more convincing.

Voice cloning can reproduce a person’s voice from relatively small samples of recorded speech, while deepfakes can create increasingly realistic video and imagery. These capabilities make business email compromise and executive impersonation more convincing.

Imagine receiving an urgent telephone call apparently from your Finance Director asking you to process an unusual payment. What happens when the caller not only knows the names of the people involved, but also sounds like the Finance Director? The same principle can extend to video calls, recorded messages, and apparently legitimate supporting documents. This creates an important new security reality: recognising someone’s voice, face, or writing style can no longer be treated as sufficient proof of identity.

AI can also accelerate reconnaissance. Attackers can use automated tools to collect and analyse large amounts of publicly available information, helping them understand organisational structures, identify senior employees, discover suppliers, and develop convincing scenarios for social engineering attacks. The underlying attacks may not be new, but AI can make them more believable, more personalised, and easier to conduct at scale.

Cybersecurity habits for an AI-enabled world

As attacks become more convincing, employees need to look beyond whether something appears legitimate. A useful principle is to verify the request, not just the person making it.

If somebody receives an unexpected request to change supplier bank details, for example, recognising the sender’s email address should not be enough. The change should be verified using an established process and, where appropriate, through a separate trusted communication channel.

The same principle applies to requests for passwords, sensitive information, confidential documents, or unusual financial transactions. Employees should also be alert to urgency. Social engineering frequently attempts to prevent people from thinking carefully: this payment must be made immediately; the Managing Director is waiting; the customer needs this now. AI has not changed that psychological technique. It has simply made the message delivering it more convincing.

Strong technical controls remain essential. Multi-Factor Authentication (MFA) can make stolen credentials harder to exploit. Email filtering, endpoint protection, access controls, and monitoring can help prevent, detect, and respond to malicious activity, but technical controls cannot anticipate every situation.

Employees should therefore know how to check suspicious links, handle unexpected attachments and QR codes, verify unusual requests, and report concerns quickly.

They should also understand that AI itself introduces information-security risks. Copying confidential business information, personal data, intellectual property, or customer information into an unapproved public AI service could result in that information being processed or stored outside the organisation’s control.

Cybersecurity awareness must therefore increasingly include not only defending against malicious uses of AI, but also using legitimate AI securely.

Building responsible AI into the organisation

Responsible AI use requires more than simply making AI tools available to employees. Businesses need to establish clear boundaries around how AI can be used, what information can be provided to AI systems and when human oversight is required.

An AI acceptable-use policy is an important starting point. Employees should understand which AI tools are approved, which uses are prohibited or restricted, and what types of information must never be entered into unapproved systems. These requirements need to be communicated clearly and reinforced through practical guidance. However, responsible AI extends beyond information security.

Businesses should consider data protection and privacy, intellectual property, confidentiality, accuracy, transparency, and potential bias. AI-generated information may appear authoritative while being inaccurate or incomplete. Where outputs could influence significant business decisions, they should be checked against reliable sources rather than simply accepted at face value.

Accountability also matters. If an AI system contributes to a decision, organisations need to establish who is responsible for that decision. Employees should know when they can rely on AI to assist their work and when outputs require additional validation, approval, or specialist review.

Third-party risk also needs consideration. An organisation may have robust internal controls but still introduce risk through suppliers whose products or services incorporate AI. Understanding where AI is being used within the supply chain, what information it processes and how that information is protected is increasingly important.

Established management-system approaches can help organisations manage these risks systematically. ISO/IEC 27001 provides a framework for managing information security risks, while ISO/IEC 42001 applies management-system principles specifically to the governance and responsible use of artificial intelligence.

The objective should not be to prevent innovation. It should be to create an environment where people can use AI productively while understanding the boundaries within which that use is safe, ethical, and accountable.

Turning employees into the first line of defence

Cybersecurity discussions have often described employees as the organisation’s “weakest link”. While there is some truth in that description, I increasingly question whether it is a helpful way to think about cybersecurity. People certainly make mistakes, and attackers deliberately exploit human behaviour. But employees are also uniquely capable of recognising when something does not make sense.

Technology may determine that an email originated from a legitimate account. An employee may recognise that the request contained within it is completely out of character. A video call may appear entirely legitimate. An employee may nevertheless question why a senior executive is suddenly asking them to bypass the organisation’s normal payment process.

Rather than treating employees as a cybersecurity weakness that needs to be controlled, organisations should recognise and develop their potential as an effective first line of defence. This requires more than annual awareness training.

Training needs to reflect the situations employees may now encounter. A finance team could be presented with a simulated voice call requesting an urgent transfer. HR employees could encounter an AI-generated recruitment scam. Procurement teams could practise responding to fraudulent supplier bank-detail changes. Employees using generative AI could be challenged to identify what information should and should not be provided to an external AI service.

These scenarios teach people how to make security decisions rather than simply asking them to remember a list of warning signs. Just as importantly, organisations need to create a culture in which employees are encouraged and supported in challenging unusual requests.

In an earlier article, “Deviation from the norm”, I discussed the importance of questioning requests that depart from established practices, particularly where urgency or apparently reasonable explanations are used to encourage compliance. AI has not changed that principle. It has made recognising those deviations, and having the confidence to challenge them, increasingly important.

An employee who delays a significant payment for five minutes while independently confirming the instruction is not being obstructive. They are applying an important security control. This becomes particularly important when requests appear to come from senior management. Attackers frequently exploit authority because employees may be reluctant to question somebody more senior.

Employees need to know that established security processes still apply when the request appears to come from the Chief Executive. Reporting processes also need to be simple and supportive. Employees who think they may have clicked a malicious link or disclosed information should feel able to report the incident immediately. The faster the security team knows about a potential compromise, the faster it can respond. Blaming people for genuine mistakes can have precisely the opposite effect, encouraging employees to remain silent when rapid reporting matters most.

The goal should be a workforce that is cautious without becoming fearful: people who understand the threats, know what controls are available, and feel confident enough to stop and verify something when it does not seem right.

From trust to verification

Artificial intelligence is changing not only how organisations operate, but also how criminals attempt to exploit them. The answer is not to become afraid of AI or to assume that every email, telephone call, or video meeting is fraudulent. Nor can organisations rely solely on cybersecurity technology to solve the problem. Businesses need layers of defence.

Technical security controls remain fundamental. Clear governance and responsible AI policies establish the boundaries within which technology can be used. Verification processes make impersonation and social engineering harder to exploit. Well-trained, confident employees provide something technology alone cannot always deliver: context and judgement.

In an AI-enabled workplace, seeing is no longer necessarily believing. Neither is hearing. Verification has therefore become increasingly important. Organisations need to move from trusting communications because they appear genuine towards confirming important actions through established processes.

Most importantly, businesses should recognise that their employees can be one of their strongest cybersecurity controls. Given the right training, processes, and organisational culture, they can provide an effective first line of defence against threats that are becoming increasingly difficult to recognise.