Questions

AI powered cyber attacks: your questions answered

Short, sourced answers to what UK managers and security leads ask about attacks that use AI and attacks on AI.

Last reviewed against NCSC (UK), Anthropic and UK Government (DSIT and Home Office). Sources

The overview gives the wider picture, and the defence plan sets out the actions in order.

Quick answers

Questions people ask

What is an AI powered cyber attack?

It is an attack where criminals or state-linked actors use AI to scale or improve their methods, such as phishing, impersonation and intrusion. The NCSC expects AI to keep making parts of an intrusion quicker and more effective[1]. Attacks on AI tools, such as prompt injection, are a related but separate category[2].

How common are cyber attacks on UK organisations?

The 2025/2026 government survey counted 43% of businesses and 28% of charities as having had a breach or attack in the past year[6]. The survey does not attribute those figures to AI[6].

How did the Arup deepfake fraud work?

An employee was tricked into transferring HK$200m (about £20m) after a video call in which synthetic voices and images impersonated senior officers[8]. The company said its own systems had not been breached[8].

Has AI really carried out a cyber attack by itself?

Anthropic reported a campaign it assessed as Chinese state-sponsored in which AI did 80-90% of the work, with humans making perhaps four to six critical decisions per campaign[5]. The company describes it as the first documented case of a large-scale attack executed without substantial human intervention[5].

What is prompt injection?

It is an attack that uses crafted text to make an LLM behave in ways its owner did not intend. OWASP ranks it first in its 2025 risks for LLM applications[9]. The NCSC says it probably cannot be fully prevented, so the aim is to limit likelihood and impact[2].

Can a product stop prompt injection?

The NCSC advises being sceptical of any product that claims it can stop prompt injection[2]. It recommends designing the system so a fooled LLM has little to abuse, for example by limiting its privileges[2].

Are UK organisations managing the risk of using AI?

Not widely, according to the 2025/2026 survey. Among businesses that use AI or are moving towards it, 24% had practices to manage its risks, against 27% of charities[6].

What is the NCSC's advice on securing AI systems?

It says security should be a core requirement across an AI system's lifecycle and that leaders should understand the consequences if its integrity, availability or confidentiality is compromised[4]. A separate government code adds baseline principles for those who develop and deploy AI[10].

Will AI make phishing harder to spot?

The sources do not measure that directly. The NCSC judges AI will make elements of intrusion more effective[1], and phishing already led the UK survey, reaching 38% of businesses[6]. Treat message quality as an unreliable signal and rely on second-channel checks.

How CyPro can help

Need a hand with any of this?

Patching is one job. Keeping a vulnerable system safe until it is patched, and proving it, is several more. CyPro's consultants, testers and SOC analysts can take any of them off your plate.

Scanner checking internet-facing systems for weaknesses

Vulnerability scanning

Find every internet-facing system you run, including the forgotten ones, and see which are still on a vulnerable build.

See the scanning service
Cyber security consultants planning hardening work

Hardening and segmentation

Our consultants put the controls in place that limit the damage when something is missed: firewall rules, network isolation and tighter admin access.

More on cypro.co.uk
Security analysts monitoring systems around the clock

24/7 security monitoring

Our SOC analysts watch your systems day and night for the signs of an attack in progress: unexpected processes, new outbound connections, logins that do not fit.

More on cypro.co.uk
Penetration tester probing an application for weaknesses

Penetration testing

A focused test of your systems and the controls around them, so you know they hold before an attacker finds out for you.

More on cypro.co.uk
Incident responders containing an attack

Incident response

If you may already be compromised, our responders contain it, preserve the evidence, find out what was touched and get you running again safely.

More on cypro.co.uk
Security lead advising a board

Fractional CISO for the board

A senior security lead who advises the board on what to fix first, what to accept and what to tell customers, and owns the decision record.

More on cypro.co.uk
Rocket launching from a cloud

Know your exposure

Not sure you are protected?

Many of the risks here sit in how an organisation uses AI: what tools staff run, what they can reach and who owns the risk. AI governance work sets that out so controls match the tools in use.