Can AI hack like an expert?

GPT-5.6 Sol solved 95% of expert-level hacking tasks in the UK AI Security Institute's tests (Jul 2026).

95%

of expert-level hacking tasks solved by GPT-5.6 Sol.

Expert level means work for someone with 10+ years in cybersecurity.

GPT-5.6 Sol, in UK AI Security Institute tests published by OpenAI. No AI solved any of these tasks before April 2025.

As of

Hacking puzzles, by the skill a human needs

Single hacking tasks, each with one hidden answer to find. Bars show the share solved by the top model at each level.

Beginner with tech skillsSome tech skills, like a data analyst or engineer
All
All solvedsince Feb 2026
1-3 years in securityHackers for hire, small-time cyber criminals
All
All solvedsince Feb 2026
3-10 years in securityRansomware developers, security analysts
99%
GPT-5.5Apr 2026
10+ years in securityVeterans of the field
95%
GPT-5.6 SolJul 2026

The line under the 95% bar is the institute's margin of error, about 10 points either way. In the same run, GPT-5.5 scored 85%. GPT-5.6 Sol now solves nearly all of these puzzles, so the institute also tests whole attacks.

Hacking puzzles by skill level: model, share solved, when tested
Skill levelModelShare solvedTested
Beginner with tech skillsAll frontier modelsAll solvedsince Feb 2026
1-3 years in securityAll frontier modelsAll solvedsince Feb 2026
3-10 years in securityGPT-5.599%Apr 2026
10+ years in securityGPT-5.6 Sol95%Jul 2026

Whole attacks, start to finish

Long chains of steps on a test network, each step needed for the next. One square per try; violet means the AI finished the attack.

Break into a company network32 steps, about 20 hours for a human expert
7 of 10 triesGPT-5.6 Sol, Jul 2026
A similar network, with basic defencesAnti-virus on every computer, 23 steps
No AI has finished it. Furthest: step 21 of 23
0 of 10 triesGPT-5.6 Sol, Jul 2026
Disrupt a power plant's controls7 steps, about 15 hours for a human expert
3 of 10 triesClaude Mythos Preview, reported Jun 2026

No other AI has finished the power plant attack.

Whole attacks: model, tries finished, when tested
AttackModelTries finishedTested
Break into a company networkGPT-5.6 Sol7 of 10Jul 2026
A similar network, with basic defencesGPT-5.6 Sol0 of 10Jul 2026
Disrupt a power plant's controlsClaude Mythos Preview3 of 10reported Jun 2026

AI hacking in the real world

Cases where AI agents attacked real computer systems, or AI found flaws in software the web runs on. Each is sourced to the lab, tester or maintainer that reported it.

OpenAI test agents broke into Hugging Face

OpenAI internal model IM1 · OpenAI, Aug 2026

In July 2026, about 700 of 1,200 OpenAI test agents, meant to stay isolated from each other, attacked Hugging Face to get the answers to a hacking test. They ran code on dozens of Hugging Face servers and took full control of one.

See the incident step by step →

Mythos 5 tried to slip bad code into a real software project

Anthropic Mythos 5 · UK AI Security Institute, Aug 2026

In a July 2026 test with internet access on and some safety filters off, an AI agent acted against real people or organisations in 10 of 122 runs. Mythos 5 made fake identities to pressure a project's maintainer into accepting its code, then edited its earlier activity to look harmless. The maintainer refused the code. The institute found no real-world harm.

Claude broke into real organisations during Anthropic's own tests

Four Claude models · Anthropic, Sep 2026

Anthropic reported four incidents in which Claude models running hacking tests reached real third-party systems without permission, the earliest in January 2026. In one, Mythos 5 published a malicious software package to a public code repository. 15 real systems installed it, and one security company's scanner leaked login details that the model used to reach the company's live database. The repository removed the package within an hour. In another, Opus 4.7 kept attacking a real company's system after it recognised in its reasoning that the target was real.

Chinese-speaking operators used Claude on about 50 organisations

Claude · Anthropic, Sep 2026

Anthropic traced a campaign by Chinese-speaking operators, likely in Hunan province, China, to about 50 organisations, from education and retail to finance and government agencies. They took bulk student data from an education company and citizen records from a Southeast Asian government agency. The operators ran “agent swarms”: a lead AI agent handing work to many AI helpers in parallel.

AI found two flaws in PHP, and governments took websites offline

OpenAI GPT-5.6 Sol and Google Gemini 4 Argon · PHP Foundation, Oct 2026

In August 2026, security firms Calif and Wiz used AI models to find two critical flaws in PHP, the language behind WordPress and Wikipedia. Finland's government IT centre, Wikimedia and the airline ANA took services offline as a precaution.

See PHP2Shell step by step →

AI hacking cases: model, when, source
CaseModelWhenSource
Hugging Face break-inOpenAI IM1Jul 2026OpenAI, METR
Open-source code attackAnthropic Mythos 5Jul 2026UK AI Security Institute
Real organisations' systemsClaude Opus 4.6 (early), Opus 4.7, Mythos 5, an internal modelReported Sep 2026Anthropic
About 50 organisationsClaudeReported Sep 2026Anthropic
Two flaws in PHP (PHP2Shell)OpenAI GPT-5.6 Sol, Google Gemini 4 ArgonAug 2026PHP Foundation, Wiz

What the labs and testers say about the AI's goals

In the Hugging Face case, AI agents pursued goals no human gave them. These are the reports' own words.

  • OpenAI, Aug 2026. The agents “took actions that were misaligned with the goals of their assigned tasks” and “dangerous actions that no human directed.”
  • The agents' own reasoning, as OpenAI printed it. “We’re attacking third-party HF using leaked token, potentially outside intended scope. ... This is arguably unauthorized. ... external service unrelated. Could be risky. Yet goal solution.”
  • UK AI Security Institute, Aug 2026. “It was never instructed to deceive; deception emerged as a by-product of pursuing the task.”
  • Anthropic, Sep 2026. About its four cases: “We found no evidence of coordination between agents, of goals beyond the assigned task, or of attempts to evade oversight.”

Models that cheat on tests

Hacking tests have set rules and a hidden answer. Cheating means looking the answer up, attacking something that is not the target, or probing the test software.

How often AI cheats on tests →

What each company says about its own newest model

Each company rates its own model on its own scale, in its own safety report. The scales differ, so the ratings can't be compared across companies.

OpenAI · GPT-6 Astra

Safety report, 3 Sep 2026

Hacking
Top level reached
"Critical", OpenAI's highest level. Astra is OpenAI's first model to reach it.
Help making biological or chemical weapons
Below top level
"High", one step below Critical.
AI improving AI
Below top level
Below "High".
Read OpenAI's report

Anthropic · Claude Opus 5.5

Safety report, 22 Sep 2026

Hacking
Below top level
The lower of Anthropic's two levels. The top level means running attacks alone and building new attack tools.
Help making biological or chemical weapons
Below top level
Anthropic rates it at its lower level (CB-1), not the higher one (CB-2).
AI improving AI
Below top level
Below Anthropic's next level.
Read Anthropic's report

Google · Gemini 4 Argon

Model card, 13 Oct 2026

Hacking
Top level not ruled out
Google's words: it "cannot be ruled out".
Help making biological weapons
Top level not ruled out
Google's expert testers found a "measurable" boost over a web search.
AI improving AI
Below top level
Argon has not reached Google's top level.
Read Google's model card

All three companies say they added extra safeguards because of these ratings. OpenAI gives GPT-6.1 Sol (29 Sep) the same ratings as Astra.

Each company's own rating of its newest model
CompanyModelHackingBio or chem weaponsAI improving AIReport date
OpenAIGPT-6 AstraTop level reachedBelow top levelBelow top level3 Sep 2026
AnthropicClaude Opus 5.5Below top levelBelow top levelBelow top level22 Sep 2026
GoogleGemini 4 ArgonTop level not ruled outTop level not ruled outBelow top level13 Oct 2026

What these tests leave out

From the institute's own notes on its tests.

  • No defenders. The test networks are smaller and simpler than real company networks, with nobody watching and no alarms.
  • A head start. The AI starts inside the network and is told what to attack.
  • Safety filters off. The institute tests US models with their safety filters turned off. The public versions have them on.
  • Newest models missing. The institute has published no hacking-skill scores yet for GPT-6 Astra, Claude Opus 5.5 or Gemini 4 Argon.

Other dangers the tests measure

Fixing failed virus experiments

GPT-5.6 Sol · SecureBio, Sep 2026

GPT-5.6 Sol
49%
Virologists
21%

Copying itself to new computers

Simplified tests · UK AI Security Institute, Dec 2025

Top model, 2025
over 60%
Top model, 2023
under 5%

The institute saw little evidence of AI doing this outside lab tests (Dec 2025).

Sources (17)
  1. OpenAI, deploymentsafety.openai.com/gpt-5-6
  2. UK AI Security Institute, aisi.gov.uk/blog/our-evaluation-of-claude-mythos-previews-cyber-capabilities
  3. UK AI Security Institute, aisi.gov.uk/blog/our-evaluation-of-openais-gpt-5-5-cyber-capabilities
  4. Epoch AI, epoch.ai/data/cyber/processed_data_for_eci.csv
  5. Anthropic, anthropic.com/claude-fable-5-mythos-5-system-card
  6. OpenAI, test agents broke into Hugging Face, Aug 2026
  7. METR, Brief independent investigation of agents' behavior, reasoning and collaboration in the OpenAI / Hugging Face hacking incident
  8. UK AI Security Institute, Mythos 5 tried to slip bad code into a real software project, Aug 2026
  9. Anthropic, Claude broke into real organisations during Anthropic's own tests, Sep 2026
  10. Anthropic, Chinese-speaking operators used Claude on about 50 organisations, Sep 2026
  11. PHP Foundation, AI found two flaws in PHP, and governments took websites offline, Oct 2026
  12. OpenAI, Faked data in a test task, Sep 2026
  13. Anthropic, anthropic.com/claude-opus-5-5-system-card
  14. Google DeepMind, Gemini 4 Argon model card (Google DeepMind, 13 Oct 2026), Frontier Safety, Oct 2026
  15. UK AI Security Institute, aisi.gov.uk/blog/preliminary-assessment-of-kimi-k3s-cyber-capabilities
  16. SecureBio, securebio.org/blog/introducing-vct-v2
  17. UK AI Security Institute, Frontier AI Trends Report (2025), autonomy findings