TL;DR: Google Threat Intelligence Group says it has documented the first known uses of Gemini in live malware attacks, alongside multiple AI-enabled malware families that can generate scripts, alter obfuscation, and support phishing, reconnaissance, and ransomware workflows during an attack, according to Swarmnetics. Static, rules-based defence is now competing with adversarial tooling that can adapt mid-execution.
At a glance
What this is: Swarmnetics says Google Threat Intelligence Group has documented the first known uses of Gemini in live malware attacks, marking a shift toward LLM-powered malware that can adapt during execution.
Why it matters: This matters because security teams now have to contend with malware that can change tactics mid-attack, which weakens the value of controls built mainly around known patterns and fixed behaviours.
Context
LLM-powered malware changes the security problem from detecting fixed malicious artefacts to handling adversarial systems that can generate or modify behaviour during the attack itself. That matters because many SOC and endpoint models still depend on signatures, repeatable patterns, and post-event correlation to identify threats.
The identity angle is indirect but real: attacker use of LLMs is increasingly tied to phishing, credential theft, and access abuse, while defenders also have to govern which AI systems can be called from operational environments. Where AI tools can participate in live attacks, governance has to cover both malware behaviour and the trust boundary around AI-assisted workflows.
Key questions
Q: What breaks when malware can adapt its commands in real time?
A: Static signatures, predictable kill-chain assumptions, and scripted response playbooks all become less reliable. If the payload can rewrite itself or generate new commands on demand, defenders lose the fixed artefacts they normally use for detection, triage, and containment.
Q: Why does LLM-guided malware increase detection risk after compromise?
A: Because the model gives the attacker a way to vary execution while keeping the same goal. That means traditional rules can miss the attack even when the host is actively enumerating files or sending data out, so defenders need layered telemetry and correlation.
Q: How do security teams know whether static detection is working well enough?
A: Look at what kinds of threats are caught before execution and what kinds only appear later in runtime telemetry. A healthy programme should show correlation between static alerts, behavioural detections, and containment outcomes. If most incidents are first seen after execution, the pre-execution layer is not covering the attack mix you face.
Q: Should AI governance and malware defence be managed together?
A: Yes. Once AI systems can be used inside live attack workflows, model access, abuse monitoring, and cyber detection become linked controls. Security teams should treat AI guardrails as part of the attack surface review, especially where models can generate code, scripts, or phishing content that influences real incidents.
Technical breakdown
How LLM-powered malware adapts mid-attack
LLM-powered malware does not need to behave like a traditional static payload. It can generate scripts, vary obfuscation, and choose the next action during execution based on what it sees in the environment. That makes the malware more like an adaptive decision system than a fixed executable. The important technical shift is that the attacker no longer has to precompute every branch of the operation. Instead, the model can be used as an on-demand reasoning layer that helps evade simple pattern matching, adjust phishing content, or change tactics when a defensive control blocks the original path.
Practical implication: Treat behavioural drift as a detection problem, not just a malware family problem.
Why static detection rules lose value against generative malware
Static rules work best when the attacker’s observable behaviour is repeatable. LLM-assisted malware breaks that assumption by creating varied outputs from the same malicious intent, including new text, code snippets, and obfuscation patterns. The result is a moving target that can still pursue the same objective while appearing different enough to evade narrow detections. This does not make controls useless, but it does reduce the protection value of signature-only approaches and simple allow or deny logic. Detection has to shift toward telemetry, sequence analysis, and behaviour that persists even when the malware changes its surface form.
Practical implication: Move more detection logic to behavioural indicators and execution context.
Where AI governance and malware defence now intersect
The article shows that AI governance is no longer separate from operational security. If LLMs can be used to assist live attacks, then guardrails, abuse monitoring, and access restrictions become part of cyber defence architecture, not just model safety. This is especially important where AI tools can be reached through general-purpose interfaces or used to generate code, reconnaissance, or phishing content. The governance issue is not only whether the model is safe in isolation, but whether it can be coerced into serving attacker workflows once exposed to real-world prompts and tool access.
Practical implication: Apply abuse-resistant controls to any AI capability that can influence live security workflows.
Threat narrative
Attacker objective: The objective is to improve attack speed, evasion, and scale by using LLM assistance to adapt malware behaviour during execution.
- Entry occurs through AI-enabled malware or assistant misuse that can be prompted to generate code, alter obfuscation, or support attacker workflows during a live operation.
- Credential or task access is then abused to drive phishing, reconnaissance, or ransomware support actions without requiring the attacker to manually script every step.
- The malware adapts in response to defensive measures, making the attack harder to block with fixed signatures or static playbooks.
- Impact is a more resilient intrusion chain that can sustain evasion, increase attacker throughput, and broaden the pool of less technical operators able to run advanced campaigns.
Breaches seen in the wild
- Meta Muse agent hijack 2026: An undocumented Muse setting let local malware hijack Meta's personal AI agent, steal its authentication material and abuse user access.
- LiteLLM PyPI package breach: LiteLLM PyPI supply chain attack, credentials stolen from users.
Read and download The State of NHI & AI Agent Breach Report 2026, covering 200+ breaches impacting Non-Human Identities including AI Agents.
NHI Mgmt Group analysis
Adaptive malware changes the defender’s unit of analysis. Security teams cannot rely on a static sample view when the payload can generate new content or alter its own execution path mid-attack. The more relevant control boundary becomes behaviour under pressure, not the original malware artefact. Practitioners should expect detection engineering to move toward runtime telemetry, not just IOC matching.
AI abuse is now a cyber control problem, not only a model-safety problem. The article shows that LLM guardrails and abuse controls are directly relevant to attack prevention because attackers are trying to coerce general-purpose models into assisting live operations. That makes access governance, prompt abuse monitoring, and output controls part of security architecture. The field needs to treat AI misuse as an operational threat surface, not a niche governance issue.
Static rules-based defence is entering a trust gap. The article’s core warning is that controls built around predictable attacker behaviour are losing ground to systems that can vary their tactics on demand. That creates a named problem we can call the adaptive execution gap: the distance between what a control expects and what a generative attacker can do in runtime. Practitioners should close that gap with behavioural detection and stricter AI usage governance.
The underground market effect matters as much as the technical one. When less skilled actors can borrow LLM-assisted tooling, attack volume can rise even before the tools become highly sophisticated. That means the risk is not limited to elite state actors, even if they are currently leading experimentation. Security leaders should plan for diffusion of capability, not only refinement of technique.
From our research library:
- AI-related credential leaks surged 81.5% year-over-year in 2025, with the surrounding AI infrastructure leaking 5x faster than core LLM providers, according to the State of Secrets Sprawl 2026.
- Read next: Agentic AI Security Guide
What this signals
Adaptive execution is becoming the new attacker advantage. When malware can rewrite scripts, vary obfuscation, and alter its own behaviour in response to blocking measures, the control objective shifts from blocking one payload to constraining a moving process. Security teams should expect more value from runtime telemetry and AI abuse monitoring than from pattern-only detection.
The AI governance boundary is now inside the attack path. Model access, plugin permissions, and output monitoring are no longer just AI programme concerns because the same interfaces can be used to support phishing, reconnaissance, and ransomware workflows. That means AI usage policy and cyber control design need to converge around the same runtime trust boundary.
AI-related credential leaks surged 81.5% year-over-year in 2025, with the surrounding AI infrastructure leaking 5x faster than core LLM providers, according to the State of Secrets Sprawl 2026. That reinforces the broader signal here: attacker capability is scaling faster than many organisations’ ability to govern the systems that can be abused to support it.
For practitioners
- Harden behaviour-based detection Prioritise telemetry that captures process chaining, abnormal script generation, and evolving obfuscation rather than relying mainly on fixed signatures.
- Restrict AI access paths Limit which AI assistants, plugins, and model endpoints can be invoked from operational environments, and review whether they can influence code or security workflows.
- Add abuse monitoring for AI outputs Inspect prompts, completions, and downstream usage for signs that a model is being used to support phishing, reconnaissance, or malware generation.
- Test response against adaptive payloads Use purple-team exercises that assume the attacker can rewrite scripts, rotate obfuscation, and change tactics after the first control fires.
Key takeaways
- LLM-assisted malware shifts the defender’s problem from recognising known malware to constraining behaviour that can change during execution.
- The practical risk is not only more sophisticated attackers, but more accessible attack tooling for lower-skill operators.
- Behavioural telemetry, AI abuse controls, and runtime monitoring matter more when the payload can rewrite its own path.
Standards & Framework Alignment
This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.
MITRE ATT&CK and OWASP Agentic AI Top 10 address the attack and risk surface, while NIST AI RMF and NIST CSF 2.0 set the governance and control requirements practitioners need to meet.
| Framework | Control / Reference | Relevance |
|---|---|---|
| NIST AI RMF | MANAGE — AI Risk Management | AI-assisted malware turns model use into an operational risk that needs governance and monitoring. |
| Recommendation — Manage model abuse risk with access limits, output monitoring, and escalation controls for live operations. | ||
| MITRE ATT&CK | TA0002;TA0006;TA0040 — Execution; Credential Access; Impact | The article describes adaptive malware behaviour across execution, access, and impact stages. |
| Recommendation — Map adaptive malware behaviours to ATT&CK tactics and tune detections for execution, credential abuse, and impact. | ||
| NIST CSF 2.0 | DE.CM-01 — Network and System Monitoring | Behavioural detection and telemetry are central defensive responses in the article. |
| PR.AA-05 — Access Permissions, Entitlements and Authorizations | The article’s identity angle includes controlling which AI systems can be invoked from operational environments. | |
| Recommendation — Expand monitoring to capture changing malware behaviour and unusual execution patterns in real time. Limit AI tool access and entitlements to reduce the chance of model-assisted abuse in production workflows. | ||
| OWASP Agentic AI Top 10 | ASI03 — Identity & Privilege Abuse | The article’s AI misuse theme overlaps with privilege and access misuse in agent-like systems. |
| Recommendation — Constrain identity and privilege paths so AI-capable tooling cannot be repurposed inside attacker workflows. | ||
Key terms
- Adaptive malware: Malware that changes its behaviour in response to the environment instead of following one fixed sequence of actions. It can adjust obfuscation, timing, or commands based on defensive signals, which reduces the value of signatures and increases the need for behavioural correlation.
- LLM-powered malware: Malware that uses a large language model during an attack to generate code, rewrite text, alter obfuscation, or adapt tactics. The model does not replace the attacker, but it can increase speed, variation, and resilience while the intrusion is underway.
- Behavioral Detection: A monitoring approach that looks for unusual activity rather than relying only on static inventories. For SaaS integrations, it detects drift in token use, data movement, timing, and endpoint behavior so teams can spot compromise, misuse, or automation that no longer matches its expected pattern.
- AI Abuse Monitoring: AI abuse monitoring is the practice of detecting when model access is being used to bypass guardrails, automate harmful tasks, or chain outputs into operational misuse. Effective monitoring combines identity signals, prompt patterns, and API telemetry rather than relying on output filtering alone.
Deepen your knowledge
NHI Foundation Level course, the industry's only accredited NHI security programme, covers NHI governance, agentic AI identity, machine identity security, IAM, human identity, identity lifecycle, and secrets management. It helps practitioners connect identity controls to the wider security programmes they operate across cloud, AI, and infrastructure.
Published by the NHIMG editorial team on July 14, 2026.
Updated on October 13, 2026.
NHI Mgmt Group, the independent authority on Non-Human Identity, IAM, and Agentic AI security. nhimg.org