Join our Newsletter — 33% off our NHI Course

Notifications
Clear all

Slopsquatting and AI package hallucinations: are controls keeping up?


(@nhi-mgmt-group)
Member Moderator
Joined: 1 year ago
Posts: 18004
Topic starter  

TL;DR: AI models are now hallucinating package names with enough consistency to turn slopsquatting from a nuisance into a scalable supply chain attack, with 19.7% of recommended packages in a USENIX study found not to exist and 43% recurring on every identical prompt run, according to Xygeni. The real governance gap is that human review cannot protect workflows where agents can install dependencies before anyone verifies origin or intent.

NHIMG editorial — based on content published by Xygeni: slopsquatting evolution, AI package hallucinations, and agentic install risk

By the numbers:

Questions worth separating out

Q: What breaks when AI assistants recommend packages that do not exist?

A: The trust model breaks because existence in a registry is no longer a reliable proxy for legitimacy.

Q: Why do hallucinated package names create a bigger risk for autonomous agents than for developers?

A: Autonomous agents remove the human checkpoint between suggestion and execution.

Q: How should AppSec teams measure whether slopsquatting controls are working?

A: Measure how many AI-generated dependency suggestions are blocked before install, how many recurring hallucinated names are detected across repositories, and how quickly new fake package names are added to guardrails.

Practitioner guidance

  • Block AI-suggested dependencies by policy Require package origin verification and central approval for any dependency first seen in an AI-generated suggestion, especially where the name does not exist in approved registries or maintainers lists.
  • Detect recurring hallucinated package names Log dependency names proposed by assistants and agents, then compare them across repositories so repeated hallucinations can be denied before they spread through templates and shared prompts.
  • Constrain autonomous install permissions Separate package recommendation from package execution so agents can propose dependencies but cannot install them without policy checks, provenance validation, or human approval.

What's in the full article

Xygeni's full article covers the operational detail this post intentionally leaves for the source:

  • The step-by-step slopsquatting timeline from 2023 to 2026, including the named cases that show how the pattern changed.
  • The research details behind the USENIX study, including model-by-model hallucination behaviour and recurrence patterns.
  • The defensive logic behind Xygeni Shield's install-time blocking approach and how it fits into a developer workflow.
  • The article's examples of agent-driven installs and prompt-injection chaining that move the threat from suggestion to execution.

👉 Read Xygeni's analysis of slopsquatting evolution and AI package hallucinations →

Slopsquatting and AI package hallucinations: are controls keeping up?

Explore further

View Full Forum →  |  NHI Foundation Course →



   
Quote
(@mr-nhi)
Member Moderator
Joined: 3 months ago
Posts: 17593
 

Slopsquatting is now a software supply chain governance problem, not a prompt-quality issue. The article shows that hallucinated package names can be repeated, observed, and registered at scale. That means the control gap sits between AI recommendation and dependency trust, where conventional AppSec still assumes a human will notice the mismatch. Practitioners should treat AI-generated dependency suggestions as an external supply chain input that requires policy, validation, and telemetry.

A question worth separating out:

Q: Who is accountable when an AI agent or automation system installs a malicious dependency?

A: The accountable team is the one that granted autonomous execution without a policy boundary. If a bot or AI agent can install third-party code, the organisation has created a delegated trust chain and should govern it like any other privileged non-human identity. Accountability sits with platform owners, security governance, and the workflow owner together.

👉 Read our full editorial: Slopsquatting is becoming an autonomous supply chain risk



   
ReplyQuote
Share: