Subscribe to the Non-Human & AI Identity Journal

Who is accountable when an agent-created repository triggers unsandboxed execution?

Accountability usually sits with the team that owns the trust boundary, not the agent itself. That means platform, developer productivity, and security owners must agree on which workspace artifacts are trusted, who can promote them, and what confirmation is required before helper execution. The control failure is governance, not just configuration.

Why This Matters for Security Teams

When an agent-created repository can trigger unsandboxed execution, the issue is not just a bad automation choice. It is a governance failure at the trust boundary between generated content, source control, and runtime execution. The practical question is who had authority to define that boundary, approve promotion, and require isolation before code or helper logic ran. That is why accountability must be assigned to the owning team, not the agent.

This aligns closely with the control themes in the OWASP Top 10 for Agentic Applications 2026 and the NIST AI Risk Management Framework, both of which emphasise lifecycle accountability, oversight, and validation of AI outputs before they are trusted operationally. The same logic applies when a repository is generated by an agent, then consumed by build systems, CI jobs, or developer tooling without review.

The risk is often underestimated because the repository may look like ordinary engineering output. In reality, it can carry prompt-injected instructions, malicious dependencies, or unsafe helper scripts that bypass normal scrutiny. In practice, many security teams encounter this only after an unsandboxed job has already executed attacker-controlled logic, rather than through intentional trust design.

How It Works in Practice

Accountability should be mapped to the organisation that owns each control point: the platform team for execution isolation, the developer productivity team for repo and pipeline defaults, and the security team for policy enforcement and monitoring. The agent may create the artifact, but it cannot be the accountable subject because it has no legal, operational, or technical duty of care.

A workable implementation usually separates creation, review, and execution. The generated repository should land in a restricted workspace, be scanned for risky files and scripts, and remain non-executable until a human or policy engine explicitly promotes it. Unsandboxed execution should be treated as an exception, not the normal path.

  • Require explicit trust labels for agent-generated repositories before any pipeline can consume them.
  • Block direct execution of helper scripts, build hooks, and install steps until review completes.
  • Use isolated runners or ephemeral sandboxes for first-run validation.
  • Log the approving identity, policy decision, and repository lineage for auditability.

For AI-specific threat analysis, MITRE ATLAS adversarial AI threat matrix and the CSA MAESTRO agentic AI threat modeling framework help teams think about how injected instructions, poisoned outputs, or tool misuse can flow into execution paths. Security controls should also align with NIST SP 800-53 Rev 5 Security and Privacy Controls for configuration management, access control, and audit logging. These controls tend to break down when CI/CD systems allow inherited trust from the agent workspace into production runners because lineage is not preserved end to end.

Common Variations and Edge Cases

Tighter sandboxing often increases delivery friction, requiring organisations to balance speed against assurance. That tradeoff is real, especially in teams using autonomous coding agents, shared build infrastructure, or rapid prototype workflows where every extra approval feels expensive.

Best practice is evolving for agentic repositories, and there is no universal standard for this yet. Some organisations assign accountability to the product owner, others to the platform operator, and mature environments usually split responsibility by control layer. The key is that someone must own the policy decision to trust or reject agent-generated artifacts.

Edge cases matter. If the repository is generated only for local experimentation, the required controls may be lighter, but the moment it touches shared infrastructure or privileged credentials, the risk profile changes. If the agent writes infrastructure code, policy-as-code, or deployment hooks, then unsandboxed execution can become a supply-chain issue rather than a simple developer convenience problem.

This is where the broader agentic AI guidance from OWASP Agentic AI Top 10 is useful: trust should be explicit, provenance should be visible, and human approval should be meaningful. In high-regulation environments, teams should also treat the decision as part of operational governance, not just secure coding hygiene, because responsibility for unsafe execution cannot be delegated to the model.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

OWASP Agentic AI Top 10 address the attack and risk surface, while NIST AI RMF, NIST CSF 2.0, NIST SP 800-63 and NIST AI 600-1 set the governance and control requirements practitioners need to meet.

Framework Control / Reference Relevance
OWASP Agentic AI Top 10 LLM03 Agent-created repos can smuggle unsafe instructions into execution paths.
NIST AI RMF GOVERN This is a governance and accountability problem, not a model-only issue.
NIST CSF 2.0 PR.AC-4 Unsandboxed execution often follows weak privilege and trust boundary design.
NIST SP 800-63 Human approval and identity proofing matter when promotion requires trusted action.
NIST AI 600-1 GenAI output must be validated before operational use in the pipeline.

Bind approvals to authenticated identities and preserve reviewer accountability.