Join our Newsletter — 33% off our NHI Course

Notifications
Clear all

AI factory engineering: what it means for security and delivery control


(@nhi-mgmt-group)
Member Moderator
Joined: 1 year ago
Posts: 17031
Topic starter  

TL;DR: Field reports from San Francisco suggest that AI agent adoption is shifting from prompt quality to harness engineering, with orchestration, verification, isolation, and permissions now determining whether teams ship safely, according to Escape. The governance lesson is that the control surface has moved from model choice to runtime structure, and that changes how identity, access, and review need to work.

NHIMG editorial — based on content published by Escape: a field report on AI agents, harness engineering, and production workflows

By the numbers:

Questions worth separating out

Q: How should security teams govern AI agents that can choose tools at runtime?

A: Security teams should govern runtime agent choice as an access event, not as a simple application action.

Q: Why do AI agents complicate access governance more than ordinary automation?

A: AI agents complicate access governance because they can branch at runtime, wait on external services, and continue later with the same operational context.

Q: How do you know if agent authentication is actually working?

A: Agent authentication is working when each agent has a unique identity, token scope matches the approved task, actions are fully attributable, and revocation stops further activity immediately.

Practitioner guidance

  • Define agent task classes and permission scopes Separate exploratory, code-changing, testing, and deployment tasks, then bind each class to the minimum tool and repo access needed.
  • Use isolated workspaces for parallel agent runs Run agents in worktrees or sandboxes with separate runtimes, unique ports, and no shared local state so one task cannot contaminate another.
  • Make verification mandatory before merge Require automated tests, static checks, and human approval before any agent-generated change can progress beyond a candidate state.

What's in the full article

Escape's full field report covers the operational detail this post intentionally leaves for the source:

  • Conversations and examples from founders, CTOs, CPOs, and engineering leaders that show how teams are actually deploying agents in production.
  • The seven-layer AI factory architecture with workflow examples for intent, execution, verification, isolation, and feedback.
  • Tooling references and implementation patterns for harness engineering, including practical workspace and review setups.
  • The author's own repository of references and working notes that informed the framework choices and predictions.

👉 Read Escape's field report on AI factory engineering and agent workflows →

AI factory engineering: what it means for security and delivery control?

Explore further

View Full Forum →  |  NHI Foundation Course →



   
Quote
(@mr-nhi)
Member Moderator
Joined: 3 months ago
Posts: 16618
 

Harness engineering is becoming the new identity boundary. The article shows that production AI systems are no longer governed by prompt quality alone. When the model can act across tools, the real control question is whether the harness constrains permissions, review, and context well enough to keep the system inside intended boundaries. For identity teams, that makes workload identity, approval flows, and secret scoping part of the agent design itself, not a downstream control.

A question worth separating out:

Q: Who is accountable when an AI agent accesses sensitive data it was not meant to use?

A: Accountability sits with the team that approved the agent, its connectors, and its policy boundaries, not with the runtime behaviour alone. Organisations need ownership for intent, permissions, monitoring, and validation so they can prove whether the agent stayed inside its approved purpose. Without that, audit and regulatory response become retrospective guesswork.

👉 Read our full editorial: AI factory engineering is replacing the editor as the control point



   
ReplyQuote
Share: