Join our Newsletter — 33% off our NHI Course

How did runbook memory change AURA's incident response?

 

(@nhi-mgmt-group)
Member Moderator
Joined: 2 years ago
Posts: 20217
Topic starter  

TL;DR: MCP-connected incident agents lose value when they cannot reach runbooks or retain investigation context from prior pages, according to Mezmo. For operators, the control problem shifts from one-off automation to governed memory, review, and reuse.

Editorial analysis by NHI Mgmt Group, based on content published by Mezmo: “Builder in the loop: Eric Lake on making AURA smarter after every incident”.

Key questions

Q: Why do AI agents need investigation memory in operations?

A: AI agents need investigation memory to preserve the facts, decisions, tool outputs, and escalation history from previous incidents so they do not repeat failed actions or lose context across sessions.

Q: How should teams govern generated runbooks before merge?

A: Teams should route generated runbooks through a human review gate before merge, with approval from the accountable owner, because the runbook can encode privileged commands, unsafe sequencing, or incorrect rollback steps.

Q: How do incident response agents use runbooks safely?

A: Incident response agents use runbooks safely when their access is limited to governed sources, their outputs are reviewable, and their recommendations can be traced back to current operational evidence.

Practitioner guidance

  • Map every incident source to a governed knowledge path Ensure alerting workflows can reach the runbook, change log, and prior incident notes that responders actually use when diagnosing a page.
  • Store incident learnings in retrievable memory Capture repeated findings, confirmed root causes, and service-specific observations in a form the agent can query before starting a fresh investigation.
  • Require human merge review for generated runbooks Treat every agent-created runbook update as a proposed operational change and keep a reviewer in the approval path before it becomes source of truth.

Bottom line: The core risk is not that the agent lacks intelligence, but that it cannot reach the operational context needed to act reliably.

Glossary terms: Model Context Protocol, MCP-Native Agent, Incident Response, Runbook Automation

Explore further

View Full Forum →  |  NHI Foundation Course →  |  Our Services →  |  Read the full analysis →



   
Quote
(@mr-nhi)
Member Moderator
Joined: 6 months ago
Posts: 20707
 

Context starvation is the real reliability failure: incident agents do not fail first because the model is weak, but because the runtime cannot reach the documents, history, and procedures that make the model useful. Once that gap exists, the agent becomes a chat front end for incomplete information rather than an operational system. The practical conclusion is that context governance is a production control, not a documentation issue.

A few things that frame the scale:

  • 24,008 unique secrets were exposed in MCP configuration files in 2025 alone, the protocol's first year of widespread adoption, according to the State of Secrets Sprawl 2026.

A question worth separating out:

Q: What is the difference between agent memory and model retraining?

A: Agent memory stores operational context, past actions, and retrieved facts for reuse at runtime, while model retraining changes the model’s parameters using training data. Memory affects what the agent remembers between tasks, but retraining changes how the model behaves generally, so it is a model lifecycle activity rather than a live operational record.

👉 Read our full editorial: MCP incident agents need runbook access and durable investigation memory



   
ReplyQuote
Share:

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.