Join our Newsletter — 33% off our NHI Course

What would it take for Gitar's multi agent system to stop bad posts?

 

(@nhi-mgmt-group)
Member Moderator
Joined: 2 years ago
Posts: 20217
Topic starter  

TL;DR: Developer-facing AI needs guardrails because the wrong message can erode trust faster than a factual error, Sonar says. Conversation-aware filtering decides whether a reply should be posted, rewritten or suppressed before noise, duplication or leakage reaches developers.

Editorial analysis by NHI Mgmt Group, based on content published by Sonar: “Guardrails for a Multi Agent System”.

Key questions

Q: Why do conversation-aware controls reduce noise better than isolated message checks?

A: Because a message’s meaning changes with thread state, reply history and workflow role.

Q: How can organisations tell whether guardrails are actually working?

A: Measure more than block counts.

Q: What breaks when AI systems are only protected by pre-release guardrails?

A: Static guardrails fail when the risk appears only after deployment, during live inference, tool use, and action execution.

Practitioner guidance

  • Define output acceptance policies Specify which message types may be posted, modified, dropped or suppressed in developer workflows, and require explicit handling for duplicates, internal references and off-thread replies.
  • Add conversation context to classification Feed thread history, recent comments and workflow state into the decision layer so that the system judges messages in context rather than as isolated text.
  • Instrument fail-open decisions Log every timeout, error and pass-through event so teams can see when imperfect messages are allowed through instead of silently dropped.

Bottom line: Developer-facing AI needs a guardrail layer because the wrong message, even when technically correct, can erode trust faster than a factual error.

Glossary terms: Guardrail Layering, Conversation-Aware Filtering, Fail-Open Behaviour, Structured Output Classification

Explore further

View Full Forum →  |  NHI Foundation Course →  |  Our Services →  |  Read the full analysis →


This topic was modified 1 week ago by NHI Mgmt Group

   
Quote
(@mr-nhi)
Member Moderator
Joined: 6 months ago
Posts: 20707
 

Developer-facing AI needs access governance, not only content moderation. Once an AI system can post into a workflow, it is making delivery decisions about information flow. That means the control question is who or what should receive the output, not just whether the output is syntactically correct. In practice, this is a governance layer over machine-mediated communication, which is increasingly relevant to agentic AI and NHI-adjacent workflows.

A question worth separating out:

Q: Should AI workflow controls fail open or fail closed when the decision layer errors?

A: It depends on the cost of silence versus the cost of a bad message. In developer workflows, fail-open can be defensible when losing real feedback is worse than posting imperfect output. The key is to make the choice explicit, log every fallback and define which message types may bypass the control.

👉 Read our full editorial: Why guardrails matter for AI systems that talk to developers



   
ReplyQuote
Share:

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.