TL;DR: AI-generated content entered official records in the Tromsø municipality case, according to Saidot, with 673 pages of chat logs showing what happened. Governance only works when review, logging, and permission changes are enforced inside the systems that use AI.
Editorial analysis by NHI Mgmt Group, based on content published by Saidot: “Beyond compliance: Building trust through AI governance and control”.
By the numbers:
- 673 pages of chat logs from Tromsø municipality became public in 2025 and exposed unverified AI-generated report content.
- The EU AI Act entered into force on 1 August, 2024, with governance rules for general-purpose AI models becoming applicable on 2 August, 2025.
Key questions
Q: Why do organisations need trigger-based governance for AI systems?
A: AI systems change after retraining, model updates, tool additions, and data changes, so a one-time approval quickly becomes stale.
Q: How do security teams know if AI governance is working?
A: Look for evidence that access decisions are reviewable, permissions are revocable, and exceptions are not becoming permanent.
Q: What breaks when AI governance exists on paper but not in enforcement?
A: Policy-only governance fails when teams cannot technically restrict access, log decisions, or revoke permissions in the systems AI actually uses.
Practitioner guidance
- Implement a governed AI inventory Track models, agents, tools, datasets, and third-party dependencies in one inventory so every AI use case has an owner, a risk rating, and a control status.
- Enforce human review checkpoints Block AI-generated outputs from progressing into reports, customer communications, or regulated workflows until a qualified reviewer explicitly approves them.
- Tie governance to change events Reassess AI systems when models are retrained, APIs change, plug-ins are added, or new data sources are introduced, because each change can alter risk.
Bottom line: The central risk is not that organisations use AI, but that they allow AI output to enter records and workflows without enforceable human oversight.
Glossary terms: AI Governance, Human-in-the-Loop Controls, Event-based Governance, AI Inventory
Explore further
View Full Forum → | NHI Foundation Course → | Our Services → | Read the full analysis →
AI governance debt is now a board-level risk: organisations that treat inventory as governance but fail to enforce controls are accumulating unresolved risk inside everyday workflows. The Tromsø case shows that the real failure is not model use, but the absence of technical guardrails that make oversight executable. Boards should treat AI control maturity as evidence of operational accountability, not as a policy exercise.
A few things that frame the scale:
- Only 37% of organisations had policies for managing AI or detecting shadow AI, according to IBM's 2025 Cost of a Data Breach Report.
A question worth separating out:
Q: Who should be accountable for AI-generated content that enters official records?
A: Accountability should sit with the business owner of the use case, the control owner for review and logging, and the governance function that sets risk thresholds. If AI-generated content is permitted into official records, someone must be responsible for the review step, the approval criteria, and the evidence trail. Shared ownership without clear control responsibility usually means nobody owns the risk.
👉 Read our full editorial: AI governance fails when controls cannot enforce human oversight