TL;DR: Generative AI is expanding quickly across enterprise and scientific use cases, but adoption is still constrained by fine-tuning limits, bias testing challenges, and the need for trust, ethics, and transparency controls, according to Fiddler. The governance question is no longer whether generative AI will scale, but whether organisations can audit and constrain it fast enough to match deployment.
NHIMG editorial — based on content published by Fiddler: Innovating with Generative AI
Questions worth separating out
Q: How should organisations govern public-facing generative AI safely?
A: Use layered controls, not a single moderation rule.
Q: Why do generative AI systems need more than accuracy testing?
A: Accuracy testing only shows whether a model can produce plausible output, not whether it will produce biased, unsafe, or policy-breaking output in real use.
Q: What do teams get wrong when they rely on human-in-the-loop controls for AI?
A: Teams often treat human-in-the-loop as a compliance checkbox, but the real test is whether the organisation understood the risk and placed controls around irreversible actions.
Practitioner guidance
- Define human review thresholds for generative AI outputs Map which outputs require approval, which require escalation, and which can be auto-published.
- Build bias test suites across multiple issue categories Test for age, gender, ethnicity, disability, socioeconomic status, geopolitics, and other relevant categories before rollout.
- Require model cards and factsheets for production use Do not approve deployment unless the team can show training limitations, test coverage, known failure modes, and intended use cases in written form.
What's in the full article
Fiddler's full blog post covers the panel detail this analysis intentionally leaves for the source:
- Panel discussion context with the speakers and the specific enterprise use cases they described.
- The examples behind the panel's comments on synthetic data, guarded chatbots, and personalised content generation.
- The detailed reasoning behind the bias, trust, and transparency themes raised during the session.
- The original wording and nuances from the panelists that are useful if you are comparing implementation approaches.
👉 Read Fiddler's summary of generative AI takeaways and governance challenges →
Generative AI governance gaps: are human-in-the-loop controls enough?
Explore further
Generative AI governance is becoming an identity-adjacent control problem, not just a model-quality problem. When a model is used to generate content, decisions, or recommendations inside enterprise workflows, the real risk is not only output quality. It is whether the system can access the right data, stay within authorised boundaries, and leave an auditable trail. That puts access scope, data permissions, and accountability squarely into the governance design. Practitioners should treat generative AI as a control plane issue as much as a model-risk issue.
A question worth separating out:
Q: How can organisations tell whether AI governance is actually working?
A: Organisations can tell AI governance is working when they can inventory every agent, explain its purpose, show who owns it, and prove that permissions are tightly scoped. If those four things are missing, the programme has policy language but not operational control. Auditors will notice the gap quickly.
👉 Read our full editorial: Generative AI governance still depends on human-in-the-loop controls