TL;DR: Prompt structure can sharply change AI reasoning quality, and even gibberish-heavy prompts may improve some puzzle answers, according to Mindgard. AI assurance has to test for stability under varied prompts, because fluent explanations can hide brittle behaviour.
Editorial analysis by NHI Mgmt Group, based on content published by Mindgard: “The riddles ChatGPT-5.2 can’t solve without Chain of Babble”.
Key questions
Q: Why do human-style reasoning prompts sometimes make LLM answers worse?
A: Because forcing a model into a human-like reasoning narrative can change the search path it uses to produce an answer.
Q: What signs show that an AI system is too brittle for operational use?
A: Frequent answer flips across similar prompts, confident but incorrect explanations, and large performance gaps between clean benchmark tasks and real user input are all signs of brittleness.
Q: How should teams test whether an AI model is really reasoning or just sounding convincing?
A: Test the same task across multiple prompt styles, hidden variants and repeated runs, then compare accuracy rather than explanation quality alone.
Practitioner guidance
- Run prompt-variation testing Evaluate the same model with structured reasoning prompts, terse prompts and non-standard prompts to see where answers change materially.
- Score explanation quality separately Measure answer accuracy independently from explanation coherence so fluent but wrong rationales do not pass validation.
- Add adversarial prompt cases to assurance Include prompt perturbation, ambiguity and distraction patterns in AI red teaming so brittle behaviour appears before production users find it.
Bottom line: The article shows that AI reasoning quality can shift sharply with prompt structure, which means coherent explanations are not proof of correctness.
Glossary terms: Chain Of Babble, Chain Of Thought, Prompt Sensitivity, AI assurance
Explore further
View Full Forum → | NHI Foundation Course → | Our Services → | Read the full analysis →
Explainability is not a control, it is a variable. The article's core lesson is that models can look more rational while becoming less accurate. That is a governance problem, not a prompt-engineering quirk, because teams often treat readable reasoning as evidence of trustworthiness. In AI assurance, the control objective is behavioural reliability under variation, not narrative quality. Practitioners should separate explanation from validation and test outputs directly.
A question worth separating out:
Q: How should organisations govern AI systems that cannot verify themselves?
A: They should treat self-checks as advisory only and require an external validation layer for any output that affects security, access, or operational decisions. That usually means separate evaluation pipelines, human escalation for exceptions, and logging that preserves the evidence used to approve a decision. The goal is to prevent the model from becoming its own judge.
👉 Read our full editorial: Chain of babble exposes brittle AI reasoning and weak governance