TL;DR: AI chargeback breaks down when token use, model calls, and latency tiers are not captured at the gateway and attributed by team or application, according to Kong. The governance challenge is not billing alone, but building reliable usage identity so AI consumption can be measured, explained, and acted on.
Editorial analysis by NHI Mgmt Group, based on content published by Kong: “# Building AI Chargeback: From Metering to Billing”.
Key questions
Q: How should teams meter AI usage for chargeback at the gateway layer?
A: Teams should meter AI traffic at the gateway so token consumption, model calls, request volume, and latency tiers are captured before they fragment across applications.
Q: Why does AI chargeback fail when usage is not attributed to teams or applications?
A: Without request-level attribution, AI consumption can be measured but not owned.
Practitioner guidance
- Instrument the AI gateway for usage telemetry Capture token consumption, model calls, request volume, and latency tiers at the gateway so the metering source is consistent across applications.
- Bind each request to an owner Require team, product, tenant, or application identifiers in the API layer so every AI request can be mapped to a cost centre without manual reconstruction.
- Separate showback from chargeback Use the same metering data for both reporting models, but move to internal billing only after the attribution logic has been validated and agreed by Finance.
Bottom line: AI chargeback breaks when consumption is inferred after the fact instead of captured where the request happens.
Explore further
View Full Forum → | NHI Foundation Course → | Our Services → | Read the full analysis →
AI chargeback is an identity governance problem before it is a finance problem. The webinar correctly frames token consumption as infrastructure plumbing, but the deeper issue is that AI usage must be tied to accountable non-human or autonomous identities before any cost model is trustworthy. If the organisation cannot identify which workload, agent, or team is generating a request, it cannot govern spend, privilege, or accountability. The practitioner implication is that usage attribution must be built into identity and access design, not added after billing fails.
A few things that frame the scale:
- 44% of NHI tokens are exposed in the wild, being sent or stored over platforms like Teams, Jira tickets, Confluence pages, and code commits, according to The 2025 State of NHIs and Secrets in Cybersecurity.
- 62% of all secrets are duplicated and stored in multiple locations, causing unnecessary redundancy and increasing the risk of accidental exposure.
A question worth separating out:
Q: What is the difference between chargeback and showback for AI platforms?
A: Chargeback bills internal consumers for their AI usage, while showback only reports it back to them. Showback is usually the maturity step before chargeback because it exposes demand, cost, and behaviour without forcing immediate financial transfer. That makes it easier to correct ownership and usage patterns first.
👉 Read our full editorial: AI chargeback needs gateway-level metering, not spreadsheet estimates
AI chargeback is an identity governance problem before it is a finance problem. The webinar correctly frames token consumption as infrastructure plumbing, but the deeper issue is that AI usage must be tied to accountable non-human or autonomous identities before any cost model is trustworthy. If the organisation cannot identify which workload, agent, or team is generating a request, it cannot govern spend, privilege, or accountability. The practitioner implication is that usage attribution must be built into identity and access design, not added after billing fails.
A few things that frame the scale:
- 44% of NHI tokens are exposed in the wild, being sent or stored over platforms like Teams, Jira tickets, Confluence pages, and code commits, according to The 2025 State of NHIs and Secrets in Cybersecurity.
- 62% of all secrets are duplicated and stored in multiple locations, causing unnecessary redundancy and increasing the risk of accidental exposure.
A question worth separating out:
Q: What is the difference between chargeback and showback for AI platforms?
A: Chargeback bills internal consumers for their AI usage, while showback only reports it back to them. Showback is usually the maturity step before chargeback because it exposes demand, cost, and behaviour without forcing immediate financial transfer. That makes it easier to correct ownership and usage patterns first.
👉 Read our full editorial: AI chargeback needs gateway-level metering, not spreadsheet estimates
AI chargeback is becoming an identity problem for workloads, not a finance spreadsheet exercise. When AI usage is attributed at the gateway, the organisation is really creating a usage identity for each request path. That shifts accountability from end-of-month estimates to runtime measurement and gives platform teams a control point they can actually govern.
A question worth separating out:
Q: When should organisations use showback instead of internal AI chargeback?
A: Showback is the better starting point when attribution is still being validated or when finance owners need visibility before billing. It lets teams test whether gateway metering and cost-centre mapping are accurate enough before money moves between business units.
👉 Read our full editorial: AI chargeback needs gateway-level metering, not spreadsheet estimates