Financial services, government, telecom, technology
Token factory for Group IT
How does Group IT give departments governed access to AI models with budgets and chargeback?
A token factory lets Group IT offer every department governed access to AI models on one GPU estate. Each department has a budget, a cap and a monthly statement. GPU capacity is shared and charged back, and every model call passes through one audited gateway with guardrails applied.
At a glance
| Industry | Financial services, government, telecom, technology |
|---|---|
| Who it is for | CIO, Head of Group IT, Head of AI platform, FinOps lead, CISO |
| Data that stays in place | Prompts, responses, usage records and audit logs |
| Runs air-gapped | Yes |
| Unit of charge | Tokens per department, with budgets and caps |
| Infrastructure | HPE Private Cloud AI, or HPE GPU servers in an HPE AI Factory design |
The problem
Enterprises that buy AI infrastructure end up with scattered model endpoints, personal API keys and no view of which department uses which model at what cost.
Group IT cannot allocate GPU capacity, cap spend, apply guardrails or charge back.
How it works
- Group IT registers the models it serves in the Katonic AI Gateway.
- Each department gets its own access, a budget and a cap.
- Every model call goes through the gateway, where guardrails and audit logging apply.
- Usage is metered per department as it happens.
- Each department receives a monthly statement, and Group IT charges the cost back.
On HPE infrastructure
On HPE Private Cloud AI
HPE Private Cloud AI is HPE's turnkey private AI system, co-engineered with NVIDIA. Katonic AI is a partner in the HPE Unleash AI program. On Private Cloud AI, Katonic connects to the models the system serves and adds the agent platform on top. The gateway sits in front of the models the system serves and meters each department's use of them.
On HPE GPU servers
Customers who build their own estate on HPE GPU servers, as part of an HPE AI Factory design, get compute, storage and networking from HPE. Katonic supplies the software layer above the hardware: open-weight models served on the customer's GPUs, the AI gateway, the agent platform and governance. The gateway shares the GPU estate between departments and turns raw GPU capacity into a metered internal service.
More on both routes: Katonic AI on HPE.
Where it stands
Available in the Katonic platform today.
Questions and answers
What is a token factory?
An internal service that turns GPU capacity into governed, metered access to AI models, so departments consume tokens against a budget instead of running their own endpoints.
Can a department exceed its budget?
Not past its cap. Group IT sets a budget and a cap for each department, and the gateway enforces them.
How is chargeback calculated?
From the usage the gateway meters for each department, reported in a monthly statement.
Does this replace personal API keys?
Yes. Access goes through the gateway, so every call is attributed, logged and subject to guardrails.