AWS Bedrock · Model provider
Can we use AWS Bedrock models and still control keys, cost and what is sent?
Yes. You add AWS Bedrock to the Katonic AI Gateway with your AWS region and credentials, and agents call its models through the gateway. The models run in your own AWS account, and prompts and responses go to Bedrock in that region. The gateway holds the credentials, decides which teams may call which model, applies rate limits and budgets, checks each turn against your guardrail profile and records usage and cost.
Where the model runs.
In your cloud account.
How it is connected
- 01Your AWS region. The address is built from it.
- 02AWS credentials. Calls are signed with AWS Signature Version 4.
In your own AWS account, in the region you name.
What leaves your environment
The prompt and the response.The prompt and the response go to AWS Bedrock in your account. Katonic controls which teams and models may do that, checks the turn against your guardrail profile and records it. In an install flagged as air-gapped, hosted providers start disabled.
Keys
Your key is kept encrypted and decrypted only for the call. It is not stored or cached in plain text.
Model access
A policy for each tenant and an entitlement for each team decide which models may be called.
Rate limits
Requests and tokens per minute, for each user, tenant and model.
Budgets
Checked before the call, at three levels: warn, soft and hard. A hard budget blocks the call.
Guardrails
The input and output of a chat turn are checked against your guardrail profile.
Failover
Health is tracked for each provider and model, with a circuit breaker. A call can move to the next member of its tier.
Cost and usage
Each call is priced when it is recorded, and usage and cost can be queried.
Who paid
Each usage record says whose credential paid for the call.
Air gap
In an install flagged as air-gapped, hosted providers start disabled.
A model you serve on your own GPUs keeps the prompt and the response on your infrastructure. The gateway does the same work in front of it.
Where do prompts go?
To AWS Bedrock in your own account and region. They do not go to Katonic.
Who holds the AWS credentials?
You do. They are kept encrypted in your Katonic install and decrypted only for the call.
Can we set a budget for Bedrock alone?
Budgets are set for users, teams and tenants and checked before each call, whichever provider serves it.