Skip to main content

Limits

The numbers the gateway works within, in one place.

Requests​

LimitValueWhat happens past it
Time to the first byte of the provider's answer60 seconds504 upstream_timeout. Not retried on another destination.
Whole request, streaming included600 secondsThe request is cut off.
Where model must appear in the bodyWithin the first 256 KiB400 model_not_determinable. Send the name in X-Onehouse-Model instead.
Request body that can be retried on another destination8 MiBA larger body goes to one destination only.
Attempts per request2The first destination, then at most one more. See Routing and failover.
Skip after a provider's 429Its Retry-After, or 10 seconds; at most 60 secondsThe destination is skipped for that model.

Tokens​

TokenLasts
A person's gateway token7 days
A service principal's gateway token5 minutes

See Sign-in and tokens.

Names and setup​

LimitValue
Alias nameLowercase letters, digits, dots, dashes and underscores; up to 64 characters
Model descriptionUp to 512 characters
Models published at once from Add a model100
MCP server nameLowercase letters, digits and hyphens; up to 64 characters
MCP server request timeout1 to 300 seconds
MCP transportStreamable HTTP only
People in Revoked user access10,000

Usage​

LimitValue
How long usage is kept30 days
Rows in each Usage table100. Totals still count every row.
Callers attributed by name500 distinct callers, or 10,000 caller-and-model pairs. Past that, usage is folded into Beyond attribution cap.

See Usage.

By cloud​

CapabilityAWSGoogle Cloud
AWS Bedrock as a providerYesNo
Direct credential (a key Onehouse stores) for providers and MCP serversYesNo
OAuth MCP serversYesNo
Onehouse MCP serverYesNo