AI Gateway adds unified fast mode support
AI Gateway now offers a unified fast mode abstraction that allows you to request lower latency or higher throughput across multiple models by setting speed to 'fast'. This feature automatically falls back to standard speed when fast tier isn't available, and is now in beta.
AI Gateway has a unified fast mode abstraction, now in beta.
You can now request the same way for every model on AI Gateway. Set speed to , and the gateway serves the fast tier when it's available and falls back to standard speed when it isn't.fast modefast
Fast mode trades a higher per-token cost for lower latency or higher throughput. You get it wherever it is available, without pinning a provider or wiring anything up yourself.
Set to under to upgrade the model to its fast serving path when one is routable:speedfastproviderOptions.gateway
You can also address a fast variant directly with its fast slug, such as , which is the same as setting on the base model.anthropic/claude-opus-5-fastspeed: 'fast'
Use the option when you want to stay on the base model ID and fall back to standard speed. Use a fast slug when you want to name the fast variant directly, for example in a fallback list. The option works across every AI Gateway API format.speedgateway.modelsspeed
Fast mode is available for a growing set of models. Find them in the with a lightning bolt next to the slug. Requesting fast mode on a model with no fast tier has no effect, and the request runs at standard speed. Fast variants of models are usually more expensive than the base model: check for more details.models listpricing
In Claude Code, toggle fast mode with for Anthropic Opus models after . For other agents, select a fast slug in your model configuration, such as ./fastanthropic/claude-opus-5-fastsetup
For more information about fast mode, read the .documentation
Requesting fast mode
Using fast mode in coding agents
Source: original entry ↗