Introducing the AI Gateway
Vercel's AI Gateway is now available for alpha testing, allowing developers to switch between ~100 AI models without managing multiple API keys or provider accounts. The Gateway handles authentication, usage tracking, and load balancing across providers to reduce costs and improve availability.
: This blog is outdated, please reference for the latest information or read the docs . The Vercel AI Gateway is now available for alpha testing.Notethis pagehere
Built on the , the Gateway lets you switch between ~100 AI models without needing to manage API keys, rate limits, or provider accounts. The Gateway handles authentication, usage tracking, and in the future, billing.AI SDK 5 alpha
Get started with and the , or continue reading to learn more.AI SDK 5Gateway
The current speed of AI development is fast and is .only getting faster
There's a new state-of-the-art model released almost every week. Frustratingly, this means developers have been locked into a specific provider or model API in their application code. We want to help developers ship fast and keep up with AI progress, without needing 10 different API keys and provider accounts.
Production AI applications often run into capacity issues or rate limiting due to high demand. Infrastructure providers move quickly to bring models online and keep up with this demand, but this can come at the expense of performance or availability.
The AI Gateway will allow you to load balance across providers, or fail over if a provider has downtime or degradation in performance. Model inference costs keep dropping and providers are competing on quality, performance, and price. The Gateway helps you quickly take advantage of these cost savings.
We're taking what we've learned scaling to millions of users, by quickly load balancing and switching between a mixture of providers, and turning that infrastructure into the AI Gateway.v0
We built the to create a common abstraction for AI model APIs across modalities like text, images, and audio.AI SDK
The AI SDK is free and open source, and works with any model or infrastructure provider. The AI Gateway is a separate Vercel product built of the AI SDK.on top
We're building these products with high cohesion, but loose coupling. The Gateway will take full advantage of AI SDK features like tool calling, function arguments, streaming, retries, attachments, and structured outputs.
During the AI Gateway alpha, usage is free with rate limits based on your Vercel plan tier. These rate limits are similar to the current .AI SDK Playground
We plan to support pay-as-you-go pricing when the Gateway reaches general availability. Model pricing will follow the provider's market rates, updated regularly. We are also planning to explore bring-your-own-key in the future.
We're shipping this in alpha to get your input and early feedback. to share your work and tell us what you want to see from the AI Gateway.Tag us on X
For more information, get started with our demo applications:
For model support and more usage examples, visit .ai-sdk.dev/model-library
Why we're building the AI Gateway
Integration with the AI SDK
Pricing
What's coming next
Start exploring AI Gateway
Load balancing and model failover
Pay-as-you-go billing
Bring-your-own-key support
Unified logging, usage tracking, and observability
OpenAI-compatible API
Source: original entry ↗
More from Vercel
Follow Vercel to get its new changes in your feed and email digest.
OpenAI Decisions API now available on AI Gateway
OpenAI's Decisions API is now accessible through Vercel's AI Gateway with an OpenAI-compatible endpoint, enabling decision models to answer typed questions and return probabilities, choices, and scores for routing, triage, and guardrails use cases. Support is available across the OpenAI SDK, AI SDK, HTTP API, and CLI with the latest versions.
Timestamp attributes now supported in Vercel Flags
Vercel Flags now supports timestamp attributes for entities, allowing you to create time-based targeting rules. Use this feature to run limited-time campaigns, show content between specific dates, or target users based on registration date.
Glyph Cluster now available in stealth on AI Gateway
Glyph Cluster, a reasoning model for coding and long-context analysis, is now available as a stealth model on Vercel's AI Gateway for Pro and Enterprise plan teams with purchased AI Gateway credits at no cost during the stealth period. The model supports function calling, streams responses, and can be accessed via AI SDK, OpenAI-compatible APIs, and coding agents.