Routing rules now available on AI Gateway
AI Gateway now supports routing rules that let you control which models your team can use at the gateway level without code changes. You can create rewrite rules to transparently swap models or deny rules to block specific models, allowing instant rerouting when models go down or get retired.
now supports .Vercel AI Gatewayrouting rules
Routing rules are firewall-style rules that control which models your team can use, applied at the gateway level instead of in your application code.
When a model goes down or gets retired, you usually have to ship a code change to move off it. With routing rules, you push one rule and every request reroutes instantly. There are two types:
Rules apply to every request made with your team's AI Gateway credentials. You manage them with the .Vercel CLI
Create a rewrite with a source and a destination model. The Gateway swaps in the destination transparently, so your application keeps requesting the source model:
Create a deny rule to block a model. Requests for it return a :403
Rules only change which model serves a request. Everything else you’ve configured still applies to the destination model, including:
Routing rules are in beta. For more information, read the .routing rules docs
Type | What it does | Use it to |
Rewrite | Serves a request for one model using another | Keep traffic flowing when a model is unavailable, migrate off a retired model, standardize on one model, or route an expensive model to a cheaper one |
Deny | Blocks requests for a model | Keep your team off models you haven’t approved |
Rewrite
Deny
: , , , the , and . Request-levelBYOKmodel fallbackssortingfilterprovider options
only: and the .Team-levelZero Data Retentionprovider allowlist
Source: original entry ↗
More from Vercel
Follow Vercel to get its new changes in your feed and email digest.
OpenAI Decisions API now available on AI Gateway
OpenAI's Decisions API is now accessible through Vercel's AI Gateway with an OpenAI-compatible endpoint, enabling decision models to answer typed questions and return probabilities, choices, and scores for routing, triage, and guardrails use cases. Support is available across the OpenAI SDK, AI SDK, HTTP API, and CLI with the latest versions.
Timestamp attributes now supported in Vercel Flags
Vercel Flags now supports timestamp attributes for entities, allowing you to create time-based targeting rules. Use this feature to run limited-time campaigns, show content between specific dates, or target users based on registration date.
Glyph Cluster now available in stealth on AI Gateway
Glyph Cluster, a reasoning model for coding and long-context analysis, is now available as a stealth model on Vercel's AI Gateway for Pro and Enterprise plan teams with purchased AI Gateway credits at no cost during the stealth period. The model supports function calling, streams responses, and can be accessed via AI SDK, OpenAI-compatible APIs, and coding agents.