AI Gateway adds confidence-based decision fallbacks
AI Gateway now supports escalating requests to a fallback model when the primary model's confidence falls below a threshold you set. Configure confidence conditions using providerOptions.gateway.models to automatically route low-confidence responses to secondary models, with support for Choice, Score, and Boolean questions.
can now escalate a decision request to a fallback model when the primary model's answer trips a confidence condition you set.AI Gateway
Conditions can be combined, so an escalation can depend on more than one signal. The plain model names you already list in keep catching outright errors, so existing fallbacks are unaffected. Confidence conditions cover Choice and Score questions. Boolean questions escalate on a probability range instead.models
Set the fallback by adding one conditional object to . Requests without it keep their existing behavior.providerOptions.gateway.models
Leave out and the condition checks every question of the matching type, so escalates when any Choice or Score answer falls below 0.6.question{ "confidenceBelow": 0.6 }
Because a triggered fallback runs a second decision, it bills both stages.
Decision fallbacks are in beta. Learn more in the .decision fallbacks documentation
Source: original entry ↗
More from Vercel
Follow Vercel to get its new changes in your feed and email digest.
OpenAI Decisions API now available on AI Gateway
OpenAI's Decisions API is now accessible through Vercel's AI Gateway with an OpenAI-compatible endpoint, enabling decision models to answer typed questions and return probabilities, choices, and scores for routing, triage, and guardrails use cases. Support is available across the OpenAI SDK, AI SDK, HTTP API, and CLI with the latest versions.
Timestamp attributes now supported in Vercel Flags
Vercel Flags now supports timestamp attributes for entities, allowing you to create time-based targeting rules. Use this feature to run limited-time campaigns, show content between specific dates, or target users based on registration date.
Glyph Cluster now available in stealth on AI Gateway
Glyph Cluster, a reasoning model for coding and long-context analysis, is now available as a stealth model on Vercel's AI Gateway for Pro and Enterprise plan teams with purchased AI Gateway credits at no cost during the stealth period. The model supports function calling, streams responses, and can be accessed via AI SDK, OpenAI-compatible APIs, and coding agents.