Regional inference now available on AI Gateway
AI Gateway now supports regional inference, allowing you to pin requests to US or EU data centers via the inferenceRegion field. Every response reports which region served the request, ensuring data residency and compliance requirements are met consistently across all model providers.
AI Gateway now supports . Set on a request to pin it to the US or EU. Every model provider that supports the selected region handles it the same way. Inference runs there, and any data the provider keeps is stored there.regional inferenceinferenceRegion
AI Gateway supports two pinned regions, plus global routing:
If no model provider can serve it, the request fails rather than running somewhere else. Every response reports the region that served it, so you can confirm where each request ran.
Here's a request pinned to the US with the AI SDK:
Until now, teams with data residency or compliance requirements had to configure regional routing separately for every provider, with no reliable way to confirm where a request actually ran. Regional inference replaces that with a single field that behaves the same everywhere and a response that tells you where each request was served.
Filter the for models available in the US or EU, or read the array from . Without , requests route globally with no residency guarantee, so residency is opt-in.model listregions/v1/modelsinferenceRegion
Pinning a region can cost more. The provider sets the regional rate, often around 10% above standard, and AI Gateway passes it through with no markup. For per-provider overrides, response verification, pricing, and BYOK behavior, read the .regional inference documentation
Region | Where inference runs |
|---|---|
| A US data center |
| An EU data center |
| Any region |
Source: original entry ↗
More from Vercel
Follow Vercel to get its new changes in your feed and email digest.
OpenAI Decisions API now available on AI Gateway
OpenAI's Decisions API is now accessible through Vercel's AI Gateway with an OpenAI-compatible endpoint, enabling decision models to answer typed questions and return probabilities, choices, and scores for routing, triage, and guardrails use cases. Support is available across the OpenAI SDK, AI SDK, HTTP API, and CLI with the latest versions.
Timestamp attributes now supported in Vercel Flags
Vercel Flags now supports timestamp attributes for entities, allowing you to create time-based targeting rules. Use this feature to run limited-time campaigns, show content between specific dates, or target users based on registration date.
Glyph Cluster now available in stealth on AI Gateway
Glyph Cluster, a reasoning model for coding and long-context analysis, is now available as a stealth model on Vercel's AI Gateway for Pro and Enterprise plan teams with purchased AI Gateway credits at no cost during the stealth period. The model supports function calling, streams responses, and can be accessed via AI SDK, OpenAI-compatible APIs, and coding agents.