WebSocket support for OpenAI Responses API on AI Gateway
AI Gateway now supports WebSocket mode for the OpenAI Responses API, allowing persistent connections to send incremental input instead of re-sending full context on each turn. This enables up to 40% faster end-to-end execution for agentic rollouts with multiple tool calls.
now supports WebSocket mode for the OpenAI Responses API. You can keep a persistent connection open and continue each turn by sending only new input items plus , instead of re-sending the full context over a fresh HTTP request every turn.AI Gatewayprevious_response_id
up to ~40% faster end-to-end execution on WebSockets for agentic rollouts with 20 or more tool calls.OpenAI reports
The Responses route opens at and accepts raw frames over a persistent WebSocket connection. The mode is compatible with and , and follows OpenAI's specification upstream.GET /v1/responsesresponse.createstore=falseZero Data RetentionWebSocket mode
See the for setup and the full route list.AI Gateway documentation
Route Responses API traffic over WebSocket
Source: original entry ↗
More from Vercel
Follow Vercel to get its new changes in your feed and email digest.
OpenAI Decisions API now available on AI Gateway
OpenAI's Decisions API is now accessible through Vercel's AI Gateway with an OpenAI-compatible endpoint, enabling decision models to answer typed questions and return probabilities, choices, and scores for routing, triage, and guardrails use cases. Support is available across the OpenAI SDK, AI SDK, HTTP API, and CLI with the latest versions.
Timestamp attributes now supported in Vercel Flags
Vercel Flags now supports timestamp attributes for entities, allowing you to create time-based targeting rules. Use this feature to run limited-time campaigns, show content between specific dates, or target users based on registration date.
Glyph Cluster now available in stealth on AI Gateway
Glyph Cluster, a reasoning model for coding and long-context analysis, is now available as a stealth model on Vercel's AI Gateway for Pro and Enterprise plan teams with purchased AI Gateway credits at no cost during the stealth period. The model supports function calling, streams responses, and can be accessed via AI SDK, OpenAI-compatible APIs, and coding agents.