AI Gateway now supports streaming transcription
AI Gateway now supports streaming transcription in beta, allowing audio to be streamed as it's captured with transcript updates returned in real-time rather than as a complete response. This reduces latency for use cases like live captioning and voice input, and integrates with AI SDK's streamTranscribe function across multiple providers.
AI Gateway now supports . Previously, transcription required a complete audio file and returned the full transcript in a single response. Now you can stream audio in as it's captured and get transcript updates back as the model produces them, keeping latency low for uses like live captioning and voice input.streaming transcription
Streaming transcription is in beta and available through the 's function with any streaming-capable transcription model.AI SDKstreamTranscribe
The example below streams raw PCM audio to and prints each transcript delta as it arrives. The result stream also carries partial and final transcripts:openai/gpt-realtime-whisper
The same code works across providers: swap the model string to use or any other . xai/grok-sttstreaming-capable transcription model
Streaming transcription also makes it easy to add a voice mode to an agent. Stream the user's speech to a transcription model and pass the live text to your agent. The agent itself does not change: it still receives text, so this works with any text-based agent. For agents that speak back, pair it with speech generation, or use realtime voice for full two-way conversation.
For more information on streaming transcription on AI Gateway, see the .documentation
Source: original entry ↗