Inkling Small model now available on AI Gateway
Inkling Small from Thinking Machines is now integrated into AI Gateway, offering comparable performance to larger models at a quarter of the size with lower compute costs. The model supports audio and image reasoning, tool use, and controllable thinking effort to balance quality against latency and cost.
from Thinking Machines is now available on AI Gateway.Inkling Small
Inkling Small reaches performance comparable to the larger Inkling model at about a quarter of the size, using much less compute per task. It is a broad generalist with native reasoning over audio and images, and it holds up well on reasoning, agentic coding, and tool use. Controllable thinking effort lets you trade quality against cost and latency, from minimal to maximum reasoning.
For visual tasks, it can crop, zoom, and inspect images programmatically, which helps on documents and charts where the relevant detail is small.
To use Inkling, set to in the :modelthinkingmachines/inkling-smallAI SDK
Inkling-Small is compatible with . Turn it on team-wide from the dashboard, or per request with , and AI Gateway routes only to providers that delete prompts and responses after each request.Zero Data RetentionzeroDataRetention: true
Inkling-Small is also a cost-efficient choice for coding and tool-use workflows. Run to connect your coding agents to AI Gateway, then select in the agent's model configuration. See the .vercel ai-gateway coding-agents setupthinkingmachines/inkling-smallcoding agents guide
AI Gateway reflects provider pricing with no markup and does not charge a platform fee on inference, including on (BYOK) requests. Try Inkling Small in the .Bring Your Own Keymodel playground
Source: original entry ↗
More from Vercel
Follow Vercel to get its new changes in your feed and email digest.
OpenAI Decisions API now available on AI Gateway
OpenAI's Decisions API is now accessible through Vercel's AI Gateway with an OpenAI-compatible endpoint, enabling decision models to answer typed questions and return probabilities, choices, and scores for routing, triage, and guardrails use cases. Support is available across the OpenAI SDK, AI SDK, HTTP API, and CLI with the latest versions.
Timestamp attributes now supported in Vercel Flags
Vercel Flags now supports timestamp attributes for entities, allowing you to create time-based targeting rules. Use this feature to run limited-time campaigns, show content between specific dates, or target users based on registration date.
Glyph Cluster now available in stealth on AI Gateway
Glyph Cluster, a reasoning model for coding and long-context analysis, is now available as a stealth model on Vercel's AI Gateway for Pro and Enterprise plan teams with purchased AI Gateway credits at no cost during the stealth period. The model supports function calling, streams responses, and can be accessed via AI SDK, OpenAI-compatible APIs, and coding agents.