megachangelog
Feature

AI Gateway now supports TypeSafe clients and HTTP API for Jev

AI Gateway now supports calling Jev, a probabilistic decision model from TypeSafe AI, through TypeSafe clients, an HTTP API, or the AI SDK. All requests are billed through AI Gateway and appear in unified usage and observability, with support for boolean, choice, and score evaluation types.

You can now call through AI Gateway using an existing TypeSafe client or the HTTP API, in addition to the AI SDK.Jev from TypeSafe AI

is a probabilistic decision model for software. State goes in, and typed answers come out with probabilities attached, so there's no generated text to parse. Requests are billed through AI Gateway on all three paths, so they appear alongside your other model calls in usage and observability.Jev

Change the base URL and API key. Your calls, questions, and response shapes stay exactly as they are.systemOnenoul

New integrations name the model as and ask one of three question types: returns a probability from 0 to 1, picks one option from a set you name, and rates against a scale you define. This example asks whether an agent should keep working after fixing a bug and passing its tests.typesafe-ai/jevbooleanchoicescore

With the HTTP API, to :POST/v1/evaluate

With the AI SDK, run the same evaluation through :evaluate

You can also use Jev through , a framework for building and deploying agents with sandboxed compute, human approvals, and evaluations already built in. eve uses Jev as the default for automatic model selection, typed evaluations, and automated tool approvals.eveevaluation model

See the to migrate a client, or the for the HTTP API or AI SDK. TypeSafe-compatible API guideevaluation guide

Read more

  • Point an existing TypeSafe client at AI Gateway without changing its evaluation calls.TypeSafe client:

  • Call Jev directly from any language or framework.HTTP API:

  • Call Jev from a TypeScript application using AI SDK.AI SDK:

Migrate an existing TypeSafe client

Start a new integration

ai-gatewayapijevintegrationevaluationsdk

Source: original entry ↗