proomt

Search

Search posts, papers, and topics

All posts

VercelRohan Taneja2 min readrelease notesintro

AI Gateway now supports TypeSafe clients and an HTTP API for Jev

Read on vercel.com

Summary

AI Gateway now lets you call the Jev probabilistic decision model via an existing TypeSafe client, a plain HTTP API, or the TypeScript AI SDK, with usage billed and observable in the gateway.

  • Swap the TypeSafe client’s baseURL to https://ai-gateway.vercel.sh/typesafe and set the AI_GATEWAY_API_KEY to route calls through AI Gateway without code changes.
  • Use the HTTP POST /v1/evaluate with model "typesafe-ai/jev" to get typed answers (boolean, choice, score) and probabilities from any language.
  • The AI SDK’s experimental_evaluate function also supports Jev, returning a probability field you can threshold in TypeScript.
  • All three integration paths are billed through AI Gateway, so calls appear alongside other model usage in observability dashboards.

Teams building AI agents or evaluation pipelines should care because they can now integrate Jev’s typed probabilistic decisions via existing TypeSafe clients, HTTP, or the AI SDK, all tracked in AI Gateway.

4/10
llmapi designobservabilitytypescriptai

Related reading

  1. TypeSafe AI's Jev now available on AI Gateway

    Vercel AI Gateway now offers Jev, a probabilistic decision model that returns typed choices, scores, and booleans instead of raw text. TypeSafe AI reports it runs up to 193× faster and 445× cheaper than standard LLMs, exposed via the experimental evaluate API in AI SDK 7.

    Vercelvercel.com2 minrelease

  3. Introducing System One Models and Jev

    TypeSafe AI announced its first “System One” model, Jev, a non‑text‑generating LLM that outputs type‑safe structured decisions with calibrated probabilities. It claims 40‑200× lower latency (70‑500 ms) and 100‑500× lower cost versus frontier LLMs, no hallucinations, and parallel sampling. The post includes a side‑by‑side demo, a custom “workflow” benchmark comparing Jev to GPT‑5.6/6 and other mod…

    Hacker News front pagetypesafe.ai9 minHN1824480lobste.rs26

  4. Jev is the fastest-adopted model in AI Gateway history

    Vercel reports that the Jev decision model was adopted by 13% of paid teams within its first day, outpacing prior model launches. Jev claims to be up to 194× faster and 445× cheaper than general‑purpose LLMs while returning structured, probabilistic decisions.

    Vercelvercel.com1 minHN21

  5. I turned Jev into a (lousy) chatbot

    jevchat is a Python CLI that turns the Typesafe Jev API into a symbol‑level chatbot by repeatedly asking Jev which next character to emit. It offers interchangeable sampling strategies and alphabets, live generation stats, and a benchmark mode that quantifies performance trade‑offs.

    Hacker News front pagegithub.com5 minHN17048

  6. Building Composite Model Context Protocol (MCP) Gateways in TypeScript

    Step‑by‑step tutorial showing how to build a stateless composite Model Context Protocol (MCP) gateway in TypeScript using Hono, Zod, and the MCP SDK. It covers config‑driven upstream registration, namespaced tool discovery, JSON‑RPC routing, per‑tool auth middleware, and a token‑bucket rate limiter, with concrete code snippets and design trade‑offs.

    SitePointsitepoint.com16 min