proomt

Search

Search posts, papers, and topics

All posts

VercelZachary Chen1 min readrelease notesintermediate

GLM 5.3 FlashX now available on AI Gateway

Read on vercel.com

Summary

Vercel AI Gateway now offers the GLM‑5.3‑FlashX model, a fast (~200 tps) multimodal coding LLM. The post includes a TypeScript streaming example, notes the model’s fit for coding agents and interactive tools, and lists AI Gateway features (unified API, usage tracking, retries/failover, custom reporting, key budgets, routing rules) with no platform fee.

  • GLM‑5.3‑FlashX delivers ~200 tokens per second, aimed at low‑latency coding assistants and tool loops.
  • Integration is a one‑liner via `streamText` in the `ai` SDK, using the model identifier `zai/glm-5.3-flashx`.
  • AI Gateway provides a unified endpoint, usage/cost tracking, retry/failover logic, custom reporting, API‑key budgets, and routing rules.
  • Pricing mirrors the provider’s rates exactly; no extra platform fee, even for BYOK requests.

Fast LLM inference is a bottleneck for real‑time coding assistants. By exposing a high‑throughput model behind a managed gateway, Vercel reduces the operational overhead of scaling inference while preserving cost transparency.

3/10
llmapi designtypescriptperformanceml infra

Related reading

  1. Qwen 3.8 Max now available on Vercel AI Gateway

    Vercel AI Gateway now offers Qwen 3.8 Max, a 2.4 T‑parameter multimodal LLM with up to 1 M token context. It can be invoked via the standard `streamText` API or through Vercel’s coding agents, with no extra platform fees and full control over usage and security.

    Vercelvercel.com1 minrelease

  2. GPT-Live 1 now available on AI Gateway

    Vercel AI Gateway now offers OpenAI’s GPT‑Live 1, a full‑duplex voice model that can listen and speak simultaneously. The SDK lets you start a voice session and optionally delegate work to any text model, with code examples for both patterns.

    Vercelvercel.com1 minrelease

  3. Gemini 3.8 Live models now available on AI Gateway

    Vercel AI Gateway now offers Google’s Gemini 3.8 Live and Live Extended Thinking models through its realtime WebSocket API, enabling real‑time spoken interactions with audio output and parallel reasoning. The post includes a short TypeScript example for token acquisition, WebSocket setup, and handling of realtime events.

    Vercelvercel.com1 minrelease

  4. TypeSafe AI's Jev now available on AI Gateway

    Vercel AI Gateway now offers Jev, a probabilistic decision model that returns typed choices, scores, and booleans instead of raw text. TypeSafe AI reports it runs up to 193× faster and 445× cheaper than standard LLMs, exposed via the experimental evaluate API in AI SDK 7.

    Vercelvercel.com2 minrelease

  6. Open-weight models take 56% of token volume, Astra doubles Fable 5.1 spend

    Vercel’s September AI Gateway Production Index shows open‑weight models processing 56% of token volume (up from 7% in Dec 2025) while accounting for only 14% of spend. Token price fell 23.2% month‑over‑month. Anthropic’s Opus 5 captured 22.5% of spend, overtaking Fable 5 which dropped to 4.9%. OpenAI’s new GPT‑6 Astra grabbed ~7.7% of total gateway spend in its first 12 days, more than double Ant…

    Vercelvercel.com6 minHN2