proomt

Search

Search posts, papers, and topics

All posts

VercelKevin Dawkins1 min readrelease notesintermediate

Gemini 3.8 Live models now available on AI Gateway

Read on vercel.com

Summary

Vercel AI Gateway now offers Google’s Gemini 3.8 Live and Live Extended Thinking models through its realtime WebSocket API, enabling real‑time spoken interactions with audio output and parallel reasoning. The post includes a short TypeScript example for token acquisition, WebSocket setup, and handling of realtime events.

  • Gemini 3.8 Live and Live Extended Thinking are accessible via Vercel AI Gateway’s realtime API.
  • Models support real‑time audio, visual grounding, 97 languages, and background tool calls during conversation.
  • Extended Thinking adds parallel multi‑step reasoning, allowing acknowledgments while processing.
  • Integration uses @ai-sdk/gateway, a WebSocket client, and token retrieval via gateway.experimental_realtime.getToken().

Engineers building voice assistants or realtime AI experiences need to know the new Gemini models and how to hook them into Vercel's unified gateway.

5/10
llmai gatewaytypescriptrealtimewebsockets

Related reading

  1. Gemini Live audio

    Simon Willison shows a minimal JavaScript UI that talks to Google’s Gemini 3.8 Live speech‑to‑speech models via a WebSocket API, using the Web Audio API for capture/playback and no external libraries.

    Simon Willisonsimonwillison.net1 min

  3. GPT-Live 1 now available on AI Gateway

    Vercel AI Gateway now offers OpenAI’s GPT‑Live 1, a full‑duplex voice model that can listen and speak simultaneously. The SDK lets you start a voice session and optionally delegate work to any text model, with code examples for both patterns.

    Vercelvercel.com1 minrelease

  4. GLM 5.3 FlashX now available on AI Gateway

    Vercel AI Gateway now offers the GLM‑5.3‑FlashX model, a fast (~200 tps) multimodal coding LLM. The post includes a TypeScript streaming example, notes the model’s fit for coding agents and interactive tools, and lists AI Gateway features (unified API, usage tracking, retries/failover, custom reporting, key budgets, routing rules) with no platform fee.

    Vercelvercel.com1 minrelease

  5. Qwen 3.8 Max now available on Vercel AI Gateway

    Vercel AI Gateway now offers Qwen 3.8 Max, a 2.4 T‑parameter multimodal LLM with up to 1 M token context. It can be invoked via the standard `streamText` API or through Vercel’s coding agents, with no extra platform fees and full control over usage and security.

    Vercelvercel.com1 minrelease