proomt

Search

Search posts, papers, and topics

All posts

VercelWalter Korman1 min readrelease notesintro

Qwen 3.8 Max now available on Vercel AI Gateway

Summary

Vercel AI Gateway now offers Qwen 3.8 Max, a 2.4 T‑parameter multimodal LLM with up to 1 M token context. It can be invoked via the standard `streamText` API or through Vercel’s coding agents, with no extra platform fees and full control over usage and security.

  • Qwen 3.8 Max is a 2.4 trillion‑parameter LLM with a 1 million‑token context window that supports both text and vision inputs.
  • Vercel AI Gateway exposes the model via a unified API; set `model: 'alibaba/qwen3.8-max'` in the `streamText` helper to call it.
  • The model can be selected in Vercel’s coding agents, enabling code generation or UI creation from screenshots and design files.
  • AI Gateway passes provider pricing through unchanged, supports BYOK, zero‑data‑retention, usage budgets, and routing rules for reliability.

Teams building AI‑augmented tooling or UI generation benefit from a large multimodal model that can be accessed through Vercel’s AI Gateway without additional costs.

5/10

Related reading

  1. GLM 5.3 FlashX now available on AI Gateway

    Vercel AI Gateway now offers the GLM‑5.3‑FlashX model, a fast (~200 tps) multimodal coding LLM. The post includes a TypeScript streaming example, notes the model’s fit for coding agents and interactive tools, and lists AI Gateway features (unified API, usage tracking, retries/failover, custom reporting, key budgets, routing rules) with no platform fee.

    Vercelvercel.com1 minrelease
  2. Gemini 3.8 Live models now available on AI Gateway

    Vercel AI Gateway now offers Google’s Gemini 3.8 Live and Live Extended Thinking models through its realtime WebSocket API, enabling real‑time spoken interactions with audio output and parallel reasoning. The post includes a short TypeScript example for token acquisition, WebSocket setup, and handling of realtime events.

    Vercelvercel.com1 minrelease
  3. TypeSafe AI's Jev now available on AI Gateway

    Vercel AI Gateway now offers Jev, a probabilistic decision model that returns typed choices, scores, and booleans instead of raw text. TypeSafe AI reports it runs up to 193× faster and 445× cheaper than standard LLMs, exposed via the experimental evaluate API in AI SDK 7.

    Vercelvercel.com2 minrelease
  4. GPT-Live 1 now available on AI Gateway

    Vercel AI Gateway now offers OpenAI’s GPT‑Live 1, a full‑duplex voice model that can listen and speak simultaneously. The SDK lets you start a voice session and optionally delegate work to any text model, with code examples for both patterns.

    Vercelvercel.com1 minrelease
  5. Shapelearn Qwen 3.8 27B (13.1 GB VRAM)

    ByteShape releases full ShapeLearn quantizations for Qwen 3.8 27B, showing that their GPU‑specific GGUFs (GPU‑1…GPU‑5) dominate the quality‑throughput frontier across six GPUs, with GPU‑5 hitting 99.63 % of BF16 accuracy at 90 TPS on a 13.1 GB model. Speculative decoding (MTP, DFlash2) further boosts throughput, and the Lite set remains competitive.

    Hacker News front pagebyteshape.com17 minHN10439
  6. Mem0 joins the Vercel Marketplace

    Mem0, a service that provides long‑term memory for AI agents, is now available as a native Vercel Marketplace integration. It auto‑creates an API key, adds it as MEM0_API_KEY, and offers built‑in billing with free and paid plans.

    Vercelvercel.com1 minrelease