Related reading
Open-weight models are fast on Neon AI Gateway. Here's why
Neon AI Gateway provides fast inference for open-weight LLMs by utilizing Databricks' optimized serving stack. This stack incorporates techniques like prompt caching, continuous batching with KV-cache paging, and a TensorRT-LLM backend, leading to significant improvements in throughput and latency.
Neonneon.com6 minOpen-weight models take 56% of token volume, Astra doubles Fable 5.1 spend
Vercel’s September AI Gateway Production Index shows open‑weight models processing 56% of token volume (up from 7% in Dec 2025) while accounting for only 14% of spend. Token price fell 23.2% month‑over‑month. Anthropic’s Opus 5 captured 22.5% of spend, overtaking Fable 5 which dropped to 4.9%. OpenAI’s new GPT‑6 Astra grabbed ~7.7% of total gateway spend in its first 12 days, more than double Ant…
Open-Sourcing Rebalancer: A Generic, High-Performance Library for Solving Assignment Problems
Meta open‑sourced Rebalancer, a library that lets engineers describe assignment problems (objects → bins) via a high‑level spec API, then solves them with either a MIP backend or a highly parallel local‑search engine. It handles millions of objects, solves ~40 M problems daily, and includes a debugging UI.
A New Framework for Open Source AI
Mozilla and partners published a paper proposing a layered, gradient openness framework for foundation models, defining openness for data, code, weights, docs, and deployment. The framework gives developers, regulators, and civil society a common language to evaluate openness and safety beyond a binary label.
Mozilla Automation Teammozilla.org3 minScaling Laws for Looped Mixture of Experts
This paper introduces Loop Scaling Laws, which jointly model recurrence and sparsity in Mixture-of-Experts (MoE) transformers. It finds that recurrence and sparsity offer complementary efficiency gains, improving prediction accuracy and enabling more efficient large model design.
Hugging Face Daily Papersarxiv.org1 minpaperHN2
