Related reading
The Other Half of the Memory Wall: Serving 35B MoEs from SSD with Trained Routing Prediction
The paper presents Edge0, a streaming MoE inference engine that predicts the next layer's routing one token ahead, allowing expert weights to be fetched from SSD while compute proceeds. This enables a 35 B‑parameter MoE to run on a single 24 GB machine at ~20 tokens/s using only ~3 GiB of active memory and with near‑teacher accuracy.
Hugging Face Daily Papersarxiv.org1 minpaperOn-Demand Masked Sessions with Twilio Proxy, Voice and Serverless
A step‑by‑step tutorial showing how to build a Just‑in‑Time masked‑call workflow with Twilio Voice, Proxy, and Sync, using a two‑bounce out‑of‑session pattern to collect a tracking code via IVR, resolve the counterpart’s number, stash it in Sync, and auto‑create a Proxy session on the fly—all deployed as Twilio Serverless Functions.
Twiliotwilio.com18 minLambda MicroEgg
lambda-microegg is a Rust e‑graph library that adds scoped, alpha‑aware binders and Miller‑style higher‑order patterns to the Egg framework, enabling capture‑avoiding substitution and higher‑order rewriting with modest performance overhead.
Lobstersphilipzucker.com15 minlobste.rs27Article: Your Next DSL Author Is a Language Model
Typed Domain Grounding (TDG) embeds a DSL inside a mainstream language the LLM already knows (e.g., Kotlin) and uses the host compiler as an oracle. The author describes five building blocks—embedding, choosing a host language with high training‑data frequency, compiler‑driven type safety, a generate‑compile‑repair loop, and an on‑demand teaching tool—and shows measured results from kUML, a Kotli…
InfoQinfoq.com18 minSqualk: an old-school forum engine built on Nostr (NIP-29 groups, NIP-7D threads)
Squalk is a SvelteKit‑based forum built on the Nostr protocol, implementing NIP‑29 groups and NIP‑7D threads. It can run in a single‑forum “simple” mode or a multi‑forum “full” mode, with chat sidebars, markdown resources, and optional server‑side rendering for SEO. Configuration is done entirely via `PUBLIC_` environment variables, and deployment scripts support both static hosting and Node SSR,…
Lobstersgithub.com5 minlobste.rs12
