Related reading
- 1 points
Saving another 100TB of RAM with math (and Rust)
Cloudflare reduced the memory footprint of its Pingora Backend Router by re‑examining the consistent‑hashing implementation in the pingora‑ketama library. By increasing the number of virtual hash points per server from the default 1 to the standard 160 (and applying weighted hashing based on disk capacity), they cut the per‑node overhead enough to reclaim >100 TB of RAM across the fleet. The post…
Cutting Node.js Memory Footprint with HyperLogLog and Count-Min Sketch in TypeScript
A step‑by‑step tutorial showing how to implement HyperLogLog and Count‑Min Sketch in pure TypeScript for Node.js, with a fast MurmurHash3‑x86‑32, memory‑bounded registers, merge support, and a Vitest benchmark suite that runs under `--expose-gc`.
SitePointsitepoint.com16 minMigrating the GitHub Copilot runtime to Rust, using Copilot
The Copilot agent runtime was rewritten from a 130‑k‑line TypeScript/Node.js codebase into a native Rust library (~830 k lines of Rust) to reduce startup latency, memory use, and improve reliability. The migration was done incrementally (in‑place) across 128 PRs, with AI‑generated code handling most of the work. The new runtime exposes a C ABI for in‑process embedding by all six Copilot SDK langu…
GitHub Oldgithub.blog65 minHN188
