1
Show HN: Cactus Needle 3: 8-29MB automation models can match DeepSeek V4 Flash
Cactus Needle 3 is a laddered attention LLM (29‑121 M params, CQ2‑bit quantised) that fits in 9‑29 MB binaries and runs on devices like a Raspberry Pi 5 (400‑4k t/s decode, 1‑10k t/s pre‑fill). It can perform tool‑calling, structured extraction, and text embedding locally, matching DeepSeek V4 Flash on downstream tasks after a single fine‑tune epoch. The post includes architecture details, benchm…
Hacker News front pagecactuscompute.com7 minreleaseHN537185
