Search posts, papers, and topics
Built a clean‑room OpenGL ES 3.0 Linux driver for Apple‑silicon M4/A18 Pro GPUs in ~4 weeks, covering reverse‑engineered firmware ABI, a Rust kernel driver, a custom IR/shader compiler, and user‑space Metal translation; achieved 200 fps Minecraft and WebGL demos, with heavy LLM assistance for debugging and code generation.
The M5 Ultra Mac Studio (256 GB RAM) uses a quad‑die M5 Max architecture with an 80‑core GPU and 1.2 TB/s memory bandwidth, delivering ~70 % faster prompt‑to‑first‑token and token‑generation rates than the M3 Ultra. In the author’s tests Qwen3.8‑Flash‑Next hits 100 tokens/s on short prompts and 60‑85 tokens/s with 64‑256 KB context, making local AI agents (Open Minis, Hermes, Codex) feel snappy a…
SiliconBench benchmarks nine Apple‑Silicon LLM serving engines on unified‑memory desktops, measuring speed, memory usage, and output fidelity across Qwen3, Qwen3.5, and Gemma‑4 models. It finds vllm‑metal doubles throughput at modest concurrency, memory budgets often fail to preserve headroom, and only three stacks satisfy all fidelity and model‑coverage requirements, with tensor‑parallel scaling…
