proomt

Search

Search posts, papers, and topics

Top

  1. 36

    Show HN: Cactus Needle 3: 8-29MB automation models can match DeepSeek V4 Flash

    Cactus Needle 3 is a laddered attention LLM (29‑121 M params, CQ2‑bit quantised) that fits in 9‑29 MB binaries and runs on devices like a Raspberry Pi 5 (400‑4k t/s decode, 1‑10k t/s pre‑fill). It can perform tool‑calling, structured extraction, and text embedding locally, matching DeepSeek V4 Flash on downstream tasks after a single fine‑tune epoch. The post includes architecture details, benchm…

    Hacker News front pagecactuscompute.com7 minreleaseHN537185
  2. 37

    Cloudflare Quick Tunnels

    Cloudflare Quick Tunnels let you expose a local service via an outbound‑only connection to Cloudflare’s edge network. The service gets a public URL (anycast across 335+ cities) with automatic TLS, DDoS protection, and no inbound ports. It’s positioned for short‑lived agents, webhooks, and testing loops, with JSON health output and no config files.

    Hacker News front pagecloudflare.com1 minreleaseHN831316
  3. 43

    Nvidia announces native GPU programming in Rust

    NVIDIA released CUDA‑Rust, letting you write GPU kernels directly in Rust and compile to PTX. Two programming models are supported: the traditional SIMT model via the `cuda-oxide` backend (nightly Rust, custom codegen) and the newer Tile model via `cutile‑rs` (stable Rust, JIT‑compiled Tile IR). Both provide Rust‑typed safety guarantees (e.g., `DisjointSlice`, tensor partitioning) and simple Carg…

    Hacker News front pagenvidia.com11 minHN961402
  4. 44

    Learning to solve hard problems in RL for LLMs by never giving up

    The post introduces the *Matthew Effect* in RL‑fine‑tuning of LLMs—performance gains concentrate on tasks the model already solves— and proposes *Never Give Up* (NGU), an adaptive sampling scheme that uses a small k for easy prompts and retries hard prompts with a high‑probability “never give up” loop. Experiments on math (AIME, GSM8k), code (Manufactoria), and larger‑scale setups (DeepScaler) sh…

    Hacker News front pagegithub.io11 minHN1179
  5. 46

    Vectorized and performance-portable Quicksort (2022)

    Google’s Highway library now includes a fully portable SIMD‑vectorized quicksort that runs 9‑19× faster than C++ std::sort. By using compress‑store (or permute‑based emulation) for partitioning, the same C++ code targets AVX2, AVX‑512, NEON, SVE and RISC‑V V. Benchmarks show 0.5 GB/s on an Apple M1 and >1 GB/s on a 3 GHz Skylake, beating prior architecture‑specific sorts. The implementation and a…

    Hacker News front pagegoogleblog.com3 minHN460142
  6. 49

    Training a 4B model to produce 81% faster query plans than Postgres

    A 4‑billion‑parameter open‑weight LLM, fine‑tuned with supervised learning and a custom RL loop, learns to emit PostgreSQL join plans that cut query latency by 44.7 % on a 113‑query benchmark. The author built a low‑noise measurement harness, a GRPO‑style reward function, and ran off‑policy distillation from ~500 GPT‑6‑style trajectories, demonstrating that a modest model can outperform Postgres’…

    Hacker News front pagerohanbansal.com51 minHN692143
  7. 55

    Reverse-engineered Jev-like model

    Jevlike is an open‑source starter model that scores a list of text options in a single forward pass. It provides a minimal architecture (option queries, shared dot‑product scorer), synthetic data generation, training/evaluation CLI, and examples on Doom and chess. The repo supports a byte‑level encoder or a frozen Hugging‑Face encoder (e.g., Qwen2.5‑0.5B), runs on CPU/MPS/CUDA, and reports benchm…

    Hacker News front pagegithub.com4 minreleaseHN16224
  8. 56

    IBM Built the Cold War’s Most Powerful Code Breaker for the NSA

    IBM’s Harvest (IBM 7950) was a 1960s NSA‑dedicated streaming coprocessor attached to an IBM Stretch mainframe. It ran up to 200× faster than contemporary machines, used a custom bit‑addressable memory model, pipelined parallel streams (P, Q → R), and introduced the world’s first automated tape library. IBM also created a domain‑specific language, Alpha, for cryptanalytic programmers. The article…

    Lobstersieee.org13 minHN10125lobste.rs8
  9. 57

    OpenJev

    OpenJev is a browser‑only demo that lets you load small LLM checkpoints (e.g., MiniCPM‑5 2B, Qwen3 0.6B) onto your GPU and compare two inference paths: reading raw logits for a set of options versus prompting the model to emit a JSON with option probabilities token‑by‑token. The page reports model sizes, download times, balanced accuracy on a few benchmarks, and wall‑clock timings measured with `…

    Hacker News front pageopenjev.com2 minreleaseHN709288
  10. 58

    Human brain is two separate organs, Stanford Medicine-led research finds

    Stanford researchers discovered that the human brain develops from two separate progenitor lineages—one for forebrain/midbrain (Otx2) and one for hindbrain (Gbx2)—and used this insight to grow functional hindbrain neurons from pluripotent stem cells. This breakthrough provides a platform for studying brain‑stem diseases such as SMA and ALS and reshapes our understanding of brain evolution.

    Hacker News front pagestanford.edu5 minreleaseHN654257