proomt

Search

Search posts, papers, and topics

edge ai

RSS
  1. 1

    Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint

    Ternary Bonsai 2 27B is a new multimodal LLM based on Qwen3.8 27B, utilizing ternary weights for a 5.9GB model footprint. It achieves over 9x compression while retaining 98.2% of the full-precision model's aggregate benchmark performance across various tasks. This enables highly capable 27B-class models to run efficiently on local devices.

    Hacker News front pageprismml.com5 minreleaseHN579198lobste.rs12