proomt

Search

Search posts, papers, and topics

vllm

RSS
  1. 1

    Turning GLM-5.3-Flash into a Jev-like decision model

    The authors demonstrate turning an off‑the‑shelf LLM (GLM‑5.3‑Flash) into a fast, typed decision model by prompting it to output only an option index and reading the token logits. Using vLLM’s allowed_token_ids and logprob_token_ids they achieve Jev‑level accuracy and speed, even for image inputs, without any fine‑tuning.

    Hacker News front pageprivatemode.ai13 minHN13559lobste.rs2