proomt

Search

Search posts, papers, and topics

  1. Android Bench 2.0: Pushing the frontier with challenging long-horizon tasks

    Android Bench 2.0 adds a set of long‑horizon tasks (multi‑day Android development problems) and introduces agent‑based evaluation. Scoring is now continuous, with the best model achieving a 28 % pass rate on these tasks, far lower than the ~91 % on earlier short tasks. The post lists new models on the leaderboard and points to updated methodology and GitHub repo.

    Androidgoogleblog.com4 minHN2