science software

OSWorld-Science: A Benchmark of Computer Use Agents for Learning and Using Scientific Softwarearxiv.org

OSWorld-Science introduces a benchmark suite of 146 scientific software tasks for evaluating visual language model agents across domains like molecular design and image analysis. The authors provide a harness for systematic comparison and show that current state‑of‑the‑art VLMs still struggle with many scientific workflows.