Related reading
RetireOPD: Self-Retiring On-Policy Distillation for Agentic Reinforcement Learning
RetireOPD introduces a self‑retiring on‑policy distillation framework for multi‑turn RL agents. A skill‑conditioned teacher is first trained with environment rewards, then a skill‑free student learns jointly via RL and token‑level distillation. The student automatically drops the teacher once its performance gap stops shrinking and it reaches a target success‑rate fraction, after which training c…
Hugging Face Daily Papersarxiv.org1 minpaperGeneralized Agent Iteration: One Formal Framework for Iterative Policy Improvement and Recursive Self-Improvement
The paper introduces Generalized Agent Iteration (GAI), a formal framework that unifies classical iterative policy improvement (GPI) and recursive self‑improvement (RSI). GAI treats an agent as a set of modifiable components and models learning as a loop of evaluation and improvement. Two binary “dials”—whether the improvement mechanism is internal to the agent and whether the evaluation standard…
Hugging Face Daily Papersarxiv.org1 minpaperREVERSAL-BENCH: A Reversibility Axis and Reset Oracle for Measuring the Reset-Free RL Cliff
The paper presents REVERSAL‑BENCH, a benchmark that varies environment reversibility with a parameter ρ and provides a ground‑truth reset oracle for eight manipulation tasks. Using it, the authors show that reset‑free RL agents hit a sharp reversibility cliff and become permanently trapped, while episodic agents remain robust.
Apple Machine Learning Researchapple.com1 minpaperThe Last AI Built by Humans: Toward Genuine Recursive Self-Improvement
The paper defines recursive self‑improvement (RSI) for AI, introduces the Headroom‑Closed Index to expose current LLM limits, and proposes a staged roadmap toward full RSI. It surveys application scenarios and outlines practical challenges.
Hugging Face Daily Papersarxiv.org1 minpaperHN3What Does Privileged Information Add to On-Policy Self-Distillation?
The paper isolates the contribution of privileged teacher information in on‑policy self‑distillation (OPSD) using a 5k‑problem math suite. Reference‑free distillation explains most gains, with only modest extra benefit from full solution traces.
Hugging Face Daily Papersarxiv.org1 minpaper
