systematicity

Thought without systematicity? Evaluating reasoning models on rule induction tasksarxiv.org

The paper builds compositional rule‑induction task families and generates isomorphic variants to probe systematicity in reasoning models. Experiments reveal that models frequently fail on equivalent variants despite solving the original task, indicating a lack of systematic reasoning.