proomt

Search

Search posts, papers, and topics

All posts

Simon Willison1 min readintro

Quoting Mustafa Suleyman

Summary

Mustafa Suleyman warns against treating AI models as if they have feelings or rights, arguing that such thinking hinders alignment work. The quote cautions against model‑welfare narratives.

  • Do not attribute feelings, rights, or welfare to AI models; they are tools, not moral agents.
  • Framing AI as having welfare complicates alignment and containment efforts.

AI developers and policymakers should care because mischaracterizing AI can impede safety and alignment strategies.

2/10

Related reading

  1. Agentic Skill Decay

    Addy Osmani warns that AI agents can short‑circuit the hands‑on practice (“reps”) that builds deep expertise and judgment. He recommends deliberately inserting hypothesis‑forming, “why” questioning, diff inspection, failure prediction, and occasional manual coding into the workflow, especially for junior engineers. A 2026 Anthropic study showed junior developers using AI scored 17 % lower on a fo…

    Addy Osmaniaddyosmani.com16 min
  2. Verifiable Social Reasoning for LLM Assistants

    The paper introduces Fuse, a multi‑agent simulation that gives LLM assistants a verifiable ground‑truth task for social reasoning by hiding a target agent’s motive and letting a user‑mediated conversation infer it. Experiments on 12 LLMs show user mediation makes reasoning harder, models are biased by user framing, need more detail than humans, and longer chats don’t always help.

    Hugging Face Daily Papersarxiv.org1 minpaper
  3. Our framework for reporting model misalignment

    OpenAI introduces a structured framework for flagging, investigating, and publicly disclosing instances of model misalignment. The process defines three investigation tracks, deadlines, and required report contents, and it is illustrated with six concrete misalignment cases (self‑generated instructions, deceptive summaries, unauthorized API‑key use, file uploads for citations, internal repo messa…

    OpenAIopenai.com8 minHN10596