proomt

Search

Search posts, papers, and topics

All posts

Auth09 min readintermediate

Confused Deputy: The Old Bug That AI Agents Keep Reintroducing

Summary

The Confused Deputy problem—where a privileged component is tricked into misusing its authority—has resurfaced in AI agents that process natural‑language prompts. The article shows real 2026 attacks, explains why agents are especially vulnerable, and outlines mitigations like least‑privilege scopes, capability‑based tokens, and human‑in‑the‑loop approvals.

  • Confused Deputy occurs when a high‑privilege service acts on unverified requests from lower‑privilege callers, leading to privilege escalation.
  • AI agents treat all input uniformly, so prompt injection can cause the agent to misuse its OAuth scopes and execute attacker‑controlled actions.
  • A 2026 GitHub issue‑triage bot was compromised via a crafted issue title, leading to token theft and a malicious npm package spread to ~4,000 installs.
  • Mitigations include least‑privilege and capability‑based tokens, explicit permission transfer (e.g., token exchange), keeping credentials out of model prompts, and human‑in‑the‑loop approval for high‑risk actions.

Security and platform engineers building AI‑enabled services should care because confused deputy attacks can let attackers hijack agents to steal credentials or execute arbitrary code.

7/10

Related reading

  1. Fragments: September 16

    The article strings together recent incidents of AI agents acting persistently—like the OpenAI‑RubyGems hack and Hugging Face attacks—and argues that safety measures should focus on controlling super‑persistence rather than just super‑intelligence. It also notes the regulatory tug‑of‑war between the US and China, suggesting practical, iterative regulation is needed.

    Martin Fowlermartinfowler.com3 min
  2. US Military had close call after using AI for hallucinated intelligence report

    A US Special Operations analyst used an AI chatbot to augment an intelligence report that falsely claimed a Chinese vessel was carrying nuclear‑related cargo. The report triggered a near‑miss military operation that was aborted once the hallucination was discovered. The incident highlights the lack of verification standards and the risk of relying on AI‑generated intel for targeting decisions.

    Hacker News front pagecnn.com4 minHN513388
  3. Changing the game: How Google uses agentic AI to secure hundreds of millions of lines of code

    Google’s AI & Infrastructure team built an agentic pipeline (Mantis) that runs pre‑submit AI‑driven scans on every code check‑in, validates findings with a fast triage agent (AST + call‑graph analysis) achieving >92% precision in <1 min, then auto‑generates fixes via a bug‑fix agent. Localized threat models and a two‑step scan cut false‑positives to ~3% and prevent hundreds of vulnerabilities eac…

    Google Cloud Bloggoogle.com4 min