InfoQSarah Deitke24 min readtalkintermediate
Presentation: Teaching Engineers, Trusting AI: How Education Enabled Autonomous Code Review
Summary
Duolingo’s DevEx AI team built a program of AI‑literacy workshops, observability dashboards, office‑hours, and vendor partnerships to get engineers comfortable with LLM‑based tools. With that foundation they launched a PR‑risk‑assessment bot that auto‑approves low‑risk pull requests, cutting review bottlenecks while keeping defect rates flat.
- Structured, lab‑style AI workshops (e.g., using Cursor, batching LLM calls) achieved 95 % positive feedback and helped reach near‑universal AI‑tool adoption among engineers.
- Internal AI observability dashboards track daily active users, tool usage by team, language, IDE, token consumption, and cost, providing data for leadership and ROI arguments.
- 15‑minute AI office‑hours and a dedicated Slack/meetup channel spread best‑practices beyond engineering to design, QA, and learning teams.
- Close vendor relationships (e.g., Cursor beta features, security/legal vetting) accelerate access to new capabilities and inform internal eval practices.
Scaling AI safely in a large engineering org requires more than tooling—it needs cultural buy‑in, measurable usage data, and clear guardrails. Duolingo’s approach shows a repeatable template: educate first, instrument usage, then automate high‑confidence workflows like code review.
6/10





