Dario Amodei's remarks at the AI Safety Summit

Summary

At the AI Safety Summit, Dario Amodei explains why rapid AI progress makes dangerous capabilities difficult to predict and motivates Anthropic’s Responsible Scaling Policy (RSP). The policy combines AI safety levels (ASLs), modeled loosely on biological safety levels, with recurring tests for dangerous capabilities along the compute scaling curve. ASL-2 covers current models and calls for model cards, external red-teaming, and strong security, while ASL-3 would require unusually strong protection against weight theft and safeguards preventing operationally useful CBRN information; ASL-4 adds escalated misuse and autonomous-system risks. Amodei also describes executive involvement, integrating RSP deadlines into product and research planning, board and external accountability, and the goal of refining company policies into regulatory testing and auditing regimes.

Takeaways

1. 1

   ASL-2 describes current models and requires present-day practices including model cards, external red-teaming, and strong security.

2. 2

   At ASL-3, Anthropic would require unusually strong security against weight theft and deployed models that do not provide operationally useful CBRN information, including under expert red-teaming.

3. 3

   The RSP is presented as a prototype for regulation, with companies and governments refining its ideas into testing, auditing, accountability, and oversight regimes.