Anthropic is endorsing SB 53

Summary

Anthropic endorses California’s SB 53, a bill governing powerful AI systems developed by frontier AI companies, after careful consideration of lessons from the previous SB 1047. The bill emerged from Governor Newsom’s working group and implements a ‘trust but verify’ approach through disclosure requirements rather than prescriptive technical mandates. SB 53 requires large developers to publish safety frameworks addressing catastrophic risks that could cause mass casualty or substantial monetary damages, release transparency reports, report critical safety incidents within 15 days, and provide whistleblower protections with monetary penalties for noncompliance. The bill exempts startups and smaller companies, focusing on large firms like Anthropic, which already follows similar practices through its Responsible Scaling Policy and system cards. Anthropic views SB 53 as a strong regulatory foundation but notes the need for evolving rules, greater detail on evaluations, and broader coverage beyond the current 10^26 FLOPS threshold.

Takeaways

1. 1

   SB 53 requires frontier AI developers to publish safety frameworks and transparency reports on catastrophic risk assessments, with mandatory incident reporting within 15 days.

2. 2

   The bill exempts startups and smaller companies, focusing regulatory burden on large firms developing the most powerful AI systems.

3. 3

   Anthropic supports SB 53 as a foundation but advocates for evolving rules, more detailed evaluations, and broader coverage beyond the current 10^26 FLOPS threshold.

FAQ