Anthropic pitches a safety bill that could block AI models
The draft would have the Commerce Department ask a judge to halt a model's release.
Policy#02
50+ people
People at risk of dying in one scenario
Image: TechCrunch
50+ peoplePeople at risk of dying in one scenario
The short version
- Politico reported that Anthropic has been shopping a draft AI safety bill that it hopes Congress might consider adopting.
- The bill would allow a model's release to be blocked if over 50 people are at risk of dying or if over a billion dollars in property damage could result.
- Independent evaluators registered with the Commerce Department would assess risk and have 72 hours to contact the department about an imminent catastrophic risk.
- The Commerce Department would have to ask a Washington, D.C., judge to halt the release, and no federal agency could halt distribution on its own.
Why it matters
The proposal sets concrete thresholds for when a model can be blocked, and the metrics resemble those in California's Senate Bill 53. The article notes that labs have largely resisted mandatory government oversight and that Anthropic's proposal goes further than other industry proposals, including Nvidia's. For developers, it shows how rules for model releases could take shape.
“This bill represents the proposals outlined in Anthropic’s Advanced AI Framework”