📷 Image: Wikimedia Commons / Mvolz
Technology
Anthropic Sets $1B Damage or 50-Death Threshold for Blocking AI Models
✍️ India Today
🗓 18 Oct 2026, 11:46 PM
👁 20
Anthropic has proposed that AI models should only be blocked if they pose a risk of causing at least $1 billion in damage or 50 deaths.
Anthropic, a leading artificial‑intelligence research organization, has outlined a new policy framework for restricting AI models. The proposal, reported by India Today, states that a model should only be blocked if it is deemed to pose a risk of causing significant harm.
Under the suggested criteria, a model would be subject to blocking only when it could lead to at least $1 billion in financial damage or result in 50 or more deaths. These thresholds are intended to provide a clear, quantifiable standard for regulators and developers.
The move reflects growing concerns over the safety and societal impact of advanced AI systems. By setting concrete limits, Anthropic aims to balance innovation with risk mitigation.
The proposal has been shared with policymakers and industry stakeholders, though it has not yet been adopted as formal regulation.
Under the suggested criteria, a model would be subject to blocking only when it could lead to at least $1 billion in financial damage or result in 50 or more deaths. These thresholds are intended to provide a clear, quantifiable standard for regulators and developers.
The move reflects growing concerns over the safety and societal impact of advanced AI systems. By setting concrete limits, Anthropic aims to balance innovation with risk mitigation.
The proposal has been shared with policymakers and industry stakeholders, though it has not yet been adopted as formal regulation.