Back to News
Market Impact: 0.6

Why Anthropic believes its latest model is too dangerous to release

AAPLAMZNGOOGLGOOGMSFTNVDA
Artificial IntelligenceCybersecurity & Data PrivacyTechnology & InnovationProduct LaunchesAntitrust & CompetitionRegulation & Legislation
Why Anthropic believes its latest model is too dangerous to release

Anthropic is delaying general release of its new Claude Mythos Preview LLM after internal tests found it discovered thousands of high-severity vulnerabilities (99% unpatched) and achieved a 72% success rate producing a Firefox exploit versus <1% for its previous model. Access is limited to ~50 entities (11 coordinating via Project Glasswing, including Google, Microsoft, Nvidia, Amazon, Apple) and Anthropic is donating $100M in access credits; access pricing is $25 per million input tokens and $125 per million output tokens. Anthropic cites safety risks, compute constraints (model is very expensive to serve) and strategic incentives to limit distribution; the firm also reports revenue run-rate growth (to $30B annualized) amid surging demand.

Analysis

Deployments of frontier-capable models will bifurcate the AI market into (a) tightly controlled, high-ARPU managed offerings sold through cloud/security channels and (b) commoditized, lower-ARPU on-device/smaller-model alternatives. Over the next 12–24 months expect cloud providers to extract premium pricing for “hardened access” and monitoring, creating a durable incremental margin line that is underpriced into current consensus for incumbent hyperscalers. Compute scarcity and gated rollouts create a transitory supply advantage for GPU suppliers and cloud hosts, but also raise the probability of demand rationing and higher effective unit prices that depress gross margins for vertically integrated users (e.g., retail/fulfillment heavy operators) in the near term. A 3–9 month capacity shock could materially lift NVDA’s revenue per GPU while simultaneously creating a 6–18 month headwind to companies forced to buy or overprovision cloud instances for safe/monitored model use. Regulatory and reputational catalysts are asymmetric and fast: a high-profile exploit or leak would trigger immediate usage curbs, enterprise purchasing freezes, and accelerate government procurement of “safe” enterprise LLMs — shifting procurement toward vetted cloud vendors and security-first providers. The biggest tail risk that reverses winners is rapid model replication or open-source parity; if frontier capabilities leak wholesale, the premium for managed access collapses within weeks and benefits open-source tooling and low-cost compute arbitrageurs.