Anthropic

Anthropic opens its AI model to outside safety scrutiny for the first time

Anthropic has handed outside researchers the keys to its own safety review process, and it can't take them back.

3 min readTechCrunch
Anthropic opens its AI model to outside safety scrutiny for the first time

Anthropic's decision to let METR publish independent safety assessments, and to waive its right to block them, is a meaningful step forward for an industry that has promised transparency more often than it has delivered it. This is not a marketing gesture. It is a structural change in how one of the most influential AI developers handles accountability. For anyone building workflows or making decisions with AI tools, that distinction matters.

The practical consequence is simple: there is now a third party with direct access to Anthropic's internal risk data, incident logs, and safety practices, and that third party can publish whatever it finds. METR is not a PR firm. It is a research organization that evaluates whether frontier models can cause harm if misused. If you are evaluating which AI tools to trust with your data or your operations, this arrangement gives you something closer to an independent audit than the usual vendor-supplied benchmarks. It is worth contrasting this with the situation described in our recent review of What to Know Before Using Abacus AI, where the lack of transparent, third-party safety data made it difficult for users to assess real reliability. Anthropic is not solving that problem for the whole industry, but it is creating a model others will be pressured to follow.

The significance goes beyond one company. Most frontier AI developers release safety reports on their own terms, selecting which risks to highlight and which to downplay. By surrendering that editorial control, Anthropic is acknowledging that internal safety teams are not enough. External scrutiny is the only way to build genuine confidence, especially as these models are deployed in contexts where mistakes carry real consequences. The same principle applies in other domains of technology governance, as our coverage of Balancing safety and privacy in the push for smarter surveillance shows: when the entity controlling the technology also controls the narrative about its risks, the public is left to trust claims that have not been independently verified.

Here is the specific takeaway: this arrangement creates a precedent that could reshape procurement decisions. If you are a business or an institution evaluating AI vendors, the ability to point to an independent, published safety assessment is a concrete advantage. It reduces the burden on your own due diligence. It also raises the bar for competitors who have not made similar commitments. The open question is whether METR's assessments will be granular enough to inform real-world deployment choices, or whether they will remain at the level of broad risk categories. That detail will determine whether this move changes the industry or remains a well-intentioned outlier. Watch for the first published report. Its depth will tell you how seriously Anthropic takes this experiment.

From TechCrunch

METR will publish its own assessments of Anthropic’s risks, incidents, and practices, and the frontier AI model maker has given up the right to block them.

Read the original at TechCrunch