Anthropic gives METR employee-like access to its systems, onboarding six METR staff with company hardware, and lets it publish its findings
Independent evaluation moves from pre-release testing to embedded staff, with the scope of allowed redactions fixed in advance.
// Key points
- Anthropic has onboarded six METR employees with company hardware and employee-like access; METR will publish its risk assessments.
- Anthropic cannot veto publication and can only require redaction of narrow, predefined categories such as customer data, privileged information or model architectures; METR may comment publicly on whether redactions were justified.
- Evaluator access has three tiers: SecureBio is in the first, reviewing the chemical and biological weapons chapter of the August Risk Report; Accenture with Faculty is working toward a partnership, and Hugging Face is in early discussions.
- It follows Anthropic’s signing of the White House Accord on Super Intelligence, which included pledges to work with external auditors or evaluators.
Builder's takeFor product builders the practical value is one more risk report on the model you pick that the vendor didn’t write. When METR’s first report lands, I’ll check its findings on agents overstepping against our own permission design. Fixing in advance what may be redacted is also worth copying: when we go through customer security reviews, agree up front what won’t be disclosed.
// Background · from #Anthropic
Full timeline →- Oct 16 Claude Opus 5.5 fast mode leaves research preview: no access request, no beta header, and a default rate limit in every usage tier
- Oct 15 Claude API launches OpenTelemetry export in beta to trace Messages API requests and Managed Agents sessions
- Oct 15 Claude Code 2.1.299 compacts 200K+ token conversations after about 54 idle minutes, before the one-hour prompt cache expires