OpenAI starts the first phase of embedded assessments: Apollo Research, METR, Transluce and Goodfire independently evaluate its model alignment, safeguards and monitoring
Outside organizations are starting independent evaluations from inside OpenAI. So far the participants and scope are public, for readers tracking whether model safety claims can be checked by third parties.
// Key points
- OpenAI announced the first phase of embedded assessments, with Apollo Research, METR, Transluce and Goodfire.
- Their scope is to independently evaluate OpenAI's model alignment, safeguards and monitoring systems.
Builder's takeThere is only a list of participants and a scope so far, nothing to act on yet. I would wait for the first reports, check them against the OpenAI models in my products for known gaps in monitoring and safeguards, and then decide where to add my own review layer.
// Background · from #OpenAI
Full timeline →- Nov 14 OpenAI introduces ChatGPT Wallet: agents in ChatGPT Work, Codex and dots can complete purchases with user approval
- Nov 13 AWS publishes an enterprise rollout guide for Codex on Amazon Bedrock: sign in through IAM Identity Center and call GPT-5.6 Sol, Terra or Luna on Bedrock
- Nov 10 OpenAI describes Control Room, a central system that tracks model workloads across its research infrastructure and can rapidly stop them