Anthropic and Accenture announce an embedded evaluation partnership

Embedded evaluation partnership announced — evaluators from Faculty, Accenture's specialist AI unit, are stationed inside Anthropic's facilities to carry out model evaluations and red-teaming, alignment evaluations and safeguard testing. With employee-equivalent access, they observe model development, monitor deployment decisions and communicate directly with staff. The two companies expect to invest at least $1 billion over the next 5 years in building evaluation capacity, and are also in talks with nonprofit evaluators such as METR. Anthropic stated that responsibility for model safety itself remains with Anthropic. The move follows on from Dario Amodei's "We Must Pace the Frontier".