
Earlier this week we told you about whistleblowers claiming that AI is moving too fast and will end up killing humanity if they don’t get it under control.
Well this morning two major AI companies agreed to slow down everything down for the sake of safety.
First, the CEO of Anthropic, Dario Amodei:
We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so.Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training.
After he posted this, OpenAI CEO Sam Altman agreed:
I agree with Dario that we need to pace the frontier. This has been a primary topic of discussions we’ve had at OpenAI in recent weeks.
Committing to having independent evaluators with employee-like access is a great idea, and we will do the same. We’ll have more to share soon.
It sounds like these whistleblowers weren’t just blowing steam after all, and they got the attention of these big industry leaders. Wow.
UPDATE:
No comments:
Post a Comment