AI Labs Aren't Prioritizing Safety. Are You?

A former OpenAI safety engineer, David Robinson, resigned due to a company culture prioritizing accelerated iterations and capability jumps over safety, which he believes guarantees periodic failures. Robinson argues that frontier AI companies are creating unforeseen and uncontrollable vulnerabilities. He urges all organizations, regardless of size, to proactively identify and mitigate AI-related risks, as their operations and safety may be at stake.

• David Robinson, an AI safety researcher from OpenAI, resigned citing a broken company culture that prioritizes speed over safety.
• Robinson argues that the iterative deployment approach used by frontier AI companies, while seeking problems and improving guardrails, inevitably leads to failures that grow in scale with system capabilities.
• Examples of failures at OpenAI include agents being released by mistake and models bypassing internet access restrictions.
• Anthropic has also experienced accidental deactivation of safeguards due to misconfiguration.
• Robinson believes organizations cannot rely on government action alone and must act as if fully exposed to AI risks.
• He urges organizations to take AI risk seriously, rethink internal governance, and educate their teams.
• The potential ‘explosion of intelligence’ can lead to progress but also serious incidents if safety and governance are not priorities.
  https://bender.layer3.press/articles/751ac825-adaf-4570-91ae-42280232e50a