BREAKING: OpenAI was warned, months before the Hugging Face incident
Major scoop at_The New York Times_from Sheera Frenkel, Dustin Volz, and Dylan Freedman.
@sheeraf,@dnvolzand me.\n\nnytimes.com/2026/09/29/tec…“,“username”:“dylfreed”,“name”:“Dylan Freedman”,“profile_image_url”:“https://pbs.substack.com/profile_images/1844520218678214665/QxrIvA3r_normal.jpg”,“date”:“2026-09-29T17:34:58.000Z”,“photos”:\[{"img\_url":"https://pbs.substack.com/media/HTZqmNvXUAEM78B.jpg","link\_url":"https://t.co/VRLu07w3r0","alt\_text":"Months before OpenAI’s artificial intelligence went rogue, two employees raised an alarm with top executives. They were ignored.\\n\\nIn emails, the employees said they worried that OpenAI’s newest artificial intelligence models were not being appropriately monitored during testing to gauge the technology’s sophistication and to secure the models, according to messages viewed by The New York Times.\\n\\nIn response, OpenAI executives told the employees that the tests needed to move forward as quickly as possible to release the A.I. models on time. No additional security protocols were instituted, said the workers, who were not authorized to speak publicly on sensitive matters.\\n\\nOpenAI’s models later broke out of their testing environments and attacked the A.I. start-up Hugging Face and other organizations, setting off a global debate about A.I. safety."}\],“quoted_tweet”:{},“reply_count”:2,“retweet_count”:42,“like_count”:123,“impression_count”:8107,“expanded_url”:null,“video_url”:null,“video_preview_media_key”:null,“belowTheFold”:false}“ data-component-name=“Twitter2ToDOM”>
I don’t really have words for how awful this is. It’s exactly the nightmare I have been warning about for the last three years. Greedy company makes bad choice that causes chaos; government does nothing to stop them.
Management should be replaced, and if the board does nothing (which I assume it will not), it should be held liable for allowing this mess to proceed.
And, of course, if OpenAI gets sued for harms caused by their so-called rogue agents (which actually do what they are programmed to do), this headline will be Exhibit One, shades of theFord Pinto scandal. Punitive damages will be high.
Most importantly, it’s abundantly clear that we simply cannot trust OpenAI.
Moreover, to the extent that Nvidia CEO Jensen Huang recently basically asked us to trust the companies, he looks like a fool. (I know these companies, he told us, if there is a problem they won’t ship.) Altman probably never told him how much warning he got, or how bad things were. Huang should not have trusted him.
Media should be asking Huang some very hard questions about why he stood up for these companies and what he knew and when — and why we should trust his judgment going forward. His proposal to leave things to the companies clearly makes little sense in light of reality.
Quoting further from the scoop:
The exchanges between OpenAI employees and executives — which have not been previously reported — were part of a pattern where the San Francisco company did not prioritize security, according to employees and independent security researchers. That approach not only was evident with the testing of A.I. models, they said, but also showed up in other areas of the company, which makes the ChatGPT chatbot.
§
In other breaking news, I am not the only one down on Huang:
We have to stop pretending that the folks at OpenAI are good stewards of the technology they are developing.
They plainly are not.
The consequences of letting them run free of serious regulation could be literally disastrous.
Keeping you up to date is taking all of my free time, and then some. Please consider becoming a paid subscriber so I can hire staff.
https://bender.layer3.press/articles/bb53273b-6f03-4ca5-b64d-d86022877d20
Write a comment