A former OpenAI researcher claims the ChatGPT maker could be on the precipice of achieving AGI, but it’s not prepared “to handle all that entails" as shiny products get precedents over safety
OpenAI’s super alignment team has been slashed by half, with majority of the staffers departing over safety concerns.
When you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.
What you need to know
Over the past few months,many OpenAI staffers have departed from the tech startupfor various reasons. Recently, OpenAI co-founder Greg Brockman announced that he’d be going on sabbatical leave through the end of the year while researcher John Schulman announced his departure from the firm to join Anthropic tofocus on AI alignment.
The mass exodus of high-profile executives from the AI firm began shortly afterSam Altman’s bizarre firing and reinstatement as CEOby the board of directors, including former OpenAI super alignment lead Jan Leike, who indicated that he left the company after falling into multiple disagreements with top officials at the company over safety, adversarial robustness, and more. Leike also noted thatsafety procedures took a backseat, giving precedent to shiny products.
While touching base withFortune, Daniel Kokotajlo, who also worked as a researcher at OpenAI until early 2023, indicated that more than half of OpenAI’s super alignment team has already departed from the company. “It’s not been like a coordinated thing. I think it’s just people sort of individually giving up,” added Kokotajlo.
As you may know, OpenAI’s founding mission was to “ensure that artificial general intelligence benefits all of humanity.” However, the firm has veered off this goal and is now aregular for-profit company.
Elon Musk has openly criticized OpenAI for abandoning its founding mission, referring to it as a “stark betrayal.” The billionairefiled a lawsuit against the firm and Sam Altmanover the same issue, but abruptly withdrew it earlier this year. Interestingly, the Tesla CEO launched another complaint against the AI firm — citinginvolvement in racketeering activities. According to Musk’s lawyers, “The previous suit lacked teeth.”
Is OpenAI AGI-ready?
It’s no secret that OpenAI is working toward hitting the AGI benchmark, however, there’s a rising concern among users about its implications for humanity. According to an AI researcher,there’s a 99.9% probability AI will end humanity, and the only way to stop this outcome is not to build AI in the first place.
AlthoughOpenAI has since formed a new safety team led by CEO Sam Altmanto ensure the company’s technological advances meet critical safety and security standards, it’s seemingly more focused on product development and the commercial side of business.
Get the Windows Central Newsletter
All the latest news, reviews, and guides for Windows and Xbox diehards.
Interestingly, months after disbanding its safety alignment team,OpenAI reportedly rushed through the GPT-40 launchand even sent out invitations for the event before testing began. The company admitted the safety and alignment team was under pressure and left with little time for testing.
To this end, it’s impossible to identify the root cause for many executives and staffers who’ve left the company in the past few years, with some even starting rival firms focused onmaking superintelligence safe. Kokotajlo speculates the mass departure is directly related to OpenAI being on the precipice of hitting the AGI benchmark, but it lacks the knowledge, regulations, and tools “to handle all that it entails.”
Elsewhere, OpenAI recentlyopposed a proposed AI billby Senator Scott Wiener designed to install safety protocols to prevent the technology from veering off the guardrails, citing a need for federal legislation.
🎒The best Back to School deals📝
Kevin Okemwa is a seasoned tech journalist based in Nairobi, Kenya with lots of experience covering the latest trends and developments in the industry at Windows Central. With a passion for innovation and a keen eye for detail, he has written for leading publications such as OnMSFT, MakeUseOf, and Windows Report, providing insightful analysis and breaking news on everything revolving around the Microsoft ecosystem. You’ll also catch him occasionally contributing at iMore about Apple and AI. While AFK and not busy following the ever-emerging trends in tech, you can find him exploring the world or listening to music.
