Thursday, 23 November 2023 05:09

OpenAI researchers warned board of AI breakthrough that could threaten humanity ahead of CEO ouster

Rate this item
(0 votes)

Ahead of OpenAI CEO Sam Altman’s four days in exile, several staff researchers wrote a letter to the board of directors warning of a powerful artificial intelligence discovery that they said could threaten humanity, two people familiar with the matter told Reuters.

The previously unreported letter and AI algorithm were key developments before the board's ouster of Altman, the poster child of generative AI, the two sources said. Prior to his triumphant return late Tuesday, more than 700 employees had threatened to quit and join backer Microsoft (MSFT.O) in solidarity with their fired leader.

The sources cited the letter as one factor among a longer list of grievances by the board leading to Altman's firing, among which were concerns over commercializing advances before understanding the consequences. Reuters was unable to review a copy of the letter. The staff who wrote the letter did not respond to requests for comment.

After being contacted by Reuters, OpenAI, which declined to comment, acknowledged in an internal message to staffers a project called Q* and a letter to the board before the weekend's events, one of the people said. An OpenAI spokesperson said that the message, sent by long-time executive Mira Murati, alerted staff to certain media stories without commenting on their accuracy.

Some at OpenAI believe Q* (pronounced Q-Star) could be a breakthrough in the startup's search for what's known as artificial general intelligence (AGI), one of the people told Reuters. OpenAI defines AGI as autonomous systems that surpass humans in most economically valuable tasks.

Given vast computing resources, the new model was able to solve certain mathematical problems, the person said on condition of anonymity because the individual was not authorized to speak on behalf of the company. Though only performing math on the level of grade-school students, acing such tests made researchers very optimistic about Q*’s future success, the source said.

Reuters could not independently verify the capabilities of Q* claimed by the researchers.

'VEIL OF IGNORANCE'

Researchers consider math to be a frontier of generative AI development. Currently, generative AI is good at writing and language translation by statistically predicting the next word, and answers to the same question can vary widely. But conquering the ability to do math — where there is only one right answer — implies AI would have greater reasoning capabilities resembling human intelligence. This could be applied to novel scientific research, for instance, AI researchers believe.

Unlike a calculator that can solve a limited number of operations, AGI can generalize, learn and comprehend.

In their letter to the board, researchers flagged AI’s prowess and potential danger, the sources said without specifying the exact safety concerns noted in the letter. There has long been discussion among computer scientists about the danger posed by highly intelligent machines, for instance if they might decide that the destruction of humanity was in their interest.

Researchers have also flagged work by an "AI scientist" team, the existence of which multiple sources confirmed. The group, formed by combining earlier "Code Gen" and "Math Gen" teams, was exploring how to optimize existing AI models to improve their reasoning and eventually perform scientific work, one of the people said.

Altman led efforts to make ChatGPT one of the fastest growing software applications in history and drew investment - and computing resources - necessary from Microsoft to get closer to AGI.

In addition to announcing a slew of new tools in a demonstration this month, Altman last week teased at a summit of world leaders in San Francisco that he believed major advances were in sight.

"Four times now in the history of OpenAI, the most recent time was just in the last couple weeks, I've gotten to be in the room, when we sort of push the veil of ignorance back and the frontier of discovery forward, and getting to do that is the professional honor of a lifetime," he said at the Asia-Pacific Economic Cooperation summit.

A day later, the board fired Altman.

 

Reuters

June 26, 2025

How to ace a job interview in 90 seconds, from an Ivy League communication expert

Sophie Caldwell You only have about 90 seconds to make a strong first impression in…
June 26, 2025

Peter Obi decries ‘coordinated lawlessness’ after brother’s property is demolished in Lagos without court order

Former presidential candidate Peter Obi has condemned what he described as a brazen act of…
June 27, 2025

Which drink is best for hydration? Hint: It isn’t water

Lisa Drayer When you’re thirsty and in need of a drink, which beverages are best…
June 21, 2025

Man convicted of posing as flight attendant to fly for free 120 times

A 35-year-old American man has been found guilty of impersonating a flight attendant at least…
June 26, 2025

17 soldiers killed, dozens injured in fierce gun battles with terrorists in Niger, Kaduna

Seventeen soldiers have been confirmed dead and at least ten others injured following coordinated attacks…
June 27, 2025

What to know after Day 1219 of Russia-Ukraine war

WESTERN PERSPECTIVE Russia captures village in eastern Ukraine near lithium deposit, Russian-backed official says Russian…
June 25, 2025

Tesla robotaxi launch: Why getting from dozens to millions of self-driving cars won't be easy

Tesla (TSLA.O) finally has a robotaxi. Now comes the hard part. The electric-vehicle maker deployed…
May 13, 2025

Nigeria's Flying Eagles qualify for World Cup after dramatic win over Senegal

Nigeria's U-20 national football team, the Flying Eagles, have secured their place at the 2025…

NEWSSCROLL TEAM: 'Sina Kawonise: Publisher/Editor-in-Chief; Afolabi Ajibola: IT Manager;
Contact Us: [email protected] Tel/WhatsApp: +234 811 395 4049

Copyright © 2015 - 2025 NewsScroll. All rights reserved.