OpenAI CEO Sam Altman will brief the United Nations Security Council next week during the annual gathering of world leaders for the UN General Assembly, the company has said.
The meeting is being organised by France, which currently holds the rotating presidency of the 15-member Security Council, and comes as major players in the industry have said a slowdown in AI development could be necessary out of safety concerns.
UN Secretary-General Antonio Guterres on Wednesday called for coordinated international action to address AI risks as fears rise about the dangers of the fast-evolving technology.
"National action is essential. But global coordination is also indispensable," Guterres told reporters.
Concerns about AI safety have escalated in recent weeks, with workers at major AI developers resigning over concerns about the dangers posed by the technology.
Anthropic chief executive Dario Amodei published an essay soon after urging caution.
"We must slow the pace at which we improve the capabilities of AI models," he wrote.
Altman and tech titan Elon Musk lent their support to the idea, as did Google DeepMind's Demis Hassabis, who himself has called for a US-led global regulatory body for the technology.
President Donald Trump has dismissed warnings against AI risks as a "hoax" and pushed back against calls for tighter oversight.
The threat of catastrophic danger as artificial intelligence develops at high speed has sparked a global debate on how it should be regulated.
Leading US labs have called for a coordinated slowdown of their cutting-edge work on the technology.
In the past two weeks, some of its researchers warned that AI could lead to human extinction, and Anthropic said it found examples where its systems could have been used toward biological weapons development, which met some skepticism.
Nvidia, OpenAI CEOs to attend Xi dinner at White House
Meanwhile, a US official said on Friday that Nvidia boss Jensen Huang and OpenAI chief executive Sam Altman are among tech leaders expected to attend a White House state dinner for Chinese President Xi Jinping next week.
"It'll be a very popular and hot-ticketed event," the official said on condition of anonymity, adding that Amazon founder Jeff Bezos, SpaceX and Tesla chief Elon Musk, Apple head Tim Cook and Google CEO Sundar Pichai will also attend.
Their presence comes as artificial intelligence is set to loom large in the talks between the two leaders, with the United States and China the two dominant powers in the AI race.
The AI debate in the US remains dominated by the idea that the country's leading developers — OpenAI, Anthropic, Google and Meta — cannot afford to slow their pace of innovation, whatever the risks, for fear that China will pull ahead.
China, long seen as trailing the United States on cutting-edge AI, has been closing that gap fast.
Washington has long tried to slow China's progress with export controls on the advanced chips needed for cutting-edge AI, blocking access to top-end US semiconductors such as those made by Nvidia.
Despite their bitter rivalry, hope remains that the two superpowers can agree on something regarding the technology when the leaders meet in Washington.
