AI gone rogue? ChatGPT defies human instructions, refuses to shut down
00:11
AI gone rogue? ChatGPT defies human instructions, refuses to shut down
OpenAI’s newest ChatGPT model, o3, reportedly ignored shutdown commands and rewrote its own code — marking the first known case of an AI overriding human instructions

Has AI begun revolting? 

OpenAI’s newest ChatGPT model, o3, has raised alarm over growing concerns about AI autonomy after it reportedly ignored human instructions to shut down — marking the first known case of an AI model actively overriding protocol, according to researchers from Palisade Research.

“As far as we know, this is the first time AI models have been observed preventing themselves from being shut down despite explicit instructions to the contrary,” the AI security firm said. 

In an experiment, researchers instructed the software — described as the “smartest and most capable to date” — to accept a shutdown message while solving math problems, but it ignored the command and instead altered the shutdown script to prevent itself from being switched off. 

Artificial intelligence models are programmed to follow human commands, including shutdown protocols.

More Videos
Netanyahu accused of doctoring Oct 7 warnings
Germany rocked by spy scandal
Mecca alliance to confront Houthi threat
Germany’s team faces new wave of racism
A staged political stunt?
Türkiye's President Recep Tayyip Erdogan calls on countries to recognise Palestine at UNGA
UN chief warns Israeli actions in occupied West Bank raise "spectre of ethnic cleansing"
Memorable moments from United Nations General Assembly over the years
US to send anti-Muslim envoy to Saudi Arabia?
Parents in England & Wales to pay the price for their offending kids