UN chief urges global ban on 'killer robots'

Guterres: lethal autonomous weapons cross a moral line

UN Secretary General António Guterres has called for lethal autonomous weapons systems — which he labels “killer robots” — to be prohibited under international law.

Speaking after the first Global Dialogue on Artificial Intelligence Governance in Geneva, Guterres focused on weapons capable of identifying, selecting and attacking targets without human oversight, leaving software in charge of life‑or‑death decisions.

He argued that some choices must never be delegated:

“Some decisions must remain forever human – none more than taking a human life.”

Handing that power to machines would be “morally repugnant” and “politically unacceptable,” he said.

Recommended reading

Mira Murati’s lab unveils Inkling, a 975B open model

Act before the first atrocity, UN chief warns

Guterres pressed governments to legislate now, not after a disaster involving autonomous weapons.

“Let us not wait for atrocity to act,” Guterres said.

The urgency, he argued, is heightened by the fact that AI models and advanced chips are already embedded in military intelligence, targeting and battlefield systems.

In a separate post on X, he warned that:

“We may be the last generation able to set the terms on which humanity and machines coexist,”

calling for AI to be governed, trusted and fair.

Military AI flashpoints: Anthropic and the Pentagon

Guterres' stance sits alongside growing tension between tech firms and defense agencies. Anthropic recently clashed with the Pentagon after seeking guarantees that its models would not be used for autonomous weapons or surveillance.

According to the article, the Pentagon rejected those limitations, insisting it should be able to use Anthropic’s models for any lawful purpose. The dispute underscores how private companies are becoming increasingly intertwined with digital warfare.

Reporting by the Wall Street Journal cited a similar concern from Pope Leo XIV, who warned that AI‑controlled weapons could promote an “anti-human” view of warfare. He cautioned that such autonomy might reduce certain dangers while further distancing political leaders from the human consequences of conflict.

Technical upsides, ethical and legal dead ends

The article notes that artificial intelligence also offers clear operational benefits in modern warfare.

Systems built on modern compute can:

• Process huge volumes of battlefield data extremely quickly
• Respond to threats at near‑real‑time speeds
• Improve targeting accuracy and precision
• Reduce risk to soldiers and potentially lower civilian casualties

Critics, however, question how meaningful “human oversight” can be when an operator may have only seconds to react to AI‑generated recommendations. That time pressure risks turning oversight into a rubber stamp.

Accountability remains unresolved as well. If an autonomous system misfires or misidentifies a target, it’s not clear who is responsible — human operators, commanding officers, hardware manufacturers, or software developers are all candidates for blame.

Scientists warn of shifting power dynamics

The piece also quotes Yoshua Bengio, Co‑Chair of the Independent International Scientific Panel on AI, who framed the stakes bluntly:

“It sounds like science fiction, but it’s a real possibility, and it could change the world in ways that we don’t understand yet, and it could change the power dynamics of our planet in ways that require our attention,”

For Guterres and his allies, that uncertainty is precisely why the rules for autonomous weapons need to be set — and enforced — before the first catastrophe, not after.