UNIDIR Warns AI Could Crowd Out Human Judgment in Military Operations

By Anjali Sharma
UNITED NATIONS – Head of the UN independent disarmament research institute Robin Geiss on Tuesday warned that the artificial intelligence is already being widely used on the battlefield, and the role of human judgment in military operations is shrinking rapidly.

UNIDIR Director Robin Geiss asked a question to reporters “Are we going to let machines target and kill human beings?”

He warned that AI was increasingly “on track to crowding out human decision-making” in the sector.

UN chief Antonio Guterres has been repeatedly urged stakeholders to make sure we do not cross this “moral red line.”

He noted that AI is being given a growing number of responsibilities in military affairs, from intelligence analysis and target identification to drone operations and orchestrating cyber-attacks.

It comes at the expense of human judgement, including in the nuclear domain, Mr. Geiss stressed.

He said that the shift is dramatically increasing the pace of battlefield operations, shortening the time between identifying and striking targets and allowed forces to engage an unprecedented number of targets each day.

UNIDIR chief warned that many of these evolving AI systems are opaque, and they are increasing the risk of error, miscalculation and therefore of unintended escalation.

AI tools are becoming easier to use, it will also become easier for non-State actors to engage in ever-more sophisticated military operations, he said.

Mr. Geiss recognized that geopolitical competition and tensions are “serious obstacles” to regulating AI involvement in the military sector.

He also stressed that concerns about its risks are increasingly being shared – regardless of political outlook – including among major global powers.

In September, the United States proposed an AI “notification mechanism” with China, so the world’s two largest military spenders can warn each other about AI incidents that could threaten national security.

Mr. Guterres called for stronger regulation of military AI and a legally binding treaty on lethal autonomous weapon systems are also “increasingly finding an echo across the international community,” the UNIDIR Director said.

The UNIDIR is working actively to create some of the building blocks required for multilateral cooperation on the matter, he added.

UNIDIR Centre of Excellence on AI, Peace and Security will launch a new multi-stakeholder forum on AI in international peace and security and in the military domain the first and only such forum within the UN system so far, said Mr. Geiss.

He emphasized that the forum will focus on three areas:

Developing a framework for responsible industry behaviour, with practical, voluntary guidelines for companies to follow at the design and development stage for AI military tools.

Developing an “AI security lexicon” to clarify key concepts such as autonomy, safety or security, which are currently being used very differently by different stakeholders creating ambiguity that hinders trust and the cooperation.

To address the risk of misuse of AI by non-State armed groups to support operational planning, execution, and logistics.