By Anjali Sharma
UNITED NATIONS – UN on Wednesday warned that Artificial intelligence AI is advancing rapidly, raised questions about how societies and governments can capture its benefits while managing risks that often extend beyond national borders.
The former researcher at the AI company Anthropic warned on 8 September that AI could pose an existential threat to humanity which led concerns intensified.
UN said that the best way to address AI’s global risks is to bring countries together to adopt shared principles and commitments on AI governance.
UN head António Guterres said on Wednesday that “National action is essential, but global coordination is indispensable,”
UN has worked for several years to provide a forum where countries can develop a shared understanding of AI technologies and discuss how they can cooperate and provide a regulatory framework on issues such as safety, human rights and disparities in access.
The UN’s current work on AI governance stems from the Global Digital Compact, adopted by Member States in 2024 as part of the UN’s Pact for the Future, exactly two years ago.
The Compact called for international cooperation on AI and proposed two new mechanisms: an independent scientific panel to assess the AI’s risks and opportunities, and an annual global dialogue where governments and other stakeholders could coordinate approaches to AI governance.
UN General Assembly formally established both the Independent International Scientific Panel on AI aims to provide governments with an independent assessment of what is known and what isn’t known about the rapidly developing technology in August 2025.
The Global Dialogue on AI Governance, meanwhile, brings governments and other stakeholders together to discuss international cooperation, share experience and work towards greater compatibility between different approaches to AI governance.
World body designed the two institutions to complement each other: the Scientific Panel provides the evidence, and countries decide at the Global Dialogue what to do in response.
The Scientific Panel’s first preliminary report, released 1 July, concluded that AI capabilities are advancing rapidly especially in areas such as reasoning, coding and science creating significant opportunities.
It also identified risks such as misinformation, discrimination, privacy violations, cyberattacks and so-called “superintelligence” that could become difficult to control.
Mr. Guterres said in his pre-UNGA remarks to the media in New York “We need a shared understanding of how to advance the safe, secure, and responsible development of AI while identifying when increasingly powerful systems may require stronger safeguards, or additional measures to manage potential risks”.
The UN’s work comes as discussions move from whether AI should be regulated, to questions about which safeguards should be implemented.
Mr. Guterres called for international cooperation to ensure that AI development remains safe, secure and responsible.
He added that voluntary efforts to slow AI development will not be sufficient if they are isolated, unverifiable or unevenly applied.
SG said it could not be done next week but it should happen soon, with “everybody on board” from the public, private, scientific, and civil society sectors when asked about how the UN could convene a summit as part of a process leading to effective regulation for humankind.
“If we believe AI development should slow when risks become too great, we need more than good intentions,” he said.
Mr. Guterres has called for an AI Child Safety Pledge and a Global Fund for AI, which would support developing countries in building AI infrastructure and capacity.
He also stressed the need for guardrails that make AI “safe, transparent, accountable, with human dignity at the centre.”
UN’s role will be to bring these governments together, provide a scientific basis for discussions and identify areas for international cooperation as national and regional governments make their own decisions about AI regulation.
Some diplomatic sources quoted in news reports speculate that the Security Council will discuss artificial intelligence during the high-level week.
UN’s SDG Media Zone will host an event on 21 September, and the AI and Human Development series will culminate with a discussion on 23 September at the UN Headquarters on the sidelines of the General Debate where AI concerns will no doubt loom large at the podium.
Both events will focus on the relationship between AI and human agency.
Mr. Guterres underscored during his press conference Wednesday that AI will be “a major topic” in his discussions with world leaders next week.
He ompared AI development to the Cold War-era arms race between the US and Soviet Union, Guterres called for cooperation between countries at the forefront of AI including the US and China to slow down AI development while risks continue to be assessed.
“The countries that have the highest capacity in the frontiers of AI – I think they should establish mechanisms of contact, have an exchange of information and (create) some common guardrails in order to avoid a race to the bottom that could one day lead to a gigantic disaster at the global level,” Mr. Guterres said.
He concluded that the scientific and diplomatic mechanisms now in place, the UN will continue to work to turn that cooperation into concrete action as AI becomes increasingly powerful.
