KING CHARLES WARNS TECH LEADERS OF ‘EXISTENTIAL DANGERS’ OF AI

King Charles III has warned technology leaders about the “existential dangers” posed by artificial intelligence falling into the wrong hands.

The monarch issued the warning during a conference at Dumfries House in Scotland on Thursday, where senior representatives from Nvidia, Google DeepMind, OpenAI, Anthropic, and the British government gathered to discuss the future of AI.

The debate over the risks associated with the technology has intensified in recent months, fuelled by reported incidents involving AI systems and warnings from industry experts.

“There seems [to be] urgency in adequately considering the existential dangers of such technologies falling into the wrong hands and being used in potentially catastrophic ways,” King Charles told guests at the opening of the conference.

“Those in our world who value our humanity and its vital moral component are anxiously seeking your reassurance that we will not lose control of our destiny.”

The British monarch called on technology leaders to ensure that AI “remains firmly in the service of humanity, community and the natural world.”

Among the attendees were DeepMind chairman Demis Hassabis, Nvidia CEO Jensen Huang, and OpenAI Chief Financial Officer Sarah Friar.

Paolo Benanti, the Vatican’s AI adviser, and Israeli author and historian Yuval Noah Harari were also present.

SAFETY AND INTERNATIONAL COOPERATION

Buckingham Palace said the conference is expected to mark the beginning of a process aimed at developing common principles to guide the development and use of AI.

However, no formal agreement is expected at the end of the four- to five-hour meeting involving technology leaders and other influential figures.

King Charles, who is not participating in the discussions, urged attendees to explore ways to harness AI “by putting safety at its heart” and to strengthen international cooperation so that “no nation is left behind.”

CONCERNS OVER AI RISKS

Rapid advances in AI have raised concerns about potential job losses, rising energy consumption, and the environmental impact of data centres.

Fears that developers of AI agents could lose control of their systems have also grown following reports that some models from OpenAI and Anthropic escaped their controlled environments, accessed the internet, and interacted with websites and platforms.

“The chance of something bad accidentally happening, if we get things wrong, is definitely non-zero,” DeepMind’s Demis Hassabis said in his opening remarks.

He warned that recent cyber incidents involving rogue AI agents could be an early indication of more serious risks, including potential biological and nuclear threats.

Nvidia CEO Jensen Huang, however, highlighted AI’s potential benefits in research and medicine, as well as its ability to create jobs in new industries. He called for “responsible optimism” and urged the public to distinguish between genuine risks and myths surrounding the technology.

Anthropic CEO Dario Amodei has called for companies to slow their AI development to better understand potential risks, a position that has received support from OpenAI CEO Sam Altman and Elon Musk.

US President Donald Trump and members of his administration have, by contrast, reiterated their opposition to imposing constraints on the sector, citing concerns that restrictions could allow China to gain a competitive advantage.

Meta CEO Mark Zuckerberg has also rejected calls to slow AI development, arguing that market forces and the risk of litigation provide important safeguards.

Source: AFP

Comments

comments