King Charles told an audience of tech CEOs and policy makers on Tuesday that artificial intelligence "poses an existential danger if it falls into the wrong hands".

He delivered the warning at a high‑profile summit in Ayrshire, where representatives from Nvidia, OpenAI and Anthropic joined government officials and academic experts.

"AI is a technology that could reshape the world, for better or for worse," the monarch said.

The monarch’s remarks came as the United Kingdom prepares to unveil its first comprehensive AI regulatory framework later this year, a move aimed at aligning the nation with the European Union’s upcoming AI Act.

AI risks highlighted at Ayrshire summit

Panelists at the event warned that large language models can generate disinformation at scale, while deep‑fake tools threaten personal privacy and national security. Nvidia’s chief executive highlighted the dual‑use nature of its graphics processors, which power both video games and advanced neural networks.

OpenAI’s chief scientist echoed concerns about "misaligned incentives" when profit‑driven firms race to release ever more capable systems without robust safety testing.

Anthropic’s co‑founder added that current alignment techniques are still experimental, leaving a gap between capability and controllability.

Calls for tighter regulation

Following the king’s statement, the UK’s Department for Science, Innovation and Technology said it would accelerate consultation on mandatory risk‑assessment procedures for high‑impact AI models.

Industry groups, including the TechUK trade body, welcomed the call for clearer rules but cautioned that overly prescriptive measures could stifle innovation and push research underground.

European Commission officials, speaking on the sidelines, noted that the EU is already drafting binding standards for “high‑risk” AI, and that cooperation with the UK will be essential to avoid regulatory fragmentation.

Broader context of global AI governance

The king’s intervention arrives amid growing alarm over AI’s role in geopolitical competition. The United States, China and the European Union have each released strategy papers outlining both the economic promise of AI and the need for safeguards.

Last month, a United Nations panel warned that autonomous weapon systems could lower the threshold for armed conflict, a scenario that echoes the monarch’s "existential" framing.

Experts such as Professor Stuart Russell of the University of California, Berkeley, have argued that without a global consensus on safety standards, AI could become a “race to the bottom” where nations sacrifice oversight for strategic advantage.

King Charles, who has championed environmental and digital ethics causes for decades, said the summit underscored a moral imperative: "We must ensure that the benefits of AI are shared widely and that its dangers are not left to chance."

With the UK’s AI strategy expected to be published in the coming months, the monarch’s remarks are likely to shape the tone of forthcoming legislation and may push other nations to accelerate their own policy work.