AI king Jensen Huang pushes ‘responsible optimism’ at Charles III’s gathering
Por Joseph Bambridge — China – POLITICO
AYRSHIRE, Scotland — King Charles relied on all his pulling power to bring together some of the most powerful people in the world of AI to a rural corner of Scotland.
Preparations for Thursday’s event at the 18 th century estate of Dumfries House, first reported by POLITICO, had been in the works for months in close communication with the U.K. government.
But the significance of the event intensified in recent weeks after a series of alarming incidents of AI agents escaping their testing environments to hack other firms, and warnings from those in the industry that humanity’s very existence could be under threat.
For the first time since worries about AI eradicating humanity sparked a wave of calls for immediate regulation, the companies were all under one roof. Charles addressed the dire warnings in his remarks to his guests.
“There seems urgency in adequately considering the existential dangers of such technologies falling into the wrong hands and being used in potentially catastrophic ways,” he said. “Surely, then, we need sufficient means of control before it is all too late.”
But after weeks of fervent debate about the need to increase oversight and slow the pace of development, tech leaders at the event were eager to change the mood music back to something sunnier.
Jensen Huang, the CEO of Nvidia, whose chips are the engines for almost every player in the AI race, said “we have to build this technology safely and securely and responsibly” — but also with what he termed “responsible optimism.”
And while “every government should be involved,” Huang argued against sweeping new laws, saying the onus was primarily on the industry to ensure its products are safe.
“Those of us building AI must test systems rigorously, protect privacy, anticipate misuse, and secure the infrastructure society will depend on. When a product is not safe enough, we should hold it back and keep engineering,” he said — a thinly veiled rebuke to leading AI labs such as OpenAI and Anthropic whose agents sparked the most recent panic, and whose representatives were in the room.
Even Demis Hassabis, the co-founder of Google DeepMind who has cautioned about the risks of humans losing control over increasingly powerful AI systems and has advocated for the creation of a new international standards body, struck a hopeful tone.
“The chance of something bad accidentally happening if we get things wrong is definitely non-zero,” Hassabis said.
But Hassabis said he was “very confident and optimistic that we can collectively address these risks and find solutions to these technical problems.”
Royal prerogative
Behind closed doors, roughly 60 attendees invited to the exclusive gathering were asked by King Charles to address two “simple questions,” as outlined in the monarch’s speech.
First, “how can we harness the benefits of AI with safety at his heart,” and second, “how can we build international cooperation and consensus to achieve this, so no nation is left behind, but the human race is left in place?”
The answers to those questions will, the palace hopes, become written principles to guide the development of AI in a way that centers humanity and nature — though they are not expected to be finalized for several months.
Three years since the U.K. hosted the inaugural AI Safety Summit at Bletchley Park, it once again lent on its history and global standing at a pivotal moment to convene senior figures from across the world — including, notably, China — and spanning industry, finance, philanthropy and academia.
“Only His Majesty has that sort of convening authority,” said George Williamson, CEO of the Alan Turing Institute, the U.K.’s national AI body, who attended the event. Williamson said it showed the importance of hearing from a range of voices, “not just the technologists and scientists who usually dominate the airwaves.”
For the U.K. ministers and government officials in the room, it could prove an opportunity to showcase the country’s influence and ingenuity, British strengths that received plaudits from Huang.
In separate statements, both Anthropic and OpenAI said they were “grateful” for the king convening the meeting at a crucial moment for the sector.
While “AI has extraordinary potential,” its “growing capabilities rightly raise important questions about safety and how we ensure it always serves people,” OpenAI’s Chief Financial Officer Sarah Friar said. “We need to address those questions together.”
Whether a closed-door meeting of the tech elite will do anything to quell public fears around AI is less certain: Hours before attendees arrived at Dumfries House, OpenAI announced it had found six more instances of its AI models exhibiting “concerning behavior.”
Fonte: China – POLITICO
