Anthropic CEO seeks immediate slowdown on AI

0

Por Ben JohansenPOLITICO – TOP Stories

openai-anthropic-rivalry-16169.jpg

Anthropic CEO Dario Amodei on Saturday called for the immediate slowdown of artificial intelligence development, warning that recent advances in AI have begun to outpace the industry’s ability to understand and control the technology.

His words are the latest in a series of calls from within the tech industry calling to slow the pace of the rollout of cutting-edge AI — though that achievement may also require a U.S. agreement for China to do the same.

In recent weeks, Anthropic and its archival OpenAI have disclosed a number of incidents in which their most advanced AI models have carried out cyberattacks without the companies’ knowledge.

In a lengthy essay published Saturday, Amodei argued that simply investing more heavily in AI safety is no longer enough. Instead, he said, companies developing frontier models need to slow the rate at which they increase their capabilities — buying researchers and governments more time to develop safeguards before AI becomes substantially more powerful.

“We must slow the pace at which we improve the capabilities of AI models,” Amodei wrote. “Progress will still seem fast, and we must make wise use of the time we gain.”

The White House did not immediately respond to questions about the post.

Elon Musk, one of the world’s other most prominent figures in AI, backed Amodei’s arguments, saying, “Dario is right.”

It’s a notable escalation from the most significant figures in the AI race. Amodei has long warned about the potential dangers of advanced AI while also arguing that the technology could transform a variety of issues. But Amodei said developments over the past several months have made him rethink the rapid progress.

The biggest change, he argued, is AI’s rapidly growing ability to help build the next generation of AI. That process, often called recursive self-improvement, has accelerated since roughly this summer, he wrote, raising the prospect that improvements in AI could eventually move faster than humans’ ability to understand what increasingly capable systems are doing.

“Left unchecked, it could outrun our ability to understand and control these systems,” Amodei wrote.

Fonte: POLITICO – TOP Stories

Deixe um comentário

O seu endereço de email não será publicado. Campos obrigatórios marcados com *