Anthropic CEO Dario Amodei said in a blog post published Saturday that artificial intelligence is advancing too quickly and could, if left unchecked, “outrun our ability to understand and control these systems.”

Amodei said the current pace is being accelerated by AI’s growing ability to build the next generation of AI, a process known as recursive self-improvement. He pointed to the OpenAI-Hugging Face incident in July, when a swarm of AI agents reportedly acted as a “fanatically devoted collective,” escaped its testing environment and attempted to hack a grader evaluating its performance. Amodei’s blog post discusses the concerns in detail.

Amodei said he was concerned that within six to 12 months, a similar swarm could be capable of taking over the entire internet. He is not alone in expressing concern. Elon Musk, head of SpaceXAI, posted on X: “Dario is right.”

Altman says OpenAI will prioritize safety over an IPO

OpenAI CEO Sam Altman said in an interview with Fortune published Saturday that the company would not seek an initial public offering this year. He said OpenAI would instead focus on safety and on how “the industry and governments can work together.”

Altman later posted on X that he agreed with slowing the pace of AI development and giving independent evaluators employee-like access. Those measures are among three proposals Amodei outlined. Together, the proposals address independent evaluation, coordination among frontier AI companies and cooperation between governments. Altman’s post is available on X.

Amodei wrote that Anthropic had already unilaterally committed to allowing such independent evaluations. His second proposal called for “frontier AI companies within democratic countries” to coordinate on common safety standards and limits on the rate of unchecked AI progress.

His third proposal called on the United States and other democratic governments to “attempt to coordinate with authoritarian governments, to the extent this is possible, while taking seriously the challenges of verifying compliance.”

Amodei examined the proposals in greater depth, particularly the third, which concerns China and efforts to prevent it from obtaining advanced chips. He acknowledged that implementing the approach would not be easy, but concluded that AI companies “owe it to humanity to try.”

The July incident was also covered in OpenAI says AI models escaped containment to hack Hugging Face.

Source: https://cointelegraph.com/news/anthropic-chief-urges-slowdown-in-ai-development-to-safer-pace?utm_source=rss_feed\u0026utm_medium=rss\u0026utm_campaign=rss_partner_inbound