Artificial intelligence (AI) giant Anthropic on June 4 called for industry leaders worldwide to slow down the development pace of the technology, warning that the models are reaching a point where they could soon independently improve themselves, potentially taking control out of the hands of humanity.
Anthropic, maker of the popular Claude chatbot, described in a blog post how continuing to delegate the development of AI to the systems themselves risks creating a technology that is “capable of fully autonomously designing and developing its own successor.”
“This is called recursive self-improvement,” Anthropic’s Marina Favaro and Jack Clark wrote in the post. “We are not there yet, and recursive self-improvement is not inevitable. But it could come sooner than most institutions are prepared for.”…