The technology community on X is grappling with renewed concerns over artificial intelligence safety following the high-profile resignation of AI researcher Jacob Coxon from Anthropic. reported that Coxon "announced his resignation from Anthropic over safety fears on Tuesday in an X post that went viral and sent shock waves through Silicon Valley and beyond."
Coxon's departure has reignited discussions about the potential dangers of rapidly advancing AI. He has outlined specific recommendations, with noting that "As a first step, he recommends that OpenAI and Anthropic limit recursive self improvement—the industry term for when AI is used to build new AI systems." Coxon also highlighted the potential for AI-enabled biological threats or cyberweapons. While acknowledging differences between leading AI developers, stated that "Coxon claims that, in his experience, Anthropic operates more responsibly than OpenAI, but he expects both companies could cut corners in the future if nothing is done to slow their race for dominance."
The sentiment that AI poses significant risks appears to be shared by many within the field. further reported that "The AI alignment lead at Anthropic predicted in a post on X that there’s a greater than 10% chance that AI could kill all people in the next decade." This alarm comes amidst ongoing incidents, with reporting that "Anthropic reveals fourth likely crime committed by its AI."
The industry's focus on AI alignment and safety remains critical. In a related development, reported that "Paul Christiano, an influential AI researcher focused on alignment, is joining the OpenAI Foundation as a member of its board." These movements underscore the urgency felt by some researchers as AI companies continue to develop increasingly powerful models.
