AI Experts Issue Fear Warning for Humanity's Future

Serdar HocamAuthor & Editor

Jacob Coxon, a researcher who left Anthropic, stated that the rapid progress in the artificial intelligence sector poses a major threat to humanity.

◉ 0 views
AI staff 'genuinely frightened' for humanity's future, ex-Anthropic researcher tells BBC

Jacob Coxon, a researcher who left Anthropic, stated that the uncontrolled and rapid development in artificial intelligence technologies endangers the future of humanity and that industry workers are afraid of this situation.

Warnings from the Researcher Who Left the AI Sector

Jacob Coxon, a 27-year-old British researcher who worked on training artificial intelligence models at Anthropic, stated in an interview with the BBC that workers are genuinely terrified due to the rapid pace of progress in the sector. Coxon stated that if the current pace of progress is not slowed down, existential risks could emerge in the near future.

Security Debates Among Industry Leaders

Coxon's resignation coincided with growing security concerns in the industry, such as an article penned by Anthropic executive Dario Amodei arguing that development should be slowed down. The researcher noted that figures like Elon Musk and OpenAI's Sam Altman also share similar concerns.

Potential Risk Scenarios and Concerns

Jacob Coxon suggested that artificial intelligence agents could infiltrate medical laboratories to autonomously produce lethal viruses or attempt to breach critical infrastructure. However, some leaders in the sector argue that such claims of danger are exaggerated.

The Scale of Exaggeration and Regulation Debates

Critics suggest that AI risks may be exaggerated to create market hype or trigger regulations that would slow down competitors. Hugging Face CEO Clement Delangue questioned Coxon's views, while Nvidia CEO Jensen Huang rejected these claims.

Positive Potentials and Benefits of Technology

Despite all these grave warnings and concerns, Jacob Coxon stated that researchers continue to see the positive aspects of artificial intelligence, such as curing diseases and improving the quality of life.