Critical warnings from AI whistleblower at NYC hearing
Former Anthropic researcher Jacob Coxon stated at a New York City Council hearing that AI companies are acting overly recklessly and that humanity faces the risk of extinction.
Former Anthropic researcher and whistleblower Jacob Coxon emphasized at a New York City Council hearing on AI regulations and kill switches that artificial intelligence technology carries the risk of wiping out humanity.
Striking Claims at the Hearing
Former Anthropic researcher Jacob Coxon stated during the New York City Council hearing on Monday that artificial intelligence companies are operating with an overly reckless startup mindset.
Coxon noted that researchers are beginning to lose full control over AI systems, and a large portion of the code is now written by AI without careful audits.
Views of Other Experts
Former Google DeepMind researcher Alex Turner and former OpenAI researcher Daniel Kokotajlo, who also participated in the hearing, testified virtually about the societal risks posed by rapidly advancing AI.
Turner estimated that the probability of AI getting out of control is roughly one in three, while Kokotajlo warned against failing to grant regulatory power to technology leaders.
Corporate Participation and New Regulations
Representatives from Anthropic, OpenAI, Google, and Meta attended the hearing following the City Council's threat of subpoenas.
NYC politicians are debating a legislative package aimed at regulating AI in the city, which includes provisions such as mandatory kill switches and external expert audits.