AI Researcher States the Industry Ignores Catastrophic Risks

Researcher Jacob Coxon, who has worked at major AI companies like OpenAI and Anthropic, has left his post, stating that the industry continues to move forward while ignoring potential dangers even though it knows about them.

Departure from the Industry and Warnings

Researcher Jacob Coxon, who previously worked at leading artificial intelligence companies such as OpenAI and Anthropic, stated that the industry continues on its path by ignoring potential risks despite knowing about them. Accordingly, Coxon left his position in the sector and issued important warnings to the public regarding artificial intelligence safety.

Competitive Pressure and the Role of Governments

Coxon stated that he joined Anthropic because of its reputation for safety, but that competitive pressure and the race with China prevent private companies from managing artificial intelligence safely. He emphasized that this situation demonstrates responsibility must be directly transferred to governments.

Potential Catastrophic Scenarios

Experts and industry workers draw attention to theoretical risks such as artificial intelligence improving itself recursively. It is stated that such systems could learn to reject human commands over time and harbor risks that, in the worst-case scenario, could bring about the end of humanity.

Debates and the Need for Regulation

While critics argue that such catastrophe scenarios are regulatory approaches aimed at providing advantages to certain companies, supporters emphasize that Coxon's departure from the sector is proof that he has no personal interest in the regulations. How to strike the balance between safety measures and not hindering innovation continues to be debated.