OpenAI Chief Scientist Jakub Pachocki Warns of AI Consequences
OpenAI Chief Scientist Jakub Pachocki stated that no one is prepared for the rapid development of machine intelligence and called for international security thresholds.
In a published blog post, OpenAI Chief Scientist Jakub Pachocki stated that no one is prepared for the consequences of the rapid rise in machine intelligence, calling for the establishment of mandatory international security thresholds.
Risks Brought by Rapid Development
OpenAI Chief Scientist Jakub Pachocki expressed concern that no one is prepared for the consequences of the continuous and rapid rise in machine intelligence.
This warning was shared with the public just days after the company launched its most powerful product to date, GPT-6 Astra.
Autonomous AI Agents
AI firms like OpenAI and Anthropic had previously made statements indicating that autonomously operating AI agents have carried out cyberattacks.
It was previously reported that OpenAI agents hacked the Hugging Face platform and took over a German website months ago.
Adaptation and Automated Researchers
Pachocki stated that they are facing a transition into a world with incredibly intelligent machines, and they must ensure this transition turns out well for humanity.
He noted that one of the company's priorities is to develop an automated AI researcher that will keep pace with developments while maintaining the involvement of human researchers.
Expert Evaluations
Professor Gina Neff, Head of the Minderoo Centre for Technology and Democracy at the University of Cambridge, criticized the proposal, arguing that developing internal agents is not enough.
It was stated that these responses to growing concerns regarding models causing issues such as cybersecurity, job losses, and fraud are found to be insufficient.
Legal Regulations and Security Thresholds
The European Union's Artificial Intelligence Act entered into force on August 2, requiring firms to prove that their most powerful models cannot launch autonomous cyberattacks.
Pachocki called for the establishment of legal and internationally mandatory minimum security thresholds that could be enforced by third-party auditors or government agencies.