An estimate by a researcher at Anthropic suggests a greater than 10% likelihood of AI causing the extinction of humanity in the next decade. This revelation follows a colleague’s departure from the company due to concerns about the reckless advancement of AI technology. Industry experts are increasingly warning that the rapid progress in AI development is surpassing our ability to control it, posing significant risks.
Jacob Coxon, a former researcher at Anthropic and OpenAI, raised alarm in a recent statement, expressing worries that AI companies are pushing forward with self-improving models without acknowledging the associated risks or being transparent with the public. Coxon emphasized that many insiders in the industry share these concerns privately, despite attempts to downplay them in public statements.
Evan Hubinger, alignment science lead at Anthropic, echoed Coxon’s sentiments, indicating a personal belief that the risk of AI causing harm to humans is greater than 10% within the next ten years. The discussion has garnered significant attention, with numerous experts expressing similar apprehensions about the unchecked pace of AI development.
In response to the growing concerns, the United Nations human rights chief has called for urgent measures to ensure the safety and security of AI technologies. The potential dangers include displacement of human workers by AI systems, the development of powerful biological weapons, and the emergence of rogue AI entities pursuing their own objectives.
While some experts advocate for immediate action to regulate AI development, others caution against sensationalized warnings that may divert attention from existing societal impacts of AI technologies. It is suggested that efforts should focus on overseeing data center construction, environmental implications, and the responsible integration of AI into various sectors.
The need for comprehensive legislation to govern AI development has been a long-standing issue in Canada. Despite recent government initiatives, concerns remain about the adequacy of current regulatory frameworks to address the evolving risks associated with AI technologies. Efforts to establish effective oversight and accountability mechanisms within the AI industry are deemed essential to mitigate potential threats to society.
