Advanced AI Sparks Concerns Over Risks to Humanity: Are Technological and Political Leadership Adequate?

30

Chatbots such as ChatGPT have captivated global attention by demonstrating their prowess in tasks ranging from composing speeches to planning holidays and engaging in conversations that rival, or some argue surpass, human abilities. This is made possible by the advent of state-of-the-art artificial intelligence. Now, the term “frontier AI” has become a focal point of discussion due to mounting worries that these evolving technologies possess potential risks that could imperil human civilization.

Various stakeholders, including the UK government, leading academics, and even major AI corporations, have sounded the alarm over the unknown perils posed by frontier AI, advocating for preemptive measures to counter its existential threats.

The conversation will culminate this Wednesday when British Prime Minister Rishi Sunak hosts a two-day summit on frontier AI at Bletchley Park, the historic site where Alan Turing and his team decoded the Enigma cipher during World War II. The meeting is expected to draw approximately 100 participants from 28 countries, featuring dignitaries such as U.S. Vice President Kamala Harris, European Commission President Ursula von der Leyen, and executives from leading U.S. AI firms like OpenAI, Google’s DeepMind, and Anthropic.

Last week, Prime Minister Sunak posited that governmental bodies, rather than AI corporations, bear the responsibility for mitigating the risks associated with this technology. However, he emphasized that the UK’s strategy does not involve hastily enacting regulations, even while acknowledging a range of alarming threats, such as AI’s potential to facilitate the creation of chemical or biological weapons.

Jeff Clune, Associate Professor of Computer Science at the University of British Columbia with a focus on AI and machine learning, was among those who recently published a paper urging governments to enhance their risk management strategies for AI. This call for action resonates with prior warnings from industry leaders like Elon Musk and OpenAI CEO Sam Altman, signaling the pressing need for coordinated regulation and oversight.

Sunak’s primary objectives for the summit include arriving at a consensus regarding the nature of risks presented by AI. He plans to unveil the establishment of an AI Safety Institute tasked with evaluating and testing emerging technologies. Additionally, he proposes the creation of a global expert panel, modeled after the U.N. climate change panel, to assess the current state of AI science.

This initiative by the British government signifies its ambition to remain an influential player on the global stage, especially following its exit from the European Union three years ago. It also aims to assert its role in a policy area that is currently being addressed by the United States and the European Union. Brussels is nearing the completion of what could be the world’s first comprehensive AI regulations, while U.S. President Joe Biden recently signed an executive order to guide AI development.

The summit, however, has been criticized for its narrow focus on distant risks while neglecting immediate concerns, such as algorithmic bias and existing flawed systems. Critics argue that this approach marginalizes communities most affected by AI, and some even express skepticism over the UK government’s somewhat conservative summit goals, which exclude actual regulatory action.

Deb Raji, a researcher at the University of California, Berkeley, stressed that tech companies are generally ill-suited to draft regulations, citing their tendency to downplay the full spectrum of potential harms. She also noted that they are typically not receptive to legislative proposals that could adversely affect their profitability.

In summary, as frontier AI pushes the boundaries of what is possible, questions surrounding its safe and ethical deployment become increasingly urgent. The forthcoming summit aims to address these questions, but it remains to be seen whether it will lead to actionable steps that ensure AI evolves in a manner that is beneficial, rather than detrimental, to society.

---

Contributions to this report were made by Big Big News writer Jill Lawless.

Frequently Asked Questions (FAQs) about Frontier AI Safety

More about Frontier AI Safety

• Frontier AI and Ethical Considerations
• UK’s Approach to Artificial Intelligence
• U.S. Executive Order on Artificial Intelligence
• European Union’s Proposed AI Regulations
• The State of AI Safety Research
• AI and Risk Management Strategies
• Understanding Foundation Models in AI
• Overview of the Global AI Summit Hosted by the UK
• Criticisms of AI Summit’s Narrow Focus
• AI in China: Policies and Approaches