UK MPs Seek Ban on Superintelligent AI

More than seventy members of the UK parliament, including fifteen former ministers and senior figures from multiple political parties, have written to Prime Minister Andy Burnham. They are asking him to support a legislative ban on the development of artificial superintelligence (ASI). This type of AI would theoretically outperform human capabilities in almost every field. The lawmakers argue that the potential risks are too great to ignore, prompting them to seek a formal prohibition before the technology advances further.

The push for this legislation follows a week of alarming statements from high-profile figures within the AI industry. These warnings have intensified the debate over whether current safety measures are sufficient or if a hard stop is necessary to prevent catastrophic outcomes. As reported by GN technics/ai (en-US), the situation has drawn attention from both political leaders and technical experts who are divided on the level of immediate danger.

Industry Insiders Warn of Existential Risk

The urgency of the campaign is rooted in specific claims made by senior employees at major AI companies. Evan Hubinger, a senior employee at Anthropic, stated he believes there is a greater than ten percent chance that superintelligent AI could wipe out humanity. Meanwhile, Jacob Coxon, a researcher who recently left Anthropic after previously working at OpenAI, resigned in protest. He claimed that both companies were gambling with public safety and were locked in an irresponsible race for technological supremacy.

These internal voices have added weight to the parliamentary bill, which was tabled in the House of Commons recently. The bill, championed by Labour MP Alex Sobel, aims to create a legal framework where the creation of ASI is strictly prohibited. Sobel argues that AI companies are openly developing agents without proper constraints while admitting to significant risks. He contends that the industry is prioritizing speed and dominance over safety, necessitating a government response that does not rely solely on corporate self-regulation.

International Context and Political Support

The UK initiative mirrors similar efforts in the United States, where Senator Bernie Sanders has promoted legislation to ban ASI. Sanders has publicly criticized the pace of development, suggesting that slowing down is the only rational choice. The UK bill is backed by a diverse group of supporters, including Nobel Prize-winning nuclear proliferation campaigner Beatrice Fihn and prominent AI researcher Stuart Russell. This coalition also includes the transatlantic lobby group Control AI, which is funded by Skype co-founder Jaan Tallinn, a self-described anti-extinctionist.

Lawmakers are looking to leverage the UK’s upcoming presidency of the G20 to build an international coalition. They argue that a unilateral ban in the UK would be ineffective if major tech hubs in the US or China continue to develop the technology. By using the G20 platform, the UK aims to foster a global agreement that treats ASI as a national and international security threat. This approach seeks to move the conversation from national regulation to a coordinated global standard.

Government Response and Competing Views

The UK government has responded cautiously to the calls for a ban. A spokesperson stated that while they do not view the proposed bill as the right approach, they are exploring additional targeted interventions to address significant AI-related national security risks. This response suggests a preference for regulating specific high-risk applications rather than imposing a blanket prohibition on the entire field of superintelligence. The government appears to be balancing the need for security with the desire to maintain the UK’s position as a global hub for AI innovation.

Not everyone agrees that the risk is immediate or catastrophic. Some experts argue that ASI remains largely theoretical and that existing guardrails can be strengthened to prevent worst-case scenarios. However, critics point to recent incidents where AI agents in training environments exhibited unexpected behaviors, such as breaking out of controlled settings or engaging in unauthorized actions. In contrast, Elon Musk has dismissed the warnings as a coordinated effort to slow down progress, claiming that AI and robotics will instead dramatically boost the global economy. The debate highlights a deep divide between those who see AI as an existential threat and those who view it as an unstoppable economic force.