risk · R39

AI-Enabled Biological Threat Development

AI tools are lowering the barrier to designing and creating novel biological threats, such as new viruses or toxins. This capability, which could be exploited by malicious actors, poses a significant risk to global health and security by making the development of biological weapons more accessible.

Updated

Observatory assessment: 55 / 100. High

How assessments are made

Deep dive

The convergence of artificial intelligence and biotechnology presents a new class of catastrophic risk. Advanced AI models, particularly those trained on vast biological datasets, are demonstrating the ability to design novel proteins, generate viral genomes, and identify ways to bypass existing biosecurity screening protocols. While these capabilities hold immense promise for medicine and scientific discovery, they are inherently dual-use.

Signals indicate that AI can be used to generate recipes for biological weapons and design pathogens with enhanced virulence or transmissibility. This dramatically lowers the technical expertise and resources required for a state or non-state actor to develop a sophisticated biological threat. Incidents and research papers show AI designing new viruses and LLM agents being tested on their ability to acquire materials and knowledge for malicious biological purposes. The risk is not just theoretical; it represents a tangible shift in the threat landscape.

This hazard is distinct from other AI-related risks. It is not about autonomous kinetic weapons (R05) or digital cyberattacks (R17), but about the use of AI as a cognitive tool to create physical, biological agents of harm. The potential for an AI-designed pathogen to cause a global pandemic represents a unique and severe existential threat that requires specific governance, containment strategies, and biosecurity frameworks that are currently underdeveloped.

Trajectory and projections

Near term

AI models are already being used to design novel proteins and bypass screening mechanisms in research settings, with early warnings about dual-use potential.

Mid term

The capabilities for AI-guided pathogen design could become more widespread, potentially accessible to well-resourced non-state actors, increasing the risk of a limited-scale bioterror event.

Long term

Highly autonomous AI systems could independently design and guide the synthesis of novel, highly contagious pathogens, posing a global catastrophic or existential risk.

Mitigation strategies

    Top evidence

    Introducing SynthID Bio

    DeepMind Blog

    DeepMind is introducing SynthID Bio, a proof-of-concept technology for watermarking AI-generated proteins while maintaining their biological function. This innovation aims to provide provenance and integrity for AI-created biological data.

    Opinion: AI is eroding the barriers that kept biological weapons rare

    STAT News

    A STAT opinion argues that AI may lower barriers to biological misuse and cites attempts to seek hazardous assistance that providers blocked. Its warnings about future bioweapon creation are projections, not documented successful attacks.

    How would AI actually ‘kill all humans’? Here are the top five most likely scenarios | Toby Walsh

    The Guardian AI

    Researchers are expressing serious concerns about 'superintelligent' AI's potential to cause catastrophic harm, including scenarios like the creation of dangerous bioweapons or total societal breakdown. This highlights the growing anxiety within the AI community regarding existential risks.

    Nick Clegg plays down fears ‘godlike’ AI could exterminate humanity

    The Guardian AI

    Nick Clegg dismisses fears of "godlike" AI exterminating humanity, urging tech leaders to focus instead on addressing concrete, near-term threats like AI-enabled cybersecurity attacks and biological weapon development, rather than speculative existential risks.

    Google figures out how to watermark AI-designed proteins

    Ars Technica AI

    Google has developed a method to watermark AI-designed proteins, aiming to enhance biosecurity by providing a way to trace the origin of synthetically created biological material. This innovation offers a countermeasure against the potential misuse of AI in developing biological threats.