Of all the ways people might misuse AI, one stands apart in consequence. A model that made it materially easier for a small group to cause a pandemic or a mass-casualty chemical attack would contribute to harm on a scale that no fraud, intrusion or disinformation campaign could match. It is also the hardest claim to test, because the evidence that would settle it cannot responsibly be produced and those who know most about the models have commercial interests in the answer.
This chapter examines the question of uplift: whether access to an AI system meaningfully increases a person's ability to cause biological or chemical harm beyond what the same person could achieve with the internet, reference works and ordinary effort. It tests two tropes from Chapter 2. T6 The weapon in human hands appears here at its most extreme. T5 The intelligence explosion enters in a narrower form: the concern that AI which accelerates science in general may accelerate dangerous science too, and that capability can outrun the evaluations meant to detect it. The chapter also takes up Q10: how a board should treat a risk that is low in estimated probability, extreme in consequence and contested among experts. Its handling is a template for the others in Part V.
Table 19.1: Safeguards by layer.
Primary topics explored
- Why this chapter carries no technical detail
- The dual-use warning
- Measuring uplift, and why it resists measurement
- Thresholds in frontier safety frameworks
- Systemic risk under the AI Act
- What organisations can do
About AI Threat
AI Threat is Book 5 of The Transformed Architecture. It investigates whether the dystopias of science fiction, with AI as the threat, are coming true. It covers every scale of the threat, from the human mind and society to misuse, machines beyond control and the end of the world, stages every debate constructively, and turns the verdict into what individuals, European enterprises and public authorities can do.
It builds on the conclusions of Architecture as Code, AI Governance, AI Platform and Security and AI Red Team.
Boards, chief risk officers, CISOs, AI governance leads, architects and public-sector leaders.
Gunnar Nordqvist
Conceived, directed and published the books of The Transformed Architecture.
Continue with the full chapter
Chapter 19: Biological and Chemical Uplift: The Hardest Question to Test in AI Threat gives the detailed explanations, practical examples and implementation patterns behind this summary.
This whitepaper belongs to “Humans Wielding Machines” and is one of 39 drawn from the manuscript.