Most of the AI that defends a large European organisation was not built by it. It arrives inside the endpoint agent, the email gateway and the SIEM, runs in the managed security service that watches the estate at night, and, where the organisation builds its own, rests on outside models and services. A security function can therefore use AI extensively without having decided to, and a supplier can change what that AI does without telling anyone. The management body, which carries legal responsibility for cybersecurity, must be able to see this and decide on it. This chapter shows how it oversees AI in cyber defence, and how supply-chain risk is managed for models, AI services, security products and managed security service providers (MSSPs).
In CSF terms the chapter is responsible for two Govern Categories. GV.OV Oversight covers the review of the cybersecurity risk management strategy, its outcomes and performance, so that the strategy is adjusted when results or risks change. GV.SC Cybersecurity Supply Chain Risk Management covers the supply-chain programme: its strategy and roles, the prioritisation of suppliers, requirements in contracts, due diligence, monitoring, the inclusion of suppliers in incident response, and what happens when a relationship ends (19, NIST, 2024). The chapter treats both through the three focus areas of the NIST Cyber AI Profile (20, NIST, 2025).
Both European instruments that govern the example organisations' cybersecurity put the duty at the top. NIS 2 requires the management bodies of essential and important entities to approve the cybersecurity risk-management measures, oversee their implementation and be accountable for infringements, and requires their members to follow training (Article 20) (3, European Union, 2022). DORA places ultimate responsibility for a financial entity's ICT risk management framework on its management body, including the policy on the use of third-party ICT services (Article 5) (2, European Union, 2022). Neither mentions security AI, yet both make it the management body's concern as soon as AI forms part of the measures or the third-party services that body relies on.
Primary topics explored
- Oversight by the management body
- AI in the supply chain
- Who tests what
- Contract and register
- Change-triggered reassessment
- Summary
About AI Red Team
AI Red Team is Book 4 of The Transformed Architecture. It shows how large European enterprises and public authorities put artificial intelligence to work as an active part of cyber defence: AI-assisted red teaming and adversary emulation, red teaming of AI systems themselves, the AI-assisted security operations centre, detection engineering, threat intelligence, incident response and purple teaming, all under a lawful mandate and with evidence a supervisor can inspect.
It builds on the conclusions of Architecture as Code, AI Governance and AI Platform and Security.
CISOs, SOC leads, red and blue team practitioners, security architects, AI architects and technical decision-makers.
Gunnar Nordqvist
Conceived, directed and published the books of The Transformed Architecture.
Continue with the full chapter
Chapter 8: Oversight and AI Supply Chain Risk in AI Red Team gives the detailed explanations, practical examples and implementation patterns behind this summary.
This whitepaper belongs to “Govern” and is one of 32 drawn from the manuscript.