A new Challenge Fund launched under the AI Security Institute is set to focus on areas critical to the UK’s national security such as AI misuse, bolstering public confidence in the technology and leading to greater AI adoption across the economy.

Researchers looking into AI security threats, such as protecting critical systems from failure and preventing AI misuse, can now apply for fresh funding to strengthen UK defences, as part of a £5 million programme.  

The Challenge Fund will be led by the UK's AI Security Institute and will award grants of up to £200,000 per project.

Minister for AI and digital government, Feryal Clark said: "AI is at the heart of our Plan for Change - driving economic growth, creating jobs, and transforming public services for people across the country. But to unlock its full potential, we must ensure AI systems are secure, resilient, and trusted – with safety baked in from the start.

"This fund supports world-class research to tackle the toughest safety and security challenges in AI, protecting critical infrastructure and removing barriers to adoption. By addressing these challenges head-on, we’re laying the foundations for AI to boost productivity, strengthen public services and power a decade of national renewal."

AI Security Institute chair Ian Hogarth said: "This fund directly supports researchers seeking to understand and address the most urgent AI risks - whether that’s ensuring AI systems remain resilient against misuse, ensuring human oversight over autonomous systems or strengthening our society against emerging threats.

"Making sure AI systems are aligned and operate with human oversight are 2 of the key open questions in technical AI safety. By funding high-impact research across these priority areas, we’re building the evidence base needed to develop a robust understanding of, and real-world solutions for, the most urgent security risks AI presents."