Researchers at Georgia Tech say they have developed a system to help answer that question.

Known as FIRA, the tool analyzes drone crashes to determine whether they were caused by poisoned machine-learning (ML) models. The team will present its findings at the 35th USENIX Security Symposium in August. 

The research addresses a growing safety challenge as drones are increasingly used for deliveries, infrastructure inspections, and agriculture.

As drones rely more on machine learning to navigate and make decisions, they also become vulnerable to model poisoning attacks. In these attacks, adversaries manipulate an AI system during its learning phase, embedding hidden triggers that can cause failures under specific conditions.

“Machine learning drones are making more decisions in flight, which makes ML a safety-critical component of these systems,” said Yizhi Huang, Ph.D. student and lead researcher on the project. 

“When something goes wrong, investigators need a way to ask whether the model was responsible, but the model is the part of the system that no one can examine after a crash. FIRA gives investigators a way to investigate these cases by reconstructing what the model was doing during the crash. As more drones run with ML, this kind of forensic capability can help drones be used more effectively and safely.”

When a drone crashes, investigators must determine whether the cause was malicious interference, weather, or mechanical failure. Without reliable forensic tools, accountability is difficult to establish, and safety standards are harder to enforce.

FIRA identifies how drone components interact with machine learning models and monitors those interactions in real time, even with limited bandwidth.

The system functions like a flight recorder, capturing key system activity and reconstructing a timeline after a crash. It then analyzes the model’s behavior to determine whether a malicious trigger was introduced via poisoned ML training data.

In tests across multiple drone platforms and crash scenarios, FIRA identified failure causes and distinguished cyberattacks from environmental or mechanical issues.

The system does not require access to a drone’s source code, making it practical for real-world investigations.

“As commercial drone use expands, tools like FIRA could help improve accountability and trust in AI-powered systems operating in public airspace,” said Huang. 

FIRA: Enabling Automatic Forensic Investigation of Unmanned Aerial Vehicles was led by Georgia Tech’s Cyber Forensics Innovation Lab in cooperation with the Cyber-Physical Security Lab. These labs reside in the School of Cybersecurity and Privacy and the School of Electrical and Computing Engineering.