Robust and Secure AI
• SEI Report
Publisher
Software Engineering Institute
Topic or Tag
Abstract
Robust and secure AI systems are AI systems that reliably operate at expected levels of performance, even when faced with uncertainty and in the presence of danger or threat. These systems have built-in structures, mechanisms, or mitigations to prevent, avoid, or provide resilience to dangers from a particular threat model. We identify three specific areas of focus to advance Robust and Secure AI for defense and national security:
- Improving the robustness of AI components and systems
- Designing for security challenges in modern AI systems
- Developing processes and tools for testing, evaluating, and analyzing AI systems
For each area, we identify ongoing work as well as challenges and opportunities in developing and deploying AI systems with confidence.
Cite This SEI Report
Barmer, H., Dzombak, R., Gaston, M., Heim, E., Palat, J., Redner, F., Smith, T., & VanHoudnos, N. (2021, June 25). Robust and Secure AI. Retrieved August 18, 2026, from https://www.sei.cmu.edu/library/robust-and-secure-ai/.
@techreport{barmer_2021,
author={Barmer, Hollen and Dzombak, Rachel and Gaston, Matt and Heim, Eric and Palat, Jay and Redner, Frank and Smith, Tanisha and VanHoudnos, Nathan},
title={Robust and Secure AI},
month={Jun},
year={2021},
institution={Software Engineering Institute, Carnegie Mellon University},
url={https://www.sei.cmu.edu/library/robust-and-secure-ai/},
note={Accessed: 2026-Aug-18}
}
Barmer, Hollen, Rachel Dzombak, Matt Gaston, Eric Heim, Jay Palat, Frank Redner, Tanisha Smith, and Nathan VanHoudnos. "Robust and Secure AI." Software Engineering Institute, Carnegie Mellon University. Software Engineering Institute, June 25, 2021. https://www.sei.cmu.edu/library/robust-and-secure-ai/.
H. Barmer, R. Dzombak, M. Gaston, E. Heim, J. Palat, F. Redner, T. Smith, and N. VanHoudnos, "Robust and Secure AI," Software Engineering Institute, Carnegie Mellon University. Software Engineering Institute, 25-Jun-2021 [Online]. Available: https://www.sei.cmu.edu/library/robust-and-secure-ai/. [Accessed: 18-Aug-2026].
Barmer, Hollen, Rachel Dzombak, Matt Gaston, Eric Heim, Jay Palat, Frank Redner, Tanisha Smith, and Nathan VanHoudnos. "Robust and Secure AI." Software Engineering Institute, Carnegie Mellon University, Software Engineering Institute, 25 Jun. 2021. https://www.sei.cmu.edu/library/robust-and-secure-ai/. Accessed 18 Aug. 2026.
Barmer, Hollen; Dzombak, Rachel; Gaston, Matt; Heim, Eric; Palat, Jay; Redner, Frank; Smith, Tanisha; & VanHoudnos, Nathan. Robust and Secure AI. Software Engineering Institute. 2021. https://www.sei.cmu.edu/library/robust-and-secure-ai/