Scalable AI

SEI Report
This paper discusses Scalable AI: the ability of AI algorithms, data, models, and infrastructure to operate at the size, speed, and complexity required for the mission.
Publisher

Software Engineering Institute

Abstract

Scalable AI is the ability of AI algorithms, data, models, and infrastructure to operate at the size, speed, and complexity required for the mission. Scalability is a critical concept in many engineering disciplines and is crucial to realizing operational AI capabilities. We identify three areas of focus to advance scalable AI:

  • Scalable management of data and models to overcome data scarcity and collection challenges
  • Enterprise scalability of AI development and deployment 
  • Scalable algorithms and infrastructure

For each area, we identify ongoing work as well as challenges and opportunities in developing and deploying AI systems at scale.

Cite This SEI Report

Barmer, H., Dzombak, R., Gaston, M., Palat, J., Redner, F., Smith, T., & Wohlbier, J. (2021, June 25). Scalable AI. Retrieved August 18, 2026, from https://www.sei.cmu.edu/library/scalable-ai/.

@techreport{barmer_2021,
author={Barmer, Hollen and Dzombak, Rachel and Gaston, Matt and Palat, Jay and Redner, Frank and Smith, Tanisha and Wohlbier, John},
title={Scalable AI},
month={Jun},
year={2021},
institution={Software Engineering Institute, Carnegie Mellon University},
url={https://www.sei.cmu.edu/library/scalable-ai/},
note={Accessed: 2026-Aug-18}
}

Barmer, Hollen, Rachel Dzombak, Matt Gaston, Jay Palat, Frank Redner, Tanisha Smith, and John Wohlbier. "Scalable AI." Software Engineering Institute, Carnegie Mellon University. Software Engineering Institute, June 25, 2021. https://www.sei.cmu.edu/library/scalable-ai/.

H. Barmer, R. Dzombak, M. Gaston, J. Palat, F. Redner, T. Smith, and J. Wohlbier, "Scalable AI," Software Engineering Institute, Carnegie Mellon University. Software Engineering Institute, 25-Jun-2021 [Online]. Available: https://www.sei.cmu.edu/library/scalable-ai/. [Accessed: 18-Aug-2026].

Barmer, Hollen, Rachel Dzombak, Matt Gaston, Jay Palat, Frank Redner, Tanisha Smith, and John Wohlbier. "Scalable AI." Software Engineering Institute, Carnegie Mellon University, Software Engineering Institute, 25 Jun. 2021. https://www.sei.cmu.edu/library/scalable-ai/. Accessed 18 Aug. 2026.

Barmer, Hollen; Dzombak, Rachel; Gaston, Matt; Palat, Jay; Redner, Frank; Smith, Tanisha; & Wohlbier, John. Scalable AI. Software Engineering Institute. 2021. https://www.sei.cmu.edu/library/scalable-ai/