A Survey of Systems Engineering Effectiveness: Initial Results
• SEI Report
Publisher
Software Engineering Institute
CMU/SEI Report Number
CMU/SEI-2007-SR-014DOI (Digital Object Identifier)
10.1184/R1/6571772.v1Topic or Tag
Abstract
This survey quantifies the relationship between the application of Systems Engineering (SE) best practices to projects and programs, and the performance of those projects and programs. The survey population consisted of projects and programs executed by defense contractors who are members of the Systems Engineering Division of the National Defense Industrial Association. The deployment of SE practices on a project or program was measured through the availability and characteristics of specific SE-related work products. Project Performance was measured through typically available project measures of cost performance, schedule performance, and scope performance. Additional project and program information such as project size, project domain, and other data was also collected to aid in characterizing the respondent's project. Analysis of the survey responses revealed moderately strong statistical relationships between Project Performance and several categorizations of specific of SE best practices. Notably stronger relationships are apparent by combining the effects of more than one the best practices categories. Of course, Systems Engineering Capability alone does not ensure outstanding Project Performance. The survey results show notable differences in the relationship between SE best practices and performance between more challenging as compared to less challenging projects. The statistical relationship between Project Performance and the combination of SE Capability and Project Challenge is quite strong for survey data of this type.
Cite This SEI Report
Goldenson, D., Elm, J., El Emam, K., Donitelli, N., Neisa, A., & NDIA SE Effectiveness Committee, T. (2007, November 1). A Survey of Systems Engineering Effectiveness: Initial Results. (SEI Report CMU/SEI-2007-SR-014). Retrieved August 18, 2026, from https://doi.org/10.1184/R1/6571772.v1.
@techreport{goldenson_2007,
author={Goldenson, Dennis and Elm, Joseph and El Emam, Khaled and Donitelli, Nichole and Neisa, Angelica and NDIA SE Effectiveness Committee, The},
title={A Survey of Systems Engineering Effectiveness: Initial Results},
month={Nov},
year={2007},
number={{CMU/SEI-2007-SR-014},
institution={Software Engineering Institute, Carnegie Mellon University},
doi={10.1184/R1/6571772.v1},
url={https://doi.org/10.1184/R1/6571772.v1},
note={Accessed: 2026-Aug-18}
}
Goldenson, Dennis, Joseph Elm, Khaled El Emam, Nichole Donitelli, Angelica Neisa, and The NDIA SE Effectiveness Committee. "A Survey of Systems Engineering Effectiveness: Initial Results." (CMU/SEI-2007-SR-014). Software Engineering Institute, Carnegie Mellon University. Software Engineering Institute, November 1, 2007. https://doi.org/10.1184/R1/6571772.v1.
D. Goldenson, J. Elm, K. El Emam, N. Donitelli, A. Neisa, and T. NDIA SE Effectiveness Committee, "A Survey of Systems Engineering Effectiveness: Initial Results," Software Engineering Institute, Carnegie Mellon University. Software Engineering Institute, SEI Report CMU/SEI-2007-SR-014, 1-Nov-2007 [Online]. Available: https://doi.org/10.1184/R1/6571772.v1. [Accessed: 18-Aug-2026].
Goldenson, Dennis, Joseph Elm, Khaled El Emam, Nichole Donitelli, Angelica Neisa, and The NDIA SE Effectiveness Committee. "A Survey of Systems Engineering Effectiveness: Initial Results." (SEI Report CMU/SEI-2007-SR-014). Software Engineering Institute, Carnegie Mellon University, Software Engineering Institute, 1 Nov. 2007. https://doi.org/10.1184/R1/6571772.v1. Accessed 18 Aug. 2026.
Goldenson, Dennis; Elm, Joseph; El Emam, Khaled; Donitelli, Nichole; Neisa, Angelica; & NDIA SE Effectiveness Committee, The. A Survey of Systems Engineering Effectiveness: Initial Results. CMU/SEI-2007-SR-014. Software Engineering Institute. 2007. DOI: 10.1184/R1/6571772.v1. https://doi.org/10.1184/R1/6571772.v1