Reliability Improvement and Validation Framework
• SEI Report
Publisher
Software Engineering Institute
CMU/SEI Report Number
CMU/SEI-2012-SR-013DOI (Digital Object Identifier)
10.1184/R1/6583043.v1Topic or Tag
Abstract
Software-reliant systems such as rotorcraft and other aircraft have experienced exponential growth in software size and complexity. The current software engineering practice of "build then test" has made them unaffordable to build and qualify. This report discusses the challenges of qualifying such systems, presenting the findings of several government and industry studies. It identifies several root cause areas and proposes a framework for reliability validation and improvement that integrates several recommended technology solutions: validation of formalized requirements; an architecture-centric, model-based engineering approach that uncovers system-level problems early through analysis; use of static analysis for validating system behavior and other system properties; and managed confidence in qualification through system assurance. This framework also provides the basis for a set of metrics for cost-effective reliability improvement that overcome the challenges of existing software complexity, reliability, and cost metrics.
Cite This SEI Report
Feiler, P., Goodenough, J., Gurfinkel, A., Weinstock, C., & Wrage, L. (2012, November 1). Reliability Improvement and Validation Framework. (SEI Report CMU/SEI-2012-SR-013). Retrieved September 18, 2026, from https://doi.org/10.1184/R1/6583043.v1.
@techreport{feiler_2012,
author={Feiler, Peter and Goodenough, John and Gurfinkel, Arie and Weinstock, Charles and Wrage, Lutz},
title={Reliability Improvement and Validation Framework},
month={Nov},
year={2012},
number={{CMU/SEI-2012-SR-013},
institution={Software Engineering Institute, Carnegie Mellon University},
doi={10.1184/R1/6583043.v1},
url={https://doi.org/10.1184/R1/6583043.v1},
note={Accessed: 2026-Sep-18}
}
Feiler, Peter, John Goodenough, Arie Gurfinkel, Charles Weinstock, and Lutz Wrage. "Reliability Improvement and Validation Framework." (CMU/SEI-2012-SR-013). Software Engineering Institute, Carnegie Mellon University. Software Engineering Institute, November 1, 2012. https://doi.org/10.1184/R1/6583043.v1.
P. Feiler, J. Goodenough, A. Gurfinkel, C. Weinstock, and L. Wrage, "Reliability Improvement and Validation Framework," Software Engineering Institute, Carnegie Mellon University. Software Engineering Institute, SEI Report CMU/SEI-2012-SR-013, 1-Nov-2012 [Online]. Available: https://doi.org/10.1184/R1/6583043.v1. [Accessed: 18-Sep-2026].
Feiler, Peter, John Goodenough, Arie Gurfinkel, Charles Weinstock, and Lutz Wrage. "Reliability Improvement and Validation Framework." (SEI Report CMU/SEI-2012-SR-013). Software Engineering Institute, Carnegie Mellon University, Software Engineering Institute, 1 Nov. 2012. https://doi.org/10.1184/R1/6583043.v1. Accessed 18 Sep. 2026.
Feiler, Peter; Goodenough, John; Gurfinkel, Arie; Weinstock, Charles; & Wrage, Lutz. Reliability Improvement and Validation Framework. CMU/SEI-2012-SR-013. Software Engineering Institute. 2012. DOI: 10.1184/R1/6583043.v1. https://doi.org/10.1184/R1/6583043.v1