Using Quality Attribute Workshops to Evaluate Architectural Design Approaches in a Major System Acquisition: A Case Study
• Technical Note
Publisher
Software Engineering Institute
CMU/SEI Report Number
CMU/SEI-2000-TN-010Topic or Tag
Abstract
To a large extent, a system’s software architecture determines the quality attributes of both the software and the entire system. It is also one of the earliest artifacts available for evaluation. For a Department of Defense (DoD) or government acquisition organization, the ability to evaluate software architectures early in the acquisition cycle can positively affect the delivered system. To assist a government organization in evaluating architectures, a series of Quality Attribute Workshops (QAWs) were planned and an initial set conducted as part of a competitive acquisition of a complex, integrated command and control system.
The QAW is a “lightweight” (i.e., non-intrusive) version of the Architecture Tradeoff Analysis MethodSM (ATAMSM) developed by the Software Engineering Institute (SEI). The QAWs provided the acquiring government agency with a means to evaluate each contractor’s software architectural approach and determine whether it satisfied the system’s quality attribute requirements (e.g., performance, interoperability, security). Since the acquisition is ongoing, follow-on workshops are currently being scheduled to evaluate the architectural designs as they evolve.
This technical note provides an overview of the QAW process and the results of the first set of workshops, including the perceived benefits of the workshops to both the acquirer and the contractors. It also discusses future opportunities for applying a full-scale architecture evaluation (e.g., an ATAM evaluation) in early stages of system acquisition, and identifies the benefits that could be obtained.
Cite This Technical Note
Bergey, J., Barbacci, M., & Wood, W. (2000, July 1). Using Quality Attribute Workshops to Evaluate Architectural Design Approaches in a Major System Acquisition: A Case Study. (Technical Note CMU/SEI-2000-TN-010). Retrieved July 26, 2025, from https://www.sei.cmu.edu/library/using-quality-attribute-workshops-to-evaluate-architectural-design-approaches-in-a-major-system-acquisition-a-case-study/.
@techreport{bergey_2000,
author={Bergey, John and Barbacci, Mario and Wood, William},
title={Using Quality Attribute Workshops to Evaluate Architectural Design Approaches in a Major System Acquisition: A Case Study},
month={{Jul},
year={{2000},
number={{CMU/SEI-2000-TN-010},
howpublished={Carnegie Mellon University, Software Engineering Institute's Digital Library},
url={https://www.sei.cmu.edu/library/using-quality-attribute-workshops-to-evaluate-architectural-design-approaches-in-a-major-system-acquisition-a-case-study/},
note={Accessed: 2025-Jul-26}
}
Bergey, John, Mario Barbacci, and William Wood. "Using Quality Attribute Workshops to Evaluate Architectural Design Approaches in a Major System Acquisition: A Case Study." (CMU/SEI-2000-TN-010). Carnegie Mellon University, Software Engineering Institute's Digital Library. Software Engineering Institute, July 1, 2000. https://www.sei.cmu.edu/library/using-quality-attribute-workshops-to-evaluate-architectural-design-approaches-in-a-major-system-acquisition-a-case-study/.
J. Bergey, M. Barbacci, and W. Wood, "Using Quality Attribute Workshops to Evaluate Architectural Design Approaches in a Major System Acquisition: A Case Study," Carnegie Mellon University, Software Engineering Institute's Digital Library. Software Engineering Institute, Technical Note CMU/SEI-2000-TN-010, 1-Jul-2000 [Online]. Available: https://www.sei.cmu.edu/library/using-quality-attribute-workshops-to-evaluate-architectural-design-approaches-in-a-major-system-acquisition-a-case-study/. [Accessed: 26-Jul-2025].
Bergey, John, Mario Barbacci, and William Wood. "Using Quality Attribute Workshops to Evaluate Architectural Design Approaches in a Major System Acquisition: A Case Study." (Technical Note CMU/SEI-2000-TN-010). Carnegie Mellon University, Software Engineering Institute's Digital Library, Software Engineering Institute, 1 Jul. 2000. https://www.sei.cmu.edu/library/using-quality-attribute-workshops-to-evaluate-architectural-design-approaches-in-a-major-system-acquisition-a-case-study/. Accessed 26 Jul. 2025.
Bergey, John; Barbacci, Mario; & Wood, William. Using Quality Attribute Workshops to Evaluate Architectural Design Approaches in a Major System Acquisition: A Case Study. CMU/SEI-2000-TN-010. Software Engineering Institute. 2000. https://www.sei.cmu.edu/library/using-quality-attribute-workshops-to-evaluate-architectural-design-approaches-in-a-major-system-acquisition-a-case-study/