Publications Related to Software Engineering Measurement and Analysis (SEMA)
2007 Publications
|
2006 Publications
|
2005 Publications
|
2004 Publications
Selected Measurement and Analysis Publications
Measurement and Software Process Improvement
Acquisition Publications
Cost Estimation
For more information
2007 Publications
Technical Report - The State of Software Measurement Practice: Results of 2006 Survey, Kasunic, Mark, CMU/SEI-2006-TR-009, February 2007
2006 Publications
Technical Report - Risk Themes Discovered Through Architecture Evaluations, Bass, Len; Nord, Robert; Wood, William; and Zubrow, David, CMU/SEI-2006-TR-012, October 2006
2005 Publications
Relationships Between CMMI and Six Sigma, http://www.sei.cmu.edu/publications/documents/05.reports/05tn005.html, Siviy, J.; Penn, M.; & Harper, E., December 2005
Designing an Effective Survey,
http://www.sei.cmu.edu/publications/documents/05.reports/05hb004.html,
Kasunic, Mark, October 2005
This handbook presents a seven-stage, end-to-end process for conducting a survey. A survey can characterize the knowledge, attitudes, and behaviors of a large group of people through the study of a subset of them. However, to protect the validity of conclusions drawn from a survey, certain procedures must be followed throughout the process of designing, developing, and distributing the survey questionnaire. Surveys are used extensively by software and systems engineering organizations to provide insight into complex issues, assist with problem solving, and support effective decision making.
QuARS: A Tool for Analyzing Requirements,
http://www.sei.cmu.edu/publications/documents/05.reports/05tr014.html,
Giuseppe Lami, September 2005
This technical report describes a disciplined method and a related automated tool that can be used for the analysis of natural language (NL) requirements documents. The tool, called the Quality Analyzer for Requirements Specifications (QuARS), makes it easier to extract structured information and metrics for detecting linguistic inaccuracies and defects.
return to top
2004 Publications
Measurement and Analysis: What Can and
Does Go Wrong? (PDF),
Maureen Brown, University of North Carolina, & Dennis Goldenson, September
2004
This paper suggests several areas where both managers and engineers would benefit from better guidance about the proper use of measurement and analysis.
Applications of the Indicator Template for Measurement and Analysis
http://www.sei.cmu.edu/publications/documents/04.reports/04tn024.html
Wolfhart Goethert & Jeannine Siviy, September 2004
This technical note presents guidance for adapting and completing an indicator template—a tool the SEI has developed to precisely describe an indicator—including its construction, correct interpretation, and how it can be utilized to direct data collection and presentation and measurement and analysis processes.
Case Study: A Measurement Program for Product Lines
http://www.sei.cmu.edu/publications/documents/04.reports/04tn023.html
Sholom Cohen, Dave Zubrow, & Ed Dunn, May 2004
This report documents the Naval Undersea Warfare Center Division Newport Ranges, Engineering, and Analysis Department’s approach for measurement and describes the Goal-Driven Software Measurement approach adopted by the test range product line effort.
Measuring Systems Interoperability: Challenges and Opportunities
http://www.sei.cmu.edu/publications/documents/04.reports/04tn003.html
Mark Kasunic & William Anderson, April 2004
This technical note presents best practices for measuring systems interoperability and assisting military planners in the acquisition, development, and implementation of command, control, communications, computers, and intelligence (C4I) systems that are interoperable.
Army Strategic Software Improvement Program (ASSIP) Survey of Army
Acquisition Managers
http://www.sei.cmu.edu/publications/documents/04.reports/04tr003.html
Mark Kasunic, March 2004
This report analyzes a survey the SEI conducted on behalf of the Army Strategic Software Improvement Program. The survey aimed to discover how Army program managers perceived major acquisition-related problem areas.
return to top
Selected Measurement and Analysis Publications
Measures for Software Product Lines
http://www.sei.cmu.edu/publications/documents/03.reports/03tn031.html
This report presents selected results from 12 case studies drawn from 11 organizations. While still limited, the case studies provide credible evidence that CMMI-based process improvement can help organizations achieve better project performance and produce higher quality products.
Deriving Enterprise-Based Measures Using the Balanced Scorecard and
Goal-Driven Measurement Techniques
http://www.sei.cmu.edu//publications/documents/03.reports/03tn024.html
Wolfhart Goethert & Matt Fisher, October 2003
This technical note describes the synergistic application of the Balanced Scorecard and Goal-Driven Software Measurement methodologies to develop measures and associated indicators for measuring an organization's health and performance.
Experiences in Implementing Measurement Programs
http://www.sei.cmu.edu/publications/documents/01.reports/01tn026.html
Wolfhart Goethert & Will Hayes, November 2001
This technical note describes some useful lessons learned at a number of organizations that have implemented measurement programs using the Goal-Driven Software Measurement methodology.
Measuring the Software Process: Statistical Process Control for Software
Process Improvement
http://www.sei.cmu.edu/publications/books/process/measuring-sw-process.html
William Florac & Anita Carleton, 1999
This book--part of the SEI’s Addison-Wesley series--shows how to use measurement to manage and improve software processes within an organization.
Practical Software Measurement: Measuring for Process Management and
Improvement
http://www.sei.cmu.edu/publications/documents/97.reports/97hb003/97hb003abstract.html
William Florac, Robert Park, & Anita Carleton, April 1997
This guidebook shows how well-established principles and methods for evaluating and controlling process performance can be applied in software settings to help achieve an organization's business and technical goals.
Goal-Driven Software Measurement--A Guidebook
http://www.sei.cmu.edu/publications/documents/96.reports/96.hb.002.html
Robert Park, Wolfhart Goethert, & William Florac, August 1996
This guidebook designed to help you identify, select, define, and implement software measures to support your business goals. The measures that result are traceable back to your business goals, so that data collection efforts are better able to stay focused on their intended objectives.
DoD Software Measurement Pilot: Applying the SEI Core Measures
http://www.sei.cmu.edu/publications/documents/94.reports/94.tr.016.html
James Rozum & William Florac, May 1995
This technical report discusses the observations and lessons learned from a pilot effort and makes recommendations regarding software measurement implementation across a large organization.
Object-Oriented Software Measures
http://www.sei.cmu.edu/publications/documents/95.reports/95.tr.002.html
C. Archer, April 1995
This paper provides an overview of the merging of a paradigm and a process, the object-oriented paradigm and the software product measurement process.
Establishing a Software Measurement Process
http://www.sei.cmu.edu/publications/documents/93.reports/93.tr.016.html
Don McAndrews, July 1993
This report presents guidelines for establishing a measurement process as part of an organization's overall software process. Methods are suggested that can be used to design a repeatable measurement process that is focused on goal setting, data analysis, and decision making rather than on just data collection and numbers.
SEI and NAWC: Working Together to Establish a Software Measurement
Program
http://www.sei.cmu.edu/publications/documents/93.reports/93.tr.007.html
James Rozum, December 1993
This report describes the Naval Air Warfare Center, Aircraft Division, Warminster’s process to establish a software measurement program. It includes real-life examples of how software measures were defined, collected, and used to improve management processes.
Lecture Notes on Engineering Measurement for Software Engineers
http://www.sei.cmu.edu/publications/documents/ems/93.em.009.html
G. Ford, 1993
These educational materials support three lectures in software engineering: introduction to engineering measurement, measurement theory, and software engineering measures.
Software Measurement for DoD Systems: Recommendations for Initial Core
Measures
http://www.sei.cmu.edu/publications/documents/92.reports/92.tr.019.html
A. Carleton, R. Park, W. Goethert, W. Florac, E.K. Bailey, & S. Pfleeger,
September 1992
This report presents recommendations for a basic set of software measures that Department of Defense organizations can use to help plan and manage the acquisition, development, and support of software systems.
Software Effort & Schedule Measurement: A Framework for Counting Staff-Hours and Reporting Schedule Information
http://www.sei.cmu.edu/publications/documents/92.reports/92.tr.021.html
Wolfhart Goethert, Elizabeth Bailey, & Mary Busby, September 1992
This report contains frameworks and recommendations for constructing and communicating clear definitions for some important measures that can help organizations to plan, manage, and improve software projects and processes.
Software Quality Measurement: A Framework for Counting Problems and
Defects
http://www.sei.cmu.edu/publications/documents/92.reports/92.tr.022.html
William Florac, September 1992
This report presents mechanisms for describing and specifying two software measures--software problems and defects--used to understand and predict software product quality and software process efficacy.
Software Size Measurement: A Framework for Counting Source
Statements
http://www.sei.cmu.edu/publications/documents/92.reports/92.tr.020.html
Robert Park, September 1992
This report presents guidelines for defining, recording, and reporting two frequently used measures of software size--physical source lines and logical source statements.
Defining and Understanding Software Measurement Data
http://www.sei.cmu.edu/publications/articles/defining-understanding-sw-measurement.html
James Rozum
This short paper describes a measurement process and provides some basic concepts that managers can use to help integrate measurement into the process for managing software development.
Measurement in Practice
http://www.sei.cmu.edu/publications/documents/91.reports/91.tr.016.html
S. Rifkin & C. Cox, July 1991
This report presents the results of site surveys of 11 divisions of 8 organizations that have gained reputations for having excellent measurement practices.
Software Metrics
http://www.sei.cmu.edu/publications/documents/cms/cm.012.html
E. Mills, (Seattle University), December 1988
This module introduces the most commonly used software metrics and reviews their use in constructing models of the software development process.
return to top
Measurement and Software Process Improvement
Benchmarking Process Maturity
http://www.cutter.com/itjournal/2003toc.html
Dave Zubrow, Cutter IT Journal, November 2003, Volume 16, No. 11
This article provides guidance for using process assessment data for benchmarking purposes. A special in-depth analysis of process appraisal results is described. Data are drawn from process assessments utilizing the SW-CMM.
Demonstrating the Impact and Benefits of CMMI®: An Update and
Preliminary Results
http://www.sei.cmu.edu/publications/documents/03.reports/03sr009.html
Dennis Goldenson & Diane Gibson, October 2003
CMM-Based Process Improvement and Schedule Deviation in Software
Maintenance
http://www.sei.cmu.edu/publications/documents/03.reports/03tn015.html
Ho-Won Jung & Dennis Goldenson, July 2003
This technical note describes the predictive validity of the SW-CMM as applied to software maintenance.
Measurement and Analysis in Capability Maturity Model Integration
Models and Software Process Improvement
http://www.sei.cmu.edu/sema/pdf/goldenson-crosstalk.pdf (PDF)
Dennis Goldenson, Joe Jarzombek, & Terry Rout, originally
in CrossTalk, July 2003
This article reviews the content and rationale behind the new Measurement and Analysis process area of CMMI.
The Internal Consistency of Key Process Areas in the Capability Maturity
Model CMM for Software (SW-CMM)
http://www.sei.cmu.edu/publications/documents/02.reports/02tr037.html
Ho-Won Jung & Dennis Goldenson, December 2002
This report examines the dimensions underlying the maturity construct in the SW-CMM and then estimates the internal consistency of each dimension based on 676 CMM-Based Appraisal for Internal Process Improvement assessments conducted from January 2000 to April 2002.
Case Studies of Software Process Improvement Methods
http://www.sei.cmu.edu/publications/documents/93.reports/93.tr.026.html
Daniel Paulish, 1993
This report describes the case studies approach applied at a number of Siemens software development organizations to observe the impact of software process improvement methods.
A Survey of Commonly Applied Methods for Software Process
Improvement
http://www.sei.cmu.edu/publications/documents/93.reports/93.tr.027.html
Robert Austin & Daniel Paulish, 1993
This report describes methods that are commonly used within industrial organizations for improving the software development process. It describes the methods in the context of the SW-CMM.
Concepts on Measuring the Benefits of Software Process Improvement
http://www.sei.cmu.edu/publications/documents/93.reports/93.tr.009.html
James Rozum, 1993
This report describes some concepts that organizations can tailor and build upon to develop a method for determining the benefits they have received from their software process improvement activities.
Software Measures and the Capability Maturity Model
http://www.sei.cmu.edu/publications/documents/92.reports/92.tr.025.html
J. H. Baumert & M. S. McWhinney, September 1992
This document describes a set of software measures that are compatible with the measurement practices described in the SW-CMM. These measures--in the form of software indicators--cover 13 different categories that include progress, effort, cost, and quality.
return to top
Acquisition Publications
Software Measurement Concepts for Acquisition Program Managers
http://www.sei.cmu.edu/publications/documents/92.reports/92.tr.011.html
James Rozum, 1992
This report provides some basic concepts that program managers can use to help integrate measurement into the process for managing software development. It also provides an initial set of measures to help address common issues in software intensive acquisitions.
Improving the Acquisition of Software-Intensive Systems
http://www.sei.cmu.edu/publications/documents/00.reports/00tr003.html
Dennis Goldenson & Matthew Fisher, August 2000
This report describes an SEI survey delivered to senior acquisition managers. Recommendations derived from the survey results are offered to increase software acquisition education and training opportunities for managers.
return to top
Cost Estimation
A Manager's Checklist for Validating Software Cost and Schedule
Estimates
http://www.sei.cmu.edu/publications/documents/95.reports/95.sr.004.html
Robert Park, January 1995
This report provides a checklist of questions to ask and evidence to look for when assessing the credibility of a software cost and schedule estimate.
Checklists and Criteria for Evaluating the Cost and Schedule Estimating
Capabilities of Software Organizations
http://www.sei.cmu.edu/publications/documents/95.reports/95.sr.005.html
Robert Park, January 1995
This report provides criteria and checklists for evaluating the capability of an organization's software estimating process and the infrastructure that supports it. It also supplies guidelines for good estimating practice.
Software Cost and Schedule Estimating: A Process Improvement
Initiative
http://www.sei.cmu.edu/publications/documents/94.reports/94.sr.003.html
Robert Park, Wolfhart Goethert, & J. Webb, May 1994
This report describes SEI efforts to improve the practice of software cost and schedule estimating. Products include templates, criteria, and guidelines for establishing defined estimating processes, training materials, examples for teaching good estimating practice, and evaluations of the abilities of contemporary cost models to meet today's estimating needs.
return to top
For More Information
To learn more, contact SEI Customer Relations.

