Software Engineering Institute Carnegie Mellon

SEMA Main Page
About SEMA
Services
Training
Presentations
Publications
Online Resources
Collaborate & Contact Information

Publications Related to Software Engineering Measurement and Analysis (SEMA)

2007 Publications    |    2006 Publications    |    2005 Publications    |    2004 Publications
Selected Measurement and Analysis Publications
Measurement and Software Process Improvement
Acquisition Publications
Cost Estimation
For more information

2007 Publications

Technical Report - The State of Software Measurement Practice: Results of 2006 Survey, Kasunic, Mark, CMU/SEI-2006-TR-009, February 2007

2006 Publications

Technical Report - Risk Themes Discovered Through Architecture Evaluations, Bass, Len; Nord, Robert; Wood, William; and Zubrow, David, CMU/SEI-2006-TR-012, October 2006

2005 Publications

Relationships Between CMMI and Six Sigma, http://www.sei.cmu.edu/publications/documents/05.reports/05tn005.html, Siviy, J.; Penn, M.; & Harper, E., December 2005

Designing an Effective Survey, http://www.sei.cmu.edu/publications/documents/05.reports/05hb004.html,
Kasunic, Mark, October 2005

This handbook presents a seven-stage, end-to-end process for conducting a survey. A survey can characterize the knowledge, attitudes, and behaviors of a large group of people through the study of a subset of them. However, to protect the validity of conclusions drawn from a survey, certain procedures must be followed throughout the process of designing, developing, and distributing the survey questionnaire. Surveys are used extensively by software and systems engineering organizations to provide insight into complex issues, assist with problem solving, and support effective decision making.

QuARS: A Tool for Analyzing Requirements, http://www.sei.cmu.edu/publications/documents/05.reports/05tr014.html,
Giuseppe Lami, September 2005

This technical report describes a disciplined method and a related automated tool that can be used for the analysis of natural language (NL) requirements documents. The tool, called the Quality Analyzer for Requirements Specifications (QuARS), makes it easier to extract structured information and metrics for detecting linguistic inaccuracies and defects.

return to top


2004 Publications

Measurement and Analysis: What Can and Does Go Wrong? (PDF),
Maureen Brown, University of North Carolina, & Dennis Goldenson, September 2004

This paper suggests several areas where both managers and engineers would benefit from better guidance about the proper use of measurement and analysis.

Applications of the Indicator Template for Measurement and Analysis
http://www.sei.cmu.edu/publications/documents/04.reports/04tn024.html
Wolfhart Goethert & Jeannine Siviy, September 2004

This technical note presents guidance for adapting and completing an indicator template—a tool the SEI has developed to precisely describe an indicator—including its construction, correct interpretation, and how it can be utilized to direct data collection and presentation and measurement and analysis processes.

Case Study: A Measurement Program for Product Lines
http://www.sei.cmu.edu/publications/documents/04.reports/04tn023.html
Sholom Cohen, Dave Zubrow, & Ed Dunn, May 2004

This report documents the Naval Undersea Warfare Center Division Newport Ranges, Engineering, and Analysis Department’s approach for measurement and describes the Goal-Driven Software Measurement approach adopted by the test range product line effort.

Measuring Systems Interoperability: Challenges and Opportunities
http://www.sei.cmu.edu/publications/documents/04.reports/04tn003.html
Mark Kasunic & William Anderson, April 2004

This technical note presents best practices for measuring systems interoperability and assisting military planners in the acquisition, development, and implementation of command, control, communications, computers, and intelligence (C4I) systems that are interoperable.

Army Strategic Software Improvement Program (ASSIP) Survey of Army Acquisition Managers
http://www.sei.cmu.edu/publications/documents/04.reports/04tr003.html
Mark Kasunic, March 2004

This report analyzes a survey the SEI conducted on behalf of the Army Strategic Software Improvement Program. The survey aimed to discover how Army program managers perceived major acquisition-related problem areas.

return to top


Selected Measurement and Analysis Publications

Measures for Software Product Lines
http://www.sei.cmu.edu/publications/documents/03.reports/03tn031.html

This report presents selected results from 12 case studies drawn from 11 organizations. While still limited, the case studies provide credible evidence that CMMI-based process improvement can help organizations achieve better project performance and produce higher quality products.

Deriving Enterprise-Based Measures Using the Balanced Scorecard and Goal-Driven Measurement Techniques
http://www.sei.cmu.edu//publications/documents/03.reports/03tn024.html
Wolfhart Goethert & Matt Fisher, October 2003

This technical note describes the synergistic application of the Balanced Scorecard and Goal-Driven Software Measurement methodologies to develop measures and associated indicators for measuring an organization's health and performance.

Experiences in Implementing Measurement Programs
http://www.sei.cmu.edu/publications/documents/01.reports/01tn026.html
Wolfhart Goethert & Will Hayes, November 2001

This technical note describes some useful lessons learned at a number of organizations that have implemented measurement programs using the Goal-Driven Software Measurement methodology.

Measuring the Software Process: Statistical Process Control for Software Process Improvement
http://www.sei.cmu.edu/publications/books/process/measuring-sw-process.html
William Florac & Anita Carleton, 1999

This book--part of the SEI’s Addison-Wesley series--shows how to use measurement to manage and improve software processes within an organization.

Practical Software Measurement: Measuring for Process Management and Improvement
http://www.sei.cmu.edu/publications/documents/97.reports/97hb003/97hb003abstract.html
William Florac, Robert Park, & Anita Carleton, April 1997

This guidebook shows how well-established principles and methods for evaluating and controlling process performance can be applied in software settings to help achieve an organization's business and technical goals.

Goal-Driven Software Measurement--A Guidebook
http://www.sei.cmu.edu/publications/documents/96.reports/96.hb.002.html
Robert Park, Wolfhart Goethert, & William Florac, August 1996

This guidebook designed to help you identify, select, define, and implement software measures to support your business goals. The measures that result are traceable back to your business goals, so that data collection efforts are better able to stay focused on their intended objectives.

DoD Software Measurement Pilot: Applying the SEI Core Measures
http://www.sei.cmu.edu/publications/documents/94.reports/94.tr.016.html
James Rozum & William Florac, May 1995

This technical report discusses the observations and lessons learned from a pilot effort and makes recommendations regarding software measurement implementation across a large organization.

Object-Oriented Software Measures
http://www.sei.cmu.edu/publications/documents/95.reports/95.tr.002.html
C. Archer, April 1995

This paper provides an overview of the merging of a paradigm and a process, the object-oriented paradigm and the software product measurement process.

Establishing a Software Measurement Process
http://www.sei.cmu.edu/publications/documents/93.reports/93.tr.016.html
Don McAndrews, July 1993

This report presents guidelines for establishing a measurement process as part of an organization's overall software process. Methods are suggested that can be used to design a repeatable measurement process that is focused on goal setting, data analysis, and decision making rather than on just data collection and numbers.

SEI and NAWC: Working Together to Establish a Software Measurement Program
http://www.sei.cmu.edu/publications/documents/93.reports/93.tr.007.html
James Rozum, December 1993

This report describes the Naval Air Warfare Center, Aircraft Division, Warminster’s process to establish a software measurement program. It includes real-life examples of how software measures were defined, collected, and used to improve management processes.

Lecture Notes on Engineering Measurement for Software Engineers
http://www.sei.cmu.edu/publications/documents/ems/93.em.009.html
G. Ford, 1993

These educational materials support three lectures in software engineering: introduction to engineering measurement, measurement theory, and software engineering measures.

Software Measurement for DoD Systems: Recommendations for Initial Core Measures
http://www.sei.cmu.edu/publications/documents/92.reports/92.tr.019.html
A. Carleton, R. Park, W. Goethert, W. Florac, E.K. Bailey, & S. Pfleeger, September 1992

This report presents recommendations for a basic set of software measures that Department of Defense organizations can use to help plan and manage the acquisition, development, and support of software systems.

Software Effort & Schedule Measurement: A Framework for Counting Staff-Hours and Reporting Schedule Information
http://www.sei.cmu.edu/publications/documents/92.reports/92.tr.021.html
Wolfhart Goethert, Elizabeth Bailey, & Mary Busby, September 1992

This report contains frameworks and recommendations for constructing and communicating clear definitions for some important measures that can help organizations to plan, manage, and improve software projects and processes.

Software Quality Measurement: A Framework for Counting Problems and Defects
http://www.sei.cmu.edu/publications/documents/92.reports/92.tr.022.html
William Florac, September 1992

This report presents mechanisms for describing and specifying two software measures--software problems and defects--used to understand and predict software product quality and software process efficacy.

Software Size Measurement: A Framework for Counting Source Statements
http://www.sei.cmu.edu/publications/documents/92.reports/92.tr.020.html
Robert Park, September 1992

This report presents guidelines for defining, recording, and reporting two frequently used measures of software size--physical source lines and logical source statements.

Defining and Understanding Software Measurement Data
http://www.sei.cmu.edu/publications/articles/defining-understanding-sw-measurement.html
James Rozum

This short paper describes a measurement process and provides some basic concepts that managers can use to help integrate measurement into the process for managing software development.

Measurement in Practice
http://www.sei.cmu.edu/publications/documents/91.reports/91.tr.016.html
S. Rifkin & C. Cox, July 1991

This report presents the results of site surveys of 11 divisions of 8 organizations that have gained reputations for having excellent measurement practices.

Software Metrics
http://www.sei.cmu.edu/publications/documents/cms/cm.012.html
E. Mills, (Seattle University), December 1988

This module introduces the most commonly used software metrics and reviews their use in constructing models of the software development process.

return to top


Measurement and Software Process Improvement

Benchmarking Process Maturity
http://www.cutter.com/itjournal/2003toc.html
Dave Zubrow, Cutter IT Journal, November 2003, Volume 16, No. 11

This article provides guidance for using process assessment data for benchmarking purposes. A special in-depth analysis of process appraisal results is described. Data are drawn from process assessments utilizing the SW-CMM.

Demonstrating the Impact and Benefits of CMMI®: An Update and Preliminary Results
http://www.sei.cmu.edu/publications/documents/03.reports/03sr009.html
Dennis Goldenson & Diane Gibson, October 2003

CMM-Based Process Improvement and Schedule Deviation in Software Maintenance
http://www.sei.cmu.edu/publications/documents/03.reports/03tn015.html
Ho-Won Jung & Dennis Goldenson, July 2003

This technical note describes the predictive validity of the SW-CMM as applied to software maintenance.

Measurement and Analysis in Capability Maturity Model Integration Models and Software Process Improvement
http://www.sei.cmu.edu/sema/pdf/goldenson-crosstalk.pdf (PDF)
Dennis Goldenson, Joe Jarzombek, & Terry Rout, originally in CrossTalk, July 2003

This article reviews the content and rationale behind the new Measurement and Analysis process area of CMMI.

The Internal Consistency of Key Process Areas in the Capability Maturity Model CMM for Software (SW-CMM)
http://www.sei.cmu.edu/publications/documents/02.reports/02tr037.html
Ho-Won Jung & Dennis Goldenson, December 2002

This report examines the dimensions underlying the maturity construct in the SW-CMM and then estimates the internal consistency of each dimension based on 676 CMM-Based Appraisal for Internal Process Improvement assessments conducted from January 2000 to April 2002.

Case Studies of Software Process Improvement Methods
http://www.sei.cmu.edu/publications/documents/93.reports/93.tr.026.html
Daniel Paulish, 1993

This report describes the case studies approach applied at a number of Siemens software development organizations to observe the impact of software process improvement methods.

A Survey of Commonly Applied Methods for Software Process Improvement
http://www.sei.cmu.edu/publications/documents/93.reports/93.tr.027.html
Robert Austin & Daniel Paulish, 1993

This report describes methods that are commonly used within industrial organizations for improving the software development process. It describes the methods in the context of the SW-CMM.

Concepts on Measuring the Benefits of Software Process Improvement
http://www.sei.cmu.edu/publications/documents/93.reports/93.tr.009.html
James Rozum, 1993

This report describes some concepts that organizations can tailor and build upon to develop a method for determining the benefits they have received from their software process improvement activities.

Software Measures and the Capability Maturity Model
http://www.sei.cmu.edu/publications/documents/92.reports/92.tr.025.html
J. H. Baumert & M. S. McWhinney, September 1992

This document describes a set of software measures that are compatible with the measurement practices described in the SW-CMM. These measures--in the form of software indicators--cover 13 different categories that include progress, effort, cost, and quality.

return to top


Acquisition Publications

Software Measurement Concepts for Acquisition Program Managers
http://www.sei.cmu.edu/publications/documents/92.reports/92.tr.011.html
James Rozum, 1992

This report provides some basic concepts that program managers can use to help integrate measurement into the process for managing software development. It also provides an initial set of measures to help address common issues in software intensive acquisitions.

Improving the Acquisition of Software-Intensive Systems
http://www.sei.cmu.edu/publications/documents/00.reports/00tr003.html
Dennis Goldenson & Matthew Fisher, August 2000

This report describes an SEI survey delivered to senior acquisition managers. Recommendations derived from the survey results are offered to increase software acquisition education and training opportunities for managers.

return to top


Cost Estimation

A Manager's Checklist for Validating Software Cost and Schedule Estimates
http://www.sei.cmu.edu/publications/documents/95.reports/95.sr.004.html
Robert Park, January 1995

This report provides a checklist of questions to ask and evidence to look for when assessing the credibility of a software cost and schedule estimate.

Checklists and Criteria for Evaluating the Cost and Schedule Estimating Capabilities of Software Organizations
http://www.sei.cmu.edu/publications/documents/95.reports/95.sr.005.html
Robert Park, January 1995

This report provides criteria and checklists for evaluating the capability of an organization's software estimating process and the infrastructure that supports it. It also supplies guidelines for good estimating practice.

Software Cost and Schedule Estimating: A Process Improvement Initiative
http://www.sei.cmu.edu/publications/documents/94.reports/94.sr.003.html
Robert Park, Wolfhart Goethert, & J. Webb, May 1994

This report describes SEI efforts to improve the practice of software cost and schedule estimating. Products include templates, criteria, and guidelines for establishing defined estimating processes, training materials, examples for teaching good estimating practice, and evaluations of the abilities of contemporary cost models to meet today's estimating needs.

return to top


For More Information

To learn more, contact SEI Customer Relations.


Return to top    |    SEMA main page