My last column focused on where the CMMI product suite is headed for the next version. Since then, a SCAMPI Lead Appraisers and CMMI Instructors Workshop and the CMMI Technology Conference and User Group have provided insights on a variety of topics that warrant further discussion in this issue. I’ve organized the topics by the session where the topic was most specifically addressed.

 

SCAMPI Lead Appraisers and CMMI Instructors Workshop

Progress on the New Introduction to CMMI (Staged and Continuous) Course

There was a beta delivery of the new Introduction to CMMI (Staged and Continuous) course at the SEI in September. At the SEI Partner Workshop in October, SEI Partners were given a summary of the differences between this new course and the Introduction to CMMI courses that cover only one representation. Authorized Introduction to CMMI instructors who attended the workshop’s Instructor Upgrade Course were the first to be approved to offer the new course.
Feedback from these instructors provided a needed adjustment in the schedule for offering the single-representation Introduction to CMMI courses. The new course is designed to be used with the Addison-Wesley book, CMMI: Guidelines for Process Integration and Product Improvement, which covers both representations. Partners believed that using the book may be preferable in some locations, but may be difficult in other locations. Since this concern must be addressed before use of the book can be assured for all course offerings, SEI Partners will continue offering the staged or the continuous courses until this difficulty is resolved. Partner contracts have already been modified to allow the delivery of all three courses through 2005. By late FY06, the V1.2 Introduction to CMMI course update will be available, as will an SEI technical report that includes both representations.

The Introduction to CMMI (Staged and Continuous) course was first offered publicly before the CMMI Technology Conference and User Group in Denver, Colorado. Feedback from that offering was positive and reflected a growing recognition that the two concepts of improvement are are complementary. (There’s more on the complementary aspects of the staged and continuous representations later in this column.) As we make the transition to the new course, we will continue to offer opportunities for authorized instructors to attend upgrade training that covers the differences between the new course and the single-representation courses. Beginning in February, all new instructors will be trained in the Introduction to CMMI (Staged and Continuous) course, as that is our direction for the future.

 

The SEI Code of Professional Conduct

The importance of professional standards of behavior in the delivery of SEI products and services has led to the creation of a Code of Professional Conduct. The SEI Partner Workshop allowed for extensive discussions on this topic with the SEI Partners responsible for both CMMI training and appraisals. The Code of Professional Conduct applies to all SEI Partners, SEI Authorized and Certified Professionals and Candidates, as well as SEI personnel who deliver any of the products and services available through the SEI Partner Network. (Technologies such as TSP/PSP and OCTAVE are offered as part of the SEI Partner Network as well as CMMI.) SEI Partner contracts now include a commitment to the Code of Professional Conduct for all SEI Partners. All SEI-Authorized CMMI instructors, SCAMPI Lead Appraisers, and candidate instructors and lead appraisers have committed to institutionalizing this professional standard. The Code can be viewed at http://www.sei.cmu.edu/partners.

SCAMPI and ISO

SCAMPI Lead Appraisers often find themselves assisting organizations that must also measure performance against various ISO standards. Two of the ISO standards that were discussed at the workshop were ISO 9001:2000 and ISO 15504. In the first case, organizations who are committed to quality improvement wish to increase the value of the appraisal effort by satisfying both CMMI and ISO 9001:2000 in a combined effort. Opportunities to explore joint appraisals, recognizing the specific needs of both ISO certifying bodies for ISO audit certificates and the SEI for authorized SCAMPI appraisals were discussed.

The ISO 15504 standard requires both appraisal methods and improvement models. Here the focus of effort is to assure that CMMI performance measured by SCAMPI appraisals meets the ISO 15504 requirements so that the results can be used in development domains such as the automotive industry. Currently the European automobile industry is considering an approach called AutoSPICE. Some companies in that industry, companies using the CMMI Product Suite as their process improvement approach, want to be sure that their efforts are understood in comparison with ISO 15504 results using other models. The potential for pilot appraisals was discussed on this theme. Attendees expressed the wish to be sure that there are no impediments that would prevent SCAMPI appraisals, using the CMMI model, to depict results that satisfy the 15504 standard, preferably in organizations seeking to harmonize their CMMI results with other improvement approaches.

 

CMMI Technology Conference and User Group

Maturity Levels and Performance

In his lunchtime keynote address to the workshop attendees, Mark Schaeffer, the DoD sponsor for CMMI and Director, Systems Engineering for the Office of the Secretary of Defense, praised the outstanding impact that CMMI provides in broadening the approach for process improvement to a unified approach for all DoD software-intensive systems. However, he also noted that his office sees too many organizations focusing on maturity levels rather than on real improvement: “When achieving a level replaces the focus on continuous improvement, we’ve lost sight of the goal.” He held that appraisal results are too often an end in themselves instead of meeting the government’s expectations for actual performance on complex, software-intensive system development. Schaeffer continued by saying, “The government expects that if you have achieved high maturity, then the next program will perform at that maturity.” He believes that the information available to the acquiring organization seen with the continuous approach – the profile of capabilities against all of the relevant development areas of concern – is more useful than broad statements of organizations with a single-digit maturity-level claim.

Schaeffer indicated that his office would be examining ways of encouraging government use of the continuous (capability-level) appraisal results. As I mentioned above, Mr. Schaeffer’s statements are well timed with the development of V1.2 and a “single-book, single-course” approach that assures that the value of the continuous representation is seen by those who may be more familiar with the maturity-level legacy from the Software CMM. Responses from attendees at the first public offering of the new Introduction to CMMI course indicated that a number of the attendees gained a new appreciation for the ability of the continuous representation to enhance capabilities based on business-critical areas as well as the ability of the staged representation to further organizational maturity.

The SEI is providing more information about appraisal results than ever before at http://seir.sei.cmu.edu/pars/. Although the majority of organizations that have agreed to have their information made publicly available (as of this writing, about 130) chose to use a staged appraisal that would result in a maturity level, the depiction of performance is shown for all CMMI process areas.

The continuous appraisals performed differ only in adding the capability level achieved in each of the process areas. (10 of these results have been made publicly available on the PARS site.) For the vast majority of the mid-level appraisals—those emphasizing the maturity level 2 and 3 process areas (i.e., managed and defined)—there are no real differences in the results. The reason for this is that the capability level achieved in each of the process areas matches the staged level requirements for satisfaction of the relevant generic goals. For a staged appraisal, the process area is described as “satisfied.” For a continuous appraisal, the depiction would be “capability level 2” for staged maturity level 2 equivalent appraisals and “capability level 3” for appraisals that are staged at maturity level 3.

Mr. Schaeffer’s comments about the continuous approach are similar to those we have been receiving from the Australian Defence Materiel Organization’s pioneering work with defense contractors in its country. Its acquisition organization has focused on a broad understanding of capabilities seen within Australia’s supply chain rather than seeking maturity levels.
Mr. Schaeffer’s points about performance expectations also reflect the SEI’s longstanding interest in depicting—and emphasizing—performance results rather than maturity level achievement. Our report on CMMI achievement shows the performance benefits of the commitment to and investment in CMMI-based process improvement. We are also researching better ways to link process capability as measured by appraisal results with performance improvement in projects and organizations.

 

CMMI Coverage for Service Organizations

In my last column, I described an adjustment to our architectural approach for CMMI models that would allow future “constellations” of CMMI models that address domains often adjacent to the development effort. At the CMMI Technology Conference and User Group, the industry chair of the CMMI Steering Group announced that a team was forming to develop the first set of these related models. The plan is to maximize the common model elements while recognizing the unique practices of—and the differences among—organizations that provide or deliver services and those that develop products and services. We anticipate that the major difference between this new constellation and the existing development constellation will be within the Engineering process areas. If we find that there is terminology that should be adjusted in the existing CMMI development models to assure commonality, we will seek to make any such changes in the V1.2 revisions.

Northrop Grumman Corporation has offered to provide the resources to develop a prototype of the Services constellation in 2005. The development project will be performed within the existing CMMI Product Team structure. The CMMI for Services team will proceed on a parallel path with the V1.2 effort. We currently envision that a CMMI-Services model could be released a few months after the V1.2 update, currently scheduled for the latter part of FY 2006. I’ll be providing more information as this effort takes shape.

 

Conference Topic Coverage