Quality and the SEI Appraisal Program
The Appraiser | Appraisal Delivery | Appraisal Data
Quality checks are built into the SEI Appraisal Program to assure that appraisals are fair and appraisal data is accurate. Three aspects determine overall appraisal quality: the quality of the appraiser, the quality of the appraisal delivery, and the quality of the appraisal data delivered to the SEI.
The Appraiser
Individuals must meet rigorous standards and complete a challenging curriculum to become Candidate Lead Appraisers. Requirements for candidacy include the following:
- successful completion of the Introduction to CMMI® course
- successful completion of the Intermediate Concepts of CMMI course
- participation as an Appraisal Team Member on at least two SCAMPI A appraisals prior to attending SCAMPI Lead AppraiserSM Training
- submission of a professional resume indicating relevant experience
- successful completion of the SCAMPI Lead Appraiser Training course
Candidate appraisers must be observed by an SEI-authorized SCAMPI Observer and judged to have the requisite consulting, presentation, leadership, and software engineering skills to properly apply their knowledge to an organization's business needs.
Lead Appraisers are reauthorized every three years. Appraisers must demonstrate that their skills and experience are current to be reauthorized.
return to top
Appraisal Delivery
The SEI's long experience with model-based process improvement has led to expectations about what organizations typically encounter in appraisals, and the typical amount of time between achievement of different maturity levels. The Process Maturity Profile provides some detailed information related to this. Based on this information, specific thresholds to trigger detailed audits of appraisal results have been established." These audits are conducted by the appraisal Quality Manager and issues are reconciled with the Lead Appraiser.
The Quality Manager may also initiate this audit process based on reported incidents.
return to top
Appraisal Data
Lead Appraisers submit appraisal information to the SEI for the Process Appraisal Information System (PAIS), a secure database of appraisal results. This information is used for SEI research efforts and for measuring the quality of appraisals. Two quality processes are in place to assure that the information submitted is accurate.
First, the data is checked for completeness and correctness when passing through the data entry process. Elements that are tested include the following:
- proper configuration of process areas for maturity level assigned
- designation of valid discipline
- consistency between the representation reported and artifacts
- completeness of artifact submission
Next, submitted data is checked by an SEI Quality Administrator to assure that
- a three-phased approach is being used, as shown through the Appraisal Input (preparation phase), Appraisal Plan (on-site phase), and Appraisal Disclosure Statement (completion phase)
- artifacts submitted are accurate, reasonable, and consistent in portraying the appraisal event
- Appraisal Team Members were properly trained and prepared for their roles on the appraisal team
- the Lead Appraiser's credentials are up-to-date
- all required SCAMPI activities were performed
The Quality Administrator then communicates the results of this review to the Lead Appraiser and offers the sponsor the ability to have their results posted on the Published Appraisal Results Web site.
return to top
For More Information
To report a quality concern, contact SCAMPI-Quality@sei.cmu.edu
If you have questions or comments, send e-mail to SEI Customer Relations customer-relations@sei.cmu.edu.
return to top | Appraisal Program main page