search menu icon-carat-right cmu-wordmark

Evaluating Process Quality from an Appraisal Perspective

November 2009 Technical Note
Emanuel R. Baker, Matt Fisher

This report explores the lack of agreement among SCAMPI Lead Appraisers about what “process quality” means in the SCAMPI process context.

Publisher:

Software Engineering Institute

CMU/SEI Report Number

CMU/SEI-2009-TN-022

Abstract

A question currently being argued throughout the appraisal community concerns evaluation of process quality during Standard CMMI® Appraisal Method for Process Improvement (SCAMPI) appraisals. Different, conflicting opinions on whether evaluation of process quality during a SCAMPI appraisal is appropriate run from an extremely vigorous “no” to an equally vigorous “yes!” The main issue in both beliefs appears to be linked to word definitions—specifically, a lack of agreement among SCAMPI Lead Appraisers about what “quality” means in the SCAMPI context. This technical note examines these beliefs in light of the following questions:

  • Do appraisal results, following the current methodology, address the quality of processes examined during the appraisal?
  • Can appraisals, following the current methodology, judge the quality of the final product or deliverable?
  • Can appraisals, following the current methodology, provide insight into the quality of the final product or deliverable during development?

Having addressed these questions in terms of quality, the technical note discusses approaches acquisition offices may use to gain the insight desired.