Analysis of interrater agreement in ISO/IEC 15504-based software process assessment

Author

Lee, Hye-young ; Jung, Ho-Won ; Chung, Chang-Shin ; Lee, Jong Moo ; Lee, Kyung Whan ; Jeong, Hack Jong

Author_Institution

Coll. of Bus. Adm., Korea Univ., Seoul, South Korea

fYear

2001

fDate

2001

Firstpage

341

Lastpage

348

Abstract

The emerging ISO/IEC 15504 standard provides a framework and a model for software process assessment and improvement. There are two requirements for reliable process assessment: internal reliability and external reliability. The objective of the study is to provide an empirical case of external reliability, i.e. the interrater agreement in ISO/IEC 15504-based software process assessment. Interrater agreement implies the extent to which independent assessors agree in their ratings of software process attributes. Our dataset was from two assessments conducted using the ISO/IEC 15504 standard. The results showed "substantial" to "excellent" agreement. This implies that the two assessments acquired external reliability

Keywords

IEC standards; ISO standards; software metrics; software reliability; software standards; ISO/IEC 15504-based software process assessment; dataset; external reliability; independent assessors; internal reliability; interrater agreement; reliable process assessment; software process assessment; software process attributes; Capability maturity model; Educational institutions; IEC standards; ISO standards; Resource management; SPICE; Software engineering; Software standards; Standards development; Writing;

fLanguage

English

Publisher

ieee

Conference_Titel

Quality Software, 2001. Proceedings.Second Asia-Pacific Conference on

Conference_Location

Hong Kong

Print_ISBN

0-7695-1287-9

Type

conf

DOI

10.1109/APAQS.2001.990039

Filename

990039