Study on Peer Review and Multi-indicators Evaluation in Scientific and Technological Assessment

Author

Liping, Yu ; Yuntao, Pan ; Chun, Yang ; Yishan, Wu

Author_Institution

Inst. of Sci. & Tech. Inf. of China, Beijing

fYear

2008

fDate

21-22 Dec. 2008

Firstpage

794

Lastpage

798

Abstract

This paper analyzes the relation between peer review and multi-indicators evaluation for scientific and technical assessment. Based on the data of the 2007 Times Higher-QS world university rankings, we use two methods, multiple linear regression analysis and kappa agreement test, for analysis. The results show that the data abundance affects the agreement between peer review and multi-indicators evaluation. We conclude that comprehensive evaluation in combination with peer review is a better choice in lack of data. Regression goodness-of-fit can be used to assess data abundance. Peer review should be the basis for the choice of indicators and indicator weights. However, multi-indicators evaluation is more stable and objective.

Keywords

data analysis; publishing; regression analysis; kappa agreement test; multiindicators evaluation; multiple linear regression analysis; peer review; scientific assessment; technological assessment; Bibliometrics; Chemicals; Educational institutions; Knowledge acquisition; Knowledge management; Linear regression; Performance analysis; Surveys Committee; Technology management; Testing; multi-indicators evaluation; peer review; scientific and technological assessment; university ranking;

fLanguage

English

Publisher

ieee

Conference_Titel

Knowledge Acquisition and Modeling, 2008. KAM '08. International Symposium on

Conference_Location

Wuhan

Print_ISBN

978-0-7695-3488-6

Type

conf

DOI

10.1109/KAM.2008.39

Filename

4732938