No 2010/16 Use and non-use of research evaluation

A literature review

Abstract

This paper reviews the literature in research evaluation and in social program evaluation on the topic of use and effects of research evaluation. The past two or three decades have seen the emergence of several new forms of research evaluation next to the existing peer review practices on papers and project proposals. The UK Research Assessment Exercises are among the most studied and discussed ones. Many other types of evaluations have received some attention but when it comes to their use and effects, interest also quickly faded. It seems time to re-address the issue and see what can be learned from the existing literature for a study of use and effects. The paper also draws on literature from social program evaluation for additional insights since in this field the concern for use and effects is further developed. The most important insight gained is that use and effects of evaluations extend beyond those implied by policy-cycle perspectives and peer review. Furthermore, concepts and conceptual frames from the field of science and technology studies can be productive in the study of a wide range of use and effects, including the pressing issue of non-use.