Award Abstract #0830387
SciSIP (MOD): A Comparative Assessment of Models for Integrating Societal Impacts Concerns into the Peer Review of Grant Proposals

NSF Org:	SBE Directorate for Social, Behavioral & Economic Sciences
Initial Amendment Date:	September 23, 2008
Latest Amendment Date:	September 23, 2008
Award Number:	0830387
Award Instrument:	Standard Grant
Program Manager:	Joshua Rosenbloom SBE Directorate for Social, Behavioral & Economic Sciences SBE Directorate for Social, Behavioral & Economic Sciences
Start Date:	October 1, 2008
Expires:	September 30, 2012 (Estimated)
Awarded Amount to Date:	$393,688.00
Investigator(s):	Robert Frodeman frodeman@unt.edu (Principal Investigator) Warren Burggren (Co-Principal Investigator) Carl Mitcham (Co-Principal Investigator) James Holbrook (Co-Principal Investigator) William Moen (Co-Principal Investigator)
Sponsor:	University of North Texas 1155 Union Circle #305250 DENTON, TX 76203-5017 (940)565-3940
NSF Program(s):	SCIENCE OF SCIENCE POLICY
Program Reference Code(s):	0000, OTHR
Program Element Code(s):	7626

ABSTRACT

Public science and engineering (S&E) funding agencies worldwide rely on the peer review of research proposals to make their funding decisions. Scientific and technical experts are best qualified to judge the scientific and technical merits of proposed research projects. Increasingly, however, society is requiring that S&E funding agencies demonstrate a return on the public investment in S&E research. In response, S&E funding agencies worldwide have incorporated considerations of broader societal impacts into the proposal review process. But asking scientists and engineers to assess the potential societal impacts of proposed research projects takes them beyond the realm of their scientific and technical expertise.

The fundamental question of this three year research project is: What is the best way to incorporate societal impacts considerations into the grant proposal peer review process? This research focuses on the ways in which different models of peer review incorporate the broader societal impacts of proposed research. The study assesses five different models of peer review across three US federal agencies: the National Science Foundation (NSF), the National Institutes of Health (NIH), and the National Oceanic and Atmospheric Administration (NOAA); and two non-US contexts: the Natural Science and Engineering Research Council of Canada (NSERC), and the Dutch Technology Foundation (STW). Using both qualitative and quantitative methods (data mining, literature review, surveys, and semi-structured interviews), this research develops usable knowledge by constructing a comparative matrix and analysis of these five models of peer review.

The Broader Impacts of this project include: (1) funding 2 graduate research assistants, thereby laying the foundation for continuing work in the Science of Science and Innovation Policy; (2) integrating this research with teaching at the undergraduate level (in UNT's Ethics in Science course); (3) expanding the network of researchers exploring the Science of Science and Innovation Policy; (4) enhancing the understanding of the process of grant proposal peer review by informing all stakeholders in the peer review process (scientists and engineers, funding agency officials, policy makers, and members of the general public) of the project's results; and finally, (5) improving the peer review of grant proposals, especially in terms of the capacity of various models of peer review to assess the societal impact of proposed S&E research. This project benefits society by improving the connection between the funding decisions rendered through proposal peer review and the societal impact of the funded research.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

BOOKS/ONE TIME PROCEEDING

Robert Frodeman, Editor in Chief. "The Oxford Handbook of Interdisciplinarity", 10/01/2010-09/30/2011, , Julie Thompson Klein, and Carl Mitcham"Oxford Handbooks",  2010, "Oxford University Press".

J. Britt Holbrook. "Peer Review", 10/01/2010-09/30/2011, , Robert Frodeman, Julie Thompson Klein, Carl Mitcham"Oxford Handbooks",  2010, "Pages 321-32 of The Osford Handbook of Interdisciplinarity, Oxford Univerisyt Press".

Please report errors in award information by writing to: awardsearch@nsf.gov.