Manage the Information
A successful peer review process is managed flawlessly, employs proven techniques, and is supported by rigorous processes and procedures. Reviewers must be supported completely during the review, oriented in the process, and prepared to conduct thorough and fair evaluations within the established system.
The Oak Ridge Institute for Science and Education (ORISE) manages information during the review process through its award-winning scoring database, PeerNet (Proposal Evaluation and Electronic Review Network). Unique to ORISE, PeerNet is a Web-based system for entering peer review scores and comments. PeerNet can be used to collect and report evaluation data from multiple reviewers using common criteria and scoring methods.
Using PeerNet significantly streamlines collecting, tabulating, and reporting evaluative comments and/or scores for peer reviews. The system was created to expedite the process of collecting preliminary comments and funding recommendations from reviewers throughout the U.S. and other countries. Winner of the Vice President's Hammer Award in 1997 for its contribution to automating the federal grants process, PeerNet provides a secure method to:
- Electronically distribute research proposals to reviewers.
- Collect reviewer comments and ratings on proposals.
- Report the evaluations assigned to proposals by reviewers.
To ensure PeerNet meets or exceeds the expectations of our sponsors, we implement ongoing configuration management for enhanced functionality (e.g., added program-based e-mail capability). In response to reviewer and sponsor feedback, ORISE has developed the capability for electronic proposal distribution through PeerNet.
In 2005, ORISE expanded PeerNet system capabilities, allowing principal investigators the opportunity to access the rebuttal function. This enables reviewers to defend or clarify proposals to other reviewers.
ORISE also performs frequent software updates to provide higher security, faster download speed, and more efficient reviews.
Key characteristics of PeerNet include:
- Security. PeerNet has a proven record of success meeting governmental cyber security requirements. Reviewers only access their own evaluations and access is automatically terminated when they have completed their final evaluations.
- Easy to Use. PeerNet is accessible 24 hours a day, seven days a week from any computer with Internet access. There are no hardware requirements for using the system and the program features a straightforward interface that enhances the positive experience of reviewers, allowing them to concentrate on providing a comprehensive technical evaluation. Sponsors can quickly and easily track review progress.
- Flexibility. PeerNet was designed to easily collect, tabulate and report evaluative comments and/or scores from multiple reviewers with common criteria. PeerNet's flexibility ensures that the scoring for each review consistently meets each sponsor's policies.
- Produces Immediate Reports. PeerNet is a database, and any data in the system can be produced in a report, either on screen or in print. ORISE administrators routinely monitor the status of the review and troubleshoot as needed to ensure timely and comprehensive evaluations. Our experience with peer reviews has allowed us to develop standard reports for commonly used data.
