| CFDA Number: | 84.133 - National Institute on Disability and Rehabilitation Research |
| Goal 8: To conduct high-quality research that leads to high quality research products. |
| Objective 8.1 of 4: To support the conduct and dissemination of high-quality research that contributes to improvement in the quality of life of persons with disabilities. |
| Indicator 8.1.1 of 2: Scientific excellence: Grantee research quality is good or excellent, as reflected in research design and its usefulness to customers. | ||||||||||||||||||||||||||||||||||||||
| Targets and Performance Data | Assessment of Progress | Sources and Data Quality | ||||||||||||||||||||||||||||||||||||
|
Status: Target met
Progress: 67.86% of all centers (19 of 28) reviewed during a rating of research design and its usefulness to customers. Explanation: This year's data are based on 28 summative reviews conducted during FY2002. The rigor of this evaluation program, which utilizes panels of experts in relevant program areas, has been significantly enhanced by an increasing emphasis on evaluation of outcomes resulting from funded research. Consequently, it is difficult to compare data to previous years. Centers that are focused on engineering and medicine achieved the highest research and development ratings. 86% of Rehabilitation Research and Training Centers in topics related to health and function were rated at good or excellent. |
Source: Other Other: Other. Additional Source Information: NIDRR Program Review; Center of Excellence Scale. Frequency: Annually. Collection Period: 2003 Data Available: October 2003 Validated By: On-Site Monitoring By ED. Improvements: Data are based upon ratings obtained from expert panels during reverse site visits. Extensive efforts have been made to ensure that centers being rated and experts serving as reviewers are conversant with the evidence based and outcomes oriented approaches to the review process. |
||||||||||||||||||||||||||||||||||||
| Indicator 8.1.2 of 2: Increased publication and citation: Publication of research findings, with the appropriate citation, will increase in refereed journals. | ||||||||||||||||||||||||||||||||||||||
| Targets and Performance Data | Assessment of Progress | Sources and Data Quality | ||||||||||||||||||||||||||||||||||||
|
Status: Unable to judge
Progress: Average number of Peer reviewed journal articles and published books and book chapters is increasing. Explanation: This indicator information comes from grantees data on Outcomes and Publications in NIDRRs web-based Performance Reporting System that went on line in July, 2001. Data is reported by calendar year of publication; consequently 2001 is the most recent completed year. Bibliographies reported by each center have been extensively evaluated so that only publication in indexed journals and major published books have been counted. Preliminary evaluation of reports for the first three quarters of 2002 indicates that the number of publications continues to increase. |
Source: Other Other: Other. Additional Source Information: NIDRR Reporting System; Annual Performance Management Report; Outcomes and Publications sections of the following grantee types Performance Reports: ARRT, RERC, and RRTC. Frequency: Annually. Collection Period: 2002 Data Available: April 2003 Validated By: On-Site Monitoring By ED. Verified by Dept. of Ed. attestation process and ED Standards for Evaluation Program Performance Data. Extrapolated document from NIDRR web based Performance Reporting System. Limitations: Data is based upon reports by the funded centers. Concerns have been raised about the potential for under-reporting. Methods to indepedently confirm publications are planned. The number of publications using the strict definitions are likely to fairly represent the productivity of centers in areas related to engineering and medicine. However, these definitions may not fully represent the productivity of centers in other areas. Improvements: NIDRR is evaluating methods of assessing productivity that fairly represent all parets of the NIDRR grant portfolio. |
||||||||||||||||||||||||||||||||||||
| Objective 8.2 of 4: Disseminate and promote use of information on research findings, in accessible formats, to improve rehabilitation services and outcomes. |
| Indicator 8.2.1 of 1: Information and TA usefulness: Recipients will find the products, information, and technical assistance that they receive from grantees useful. | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| Targets and Performance Data | Assessment of Progress | Sources and Data Quality | |||||||||||||||||||||||||||||||||||||||||||||||||||
|
Status: Target exceeded
Progress: Current information on this indicator is based on Disability and Business Technical Assistance Centers (DBTACs) reporting system ADA Impact Management System (AIMS, data for Year '01 and '02) The AIMS use a Likert Scale. Explanation: The AIMS survey consists of postcard survey that is sent out after a request for information on ADA. The survey is voluntary and in '02, 715 customers completed the required 8 questions. Question #5 refers to the usefulness of materials requested. 97% of respondents rated the information as Very and Somewhat Useful; 2% as Not Very Useful and 1% as Not Applicable. |
Source: Other Other: Other. Additional Source Information: AIMS Survey. Frequency: Semi-Annually. Collection Period: 2001 Data Available: January Validated By: On-Site Monitoring By ED. Limitations: Sample size is limited. |
|||||||||||||||||||||||||||||||||||||||||||||||||||
| Objective 8.3 of 4: Expand system capacity for conduct of high-quality rehabilitation research and services by ensuring availability of qualified researchers and practitioners, including persons with disabilities and other underserved groups. |
| Indicator 8.3.1 of 2: Contributions of trainees and fellows: Contributions by NIDRR trainees and fellows that apply to study rehabilitation will increase. | ||||||||||||||||||||||||||||||||||||
| Targets and Performance Data | Assessment of Progress | Sources and Data Quality | ||||||||||||||||||||||||||||||||||
|
Status: Target met
Explanation: Our Capacity Building data reported in this period come from the ARRTs only. The ARRTs conduct the NIDRR Fellows Program. Other NIDRR programs are not required to report these data. The measure is based on the number of fellows surveyed. In FY '01, there were 18 fellows. In FY '02 we based our data on the number of centers funded (15) with an average of 3-4 fellows in each program. The number of fellows varies every year. |
Source: Other Other: Other. Additional Source Information: AART, NIDRR Annual Performance Management Report Frequency: Annually. Collection Period: 2002 Data Available: October 2002 Validated By: On-Site Monitoring By ED. Verified by Dept. of Ed. attestation process and ED Standards for Evaluation Program Performance Data. Limitations: Our capacity building data comes from the ARRT training/fellows program. In FY02 there were 15 funded centers, on average each program has 3-4 full-time fellows conducting post doctoral research. NIDRR's reporting system has data on 14 of these centers. These data indicate that 102 publications resulted from the work of the fellows in these centers. An average of 6 publications and 12 presentations per center and 2 per fellow. The number of fellows in each center varies every year. |
||||||||||||||||||||||||||||||||||
| Indicator 8.3.2 of 2: Researchers with disabilities and from underserved groups: Participation of researchers working in the field who have disabilities or are from underserved groups will increase. | ||||||||||||||||||||||||||||||||||||
| Targets and Performance Data | Assessment of Progress | Sources and Data Quality | ||||||||||||||||||||||||||||||||||
|
Status: Unable to judge
Explanation: The information collected is based on the grantees reports on Staffing by staffing position and category. Some persons worked less than full time on the grant. The data refer only to paid grantee staff. The total number of centers reporting during this period was 114 (58%) out of 194 centers who entered their staffing information using the new web system. This measure represents successful completion of planning tasks and conduct of capacity building and outreach conference. Participation of at least 25 individuals from currently funded entities and individuals from other eligible entities. |
Source: Other Other: Other. Additional Source Information: NIDRR Web Reporting System; Annual Performance Report; NIDRR Performance Reporting System sections on Staffing from the following programs only D&U, DRRP, FIP, MS, RERC, RRTC. Frequency: Annually. Collection Period: 2002 Data Available: January 2002 Validated By: Federal Statistical Agencies. Limitations: Disability and minority data reported on the Staffing section of the NIDRR web-based Performance Reporting System are based on voluntary disclosure information. |
||||||||||||||||||||||||||||||||||
| Objective 8.4 of 4: Ensure productivity and management effectiveness. |
| Indicator 8.4.1 of 1: Usefulness of NIDRR products: The percentage of customers reporting that NIDRR products and information are useful will increase. | |||||||||||||
| Targets and Performance Data | Assessment of Progress | Sources and Data Quality | |||||||||||
|
Status: Target met
Progress: Data gathering activities were started in 2001, with help from the National Center for the Dissemination of Disability Research (NCDRR) annual survey. The survey seeks comsumers' and stakeholders' input and interests on disability research information and their ability to access such information. The sample consisted of 1028 consumers from NIDRR's Independent Living Centers; 430 stakeholders and 166 NIDRR grantees' researchers. Explanation: Ninety-four (94%) of consumers and stakeholders indicated that disability research information was useful. They stated that their preferred means of accessing research information was contacting community service providers (70%), disability research organizations (68%); looking in brochures (56%) and looking on the Internet (54%). Eighty-two (82%) of researchers use the Internet, 66% use brochures and 58% use research journals. Overall consumers used these approaches less frequently. |
Source: Other Other: Other. Sponsor: National Center for the Dissemination of Disability Research.. Date Sponsored: 01/01/2001. Additional Source Information: The National Center for the Dissemination of Disability Research (NCDRR) engages annually on a survey activity that helps increase the knowledge base in the National Institute on Disabilty and Rehabilitation research community regarding dissemination and utilization of research findings. A key component of the research is to gain knowledge on what kinds of disability - related research are key to consumers, how they prefer to learn about this information and how they apply it. Frequency: Annually. Collection Period: 2003 Data Available: July 2003 Validated By: On-Site Monitoring By ED. The survey addresses three distinct types of customers - 1) Consumer group - individuals with disabilities and their families participating in Independent Living Centers across the country; 2) Stakeholders-- representatives from various organizations that come in direct contact with consumers and 3) Researchers -- only NIDRR-funded researchers, i.e. grantees. Limitations: Results are based on relatively small samples of the three types of customers. Improvements: Questions on the survey must be refined to look for the usefulness on the information presented (i.e. formats) and access needs. |
|||||||||||
