Portfolio Analysis of NIH Prevention Research

The ODP plays an important role in characterizing the NIH prevention research portfolio. Since 2015, the ODP has been developing better approaches to describe and understand NIH-funded prevention research and to summarize study findings in a meaningful way.

The ODP’s process and the major results of our work are highlighted below.

Why the ODP Analyzes NIH Prevention Research

why-the-odp-analyzes-nih-prevention-research

The ODP seeks to better understand the NIH’s investment in prevention research by methodically characterizing the NIH prevention research portfolio, providing more information about what the NIH is funding and in greater detail than previously available.

More specific identification and analysis of NIH-funded prevention research enables the ODP to assess the progress and changes in NIH-funded prevention research over time. These efforts help the ODP describe trends in NIH-funded prevention research and identify gaps in the NIH prevention research portfolio that could benefit from targeted investments, potentially addressing important modifiable risk factors and, therefore, reducing the burden of preventable disease.

The ODP provides leadership for the development, coordination, and implementation of prevention research in collaboration with NIH Institutes and Centers and other partners. Fulfilling this vision depends on the ODP’s ability to accurately characterize studies across a number of dimensions such as topic area, study design, population studied, and type of prevention research.

How the ODP Identifies and Classifies NIH Prevention Research

how-the-odp-identifies-and-classifies-nih-prevention-research


Defining and Coding Prevention Research

The ODP defines prevention research as encompassing both primary and secondary prevention research in humans, as well as prevention-related methods for use in humans—it does not include basic or preclinical studies that could still be years away from preventing disease or disability.

Working closely with the Office of Portfolio Analysis (OPA), the ODP developed new methods to apply a machine learning approach to the NIH’s prevention research portfolio based on the ODP's definition of prevention research.

Once the machine learning tools identify relevant NIH prevention research projects, the ODP’s prevention research taxonomy (PDF)—along with a detailed protocol (PDF)—serves as a set of rules for coding project abstracts. The taxonomy is a framework for classifying research and includes 140 non-mutually exclusive topics grouped into six categories. The protocol provides teams of coders with instructions, definitions, and examples to support the accurate, standardized classification of research projects.

Overall process of characterizing the NIH prevention research portfolio using a novel machine learning algorithm. #1: Database of funded NIH grants (FY2012-2017). #2: Feed into Machine Learning Program. #3: Machine learning program identifies prevention and non-prevention projects. #3 50% of prevention projects are manually coded and 5% of non-prevention are manually coded by staff. #4: Quality control checks of project coding. #5: Extrapolation of data. #6: Database of well-annotated NIH-funded prevention research.

The ODP continually refines and trains its machine learning algorithms to identify prevention research projects. Efforts are currently underway to apply machine learning to support coding more specific details of individual prevention research grants based on the ODP taxonomy, such as the health condition, study population, study design, and type of prevention research.


1Protocol: Coding Abstracts Using the ODP Prevention Taxonomy - version 1.0 (PDF)
 

Analysis and Findings: NIH Investment in Prevention Research

analysis-and-findings-nih-investment-in-prevention-research


Summary and Early Findings

  • The ODP coded more than 11,000 research projects across 12 activity codes for grants awarded in fiscal years 2012–2017, leading to the first-ever detailed analysis of the NIH prevention research portfolio.
  • These 12 activity codes represent 91.7% of all new projects and 84.1% of all dollars used in NIH research supported by extramural grants and collaborative agreements.
  • The ODP collaborated with the OPA to develop novel machine learning algorithms that identify prevention research projects. Because the machine learning method was specifically trained to recognize applied prevention research, it more accurately identified applied prevention grants than other approaches.
  • Using these new tools and methods, the ODP found that primary and secondary prevention research represents 16.7% of NIH research projects and 22.6% of NIH research funding.
  • A large proportion of prevention research projects included observational studies (63.3%), analysis of existing data (43.4%), or methods research (23.9%). Projects using a randomized clinical trial design represented less than a fifth (18.2%) of the NIH prevention research portfolio.
Primary and Secondary Prevention Research

The ODP regularly publishes the results of its analyses of the NIH prevention research portfolio in specific areas, which are listed below. New publications will be added as they become available.
 

Diet and Physical Activity
Leading Causes and Risk Factors of Death and Disability
Substance Use

1Protocol: Coding Abstracts Using the ODP Prevention Taxonomy - version 1.0 (PDF)
 

 

Interested in exploring NIH-funded research projects?

Search these databases for NIH-funded research projects, publications, and more.

 

 

 

 

 

Last updated on December 1, 2020