Skip Navigation
Department of Health and Human Services www.hhs.gov
 
Slide Tray
0 slides

Return to Slide Library

Slides

Add Search Results to Slide Tray Search:

"methodology"

Slides: 1–12 of 20
This slide includes a table with two columns and three rows. Column 1, row 1: high. Column 2, row 2: High confidence that the evidence reflects the true effect. Further research is very unlikely to change our confidence in the estimate of effect. Column 1, row 2: moderate. Column 2, row 2: Moderate confidence that the evidence reflects the true effect. Further research may change our confidence in the estimate of effect and may change the estimate. Column 1, row 3: low. Column 2, row 3: Low confidence that the evidence reflects the true effect. Further research is likely to change our confidence in the estimate of effect and is likely to change the estimate. Column 1, row 4: insufficient. Column 2, row 4: Evidence is either unavailable or does not permit estimation of an effect. There is a footnote at the bottom that includes the following references: Guyatt GH, et al. BMJ 2008;336:924-6; Owens DK, et al. J Clin Epidemiol 2010;63:513-23; Samson  DJ, et al. AHRQ Comparative Effectiveness Review No. 20. Available at: http://www.effectivehealthcare.ahrq.gov/index.cfm/search-for-guides-reviews-and-reports/?pageaction=displayproduct&productID=447.

Rating the Strength of Evidence From the CER: A Modification of the GRADE Methodology

Extracting the Data. Who should extract the data? Domain experts versus methodologists. What extraction method should be used? Single or double independent extraction followed by reconciliation versus single extraction and independent verification. Should data extraction be blinded (to authors, journal, results)?

Extracting the Data

Rating the Strength of Evidence From the CER: A Modification of the GRADE Methodology

Four Required Domains: Consistency Scores. Only three possible scores for consistency: Consistent (i.e., no inconsistency). Inconsistent. Unknown or not applicable (single study cannot be assessed). Meta-analysis: Use appropriate tests, such as Cochran’s Q test or I<sup2</sup> statistics.

Four Required Domains: Consistency Scores

Alt text:
Results: Additional Sensitivity Analyses. Give the results of additional analyses, such as sensitivity or subgroup analyses and meta-regressions. Include the results of additional analyses to facilitate a better understanding of heterogeneity. Example 1: “[B]enefits of chondroitin were smaller in trials with adequate concealment of allocation compared with trials with unclear concealment (P for interaction = 0.050), in trials with an intention-to-treat analysis compared with those that had excluded patients from the analysis (P for interaction = 0.017), and in large compared with small trials (P for interaction = 0.022).”

Results: Additional Sensitivity Analyses

Presenting Popular Studies Is Not Enough. One evaluation compared the results of popular studies against others with populations and methodologies that were similar or superior. Evaluation of 45 studies published from 1993 to 2000 in journals with high impact factors that reported positive findings and were cited more than 1,000 times. Results were compared against other studies with the same comparators by employing populations and methodologies that were similar or superior. Opposite/null findings or much more dramatic effects were found 31 percent of the time. Eighty-three percent of nonrandomized studies and 23 percent of randomized controlled trials were subsequently contradicted.

Presenting Popular Studies Is Not Enough

Pages: [1] 2 Next