minutes-o.gif (1287 bytes)

Summary of Treatment Fidelity Workgroup

July 12-13, 2001, Washington, DC

Present:

Al Bellg, Rush-Presbyterian-St. Luke’s Medical Center
Belinda Borrelli, The Miriam Hospital/Brown University
Susan Czajkowski, NHLBI
Diane Elliot, OHSU
Paul Estabrooks, Kansas State University
Jackie Hecht, Miriam Hospital/Brown University
Gary Kreps, NCI
Gebenga Ogedegbe, Cornell University
Denise Orwig, University of Maryland
Deb Riebe, University of Rhode Island
Barbara Resnick, University of Maryland
Deborah Sepinwall, Brown/Miriam
Geof Williams, University of Rochester

     
I. Definition of Treatment Fidelity: Includes Design, Delivery, Training, Receipt and Enactment
II. Consensus re: what % of tapes should be reviewed for Treatment Fidelity
  • Begin with 20 – 25% of tapes that are selected blindly and randomly, especially when good rater reliability has been established.
  • Develop a priori coding criteria.
  • Consult with your project statistician.
  • Tapes should be randomly selected throughout the intervention period and areas of omission (leaving key things out) and commission (including key things that don’t belong)
III. SBM Workshop Proposed Outline
  • Define goals of the workshop
  • Present introduction and rationale of the model
  • Clarification of terms and domains of the model, including use of term “treatment fidelity”… We may want to consider calling this “optimizing treatment” or “evaluating treatment quality”
  • Review matrix (best practices)
  • Describe the model by construct, using examples from BCC studies that address different behaviors (e.g., smoking, nutrition, physical activity)
  • Organize workshop by different treatment fidelity areas (e.g., training, design, receipt, enactment).
  • Provide handouts including: a) model description; b) tx fidelity checklists; c) monitoring tools; d) template with existing BCC project and blank template for participants to apply their own work; and e) “Best Practices” Paper and Matrix.
IV. History of Treatment Fidelity/Review Paper
  • Goal: To replicate Moncher and Prinz paper with a focus on behavioral interventions/health behavior
  • 10 journals that are the most popular within the Health Promotion field have been selected from the last decade
    1. Suggestion: include some international journals and those selected by the RE-Aim group (e.g., Journal of Health Psychology, UK)
  • Deborah Sepinwall from Brown University will take the lead in reviewing the literature; she will start on August 6, 2001.
  • Have at least 2 people code each article
  • Set a priori guidelines, allowing for flexibility and needed modifications.
  • Pilot test the coding
  • Next step: Come up with criteria for selecting journals… may consider limiting the search to the past 5 years, if the volume is too great.