Treatment Fidelity in Reading Intervention Studies

Treatment Fidelity in Reading Intervention Studies

First Author: Philip Capin -- University of Texas at Austin
Additional authors/chairs: 
Melodee A. Walker; Sharon Vaughn ; Jeanne Wanzek
Keywords: Fidelity, Systematic review, Reading, Multi-tier intervention
Abstract / Summary: 

Purpose: Treatment fidelity data are critical to interpreting and generalizing outcomes of intervention research. The purpose of this synthesis is to examine how treatment fidelity is measured and reported over time. This synthesis expands on and extends prior reviews (e.g., Wanzek, Haring, Ciullo, & McCulley, 2011) by examining treatment fidelity practices for Tier 2 and 3 type reading interventions from 1995 to 2015.

Method: The authors designed a codesheet based on guidelines developed in the health (e.g., Bellg et al., 2004) and educational fields (e.g., Gersten et al., 2005) for the collection and reporting of treatment fidelity. All studies (n = 101) were coded to extract and classify information related to (a) implementer training and support, (b) treatment integrity, (c) treatment differentiation, and (d) general study features specified in the What Works Clearinghouse Design and Implementation Assessment Device (IES, 2011).

Results: Data analysis will be completed by January 1, 2016. We will report on the proportion of intervention studies that report treatment fidelity. We will also analyze how the types and quality of fidelity reporting has changed over time. We hypothesize that fidelity data reporting has improved over time; however, a majority of studies will not sufficiently describe implementer training and support or the fidelity collection methods, in order to allow for study replications. We also hypothesize approximately half of all studies will not provide quantitative fidelity data.

Implications: Findings and implications for future fidelity data collection and reporting in reading interventions will be provided.