Education Drivers

Effective Instruction Treatment Integrity

For the best chance of a positive impact on educational outcomes, two conditions must be met: (a) Effective interventions must be adopted, and (b) those interventions must be executed with sufficient quality (treatment integrity) to ensure the intervention is implemented as designed. Treatment integrity research finds that integrity scores are very low and, in practice, implementation is rarely assessed. If an intervention with a strong research base is not implemented with a high level of treatment integrity, then the students do not actually experience the intervention and there is no reason to assume they will benefit from it. Under these circumstances, it is impossible to know if poor outcomes are the result of an ineffective intervention or poor implementation of that intervention. Treatment integrity is defined as consistently implementing the essential components of an intervention as planned, intended, and originally designed. Studies find degradation of fidelity begins shortly after training. To ensure consistent levels of treatment integrity, teachers require ongoing monitoring and feedback of implementation. To date, research has not identified what threshold of treatment integrity is required to ensure the optimum benefit of an evidence-based practice.

Publications

TITLE
SYNOPSIS
CITATION
Treatment Integrity: Fundamental to Education Reform

To produce better outcomes for students two things are necessary: (1) effective, scientifically supported interventions (2) those interventions implemented with high integrity.  Typically, much greater attention has been given to identifying effective practices.  This review focuses on features of high quality implementation.

Detrich, R. (2014). Treatment integrity: Fundamental to education reform. Journal of Cognitive Education and Psychology, 13(2), 258-271.

Innovation, Implementation Science, and Data-Based Decision Making: Components of Successful Reform

Schools are often expected to implement innovative instructional programs.  Most often these initiatives fail because what we know from implementation science is not considered as part of implementing the initiative.  This chapter reviews the contributions implementation science can make for improving outcomes for students.

Detrich, R. Innovation, Implementation Science, and Data-Based Decision Making: Components of Successful Reform. Handbook on Innovations in Learning, 31.

Treatment Integrity: A Fundamental Unit of Sustainable Educational Programs.

Reform efforts tend to come and go very quickly in education. This paper makes the argument that the sustainability of programs is closely related to how well those programs are implemented.

Detrich, R., Keyworth, R. & States, J. (2010). Treatment Integrity: A Fundamental Unit of Sustainable Educational Programs. Journal of Evidence-Based Practices for Schools, 11(1), 4-29.

Using Performance Feedback to Improve Teacher Effectiveness

This paper examines intervention and instruction failures and describe concrete steps that implementers can take to improve the results of their instruction and intervention in classrooms.

VanDerHeyden, A. (2013). Are We Making the Differences That Matter in Education? In Performance Feedback: Using Data to Improve Educator Performance (Vol. 3, pp. 119-138). Oakland, CA: The Wing Institute.

 

Presentations

TITLE
SYNOPSIS
CITATION
Using Performance Feedback to Improve Teacher Effectiveness

This paper examines intervention and instruction failures and describe concrete steps that implementers can take to improve the results of their instruction and intervention in classrooms.

VanDerHeyden, A. (2011). Using Performance Feedback to Improve Teacher Effectiveness [Powerpoint Slides]. Retrieved from 2011-wing-presentation-amanda-vanderheyden.

Treatment Integrity and Program Fidelity: Necessary but Not Sufficient to Sustain Programs
If programs are to sustain they must be implemented with integrity. If there is drift over time, it raises questions about whether the program is sustaining or has been substantially changed.
Detrich, R. (2008). Treatment Integrity and Program Fidelity: Necessary but Not Sufficient to Sustain Programs [Powerpoint Slides]. Retrieved from 2008-aba-presentation-ronnie-detrich.
Treatment Integrity: A Fundamental Component of PBS
School-wide initatives have to be well implemented if there is to be any benefit. This talk describes methods for assuring high levels of treatment integrity.
Detrich, R. (2008). Treatment Integrity: A Fundamental Component of PBS [Powerpoint Slides]. Retrieved from 2008-apbs-txint-presentation-ronnie-detrich.
Toward a Technology of Treatment Integrity
If research supported interventions are to be effective it is necessary that they are implemented with integrity. This paper describes approahes to assuring high levels of treatment integrtiy.
Detrich, R. (2011). Toward a Technology of Treatment Integrity [Powerpoint Slides]. Retrieved from 2011-apbs-presentation-ronnie-detrich.
Treatment Integrity: Necessary by Not Sufficient for Improving Outcomes
Treatment integrity is necessary to improve outcomes but it is not sufficient. It is also necessary to implement scientifically supported interventions.
Detrich, R. (2015). Treatment Integrity: Necessary by Not Sufficient for Improving Outcomes [Powerpoint Slides]. Retrieved from 2015-ebpindisabilities-txint-presentation-ronnie-detrich.

 

Student Research

TITLE
SYNOPSIS
CITATION
Preparing teachers to train parents in the use of evidence-based strategies for reading fluency.
This study evaluated the effects of training teachers to train parents to implement a program for increasing reading fluency for struggling readers. While all students improved, the quality of implementation moderated effects.
Kupzyk, S. (2009). Preparing teachers to train parents in the use of evidence-based strategies for reading fluency. Retrieved from student-research-2009-c.

No items found.

TITLE
SYNOPSIS
Association for Behavior Analysis International (ABAI)
ABAI organization promotes the development, and support of the science of behavior analysis through research, education, and practice.
Center on Teaching and Learning (CTL)
CTL is research center that conducts and disseminates research that focuses on practical solutions to serious problems in school systems.
National Center on Student Progress Monitoring
The Center's mission is to provide technical assistance to states and districts and disseminate information about progress monitoring practices proven to work in different academic content areas (Gr. K-5).
Back to Top