Publications
TITLE
SYNOPSIS
CITATION
LINK
Approaches to Increasing Treatment Integrity
Strategies designed to increase treatment integrity fall into two categories: antecedent-based strategies and consequence-based strategies.
Detrich, R., States, J. & Keyworth, R. (2017). Approaches to Increasing Treatment Integrity. Oakland, Ca. The Wing Institute
Overview: Formal Teacher Evaluation
The purpose of this overview is to provide information about the role of formal teacher evaluation, the research that examines the practice, and its impact on student outcomes.
Performance Feedback in Education: On Who and For What
This paper reviews the importance of feedback in education reviewed the scientific model of behavior change (antecedent, behavior, consequences).
Daniels, A. (2013). Feedback in Education: On Whom and for What. In Performance Feedback: Using Data to Improve Educator Performance (Vol. 3, pp. 77-95). Oakland, CA: The Wing Institute.
Treatment Integrity in the Problem Solving Process
The usual approach to determining if an intervention is effective for a student is to review student outcome data; however, this is only part of the task. Student data can only be understood if we know something about how well the intervention was implemented. Student data without treatment integrity data are largely meaningless because without knowing how well an intervention has been implemented, no judgments can be made about the effectiveness of the intervention. Poor outcomes can be a function of an ineffective intervention or poor implementation of the intervention. Without treatment integrity data, the is a risk that an intervention will be judged as ineffective when, in fact, the quality of implementation was so inadequate that it would be unreasonable to expect positive outcomes.
Detrich, R., States, J. & Keyworth, R. (2017). Treatment Integrity in the Problem Solving Process. Oakland, Ca. The Wing Institute.
Value-Added Research in Education: Reliability, Validity, Efficacy, and Usefulness
The purpose of this paper on value-added research in education is to define this type of research, provide an overview of how it has been conducted, and discuss its benefits and limitations.
Cleaver, S., Detrich, R. & States, J. (2020). Overview of Value-Added Research in Education: Reliability, Validity, Efficacy, and Usefulness. Oakland, CA: The Wing Institute. https://www.winginstitute.org/staff-value-added.
Data Mining
TITLE
SYNOPSIS
CITATION
LINK
Does Feedback Improve Performance?
This review is a summary of the effect size of the effectiveness feedback to improve both student and teacher performance.
States, J. (2011). Does Feedback Improve Performance? Retrieved from does-feedback-improve-performance.
Does professional development make a difference in student performance?
This analysis looks at a systematic review of teacher professional development on student achievement.
States, J. (2011). Does professional development make a difference in student performance? Retrieved from does-professional-development-make.
How does coaching compare with traditional staff development in improving student achievement?
This analysis compares the effectiveness of coaching compared to traditional forms of professional development for teachers.
States, J. (2012). How does coaching compare with traditional staff development in improving student achievement? Retrieved from how-does-coaching-compare.
How does performance feedback affect the way teachers carry out interventions?
This analysis examined the impact of performance feedback on the quality of implementation of interventions.
Detrich, R. (2015). How does performance feedback affect the way teachers carry out interventions? Retrieved from how-does-performance-feedback.
How often are treatment integrity measures reported in published research?
This analysis examined the frequency that treatment integrity is reported in studies of research-based interventions.
Detrich, R. (2015). How often are treatment integrity measures reported in published research? Retrieved from how-often-are-treatment.
How well are Interventions Implemented in Educational Settings?
This analysis examined two studies to understand the reliability of self-reporting of practitioners implementing interventions.
Detrich, R. (2015). How well are Interventions Implemented in Educational Settings? Retrieved from how-well-are-interventions.
Is there empirical research to validate the use of prereferral intervention teams (PIT) to reduce special education referrals, achieve gains, or improve student conduct?
This is a review of a meta-analysis of Prereferral Intervention Teams on student and system outcomes.
States, J. (2011). Is there empirical research to validate the use of prereferral intervention teams (PIT) to reduce special education referrals, achieve gains, or improve student conduct? Retrieved from is-there-empirical-research.
What evidence do principals rely on in assessing the quality of a teacher’s instruction?
This analysis examines principal sources of information on teacher instructional competency and the amount of time spent assessing teacher's instructional skills.
States, J. (2015). What evidence do principals rely on in assessing the quality of a teacher’s instruction? Retrieved from what-evidence-do-principals.
What Teacher Training Methods Result in Changes in Classroom Practices?
This analysis compares the effectiveness of staff development methods that include, didactic presentation, modeling, practice with feedback, and coaching.
States, J. (2011). What Teacher Training Methods Result in Changes in Classroom Practices? Retrieved from what-teacher-training-methods.
Presentations
TITLE
SYNOPSIS
CITATION
LINK
Performance Feedback in Education: On Who and For What
This paper reviews the importance of feedback in education reviewed the scientific model of behavior change (antecedent, behavior, consequences).
Daniels, A. (2011). Performance Feedback in Education: On Who and For What [Powerpoint Slides]. Retrieved from 2011-wing-presentation-aubrey-daniels.
Performance Feedback: Use It or Lose It
This paper examines the importance of performance feedback systems at all levels of school, staff and student outcomes to achieve desired results over time.
Keyworth, R. (2011). Performance Feedback: Use It or Lose It [Powerpoint Slides]. Retrieved from 2011-aba-presentation-randy-keyworth.
School Reform and Culture Change: What We Missed
This analysis reviews the ongoing failure of school reform efforts in the context of poor teacher preparation and performance feedback.
Keyworth, R. (2012). School Reform and Culture Change: What We Missed [Powerpoint Slides]. Retrieved from 2012-wing-presentation-randy-keyworth.
Teacher Coaching: The Missing Link in Teacher Professional Development
Research suggests that coaching is one of the most effective strategies in training teachers. This paper identifies the critical practice elements of coaching and their absence in teacher training.
Keyworth, R. (2013). Teacher Coaching: The Missing Link in Teacher Professional Development [Powerpoint Slides]. Retrieved from 2013-calaba-presentation-randy-keyworth.
Teacher Induction: Where the Rubber Meets the Road
The paper examines one of the most critical components of teach training: an on-the-job, ongoing system of coaching and performance feedback to improve skill acquisition, generalization and maintenance.
Keyworth, R. (2010). Teacher Induction: Where the Rubber Meets the Road [Powerpoint Slides]. Retrieved from 2010-aba-presentation-randy-keyworth.
Treatment Integrity: Necessary by Not Sufficient for Improving Outcomes
Treatment integrity is necessary to improve outcomes but it is not sufficient. It is also necessary to implement scientifically supported interventions.
Detrich, R. (2015). Treatment Integrity: Necessary by Not Sufficient for Improving Outcomes [Powerpoint Slides]. Retrieved from 2015-ebpindisabilities-txint-presentation-ronnie-detrich.
Using Student Data as a Basis for Feedback to Teachers
This paper offers an alternative to evaluating teachers based on student performance on annual high stakes tests.
Detrich, R. (2011). Using Student Data as a Basis for Feedback to Teachers [Powerpoint Slides]. Retrieved from 2011-aba-presentation-ronnie-detrich.
Student Research
TITLE
SYNOPSIS
CITATION
LINK
Effects of a problem solving team intervention on the problem-solving process: Improving concept knowledge, implementation integrity, and student outcomes.
This study evaluated the effects of a problem solving intervention package that included problem-solving information, performance feedback, and coaching in a student intervention planning protocol.
Vaccarello, C. A. (2011). Effects of a problem solving team intervention on the problem-solving process: Improving concept knowledge, implementation integrity, and student outcomes. Retrieved from student-research-2011.
