Publications
Increasing education’s reliance on evidence to guide decisions requires a significant change in the culture of districts and schools. This paper reviews the implications of moving toward evidence-based education.
Detrich, R., Keyworth, R., & States, J. (2007). A Roadmap to Evidence-based Education: Building an Evidence-based Culture. Journal of Evidence-based Practices for Schools, 8(1), 26-44.
The notion of best available evidence implies that some evidence is better than other. This paper reviews different sources of evidence and the relative strengths and limitations of each type.
Slocum, T. A., Spencer, T. D., & Detrich, R. (2012). Best available evidence: Three complementary approaches. Education and Treatment of Children, 35(2), 153-181.
The systematic review process is an assessment and, as such, concerns about validity of the assessment are paramount. In this paper, we review the considerations that are important in reaching conclusions about the adequacy of a systematic review.
Slocum, T. A., Detrich, R., & Spencer, T. D. (2012). Evaluating the validity of systematic reviews to identify empirically supported treatments. Education and Treatment of Children, 35(2), 201-233.
Evidence-based practice is a framework for decision making. Even with high quality evidence there are likely sources of uncertainty that practitioners must confront.
Detrich, R., Slocum, T. A., & Spencer, T. D. (2013). Evidence-based education and best available evidence: decision-making under conditions of uncertainty. Evidence-Based Practices, 26, 21.
This article examines the evidence-based practice decision-making heuristic in the broader context of clinical decision making.
Chorpita, B. F., & Starace, N. K. (2010). Evidence-based practice in the broader context: How can we really use evidence to inform decisions. Journal of Evidence-Based Practices for Schools, 11(1), 47-61.
Synopsis: Evidence-based practice is characterized as a framework for decision-making integrating best available evidence, clinical expertise, and client values and context. This paper reviews how these three dimensions interact to inform decisions.
Spencer, T. D., Detrich, R., & Slocum, T. A. (2012). Evidence-based practice: A framework for making effective decisions. Education and Treatment of Children, 35(2), 127-151.
Evidence-based, empirically-supported, and best practice are often used interchangeably. A case is made that for clarity each term should have a separate and distinct meaning.
Detrich, R. (2008). Evidence-Based, Empirically Supported, OR Best Practice?. Effective practices for children with autism, 1.
Fidelity of implementation is a critical but often neglected component of any new system, practice, or intervention in educational research and practice. Fidelity is a multidimensional construct focused on providing evidence of adherence, quality, dosage, differentiation, and responsiveness following implementation. Unfortunately, fidelity has not always been prioritized, although evidence suggests that is changing, at least in published research.
Gage, N., MacSuga-Gage, A., and Detrich, R. (2020). Fidelity of Implementation in Educational Research and Practice. Oakland, CA: The Wing Institute.
This paper examines the types of research to consider when evaluating programs, how to know what “evidence’ to use, and continuums of evidence (quantity of the evidence, quality of the evidence, and program development).
Twyman, J. S., & Sota, M. (2008). Identifying research-based practices for response to intervention: Scientifically based instruction. Journal of Evidence-Based Practices for Schools, 9(2), 86-101.
This book provides a guide to the conceptual and practical knowledge principals, superintendents, and other school leaders need to implement evidence-based educational innovations.
Wallace, F., Blasé, K., Fixsen, D., & Naoom, S. (2008). Implementing the Findings of Research: Bridging the Gap between Knowledge and Practice. Educational Research Service.
This paper outlines the best practices for researchers and practitioners translating research to practice as well as recommendations for improving the process.
Shriver, M. D. (2007). Roles and responsibilities of researchers and practitioners for translating research to practice. Journal of Evidence-Based Practices for Schools, 8(1), 1-30.
Applied behavior analysis emphasizes being scientifically-based In this paper, we discuss how the core features of evidence-based practice can be integrated into applied behavior analysis.
Slocum, T. A., Detrich, R., Wilczynski, S. M., Spencer, T. D., Lewis, T., & Wolfe, K. (2014). The Evidence-Based Practice of Applied Behavior Analysis. The Behavior Analyst, 37(1), 41-56.
This article allows readers to determine if a specific study is a credible example of single-subject research and if a specific practice or procedure has been validated as “evidence-based” via single-subject research.
Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Wolery, M. (2008). The use of single-subject research to identify evidence-based practice in special education. Advances in Evidence-Based Education, 1(1), 67-87.
To produce better outcomes for students two things are necessary: (1) effective, scientifically supported interventions (2) those interventions implemented with high integrity. Typically, much greater attention has been given to identifying effective practices. This review focuses on features of high quality implementation.
Detrich, R. (2014). Treatment integrity: Fundamental to education reform. Journal of Cognitive Education and Psychology, 13(2), 258-271.
This article focuses on the most fundamental question regarding evidence-based practice: What is evidence? To address this question, the authors first review several of the definitions, criteria, and strategies that have been used to define scientific evidence.
Drake, R.E., Latimer, E.S., Leff, H. S., McHugi, G. J., Burns, B. J. (2004). What is Evidence?. In Child and Adolescent Psychiatric Clinics of North America, Vol. 13, pp. 717-728
This paper examines a range of education failures: common mistakes in how new practices are selected, implemented, and monitored. The goal is not a comprehensive listing of all education failures but rather to provide education stakeholders with an understanding of the importance of vigilance when implementing new practices.
States, J., & Keyworth, R. (2020). Why Practices Fail. Oakland, CA: The Wing Institute. https://www.winginstitute.org/roadmap-overview
Data Mining
This item provides information for practitioners on how to interpret effect sizes found in research papers.
States, J. (2010). How can I interpret the effect size from a study into the impact a practice might have if I implement the practice in my classroom or school? Retrieved from how-can-i-interpret.
Presentations
Systematic data-based decision making is critical to insure that educators are able to identify, implement, and trouble shoot evidence-based interventions customized to individual students and needs.
Keyworth, R. (2010). A Systematic Approach to Data-based Decision Making in Education [Powerpoint Slides]. Retrieved from 2010-hice-presentation-randy-keyworth.
This paper examines the critical pracitce elements of data-based decision making and strategies for building school cultures to support the process.
Keyworth, R. (2009). A Systematic Approach to Data-based Decision Making in Education: Building School Cultures [Powerpoint Slides]. Retrieved from 2009-campbell-presentation-randy-keyworth.
This paper examines the issues, challenges, and opportunities of creating a school culture that uses data systematically in all of its decision making.
Keyworth, R. (2009). Building a Data-based Decision Making Culture through Performance Management [Powerpoint Slides]. Retrieved from 2008-aba-presentation-randy-keyworth.
This paper reviews the legal and ethical basis for relying on scientifically supported interventions to improve outcomes for students.
Detrich, R. (2007). Evidence, Ethics, and the Law [Powerpoint Slides]. Retrieved from 2007-apbs-presentation-ronnie-detrich.
On the face of it, the mandate to utilize scientifically supported interventions to improve outcomes seems obvious and straighforward. The paper reviews the challenges involved in doing so.
Detrich, R. (2007). Evidence-based Education: It Isn't as Simple as You Might Think [Powerpoint Slides]. Retrieved from 2007-calaba-ebe-presentation-ronnie-detrich.
This paper examines the types of research to consider when evaluating programs, how to know what “evidence’ to use, and continuums of evidence (quantity of the evidence, quality of the evidence, and program development).
Twyman, J. (2007). Identifying Research-based Practices for RtI: Scientifically Based Reading [Powerpoint Slides]. Retrieved from 2007-wing-presentation-janet-twyman.
This paper outlines the best practices for researchers and practitioners translating research to practice as well as recommendations for improving the process.
Shriver, M. (2006). Roles and Responsibilities of Researchers and Practitioners Translating Research to Practice [Powerpoint Slides]. Retrieved from 2006-wing-presentation-mark-shriver.
This paper examines the policy, culture, and system obstacles to progam sustainability, and identifies strategies to overcome these obstacles.
Keyworth, R. (2008). Sustainable Programs: In Search of the Elusive [Powerpoint Slides]. Retrieved from 2008-campbell-presentation-randy-keyworth.
This paper offers an overview of issues practitioners must consider in selecting practices. Types of evidence, sources of evidence, and the role of professional judgment are discussed as cornerstones of effective evidenced-based decision-making.
States, J. (2010). What the Data Tell Us [Powerpoint Slides]. Retrieved from 2010-capses-presentation-jack-states.
This paper examines the latest research on which practice elements are essential for interventions to survive and thrive over time.
Keyworth, R. (2008). What We Know About Sustaining Programs? [Powerpoint Slides]. Retrieved from 2008-calaba-presentation-randy-keyworth.