Evidence-Based Decision Making Overview

All Wing Resources

Publications

TITLE
SYNOPSIS
CITATION
A roadmap to evidence-based education: Building an evidence-based culture

Increasing education’s reliance on evidence to guide decisions requires a significant change in the culture of districts and schools. This paper reviews the implications of moving toward evidence-based education.

Detrich, R., Keyworth, R., & States, J. (2007). A Roadmap to Evidence-based Education: Building an Evidence-based Culture. Journal of Evidence-based Practices for Schools, 8(1), 26-44.

Best Available Evidence: Three Complementary Approaches

The notion of best available evidence implies that some evidence is better than other. This paper reviews different sources of evidence and the relative strengths and limitations of each type.

Slocum, T. A., Spencer, T. D., & Detrich, R. (2012). Best available evidence: Three complementary approaches. Education and Treatment of Children, 35(2), 153-181.

Evaluating the Validity of Systematic Reviews to Indentify Empirically Supported Treatments

The systematic review process is an assessment and, as such, concerns about validity of the assessment are paramount.  In this paper, we review the considerations that are important in reaching conclusions about the adequacy of a systematic review.

Slocum, T. A., Detrich, R., & Spencer, T. D. (2012). Evaluating the validity of systematic reviews to identify empirically supported treatments. Education and Treatment of Children, 35(2), 201-233.

Evidence-Based Education and Best Available Evidence: Decision-Making Under Conditions of Uncertainty

Evidence-based practice is a framework for decision making.  Even with high quality evidence there are likely sources of uncertainty that practitioners must confront.

Detrich, R., Slocum, T. A., & Spencer, T. D. (2013). Evidence-based education and best available evidence: decision-making under conditions of uncertainty. Evidence-Based Practices, 26, 21.

Evidence-based practice in the broader context: How can we really use evidence to inform decisions

This article examines the evidence-based practice decision-making heuristic in the broader context of clinical decision making.

Chorpita, B. F., & Starace, N. K. (2010). Evidence-based practice in the broader context: How can we really use evidence to inform decisions. Journal of Evidence-Based Practices for Schools11(1), 47-61.

Evidence-based Practice: A Framework for Making Effective Decisions

Synopsis: Evidence-based practice is characterized as a framework for decision-making integrating best available evidence, clinical expertise, and client values and context.  This paper reviews how these three dimensions interact to inform decisions.

Spencer, T. D., Detrich, R., & Slocum, T. A. (2012). Evidence-based practice: A framework for making effective decisions. Education and Treatment of Children, 35(2), 127-151.

Evidence-Based, Empirically Supported, OR Best Practice?

Evidence-based, empirically-supported, and best practice are often used interchangeably. A case is made that for clarity each term should have a separate and distinct meaning.

Detrich, R. (2008). Evidence-Based, Empirically Supported, OR Best Practice?. Effective practices for children with autism, 1.

Fidelity of Implementation in Educational Research and Practice

Fidelity of implementation is a critical but often neglected component of any new system, practice, or intervention in educational research and practice. Fidelity is a multidimensional construct focused on providing evidence of adherence, quality, dosage, differentiation, and responsiveness following implementation. Unfortunately, fidelity has not always been prioritized, although evidence suggests that is changing, at least in published research.

Gage, N., MacSuga-Gage, A., and Detrich, R. (2020). Fidelity of Implementation in Educational Research and Practice. Oakland, CA: The Wing Institute.

Identifying research-based practices for response to intervention: Scientifically-based instruction

This paper examines the types of research to consider when evaluating programs, how to know what “evidence’ to use, and continuums of evidence (quantity of the evidence, quality of the evidence, and program development).

Twyman, J. S., & Sota, M. (2008). Identifying research-based practices for response to intervention: Scientifically based instruction. Journal of Evidence-Based Practices for Schools, 9(2), 86-101.

Implementing the Findings of Research: Bridging the Gap between Knowledge and Practice

This book provides a guide to the conceptual and practical knowledge principals, superintendents, and other school leaders need to implement evidence-based educational innovations.

Wallace, F., Blasé, K., Fixsen, D., & Naoom, S. (2008). Implementing the Findings of Research: Bridging the Gap between Knowledge and Practice. Educational Research Service.

Roles and responsibilities of researchers and practitioners for translating research to practice

This paper outlines the best practices for researchers and practitioners translating research to practice as well as recommendations for improving the process.

Shriver, M. D. (2007). Roles and responsibilities of researchers and practitioners for translating research to practice. Journal of Evidence-Based Practices for Schools, 8(1), 1-30.

The Evidence-Based Practice of Applied Behavior Analysis

Applied behavior analysis emphasizes being scientifically-based In this paper, we discuss how the core features of evidence-based practice can be integrated into applied behavior analysis.

Slocum, T. A., Detrich, R., Wilczynski, S. M., Spencer, T. D., Lewis, T., & Wolfe, K. (2014). The Evidence-Based Practice of Applied Behavior Analysis. The Behavior Analyst, 37(1), 41-56.

The Use of Single-Subject Research to Identify Evidence-Based Practice in Special Education

This article allows readers to determine if a specific study is a credible example of single-subject research and if a specific practice or procedure has been validated as “evidence-based” via single-subject research.

Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Wolery, M. (2008). The use of single-subject research to identify evidence-based practice in special education. Advances in Evidence-Based Education, 1(1), 67-87.

Treatment Integrity: Fundamental to Education Reform

To produce better outcomes for students two things are necessary: (1) effective, scientifically supported interventions (2) those interventions implemented with high integrity.  Typically, much greater attention has been given to identifying effective practices.  This review focuses on features of high quality implementation.

Detrich, R. (2014). Treatment integrity: Fundamental to education reform. Journal of Cognitive Education and Psychology, 13(2), 258-271.

What is Evidence?

This article focuses on the most fundamental question regarding evidence-based practice: What is evidence? To address this question, the authors first review several of the definitions, criteria, and strategies that have been used to define scientific evidence.

Drake, R.E., Latimer, E.S., Leff, H. S., McHugi, G. J., Burns, B. J. (2004). What is Evidence?. In Child and Adolescent Psychiatric Clinics of North America, Vol. 13, pp. 717-728

Why Education Practices Fail?

This paper examines a range of education failures: common mistakes in how new practices are selected, implemented, and monitored. The goal is not a comprehensive listing of all education failures but rather to provide education stakeholders with an understanding of the importance of vigilance when implementing new practices.

States, J., & Keyworth, R. (2020). Why Practices Fail. Oakland, CA: The Wing Institute. https://www.winginstitute.org/roadmap-overview

 

Data Mining

TITLE
SYNOPSIS
CITATION
Does sample size correlate to larger or smaller effect sizes obtained from reviews of research studies?
This analysis looks at the relationship between the sample size used in studies and the size plays on effect sizes derived from these studies.
States, J. (2010). Does sample size correlate to larger or smaller effect sizes obtained from reviews of research studies? Retrieved from does-sample-size-correlate.
How big will be the impact of an intervention?
The analysis shows how effect size can be used to understand the impact of educational interventions.
States, J. (2010). How big will be the impact of an intervention? Retrieved from how-big-will-be.
How can I interpret the effect size from a study into the impact a practice might have if I implement the practice in my classroom or school?

This item provides information for practitioners on how to interpret effect sizes found in research papers.

States, J. (2010). How can I interpret the effect size from a study into the impact a practice might have if I implement the practice in my classroom or school? Retrieved from how-can-i-interpret.

What is Qualitative Research?
This overview examines qualitative research and how it can be effectively used in educational research.
States, J. (2010). What is Qualitative Research? [Overview, Type A]. Retrieved from what-is-qualitative-research.
What We Know About Effect Size
This piece looks at effect size as a tool for educational researchers and practitioners.
States, J. (2010). What We Know About Effect Size Retrieved from what-we-know-about920.

 

Presentations

TITLE
SYNOPSIS
CITATION
A Systematic Approach to Data-based Decision Making in Education

Systematic data-based decision making is critical to insure that educators are able to identify, implement, and trouble shoot evidence-based interventions customized to individual students and needs.

Keyworth, R. (2010). A Systematic Approach to Data-based Decision Making in Education [Powerpoint Slides]. Retrieved from 2010-hice-presentation-randy-keyworth.

A Systematic Approach to Data-based Decision Making in Education: Building School Cultures

This paper examines the critical pracitce elements of data-based decision making and strategies for building school cultures to support the process.

Keyworth, R. (2009). A Systematic Approach to Data-based Decision Making in Education: Building School Cultures [Powerpoint Slides]. Retrieved from 2009-campbell-presentation-randy-keyworth.

An Expanded Model of Evidence-based Practice in Special Education
This paper reviews the types of evidence that can used to guide decision-making in special education as well as the necessity for high quality implementation, and monitoring the effects of intervention.
Detrich, R. (2006). An Expanded Model of Evidence-based Practice in Special Education [Powerpoint Slides]. Retrieved from 2006-campbell-presentation-ronnie-detrich.
Best Practices: Standing on the Shoulders of Giants?
One source of evidence about effective practices is best practice guides. This talks review the advantages and limitations of these guides.
Detrich, R. (2009). Best Practices: Standing on the Shoulders of Giants? [Powerpoint Slides]. Retrieved from 2009-aba-presentation-ronnie-detrich.
Building a Data-based Decision Making Culture through Performance Management

This paper examines the issues, challenges, and opportunities of creating a school culture that uses data systematically in all of its decision making.

Keyworth, R. (2009). Building a Data-based Decision Making Culture through Performance Management [Powerpoint Slides]. Retrieved from 2008-aba-presentation-randy-keyworth.

Data-based Decision Making Cultures: Four Assumptions.
Data-based decision making is often found in ethichal guidelines for practice. This paper explores four assumptions that have to be true if students are to benefit.
Detrich, R. (2010). Data-based Decision Making Cultures: Four Assumptions. [Powerpoint Slides]. Retrieved from 2010-apbs-presentation-ronnie-detrich.
Data-Based Decision Making for Students Social Behavioral Difficulties
This paper discusses methods for making valid data-based decisions for student social behavior.
Gresham, F. (2009). Data-Based Decision Making for Students Social Behavioral Difficulties [Powerpoint Slides]. Retrieved from 2009-wing-presentation-frank-gresham.
Data-based Decision Making: More than the Data
Data-based decision making requires more than having data. This paper reviews what is necessary to effectively employ data-based decision making.
Detrich, R. (?). Data-based Decision Making: More than the Data [Powerpoint Slides]. Retrieved from 2009-calaba-presentation-ronnie-detrich.
Evidence, Ethics, and the Law

This paper reviews the legal and ethical basis for relying on scientifically supported interventions to improve outcomes for students.

Detrich, R. (2007). Evidence, Ethics, and the Law [Powerpoint Slides]. Retrieved from 2007-apbs-presentation-ronnie-detrich.

Evidence-based Education: It Isn't as Simple as You Might Think

On the face of it, the mandate to utilize scientifically supported interventions to improve outcomes seems obvious and straighforward. The paper reviews the challenges involved in doing so.

Detrich, R. (2007). Evidence-based Education: It Isn't as Simple as You Might Think [Powerpoint Slides]. Retrieved from 2007-calaba-ebe-presentation-ronnie-detrich.

Evidence-based Practice for Applied Behavior Analysts: Necessary or Redundant
Evidence-based practice has been described as a decision making framework. This presentation describes the features and challenges of this perspecive.
Detrich, R. (2015). Evidence-based Practice for Applied Behavior Analysts: Necessary or Redundant [Powerpoint Slides]. Retrieved from 2013-aba-presentation-ronnie-detrich-tim-slocum-teri-lewis-trina.
Evidence-based Practice: More than a List
Evidence-based practice has at least two meanings. This paper argues that it is best thought of as a decision-making framework.
Detrich, R. (2011). Evidence-based Practice: More than a List [Powerpoint Slides]. Retrieved from 2011-apbs-presentation-ronnie-detrich.
Evolution of the Revolution: How Can Evidence-based Practice Work in the Real World?
This paper provides an overview of the considerations when introducing evidence-based services into established mental health systems.
Chorpita, B. (2008). Evolution of the Revolution: How Can Evidence-based Practice Work in the Real World? [Powerpoint Slides]. Retrieved from 2008-wing-presentation-bruce-chorpita.
From Evidence-based Practice to Practice-based Evidence: Behavior Analysis in Special Education
Evidence-based practice is a decision making framework. This talk reviews the types of evidence that can be used in decision-making and when each source of evidence is best used.
Detrich, R. (2006). From Evidence-based Practice to Practice-based Evidence: Behavior Analysis in Special Education [Powerpoint Slides]. Retrieved from 2006-calstatefresnoaba-presentation-ronnie-detrich.
IDEIA and Evidence-based Interventions: Implications for Practitioners
The reauthorization of special education law (IDEIA) emphasizes using scientifically supported programs. This talk reviews the implications for special education practitioners.
Detrich, R. (2008). IDEIA and Evidence-based Interventions: Implications for Practitioners [Powerpoint Slides]. Retrieved from 2008-apbs-txint-presentation-ronnie-detrich.
Identifying Research-based Practices for RtI: Scientifically Based Reading

This paper examines the types of research to consider when evaluating programs, how to know what “evidence’ to use, and continuums of evidence (quantity of the evidence, quality of the evidence, and program development).

Twyman, J. (2007). Identifying Research-based Practices for RtI: Scientifically Based Reading [Powerpoint Slides]. Retrieved from 2007-wing-presentation-janet-twyman.

If We Want More Evidence-based Practice, We Need More Practice-based Evidence
This paper discusses the importance, strengths, and weaknesses of using practice-based evidence in conjunction with evidence-based practice.
Cook, B. (2015). If We Want More Evidence-based Practice, We Need More Practice-based Evidence [Powerpoint Slides]. Retrieved from 2015-wing-presentation-bryan-cook.
Professional Judgment: Fallibility, Inevitability,and Manageability
This paper examines the many obstacles to effective professional judgment, the role it plays, and strategies for improving this critical function.
Keyworth, R. (2007). Professional Judgment: Fallibility, Inevitability,and Manageability [Powerpoint Slides]. Retrieved from 2007-aba-presentation-rk.
Research Based Dissemination: Or Confessions of a Poor Disseminator"
This paper shares research on what makes ideas "stick" (gain acceptance, maintain) within a culture and provided an acronym from the results: SUCCESS (simple, unexpected, concrete, credible, emotional, involve stories).
Cook, B. (2014). Research Based Dissemination: Or Confessions of a Poor Disseminator" [Powerpoint Slides]. Retrieved from 2014-wing-presentation-bryan-cook.
Roles and Responsibilities of Researchers and Practitioners Translating Research to Practice

This paper outlines the best practices for researchers and practitioners translating research to practice as well as recommendations for improving the process.

Shriver, M. (2006). Roles and Responsibilities of Researchers and Practitioners Translating Research to Practice [Powerpoint Slides]. Retrieved from 2006-wing-presentation-mark-shriver.

Single Subject Research and Evidence-based Interventions: Are SSDs Really the Ugly Stepchild?
In most discussions about high quality research, single participant designs have been relegated to a lower status. This paper reviews the characteristics of SSDs and the contributions they can make to the evidence-base.
Detrich, R. (2007). Single Subject Research and Evidence-based Interventions: Are SSDs Really the Ugly Stepchild? [Powerpoint Slides]. Retrieved from 2007-aba-presentation-ronnie-detrich.
Sustainable Programs: In Search of the Elusive

This paper examines the policy, culture, and system obstacles to progam sustainability, and identifies strategies to overcome these obstacles.

Keyworth, R. (2008). Sustainable Programs: In Search of the Elusive [Powerpoint Slides]. Retrieved from 2008-campbell-presentation-randy-keyworth.

The Ethical and Legal Basis for Evidence-based Education: Implications for the Profession
No Child Left Behind emphasized the importantance of utilizing practices that are scientifically supported. This paper reviews the implications of evidence-based education for the profession.
Detrich, R. (2008). The Ethical and Legal Basis for Evidence-based Education: Implications for the Profession [Powerpoint Slides]. Retrieved from 2008-teacher-presentation-ronnie-detrich.
The Four Assumptions of the Apocalypse
This paper examines the four basic assumptions for effective data-based decision making in education and offers strategies for addressing problem areas.
Detrich, R. (2009). The Four Assumptions of the Apocalypse [Powerpoint Slides]. Retrieved from 2009-wing-presentation-ronnie-detrich.
What the Data Tell Us

This paper offers an overview of issues practitioners must consider in selecting practices. Types of evidence, sources of evidence, and the role of professional judgment are discussed as cornerstones of effective evidenced-based decision-making.

States, J. (2010). What the Data Tell Us [Powerpoint Slides]. Retrieved from 2010-capses-presentation-jack-states.

What We Know About Sustaining Programs?

This paper examines the latest research on which practice elements are essential for interventions to survive and thrive over time.

Keyworth, R. (2008). What We Know About Sustaining Programs? [Powerpoint Slides]. Retrieved from 2008-calaba-presentation-randy-keyworth.

Workshop: Evidence-based Practice of Applied Behavior Analysis.
Evidence-based practice is a decision-making framework that integrates best available evidence, professional judgement, and client values and context. This workshop described the relationship across these three dimensions of decision-making.
Detrich, R. (2015). Workshop: Evidence-based Practice of Applied Behavior Analysis. [Powerpoint Slides]. Retrieved from 2015-missouriaba-workshop-presentation-ronnie-detrich.
Back to Top