Best Available Evidence Overview

All Wing Resources

Publications

TITLE
SYNOPSIS
CITATION
A roadmap to evidence-based education: Building an evidence-based culture

Increasing education’s reliance on evidence to guide decisions requires a significant change in the culture of districts and schools. This paper reviews the implications of moving toward evidence-based education.

Detrich, R., Keyworth, R., & States, J. (2007). A Roadmap to Evidence-based Education: Building an Evidence-based Culture. Journal of Evidence-based Practices for Schools, 8(1), 26-44.

Best Available Evidence: Three Complementary Approaches

The notion of best available evidence implies that some evidence is better than other. This paper reviews different sources of evidence and the relative strengths and limitations of each type.

Slocum, T. A., Spencer, T. D., & Detrich, R. (2012). Best available evidence: Three complementary approaches. Education and Treatment of Children, 35(2), 153-181.

Evaluating the Validity of Systematic Reviews to Indentify Empirically Supported Treatments

The systematic review process is an assessment and, as such, concerns about validity of the assessment are paramount.  In this paper, we review the considerations that are important in reaching conclusions about the adequacy of a systematic review.

Slocum, T. A., Detrich, R., & Spencer, T. D. (2012). Evaluating the validity of systematic reviews to identify empirically supported treatments. Education and Treatment of Children, 35(2), 201-233.

Evidence-Based Education and Best Available Evidence: Decision-Making Under Conditions of Uncertainty

Evidence-based practice is a framework for decision making.  Even with high quality evidence there are likely sources of uncertainty that practitioners must confront.

Detrich, R., Slocum, T. A., & Spencer, T. D. (2013). Evidence-based education and best available evidence: decision-making under conditions of uncertainty. Evidence-Based Practices, 26, 21.

Evidence-based Practice: A Framework for Making Effective Decisions

Synopsis: Evidence-based practice is characterized as a framework for decision-making integrating best available evidence, clinical expertise, and client values and context.  This paper reviews how these three dimensions interact to inform decisions.

Spencer, T. D., Detrich, R., & Slocum, T. A. (2012). Evidence-based practice: A framework for making effective decisions. Education and Treatment of Children, 35(2), 127-151.

Evidence-Based, Empirically Supported, OR Best Practice?

Evidence-based, empirically-supported, and best practice are often used interchangeably. A case is made that for clarity each term should have a separate and distinct meaning.

Detrich, R. (2008). Evidence-Based, Empirically Supported, OR Best Practice?. Effective practices for children with autism, 1.

Identifying research-based practices for response to intervention: Scientifically-based instruction

This paper examines the types of research to consider when evaluating programs, how to know what “evidence’ to use, and continuums of evidence (quantity of the evidence, quality of the evidence, and program development).

Twyman, J. S., & Sota, M. (2008). Identifying research-based practices for response to intervention: Scientifically based instruction. Journal of Evidence-Based Practices for Schools, 9(2), 86-101.

Implementing the Findings of Research: Bridging the Gap between Knowledge and Practice

This book provides a guide to the conceptual and practical knowledge principals, superintendents, and other school leaders need to implement evidence-based educational innovations.

Wallace, F., Blasé, K., Fixsen, D., & Naoom, S. (2008). Implementing the Findings of Research: Bridging the Gap between Knowledge and Practice. Educational Research Service.

Roles and responsibilities of researchers and practitioners for translating research to practice

This paper outlines the best practices for researchers and practitioners translating research to practice as well as recommendations for improving the process.

Shriver, M. D. (2007). Roles and responsibilities of researchers and practitioners for translating research to practice. Journal of Evidence-Based Practices for Schools, 8(1), 1-30.

The Evidence-Based Practice of Applied Behavior Analysis

Applied behavior analysis emphasizes being scientifically-based In this paper, we discuss how the core features of evidence-based practice can be integrated into applied behavior analysis.

Slocum, T. A., Detrich, R., Wilczynski, S. M., Spencer, T. D., Lewis, T., & Wolfe, K. (2014). The Evidence-Based Practice of Applied Behavior Analysis. The Behavior Analyst, 37(1), 41-56.

Why Education Practices Fail

This paper examines a range of education failures: common mistakes in how new practices are selected, implemented, and monitored. The goal is not a comprehensive listing of all education failures but rather to provide education stakeholders with an understanding of the importance of vigilance when implementing new practices.

States, J., & Keyworth, R. (2020). Why Practices Fail. Oakland, CA: The Wing Institute. https://www.winginstitute.org/roadmap-overview

Why Education Practices Fail?

This paper examines a range of education failures: common mistakes in how new practices are selected, implemented, and monitored. The goal is not a comprehensive listing of all education failures but rather to provide education stakeholders with an understanding of the importance of vigilance when implementing new practices.

States, J., & Keyworth, R. (2020). Why Practices Fail. Oakland, CA: The Wing Institute. https://www.winginstitute.org/roadmap-overview

 

Data Mining

TITLE
SYNOPSIS
CITATION
Does sample size correlate to larger or smaller effect sizes obtained from reviews of research studies?
This analysis looks at the relationship between the sample size used in studies and the size plays on effect sizes derived from these studies.
States, J. (2010). Does sample size correlate to larger or smaller effect sizes obtained from reviews of research studies? Retrieved from does-sample-size-correlate.
How big will be the impact of an intervention?
The analysis shows how effect size can be used to understand the impact of educational interventions.
States, J. (2010). How big will be the impact of an intervention? Retrieved from how-big-will-be.
How can I interpret the effect size from a study into the impact a practice might have if I implement the practice in my classroom or school?

This item provides information for practitioners on how to interpret effect sizes found in research papers.

States, J. (2010). How can I interpret the effect size from a study into the impact a practice might have if I implement the practice in my classroom or school? Retrieved from how-can-i-interpret.

What is Qualitative Research?
This overview examines qualitative research and how it can be effectively used in educational research.
States, J. (2010). What is Qualitative Research? [Overview, Type A]. Retrieved from what-is-qualitative-research.
What We Know About Effect Size
This piece looks at effect size as a tool for educational researchers and practitioners.
States, J. (2010). What We Know About Effect Size Retrieved from what-we-know-about920.

 

Presentations

TITLE
SYNOPSIS
CITATION
A Systematic Approach to Data-based Decision Making in Education

Systematic data-based decision making is critical to insure that educators are able to identify, implement, and trouble shoot evidence-based interventions customized to individual students and needs.

Keyworth, R. (2010). A Systematic Approach to Data-based Decision Making in Education [Powerpoint Slides]. Retrieved from 2010-hice-presentation-randy-keyworth.

A Systematic Approach to Data-based Decision Making in Education: Building School Cultures

This paper examines the critical pracitce elements of data-based decision making and strategies for building school cultures to support the process.

Keyworth, R. (2009). A Systematic Approach to Data-based Decision Making in Education: Building School Cultures [Powerpoint Slides]. Retrieved from 2009-campbell-presentation-randy-keyworth.

An Expanded Model of Evidence-based Practice in Special Education
This paper reviews the types of evidence that can used to guide decision-making in special education as well as the necessity for high quality implementation, and monitoring the effects of intervention.
Detrich, R. (2006). An Expanded Model of Evidence-based Practice in Special Education [Powerpoint Slides]. Retrieved from 2006-campbell-presentation-ronnie-detrich.
Building a Data-based Decision Making Culture through Performance Management

This paper examines the issues, challenges, and opportunities of creating a school culture that uses data systematically in all of its decision making.

Keyworth, R. (2009). Building a Data-based Decision Making Culture through Performance Management [Powerpoint Slides]. Retrieved from 2008-aba-presentation-randy-keyworth.

Data-Based Decision Making for Students Social Behavioral Difficulties
This paper discusses methods for making valid data-based decisions for student social behavior.
Gresham, F. (2009). Data-Based Decision Making for Students Social Behavioral Difficulties [Powerpoint Slides]. Retrieved from 2009-wing-presentation-frank-gresham.
Evidence, Ethics, and the Law

This paper reviews the legal and ethical basis for relying on scientifically supported interventions to improve outcomes for students.

Detrich, R. (2007). Evidence, Ethics, and the Law [Powerpoint Slides]. Retrieved from 2007-apbs-presentation-ronnie-detrich.

Evidence-based Education: It Isn't as Simple as You Might Think

On the face of it, the mandate to utilize scientifically supported interventions to improve outcomes seems obvious and straighforward. The paper reviews the challenges involved in doing so.

Detrich, R. (2007). Evidence-based Education: It Isn't as Simple as You Might Think [Powerpoint Slides]. Retrieved from 2007-calaba-ebe-presentation-ronnie-detrich.

Evidence-based Practice for Applied Behavior Analysts: Necessary or Redundant
Evidence-based practice has been described as a decision making framework. This presentation describes the features and challenges of this perspecive.
Detrich, R. (2015). Evidence-based Practice for Applied Behavior Analysts: Necessary or Redundant [Powerpoint Slides]. Retrieved from 2013-aba-presentation-ronnie-detrich-tim-slocum-teri-lewis-trina.
Evolution of the Revolution: How Can Evidence-based Practice Work in the Real World?
This paper provides an overview of the considerations when introducing evidence-based services into established mental health systems.
Chorpita, B. (2008). Evolution of the Revolution: How Can Evidence-based Practice Work in the Real World? [Powerpoint Slides]. Retrieved from 2008-wing-presentation-bruce-chorpita.
From Evidence-based Practice to Practice-based Evidence: Behavior Analysis in Special Education
Evidence-based practice is a decision making framework. This talk reviews the types of evidence that can be used in decision-making and when each source of evidence is best used.
Detrich, R. (2006). From Evidence-based Practice to Practice-based Evidence: Behavior Analysis in Special Education [Powerpoint Slides]. Retrieved from 2006-calstatefresnoaba-presentation-ronnie-detrich.
IDEIA and Evidence-based Interventions: Implications for Practitioners
The reauthorization of special education law (IDEIA) emphasizes using scientifically supported programs. This talk reviews the implications for special education practitioners.
Detrich, R. (2008). IDEIA and Evidence-based Interventions: Implications for Practitioners [Powerpoint Slides]. Retrieved from 2008-apbs-txint-presentation-ronnie-detrich.
Identifying Research-based Practices for RtI: Scientifically Based Reading

This paper examines the types of research to consider when evaluating programs, how to know what “evidence’ to use, and continuums of evidence (quantity of the evidence, quality of the evidence, and program development).

Twyman, J. (2007). Identifying Research-based Practices for RtI: Scientifically Based Reading [Powerpoint Slides]. Retrieved from 2007-wing-presentation-janet-twyman.

If We Want More Evidence-based Practice, We Need More Practice-based Evidence
This paper discusses the importance, strengths, and weaknesses of using practice-based evidence in conjunction with evidence-based practice.
Cook, B. (2015). If We Want More Evidence-based Practice, We Need More Practice-based Evidence [Powerpoint Slides]. Retrieved from 2015-wing-presentation-bryan-cook.
Professional Judgment: Fallibility, Inevitability,and Manageability
This paper examines the many obstacles to effective professional judgment, the role it plays, and strategies for improving this critical function.
Keyworth, R. (2007). Professional Judgment: Fallibility, Inevitability,and Manageability [Powerpoint Slides]. Retrieved from 2007-aba-presentation-rk.
Roles and Responsibilities of Researchers and Practitioners Translating Research to Practice

This paper outlines the best practices for researchers and practitioners translating research to practice as well as recommendations for improving the process.

Shriver, M. (2006). Roles and Responsibilities of Researchers and Practitioners Translating Research to Practice [Powerpoint Slides]. Retrieved from 2006-wing-presentation-mark-shriver.

Single Subject Research and Evidence-based Interventions: Are SSDs Really the Ugly Stepchild?
In most discussions about high quality research, single participant designs have been relegated to a lower status. This paper reviews the characteristics of SSDs and the contributions they can make to the evidence-base.
Detrich, R. (2007). Single Subject Research and Evidence-based Interventions: Are SSDs Really the Ugly Stepchild? [Powerpoint Slides]. Retrieved from 2007-aba-presentation-ronnie-detrich.
The Ethical and Legal Basis for Evidence-based Education: Implications for the Profession
No Child Left Behind emphasized the importantance of utilizing practices that are scientifically supported. This paper reviews the implications of evidence-based education for the profession.
Detrich, R. (2008). The Ethical and Legal Basis for Evidence-based Education: Implications for the Profession [Powerpoint Slides]. Retrieved from 2008-teacher-presentation-ronnie-detrich.
The Four Assumptions of the Apocalypse
This paper examines the four basic assumptions for effective data-based decision making in education and offers strategies for addressing problem areas.
Detrich, R. (2009). The Four Assumptions of the Apocalypse [Powerpoint Slides]. Retrieved from 2009-wing-presentation-ronnie-detrich.
The Role of Data-based Decision Making

This presentation examines the impact of data-based decision making in schools. It looks at the critical role data plays in building an evidence-based model for education that relies on monitoring for the reliable implementation of practices.

States, J. (2010). The Role of Data-based Decision Making [Powerpoint Slides]. Retrieved from 2010-hice-presentation-jack-states.

The Role of Data-based Decision Making

This paper identifies the critical features required for developing and maintaining a systemic data-based decision making model aligned at all levels, beginning with an individual student in the classroom and culminating with policy makers.

States, J. (2009). The Role of Data-based Decision Making [Powerpoint Slides]. Retrieved from 2009-campbell-presentation-jack-states.

What the Data Tell Us

This paper offers an overview of issues practitioners must consider in selecting practices. Types of evidence, sources of evidence, and the role of professional judgment are discussed as cornerstones of effective evidenced-based decision-making.

States, J. (2010). What the Data Tell Us [Powerpoint Slides]. Retrieved from 2010-capses-presentation-jack-states.

Why Is The U.S. So Bad At Knowledge Transfer And Implementation Of Evidence-Based Practices And How We Can Do Better

This paper examines why evidence-based practices are passed over for interventions with less than rigorous evidence. A road map for lasting change is presented stressing types of research, knowledge transfer, implementation and monitoring.

States, J. (2014). Why Is The U.S. So Bad At Knowledge Transfer And Implementation Of Evidence-Based Practices And How We Can Do Better [Powerpoint Slides]. Retrieved from 2014-campbell-presentation-jack-states.

Why Science Has Not Had A Greater Impact On Education

This paper examines the impact of science on school reform. Despite 40 years of rigorous research, we find science has failed to make a significant impact. This presentation offers obstacles and solutions to this dilemma.

States, J. (2014). Why Science Has Not Had A Greater Impact On Education [Powerpoint Slides]. Retrieved from 2015-hice-presentation-jack-states.

Workshop: Evidence-based Practice of Applied Behavior Analysis.
Evidence-based practice is a decision-making framework that integrates best available evidence, professional judgement, and client values and context. This workshop described the relationship across these three dimensions of decision-making.
Detrich, R. (2015). Workshop: Evidence-based Practice of Applied Behavior Analysis. [Powerpoint Slides]. Retrieved from 2015-missouriaba-workshop-presentation-ronnie-detrich.

 

Student Research

TITLE
SYNOPSIS
CITATION
The Adoption of Curricula in K-12 Schools: An Exploratory Qualitative Analysis.

This exploratory qualitative study investigated how school districts engage in the process of adopting curricula for use in grades K-12 and what factors influence administrators when making adoption decisions.

Rolf, K. (2020). The Adoption of Curricula in K-12 Schools: An Exploratory Qualitative Analysis. Utah State University. https://drive.google.com/file/d/1O_rvmZKGE8rCf_nVTdOwgy4AVk-Gw6hH/view

Back to Top