Education Drivers

Types Of Evidence

Publications

TITLE
SYNOPSIS
CITATION
Evidence-Based Practice in the Broader Context: How Can We Really Use Evidence to Inform Decisions?

This paper provides an overview of the considerations when introducing evidence-based services into established mental health systems.

Chorpita, B. F., & Starace, N. K. (2010). Evidence-Based Practice in the Broader Context: How Can We Really Use Evidence to Inform Decisions? Journal of Evidence-Based Practices for Schools, 11(1), 4-29.

Evidence-Based, Empirically Supported, OR Best Practice?

Evidence-based, empirically-supported, and best practice are often used interchangeably. A case is made that for clarity each term should have a separate and distinct meaning.

Detrich, R. (2008). Evidence-Based, Empirically Supported, OR Best Practice?. Effective practices for children with autism, 1.

A roadmap to evidence-based education: Building an evidence-based culture

Increasing education’s reliance on evidence to guide decisions requires a significant change in the culture of districts and schools. This paper reviews the implications of moving toward evidence-based education.

Detrich, R., Keyworth, R., & States, J. (2007). A Roadmap to Evidence-based Education: Building an Evidence-based Culture. Journal of Evidence-based Practices for Schools, 8(1), 26-44.

Roles and responsibilities of researchers and practitioners for translating research to practice

This paper outlines the best practices for researchers and practitioners translating research to practice as well as recommendations for improving the process.

Shriver, M. D. (2007). Roles and responsibilities of researchers and practitioners for translating research to practice. Journal of Evidence-Based Practices for Schools, 8(1), 1-30.

Evidence-based Practice: A Framework for Making Effective Decisions

Synopsis: Evidence-based practice is characterized as a framework for decision-making integrating best available evidence, clinical expertise, and client values and context.  This paper reviews how these three dimensions interact to inform decisions.

Spencer, T. D., Detrich, R., & Slocum, T. A. (2012). Evidence-based practice: A framework for making effective decisions. Education and Treatment of Children, 35(2), 127-151.

Identifying research-based practices for response to intervention: Scientifically based instruction

This paper examines the types of research to consider when evaluating programs, how to know what “evidence’ to use, and continuums of evidence (quantity of the evidence, quality of the evidence, and program development).

Twyman, J. S., & Sota, M. (2008). Identifying research-based practices for response to intervention: Scientifically based instruction. Journal of Evidence-Based Practices for Schools, 9(2), 86-101.

 

Data Mining

TITLE
SYNOPSIS
CITATION
Does sample size correlate to larger or smaller effect sizes obtained from reviews of research studies?
This analysis looks at the relationship between the sample size used in studies and the size plays on effect sizes derived from these studies.
States, J. (2010). Does sample size correlate to larger or smaller effect sizes obtained from reviews of research studies? Retrieved from does-sample-size-correlate.
How big will be the impact of an intervention?
The analysis shows how effect size can be used to understand the impact of educational interventions.
States, J. (2010). How big will be the impact of an intervention? Retrieved from how-big-will-be.
How can I interpret the effect size from a study into the impact a practice might have if I implement the practice in my classroom or school?
This item provides information for practitioners on how to interpret effect sizes found in research papers.
States, J. (2010). How can I interpret the effect size from a study into the impact a practice might have if I implement the practice in my classroom or school? Retrieved from how-can-i-interpret.

 

Presentations

TITLE
SYNOPSIS
CITATION
Roles and Responsibilities of Researchers and Practitioners Translating Research to Practice

This paper outlines the best practices for researchers and practitioners translating research to practice as well as recommendations for improving the process.

Shriver, M. (2006). Roles and Responsibilities of Researchers and Practitioners Translating Research to Practice [Powerpoint Slides]. Retrieved from 2006-wing-presentation-mark-shriver.

What the Data Tell Us

This paper offers an overview of issues practitioners must consider in selecting practices. Types of evidence, sources of evidence, and the role of professional judgment are discussed as cornerstones of effective evidenced-based decision-making.

States, J. (2010). What the Data Tell Us [Powerpoint Slides]. Retrieved from 2010-capses-presentation-jack-states.

Identifying Research-based Practices for RtI: Scientifically Based Reading

This paper examines the types of research to consider when evaluating programs, how to know what “evidence’ to use, and continuums of evidence (quantity of the evidence, quality of the evidence, and program development).

Twyman, J. (2007). Identifying Research-based Practices for RtI: Scientifically Based Reading [Powerpoint Slides]. Retrieved from 2007-wing-presentation-janet-twyman.

Evolution of the Revolution: How Can Evidence-based Practice Work in the Real World?
This paper provides an overview of the considerations when introducing evidence-based services into established mental health systems.
Chorpita, B. (2008). Evolution of the Revolution: How Can Evidence-based Practice Work in the Real World? [Powerpoint Slides]. Retrieved from 2008-wing-presentation-bruce-chorpita.
If We Want More Evidence-based Practice, We Need More Practice-based Evidence
This paper discusses the importance, strengths, and weaknesses of using practice-based evidence in conjunction with evidence-based practice.
Cook, B. (2015). If We Want More Evidence-based Practice, We Need More Practice-based Evidence [Powerpoint Slides]. Retrieved from 2015-wing-presentation-bryan-cook.
From Evidence-based Practice to Practice-based Evidence: Behavior Analysis in Special Education
Evidence-based practice is a decision making framework. This talk reviews the types of evidence that can be used in decision-making and when each source of evidence is best used.
Detrich, R. (2006). From Evidence-based Practice to Practice-based Evidence: Behavior Analysis in Special Education [Powerpoint Slides]. Retrieved from 2006-calstatefresnoaba-presentation-ronnie-detrich.
An Expanded Model of Evidence-based Practice in Special Education
This paper reviews the types of evidence that can used to guide decision-making in special education as well as the necessity for high quality implementation, and monitoring the effects of intervention.
Detrich, R. (2006). An Expanded Model of Evidence-based Practice in Special Education [Powerpoint Slides]. Retrieved from 2006-campbell-presentation-ronnie-detrich.
Evidence-based Education: Can We Get There From Here?
This paper reviews the steps that will be necessary to make evidence-based education a reality.
Detrich, R. (2008). Evidence-based Education: Can We Get There From Here? [Powerpoint Slides]. Retrieved from 2007-calaba-ebe-presentation-ronnie-detrich.
IDEIA and Evidence-based Interventions: Implications for Practitioners
The reauthorization of special education law (IDEIA) emphasizes using scientifically supported programs. This talk reviews the implications for special education practitioners.
Detrich, R. (2008). IDEIA and Evidence-based Interventions: Implications for Practitioners [Powerpoint Slides]. Retrieved from 2008-apbs-txint-presentation-ronnie-detrich.
Evidence-based Practice: More than a List
Evidence-based practice has at least two meanings. This paper argues that it is best thought of as a decision-making framework.
Detrich, R. (2011). Evidence-based Practice: More than a List [Powerpoint Slides]. Retrieved from 2011-apbs-presentation-ronnie-detrich.
Workshop: Evidence-based Practice of Applied Behavior Analysis.
Evidence-based practice is a decision-making framework that integrates best available evidence, professional judgement, and client values and context. This workshop described the relationship across these three dimensions of decision-making.
Detrich, R. (2015). Workshop: Evidence-based Practice of Applied Behavior Analysis. [Powerpoint Slides]. Retrieved from 2015-missouriaba-workshop-presentation-ronnie-detrich.
TITLE
SYNOPSIS
CITATION
Creating Single-Subject Design in Microsoft Excel
The article provides a task analyses for constructing various types of commonly used single-subject design graphs in Microsoft Excel
Dixon, M. R., Jackson, J. W., Small, S. L., Horner?King, M. J., Lik, N. M. K., Garcia, Y., & Rosales, R. (2009). CCreating Single-Subject Design in Microsoft Excel™ 2007. Journal of applied behavior analysis, 42(2), 277-293.
Some recommendations for the reporting of quantitative studies

This editorial offers recommendations aimed at providing examples of a series of elements that may significantly contribute towards demonstrating the robustness of quantitative results. It is therefore not a methodological guide but instead a guide that acts as a reminder of some basic principles when reporting quantitative research.

López, X., Valenzuela, J., Nussbaum, M., & Tsai, C. C. (2015). Some recommendations for the reporting of quantitative studies. Computers & Education, 91(C), 106-110.

Understanding Bias Due to Measures Inherent to Treatments in Systematic Reviews in Education

This paper contrasts effect sizes in What Works Clearinghouse and Best Evidence Encyclopedia reading and math reviews to explore the degree to which these measures produce different estimates.

Slavin, R. E., & Madden, N. A. (2008). Understanding bias due to measures inherent to treatments in systematic reviews in education. In annual meeting of the Society for Research on Effective Education, Crystal City, VA.

Randomized Trials and Quasi-Experiments in Education Research
This paper examines the benefits and challenges inherent in using randomized clinical trials and quasi-experimental designs in the field of education research.
Angrist, J. D. (2003). Randomized trials and quasi-experiments in education research. NBER Reporter Online, (Summer 2003), 11-14.
The Core Analytics of Randomized Experiments for Social Research
This paper examines the elements of randomized experiments for social research.
Bloom, H. S. (2006). The core analytics of randomized experiments for social research.
Randomized, Controlled Trials, Observational Studies, and the Hierarchy of Research Designs
A study comparing the efficacy of randomized controlled trials to observational studies.
Concato, J., Shah, N., & Horwitz, R. I. (2000). Randomized, controlled trials, observational studies, and the hierarchy of research designs. New England Journal of Medicine, 342(25), 1887-1892.
Can Randomized Trials Answer the Question of What Works?
This article discusses the use of randomized controlled trials as required by the Department of Education in evaluating the effectiveness of educational practices.
EDUC, A. R. O. (2005). Can randomized trials answer the question of what works?.
Statistical Significance and Effect Size: Two Sides of a Coin
This paper suggests that statistical significance testing and effect size are two sides of the same coin; they complement each other, but do not substitute for one another
Fan, X. (1999). Statistical Significance and Effect Size: Two Sides of a Coin.
New Federal Policy Favors Randomized Trials in Education Research
Thisis an article from the Chronicle of Higher Education discussing the pros and cons of randomized controlled trials in education
Glenn, D. A. V. I. D. (2005). New federal policy favors randomized trials in education research. The Chronicle of Higher Education, Retrieved March, 25, 2005.
Implementing Randomized Field Trials in Education: Report of a Workshop
This book examines the use of randomized controlled trial (RCT) studies in education.
Hilton, M., & Towne, L. (Eds.). (2004). Implementing Randomized Field Trials in Education:: Report of a Workshop. National Academies Press.
The Use of Single-Subject Research to Identify Evidence-Based Practice in Special Education
The defining features of single-subject research are presented, the contributions of single-subject research for special education are reviewed, and a specific proposal is offered for using single-subject research to document evidence-based practice.
Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Wolery, M. (2005). The use of single-subject research to identify evidence-based practice in special education. Exceptional Children, 71(2), 165-179.
Single-Case Research: Documenting Evidence-based Practice
Making the case that single-subject design can and should be accepted as an alternative to randomized controlled trials in determining efficacy of practices.
Horner, R. University of Oregon.
Single-Case Designs for Educational Research
This paper examines the benefits and challenges inherent in using of randomized clinical trials and quasi-experimental designs in the field of education research.
Kazdin, A. E. (2011). Single-case research designs: Methods for clinical and applied settings . Oxford University Press.
Single-Case Designs for Educational Research
This book provides a thorough summary of information about the use of single-subject experimental designs in educational research
Kennedy, C. H. (2005). Single-case designs for educational research. Pearson/A & B.
Single-case research design and analysis: New directions for psychology and education.
This book provides a thorough summary of information about the use of single-subject experimental designs.
Kratochwill, T. R., & Levin, J. R. (1992). Single-case research design and analysis: New directions for psychology and education. Lawrence Erlbaum Associates, Inc.
Single-Case Design Technical Documentation
Single case design has made important contributions to identifying effective educational practices. Until recently, there have been no standards for evaluating the quality and quality of studies across a topic area. These standards were developed by the Institute for Education Science.
Kratochwill, T. R., Hitchcock, J., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M. & Shadish, W. R. (2010). Single-case designs technical documentation. Retrieved from What Works Clearinghouse website: http://ies.ed.gov/ncee/wwc/pdf/wwc_scd.pdf.
What Works Clearinghouse: SINGLE?CASE DESIGN TECHNICAL DOCUMENTATION
This paper by a What Works Clearinghouse the panel provides an overview of singlr-subject designs (SCDs), specifies the types of questions that SCDs are designed to answer, and discusses the internal validity of SCDs. The panel then proposes standards to be implemented by the WWC.
Kratochwill, T. R., Hitchcock, J., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M., & Shadish, W. R. (2010). Single-case designs technical documentation. What Works Clearinghouse.
Comparing Results of Systematic Reviews: Parallel Reviews of Research on Repeated Reading.
This paper demonstrates that different well accepted methods for reviewing research on repeated readings produces different results.
O’Keeffe, B. V., Slocum, T. A., Burlingame, C., Snyder, K., & Bundock, K. (2012). Comparing Results of Systematic Reviews: Parallel Reviews of Research on Repeated Reading. Education & Treatment of Children (West Virginia University Press), 35(2), 333-366
Combining estimates of effect size
This book is an in depth examination of literature synthesis along with useful advice when one attempts to interpret the results of a meta-analysis.
Shadish, W. R., & Haddock, C. K. (2009). Combining estimates of effect size. The Handbook of Research Synthesis and Meta-analysis, 257-277.
The state of the science in the meta-analysis of single-case experimental designs
This is a review of the issues and methods for conducting a meta-analysis of single-case design research studies.
Shadish, W. R., Rindskopf, D. M. & Hedges, L. V. (2008). The state of the science in the meta-analysis of single-case experimental designs. Evidence-Based Communication Assessment and Intervention, 2(3), 188-196. doi:10.1080/17489530802581603
Effects of Sample Size on Effect Size in Systematic Reviews in Education
This study uses data from the elementary and secondary mathematics explores the effects of sample size on effect size in program evaluations in education.
Slavin, R.E., & Smith, D. (2009). The relationship between sample sizes and effect sizes in systematic reviews in education. Educational Evaluation and Policy Analysis, 31 (4), 500-506.
TITLE
SYNOPSIS
Effect Size Substantive Interpretation Guidelines: Issues in the Interpretation of Effect Sizes, 2003
These guidelines describe the strengths and limitations of several approaches to the assessing the magnitude of an intervention’s effect.
Journal of Contemporary Clinical Trials
Contemporary Clinical Trials is an international journal that publishes manuscripts pertaining to the design, methods and operational aspects of clinical trials.
Logical Positivism
An overview of Logical Positivism and it’s impact on science and the issue of verifiability.
Spurious Correlations
An important rule of research is; correlation does not equal causation. Just because two events track each other over time does not mean that one caused the other. This web site mines data and uses to humor to make the point that for such correlations are often “Spurious Correlations”.
Back to Top