Effectiveness

All Wing Resources

Publications

TITLE
SYNOPSIS
CITATION
Are we making the differences that matter in education?

This paper argues that ineffective practices in schools carry a high price for consumers and suggests that school systems consider the measurable yield in terms of gains in student achievement for their schooling effort.

VanDerHeyden, A. (2013). Are we making the differences that matter in education. In R. Detrich, R. Keyworth, & J. States (Eds.),Advances in evidence-based education: Vol 3(pp. 119–138). Oakland, CA: The Wing Institute. Retrieved from http://www.winginstitute.org/uploads/docs/Vol3Ch4.pdf

Overview of Treatment Integrity

For the best chance of a positive impact on educational outcomes, two conditions must be met: (a) Effective interventions must be adopted, and (b) those interventions must be implemented with sufficient quality (treatment integrity) to ensure benefit.  To date, emphasis in education has been on identifying effective interventions and less concern with implementing the interventions. The research on the implementation of interventions is not encouraging. Often, treatment integrity scores are very low and, in practice, implementation is rarely assessed. If an intervention with a strong research base is not implemented with a high level of treatment integrity, then the students do not actually experience the intervention and there is no reason to assume they will benefit from it. Under these circumstances, it is not possible to know if poor outcomes are the result of an ineffective intervention or poor implementation of that intervention. Historically, treatment integrity has been defined as implementing an intervention as prescribed. More recently, it has been conceptualized as having multiple dimensions, among them dosage and adherence which must be measured to ensure that it is occurring at adequate levels.

Detrich, R., States, J., & Keyworth, R. (2107). Overview of Treatment Integrity. Oakland, Ca. The Wing Institute.

Summative Assessment Overview

Summative assessment is an appraisal of learning at the end of an instructional unit or at a specific point in time. It compares student knowledge or skills against standards or benchmarks. Summative assessment includes midterm exams, final project, papers, teacher-designed tests, standardized tests, and high-stakes tests. 

States, J., Detrich, R. & Keyworth, R. (2018). Overview of Summative Assessment. Oakland, CA: The Wing Institute. https://www.winginstitute.org/assessment-summative

 

Data Mining

TITLE
SYNOPSIS
CITATION
Have NAEP math scores improved over the past 40 years of school reform?

This analysis examines long term math score trends in the United States.

Keyworth, R. (2010). Have NAEP math scores improved over the past 40 years of school reform? Retrieved from have-naep-reading-scores925.

Have NAEP reading scores improved over the past 40 years of school reform?
This analysis examines long term reading score trends in the United States.
Keyworth, R. (2010). Have NAEP reading scores improved over the past 40 years of school reform? Retrieved from have-naep-reading-scores924.
Have reading scores improved over 40-plus years of school reform?

This analysis examines long term reading score trends in the United States.

Keyworth, R. (2010). Have reading scores improved over 40-plus years of school reform? Retrieved from have-reading-scores-improved926.

How does class size reduction measure up to other common educational interventions in a cost-benefit analysis?

This analysis examined the cost effectiveness of research from Stuart Yeh on common sturctural interventions in education. Additionally, The Wing Institute analyzes class-size reduction using Yeh's methods.

States, J. (2009). How does class size reduction measure up to other common educational interventions in a cost-benefit analysis? Retrieved from how-does-class-size.

 

Presentations

TITLE
SYNOPSIS
CITATION
Performance Feedback from a Global Perspective
This paper reviewed recent feedback on U.S. school performance from the Programme for International Student Assessment (PISA).
Keyworth, R. (2011). Performance Feedback from a Global Perspective [Powerpoint Slides]. Retrieved from 2011-wing-presentation-randy-keyworth.

 

Student Research

TITLE
SYNOPSIS
CITATION
Evaluating a Multimedia Professional Development Package for Improving Implementation of Evidence-Based Instructional Practices

Three 8th grade English teachers participated in this single-case multiple baseline experiment. These teachers were observed daily during classes that were inclusive to students with disabilities. Observations were conducted using the Classroom Teaching Scan (www.classroomteachingscan.com/ctscan/). Within the Classroom Teaching Scan, a checklist of quality indicators for modeling was the primary dependent variable. Additionally, observations were scored using the Protocol for Language Arts Teaching Observations (PLATO, 2017). Participating students responded to curriculum-based measurement writing prompts throughout the study.

Minor changes in performance on the PLATO and CBM measures were demonstrated. However, these measures were descriptive in nature, not experimental. Therefore, more research over a sustained period of time is necessary to determine the effect of this professional development package on distal measures of teacher quality and student outcomes.

Elwood, J.R. (2017). Evaluating a Multimedia Professional Development Package for Improving Implementation of Evidence-Based Instructional Practices:Oakland, CA: The Wing Institute. https://www.winginstitute.org.

 

Back to Top