Efficiency

In a society of limited resources and increasing demand, education systems need to focus on efficiency as well as outcomes. In the business world, this is often referred to as return on investment (ROI). How do education outcomes relate to spending? Which education systems get the greatest results for dollars spent? The data suggest that spending alone does not necessarily result in improved outcomes. An increasing amount of evidence reinforces the conclusion that funding alone has no direct relationship to school success. The lack of a direct link between per-pupil spending and education outcomes is apparent at all levels of macro analysis: international, national, state, and local district. In 2015, the United States ranked third in per-pupil spending among the 34 countries in the Organisation for Economic Co-operation and Development (OECD), yet among these nations ranks 25th in science, 22nd in reading, and 38th in mathematics. Per-pupil funding at the national level has increased in real dollars with virtually no improvement in National Assessment of Educational Progress (NAEP) academic scores. Individual state and district per-pupil funding vary dramatically, with no correspondence to student performance.

Publications

TITLE
SYNOPSIS
CITATION
Feedback at the System Level: Benchmarking U.S. Education Performance

This analysis examines the performance of the U.S. K–12 education system over time, in comparison to other nations, and at different levels of organizational structure: states, school districts, and schools. It also reviews performance in terms of four societal outcomes: effectiveness, equity, efficiency, and participation.

Keyworth, R., States, J. & Detrich, R. (2013). Feedback at the System Level: Benchmarking U.S. Education Performance. In Performance Feedback: Using Data to Improve Educator Performance (Vol. 3, pp. 1-76). Oakland, CA: The Wing Institute.

 

 

Data Mining

TITLE
SYNOPSIS
CITATION
How does class size reduction measure up to other common educational interventions in a cost-benefit analysis?

This analysis examined the cost effectiveness of research from Stuart Yeh on common sturctural interventions in education. Additionally, The Wing Institute analyzes class-size reduction using Yeh's methods.

States, J. (2009). How does class size reduction measure up to other common educational interventions in a cost-benefit analysis? Retrieved from how-does-class-size.

 

Presentations

TITLE
SYNOPSIS
CITATION
Performance Feedback from a Global Perspective
This paper reviewed recent feedback on U.S. school performance from the Programme for International Student Assessment (PISA).
Keyworth, R. (2011). Performance Feedback from a Global Perspective [Powerpoint Slides]. Retrieved from 2011-wing-presentation-randy-keyworth.
TITLE
SYNOPSIS
CITATION
Exploring effective and efficient prereferral interventions: A component analysis of behavioral consultation.

Assessed the effects of 3 increasingly inclusive versions of the Behavioral Consultation (BC) model on problem behavior in mainstream classrooms in an effort to develop an effective and efficient approach to prereferral intervention.

Fuchs, D., & Fuchs, L. S. (1989). Exploring effective and efficient prereferral interventions: A component analysis of behavioral consultation. School Psychology Review, 18(2), 260-283.

 

School Lunch Quality and Academic Performance

Providing children with nutritious school meals continues to be a topic of interest in education policy. It has been argued that a healthy diet can have a positive impact on childhood obesity as well as student achievement. However, there is little empirical evidence to support this popular intervention. A working paper released by the National Bureau of Economic Research offers insights to help policy makers decide whether to select this option as a way to make a difference in children’s lives. The study, a natural experiment conducted in California public schools, uses a difference-in-difference regression statistical analysis of data from a treatment group and a control group at two or more different time periods, pre-treatment and post-treatment. The study found no evidence to support a reduction in obesity, but it did discover that introducing healthy meals was associated with a 0.036 standard deviation increase in test scores. The improved student achievement, although small, makes nutritious school lunches a viable cost-effective intervention that can boost test scores. It is important to remember that this is a correlational study and thus cannot establish a cause and effect relationship between healthy eating and student achievement.

 

Anderson, M. L., Gallagher, J., & Ritchie, E. R. (2017). School lunch quality and academic performance (NBER Working Paper No. 23218). Cambridge, MA: National Bureau of Economic Research.

Why Education Experts Resist Effective Practices (And What It Would Take To Make Education More Like Medicine

The first section of this essay provides examples from reading and mathematics curricula that show experts dispensing unproven methods and flitting from one fad to another. The middle section describes how experts, for ideological reasons, have shunned some solutions that do display robust evidence of efficacy. The following sections show how public impatience has forced other professions to "grow up" and accept accountability and scientific evidence. The paper concludes with a plea to develop education into a mature profession.

Carnine, D. (2000). Why Education Experts Resist Effective Practices (And What It Would Take To Make Education More Like Medicine).

 

Feedback at the System Level: Benchmarking U.S. Education Performance

This analysis examines the performance of the U.S. K–12 education system over time, in comparison to other nations, and at different levels of organizational structure: states, school districts, and schools. It also reviews performance in terms of four societal outcomes: effectiveness, equity, efficiency, and participation.

Keyworth, R., States, J. & Detrich, R. (2013). Feedback at the System Level: Benchmarking U.S. Education Performance. In Performance Feedback: Using Data to Improve Educator Performance (Vol. 3, pp. 1-76). Oakland, CA: The Wing Institute.

 

Defining, conceptualizing, and measuring fidelity of implementation and its relationship to outcomes in K–12 curriculum intervention research.

Education researchers are being asked to conduct rigorous, scientifically based studies of K–12 curriculum interventions; therefore, the need for measuring fidelity of implementation and empirically relating it to outcomes (the chief rationale for this review) is warranted to ensure internal and external validity. The results of this review indicate that there are too few studies to guide researchers on how fidelity of implementation to core curriculum interventions can be measured and related to outcomes, particularly within efficacy and effectiveness studies, where the requirements for fidelity measures differ. 

O’Donnell, C. L. (2008). Defining, conceptualizing, and measuring fidelity of implementation and its relationship to outcomes in K–12 curriculum intervention research. Review of educational research78(1), 33-84.

PISA 2015 Results in Focus

Over the past decade, the OECD Programme for International Student Assessment, PISA, has become the world’s premier yardstick for evaluating the quality, equity and efficiency of school systems. This special issue of the PISA in Focus series highlights the results of the first two volumes of the PISA 2015 initial report: Excellence and Equity in Education; and Policies and Practices for Successful Schools.

OECD Publishing (2016). PISA 2015 Results in Focus. PISA in Focus,67. Retrieved from https://doi.org/10.1787/aa9237e6-en.

A Guide to Calculating District Expenditure-to-Performance Ratios Using Publicly Available Data

Efficient use of educational resources is a perennial challenge for school systems. Maximizing the impact of education interventions to magnify student achievement is an important goal for all school districts. This guide examines the use of expenditure-to-performance ratios as a critical indicator for school systems to help decide which interventions make sense when education dollars are at a premium. It describes how states and districts can use available data on district expenditures and student academic achievement to calculate six district-level expenditure-to-performance ratios.

 

Ryan, S., Lavigne, H. J., Zweig, J. S., & Buffington, P. J. (2017). A guide to calculating district expenditure-to-performance ratios using publicly available data. (REL 2017-179). Washington, DC: U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, Regional Educational Laboratory Northeast & Islands.

 

The Impacts of Reading Recovery at Scale: Results From the 4-Year i3 External Evaluation

A recent large-scale evaluation of Reading Recovery, a supplemental reading program for young struggling readers, supports previous research that found it to be effective.  In a 4 year, federally funded project, almost 3,500 students in 685 schools found that generally students benefitted from the intervention. Students receiving Reading Recovery receive supplemental services in a 1:1 instructional setting for 30 minutes 5 days a week from an instructor trained in Reading Recovery.  In the study reported here, students who received Reading Recovery had effect sizes of .35-.37 relative to a control group across a number of measures of reading.  These represent moderate effect sizes and account for about a 1.5 month increase in skill relative to the control group.  Even though the research supports the efficacy of the intervention, it also raises questions about its efficiency.  The schools that participated in the study served about 5 students and the estimated cost per student has ranged from $2,000-$5,000.  These data raise questions about the wisdom of spending this much money per student for growth of about a month and a half.

Sirinides, P., Gray, A., & May, H. (2018). The Impacts of Reading Recovery at Scale: Results From the 4-Year i3 External Evaluation. Educational Evaluation and Policy Analysis, 0162373718764828.

How does class size reduction measure up to other common educational interventions in a cost-benefit analysis?

This analysis examined the cost effectiveness of research from Stuart Yeh on common sturctural interventions in education. Additionally, The Wing Institute analyzes class-size reduction using Yeh's methods.

States, J. (2009). How does class size reduction measure up to other common educational interventions in a cost-benefit analysis? Retrieved from how-does-class-size.

TITLE
SYNOPSIS
Education Trust
The Education Trust is a national non-profit advocacy organization that promotes high academic achievement for all students at all levels, particularly for students of color and low-income students.
Practicewise

PracticeWise works primarily in mental health to support individuals working with children and families to be more informed and more prepared, through established knowledge management strategies and resources. The services include professional training, online information resources, books and guides, organizational consultation, and service system design and management.

What Works Clearinghouse (WWC)

The goal of the WWC is a resource for informed education decision-making. The WWC identifies evidence-based practice, program, or policy, and disseminates summary information on the WWC website.

Back to Top