Education Drivers

Program Accountability

Publications

TITLE
SYNOPSIS
CITATION
Sustainability of evidence-based programs in education

This paper discusses common elements of successfully sustaining effective practices across a variety of disciplines.

Fixsen, D. L., Blase, K. A., Duda, M., Naoom, S. F., & Van Dyke, M. (2010). Sustainability of evidence-based programs in education. Journal of Evidence-Based Practices for Schools, 11(1), 30-46.

 

Presentations

TITLE
SYNOPSIS
CITATION
Now What? The Current State of Principal Preparation, Evaluation, and Support
This paper examines the current state of principal development in the context of best practices, including: evidence-based curriculum, well-trained instructors, effective coaching, and ongoing feedback and support.
Keyworth, R. (2015). Now What? The Current State of Principal Preparation, Evaluation, and Support [Powerpoint Slides]. Retrieved from 2015-calaba-presentation-randy-keyworth.
TITLE
SYNOPSIS
CITATION
Risks and rewards of school-based mentoring Relationships: A reanalysis of the student mentoring program evaluation.

This study presents a reanalysis of a large randomized controlled trial of school-based mentoring and examines the estimated effect of mentoring as a function of mentee-reported relationship quality using a novel statistical approach.

Lyons, M. D., & McQuillin, S. D. (2019). Risks and rewards of school-based mentoring relationships: A reanalysis of the student mentoring program evaluation. School Psychology, 34(1), 76-85.

http://dx.doi.org/10.1037/spq0000265

Evaluating Principals: Balancing Accountability with Professional Growth

The goal of this paper is to provide policymakers with recommendations for the design and implementation of strong principal development and evaluation systems. States and local school systems that pursue these ideas can use principal evaluation to drive a powerful vision of principal effectiveness and, by consequence, improve outcomes for all students.

(2010). Evaluating Principals: Balancing Accountability with Professional Growth. New Leaders for New Schools.

Principal Evaluation Rubric

Overview New Leaders has recently published a new principal evaluation model. It includes seven modules: (1) Overview of the New Leaders Principal Evaluation Model, (2) The Principal Evaluation Rubric, (3) Setting a Principal Practice Goal + Strategic Planning, (4) Identifying Evidence, (5) Direct Observation of Principal Practice, (6) Collecting and Mapping Evidence to the Principal Practice Rubric, and (7) Providing Actionable Feedback.

(2012). Putting Principal Evaluation into Practice. New Leaders

Putting Principal Evaluation into Practice

Overview New Leaders has recently published a new principal evaluation model. It includes seven modules: (1) Overview of the New Leaders Principal Evaluation Model, (2) The Principal Evaluation Rubric, (3) Setting a Principal Practice Goal + Strategic Planning, (4) Identifying Evidence, (5) Direct Observation of Principal Practice, (6) Collecting and Mapping Evidence to the Principal Practice Rubric, and (7) Providing Actionable Feedback.

(2012). Putting Principal Evaluation into Practice. New Leaders

A New Approach to Principal Preparation: Innovative Programs Share Their Practices and Lessons Learned

This paper examines a number of promising principal preparation programs to identify lessons for improving the impact of principals on student perrmance.

A new approach to principal preparation: Innovative programs share their practices and lessons learned. Rainwater Leadership Alliance, 2010.

Who benefits most from a broadly targeted prevention program? Differential efficacy across populations in the Teen Outreach program

This study examined a highly successful, well‐documented, national program to prevent teenage pregnancy and school failure—the Teen Outreach program—to address a fundamental question: How well can a developmentally focused, broadly targeted prevention program address the needs of those students within the program who are at the highest risk of problematic behavior. 

Allen, J. P., & Philliber, S. (2001). Who benefits most from a broadly targeted prevention program? Differential efficacy across populations in the Teen Outreach Program. Journal of Community Psychology29(6), 637-655.

Differences between graduates of 4-year and 5-year teacher preparation programs

A 10-year comparison of graduates from 4- and 5-year teacher education programs at the same institution revealed significant differences between graduates of the two programs. Limitations of the study and alternative explanations for these differences are discussed.

Andrew, M. D. (1990). Differences between graduates of 4-year and 5-year teacher preparation programs. Journal of Teacher Education, 41, 45–51

Can evidence-based prevention programs be sustained in community practice settings? The Early Risers' advanced-stage effectiveness trial

This study evaluated institutional sustainability of the Early Risers “Skills for Success” conduct problems prevention program.

August, G. J., Bloomquist, M. L., Lee, S. S., Realmuto, G. M., & Hektner, J. M. (2006). Can evidence-based prevention programs be sustained in community practice settings? The Early Risers’ advanced-stage effectiveness trial. Prevention Science7(2), 151-165.

Obtaining Validation from Graduates on a Restructured Principal Preparation Program

This study used within-program comparison of follow-up survey responses from two sets of program graduates from a university-based leadership preparation program to determine differences in program features and outcome measures.

Ballenger, J., Alford, B., McCune, S. L., & McCune, E. D. (2010). Obtaining validation from graduates on a restructured principal preparation program. Jsl Vol 19-N5, 19 533.

Outcome evaluation of Washington State's research-based programs for juvenile offenders.

The CJAA funded the nation’s first statewide experiment concerning research-based programs for juvenile justice. The question here was whether they work when applied statewide in a “real world” setting. This report indicates that the answer to this question is yes— when the programs are competently delivered. 

Barnoski, R., & Aos, S. (2004). Outcome evaluation of Washington State’s research-based programs for juvenile offenders. Olympia, WA: Washington State Institute for Public Policy, 460.

Intervention-based school psychology services: Training for child-level accountability; preparing for program-level accountability

This research evaluated the outcomes of a school psychology training practicum by replicating intervention-based service delivery procedures established in prior research. 

Bonner, M., & Barnett, D. W. (2004). Intervention-based school psychology services: Training for child-level accountability; preparing for program-level accountability. Journal of School Psychology42(1), 23-43.

Progress Over a Decade in Preparing More Effective School Principals

Over the past 10 years, the Southern Regional Education Board has helped states and public universities across the region evaluate their state policies for preparing school principals who are leaders of instruction. This benchmark report reviews the past decade and looks at 10 learning-centered leadership indicators to gauge how far states have come and how far they need to go in selecting, preparing and supporting leaders of change.

Bottoms, G., Egelson, P., & Bussey, L. H. (2012). Progress over a decade in preparing more effective school principals. Atlanta, GA: Southern Regional Education Board.

Reducing Impediments to Technology Transfer in Drug Abuse Programming

This chapter will address the issues for research utilization that have been described in the literature and speak to their application to the field of drug abuse service delivery. I

Brown, B. S. (1995). Reducing impediments to technology transfer in drug abuse programming. NIDA research monograph155, 169-185.

Evaluating the Effects of Functional Communication Training in the Presence and Absence of Establishing Operations

The authors conducted functional analyses of aberrant behavior with 4 children with developmental disabilities, then implemented functional communication training (FCT) by using different mands across two contexts. 

Brown, K. A., Wacker, D. P., Derby, K. M., Peck, S. M., Richman, D. M., Sasso, G. M., ... & Harding, J. W. (2000). Evaluating the effects of functional communication training in the presence and absence of establishing operations. Journal of Applied Behavior Analysis33(1), 53-71.

Dramatic Cures for Juvenile Crime: An Evaluation of a Prisoner-Run Delinquency Prevention Program

This article describes an evaluation of a prisoner-run delinquency prevention program at Hawaii's major prison.

Buckner, J. C., & Chesney-Lind, M. (1983). Dramatic cures for juvenile crime: An evaluation of a prisoner-run delinquency prevention program. Criminal Justice and Behavior10(2), 227-247.

An Analysis of Principal Preparation Programs at Pennsylvania State Schools

This study examined principal preparation programs within the Pennsylvania State System of Higher Education to ascertain whether their programs were structured in a way that would equip principal candidates with the leadership roles deemed essential for 21st century school leadership.

Burks, Karlin. (2014). An Analysis of Principal Preparation Programs at Pennsylvania State Schools. Seton Hall University Dissertations and Theses (ETDs) Paper 1934.

Amazing Results! Teacher Expectations and Student Achievement (TESA) Follow-Up Survey of TESA-Trained Teachers in 45 States and the District of Columbia.

This paper describes a survey of teachers trained in Teacher Expectations and Student Achievement (TESA). The study examined whether teachers: agreed that TESA interactions were useful with today's children; continued to practice the TESA coding and observation process after being trained; and would recommend TESA to colleagues. 

Cantor, J., Kester, D., & Miller, A. (2000). Amazing Results! Teacher Expectations and Student Achievement (TESA) Follow-Up Survey of TESA-Trained Teachers in 45 States and the District of Columbia.

Developing District-wide Expertise in Leaders’ Ability to Analyze and Improve Instructional Practice

This manuscript reports on two district’s efforts to improve the instructional leadership of principals, and lead teacher coaches in collaboration with an external support provider.

Copland, M. A., & Blum, D. (2007). Developing District-wide Expertise in Leaders’ Ability to Analyze and Improve Instructional Practice.

Rethinking Leadership: The Changing Role of Principal Supervisors

This report consists of two parts: a survey of 67 public school systems district staff serving as principal supervisors and on-site analysis of six districts pre-service training and support systems for new principals.

Corcoran, A., et al. (2013). Rethinking Leadership: The Changing Role of Principal Supervisors. The Wallace Foundation.

The Accountability Illusion

This study examines the NCLB accountability systems and the basic AYP rules for 28 states as they operate in practice

Cronin, J., Dahlin, M., Xiang, Y., & McCahon, D. (2009). The accountability illusion. Retrieved from http://www.edexcellencemedia.net/publications/2009/200902_ accountabilityillusion/2009_AccountabilityIllusion_WholeReport.pdf

Program integrity in primary and early secondary prevention: are implementation effects out of control?

The authors examined the extent to which program integrity (i.e., the degree to which programs were implemented as planned) was verified and promoted in evaluations of primary and early secondary prevention programs published between 1980 and 1994. 

Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: are implementation effects out of control?. Clinical psychology review18(1), 23-45.

Accountability for college and career readiness: Developing a new paradigm.

This report recommends an accountability approach that focuses on meaningful learning, enabled by professionally skilled and committed educators, and supported by adequate and appropriate resources, so that all students regardless of background are prepared for both college and career when they graduate from high school.

Darling-Hammond, L., Wilhoit, G., & Pittenger, L. (2014). Accountability for college and career readiness: Developing a new paradigm. Stanford, CA: Stanford Center for Opportunity Policy in Education. Retrieved from https://edpolicy.stanford.edu/sites/default/files/publications/accountability-college-and-career-readiness-developing-new-paradigm.pdf

The Nature of Leadership Development

This book provides insight into the streams that are driving leadership theory and practice today. The Nature of Leadership, Second Edition provides students with an updated and complete yet concise handbook that solidifies and integrates the vast and disparate leadership literature.

Day, D., Antonakis, J. (2012). The Nature of Leadership. SAGE.

The For-Profit Postsecondary School Sector: Nimble Critters or Agile Predators?

This study describe the schools, students, and programs in the for-profit higher education sector, it's phenomenal recent growth, and it's relationship to the federal and state governments. The study find that for-profit institutions educate a larger fraction of minority, disadvantaged, and older students, and they have greater success at reatining students in their first year and fetting them to complete short programs at the certificate and AA levels. But they also find that the for-profit students end-up with higher unemployment and "idleness" rates and lower earning six years after entering programs than do comparable students from other schools. and they have far greater student debt burdens and default rates on their student loans.

Deming, David J., Claudia Goldin, and Lawrence F. Katz. 2012. "The For-Profit Postsecondary School Sector: Nimble Critters or Agile Predators?" Journal of Economic Perspectives26 (1): 139-64.

The Effectiveness of Principal Training and Formal Principal Mentoring Programs

The purpose of this study was to determine principals' perceptions of how effective mentoring programs and university-based principal preparation programs are in developing the skills necessary to carry out the 13 critical success factors identified by the Southern Regional Education Board (SREB). A review of the literature addressed what it means to be an effective principal and what an effective mentoring program should look like.

Dodson, R. B. (2006). The Effectiveness of Principal Training and Formal Principal Mentoring Programs.

The study of implementation: Current findings from effective programs that prevent mental disorders in school-aged children

This article reviews implementation issues in prevention trials and specifically highlights the study of implementation in the 34 programs determined to be effective in a recent review conducted by the Prevention Research Center for the Center for Mental Health Services.

Domitrovich, C. E., & Greenberg, M. T. (2000). The study of implementation: Current findings from effective programs that prevent mental disorders in school-aged children. Journal of Educational and Psychological Consultation11(2), 193-221.

Teacher prep review: Program Performance in Early Reading Instruction.

The National Council of Teacher Quality (NCTQ) review examines teacher preparation program progress in adopting the necessary components of evidence-based reading instruction. The report continues the effort of two previous reports offering educators a look at trends on preparation program progress on providing this essential training.

Drake, G., et al. (2020). Teacher Prep Review: Program Performance in Early Reading Instruction. National Council on Teacher Quality.https://www.nctq.org/dmsView/NCTQ_2020_Teacher_Prep_Review_Program_Performance_in_Early_Reading_Instruction

Implementation Matters: A Review of Research on the Influence of Implementation on Program Outcomes and the Factors Affecting Implementation

The first purpose of this review is to assess the impact of implementation on program outcomes, and the second purpose is to identify factors affecting the implementation process.

Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American journal of community psychology, 41(3-4), 327-350.

Issues in Disseminating and Replicating Effective Prevention Programs

a brief overview of findings from the Blueprints for Violence Prevention-Replication Initiative is presented, identifying factors that enhance or impede a successful implementation of these programs.

Elliott, D. S., & Mihalic, S. (2004). Issues in disseminating and replicating effective prevention programs. Prevention Science5(1), 47-53.

School accountability

This chapter reviews the theory of school-based accountability, describes variations across programs and identifies key features influencing the effectiveness and possible unintended consequences of accountability policies. 

Figlio, D., & Loeb, S. (2011). School accountability. In E. A. Hanushek, S. J. Machin, & L. Woessman (Eds.), Handbooks in economics: Economics of education (Vol. 3, pp. 383–421). Amsterdam, Netherlands: Elsevier.

Program evaluation: Alternative approaches and practical guidelines

Part One provides the reader with information essential to understanding not only the content of the section that follow but also the wealth of material that exists in the literature on  program evaluation. Part Two introduces you to different approaches to evaluation to enlarge your understanding of the diversity of choices that evaluators and stakeholders make in undertaking evaluation.

Fitzpatrick, J. L., Sanders, J. R., & Worthen, B. R. (2003). Program Evaluation: Alternative Approaches and Practical Guidelines.

Sustainability of evidence-based programs in education

This paper discusses common elements of successfully sustaining effective practices across a variety of disciplines.

Fixsen, D. L., Blase, K. A., Duda, M., Naoom, S. F., & Van Dyke, M. (2010). Sustainability of evidence-based programs in education. Journal of Evidence-Based Practices for Schools, 11(1), 30-46.

Implementation Research: A Synthesis of the Literature

This is a comprehensive literature review of the topic of Implementation examining all stages beginning with adoption and ending with sustainability.

Fixsen, D. L., Naoom, S. F., Blase, K. A., & Friedman, R. M. (2005). Implementation research: A synthesis of the literature.

Evaluating Fidelity: Predictive Validity for a Measure of Competent Adherence to the Oregon Model of Parent Management Training

This article presents the Fidelity of Implementation Rating System (FIMP), an observation-based measure assessing competent adherence to the Oregon model of Parent Management Training (PMTO). 

Forgatch, M. S., Patterson, G. R., & DeGarmo, D. S. (2005). Evaluating fidelity: Predictive validity for a measure of competent adherence to the Oregon model of parent management training. Behavior therapy36(1), 3-13.

The Principal Internship: How Can We Get It Right?

In this report, the Southern Regional Education Board evaluates some 60 internship programs within its states and finds them lacking in a number of ways, including failing to provide real experiences in leadership. It urges policymakers, universities and school districts to create apprenticeships that better prepare aspiring principals for the demands they will face.

Fry, B., Bottoms, G., & O’neill, K. (2005). The principal internship: How can we get it right. Atlanta, GA: Southern Regional Education Board.

Schools Can’t Wait: Accelerating The Redesign of University Principal Preparation Programs

This report of 22 universities principal preparation programs identifies weaknesses in the training and offers recommendations for states to address the problems.

Fry, B., et al. (2006). Schools Can’t Wait: Accelerating The Redesign of University Principal Preparation Programs. Southern Regional Education Board.

A framework for building capacity for responsiveness to intervention

This commentary offers such a framework and then they consider how the articles constituting this special issue address the various questions posed in the framework. 

Fuchs, L. S., & Fuchs, D. (2006). A framework for building capacity for responsiveness to intervention. School Psychology Review35(4), 621.

How Principals Learn to Lead: The Comparative Influence of On-the-Job Experiences, Administrator Credential Programs, and the ISLLC Standards in the Development of Leadership Expertise among Urban Public School Principals

This study examines the influence of administrator credential programs, on-the-job experiences, and the standards in the development of urban public school principals.

Fultz, M. Assessing the Relationship Between Administrator Preparation Programs and Job Performance.

Developing Leaders: The Importance--and the Challenges--of Evaluating Principal Preparation Programs

The authors have been evaluating the impact of five principal preparation programs in the United States on student outcomes. This information should be considered as one aspect of preparation program improvement and accountability. The study team lays out its recommendations in this policy paper. 

George W. Bush Institute & Education Reform Initiative. (2016). Developing Leaders: The Importance--and the Challenges--of Evaluating Principal Preparation Programs, Retrieved from https://gwbcenter.imgix.net/Resources/gwbi-importance-of-evaluating-principal-prep.pdf

Redefining Accountability to Treat Teachers and Leaders Like the Professionals They Are

The Every Student Succeeds Act creates opportunities for policymakers to re-imagine accountability in schools—and not only by incorporating additional measures of student success into outcome-based accountability regimes.

Gill, B. (2017). Redefining Accountability to Treat Teachers and Leaders Like the Professionals They Are. Retrieved from https://www.brookings.edu/blog/brown-center-chalkboard/2017/04/13/redefining-accountability-to-treat-teachers-and-leaders-like-the-professionals-they-are/

No Child Left Behind, Contingencies, and Utah's Alternate Assessment

This article examine the concept of behavioral contingency and describes NCLB as a set of contingencies to promote the use of effective educational practices. Then they describe their design of an alternate assessment, including the components designed to capitalize on the contingencies of NCLB to promote positive educational outcomes. 

Hager, K. D., Slocum, T. A., & Detrich, R. (2007). No Child Left Behind, Contingencies, and Utah’s Alternate Assessment. JEBPS Vol 8-N1, 63.

Evaluating intensive family preservation programs: a methodological review

To determine the adequacy of evaluations of family preservation services (FPS), which are designed to support families and prevent out-of-home placements of children at risk of abuse or neglect, and to assess the effectiveness of FPS at reducing out-of-home placements of children

Henegan AM, Horwitz SM, Leventhal JM: Evaluation of intensive family preservation programs: a methodological review. Pediatrics 97:535–542, 1997

The Problem with "Proficiency": Limitaions of Statistic and Policy Under No Child Left Behind

The Percentage of Proficient Students (PPS) has become a ubiquitous statistic under the No Child Left Behind Act. The author demonstrates that the PPS metric offers only limited and unrepresentative depictions of large-scale test score trends, gaps, and gap trends.  The author shows how the statistical shortcomings of these depictions extend to shortcomings of policy, from exclusively encouraging score gains near the proficiency cut score to shortsighted comparisons of state and national testing results. The author proposes alternatives for large-scale score reporting and argues that a distribution-wide perspective on results is required for any serious analysis of test score data, including “growth”-related results under the recent Growth Model Pilot Program.

Ho, A. D. (2008). The problem with “proficiency”: Limitations of statistics and policy under No Child Left Behind. Educational researcher37(6), 351-360.

Linking Teacher Preparation Program Design and Implementation to Outcomes for Teachers and Students.

Improving the use of evidence in teacher preparation is one of the greatest challenges and
opportunities for our field. The chapters in this volume explore how data availability, quality,
and use within and across preparation programs shed light on the structures, policies, and
practices associated with high-quality teacher preparation.

Jackson, C., Carinci, J. E., & Meyer, S. J. (2020). SUPPORTING THE USE OF EVIDENCE IN TEACHER PREPARATION. Linking Teacher Preparation Program Design and Implementation to Outcomes for Teachers and Students, 237.

Improving School Accountability Measures

The authors highlight an under-appreciated weakness of that approach-he imprecision of school-level test score means -- and propose a method for a better discerning signal from noise in annual school report cards. 

Kane, T. J., & Staiger, D. O. (2001). Improving school accountability measures (No. w8156). National Bureau of Economic Research.

High Versus Low Implementation of Instructional Support Teams: A Case for Maintaining Program Fidelity

In 1990, the Commonwealth of Pennsylvania implemented a statewide instructional support team (IST) process to provide prereferral assessment and intervention for at-risk students in 500 school districts. The current study examined the academic performance of students affected by this process as contrasted with other at-risk students who did not have access to it.

Kovaleski, J. F., Gickling, E. E., Morrow, H., & Swank, P. R. (1999). High versus low implementation of instructional support teams: A case for maintaining program fidelity. Remedial and Special Education20(3), 170-183.

Principal Evaluation Handbook

New Leaders has recently published a new principal evaluation model. It includes seven modules: (1) Overview of the New Leaders Principal Evaluation Model, (2) The Principal Evaluation Rubric, (3) Setting a Principal Practice Goal + Strategic Planning, (4) Identifying Evidence, (5) Direct Observation of Principal Practice, (6) Collecting and Mapping Evidence to the Principal Practice Rubric, and (7) Providing Actionable Feedback.

Leaders, N. (2012). New leaders principal evaluation handbook. New York: Author.

Changes in teacher education: The Holy Grail of quality

The Teacher Education Committee at Northwestern Oklahoma State University approved the development of a competency-based teacher education program. A subcommittee identified and wrote professional education competencies which students should master prior to program completion.

Lehr, M. (1981). Changes in Teacher Education: The Holy Grail of Quality.

The Campbell Collaboration: Providing Better Evidence for a Better World

This paper provides the history and summarizes the development of the Campbell Collaboration. The Campbell Collaboration is a “nonprofit organization with the mission of helping people make well-informed decisions about the effects of interventions in the social, behavioral, and educational domains. The paper looks at the organization’s efforts to build a world library of accurate, synthesized evidence to inform policy and practice and improve human well-being worldwide. The Education section of the Campbell research library produces reviews on issues in early childhood, elementary, secondary, and postsecondary education. Topics range from academic programs, teacher qualifications, testing, to a wide variety of school-based interventions. Campbell systematic reviews and related evidence synthesis provide unbiased summaries of bodies of empirical evidence. 

Littell, J. H., & White, H. (2018). The Campbell Collaboration: Providing better evidence for a better world. Research on Social Work Practice28(1), 6-12.

Treatment fidelity in outcome studies

Fidelity of treatment in outcome research refers to confirmation that the manipulation of the independent variable occurred as planned. Verification of fidelity is needed to ensure that fair, powerful, and valid comparisons of replicable treatments can be made.

Moncher, F. J., & Prinz, R. J. (1991). Treatment fidelity in outcome studies. Clinical psychology review11(3), 247-266.

Fast facts: Expenditures

Current expenditures for education can be expressed in terms of the percentage of funds going toward salaries, employee benefits, purchased services, tuition, supplies, or other expenditures.

National Center for Education Statistics. (n.d.). Fast facts: Expenditures

The Information Book Flood: Is Additional Exposure Enough to Support Early Literacy Development?

Over the past twenty years many reading interventions have been proposed. One of these, “Book Flooding”, proposes that providing an enriched environment in which books are present and readily available can improve reading. Much of the research on this topic has focused on exposing children in the early grades to storybooks. Given the greater importance on reading complex text in meeting new reading standards, this study examines the impact of book flooding of books that stress academic words and technical terms. This quasi-experimental study examines the influence of a book distribution program targeted at enhancing children’s exposure to information books. The research examined whether a flood of information books in early childhood settings could affect growth in language, content-related vocabulary, and concepts of comprehending information text. The study concludes there were no significant effects on student outcomes and that book distribution programs on their own need to be reevaluated if they are to improved student reading performance.

Neuman, S. B. (2017). The Information Book Flood: Is Additional Exposure Enough to Support Early Literacy Development?. The Elementary School Journal118(1), 1-27.

Literature Review of Principal Preparation Programs

This literature review highlights central elements of the residency component of school leader preparation programs by aggregating the results of studies conducted on existing principal preparation programs. 

New York City Leadership Academy. (2013). Literature Review of Principal Preparation Programs. Retrieved from https://www.nycleadershipacademy.org/wp-content/uploads/2018/06/residency-design-literature-review.pdf

Taking Charge of Principal Preparation-A Guide to NYC Leadership Academy's Aspiring Principals Program

This report provides an overview of NYCLA’s flagship principal preparation program. Intended to help others involved in principal preparation think through important elements of principal preparation, including candidate selection, developing experiential learning opportunities, and funding, staffing and sustaining the program, the guide shares NYCLA’s successes and lessons learned during the 11 years we have delivered the Aspiring Principals Program in New York City, as well as through our work with various state and district partners nationally to adapt the program.

NYC Leadership Academy (2014). Taking Charge of Principal Preparation-A Guide to NYC Leadership Academy's Aspiring Principals Program.  Retrieved from http://www.nycleadershipacademy.org/news-and-resources/tools-and-publications/pdfs/app-guide-full-guide.

Equality and Quality in U.S. Education: Systemic Problems, Systemic Solutions. Policy Brief

This paper enters debate about how U.S. schools might address long-standing disparities in educational and economic opportunities while improving the educational outcomes for all students. with a vision and an argument for realizing that vision, based on lessons learned from 60 years of education research and reform efforts. The central points covered draw on a much more extensive treatment of these issues published in 2015. The aim is to spark fruitful discussion among educators, policymakers, and researchers.

O'Day, J. A., & Smith, M. S. (2016). Equality and Quality in US Education: Systemic Problems, Systemic Solutions. Policy Brief. Education Policy Center at American Institutes for Research.

How serious is America’s literacy problem?

The first step in solving a problem is seeing it clearly. This article, part one of an ongoing series, defines the broad scope and depth of the literacy crisis in the United States, among both children and adults.

Rea, A. (2020). How Serious is America’s Literacy Problem. Library Journal. April29.

A Consumer’s Guide to Evaluating a Core Reading Program Grades K-3: A Critical Elements Analysis

A critical review of reading programs requires objective and in-depth analysis. For these reasons, the authors offer the following recommendations and procedures for analyzing critical elements of programs.

Simmons, D. C., & Kame’enui, E. J. (2003). A consumer’s guide to evaluating a core reading program grades K-3: A critical elements analysis. Retrieved December19, 2006.

The Impacts of Reading Recovery at Scale: Results From the 4-Year i3 External Evaluation

A recent large-scale evaluation of Reading Recovery, a supplemental reading program for young struggling readers, supports previous research that found it to be effective.  In a 4 year, federally funded project, almost 3,500 students in 685 schools found that generally students benefitted from the intervention. Students receiving Reading Recovery receive supplemental services in a 1:1 instructional setting for 30 minutes 5 days a week from an instructor trained in Reading Recovery.  In the study reported here, students who received Reading Recovery had effect sizes of .35-.37 relative to a control group across a number of measures of reading.  These represent moderate effect sizes and account for about a 1.5 month increase in skill relative to the control group.  Even though the research supports the efficacy of the intervention, it also raises questions about its efficiency.  The schools that participated in the study served about 5 students and the estimated cost per student has ranged from $2,000-$5,000.  These data raise questions about the wisdom of spending this much money per student for growth of about a month and a half.

Sirinides, P., Gray, A., & May, H. (2018). The Impacts of Reading Recovery at Scale: Results From the 4-Year i3 External Evaluation. Educational Evaluation and Policy Analysis, 0162373718764828.

Effective programs in elementary mathematics: A best-evidence synthesis

This article reviews research on the achievement outcomes of three types of approaches to
improving elementary mathematics: mathematics curricula, computer-assisted instruction
(CAI), and instructional process programs.

Slavin, R. E., & Lake, C. (2008). Effective programs in elementary mathematics: A best-evidence synthesis. Review of educational research78(3), 427-515.

Outcome of Early Intervention for Children With Autism

Since 1980, 12 peer-reviewed outcome studies (nine on behavior analytic programs, one on Project TEACCH, and two on Colorado Health Sciences) have focused on early intervention for children with autism. Mean 10 gains of 7-28 points were reported in studies of behavior analytic programs, and 3-9 in studies on TEACCH and Colorado. 

Smith, T. (1999). Outcome of early intervention for children with autism. Clinical Psychology: Science and Practice6(1), 33-49.

Building special education teacher capacity in rural schools: Impact of a Grow Your Own program

The purpose of this study was to determine the extent to which a grow your own (GYO) program equitably increased special education teacher capacity in one Southern state's rural and non-rural school districts.

Sutton, J. P., Bausmith, S. C., O'connor, D. M., Pae, H. A., & Payne, J. R. (2014). Building special education teacher capacity in rural schools: Impact of a grow your own program. Rural Special Education Quarterly33(4), 14-23.

Intervention fidelity in special and general education research journals

Treatment fidelity reporting practices are described for journals that published general and special education intervention research with high impact factors from 2005 through 2009. The authors reviewed research articles, reported the proportion of intervention studies that described fidelity measurement, detailed the components of fidelity measurement reported, and determined whether the components of fidelity reported differed based on the research design, the type of intervention, or the number of intervention sessions.

Swanson, E., Wanzek, J., Haring, C., Ciullo, S., & McCulley, L. (2013). Intervention fidelity in special and general education research journals. The Journal of Special Education47(1), 3-13.

Tutor Trust: Affordable Primary Tuition: Evaluation report and executive summary November 2018

The purpose of this study is the examination of low-cost interventions to improve the performance of disadvantaged students. The intervention was designed to improve the performance of students by providing small-group tutoring sessions. The research found that children who received tutoring progressed more in math compared to children in control schools (effect size = +0.19). 

Torgerson, C. J., Bell, K., Coleman, E., Elliott, L., Fairhurst, C., Gascoine, L., Hewitt, C. E., & Torgerson, D. J. (2018). Tutor Trust: Affordable Primary Tuition. The Education Endowment Foundation (EEF).

Improving State Evaluation of Principal Preparation Programs

Intended for state officials involved in the assessment and approval of university and other programs to train future school principals, this report describes five design principles for effective program evaluation.

UCEA and New Leaders (2016). Improving state evaluation of principal preparation programs. Retrieved from: www.sepkit.org

Making education evidence-based: Premises, principles, pragmatics, and politics.

We are at the beginning of the transformation of education into an evidence-based field. By evidence-based, I mean an endeavor in which decision makers routinely seek out the best available research and data before adopting programs or practices that will affect significant numbers of students.

Whitehurst, G. J. R. (2004). IPR distinguished public policy lecture series 2003-04—Making education evidence-based: Premises, principles, pragmatics, and politics.

The Cost-Effectiveness of Five Policies for Improving Student Achievement

This study compares the effect size and return on investment for rapid assessment, between, increased spending, voucher programs, charter schools, and increased accountability.

Yeh, S. S. (2007). The cost-effectiveness of five policies for improving student achievement. American Journal of Evaluation, 28(4), 416-436.

Independent Teacher Education Programs: Apocryphal Claims, Illusory Evidence

This policy brief surveys historical and contemporary trends in teacher preparation, and explores what is known about the quality of five of the most prominent independent teacher education programs in the U.S., including their impact on teacher quality and student learning. The author's analysis demonstrates that claims regarding the success of such programs are not substantiated by peer-reviewed research and program evaluations.

Zeichner, K. (2016). Independent Teacher Education Programs: Apocryphal Claims, Illusory Evi-dence. Boulder, CO: National Education Policy Center. Retrieved from http://nepc.colorado.edu/publication/teacher-education

Impacts of New Leaders on Student Achievement in Oakland
This report presents our examination of impacts of principals trained by New Leaders on student achievement in Oakland Unified School District (OUSD). For the last 10 years, New Leaders has partnered with OUSD in efforts to improve the recruitment and training of effective principals and school leaders. This report fills an important gap in the literature, as little research has been done looking at the impacts of principal training programs on student achievement.
Booker, K., Thomas, J. (2014). Impacts of New Leaders on Student Achievement in Oakland. Mathematica Policty Research
Gateways to the Principalship State Power to Improve the Quality of School Leaders
This paper analyzes state policies for principal preparation approval and certification in 16 states, eight of which are "lagging," and eight "leading" in efforts to ensure effective leaders.
Cheney, G. R., & Davis, J. (2011). Gateways to the Principalship: State Power to Improve the Quality of School Leaders. Center for American Progress.
School Principals and School Performance
This paper uses data from New York City to estimate how the characteristics of school principals relate to school performance, as measured by students' standardized exam scores and other outcomes. There is little evidence of any relationship between school performance and principal education and pre-principal work experience, but some evidence that experience as an assistant principal at the principal's current school is associated with higher performance among inexperienced principals.
Clark, D., Martorell, P., & Rockoff, J. (2009). School Principals and School Performance. Working Paper 38. National Center for Analysis of longitudinal data in Education research.
Measuring Principal Performance: How Rigorous Are Commonly Used Principal Performance Assessment Instruments?
This study reviewed eight publicly available formative assessments of principal performance, focusing on the tool’s approach, time requirement, content and construct validity, and reliability.
Condon, C., & Clifford, M. (2010). Measuring Principal Performance: How Rigorous Are Commonly Used Principal Performance Assessment Instruments? A Quality School Leadership Issue Brief. Learning Point Associates.

No items found.

Back to Top