Instructional Effectiveness

All Research

TITLE
SYNOPSIS
CITATION
Evaluating Principals: Balancing Accountability with Professional Growth
The goal of this paper is to provide policymakers with recommendations for the design and implementation of strong principal development and evaluation systems. States and local school systems that pursue these ideas can use principal evaluation to drive a powerful vision of principal effectiveness and, by consequence, improve outcomes for all students.
(2010). Evaluating Principals: Balancing Accountability with Professional Growth. New Leaders for New Schools.
Principal Evaluation Handbook
New Leaders has recently published a new principal evaluation model. It includes seven modules: (1) Overview of the New Leaders Principal Evaluation Model, (2) The Principal Evaluation Rubric, (3) Setting a Principal Practice Goal + Strategic Planning, (4) Identifying Evidence, (5) Direct Observation of Principal Practice, (6) Collecting and Mapping Evidence to the Principal Practice Rubric, and (7) Providing Actionable Feedback.
(2012). Principal Evaluation Handbook. New Leaders
Putting Principal Evaluation into Practice
Overview New Leaders has recently published a new principal evaluation model. It includes seven modules: (1) Overview of the New Leaders Principal Evaluation Model, (2) The Principal Evaluation Rubric, (3) Setting a Principal Practice Goal + Strategic Planning, (4) Identifying Evidence, (5) Direct Observation of Principal Practice, (6) Collecting and Mapping Evidence to the Principal Practice Rubric, and (7) Providing Actionable Feedback.
(2012). Putting Principal Evaluation into Practice. New Leaders
Principal Evaluation Rubric
Overview New Leaders has recently published a new principal evaluation model. It includes seven modules: (1) Overview of the New Leaders Principal Evaluation Model, (2) The Principal Evaluation Rubric, (3) Setting a Principal Practice Goal + Strategic Planning, (4) Identifying Evidence, (5) Direct Observation of Principal Practice, (6) Collecting and Mapping Evidence to the Principal Practice Rubric, and (7) Providing Actionable Feedback.
(2012). Putting Principal Evaluation into Practice. New Leaders
A New Approach to Principal Preparation: Innovative Programs Share Their Practices and Lessons Learned

This paper examines a number of promising principal preparation programs to identify lessons for improving the impact of principals on student perrmance.

A new approach to principal preparation: Innovative programs share their practices and lessons learned. Rainwater Leadership Alliance, 2010.

Rethinking the Use of Tests: A Meta-Analysis of Practice Testing

This meta-analysis examined the effects of practice tests versus non-testing learning conditions on student performance. Research demonstrates that students who take practice tests often outperform students in non-testing learning conditions such as restudying, practice, filler activities, or no presentation of the material. Results reveal that practice tests are more beneficial for learning than restudying and all other comparison conditions.

Adesope, O. O., Trevisan, D. A., & Sundararajan, N. (2017). Rethinking the Use of Tests: A Meta-Analysis of Practice Testing. Review of Educational Research, 0034654316689306.

A Synthesis of Empirical Research on Teaching Mathematics to Low-Achieving Students

This meta-analysis synthesized research on the effects of interventions to improve mathematics achievement of students considered at risk for academic failure. It found that effective interventions included providing teachers and students with student performance data; using peer tutors; providing clear, specific feedback to parents on children's mathematics success; and using explicit instruction to teach math.

Baker, S., Gersten, R., & Lee, D. S. (2002). A synthesis of empirical research on teaching mathematics to low-achieving students. The Elementary School Journal, 51-73.

Obtaining Validation from Graduates on a Restructured Principal Preparation Program

This study used within-program comparison of follow-up survey responses from two sets of program graduates from a university-based leadership preparation program to determine differences in program features and outcome measures.

Ballenger, J., Alford, B., McCune, S. L., & McCune, E. D. (2010). Obtaining validation from graduates on a restructured principal preparation program. Jsl Vol 19-N5, 19 533.

Progress Over a Decade in Preparing More Effective School Principals

Over the past 10 years, the Southern Regional Education Board has helped states and public universities across the region evaluate their state policies for preparing school principals who are leaders of instruction. This benchmark report reviews the past decade and looks at 10 learning-centered leadership indicators to gauge how far states have come and how far they need to go in selecting, preparing and supporting leaders of change.

Bottoms, G., Egelson, P., & Bussey, L. H. (2012). Progress over a decade in preparing more effective school principals. Atlanta, GA: Southern Regional Education Board.

An Analysis of Principal Preparation Programs at Pennsylvania State Schools

This study examined principal preparation programs within the Pennsylvania State System of Higher Education to ascertain whether their programs were structured in a way that would equip principal candidates with the leadership roles deemed essential for 21st century school leadership.

Burks, Karlin. (2014). An Analysis of Principal Preparation Programs at Pennsylvania State Schools. Seton Hall University Dissertations and Theses (ETDs) Paper 1934.

Rethinking Leadership: The Changing Role of Principal Supervisors

This report consists of two parts: a survey of 67 public school systems district staff serving as principal supervisors and on-site analysis of six districts pre-service training and support systems for new principals.

Corcoran, A., et al. (2013). Rethinking Leadership: The Changing Role of Principal Supervisors. The Wallace Foundation.

The Effectiveness of Principal Training and Formal Principal Mentoring Programs

The purpose of this study was to determine principals' perceptions of how effective mentoring programs and university-based principal preparation programs are in developing the skills necessary to carry out the 13 critical success factors identified by the Southern Regional Education Board (SREB). A review of the literature addressed what it means to be an effective principal and what an effective mentoring program should look like.

Dodson, R. B. (2006). The Effectiveness of Principal Training and Formal Principal Mentoring Programs.

Active learning increases student performance in science, engineering, and mathematics

This meta-analysis examined the impact of lecturing as compared to active methods of instruction on learning and course performance. The effect sizes indicate that on average, student performance on examinations and concept inventories increased by 0.47 SDs under active learning (n = 158 studies), and that the odds ratio for failing was 1.95 under traditional lecturing (n = 67 studies).

Freeman, S., Eddy, S. L., McDonough, M., Smith, M. K., Okoroafor, N., Jordt, H., & Wenderoth, M. P. (2014). Active learning increases student performance in science, engineering, and mathematics. Proceedings of the National Academy of Sciences, 111(23), 8410-8415.

The Principal Internship: How Can We Get It Right?

In this report, the Southern Regional Education Board evaluates some 60 internship programs within its states and finds them lacking in a number of ways, including failing to provide real experiences in leadership. It urges policymakers, universities and school districts to create apprenticeships that better prepare aspiring principals for the demands they will face.

Fry, B., Bottoms, G., & O’neill, K. (2005). The principal internship: How can we get it right. Atlanta, GA: Southern Regional Education Board.

How Principals Learn to Lead: The Comparative Influence of On-the-Job Experiences, Administrator Credential Programs, and the ISLLC Standards in the Development of Leadership Expertise among Urban Public School Principals

This study examines the influence of administrator credential programs, on-the-job experiences, and the standards in the development of urban public school principals.

Fultz, M. Assessing the Relationship Between Administrator Preparation Programs and Job Performance.

Assisting Students Struggling with Mathematics: Response to Intervention (RtI) for Elementary and Middle Schools

The What Works Clearinghouse (WWC) guide recommends practices to be in the repertoire of mathematics instructors for maximizing the effectiveness of mathematics instruction.

Gersten, R., Beckman S., Clarke B., Foegen A., Marsh L., Star J., and Witzel B. (2009). Assisting Students Struggling with Mathematics: Response to Intervention (RtI) for Elementary and Middle Schools (NCEE 2009-4060) Washington D.C.: National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education.

Make Room for the Principal Supervisors

This report describes how Denver Public Schools hired personnel to coach and evaluate its principals.

Gill, J., (2013). Make Room for the Principal Supervisors. The Wallace Foundation.

The Evaluation of Principals: What and How do States and Urban Districts Assess Leadership?

This study present results of a comprehensive review of principal leadership assessment practices in the United States. Using the learning-centered leadership framework, it focused on identifying the congruence (or lack thereof) between documented assessment practices and the research-based criteria for effective leadership that are associated with improved school performance.

Goldring, E., Cravens, X. C., Murphy, J., Porter, A. C., Elliott, S. N., & Carson, B. (2009). The evaluation of principals: What and how do states and urban districts assess leadership?. The Elementary School Journal, 110(1), 19-39

Assessing Learning-Centered Leadership: Connections to Research, Professional Standards, and Current Practices

With support from The Wallace Foundation, a Vanderbilt University team is developing a tool to monitor and assess the performance of school leaders. The Vanderbilt assessment will differ from existing tools by focusing 100 percent on instructional leadership and examining both principals and leadership teams. The paper, with two companion reports, presents the research behind and conceptual framework for the tool.

Goldring, E., Porter, A., Murphy, J., Elliott, S. N., & Cravens, X. (2009). Assessing learning-centered leadership: Connections to research, professional standards, and current practices. Leadership and Policy in Schools, 8(1), 1-36.

Triangulating Principal Effectiveness: How Perspectives of Parents, Teachers, and Assistant Principals Identify the Central Importance of Managerial Skills

This study draws on data combining survey responses from principals, assistant principals, teachers and parents with administrative data to identify which principal skills matter most for school outcomes.

Grissom, J. A., & Loeb, S. (2011). Triangulating Principal Effectiveness How Perspectives of Parents, Teachers, and Assistant Principals Identify the Central Importance of Managerial Skills. American Educational Research Journal, 48(5), 1091-1123.

Teacher and Principal Leadership in Chicago- Ongoing Analysis of Preparation Programs

This study draws on a range of existing quantitative data resources, including Chicago Public Schools' personnel and test score data, and a biannual survey of teachers and principals to

Hart, H. M., Sporte, S. E., Ponisciak, S. M., Stevens, W., & Cambronne, A. (2008). Teacher and Principal Leadership in Chicago: Ongoing Analyses of Preparation Programs. Research Report. Consortium on Chicago School Research.

Great Principals at Scale: Creating Districts That Enable All Principals to be Effective

This report is a comprehensive and research-based framework outlining the conditions necessary for transformational school leaders to succeed. It offers a framework of conditions that can help districts enable great school leadership.

Ikemoto, G., Taliaferro, L., Fenton, B., Davis, J. (2014)Great Principals at Scale: Creating Districts That Enable All Principals to be Effective. New Leaders

Trends in GRE Scores in Education Administration: Implications for Principal Preparation Programs

This report examines the issue of school principal candidate standards as evidenced by below-average verbal, quantitative, and analytic scores, as measured by standardized tests.

Keedy, J. L., & Grandy, J. (1999). Trends in GRE Scores in Education Administration: Implications for Principal Preparation Programs.  Retrieved from http://files.eric.ed.gov/fulltext/ED436828.pdf

A Theory-Based Meta-Analysis of Research on Instruction.

This research synthesis examines instructional research in a functional manner to provide guidance for classroom practitioners.

Marzano, R. J. (1998). A Theory-Based Meta-Analysis of Research on Instruction.

 

More Than Content: The Persistent Cross-Subject Effects of English Language Arts Teachers’ Instruction

This paper investigates the long-term impact of teachers' value-added effects on student learning over multiple years and across subject areas. The study finds that the durable effects of English Language Arts (ELA) teachers are more likely to generalizable across subjects than the instructional effects of math teachers.

Master, B., Loeb, S., & Wyckoff, J. (2017). More Than Content: The Persistent Cross-Subject Effects of English Language Arts Teachers’ Instruction. Educational Evaluation and Policy Analysis, 0162373717691611.

This study is a meta-analysis to identify the subject matter practice elements required to effectively teach reading to children

This study is a meta-analysis to identify the subject matter practice elements required to effectively teach reading to children

National Reading Panel (US), National Institute of Child Health, & Human Development (US). (2000). Report of the national reading panel: Teaching children to read: An evidence-based assessment of the scientific research literature on reading and its implications for reading instruction: Reports of the subgroups. National Institute of Child Health and Human Development, National Institutes of Health.

Taking Charge of Principal Preparation-A Guide to NYC Leadership Academy's Aspiring Principals Program

This report provides an overview of NYCLA’s flagship principal preparation program. Intended to help others involved in principal preparation think through important elements of principal preparation, including candidate selection, developing experiential learning opportunities, and funding, staffing and sustaining the program, the guide shares NYCLA’s successes and lessons learned during the 11 years we have delivered the Aspiring Principals Program in New York City, as well as through our work with various state and district partners nationally to adapt the program.

NYC Leadership Academy (2014). Taking Charge of Principal Preparation-A Guide to NYC Leadership Academy's Aspiring Principals Program.  Retrieved from http://www.nycleadershipacademy.org/news-and-resources/tools-and-publications/pdfs/app-guide-full-guide.

Shifting Paradigms-Redesigning a Principal Preparation Program's Curriculum

This paper describes Auburn University's story of developing an innovative field-based master's level principal preparation program. The program’s goal was to align the program's curriculum and internship experiences with state and other accrediting agency standards, current leadership preparation research, and local educational agency (LEA) partner input and support. 0

Reames, E. (2010). Shifting Paradigms: Redesigning a Principal Preparation Program's Curriculum. Journal of Research on Leadership Education, 5, 436-459.

Assessing Educational Leaders: Evaluating Performance for Improved Individual and Organizational Results

This book presents information and tools necessary to successfully evaluate all types of educational leaders and improve both individual and organizational performance.

Reeves, D. B. (Ed.). (2008). Assessing educational leaders: Evaluating performance for improved individual and organizational results. SAGE.

What Makes A Leadership Preparation Program Exemplary

In this report, the Southern Regional Education Board outlines critical actions that states, districts, universities and principals themselves should take as part of a systematic plan to address principal succession. The report makes the case for principal succession planning and describes six steps for succession planning that states and districts can implement to ensure they have the right principals for the job.

Schmidt-Davis, J., & Bottoms, G. (2011). Who's Next? Let's Stop Gambling on School Performance and Plan for Principal Succession. Southern Regional Education Board (SREB).

What One Hundred Years of Research Says About the Effects of Ability Grouping and Acceleration on K–12 Students’ Academic Achievement: Findings of Two Second-Order Meta-Analyses

This paper analyzed the results of research on the effects of ability grouping and acceleration on students' academic achievement. Nineteen meta-analyses were met criteria for inclusion for the review. Results were found for improved academic achievement within-class grouping, cross-grade grouping by subject, and grouping for the gifted. No positive effects were identified for between-class grouping. The results were consistent regardless of whether students were high, medium, or low achievers. The study found acceleration appeared to have a positive, moderate, and statistically significant impact on students’ academic achievement.

Steenbergen-Hu, S., Makel, M. C., & Olszewski-Kubilius, P. (2016). What One Hundred Years of Research Says About the Effects of Ability Grouping and Acceleration on K–12 Students’ Academic Achievement: Findings of Two Second-Order Meta-Analyses. Review of Educational Research, 86(4), 849-899.

Comparing and validating methods of reading instruction using behavioural and neural findings in an artificial orthography.

The results of this study confirm that early literacy instruction is most effective when focused on print-to-sound relationships (phonics) rather than on meaning. The benefits of print-to-sound training were found to be superior to print-to-meaning training for these reasons: (a) Reading aloud trained words learned phonetically was faster and more accurate, (b) generalization in reading aloud untrained words was faster, and (c) comprehension of written words was more accurate earlier in learning.

Taylor, J. S. H., Davis, M. H., & Rastle, K. (2017, April 20). Comparing and validating methods of reading instruction using behavioural and neural findings in an artificial orthography. Journal of Experimental Psychology: General. Advance online publication.

Productive teaching

This literature review examines the impact of various instructional methods

Walberg H. J. (1999). Productive teaching. In H. C. Waxman & H. J. Walberg (Eds.) New directions for teaching, practice, and research (pp. 75-104). Berkeley, CA: McCutchen Publishing.

The New York City Aspiring Principals Program-A School-Level Evaluation

This report represents the first systematic comparison of student outcomes in schools led by the Aspiring Principals Program (APP) graduates after three years to those in comparable schools led by other new principals.

Weinstein, M., Schwartz, A. E., & Corcoran, S. P. (2009). The New York City Aspiring Principals Program: A School-Level Evaluation. NYU Wagner Research Paper, (2011-07).

Impacts of New Leaders on Student Achievement in Oakland
This report presents our examination of impacts of principals trained by New Leaders on student achievement in Oakland Unified School District (OUSD). For the last 10 years, New Leaders has partnered with OUSD in efforts to improve the recruitment and training of effective principals and school leaders. This report fills an important gap in the literature, as little research has been done looking at the impacts of principal training programs on student achievement.
Booker, K., Thomas, J. (2014). Impacts of New Leaders on Student Achievement in Oakland. Mathematica Policty Research
Gateways to the Principalship State Power to Improve the Quality of School Leaders
This paper analyzes state policies for principal preparation approval and certification in 16 states, eight of which are "lagging," and eight "leading" in efforts to ensure effective leaders.
Cheney, G. R., & Davis, J. (2011). Gateways to the Principalship: State Power to Improve the Quality of School Leaders. Center for American Progress.
School Principals and School Performance
This paper uses data from New York City to estimate how the characteristics of school principals relate to school performance, as measured by students' standardized exam scores and other outcomes. There is little evidence of any relationship between school performance and principal education and pre-principal work experience, but some evidence that experience as an assistant principal at the principal's current school is associated with higher performance among inexperienced principals.
Clark, D., Martorell, P., & Rockoff, J. (2009). School Principals and School Performance. Working Paper 38. National Center for Analysis of longitudinal data in Education research.
Measuring Principal Performance: How Rigorous Are Commonly Used Principal Performance Assessment Instruments?
This study reviewed eight publicly available formative assessments of principal performance, focusing on the tool’s approach, time requirement, content and construct validity, and reliability.
Condon, C., & Clifford, M. (2010). Measuring Principal Performance: How Rigorous Are Commonly Used Principal Performance Assessment Instruments? A Quality School Leadership Issue Brief. Learning Point Associates.
Developing District-wide Expertise in Leaders’ Ability to Analyze and Improve Instructional Practice
This manuscript reports on two district’s efforts to improve the instructional leadership of principals, and lead teacher coaches in collaboration with an external support provider.
Copland, M. A., & Blum, D. (2007). Developing District-wide Expertise in Leaders’ Ability to Analyze and Improve Instructional Practice.
The Nature of Leadership Development
This book provides insight into the streams that are driving leadership theory and practice today. The Nature of Leadership, Second Edition provides students with an updated and complete yet concise handbook that solidifies and integrates the vast and disparate leadership literature.
Day, D., Antonakis, J. (2012). The Nature of Leadership. SAGE.
Schools Can’t Wait: Accelerating The Redesign of University Principal Preparation Programs
This report of 22 universities principal preparation programs identifies weaknesses in the training and offers recommendations for states to address the problems.
Fry, B., et al. (2006). Schools Can’t Wait: Accelerating The Redesign of University Principal Preparation Programs. Southern Regional Education Board.
Preparing Principals to Raise Student Achievement: Implementation and Effects of the New Leaders Program in Ten Districts
New Leaders is a nonprofit organization with a mission to ensure high academic achievement for all students by developing outstanding school leaders to serve in urban schools. This report describes how the New Leaders program was implemented in partner districts, and it provides evidence of the effect that New Leaders has on student achievement.
Gates, S., Burkhauser, S., Baird, M., Lavery, D. (2014). Preparing Principals to Raise Student Achievement: Implementation and Effects of the New Leaders Program in Ten Districts. Rand Corporation
An Innovative Look, a Recalcitrant Reality: The Politics of Principal Preparation Reform
This paper discusses how principal preparation programs can more effectively recruit and prepare future leaders in schools.
Hess, F. M., & Kelly, A. P. (2005). An innovative look, a recalcitrant reality: The politics of principal preparation reform. Educational policy, 19(1), 155-180.
Learning to Lead? What Gets Taught in Principal Preparation Programs
The purpose of this paper is to identify key features of principal preparation programs.
Hess, F., & Kelly, A. (2007). Learning to lead: What gets taught in principal-preparation programs. The Teachers College Record, 109(1), 244-274.
Overview and Inventory of State Education Reforms: 1990 to 2000
This report describes the education reform efforts in the United Stats in the 1990’s.
Hurst, D., Tan, A., Meek, A., and Sellers, J. (2003). Overview and inventory of state education reforms: 1990 to 2000. Washington, DC: National Center for Education Statistics.
From Policy Into Practice: The Effects of Principal Preparation Programs on Principal Behavior
The purpose of this article is to evaluate the effectiveness of principals who have undergone administrative training compared to those who have not. then reviews the potential impact of the new policy on principal training in Turkey and the literature regarding the effects of principal training programs.
Isik, H. (2003). From policy into practice: the effects of principal preparation programs on principal behavior. International Journal of Educational Reform, 12(4), 260-274.
Quality Measures: Principal Preparation Program Self-Assessment Toolkit
This report is designed to help principal preparation programs assess the quality of the training they offer.
King, C., (2013). Quality Measures: Principal Preparation Program Self-Assessment Toolkit. Education Development Center, Inc.
Recasting Leadership Development
This paper evolved from an invited address, “Lessons of My Experience: Three Decades of Exploring Leadership Development,” to the Society for Industrial and Organizational Psychology in April of 2009 as recipient of the 2008 Distinguished Professional Contributions Award.
McCALL, M. W. (2010). Recasting leadership development. Industrial and Organizational Psychology, 3(1), 3-19.
Research on School Leadership Preparation in the United States: an Analysis
This article addresses the work on rethinking the preparatory function in school administration in the US in a number of ways (e.g., unpacking the larger environmental forces that are fueling the turmoil in school administration). More recently, the field has turned our attention to the question of how research on the preparation of school leaders can inform efforts to strengthen the preparatory function. It summarize that work herein.
Murphy, J., & Vriesenga, M. (2006). Research on school leadership preparation in the United States: An analysis. School Leadership and Management, 26(2), 183-195.
Districts Developing Leaders: Lessons on Consumer Actions and Program Approaches from Eight Urban Districts
This report examines efforts in eight Wallace-supported school districts to revamp university principal-training programs. It finds that districts can influence leader training by acting like “discerning customers” who clearly describe to training programs the principal capabilities they are in the market for.
Orr, M. T., King, C., & LaPointe, M. (2010). Districts Developing Leaders: Lessons on Consumer Actions and Program Approaches from Eight Urban Districts. Education Development Center, Inc.
The Attributes and Career Paths of Principals: Implications for Improving Policy
This paper examines the attributes and career paths of New York States principals. It found that many of the commonly held beliefs about principals are supported by a systematic examination of the data. In other cases, we find that some widely held beliefs about principals are more myth than fact.
Papa, F. C., Lankford, H., & Wyckoff, J. (2002). The attributes and career paths of principals: Implications for improving policy. Teacher Policy Research Center.
MAKING SENSE OF LEADING SCHOOLS A Study of the School Principalship
The purpose of this paper is to identify common roles played by principals, how these roles differ across types of schools, and finally, how effectively are preparation programs training principals in these roles.
Portin, B., Schneider, P., DeArmond, M., & Gundlach, L. (2003). Making sense of leading schools. A National Study of the Principalship. Center of Reinventing Public Education. Daniel J. Evans School of Public Affairs. University of Washington. Seattle, WA.
The Cost-Effectiveness of Five Policies for Improving Student Achievement
This study compares the effect size and return on investment for rapid assessment, between, increased spending, voucher programs, charter schools, and increased accountability.
Yeh, S. S. (2007). The cost-effectiveness of five policies for improving student achievement. American Journal of Evaluation, 28(4), 416-436.
Improving School Leadership Preparation: Collaboration Models For Measuring Effectiveness.
This brief offers recommendations for principal preparation program approval and accreditation including: standards, reporting requirements, and on-going review processes for certification of school principals.
Yoder, N., Freed, D., And Fetters, J. (2014). Improving School Leadership Preparation: Collaboration Models For Measuring Effectiveness. Center on Great Teachers and Leaders: American Institutes for Research.
Back to Top