Categories for Implementation
September 26, 2019
What Is My Next Step? School Students’ Perceptions of Feedback. The power of feedback is touted as one of the most powerful practices for improving performance. Research consistently reports large effect sizes for feedback improving performance, yet variability relating to the effects of feedback exists. The Kluger and DeNisi 1996 meta-analysis was one such study that found a medium 0.41 effect size for the general impact of feedback. What Kluger and DeNisi found was that not all feedback is alike. This 2019 study attempts to increase our knowledge base by examining the power of different forms of feedback as a means to increase the impact of teacher delivered feedback. The paper aims to investigate student perceptions of feedback through designing a student feedback perception questionnaire (SFPQ) based on a conceptual model of feedback. The questionnaire was used to collect data about the helpfulness for learning resulting from different feedback types and levels. Findings from this study demonstrate that the SPFQ tool partially affirms Hattie and Timperely’s (2007) conceptual model of feedback. Feeding forward (information about improvement) was found to be a unique feedback type that was perceived by participants as being most helpful to learning compared to other feedback.
Citation: Brooks, C., Huang, Y., Hattie, J., Carroll, A., & Burton, R. (2019). What is my next step? School students’ perceptions of feedback. In Frontiers in Education (Vol. 4, p. 96). Frontiers.
Link: https://www.frontiersin.org/articles/10.3389/feduc.2019.00096/full
August 15, 2019
Teaching Elementary School Students to Be Effective Writers: A Practice Guide. This What Works Clearinghouse (WWC) practice guide examines the research on how teaching elementary students how to write. The report analyzes the evidence supporting those teaching methods commonly employed to increase student competency in becoming a fluent writer. The guide is for teachers, literacy coaches, principals, districts, and curriculum developers, and other educators. The paper summarizes the available research and provides recommendations on the types of activities and strategies teachers can use to increase student writing proficiency.
Citation: Graham, S., Bollinger, A., Olson, C. B., D’Aoust, C., MacArthur, C., McCutchen, D., & Olinghouse, N. (2012). Teaching Elementary School Students to Be Effective Writers: A Practice Guide. NCEE 2012-4058. What Works Clearinghouse.
Link: https://files.eric.ed.gov/fulltext/ED533112.pdf
July 30, 2019
The Effects of Targeted Professional Development on Teachers’ Use of Empirically Supported Classroom Management Practices. Research suggests teachers want and need to improve classroom management skills. Studies also find that teachers currently receive limited training and support in this critical area of instruction. This study examines brief, targeted professional development (brief training, email prompting, and self-management) to improve teacher classroom management skills. The training focused on increasing the effective use of prompting, increased active student responding, and delivery of praise. The results show that teachers increased their prompt and specific praise rates while they actively engaged in training. However, the effects of professional development did not maintain when training shifted to a new skill.
Citation: Simonsen, B., Freeman, J., Myers, D., Dooley, K., Maddock, E., Kern, L., & Byun, S. (2019). The Effects of Targeted Professional Development on Teachers’ Use of Empirically Supported Classroom Management Practices. Journal of Positive Behavior Interventions, 1098300719859615.
Link: https://journals.sagepub.com/doi/abs/10.1177/1098300719859615
April 11, 2019
Principal Pipeline: A Feasible, Affordable, and Effective Way for Districts to Improve Schools. The Rand Corporation just released its report evaluating the impact of the Principal Pipeline Initiative (PPI),a project supported by the Wallace Foundation to create and implement a strategic process for school leadership talent management. PPI was operated from 2011 to 2016 in six large school districts. It was composed of leadership standards, pre-service preparation opportunities for assistant principals and principals, selective hiring and placement, and on-the-job induction, evaluation and support. The Rand Study evaluated PPI’s feasibility, effectiveness, and affordability. It concluded that the model was feasible as each participating district was able to implement all components of the model at scale in different ways depending on the unique aspects of the district. From an effectiveness standpoint, newly placed principals in PPI districts had a greater statistically significant impact on student reading and math scores than non-PPI principals, they were more likely to stay ion their schools for at least two years, and the novice principals rated the program’s hiring, evaluation, and support process higher than non-participating principals rated the baseline model. And finally, the study found the model affordable at $ 42 per student per year, which represented a significant return on investment. Note: It is hoped that future studies will include outcome measure such as teacher retention, effectiveness, and satisfaction in the context of principal development.
Citation: Gates, Susan M., Matthew D. Baird, Benjamin K. Master, and Emilio R. Chavez-Herrerias, Principal Pipelines: A Feasible, Affordable, and Effective Way for Districts to Improve Schools, Santa Monica, Calif.: RAND Corporation, RR-2666-WF, 2019.
Link: https://www.rand.org/pubs/research_reports/RR2666.html
January 22, 2019
When Evidence-based Literacy Programs Fail. This study examines the implementation of Leveled Literacy Intervention (LLI) for struggling readers that had been proven to work in early grades. Disappointingly, the results showed after an average of 19 weeks of instruction the intervention had no impact on students’ reading comprehension and a negative impact on their mastery of ELA/literacy standards. The LLI impact on Smarter Balanced ELA/literacy scores was roughly equivalent to students losing more than five months of learning, based on the typical annual growth of students in grades 6-8. When the results were deconstructed, it was found that the failure to overcome obstacles to effective implementation played a significant role in the failure of the program to produce the anticipated results. The findings highlight the importance of considering context and implementation, in addition to evidence of effectiveness, when choosing an intervention program. Not only do schools need to adopt programs supported by evidence, but equally educators need to implement them consistently and effectively if students are to truly benefit from an intervention.
Citation: Gonzalez, N. (2018). When evidence-based literacy programs fail. Phi Delta Kappan, 100(4), 54–58. https://doi.org/10.1177/0031721718815675
Link: https://journals.sagepub.com/doi/full/10.1177/0031721718815675#articleCitationDownloadContainer
January 22, 2019
Barriers to Implementing Classroom Management and Behavior Support Plans: An Exploratory Investigation. Ample evidence supports effective classroom management’s place in maximizing student achievement. Unfortunately, sustained implementation of classroom management strategies too often fail. This study examines obstacles encountered by 33 educators along with suggested interventions to overcome impediments to effective delivery of classroom management interventions or behavior support plans. Having the right classroom management plan isn’t enough if you can’t deliver the strategies to the students in the classroom.
Citation: Collier‐Meek, M. A., Sanetti, L. M., & Boyle, A. M. (2019). Barriers to implementing classroom management and behavior support plans: An exploratory investigation. Psychology in the Schools, 56(1), 5-17.
Link: https://onlinelibrary.wiley.com/doi/pdf/10.1002/pits.22127
December 5, 2018
Accountability policies and teacher decision making: Barriers to the use of data to improve practice. Underlying many accountability policies is the assumption that standardized test data and other common sources of data will be used to make decisions that will result in changes to instructional practices. This study examines longitudinal from nine high schools nominated as leading practitioners of Continuous Improvement (CI) practices. The researchers compared continuous improvement best practices to teachers actual use of data in making decisions. The study found teachers to be receptive, but also found that significant obstacles were interfering with the effective use of data that resulted in changes in instruction. The analysis showed cultural values and practices inconsistent with accountability policies and continuous improvement practices impede implementation. The researchers identify barriers to use of testing and other data that help to account for the less than successful results. Given the current understanding of the importance on implementation science in the effective application of any new practice, these findings are not a surprise. As our colleague, Ronnie Detrich, is quoted as saying, “Implementation is where great ideas go to die”.
Citation: Ingram, D., Louis, K. S., & Schroeder, R. G. (2004). Accountability policies and teacher decision making: Barriers to the use of data to improve practice. Teachers College Record, 106(6), 1258-1287.
Link: Accountability policies and teacher decision making: Barriers to the use of data to improve practice
December 5, 2018
A Review of Schoolwide Positive Behavior Interventions and Supports as a Framework for Reducing Disciplinary Exclusions. Schoolwide positive behavior interventions and supports (SWPBIS) is implemented in more than 23,000 schools. Several reviews have examined the impact of SWPBIS, including a meta-analysis of single-case design research. However, to date, there has not been a randomized controlled trials (RCTs) reviews on the effects of SWPBIS implementation to reduce disciplinary exclusion, including office discipline referrals and suspensions. The purpose of this study is to conduct a systematic meta-analysis of RCTs on SWPBIS. Ninety schools, including both elementary and high schools, met criteria to be included in this study. A statistically significant large treatment effect (g = −.86) was found for reducing school suspension. No treatment effect was found for office discipline referrals.
Citation: Gage, N.A., Whitford, D.K. and Katsiyannis, A., 2018. A review of schoolwide positive behavior interventions and supports as a framework for reducing disciplinary exclusions. The Journal of Special Education, p.0022466918767847.
Link: Schoolwide Positive Behavior Interventions and Supports as a Framework for Reducing Disciplinary Exclusions
October 26, 2018
Hard Words: Why aren’t kids being taught to read?
This report and podcast examines the scientific basis for how to teach reading to children. This investigation reveals how children learn to read, emphasizing the five critical components of reading instruction. Unfortunately, most teacher preparation programs ignore the science and, in some cases, actively resist it. As a result, millions of kids are being set up to fail. This American Public Media documentary assesses the current knowledge base behind sound reading practices, the positive impact of effective reading practices can have on student reading performance, and the challenges faced in implementing these practices in the face of opposition from practitioners of whole language and proponents of balanced reading instruction.
Citation:Hanford, E, (2018). Hard Words: Why aren’t kids being taught to read? American Public Media (APM). https://www.apmreports.org/story/2018/09/10/hard-words-why-american-kids-arent-being-taught-to-read
Link: https://www.apmreports.org/story/2018/09/10/hard-words-why-american-kids-arent-being-taught-to-read
June 27, 2018
Four Domains for Rapid School Improvement: An Implementation Framework
The National Implementation Research Network (NIRN) and the National Center for School Turnaround published the “Four Domains for Rapid School Improvement: An Implementation Framework” as a companion to the Center for School Turnaround’s publication of “The Four Domains for Rapid School Improvement: A Systems Framework“. This paper describes “how” to effectively implement lasting school improvement initiatives that maximize leadership, develop talent, amplify instructional transformation, and shift the culture.
Citation:Jackson, K., R., Fixsen, D., and Ward, C. (2018). Four Domains for Rapid School Improvement: An Implementation Framework. The Center on School Turnaround.
Link: https://files.eric.ed.gov/fulltext/ED583980.pdf
