Developing Knowledge About What Works to Make Schools Safe: Implementation and Evaluation of Tools for Life to Improve School Climate and Safety in Jackson Public School District, Mississippi, 2016-2018 (ICPSR 37600)
Tools for Life: Relationship-Building Solutions (TFL) is a program designed to improve school climate and safety through the proactive development of elementary and middle school students' interpersonal skills (relationship-building and communication) and intrapersonal skills (self-regulation and resiliency). In the 2016-2017 and 2017-2018 school years, the Jackson (Mississippi) Public School District (JPSD) implemented TFL in grades 1 through 8. RAND researchers conducted a randomized controlled trial to determine whether TFL, integrated into existing school practices, positively affected school climate and safety in the district.
This project described the implementation of TFL in JPSD, calculated its costs, and evaluated the program's effectiveness. TFL was designed to improve whole-school change in relationships among staff and students, but the project researchers found that implementation of TFL in JPSD schools was generally shallow, and the program was rarely, if at all, implemented across a whole school as it was designed. TFL had little impact: After one year of implementation, there were no practically or statistically significant differences between schools that implemented TFL and those that did not in measures of students' social and emotional, school climate, behavioral, or achievement outcomes. In addition to the uneven implementation of the program, methodological limitations of the study and contextual factors in JPSD may have contributed to these finding.
Evaluation of the Bully-Proofing Your School Program in Colorado, 2001-2006 (ICPSR 21840)
Interconnecting Positive Behavioral Interventions and Supports (PBIS) and School Mental Health to Improve School Safety, South Carolina and Florida, 2013-2020 (ICPSR 37908)
Bullying, fighting, and other forms of interpersonal violence occur frequently in elementary schools, and are associated with student distress, poor school functioning, and increases in aggression, delinquency, and other behavior problems. Positive Behavioral Intervention and Supports (PBIS) is a holistic, multi-tiered, evidence-based approach for preventing and reducing aggression and other problem behavior in school. However, the majority of PBIS schools struggle with more intensive interventions, which many students who present aggressive and disruptive behaviors need. School mental health (SMH) offers promise for addressing these limitations in PBIS. However, SMH lacks an implementation structure and as a result a student must effectively be at a crisis level to be referred for services. Because PBIS and SMH have operated separately, the impacts of both initiatives have been limited.
To address these limitations, the Interconnected Systems Framework (ISF) has been developed by leaders from national centers for both initiatives, providing specific guidance on PBIS-SMH interconnection through effective teams, data-based decision making, implementation support for evidence-based practices, and ongoing quality improvement to assure responsiveness to school and student needs. Involving partnerships with school districts and community mental health agencies in two school districts located in South Carolina and Florida, 24 schools implementing PBIS with fidelity were randomly assigned to the three conditions: the ISF, PBIS and SMH, or PBIS alone (8 schools per condition). Data were collected from school records, teacher and student reports, and school implementation teams. The impacts of ISF were compared to the other two conditions on school climate and safety, student exposure to violence, problem behavior and discipline problems, and access to and quality of services.