Developing Knowledge About What Works to Make Schools Safe: Implementation and Evaluation of Tools for Life to Improve School Climate and Safety in Jackson Public School District, Mississippi, 2016-2018 (ICPSR 37600)
Version Date: Jan 30, 2023 View help for published
Principal Investigator(s): View help for Principal Investigator(s)
Gabriella Gonzalez, RAND Corporation
https://doi.org/10.3886/ICPSR37600.v1
Version V1
Summary View help for Summary
Tools for Life: Relationship-Building Solutions (TFL) is a program designed to improve school climate and safety through the proactive development of elementary and middle school students' interpersonal skills (relationship-building and communication) and intrapersonal skills (self-regulation and resiliency). In the 2016-2017 and 2017-2018 school years, the Jackson (Mississippi) Public School District (JPSD) implemented TFL in grades 1 through 8. RAND researchers conducted a randomized controlled trial to determine whether TFL, integrated into existing school practices, positively affected school climate and safety in the district.
This project described the implementation of TFL in JPSD, calculated its costs, and evaluated the program's effectiveness. TFL was designed to improve whole-school change in relationships among staff and students, but the project researchers found that implementation of TFL in JPSD schools was generally shallow, and the program was rarely, if at all, implemented across a whole school as it was designed. TFL had little impact: After one year of implementation, there were no practically or statistically significant differences between schools that implemented TFL and those that did not in measures of students' social and emotional, school climate, behavioral, or achievement outcomes. In addition to the uneven implementation of the program, methodological limitations of the study and contextual factors in JPSD may have contributed to these finding.
Citation View help for Citation
Export Citation:
Funding View help for Funding
Subject Terms View help for Subject Terms
Geographic Coverage View help for Geographic Coverage
Smallest Geographic Unit View help for Smallest Geographic Unit
None
Restrictions View help for Restrictions
Access to these data is restricted. Users interested in obtaining these data must complete a Restricted Data Use Agreement, specify the reasons for the request, and obtain IRB approval or notice of exemption for their research.
Distributor(s) View help for Distributor(s)
Time Period(s) View help for Time Period(s)
Date of Collection View help for Date of Collection
Data Collection Notes View help for Data Collection Notes
-
The initial release of this study by ICPSR only contains quantitative data. The qualitative transcripts will be released in a future update.
Study Purpose View help for Study Purpose
The purpose of this study was to implement a social and emotional learning (SEL) program in a school district and evaluate its effects on school climate and safety throughout the district.
Study Design View help for Study Design
The study of the focal schools drew on an embedded, single-case design. With this design, the primary unit of interest was recognized as the district (JPSD). Therefore, it was sought to understand how Tools for Life (TFL) was implemented in this single district by attending to selected subunits (i.e., schools) within the district. The schools provided opportunities for extended analysis and helped to enhance insights into the single district.
Sample View help for Sample
The sample on which the study is based on consist of elementary and middle schools that were part of the initial treatment group, meaning that Tools for Life (TFL) was implemented at the beginning of the 2016-2017 school year. The other schools were in the control group; they received delayed treatment and began implementing TFL in 2017-2018.
To select the focal schools, the Jackson Public School District (JPSD)'s data was reviewed to determine variables that were likely to influence implementation and show some variability across schools. Two primary variables on which the schools were stratified were identified: total enrollment and in-school suspension (ISS) rates for males. Upon omitting schools with unique characteristics that would make findings less generalizable to other JPSD schools (i.e., rural and magnet schools), a selection of schools was able to be sampled from. Given the low incidence or middle schools with lower enrollment and lower ISS rates and middle schools with higher enrollment and higher ISS, schools that were sampled either had high enrollment and low ISS or low enrollment and high ISS.
Eligible school names were entered into numbered lists. Then, a random number generator to generate a number from each list was used until an appropriate number of schools was selected. Backup schools were also selected in case JPSD leaders were aware of a reason why a school would be a poor choice for being in a focal group. The focal school selection was presented to JPSD leaders in May 2016 and approval was received to proceed.
Subsequently, in early 2017, because of a change in data-collection arrangement and reduction in capacity, the number of focal schools was reduced; of which a random selection was implemented.
Time Method View help for Time Method
Universe View help for Universe
The quantitative data pertain to elementary and middle school students enrolled in the Jackson Public School District (JPSD). The qualitative interview transcripts pertain to JPSD teachers and staff.
Unit(s) of Observation View help for Unit(s) of Observation
Data Source View help for Data Source
Jackson Public School District administrative data release
Data Type(s) View help for Data Type(s)
Mode of Data Collection View help for Mode of Data Collection
Description of Variables View help for Description of Variables
Variables found in the data include assessment scores (Student Archival Data), opinions on school safety and performance (Student Survey Data), scale scores (Student Impact Analysis Data), and demographic information such as race and gender (Student Archival Data and Student Impact Analysis Data).
Response Rates View help for Response Rates
Less than one-third of eligible participants opted to participate in the data collection.
Presence of Common Scales View help for Presence of Common Scales
Scales that are present in the data include student level (emotional health, social and emotional learning (SEL), communication, empathy, self-control, and engagement) and school level (safety, student-teacher trust, and student-peer relationships) scores.
HideNotes
The public-use data files in this collection are available for access by the general public. Access does not require affiliation with an ICPSR member institution.
ICPSR usually offers files in multiple formats for researchers to be able to access data and documentation in formats that work well within their needs. If you have questions about the accessibility of materials distributed by ICPSR or require further assistance, please visit ICPSR’s Accessibility Center.
One or more files in this data collection have special restrictions. Restricted data files are not available for direct download from the website; click on the Restricted Data button to learn more.