Improving School Safety in the District of Columbia: Evaluating the Safe School Certification Program, 2016-2020 (ICPSR 37892)
Version Date: Jun 29, 2022 View help for published
Principal Investigator(s): View help for Principal Investigator(s)
Deborah Temkin, Child Trends;
Renee Ryberg, Child Trends;
Bonnie Solomon, Child Trends;
Brandon Stratford, Child Trends;
Rebecca Madill, Child Trends
https://doi.org/10.3886/ICPSR37892.v1
Version V1
Summary View help for Summary
From 2016 through 2020, Child Trends, in partnership with the D.C. Office of Human Rights and the D.C. Office of the State Superintendent of Education, and with funding from the National Institute of Justice's Comprehensive School Safety Initiative, implemented and evaluated the Safe School Certification (SSC) Program, a three-year technical assistance model to support schools in strengthening organizational capacity across eight elements key to improving school climate: leadership, data, buy-in, policy and policy enforcement, student engagement, family and community engagement, training, and programs and practices. To help support schools' efforts, and to evaluate SSC's effectiveness, survey data were collected annually from students, parents, instructional staff, and non-instructional staff at participating schools using the U.S. Department of Education's School Climate Survey (EDSCLS), which was adapted to include measures of sexual orientation and gender identity, grit, and personal experiences of bullying and fights. Additionally, observations using the Classroom Assessment Scoring System - Secondary (CLASS-S) were conducted in a random sample of five classrooms in each participating school each year. Finally, as part of the implementation evaluation, interviews were conducted with the technical assistance providers, points of contact or leadership at participating schools, the SSC developer, and the manager of the Certification Advisory Board (CAB), which provided feedback to schools over the course of implementation through reviews of compiled workbooks.
Citation View help for Citation
Export Citation:
Funding View help for Funding
Subject Terms View help for Subject Terms
Geographic Coverage View help for Geographic Coverage
Smallest Geographic Unit View help for Smallest Geographic Unit
None
Restrictions View help for Restrictions
This data collection may not be used for any purpose other than statistical reporting and analysis. Use of these data to learn the identity of any person or establishment is prohibited. To protect respondent privacy, this data collection is restricted from general dissemination. To obtain this file, researchers must agree to the terms and conditions of a Restricted Data Use Agreement in accordance with existing ICPSR servicing policies.
Distributor(s) View help for Distributor(s)
Time Period(s) View help for Time Period(s)
Date of Collection View help for Date of Collection
Study Purpose View help for Study Purpose
The purpose of this study is to determine whether the Safe School Certification Program's organizational capacity building approach can foster a positive school climate (defined as the collective quality of individuals' experiences at school) in a secondary educational institution as a means to lower rates of minor (bullying) and major (fighting) school violence.
Study Design View help for Study Design
Each school within the "enhanced supports" condition was assigned one of two dedicated technical assistance specialists (TAS). In turn, each school was asked to identify a point of contact (POC) to work with the TAS throughout the project. Although the TAS frequently reached out to all enhanced support schools, schools' engagement varied, with some schools connecting with their TAS on a daily or weekly basis and others making little to no contact over the course of the project. Generally, however, the assigned TAS worked with their schools to convene a Core Leadership Team (CLT) and a Student Leadership Team (SLT), identify their current capacity around each element of the Safe School Certification (SSC) framework, review and interpret data, and facilitate decision-making to make progress on the framework.
Ultimately, a school was responsible for identifying and implementing practices to address each of the SSC elements. SSC is designed such that schools should ideally complete their work on the first checkpoint consisting of three elements (leadership, data, buy-in) during the first year, work on the second checkpoint consisting of the final five elements (policy, student engagement, family and community engagement, training, and programs) in the second year, and work on sustainability in the third and final year. However, schools moved at their own pace through the process.
The D.C. Office of Human Rights (OHR) convened a group of local stakeholders to serve as the Community Advisory Board (CAB). When schools submitted a workbook, Child Trends redacted potential identifying information (e.g., school and personnel names, addresses, mascots) and provided the de-identified workbook to the CAB for blinded review. The CAB provided written feedback and scored schools' workbooks based on a rubric describing each element's desired states on a scale of 0-2, with 2 indicating that a school has fully engaged on that element. The CAB deemed schools to have "passed" a checkpoint if schools scored at least 70% of the total potential points (11 out of 16 for checkpoint 1 and 28 out of 40 for checkpoint 2). After passing a checkpoint, schools were eligible to apply for grant funding, administered by the Office of the State Superintendent of Education (OSSE), to help support their evidence-informed programs and practices aligned to the SSC framework.
Sample View help for Sample
School-level sampling consisted of a selection of 26 public and charter middle and high schools (13 intervention/treatment and 13 control) within the District of Columbia. Classroom-level data was collected from a random sample of 5 classrooms from each participating school. Individual-level data was derived from individuals affiliated with each participating school (student, parents, and staff). Students were selected based on time and resource constraints, and those specifically in the Analytical Sample were limited to grades 7 to 9 (done so to avoid the potential of having the same students at multiple waves).
Time Method View help for Time Method
Universe View help for Universe
Secondary educational institutions in the District of Columbia and relevant individuals (students, parents, and staff).
Unit(s) of Observation View help for Unit(s) of Observation
Data Source View help for Data Source
School-level demographic information was obtained from OSSE Equity Reports and the DC School Report Card Resource Library.
Benchmark scales are derived from the Department of Education School Climate Survey (EDSCLS) Psychometric Benchmarking Technical Report.
Data Type(s) View help for Data Type(s)
Mode of Data Collection View help for Mode of Data Collection
Description of Variables View help for Description of Variables
Variables in the Classroom Assessment Scoring System (CLASS) datasets pertain to classroom-level performance and subjects taught. Variables in the Department of Education School Climate Survey (EDSCLS) datasets pertain to respondent demographics (race, gender, sexual orientation, etc.) and opinions on school safety and performance at the individual level (students, parents, and staff).
Response Rates View help for Response Rates
Not available.
Presence of Common Scales View help for Presence of Common Scales
Grit scales and scale scores are present in the Department of Education School Climate Survey datasets.
HideWeight View help for Weight
Two versions of poststratification weights for the Department of Education School Climate Survey Student Analytical Sample and Year 1 Data were constructed. These weights are based on the inverse probability that a student responded to the survey based on their race/ethnicity and the size of their grade-level according to publicly available aggregate data for each school. With the weights, results are generalizable to the schools and grades surveyed. The first weight variable, PSWT in the Student Analytical Sample, should be used when analyzing data for all four years. The second weight variable, also named PSWT, was constructed to be used with the Year 1 Data only.
HideNotes
The public-use data files in this collection are available for access by the general public. Access does not require affiliation with an ICPSR member institution.
One or more files in this data collection have special restrictions. Restricted data files are not available for direct download from the website; click on the Restricted Data button to learn more.