Assessing Different Levels and Dosages of the Shifting Boundaries Intervention to Prevent Youth Dating Violence in New York City Middle Schools: A Randomized Control Trial, 2011-2014 (ICPSR 36355)
These data are part of NACJD's Fast Track Release and are distributed as they were received from the data depositor. The files have been zipped by NACJD for release, but not checked or processed except for the removal of direct identifiers. Users should refer to the accompanying readme file for a brief description of the files available with this collection and consult the investigator(s) if further information is needed.
This study was a randomized controlled trial of a dating violence and sexual harassment (DV/H) prevention program called the Shifting Boundaries (SB) Program. Thirty-five public middle schools in New York City were randomly assigned to one of four treatment conditions of the SB program. The project includes a baseline and two follow-up surveys with 6th, 7th and 8th grade students to assess short to medium term impact on rates of DV/H. The classroom curriculum intervention (SBC) covered the consequences for perpetrators of DV/H, state laws and penalties for DV/H, and respectful relationships. The school (building-level) intervention (SBS) included the use of school-based restraining orders, higher levels of faculty and security presence in areas identified through student mapping of safe/unsafe "hot spots," and the use of posters to increase awareness and reporting of DV/H.
The project examined (1) the effects of saturating a school environment by providing the SB intervention to all three middle school grades compared to only two grades or one grade and (2) the effects of two dosages of SB across two years compared to one dosage of the SB intervention across one year which was explored in two prior evaluations of the program.
Carnegie Commission National Survey of Higher Education: Undergraduate Study Subsample, 1969-1970 (ICPSR 7079)
Chicago Longitudinal Study, 1986-1989 (ICPSR 25921)
The Chicago Longitudinal Study investigates the educational and social development of a same-age cohort of 1,539 low-income, minority children (93 percent African American) who grew up in high-poverty neighborhoods in central-city Chicago and attended government-funded kindergarten programs in the Chicago Public Schools in 1985-1986. Children were at risk of poor outcomes because they face social-environmental disadvantages including neighborhood poverty, family low-income status, and other economic and educational hardships.
Study Goals
The CLS is guided by four major goals:
- To document patterns of school performance and social competence throughout the school-age years, including their school achievement and attitudes, academic progress, and psychosocial development.
- To evaluate the effects of the Child-Parent Center and Expansion Program on child and youth development. Children and families had the opportunity to participate in this unique Head Start type early childhood intervention from ages three to nine (preschool to third grade).
- To identify and better understand the educational and psychosocial pathways through which the effects of early childhood experiences are manifested, and more generally, through which scholastic and behavioral development proceeds.
- To investigate the contributions to children's educational and social development of a variety of personal, family, school, and community factors, especially those that can be altered by program or policy interventions to prevent learning difficulties and promote positive outcomes.
Studies addressing the first two goals have been reported extensively. Participation in the Child-Parent Center Program for different lengths of time, for example, has been found to be significantly associated with higher levels of school achievement into adolescence, with higher levels of consumer skills, with enhanced parent involvement in children's education, and with lower rates of grade retention and special education, lower rates of early school dropout, and with lower rates of delinquent behavior (Reynolds, 1994, 1995, 2000; Reynolds and Temple, 1995, 1998; Temple, Reynolds, and Miedel, in press). Children's patterns of school and social adjustment over time (Reynolds and Bezruczko, 1993; Reynolds and Gill, 1994; Reynolds, 2000) as well as several methodological contributions (Reynolds and Temple, 1995; Reynolds, 1998a, 1998b) also have been reported elsewhere. Examples of studies addressing goals three and four are reported in a special issue of the Journal of School Psychology (Reynolds, 1999).
The Chicago Longitudinal Study is particularly appropriate for addressing these and other goals for two reasons. First, the CLS is one of the most extensive and comprehensive studies undertaken of a low-income, urban sample. Data were collected beginning during children's preschool years and have continued on a yearly basis throughout the school-age years. Multiple sources of data have been utilized in this on-going study, including teacher surveys, child surveys and interviews, parent surveys and interviews, school administrative records, standardized tests, and classroom observations. Thus, the impact of a variety of individual, family, and school-related factors can be investigated.
A second unique feature of the CLS is that although the project concerns child development, an emphasis is given to factors and experiences that are alterable by program or policy intervention both within and outside of schools. Besides information on early childhood intervention, information has been collected on classroom adjustment, parent involvement and parenting practices, grade retention and special education placement, school mobility, educational expectations of children, teachers, and parents, and on the school learning environment.
Civic Cohort: Parent-Youth Dyad Interviews during the 2002-2004 Election Cycles in Arizona, Colorado, and Florida (ICPSR 36529)
Community College Civic Outcomes Survey, Spring 2015 (ICPSR 36833)
The Community College Civic Outcomes Survey, Spring 2015 study examines the individual and institutional factors associated with greater civic agency, capacity, behavior, and knowledge among college students. In Spring 2015, two surveys were digitally administered at nine community colleges. These nine colleges were purposively selected for diversity in terms of geography, campus setting, size, and the racial and ethnic composition of their student bodies. From a total of 98,838 recipients, 4,788 usable surveys were returned, for an aggregate five percent response rate (response rates varied from two to 13% among the nine colleges). This data includes a sample of 3,897 from those surveys collected.
The Civic Outcomes Survey (COS) was administered to students, and included questions related to voting, political and community engagement, civic knowledge, and leadership development. The Institutional Questionnaire (IQ), was admitted to each college's liaisons to The Democracy Commitment (TDC), and included questions related to college-level factors known to influence student engagement. These questions assessed for institutional intentionality towards civic engagement through college missions and strategic planning, as well as academic and faculty focus on civic involvement. Both instruments were previously tested in a small regional pilot and were subsequently refined to allow for greater response variability. Demographic variables include race, income, gender, and enrollment status.
Community College Civic Outcomes Survey, United States, Spring 2016 (ICPSR 36954)
The Community College Civic Outcomes Survey, Spring 2016 study examines the individual and institutional factors associated with greater civic agency, capacity, behavior, and knowledge among college students. In Spring 2016, two surveys were digitally administered at 13 community colleges, or community college systems. These colleges were purposively selected for diversity in terms of geography, campus setting, size, and the racial and ethnic composition of their student bodies. This data includes a sample of 1,693 surveys from those collected.
The Civic Outcomes Survey (COS) was administered to students, and included questions related to voting, political and community engagement, civic knowledge, and leadership development. The Institutional Questionnaire (IQ), was admitted to each college's liaisons to The Democracy Commitment (TDC), and included questions related to college-level factors known to influence student engagement. These questions assessed for institutional intentionality towards civic engagement through college missions and strategic planning, as well as academic and faculty focus on civic involvement. Both instruments were previously tested in a small regional pilot and were subsequently refined to allow for greater response variability. Demographic variables include race, income, gender, and enrollment status.
Community College Civic Outcomes Survey, United States, Spring 2017 (ICPSR 36961)
The Community College Civic Outcomes Survey, Spring 2017 study examines the individual and institutional factors associated with greater civic agency, capacity, behavior, and knowledge among college students. In Spring 2017, two surveys were digitally administered at 8 community colleges, or community college systems. These colleges were purposively selected for diversity in terms of geography, campus setting, size, and the racial and ethnic composition of their student bodies. This data includes a sample of 1,168 surveys from those collected.
The Civic Outcomes Survey (COS) was administered to students, and included questions related to voting, political and community engagement, civic knowledge, and leadership development. The Institutional Questionnaire (IQ), was admitted to each college's liaisons to The Democracy Commitment (TDC), and included questions related to college-level factors known to influence student engagement. These questions assessed for institutional intentionality towards civic engagement through college missions and strategic planning, as well as academic and faculty focus on civic involvement. Both instruments were previously tested in a small regional pilot and were subsequently refined to allow for greater response variability. Demographic variables include race, income, gender, and enrollment status.
Counseling for High Skills (CHS) Program Evaluation, 1994, 1995, and 1997: [Colorado, Florida, Iowa, Kansas, and Nebraska] (ICPSR 2757)
Developing Knowledge About What Works to Make Schools Safe: Implementation and Evaluation of Tools for Life to Improve School Climate and Safety in Jackson Public School District, Mississippi, 2016-2018 (ICPSR 37600)
Tools for Life: Relationship-Building Solutions (TFL) is a program designed to improve school climate and safety through the proactive development of elementary and middle school students' interpersonal skills (relationship-building and communication) and intrapersonal skills (self-regulation and resiliency). In the 2016-2017 and 2017-2018 school years, the Jackson (Mississippi) Public School District (JPSD) implemented TFL in grades 1 through 8. RAND researchers conducted a randomized controlled trial to determine whether TFL, integrated into existing school practices, positively affected school climate and safety in the district.
This project described the implementation of TFL in JPSD, calculated its costs, and evaluated the program's effectiveness. TFL was designed to improve whole-school change in relationships among staff and students, but the project researchers found that implementation of TFL in JPSD schools was generally shallow, and the program was rarely, if at all, implemented across a whole school as it was designed. TFL had little impact: After one year of implementation, there were no practically or statistically significant differences between schools that implemented TFL and those that did not in measures of students' social and emotional, school climate, behavioral, or achievement outcomes. In addition to the uneven implementation of the program, methodological limitations of the study and contextual factors in JPSD may have contributed to these finding.
Education and Citizenship in East Africa, 1966-1967: Kenya Sample (ICPSR 7301)
Education and Citizenship in East Africa, 1966-1967: Tanzania Sample (ICPSR 4073)
Effectiveness of a SEL Program for Both Teachers and Students (ICPSR 208044)
Evaluation of the Bully-Proofing Your School Program in Colorado, 2001-2006 (ICPSR 21840)
Evaluation of the Children at Risk Program in Austin, Texas, Bridgeport, Connecticut, Memphis, Tennessee, Savannah, Georgia, and Seattle, Washington, 1993-1997 (ICPSR 2686)
Evaluation of Violence Prevention Programs in Four New York City Middle Schools, 1993-1994 (ICPSR 2704)
Examining the Efficacy of Circles on School Safety and Student Outcomes in Boston Public Schools, Massachusetts, 2017-2020 (ICPSR 39254)
High School and Beyond, 1980: A Longitudinal Survey of Students in the United States (ICPSR 7896)
High School and Beyond, 1980: Sophomore and Senior Cohort First Follow-Up (1982) (ICPSR 8297)
High School Seniors Cohort Study, 1965 and 1973 (ICPSR 7575)
Impact Evaluation of Complementarities Between Positive Behavioral Interventions and Supports (PBIS) and Restorative Justice, Maryland, 2018-2021 (ICPSR 38863)
Across the United States (U.S.), school districts have grappled with how to create safe community- and achievement-oriented schools and how to ensure the necessary discipline is applied transparently, fairly, and without bias. Two programs that many schools have turned to in order to achieve these goals are Schoolwide Positive Behavioral Interventions and Supports (PBIS) and Restorative Justice (RJ). PBIS is an evidence-driven schoolwide behavioral management approach that aims to outline clear expectations for students and to cultivate shared norms and practices across classrooms and school spaces. PBIS has become a popular approach in schools and districts: as of 2020; over 19,000 schools in the U.S. have implemented PBIS.
A second program, Restorative Justice (RJ), has grown in popularity in recent years. RJ typically focuses on restorative relationship building between affected parties, peaceful reconciliation, and non-punitive approaches to rectifying harm, using a structured circle discussion format. RJ schools use both community circles, designed to build a safe space for students and staff to share and listen to each other, and restorative circles, designed to share perspectives on and redress a behavioral issue.
Working with a large school district in a mid-Atlantic state, researchers set out to test whether these two programs substitute for or complement each other. In partnership with the school district researchers conducted two separate school-level randomized controlled trials (RCTs). The first RCT (RCT 1) sought to uncover the marginal impact of RJ by adding the program to a set of randomly selected schools that were already implementing PBIS. The second RCT (RCT 2) was designed to discover the impact of introducing both programs together into schools that had neither program at baseline. Researchers conducted student and staff surveys to collect measures of school climate, teacher logs to record program implementation, and researchers also received administrative data from the district on student test scores, teacher and student absences, student disciplinary infractions, and school costs.
There is growing evidence of the effectiveness of each of these programs in isolation. A recent meta-analysis of 32 experimental and quasi-experimental impact studies of PBIS found that PBIS reduced disciplinary exclusions and problem behavior and increased academic achievement. The findings were statistically significant and showed small to medium effect sizes. Individual studies have found that PBIS reduces the use of office disciplinary referrals and other exclusionary disciplinary measures (including the use of in-school and out-of-school suspensions), while improving student behavior and attitudes across school levels. Individual studies show variable--some statistically significant and some null--impacts on academic outcomes.
The empirical evidence on the effect of RJ in U.S. schools is more limited, with little rigorous casual evidence published to date. Based on patterns across rigorous and non-rigorous research, restorative justice is associated with decreases in suspension rates and disciplinary disparities, improved student behavior, and improved school climate and relationships.
Improving School Safety in the District of Columbia: Evaluating the Safe School Certification Program, 2016-2020 (ICPSR 37892)
Improving the Decision-Making Skills of Secondary School Students, 1992-1993: [Eugene, Oregon] (ICPSR 2361)
Instructional Supports for Motivation Trajectories in Introductory College Engineering (ICPSR 160221)
Investigating the Effectiveness of the School Security Climate on Student Connectedness and School Performance, New York City, New York, 2018-2021 (ICPSR 38254)
School safety research rarely considers the school security climate as a product of the simultaneous implementation of several school safety interventions. This is potentially problematic, as schools seldom employ only one safety intervention. Rather, schools today employ several interventions simultaneously to meet their safety and security needs. The purpose of this study is to investigate and identify effective types of school security climates and examine student growth within these climates. This multi-year project attempts to meet two goals: 1) Identify effective types of school security climates; and 2) Determine how the school security climate affects individual students. Data were collected from approximately 600 students attending 10 schools over the course of three years. Measures included an adapted version of the School Survey on Crime and Safety (SSOCS) and the Maryland Safe and Supportive Schools Survey (MDS3). The survey also included questions to obtain respondent demographics (age, gender, race/ethnicity) and other descriptive information about students and their experiences.
Jewish School Study, 2001 [United States] (ICPSR 4550)
Law-Related Education Evaluation Project [United States], 1979-1984 (ICPSR 8406)
Longitudinal Study of American Youth, 1987-1994, 2007-2011, 2014-2017 (ICPSR 30263)
The Longitudinal Study of American Youth (LSAY) is a project that was funded by the National Science Foundation in 1985 and was designed to examine the development of: (1) student attitudes toward and achievement in science, (2) student attitudes toward and achievement in mathematics, and (3) student interest in and plans for a career in science, mathematics, or engineering, during middle school, high school, and the first four years post-high school. The relative influence parents, home, teachers, school, peers, media, and selected informal learning experiences had on these developmental patterns was considered as well.
The older LSAY cohort, Cohort One, consisted of a national sample of 2,829 tenth-grade students in public high schools throughout the United States. These students were followed for an initial period of seven years, ending four years after high school in 1994. Cohort Two, consisted of a national sample of 3,116 seventh-grade students in public schools that served as feeder schools to the same high schools in which the older cohort was enrolled. These students were followed for an initial period of seven years, concluding with a telephone interview approximately one year after the end of high school in 1994.
Beginning in the fall of 1987, the LSAY collected a wide array of information including: (1) a science achievement test and a mathematics achievement test each fall, (2) an attitudinal and experience questionnaire at the beginning and end of each school year, (3) reports about education and experience from all science and math teachers in each school, (4) reports on classroom practice by each science and math teacher serving a LSAY student, (5) an annual 25-minute telephone interview with one parent of each student, and (6) extensive school-level information from the principal of each study school.
In 2006, the NSF funded a proposal to re-contact the original LSAY students (then in their mid-30's) to resume data collection to determine their educational and occupational outcomes. Through an extensive tracking activity which involved: (1) online tracking, (2) newsletter mailing, (3) calls to parents and other relatives, (4) use of alternative online search methods, and (5) questionnaire mailing, more than 95 percent of the original sample of 5,945 LSAY students were located or accounted for. In addition to re-contacting the students, the proposal defined a new eligible sample of approximately 5,000 students and these young adults were asked to complete a survey in 2007. A second survey was conducted in the fall of 2008 that sought to gather updated information about occupational and education outcomes and to measure the civic scientific literacy of these young adults, in which to date more than 3,200 participants have responded. A third survey was conducted in the fall of 2009 that sought to gather updated information about occupational and education outcomes and to measure the participants' use of selected informal science education resources, in which to date more than 3,200 participants have responded. A fourth survey was conducted in the fall of 2010 that sought to gather updated information about occupational and education outcomes, as well as provided questions about the participants' interactions with their children, in which to date more than 3,200 participants have responded. Finally, a fifth survey was conducted in the fall of 2011 that sought to gather updated information about education outcomes and included an expanded occupation battery for all participants, as well as an expanded spousal information battery for all participants. The 2011 questionnaire also included items about the 2011 Fukushima incident in Japan along with attitudinal items about nuclear power and global climate change. To date approximately 3,200 participants responded to the 2011 survey.
There were no surveys conducted in 2012 or 2013. Beginning in 2014 the LSAY was funded by the National Institute on Aging for five years. This data release adds the 2017 data to the previous data release that included data through 2016.
The public release data files include information collected from the national probability sample students, their parents, and the science and mathematics teachers in the students' schools. The data covers the initial seven years, beginning in the fall of 1987, as well as the data collected in the 2007, 2008, 2009, 2010, 2011, 2014, 2015, 2016, and 2017 questionnaires.
Part 1: LSAY Merged Cohort (Base File) contains student and parent data from both cohorts of the LSAY from 1987-1994 and student follow-up data from 2007-2011 and 2014-2017. Additionally, Parts 2 - 5 contain information gathered from two teacher background questionnaires and two principal questionnaires from 1987-1994.
Longitudinal Study of American Youth, 1988-1994, 2007-2014 (ICPSR 37336)
Data users can find the latest version of the entire Longitudinal Study of American Youth data collection, including years 1988-1994 and 2007-2014 on ICPSR's website. See ICPSR 30263. Also, data users may explore NADAC's Longitudinal Study of American Youth (LSAY), Seventh Grade Data, 1987-1988; 2015-2016.
The Longitudinal Study of American Youth (LSAY) is a project that was funded by the National Science Foundation in 1985 and was designed to examine the development of: (1) student attitudes toward and achievement in science, (2) student attitudes toward and achievement in mathematics, and (3) student interest in and plans for a career in science, mathematics, or engineering, during middle school, high school, and the first four years post-high school. The relative influence parents, home, teachers, school, peers, media, and selected informal learning experiences had on these developmental patterns were considered as well.
The older LSAY cohort, Cohort One, consisted of a national sample of 2,829 tenth-grade students in public high schools throughout the United States. These students were followed for an initial period of seven years, ending four years after high school in 1994. Cohort Two, consisted of a national sample of 3,116 seventh-grade students in public schools that served as feeder schools to the same high schools in which the older cohort was enrolled. These students were followed for an initial period of seven years, concluding with a telephone interview approximately one year after the end of high school in 1994.
Beginning in the fall of 1987, the LSAY collected a wide array of information including: (1) a science achievement test and a mathematics achievement test each fall, (2) an attitudinal and experience questionnaire at the beginning and end of each school year, (3) reports about education and experience from all science and math teachers in each school, (4) reports on classroom practice by each science and math teacher serving a LSAY student, (5) an annual 25-minute telephone interview with one parent of each student, and (6) extensive school-level information from the principal of each study school.
In 2006, the NSF funded a proposal to re-contact the original LSAY students (then in their mid-30's) to resume data collection to determine their educational and occupational outcomes. Through an extensive tracking activity which involved: (1) online tracking, (2) newsletter mailing, (3) calls to parents and other relatives, (4) use of alternative online search methods, and (5) questionnaire mailing, more than 95 percent of the original sample of 5,945 LSAY students were located or accounted for. In addition to re-contacting the students, the proposal defined a new eligible sample of approximately 5,000 students and these young adults were asked to complete a survey in 2007. A second survey was conducted in the fall of 2008 that sought to gather updated information about occupational and education outcomes and to measure the civic scientific literacy of these young adults, in which to date more than 3,200 participants have responded. A third survey was conducted in the fall of 2009 that sought to gather updated information about occupational and education outcomes and to measure the participants' use of selected informal science education resources, in which to date more than 3,200 participants have responded. A fourth survey was conducted in the fall of 2010 that sought to gather updated information about occupational and education outcomes, as well as provided questions about the participants' interactions with their children, in which to date more than 3,200 participants have responded. Finally, a fifth survey was conducted in the fall of 2011 that sought to gather updated information about education outcomes and included an expanded occupation battery for all participants, as well as an expanded spousal information battery for all participants. The 2011 questionnaire also included items about the 2011 Fukushima incident in Japan along with attitudinal items about nuclear power and global climate change. To date approximately 3,200 participants responded to the 2011 survey.
Longitudinal Study of American Youth (LSAY), Seventh Grade Data, 1987-1988; 2015-2016 (ICPSR 37287)
The Longitudinal Study of American Youth (LSAY) is a project that was originally funded by the National Science Foundation in 1985 and was designed to examine the development of: (1) student attitudes toward and achievement in science, (2) student attitudes toward and achievement in mathematics, and (3) student interest in and plans for a career in science, mathematics, or engineering, during middle school, high school, and the first four years post-high school. The relative influence parents, home, teachers, school, peers, media, and selected informal learning experiences had on these developmental patterns was considered as well.
The LSAY was designed to select and follow two cohorts of students in 1987. Cohort One was a national sample of approximately 3,000 tenth grade students in public high schools throughout the United States. Cohort Two, consisted of a national sample of 3,116 seventh grade students in public schools that served as feeder schools to the same high schools in which the older cohort was enrolled. Data collection continues for Cohorts One and Two, 31 years after the study began.
In the fall of 2015, data collection began on a third cohort: Cohort Three. Cohort Three consisted of 3,721 students in the seventh grade in public schools throughout the United States. The data in this release provides seventh grade comparison data across a 28-year timespan: Cohort Two (1987-1988) and Cohort Three (2015-2016).
This study includes arts-related variables about student and parent participation in music, art, literary, dance, and theatrical pursuits. For a more details please see Description of Variables.
Mathematics Teaching in the 21st Century (ICPSR 34430)
MT21 is a cross-national study of the preparation of middle school mathematics teachers. Countries participating included Chinese Taipei (Taiwan), South Korea (Korea), Bulgaria, Germany, Mexico, and the United States. Data were collected from teachers in their first and last year of preparation by sampling institutions in each country. Future teachers were asked about their backgrounds, course-taking and program activities, knowledge relevant to their teaching (mathematical and pedagogical), and beliefs and perspectives on content and pedagogy.
The 1995 Third International Mathematics and Science Study (TIMSS) data revealed that countries with higher achievement have teachers who teach substantially different content than that of their less accomplished counterparts (see Schmidt et al., 1996; Schmidt et al., 2001). The 1996 Report of the National Commission on Teaching and America's Future argued that what teachers know and do in the classroom matters for pupil learning. It also argued that teacher education might be a viable policy tool to improve the quality of education (National Commission on Teaching and America's Future, 1996). United States reform efforts are consistent with this line of thought. They have introduced standards to measure teacher quality as it relates to student achievement. This, in turn, led to accountability concerns regarding teacher preparation programs (INTASC, 1995; Murray, 2000; Leithwood, Edge and Jantzi, 1999; NCATE, 2000).
The MT21 Project was designed to answer the following question: how shall we prepare our future teachers to teach a more rigorous curriculum to all students? Several assumptions were made going into this work: the concepts and models defining teacher preparation are not fixed across the world. Recognizing and understanding this diversity to develop a cross-national study of teacher preparation poses a complex and challenging problem. It is hoped that the resulting international data would not only serve to provide policy insights but would also bring about change by making visible contrasts with other countries in terms of teacher preparation in the United States.
MDRC's Evaluation of Communities In Schools (CIS), North Carolina and Texas, 2011-2014 (ICPSR 37037)
Communities In Schools (CIS) works to provide and connect students with integrated support services to keep them on a path to graduation. The intent of the CIS model is to reduce dropout rates by integrating community and school-based support services within schools through the provision of "Level 1" and "Level 2" services. Level 1 services are broadly available to all students or to groups of students and are usually short-term, low intensity activities or services. CIS Coordinators spend much of their time focused on more intensive Level 2 "case-managed" services, which they provide to a subset of students displaying one or more significant risk factors, such as poor academic performance, a high absentee rate, or behavioral problems.
This study was a two-year randomized controlled trial of Level-2 CIS case management, which examined service provision, student experiences and student outcomes. This trial was half of a two-pronged national evaluation, the other half was a quasi-experimental study of the whole-school model. The study evaluated 24 mostly urban, low-income secondary schools in North Carolina and Texas during the 2012-2013 and 2013-2014 school years; baseline data was also collected during the 2011-2012 school year. Data was collected through student surveys, school records, and CIS management information systems (MIS) data.
The data in this collection is student-level, including all information collected about students in the study sample with 613 variables and 4459 cases. The dataset includes three school years of data: baseline period (2011-2012), first year of implementation (2012-2013) and second year of implementation (2013-2014). Demographic variables in this collection include: free lunch status, special education status, employment, race, language, ethnicity, gender, household members, number of siblings, parents' education level, and grade level.
Measures of Effective Teaching: 1 - Study Information (ICPSR 34771)
The Measures of Effective Teaching Project (MET)
The MET project is based on two premises: First, a teacher's evaluation should depend to a significant extent on his/her students' achievement gains; second, any additional components of the evaluation (e.g., classroom observations) should be valid predictors of student achievement gain.
Student achievement was measured in two ways -- through existing state assessments, designed to assess student progress on the state curriculum for accountability purposes, and supplemental assessments, designed to assess higher-order conceptual understanding. The supplemental assessments used were Stanford 9 Open-Ended Reading Assessment in grades 4 through 8, Balanced Assessment in Mathematics (BAM) in grades 4 through 8, and the ACT QualityCore series for Algebra I, English 9, and Biology.
Panoramic digital video of classroom sessions were taken of participating teachers and students, teachers submitted commentary on their lessons (e.g., specifying the learning objective) and then trained raters scored the lesson based on classroom observation protocols using the following five observation protocols:
- Classroom Assessment Scoring System (CLASS), developed by Robert Pianta, University of Virginia
- Framework for Teaching, developed by Charlotte Danielson
- Mathematical Quality of Instruction (MQI), developed by Heather Hill, Harvard University, and Deborah Loewenberg Ball, University of Michigan
- Protocol for Language Arts Teaching Observations (PLATO), developed by Pam Grossman, Stanford University
- Quality Science Teaching (QST) Instrument, developed by Raymond Pecheone, Stanford University
A subset of the videos also are being scored using an observational protocol developed by the National Board for Professional Teaching Standards (NBPTS) and using the UTeach Observational Protocol (UTOP), developed by the UTeach Preparation Program.
Close to 3,000 teacher volunteers from across the following six, predominantly urban, school districts participated in the MET project: Charlotte-Mecklenburg Schools, Dallas Independent School District, Denver Public Schools, Hillsborough County Public Schools, Memphis City Schools, and the New York City Department of Education. Participants teach math and English language arts (ELA) in grades 4-8, Algebra I, grade 9 English, and high school biology.
The Study Information Release
Contained in this release are a comprehensive user guide, an observation measures report, a randomization file, a video information file, a subject ID file, a teacher demographics file, a student global ID crosswalk file, and a teacher global ID crosswalk file.
- User Guide - The user guide provides information on all data releases included in the MET longitudinal database. The report describes: (1) the educational research and policy context for the study; (2) research questions addressed by MET researchers; (3) the core study design and sub-studies; (4) the realized study sample; (5) additional information on study instruments and derived measures; and (6) the data files available for secondary analysis.
- Observation Measures Report - This report includes a description of the scoring design used for each phase and each year of the video observation measures and final reports of the scoring carried out for each measure.
- Randomization File - Year two of the MET study included a process for randomizing the classroom to which teachers were assigned. Information found in the randomization file includes district, school, section and student IDs, teacher IDs for the teacher a student was randomly assigned to, the actual teacher the student was recorded as having in May of that year, and the actual teacher the student was recorded as having in October of that year. Also included in the file are variables that indicate the grade of the student, their randomization block and exchange group and section each student was assigned to.
- Video Information File - This file contains descriptive information about the videos captured for the MET project. Variables found in the file include the ID of the video, as well as IDs for the district, school, teacher and section related to each video, the subject, grade, and year of the video and whether the file is available for users to view.
- Subject ID Crosswalk - This file contains only ID variables and is included to describe the associations between districts, schools, teachers, sections and students.
- Teacher Demographics File - This file contains descriptive information about the teachers in the MET project. Variables found in the file include the ID of the teacher, as well as IDs for the district, gender, race, years experience, and level of education.
- Student Global ID Crosswalk File - Students were given new and unique IDs in each year of data collection. This file matches those Student IDs across the 2008-09, 2009-10, 2010-11, 2011-12, 2012-13, and 2013-14 academic years.
- Teacher Global ID Crosswalk File - Teachers were given new and unique IDs in each year of data collection. This file matchers those Teachers IDs across the 2008-09, 2009-10, 2010-11, 2011-12, 2012-13, and 2013-14 academic years.
Measures of Effective Teaching: 2 - Core Files, 2009-2011 (ICPSR 34414)
The MET project is based on two premises: First, a teacher's evaluation should depend to a significant extent on his/her students' achievement gains; second, any additional components of the evaluation (e.g., classroom observations) should be valid predictors of student achievement gain.
Student achievement was measured in two ways -- through existing state assessments, designed to assess student progress on the state curriculum for accountability purposes, and supplemental assessments, designed to assess higher-order conceptual understanding. The supplemental assessments used were:
- Stanford 9 (SAT-9) Open-Ended Reading Assessment in grades 4 through 8
- Balanced Assessment in Mathematics (BAM) in grades 4 through 8
- ACT QualityCore series for Algebra I, English 9, and Biology
Panoramic digital video of classroom sessions were taken of participating teachers and students, teachers submitted commentary on their lessons (e.g., specifying the learning objective) and then trained raters scored the lesson based on classroom observation protocols using the following five observation protocols:
- Classroom Assessment Scoring System (CLASS), developed by Robert Pianta, University of Virginia
- Framework for Teaching (FFT), developed by Charlotte Danielson
- Mathematical Quality of Instruction (MQI), developed by Heather Hill, Harvard University, and Deborah Loewenberg Ball, University of Michigan
- Protocol for Language Arts Teaching Observations (PLATO), developed by Pam Grossman, Stanford University
- Quality Science Teaching (QST) Instrument, developed by Raymond Pecheone, Stanford University
A subset of the videos are also being scored using an observational protocol developed by the National Board for Professional Teaching Standards (NBPTS).
Close to 3,000 teacher volunteers from across the following 6, predominantly urban, school districts participated in the MET project: Charlotte-Mecklenburg Schools, Dallas Independent School District, Denver Public Schools, Hillsborough County Public Schools, Memphis City Schools, and the New York City Department of Education. Participants teach math and English language arts (ELA) in grades 4-8, Algebra I, grade 9 English, and high school biology.
Data File Description- District/School File - This data file contains an ID for the district where MET teachers taught and data on the schools where they taught. All data are from year one of the study. The data included for schools include limited measures of school organization, student composition, and aggregated test score information. The file also includes data collected from school principals about the nature of teacher evaluation processes in a school.
- Teacher File - This data file contains data on those MET teachers who participated in year one of the study only or who participated in both years of the study. There is one data record per teacher. Data in the teacher file was collected (or recorded) only once during the study. Among the variables included in the file are: (1) teacher IDs; (2) ID variables for district and school; (3) variables indicating a teacher's grade, subject, and study status; (4) measures of teachers' personal characteristics and professional background; (5) teacher responses to MET teacher working conditions survey [administered in year one of the study]; (6) teacher responses to the MET teacher survey administered [in year two of the study]; (7) teachers' scaled scores as well as multiple choice and constructed response sub-scores for the CKT measures; and (8) principal ratings of a teacher's effectiveness.
- Class Section File - This data file contains data on the focal class sections taught by MET teachers. There is one data record per section. In most cases, generalists have one class section per year in the study, so that teachers who participated in both years of the study will have a total of 2 class sections of data per teacher record per year. Specialists generally have 2 class sections in year one and 1 class section in year two year, so that teachers who participated in both years of the study will have a total of up to 3 class sections of data per teacher record. Among the variables included for each class section taught by a teacher are: (1) section IDs; (2) ID variables for teacher, school, and district; (3) variables indicating a teacher's grade, subject, and study status; (4) measures of class composition, including aggregated data on students' prior year test scores, ethnic composition, free lunch status, and special education status; and (5) class size. Also included in this data file are: (6) value-added measures of teaching effectiveness based on student achievement scores [aggregated to the section level]; (7) measures of teaching effectiveness based on classroom observation score data [aggregated to the section level]; and (8) measures of teaching effectiveness based on student survey data [aggregated to the section level].
- Student File - These data files contain data on students who were in the focal class sections of MET teachers during either year. Data on each student include: (1) student ID; (2) ID variables for section, teacher, school, and district; (3) measures of current and prior student achievement for all tests/years recorded [e.g., 2010-2011, 2009-2010; and up to three prior years]; (4) measures of student background [sex, ethnicity, lunch status, special education status, program participation]; and (5) student survey responses.
- Classroom Observation Scores File - These data files contain data from all classroom observation sessions conducted on each teacher. There will be one file per observation instrument and each file will have one record for each segment scored by a rater. Data on each observation session include: (1) a segment ID, (2) ID variables for video, section, teacher, school, and district; (3) variables indicating the video's grade, and subject; (4) a variable indicating whether score comes from the primary scorer or a secondary scorer; (5) scores on the dimensions of the given observation instrument; (5) a variable indicating if the rater deferred scoring of the video to the scoring leader. Note that each video will generally have multiple rows because scores were given at the segment level. Additionally, instruments with different segment scoring lengths will not be comparable at the segment level.
Measures of Effective Teaching: 3a - Base Data: Section-Level Analytical Files, 2009-2011 (ICPSR 34309)
The MET project is based on two premises: First, a teacher's evaluation should depend to a significant extent on his/her students' achievement gains; second, any additional components of the evaluation (e.g., classroom observations) should be valid predictors of student achievement gain.
Student achievement was measured in two ways--through existing state assessments, designed to assess student progress on the state curriculum for accountability purposes, and supplemental assessments, designed to assess higher-order conceptual understanding. The supplemental assessments used were Stanford 9 Open-Ended Reading Assessment in grades 4 through 8, Balanced Assessment in Mathematics (BAM) in grades 4 through 8, and the ACT QualityCore series for Algebra I, English 9, and Biology.
Panoramic digital video of classroom sessions were taken of participating teachers and students, teachers submitted commentary on their lessons (e.g., specifying the learning objective) and then trained raters scored the lesson based on classroom observation protocols using the following five observation protocols:
Classroom Assessment Scoring System (CLASS), developed by Robert Pianta, University of Virginia
Framework for Teaching, developed by Charlotte Danielson
Mathematical Quality of Instruction (MQI), developed by Heather Hill, Harvard University, and Deborah Loewenberg Ball, University of Michigan
Protocol for Language Arts Teaching Observations (PLATO), developed by Pam Grossman, Stanford University
Quality Science Teaching (QST) Instrument, developed by Raymond Pecheone, Stanford University
A subset of the videos also are being scored using an observational protocol developed by the National Board for Professional Teaching Standards (NBPTS)
Close to 3,000 teacher volunteers from across the following six, predominantly urban, school districts participated in the MET project: Charlotte-Mecklenburg Schools, Dallas Independent School District, Denver Public Schools, Hillsborough County Public Schools, Memphis City Schools, and the New York City Department of Education. Participants teach math and English language arts (ELA) in grades 4-8, Algebra I, grade 9 English, and high school biology.
Measures of Effective Teaching: 3b - Base Data: Item-Level Supplemental Test Files, 2009-2011 (ICPSR 34868)
The MET project is based on two premises: First, a teacher's evaluation should depend to a significant extent on his/her students' achievement gains; second, any additional components of the evaluation (e.g., classroom observations) should be valid predictors of student achievement gain.
Student achievement was measured in two ways -- through existing state assessments, designed to assess student progress on the state curriculum for accountability purposes, and supplemental assessments, designed to assess higher-order conceptual understanding. The supplemental assessments used were:
- Stanford 9 (SAT 9) Open-Ended Reading Assessment in grades 4 through 8
- Balanced Assessment in Mathematics (BAM) in grades 4 through 8
- ACT QualityCore series for Algebra I, English 9, and Biology (ACT)
Close to 3,000 teacher volunteers from across the following 6, predominantly urban, school districts participated in the MET project: Charlotte-Mecklenburg Schools, Dallas Independent School District, Denver Public Schools, Hillsborough County Public Schools, Memphis City Schools, and the New York City Department of Education. Participants teach math and English language arts (ELA) in grades 4-8, Algebra I, grade 9 English, and high school biology.
The Item-Level Supplemental Test Files release consists of data files for the three supplemental assessments (SAT 9, BAM, and ACT).
Measures of Effective Teaching: 3c - Base Data: Item-Level Observational Scores, 2009-2011 (ICPSR 34346)
The MET project is based on two premises: First, a teacher's evaluation should depend to a significant extent on his/her students' achievement gains; second, any additional components of the evaluation (e.g., classroom observations) should be valid predictors of student achievement gain.
Student achievement was measured in two ways -- through existing state assessments, designed to assess student progress on the state curriculum for accountability purposes, and supplemental assessments, designed to assess higher-order conceptual understanding.
Panoramic digital video of classroom sessions were taken of participating teachers and students, teachers submitted commentary on their lessons (e.g., specifying the learning objective) and then trained raters scored the lesson based on classroom observation protocols using the following five observation protocols:
- Classroom Assessment Scoring System (CLASS), developed by Robert Pianta, University of Virginia
- Framework for Teaching (FFT), developed by Charlotte Danielson
- Mathematical Quality of Instruction (MQI), developed by Heather Hill, Harvard University, and Deborah Loewenberg Ball, University of Michigan
- Protocol for Language Arts Teaching Observations (PLATO), developed by Pam Grossman, Stanford University
- Quality Science Teaching (QST) Instrument, developed by Raymond Pecheone, Stanford University
A subset of the videos also are being scored using an observational protocol developed by the National Board for Professional Teaching Standards (NBPTS) and using the UTeach Observational Protocol (UTOP), developed by the UTeach Preparation Program.
Close to 3,000 teacher volunteers from across the following 6, predominantly urban, school districts participated in the MET project: Charlotte-Mecklenburg Schools, Dallas Independent School District, Denver Public Schools, Hillsborough County Public Schools, Memphis City Schools, and the New York City Department of Education. Participants teach math and English language arts (ELA) in grades 4-8, Algebra I, grade 9 English, and high school biology.
The Item-Level Observational Scores Release
This release consists of data files for the five observational protocols listed (CLASS, FFT, MQI, PLATO, and QST) and the UTOP subset. Also included are rater comment files explaining rater scores on the CLASS instrument and master coded scores for the CLASS, FFT, PLATO, MQI and QST observational measures.
Measures of Effective Teaching: 3d - Base Data: Item-Level Surveys and Assessment Teacher Files, 2009-2011 (ICPSR 34345)
The MET project is based on two premises: First, a teacher's evaluation should depend to a significant extent on his/her students' achievement gains; second, any additional components of the evaluation (e.g., classroom observations) should be valid predictors of student achievement gain.
Student achievement was measured in two ways -- through existing state assessments, designed to assess student progress on the state curriculum for accountability purposes, and supplemental assessments, designed to assess higher-order conceptual understanding. The supplemental assessments used were Stanford 9 Open-Ended Reading Assessment in grades 4 through 8, Balanced Assessment in Mathematics (BAM) in grades 4 through 8, and the ACT QualityCore series for Algebra I, English 9, and Biology.
Panoramic digital video of classroom sessions were taken of participating teachers and students, teachers submitted commentary on their lessons (e.g., specifying the learning objective) and then trained raters scored the lesson based on classroom observation protocols using the following five observation protocols:
Classroom Assessment Scoring System (CLASS), developed by Robert Pianta, University of Virginia
Framework for Teaching (FFT), developed by Charlotte Danielson
Mathematical Quality of Instruction (MQI), developed by Heather Hill, Harvard University, and Deborah Loewenberg Ball, University of Michigan
Protocol for Language Arts Teaching Observations (PLATO), developed by Pam Grossman, Stanford University
Quality Science Teaching (QST) Instrument, developed by Raymond Pecheone, Stanford University
A subset of the videos also are being scored using an observational protocol developed by the National Board for Professional Teaching Standards (NBPTS) and using the UTeach Observational Protocol (UTOP), developed by the UTeach Preparation Program.
Close to 3,000 teacher volunteers from across the following six, predominantly urban, school districts participated in the MET project: Charlotte-Mecklenburg Schools, Dallas Independent School District, Denver Public Schools, Hillsborough County Public Schools, Memphis City Schools, and the New York City Department of Education. Participants teach math and English language arts (ELA) in grades 4-8, Algebra I, grade 9 English, and high school biology.
The Item-Level Survey Instruments and Assessment Files release consists of data files created from the six collection instruments described below:
The Principal Survey focuses on whether principals already know what they need to know about the effectiveness of their teachers or whether the instruments provide new information to these principals. The survey asks principals to provide an effectiveness rating for up to 12 MET teachers. It asks them how confident they are about each rating and what information they use to assess effective teaching.
The Student Perception Survey analyzes the value of elementary and secondary student feedback on the effort to improve both teaching and learning. Questions were created to elucidate the perceptions of the students and their school and classroom experiences.
The Teacher Web Survey was created to help answer whether teachers take seriously the rating provide by their administrator. It asks teachers to report whether they trust their principal -- Using Meyer, Davis, and Schoonhoven's three bases of trust: consistency, competency, and benevolence. It also asks teachers whether and to what extent they have acted on the feedback provided by their principal and whether the change made a positive difference in their teaching effectiveness.
The Teacher Working Condition Survey questions were intended to shed light on the level of support existing for teachers at their school environments, e.g., whether educators are valued, trusted, and have the time and ability to collaborate to improve instruction, as well as other aspects of working conditions such as time, facilities and resources, empowerment, professional development, community engagement, induction and leadership.
The Teacher Knowledge Assessment questions were intended to test the utility of both newly developed and well established measures of teacher knowledge to predict measures of teacher effectiveness.
The Survey of Enacted Curriculum was intended to investigate the role that the content of instruction plays in affecting student achievement gains, as compared to the study's broader focus on instructional quality measures