Head Start CARES Demonstration: National Evaluation of Three Approaches to Improving Preschoolers' Social and Emotional Competence, 2009-2015 (ICPSR 35510)
Version Date: Mar 6, 2017 View help for published
Principal Investigator(s): View help for Principal Investigator(s)
Pamela Morris, MDRC, and New York University
https://doi.org/10.3886/ICPSR35510.v3
Version V3
Alternate Title View help for Alternate Title
Summary View help for Summary
Low-income preschool children experience greater risks to their social and emotional development than their more affluent peers. These gaps are observed before children begin their formal schooling, and they remain or increase during the elementary school years. Since social and emotional risks may compromise children's future mental health and peer relationships, addressing them is important in its own right. In addition, social-emotional competence may aid learning: children who have difficulty regulating their emotions and behaviors have been found to receive less instruction, to be less engaged in and less positive about their role as learners, and to have fewer opportunities for learning from peers.
The Head Start CARES (Classroom-based Approaches and Resources for Emotion and Social skill promotion) demonstration tests three distinct approaches to enhancing children's social-emotional development on a large scale within the Head Start system - the largest federally funded early-childhood education program in the United States. Conceived and sponsored by the Office of Head Start and the Office of Planning, Research and Evaluation in the Administration for Children and Families within the United States Department of Health and Human Services, the Head Start CARES demonstration was conducted by MDRC, a nonprofit, nonpartisan education and social policy research organization, in collaboration with MEF Associates and several academic partners.
The three evidence-based social-emotional interventions selected for the Head Start CARES evaluation included: The Incredible Years Teacher Training Program (IY), Preschool PATHS (PATHS), and a one-year version of Tools of the Mind- Play (Tools). The interventions are referred to as "enhancements" because they enriched and complemented existing practices and curricula used in Head Start classrooms. These enhancements represent three "types" of social-emotional programming. That is, while all three were aimed at children's social-emotional development, they varied in their approach to changing this set of child outcomes by targeting somewhat different teacher practices, because they were built on differing theories about how social and emotional skills develop.
Baseline and Follow-up Class-level Impact Analysis Data Files
Data included in class-level data files were collected from external observers and teachers through two sources: Classroom Observations and Teacher Self-Surveys.
Classroom Observations were conducted by observers blind to treatment status who observed the classrooms participating in the study in four different sessions at Spring Baseline and Pre-K Follow-up. This source includes the Classroom Assessment Scoring System (CLASS) scores and the Adapted Teaching Style Rating Scale (Adapted-TSRS) scores.
Teacher Self-Surveys were collected from lead teachers at Spring Baseline and Pre-K Follow-up. This data source includes information on classroom composition as well as teacher demographics, teaching experience, level of stress and depression, and professional relationship with peers and supervisors.
Child-level Impact Analysis Data File
Data included in this file were collected at Fall Baseline, Pre-K Follow-up and K Follow-up from teachers, children and their parents through three sources: Teacher Reports on Individual Children, Direct Child Assessments and Parent Surveys.
Teacher Reports on Individual Children (Teacher Reports) were collected at Fall Baseline, Pre-K Follow-up and K Follow-up. Lead teachers filled out surveys for each child separately, including questions about the child's social skills and behavior, the child's specific knowledge and skills, and the teacher's relationship with the child. Teacher reports were collected for both 4-year-olds and 3-year-olds at Fall Baseline and Pre-K Follow-up, but were not collected for 3-year-olds at K Follow-up. As a cover page to the Teacher Report, a shortened version of the Teacher Self-Survey was collected at K Follow-up and those data are included in this dataset.
Direct Child Assessments were conducted at Fall Baseline and Pre-K Follow-up. The dataset comprises data on a set of tasks measuring different skills for each child separately, including social and emotional skills, self-regulation skills and academic skills. Direct Child Assessments were collected for 4-year- olds only.
Parent Surveys were collected at Fall Baseline and K Follow-up. The survey was administered by phone and includes information on family demographics, parent-teacher involvement, parent's perception of school safety, child's social skills and behavior problems, parental level of stress and depression, and household composition and income. Parent Surveys were collected for 4-year-olds only.
Class-level Implementation Analysis Data File
This data file includes data collected from coaches, trainers and teachers on teacher training, classroom-based coaching, and classroom implementation. The data included in this dataset were collected through five separate instruments: (1) Teacher Training Attendance Forms, (2) Coach Weekly Logs, (3) Coach Monthly Fidelity Logs, (4) Trainer Fidelity Logs, and (5) Teacher's View of the Enhancement. Data collected from the first four data sources were collected multiple times during the implementation year while the fifth was collected once at the beginning of the implementation year. The instruments were administered through the Head Start CARES management information system (MIS) with the exception of the Teacher Training Attendance Forms, which were collected on paper. The file also includes some Teacher Self-Survey variables. Data were collected for program group classrooms only.
Coach-level Implementation Analysis Data File
This data file includes data collected from coaches and trainers on classroom-based coaching. The data included in this dataset were collected through five separate instruments: (1) Teacher Training Attendance Forms, (2) Trainer Supervision Logs, (3) Trainer Logs of Coach Quality, (4) Coach Demographics Survey, and (5) Coach End-of-Year Reflections. The instruments were administered through the Head Start CARES management information system (MIS) with the exception of the Teacher Training Attendance Forms, which were collected on paper.
Audiotape Analysis Data File
The audiotape data file includes data created using qualitative information (audiotape transcripts of coach-teacher meetings) that can be used to conduct analyses on one of the two components of the professional development model for the Head Start CARES demonstration: classroom-based coaching.
Child-level Tracking Data File
The child-level tracking data file includes parent-reported data collected in elementary school for children from the Head Start CARES sample. It includes information from parents about children's location and grade, social skills and problem behaviors at home, and receipt of special services.
Citation View help for Citation
Export Citation:
Funding View help for Funding
Subject Terms View help for Subject Terms
Geographic Coverage View help for Geographic Coverage
Smallest Geographic Unit View help for Smallest Geographic Unit
State
Restrictions View help for Restrictions
This data collection may not be used for any purpose other than statistical reporting and analysis. Use of these data to learn the identity of any person or establishment is prohibited.
Public Use Files: The Head Start CARES documentation is public use and is available for download. Documentation includes the User Guide, Questionnaires and Codebooks.
Restricted Use Files: To protect respondent privacy, the Head Start CARES data are restricted from general dissemination. Access to parts of this study requires a signed User Agreement. To obtain the file(s), researchers must agree to the terms and conditions of the Restricted Data Use Agreement, found via ICPSR's online Restricted Data Contracting System, by clicking the "apply online for access to the data" link above.
Distributor(s) View help for Distributor(s)
Time Period(s) View help for Time Period(s)
Date of Collection View help for Date of Collection
Data Collection Notes View help for Data Collection Notes
-
Data used to estimate the impacts of the Head Start CARES enhancements on teachers, classrooms, and children were collected from multiple sources at four different points in time: (1) in the spring before the preschool year in which the enhancements were implemented (Spring Baseline); (2) at the beginning of the implementation year (Fall Baseline); (3) at the end of the implementation year (Pre-K Follow-up); and (4) in the spring of the kindergarten year, one year after the enhancements were implemented (K Follow-up). Data collected from coaches and trainers submitted through the Head Start CARES management information system (MIS) for monitoring implementation were collected either one time or multiple times throughout the Head Start CARES academic year.
-
Four grantees that participated during the 2009-2010 school year were in Cohort One, and 13 grantees that participated during the 2010-2011 school year were in Cohort Two.
Study Purpose View help for Study Purpose
The Head Start CARES (Classroom-based Approaches and Resources for Emotion and Social skill promotion) demonstration tests three distinct approaches to enhancing children's social-emotional development on a large scale within the Head Start system. The three evidence-based social-emotional interventions selected for the Head Start CARES evaluation included: The Incredible Years Teacher Training Program (IY), Preschool PATHS (PATHS), and a one-year version of Tools of the Mind-Play (Tools).
Study Design View help for Study Design
The Head Start demonstration was conducted over the course of one academic year with 17 Head Start grantees selected to reflect the geographic, racial, and ethnic diversity of the national Head Start population. Grantees were distributed fairly equally across four regions of the country, with four grantees in the Northeast, four in the West, three in the South, and six in the Midwest/Plains states. Also, they were distributed across community action agencies, stand-alone non-profit entities, and large local school systems. Four grantees that participated during the 2009-2010 school year were in Cohort One, and 13 grantees that participated during the 2010-2011 school year were in Cohort Two. Grantees varied on a number of characteristics, including organizational setting, geographic location, urban/rural status, size, and racial or ethnic composition.
Within each grantee, groups of 4 or 8 similar centers (in terms of their racial/ethnic composition, part-day/full-day programming, and age classroom composition) were randomly assigned to one of the three enhancements or to a control group that conducted business as usual. In some cases, all centers within a grantee were similar enough in their characteristics that all centers within grantees could be randomly assigned in a single block. However, for some larger grantees, there were differences among groups of centers in racial/ethnic composition, part-day/full-day programming, and/or age classroom composition. The centers in these grantees were grouped into smaller 4- or 8-center random assignment blocks so that all the centers in each block were comparable across these characteristics. A total of 104 centers across 22 blocks were randomly assigned to one of these four groups. Eighteen blocks included four centers in the study, and four blocks included eight centers. Up to six classrooms and an average of 12 children per classroom were included in the study.
The preschool sample included 307 classrooms and 3,603 children (2,670 four-year-old children and 933 three-year-old children). For the child-level tracking effort, the study attempted to track 3,588 children: all 4-year-olds that were located in kindergarten (2,655) and the 933 3-year-olds in the preschool sample. Of these children, data was collected on 2,875 at least once during the two-year long-term follow-up period (when the children were in grades 1 to 3).
Sample View help for Sample
The preschool sample included 307 classrooms and 3,603 children (2,670 four-year-old children and 933 three-year-old children). The study attempted to follow the 2,670 four-year-old children into kindergarten for further data collection. Of these children, 2,599 were tracked to their kindergarten classrooms.
The sample of classrooms participating in the audiotape study was not intended to be a representative sample of classrooms. Classrooms were selected from the full set of Cohort 2 sites that represented all three curriculum enhancements: Incredible Years (IY), Preschool PATHS (PATHS), or Tools of the Mind--Play (Tools-Play). A total of 21 coach-teacher pairs from 11 Head Start grantees participated in the effort. The audiotape data are restricted to classrooms with audiotaped recordings at all three time periods. Of the 21 coach-teacher pairs that participated in the effort, 18 submitted complete recordings, producing a total of 54 recorded coach-teacher meetings.
Time Method View help for Time Method
Universe View help for Universe
Head Start teachers, students, and parents
Unit(s) of Observation View help for Unit(s) of Observation
Data Type(s) View help for Data Type(s)
Mode of Data Collection View help for Mode of Data Collection
Response Rates View help for Response Rates
Specific response rates for each collection of each instrument can be found in the codebooks for each dataset. In general, base-line and follow-up impact response rates were > 90 percent, coach-level implementation and child-level impact response rates were > 80 percent and class-level implementation response rates were > 60 percent.
Presence of Common Scales View help for Presence of Common Scales
Classroom Assessment Scoring System
Adapted Teaching Style Rating Scale
Woodcock-Johnson III
Expressive One-Word Picture Vocabulary Test
HideOriginal Release Date View help for Original Release Date
2015-03-31
Version History View help for Version History
- Morris, Pamela. Head Start CARES Demonstration: National Evaluation of Three Approaches to Improving Preschoolers' Social and Emotional Competence, 2009-2015. ICPSR35510-v3. Ann Arbor, MI: Inter-university Consortium for Political and Social Research [distributor], 2017-03-06. http://doi.org/10.3886/ICPSR35510.v3
2017-03-06 Added updated data and documentation for Child-level Tracking Data File to include an additional School ID variable.
2017-02-01 Added data and documentation for Child-level Tracking Data File.
2015-07-17 A variable-search function was added to the study home-page, and additional question text was added to the codebooks.
2015-03-31 ICPSR data undergo a confidentiality review and are altered when necessary to limit the risk of disclosure. ICPSR also routinely creates ready-to-go data files along with setups in the major statistical software formats as well as standard codebooks to accompany the data. In addition to these procedures, ICPSR performed the following processing steps for this data collection:
- Performed consistency checks.
- Created variable labels and/or value labels.
- Standardized missing values.
- Created online analysis version with question text.
- Checked for undocumented or out-of-range codes.
Notes
The public-use data files in this collection are available for access by the general public. Access does not require affiliation with an ICPSR member institution.
One or more files in this data collection have special restrictions. Restricted data files are not available for direct download from the website; click on the Restricted Data button to learn more.
This study is maintained and distributed by the Child and Family Data Archive (CFData). CFData hosts datasets about young children, their families and communities, and the programs that serve them. CFData is supported by Office of Planning, Research and Evaluation (OPRE), an office of the Administration for Children and Families (ACF) in the U.S. Department of Health and Human Services.