Search results

The 2021-2022 Study of Family and Staff Experiences in AIAN Head Start FACES Programs (2021-2022 Study) builds on the American Indian and Alaska Native Head Start Family and Child Experiences Survey (AIAN FACES), which has been a source of national information on children and families enrolled in Head Start programs operated by federally recognized tribes (known as Region XI AIAN Head Start) since 2015. The motivation and goals of the Study of Family and Staff Experiences in AIAN FACES Programs (the 2021-2022 study) came from a need that arose as the COVID-19 pandemic continued into another year of affecting Region XI Head Start families' and staff's lives--and from recognizing the disproportionate impact of the pandemic on AIAN communities.

The 2021-2022 study included a nonrepresentative sample of Region XI Head Start programs and the children and families they serve. Although a nationally representative sample of Region XI Head Start programs, centers, teachers, and children were selected, fewer of them participated than expected, despite an extension of the planned parental consent collection and data collection windows.

The 2021-2022 Study of Family and Staff Well-Being in Head Start FACES Programs (2021-2022 study), builds on the Head Start Family and Child Experiences Survey (FACES), which has been a source of national information about Head Start programs and participants since 1997. The motivation and goals of the Study of Family and Staff Well-Being in Head Start Family and Child Experiences Survey Programs (the 2021-2022 study) came from a need that arose as the COVID-19 pandemic continued into another year of affecting Head Start families' and staff's lives.

The 2021-2022 study included two components. Firstly, the Program, Staff, and Family Study, was conducted in 60 programs, and included the collection of parent surveys and Teacher Child Reports (TCRs) in fall 2021 and spring 2022, as well as a teacher survey in fall 2021. Secondly, the Program and Staff Study, conducted in the 60 programs participating in the Program, Staff, and Family Study plus an additional 120 programs, included the collection of program director, center director, and teacher surveys in spring 2022.

The 2021-2022 study aimed to describe the national population of Head Start programs, centers, teachers, classrooms, and children during the 2021-2022 program year. However, the Data Producers were unable to fully meet this goal because of challenges related to the COVID-19 pandemic. A nationally representative sample of Head Start programs was selected. However, fewer of the programs participated than expected. Probability samples of centers, teachers, and children within the participating programs were selected. Weights are available for analysis to account for the probability that children and their teachers, centers, and programs were selected for the study. This lessens the risk of bias due to study non-participation and survey nonresponse; and provide results that represent, to the extent possible, all programs, centers, teachers, classrooms, and children in Head Start. The responding sample may not fully represent the population due to higher-than-expected non-response that may not have been adequately addressed with weighting adjustments.

Despite these limitations, the 2021-2022 study sample design supports many analyses for programs and teachers, as well as children. The data from the programs in the Program, Staff, and Family Study can address questions about the children and parents who participate in the program, including about children's development across one year in the Head Start program for both newly entering children and those returning for a second year. The study also supports research questions related to subgroups of interest, such as families with low income and specific racial/ethnic groups, as well as policy issues that emerge during the study. In addition, the research questions investigate the characteristics of Head Start programs, centers, and teachers, and the classrooms they teach. Users can use the same data to answer questions about the relationships between program and classroom characteristics and child and family well-being. The data from the larger sample of programs in the Program and Staff Study are most useful for answering questions about Head Start programs, classrooms, teachers, and program and center directors.

The Head Start Family and Child Experiences Survey (FACES) is a major source of information on Head Start programs and the children and families they serve. Since 1997, FACES has conducted studies in a nationally representative sample of Head Start programs, but has historically not included Region XI (programs operated by federally-recognized tribes), whose programs are designed to serve predominantly American Indian and Alaska Native (AI/AN) children and families. The American Indian and Alaska Native Head Start Family and Child Experiences Survey 2015 (AI/AN FACES 2015), the first national study of Region XI AI/AN Head Start children and families, is designed to fill this information gap.

The design of AI/AN FACES 2015 has been informed by members of the AI/AN FACES 2015 Workgroup which includes tribal Head Start directors, researchers with expertise working with tribal communities, Mathematica Policy Research study staff, and federal officials from the Office of Head Start, Region XI, and the Office of Planning, Research and Evaluation. Building on FACES as the foundation, members of the AI/AN FACES 2015 Workgroup have shared insights and information on the kinds of information needed about children and families served by Region XI AI/AN Head Start programs (including children's development and school readiness, parent and family demographics, health, and program engagement, and teacher, classroom, and program characteristics). Members also provided input on recruitment practices and study methods that are responsive to the unique cultural and self-governing contexts of tribal Head Start programs.

Data collection with Region XI children, families, classrooms, and programs took place in the Fall of 2015 and the Spring of 2016. Twenty-one Region XI Head Start programs participated. Procedures for tribal review and approval in each of those 21 communities were followed. Information about this study has been shared broadly with tribal Head Start programs and tribal leaders via OHS tribal consultations, nationally-broadcast webinars, National Indian Head Start Directors' Association Board of Directors (NIHSDA) annual conferences, the 2016 ACF National Research Conference on Early Childhood, and the Secretary's Tribal Advisory Council (STAC) December 2014 and 2016 meetings.

The Carolina Abecedarian (ABC) Project and the Carolina Approach to Responsive Education (CARE) projects consist of two consecutive longitudinal studies on the effectiveness of early childhood educational intervention for children at high risk for developmental delays and school failure. Combined, the two studies test the hypothesis that child care, home visit, and home school resource interventions can enhance cognitive and academic outcomes for children at risk for school failure due to factors such as poverty, low maternal IQ, or low parental education. These studies provide the only experimental data regarding the efficacy of child care interventions that began during early infancy and lasted until the child entered kindergarten. In addition, the data allow for tests of the efficacy of intervention during the primary grades.

Research hypotheses include:

1. Within this high-risk sample, early cumulative risk will be negatively associated with young adult educational outcomes, employment outcomes, avoidance of teen parenthood, and avoidance of criminal behavior.
2. Early intervention will moderate the effects of risk such that the effects of increased risk would be weaker for those who received the intervention than for those who did not.
3. The early home environment would mediate any found effects for early risk and that early educational intervention would moderate the effects of the early home environment such that the effects of a poor-quality home environment would be weaker for those who received treatment compared to those who did not.

Further information can be found on the Carolina Abecedarian Project Web site.

The Carolina Abecedarian (ABC) Project and the Carolina Approach to Responsive Education (CARE) projects consist of two consecutive longitudinal studies on the effectiveness of early childhood educational intervention for children at high risk for developmental delays and school failure. Combined, the two studies test the hypothesis that child care, home visit, and home school resource interventions can enhance cognitive and academic outcomes for children at risk for school failure due to factors such as poverty, low maternal IQ, or low parental education. These studies provide the only experimental data regarding the efficacy of child care interventions that began during early infancy and lasted until the child entered kindergarten. In addition, the data allow for tests of the efficacy of intervention during the primary grades.

Research hypotheses include:

• Within this high-risk sample, early cumulative risk will be negatively associated with young adult educational outcomes, employment outcomes, avoidance of teen parenthood, and avoidance of criminal behavior.
• Early intervention will moderate the effects of risk such that the effects of increased risk would be weaker for those who received the intervention than for those who did not.
• The early home environment would mediate any found effects for early risk and that early educational intervention would moderate the effects of the early home environment such that the effects of a poor-quality home environment would be weaker for those who received treatment compared to those who did not.

Demographic variables included in this collection: gender, age, level of education.

Early Head Start (EHS) programs are comprehensive, two-generation programs that focus on enhancing children's development while strengthening families. Designed for low-income pregnant women and families with infants and toddlers up to age 3, Early Head Start programs strive to achieve their goals by designing program options based on family and community needs. Programs may offer one or more options to families, including a home-based option, a center-based option, a combination option in which families receive a prescribed number of home visits and center-based experiences, and locally designed options, which in some communities include family child care.

The Early Head Start Research and Evaluation (EHSRE) Study was conducted by Mathematica Policy Research (MPR) and included five major components: (1) an implementation study; (2) an impact evaluation, using an experimental design; (3) local research studies to learn about pathways to desired outcomes; (4) policy studies to respond to information needs in areas of emerging policy-relevant issues; and (5) continuous program improvement. The study involved 3,001 children and families in 17 sites representing diverse program models, racial/ethnic makeup, urban-rural location, program auspice, and program experience in serving infants and toddlers. Three phases comprise the collection: Birth to Three ("0-3"), Pre-Kindergarten ("PreK") Follow-up and the Elementary School ("G5") Follow-up. A brief description of each phase is provided below:

• Birth to Three Phase (1996-2001): included a cross-site national study that encompassed an Impact Evaluation and Implementation Study that investigated program impacts on children and families through their time in the program as well as site-specific research conducted by local research projects.
• Pre-Kindergarten Follow-up Phase (2001-2005) : built upon the earlier research and followed the children and families who were in the original study from the time they left the Early Head Start program until they entered kindergarten. It was designed to document the long-term consequences of receiving either Early Head Start services or other community services up until age 3 combined with subsequent Head Start or other formal early care and education programs on children's school readiness and parent functioning.
• Elementary School Follow-up Phase (2005-2010): assessed children and families when the children were fifth graders or attending their sixth year of formal schooling. The study included direct assessments of children's cognitive, socio-emotional, and physical development; parent interviews; teacher questionnaires; and videotaping of maternal-child interactions.

The Early Head Start findings are based on a mixture of direct child assessments, observations of children's behavior by in-person interviewers, ratings of videotaped parent-child interactions in standardized ways, ratings of children's behaviors by their parents, and parents' self-reports of their own behaviors, attitudes, and circumstances. Data in this collection were constructed by the Mathematica Policy Research (MPR) researchers for use in their analyses. Very few of the original source variables are present in this public-use file. The constructs came from several data sources:

1. Baseline data, which were collected from the Head Start Family Information System (HSFIS) program application and enrollment forms and the MPR Tracking System. These data contain information on the program status of each case, characteristics of the applicant, mother, and focus child from the MPR Tracking System, summary variables pertaining to all family members, and information on the father, on family circumstances, on the mother's pregnancy, and on the focus child.

2. Parent services follow-up interviews (PSI) targeted for 6, 15, and 26 months after random assignment. These data contain information on use of services both in and outside of Early Head Start, progress toward economic self-sufficiency, family health, and children's health.

3. Parent interviews (BPI) targeted for completion when children were 14, 24, and 36 months old. These interviews obtained a large amount of information from the primary caregivers about their child's development and family functioning. Specific questions asked of parents in the parent interview included items about raising a baby, child's health, household composition, child care, mother figure, father figure, family routines, parents' and parent-child activities, child behavior, and stressful events.

4. Child and family assessments targeted for administration when children were 14, 24, and 36 months old. Field interviewers recorded information from their observations of children's behavior and home environments. Direct child assessments included Bayley Assessments, Peabody Picture Vocabulary Tests (PPVTs), and videotaped semi-structured parent-child interactions.

5. Child care provider interviews and observations targeted for administration when children were 14, 24, and 36 months old. Interview and observation data were collected from child care providers for children who were in child care arrangements that met particular criteria when they were approximately 14, 24 and 36 months old. Different data collection instruments were used for children in child care centers and children cared for by family child care providers or relatives. Data from both types of providers may be used together for some types of analyses.

6. Father interviews targeted for collection when children were 24 and 36 months old. In addition to asking mothers about their child's father, biological fathers and father figures in 12 sites were interviewed directly about fathering issues at the time of the 24- and 36-month birthday-related interviews (but not when children were 14 months old).

The Individuals with Disabilities Education Act authorizes states to create early intervention (EI) programming to provide developmental and therapeutic services to infants and toddlers with a developmental condition; EI programs are mandated to report on child and family outcomes for purposes of accountability and quality improvement. For both purposes, there is critical need for research evidence on the adequacy of EI services. The researchers for this study partnered with a large urban EI program in Colorado that had recently transitioned to electronic data capture and was implementing a statewide initiative to facilitate function-focused care with individual families and paired collected electronic patient-reported outcomes (e-PRO) data with EI administrative data on child and family characteristics and service use to more fully examine EI service adequacy relative to patient-important outcomes.

This study collected information from Young Children's Participation and Environment Measure (YC-PEM e-PRO) on home, environment, and community participation, involvement, and desired change. Measurements were also collected from the Pediatric Evaluation of Disability Inventory Computer Adaptive Test (PEDI-CAT e-PRO) on mobility, social cognitive, and daily activities domains. The Child Outcomes Summary (COS) was used to capture functional performance related to having positive social relationships, acquiring and using knowledge and skills, and taking appropriate action to meet needs. Early Intervention Service Use measured EI intensity, whether child received specific services including physical therapy (PT), occupational therapy (OT), speech therapy (ST), psychology, or developmental intervention (DI), and the total number of service hours received within each discipline. Demographic variables include reasons child received EI services, number of developmental delay conditions, age, race, and ethnicity; as well as caregiver's education, employment, number of children at home, income, and insurance type.

The Head Start Family and Child Experiences Survey (FACES) has been a source of information on the Head Start program and the children and families it serves. The 2019 Head Start Family and Child Experiences Survey, or FACES 2019, is the seventh in a series of national studies of Head Start, with earlier studies conducted in 1997, 2000, 2003, 2006, 2009, and 2014. It includes nationally representative samples of Head Start programs and centers, classrooms, and children and their families during the 2019-2020 program year. Data from surveys of Head Start program and center directors and classroom teachers provide descriptive information about program policies and practices, classroom activities, and the background of Head Start staff. These data compromise the Classroom Study. A sample of these programs also provides data from parent surveys, teacher child reports, and direct child assessments as part of the Classroom + Child Outcomes Study. FACES 2019 is designed to help policymakers address current policy questions and to support programs and practitioners working with Head Start families.

According to the study design, FACES would have assessed children's readiness for school, surveyed parents, and asked teachers to provide information on children in both fall 2019 and spring 2020. In response to the COVID-19 (for coronavirus disease 2019) pandemic, however, FACES 2019 cancelled the first piece--the in-person data collection of child assessments in spring 2020. In-person classroom observations as part of the Classroom Study were also cancelled in spring 2020.

FACES is designed so that researchers can answer a wide range of research questions that are crucial for aiding program directors and policymakers. FACES 2019 data may be used to describe (1) the quality and characteristics of Head Start programs, teachers, and classrooms; (2) the changes or trends in the quality and characteristics of the classrooms, programs, and staff over time; (3) the school readiness skills and family characteristics of the children who participate in Head Start; (4) the factors or characteristics that predict differences in classroom quality; (5) the changes or trends in the children's outcomes and family characteristics over time; and (6) the factors or characteristics at multiple levels that predict differences in the children's outcomes. The study also supports research questions related to subgroups of interest, such as children with identified disabilities and children who are dual-language learners (DLLs), as well as policy issues that emerge during the study. The study addresses changes in children's outcomes and experiences as well as changes in the characteristics of Head Start classrooms over time and across the rounds of FACES. Some of the questions that are central to FACES include:

1. What are the characteristics of Head Start programs, including structural characteristics and program policies and practices?
2. What are the characteristics and observed quality of Head Start classrooms?
3. What are the characteristics and qualifications of Head Start teachers and management staff?
4. Are the characteristics of programs, classrooms, and staff changing over time?
5. What are the demographic characteristics and home environments of children and families who participate in Head Start?
6. Are family demographic characteristics and aspects of home environments changing over time?
7. How do families make early care and education decisions?
8. What are the experiences of families and children in Head Start?
9. What are the average school readiness skills and developmental outcomes of the population of Head Start children in fall and spring of the Head Start year?
10. What gains do children make during a year of Head Start?
11. Are children's school readiness skills (average skills or average gains in skills) improving over time?
12. Does classroom quality vary by characteristics of classrooms, teachers, or programs?
13. What characteristics of programs, teachers, or classrooms are associated with aspects of classroom quality?
14. Do the school readiness skills of children in fall and spring and their gains in skills vary by child, family, program, and classroom characteristics?
15. What is the association between observed classroom quality and children's school readiness skills? Between child and family characteristics and children's school readiness skills?

The User Guide provides detailed information about the FACES 2019 study design, execution, and data to inform and assist researchers who may be interested in using the data for future analyses. The following items are provided in the User Guide as appendices.

• Appendix A. Elements of the FACES Design and Key Instruments Used (and Child Outcomes Captured): FACES 1997-FACES 2019
• Appendix B. Copyright Permissions
• Appendix C. Instrument Content Matrices
• Appendix D. Instruments
• Appendix E. Spring 2020 Center/Program Codebook
• Appendix F. Spring 2020 Classroom/Teacher Codebook
• Appendix G. Fall 2019-Spring 2020 Child Codebook
• Appendix H. Descriptions of Composite Variables

The Head Start Family and Child Experiences Survey (FACES) is an ongoing national longitudinal study of the cognitive, social, emotional, and physical development of Head Start children. It examines the characteristics, well-being, and accomplishments of families, the observed quality of Head Start classrooms, and the characteristics and opinions of Head Start teachers and other program staff. FACES was designed to address four central questions related to program performance objectives:

1. Does Head Start enhance children's development and school readiness?
2. Does Head Start strengthen families as the primary nurturers of their children?
3. Does Head Start provide children with high quality educational, health, and nutritional services?
4. How is classroom quality related to child outcomes?

The FACES 1997 Cohort involved a nationally representative sample of children and families in Head Start programs in the United States who were studied at entry into the program in the fall of 1997, assessed in the spring at the completion of one or two years of Head Start, and followed up in the spring of the kindergarten and first grade years. During these visits, the research team completed individual interviews with staff and parents, child and classroom observations, direct child assessments through one-on-one interviews, and indirect assessments of children by their teachers and parents.

The data collection instruments used in FACES were designed to measure several different types of skills, accomplishments, and behaviors that are relevant to a child's school readiness and social competence:

1. The parent interview was designed to collect up-to-date information about current Head Start families while being sensitive to differences based on the background of the respondents. The interview provided descriptive information about the parents (education, work status, health, nativity, depression, social support, use of discipline and rules, exposure to violence), the household (income, housing, activities with children, use of child care), and the children (gender, ethnicity, health, behavior, literacy skills, disabilities, exposure to violence). Additionally, parents reported how their families came to Head Start and how they perceived their Head Start experiences.
2. The staff interview was designed to provide a profile of the background, qualifications, and training of Head start personnel as well as an understanding of classroom activities, family activities, services, local programs offered to families, and staff perspectives on their programs and the families they served.
3. The child and classroom observations were designed to record information from the observations of children's behavior and home environments. Some of the assessments used included Peabody Picture Vocabulary Tests (PPVTs), Woodcock-Johnson Revised Tests of Achievement, Norm Referenced Cognitive Tests, Story and Print Concepts, and McCarthy Scales of Children's Abilities.

The Head Start Family and Child Experiences Survey (FACES) is an ongoing national longitudinal study of the cognitive, social, emotional, and physical development of Head Start children. It examines the characteristics, well-being, and accomplishments of families, the observed quality of Head Start classrooms, and the characteristics and opinions of Head Start teachers and other program staff. FACES was designed to address four central questions related to program performance objectives:

1. Does Head Start enhance children's development and school readiness?
2. Does Head Start strengthen families as the primary nurturers of their children?
3. Does head Start provide children with high quality educational, health, and nutritional services?
4. How is classroom quality related to child outcomes?

The FACES 2000 Cohort involved a nationally representative sample of children and families in Head Start programs in the United States who were studied at entry into the program in the fall of 2000, assessed at the completion of one or two years of program experience, and followed up in the spring of the kindergarten year. The FACES 2000-2003 battery has four main components: the child assessment, parent interview, teacher and staff interviews, and classroom observations.

1. The child assessments included the major components of school readiness, and were collected through direct child assessments and rating scales completed by parents and teachers. Direct child assessments included the Peabody Picture Vocabulary Test Third Edition-Revised (PPVT-III), Woodcock-Johnson Psycho-Educational Battery-Revised, McCarthy Scales of Children's Abilities, story and print concepts, social awareness, color names and one-to-one counting, Leiter International Performance Scale-Revised, interview ratings, and follow-up Early Childhood Longitudinal Study-Kindergarten (ECLS-K) measures.

2. The parent interview was designed to provide Head Start with a comprehensive understanding of the families that they serve, including the characteristics of households and household members, levels and types of participation in the program and in other community services, involvement with their children, and an understanding of their children's development. In addition to this, parents were asked to rate each child on a set of behaviors that assessed the child's basic social skills and behavior problems.

3. The teacher and staff interview was designed to provide information on Head Start personnel experience, education, and training as well as knowledge and beliefs about child development, and educational activities with children and parents.

4. The classroom observations were designed to measure peer interactions, friendships of children, and the extent to which Head Start programs employed skilled teachers and provided developmentally appropriate environments and curricula for their children. Some of the assessments used included the Assessment Profile, Early Childhood Environment Rating Scale-Revised (ECERS-R), classroom observation of teacher-directed activities, and the Arnett Caregiver Interaction Scale.

The Head Start Family and Child Experiences Survey (FACES) is an ongoing national longitudinal study of the cognitive, social, emotional, and physical development of Head Start children. It examines the characteristics, well-being, and accomplishments of families, the observed quality of Head Start classrooms, and the characteristics and opinions of Head Start teachers and other program staff. FACES was designed to address four central questions related to program performance objectives:

1. Does Head Start enhance children's development and school readiness?
2. Does Head Start strengthen families as the primary nurturers of their children?
3. Does head Start provide children with high quality educational, health, and nutritional services?
4. How is classroom quality related to child outcomes?

The FACES 2003 Cohort involved a nationally representative sample of children and families in Head Start programs in the United States who were studied at entry into the program in the fall of 2003, assessed at the completion of their program experience, and followed up at the end of their kindergarten year. The FACES 2003 battery has five main components: the child assessment, parent interview, teacher and staff interviews, classroom observations and teacher-child reports.

1. The child assessments included the major components of school readiness, and were collected through direct child assessments and rating scales completed by parents and teachers. Some of the direct child assessments included the Peabody Picture Vocabulary Test Third Edition-Revised (PPVT-III), Woodcock-Johnson Psycho-Educational Battery-Revised, McCarthy Scales of Children's Abilities, story and print concepts, social awareness, color names and one-to-one counting and assessor ratings.

2. The parent interview was designed to provide Head Start with a comprehensive understanding of the families that they serve, including the characteristics of households and household members, levels and types of participation in the program and in other community services, involvement with their children, and an understanding of their children's development. In addition to this, parents were asked to rate each child on a set of behaviors that assessed the child's basic social skills and behavior problems.

3. The teacher and staff interview was designed to provide information on Head Start personnel experience, education, and training as well as knowledge and beliefs about child development, and educational activities with children and parents.

4. The classroom observations were designed to measure peer interactions, friendships of children, and the extent to which Head Start programs employed skilled teachers and provided developmentally appropriate environments and curricula for their children. Some of the assessments used included the Assessment Profile, Early Childhood Environment Rating Scale-Revised (ECERS-R), classroom observation of teacher-directed activities, and the Arnett Caregiver Interaction Scale.

5. The teacher-child report was designed to capture important sources of information about children's learning and behavior through the use of the Teacher-Child Report (TCR), social skills ratings, the Behavior Problems scale and the Preschool Learning Behavior Scale (PLBS).

The Head Start Family and Child Experiences Survey (FACES) is a periodic, ongoing longitudinal study of program performance. Successive nationally representative samples of Head Start children, their families, classrooms, and programs provide descriptive information on the population of children and families served; staff qualifications, credentials, and opinions; Head Start classroom practices and quality measures; and child and family outcomes. FACES includes a battery of child assessments across multiple developmental domains (cognitive, social, emotional, and physical).

For nearly a decade, the Office of Head Start, the Administration for Children and Families, other federal agencies, local programs, and the public have depended on FACES for valid and reliable national information on (1) the skills and abilities of Head Start children, (2) how Head Start children's skills and abilities compare with preschool children nationally, (3) Head Start children's readiness for and subsequent performance in kindergarten, and (4) the characteristics of the children's home and classroom environments. The FACES study is designed to enable researchers to answer a wide range of research questions that are crucial for aiding program managers and policymakers. Some of the questions that are central to FACES include:

1. What are the demographic characteristics of the population of children and families served by Head Start? How has the population served by Head Start changed?
2. What are the experiences of families and children in the Head Start program? How have they changed?
3. What are the cognitive and social skills of Head Start children at the beginning and end of their first year in the program? Has Head Start program performance improved over time?
4. Do the gains in cognitive and social skills that Head Start children achieve carry over into kindergarten? Do larger gains (or greater declines in problem behavior) translate into higher achievement at the end of kindergarten?
5. What are the qualifications of Head Start teachers in terms of education, experience, and credentials? Are average teacher education levels rising in Head Start?
6. What is the observed quality of Head Start classrooms as early learning environments, including the level and range of teaching and interactions, provisions for learning, emotional and instructional support, and classroom organization? How has quality changed over time? What program- and classroom-level factors are related to observed classroom quality? How is observed quality related to children's outcomes and developmental gains?

FACES also supports analyses of subgroups of interest, such as children with disabilities, dual language learners, and children who are performing above or below average on standardized assessments. Its design changes in response to emerging policy and research questions. For example, in response to the growing concern about childhood obesity, measures of children's height and weight were introduced in FACES 2006.

Measures for FACES 2006 were selected to balance the need to support comparisons to previous cohorts of FACES (particularly with respect to program performance measures) against the need to update the measurement battery and address emerging policy issues and benefits from progress in the assessment field. Many of the measures used in FACES 2006 were included in previous cohorts and they are presented below by the five major measurement sources in FACES: (1) child direct assessments; (2) parent interviews; (3) teacher interviews and survey; (4) classroom observations; and (5) program director, center director, and education coordinator interviews.

1. The child direct assessments included the major components of school readiness. They included a language screener, the Peabody Picture Vocabulary Test, Fourth Edition/Test de Vocabulario de Imagines Peabody, subtests from the Woodcock-Johnson Tests of Achievement Third Edition/Bateria III Woodcock-Munoz (letter word identification, applied problems, spelling, and word attack), a measure of early math literacy based on items from the Early Childhood Longitudinal Study, Birth and Kindergarten Cohorts math assessments (geometry, patterns, and measurement), story and print concepts, and physical measurements (height and weight). At the end of the direct child assessment, interviewers rate the child's attention, organization/impulse control, activity level, and sociability using items from the Leiter-R scales.
2. The parent interview was designed to provide Head Start with a comprehensive understanding of the families that they serve, including the demographic characteristics of households and household members, parent-child relationships and the quality of the child's home life, and parent ratings of the child's behavior problems, social skills, and competencies, levels and types of participation in the program and in other community services.
3. The Head Start teacher interview was designed to collect information about classroom and teacher characteristics related to the quality of care provided by Head Start programs. Teachers were asked about their classroom activities and use of curricula, as well as their demographic and educational background and professional experience. They also used a Web survey to rate the social skills, problem behaviors, and competencies of each FACES child in their classroom. Kindergarten teachers provided information about schools attended by Head Start children, their classrooms and school experiences using a Web survey. They also completed ratings of each FACES child's social skills, behavior problems and competencies.
4. The classroom observations were designed to measure peer interactions and the extent to which Head Start programs employed skilled teachers and provided developmentally appropriate environments and curricula for their children. The measures used included the Early Childhood Environment Rating Scale-Revised (ECERS-R), the Arnett Scale of Lead Teacher Behavior, and the Instructional Support scale from the Classroom Assessment Scoring System (CLASS). Counts of children and adults were also taken to calculate group size and child-adult ratios.
5. The Program Director, Center Director, and Education Coordinator Interviews gathered information about staffing and recruitment, teacher education initiatives and training, waiting lists and program expansion, classroom activities, curriculum, overview of program management, and parent involvement.

The User Guide provides detailed information about the FACES 2006 study design, execution, and data to inform and assist researchers who may be interested in using the data for future analyses. The following items are provided in the User Guide as appendices.

• Appendix A -- Copyright Statements
• Appendix B -- Instrument Content Matrices
• Appendix C -- Questionnaires
• Appendix D -- Center/Program Codebook
• Appendix E -- Classroom/Teacher Codebook
• Appendix F -- Child Codebook
• Appendix G -- Description of Constructed/Derived Variables

The Head Start Family and Child Experiences Survey (FACES) is a periodic, ongoing longitudinal study of program performance. Successive nationally representative samples of Head Start children, their families, classrooms, and programs provide descriptive information on the population of children and families served; staff qualifications, credentials, and opinions; Head Start classroom practices and quality measures; and child and family outcomes. FACES includes a battery of child assessments across multiple developmental domains (cognitive, social, emotional, and physical). FACES 2009 is the latest FACES cohort study and followed children from Head Start entry in fall 2009 through one or two years of program participation and to kindergarten.

For nearly a decade, the Office of Head Start, the Administration for Children and Families, other federal agencies, local programs, and the public have depended on FACES for valid and reliable national information on (1) the skills and abilities of Head Start children, (2) how Head Start children's skills and abilities compare with preschool children nationally, (3) Head Start children's readiness for and subsequent performance in kindergarten, and (4) the characteristics of the children's home and classroom environments. The FACES study is designed to enable researchers to answer a wide range of research questions that are crucial for aiding program managers and policymakers. Some of the questions that are central to FACES include:

1. What are the demographic characteristics of the population of children and families served by Head Start? How has the population served by Head Start changed?
2. What are the experiences of families and children in the Head Start program? How have they changed?
3. What are the cognitive and social skills of Head Start children at the beginning and end of their first year in the program? Has Head Start program performance improved over time?
4. Do the gains in cognitive and social skills that Head Start children achieve carry over into kindergarten? Do larger gains (or greater declines in problem behavior) translate into higher achievement at the end of kindergarten?
5. What are the qualifications of Head Start teachers in terms of education, experience, and credentials? Are average teacher education levels rising in Head Start?
6. What is the observed quality of Head Start classrooms as early learning environments, including the level and range of teaching and interactions, provisions for learning, emotional and instructional support, and classroom organization? How has quality changed over time? What program- and classroom-level factors are related to observed classroom quality? How is observed quality related to children's outcomes and developmental gains?

In response to recent trends and mandates, FACES 2009 expanded the information collected on families and children who speak a primary language other than English and the information collected on children who are homeless. Earlier cohorts of FACES gathered information on the languages spoken in the home and used for classroom instruction. Given the growth in the population of Hispanic/Latino preschoolers (Hernandez 2006), FACES 2009 placed additional emphasis on Dual Language Learners (DLLs). In addition, given the 2007 Head Start Act's focus on children and families who are homeless, FACES 2009 expanded coverage on the enrollment of such children, how the program ensures that they enroll in Head Start, and the special services available to such children and their families.

FACES 2009 carefully balanced the need for consistent measurement of outcomes against the need for improvements in instrumentation and techniques. In some instances, new instruments were added to obtain more comprehensive information on Head Start children. For example, the Expressive One-Word Picture Vocabulary Test was added to assess children's expressive language, which is related to later reading achievement even more so than receptive language (National Early Literacy Panel 2008). A measure of phonemic awareness from the Early Childhood Longitudinal Study-Birth Cohort (ECLS-B) preschool wave was also added to assess children's knowledge of beginning and ending sounds in words. Further, FACES 2009 included a direct assessment of executive functioning-a pencil tapping task to examine children's inhibitory control, working memory, and attention-which has been shown to relate to young children's development in mathematics, vocabulary, and literacy (Blair and Razza 2007; Espy et al. 2004; McClelland et al. 2007).

The User Guide provides detailed information about the FACES 2009 study design, execution, and data to inform and assist researchers who may be interested in using the data for future analyses. The following items are provided in the User Guide as appendices.

• Appendix A - Copyright statements
• Appendix B - Instrument Content Matrices
• Appendix C - Questionnaires
• Appendix D - Center/Program Codebook
• Appendix E - Classroom/Teacher Codebook
• Appendix F - Child Codebook
• Appendix G - Description of Constructed/Derived Variables

The 2014 Head Start Family and Child Experiences Survey, or FACES 2014, is the sixth in a series of national studies of Head Start, with earlier studies conducted in 1997, 2000, 2003, 2006, and 2009. FACES 2014 used a new study design that differs from earlier rounds of FACES in several important ways: (1) it included larger program and classroom samples, (2) all data were collected in a single program year, (3) the baseline sample of children included both children enrolled in their first and second year of Head Start, and (4) several special studies were conducted along with the main (Classroom + Child Outcomes Core and Classroom Core) study to collect more detailed information about a given topic, to study new populations of Head Start programs and participants, and to evaluate measures for possible use in future rounds of FACES. For example, the Family Engagement Plus study collected information from parents and staff (teachers and family services staff) on family engagement efforts and service provision in Head Start programs.

The FACES 2014 Family Engagement Plus study took place in spring 2015 within the 60 programs that participated in the child-level data collection in the Classroom + Child Outcomes Core study. This Plus study describes family engagement practices in Head Start from the perspectives of parents and Head Start staff. It examines how practices align with the Head Start Parent, Family, and Community Engagement (PFCE) Framework and targeted family outcomes. It also explores how programs engage with community partners to provide comprehensive services to families and how parents and staff characterize their relationships with one another. It includes semi-structured interviews with parents and family services staff (FSS) as well as supplemental content added to the Core parent and teacher surveys. This release includes open-ended qualitative data from the semi-structured interviews included in the Family Engagement Plus study.

The primary research questions for the Family Engagement Plus study are as follows:

1. What do family engagement efforts look like in Head Start?
2. How are families engaged in Head Start and in their children's learning and development at home and in the community?
3. What staff are involved in family engagement efforts, and in what ways are they involved in those efforts?
4. How are comprehensive family services provided in Head Start?
5. How do parents and staff characterize their relationships and interactions with one another?
6. How do family engagement efforts and service provisions align with the Head Start Parent, Family, and Community Engagement (PFCE) Framework?

The User's Manual provides detailed information about the Family Engagement Plus study design, execution, and data to inform and assist researchers who may be interested in using the data for future analyses or pairing the Family Engagement qualitative data collection sources with other FACES 2014 sources.

The 2014 Head Start Family and Child Experiences Survey, or FACES 2014, is the sixth in a series of national studies of Head Start, with earlier studies conducted in 1997, 2000, 2003, 2006, and 2009. This release includes nationally representative samples of Head Start programs and centers, classrooms, children and their families through spring of 2017. Data from surveys of Head Start program and center directors, classroom teachers, and parents provided descriptive information about program policies and practices, classroom activities, and the background and experiences of Head Start staff and families. Classroom observations were used to assess the quality of Head Start classrooms. Children in the study participated in a direct assessment that provided a picture of their school readiness skills at different time points.

FACES 2014 used a new study design that differs from earlier rounds of FACES in several important ways: (1) it included larger program and classroom samples, (2) all data were collected in a single program year, (3) the baseline sample of children included both children enrolled in their first and second year of Head Start, and (4) several special studies were conducted along with the main (Core) study to collect more detailed information about a given topic, to study new populations of Head Start programs and participants, and to evaluate measures for possible use in future rounds of FACES. For example, the Family Engagement Plus study collected information from parents and staff (teachers and family services staff) on family engagement efforts and service provision in Head Start programs.

The Office of Head Start, the Administration for Children and Families, other federal agencies, local programs, and the public have depended on FACES for valid and reliable national information on (1) the skills and abilities of Head Start children, (2) how Head Start children's skills and abilities compare with preschool children nationally, (3) Head Start children's readiness for and subsequent performance in kindergarten, and (4) the characteristics of the children's home and classroom environments. The FACES study was designed to enable researchers to answer a wide range of research questions that are crucial for aiding program managers and policymakers. Some of the questions that are central to FACES include:

1. What are the demographic characteristics of the population of children and families served by Head Start? How has the population served by Head Start changed?
2. What are the experiences of families and children in the Head Start program? How have they changed?
3. What are the cognitive and social skills of Head Start children at the beginning and end of the program year? Has Head Start program performance improved over time?
4. What are the qualifications of Head Start teachers in terms of education, experience, and credentials? Are average teacher education levels rising in Head Start?
5. What is the observed quality of Head Start classrooms as early learning environments, including the level and range of teaching and interactions, provisions for learning, emotional and instructional support, and classroom organization? How has quality changed over time?
6. What program- and classroom-level factors are related to observed classroom quality?
7. How is observed quality related to children's outcomes and developmental gains?

The User Guide provides detailed information about the FACES 2014 study design, execution, and data to inform and assist researchers who may be interested in using the data for future analyses. The following items are provided in the User Guide as appendices.

• Appendix A - Elements Of The FACES Design And Key Measures Used (And Child Outcomes Captured): FACES 1997 - FACES 2014
• Appendix B - Copyright Permissions
• Appendix C - Instrument Content Matrices
• Appendix D - Instruments
• Appendix E - Spring 2015 Center/Program Codebook
• Appendix F - Spring 2015 Classroom/Teacher Codebook
• Appendix G - 2014-2015 Child Codebook
• Appendix H - Spring 2015 Family Engagement Family Service Staff Interview Codebook
• Appendix I - Spring 2015 Family Engagement Parent Interview Codebook
• Appendix J - Spring 2017 Center/Program Codebook
• Appendix K - Spring 2017 Classroom/Teacher Codebook
• Appendix L - Descriptions of Constructed/Derived Variables
• Appendix M - Synthetic Estimation for Child Growth Across Two Years

In 2010, the United States Congress authorized the Maternal, Infant, and Early Childhood Home Visiting (MIECHV) program, which started a major expansion of evidence-based home visiting programs for families living in at-risk communities. MIECHV is administered by the Health Resources and Services Administration (HRSA) in collaboration with the Administration for Children and Families (ACF) within the U.S. Department of Health and Human Services (HHS). The authorizing legislation required an evaluation of the program, which became the Mother and Infant Home Visiting Program Evaluation (MIHOPE). The evaluation is being conducted for HHS by MDRC with James Bell Associates, Johns Hopkins University, Mathematica, the University of Georgia, and Columbia University.

MIHOPE was designed to learn whether families benefit from MIECHV-funded early childhood home visiting programs, and if so, how. The study included the four evidence-based models that 10 or more states chose in their initial MIECHV plans in fiscal year 2010-2011: Early Head Start - Home-based option, Healthy Families America, Nurse-Family Partnership, and Parents as Teachers. MIHOPE was the first study to include all of these four evidence-based models.

To provide rigorous evidence on the MIECHV-funded programs' effects, the study randomly assigned more than 4,200 families to receive either MIECHV-funded home visiting or information on community services. As is the standard method in studies that use random assignment, the primary analytical strategy in MIHOPE was to compare the outcomes of the entire program group with those of the entire control group.

As per the authorizing legislation, the study measured early effects on family and child outcomes in the areas listed below, with the exception of school readiness and academic achievement (which were not included at this point because children were too young to measure those outcomes):

• Prenatal, maternal, and newborn health
• Child health and development, including child maltreatment
• Parenting skills
• School readiness and child academic achievement
• Crime and domestic violence
• Family economic self-sufficiency
• Referrals and service coordination

Videos and Video Metadata: Two sets of videos are included in the MIHOPE restricted access files. They include:

• Mother-home visitor interactions at 387 home visits and
• Interactions between child and mother using the "Three Bags" and "Clean-Up" tasks with 2,832 families.

The mother-home visitor interaction videos were recorded only for treatment group families at two points in time: the first was, on average, about eight weeks after the family's first home visit and the second was about eight months after the family's first home visit. Overall, 264 families are included in the mother-home visitor interaction videos in total, with 123 of these families recorded at both points in time.

The mother-child interaction videos, during which the child and mother play with toys contained in three bags and place the toys back in the bags (the "Three Bags" and "Clean-Up" tasks), were recorded when the 15-month in-home assessments were conducted and are available for 2,832 families in the treatment and control groups.

The videos are only linkable to a few pieces of metadata (home visiting model, video ID, treatment status, and variables indicating whether the family appears in the home visit videos, the three-bag task videos, or both). The videos in the restricted access data are not linkable to any other data included in the restricted access files. Additionally, the videos may only be viewed at the Inter-university Consortium for Political and Social Research's on-site Physical Data Enclave in Ann Arbor, Michigan.

Mother and Infant Home Visiting Program Evaluation-Strong Start (MIHOPE-Strong Start) was a large-scale evaluation that rigorously tested the effectiveness of evidence-based home visiting in improving birth and health outcomes during pregnancy and in the year after birth. Local programs included in the study's analysis implemented one of two evidence-based models: Healthy Families America (HFA) or Nurse-Family Partnership (NFP). These models were chosen because earlier evaluations found some evidence of their having positive impacts on birth outcomes.

The Office of Planning, Research, and Evaluation (OPRE) of the Administration for Children and Families (ACF) partnered with the Center for Medicare and Medicaid Innovation (CMMI) of the Centers for Medicare and Medicaid Services (CMS) and the Maternal and Child Health Bureau (MCHB) of the Health Resources and Services Administration (HRSA) to sponsor the study. MIHOPE-Strong Start was part of the CMMI's Strong Start for Mothers and Newborns Initiative, which evaluated whether enhanced, nonmedical prenatal interventions, when provided in addition to routine medical care, have the potential to improve birth outcomes and reduce health care costs for women enrolled in Medicaid or the Children's Health Insurance Program (CHIP). Under contract with OPRE, MDRC conducted MIHOPE-Strong Start in collaboration with James Bell Associates, Johns Hopkins University, Mathematica, and New York University.

The analysis for MIHOPE-Strong Start included 2,899 women and 66 local programs (37 HFA and 29 NFP programs) operating across 17 states: California, Georgia, Illinois, Indiana, Iowa, Kansas, Massachusetts, Michigan, Nevada, New Jersey, New York, North Carolina, Pennsylvania, South Carolina, Tennessee, Washington, and Wisconsin. Women were eligible for MIHOPE-Strong Start if they were pregnant and at least 8 weeks from their due date.

The MIHOPE-Strong Start analysis included a subset of families and local programs that were recruited for MIHOPE, the national evaluation of the Maternal, Infant, and Early Childhood Home Visiting (MIECHV) program. Specifically, the MIHOPE-Strong Start impact analysis included information on 46 local home visiting programs and 1,845 families that were initially recruited for MIHOPE but met the MIHOPE-Strong Start eligibility criteria. An important distinction between MIHOPE-Strong Start and MIHOPE is that MIHOPE included only programs receiving MIECHV funding, while MIHOPE-Strong Start included both MIECHV and non-MIECHV-funded programs.

In both studies, families were randomly assigned either to an evidence-based home visiting program or to a control group who was given information on other services available in the community. The random assignment design was intended to create program and control groups that were similar when women entered the study, so that systematic differences in the outcomes of interest observed between the two groups can be attributed to the home visiting services rather than to the preexisting characteristics of the women.