Project Upgrade in Miami-Dade County, Florida, 2003-2009 (ICPSR 31061)
Version Date: Jun 10, 2011 View help for published
Principal Investigator(s): View help for Principal Investigator(s)
Jean Layzer, Abt Associates
Series:
https://doi.org/10.3886/ICPSR31061.v2
Version V2
Summary View help for Summary
The Evaluation of Child Care Subsidy Strategies is a multi-site, multi-year effort to determine whether and how different child care subsidy policies and procedures and quality improvement efforts help low-income parents obtain and hold onto jobs and improve outcomes for children. Funding from the Child Care and Development Fund (CCDF) administered by the Child Care Bureau are divided into two purposes. The vast majority are aimed at assisting children of low-income working parents whose eligibility is determined by states within broad federal guidelines, while a much smaller portion (4 percent) work with state matching funds to improve the quality of child care for all children. For this studies series, four experiments were conducted, two test alternative subsidy policies for low-income families and two test approaches to the use of set-aside funds for improving child care quality for all children. The four study sites and focus of evaluation include: (1) effectiveness of three language and literacy curricula on teaching practices and children's language and literacy outcomes (Miami-Dade County, Florida); (2) impact of alternative eligibility and re-determination child care subsidy policies on parental employment outcomes (Illinois); (3) impact of alternative child care co-payment structures on use of child care subsidies and employment outcomes (Washington) and (4) effectiveness of training on Learning Games curriculum in changing care-giving practices in family child care homes and children's developmental outcomes (Massachusetts).
A two-year experiment, Project Upgrade tests the effectiveness of three different language and literacy interventions, Ready, Set, Leap! (RSL!), Breakthrough to Literacy (BTL) and Building Early Language and Literacy (BELL) implemented in child care centers in Miami-Dade County, Florida, that served children from low-income families. One hundred and sixty-two centers were randomly assigned to one of three research-based curricula or to a control group that continued with its existing program. The curricula, while grounded in a common set of research findings, differed in intensity, pedagogic strategies, and use of technology. In each center, one classroom that served four-year-old children was selected for the study. Teachers and aides assigned to the three treatment groups received initial and follow-up training as well as ongoing mentoring over a period of approximately 18 months, from Fall 2003 to Spring 2005. The study tested two kinds of outcomes: teacher behavior and interactions with children, and aspects of the classroom environment that support children's language and literacy development, measured through direct observation; and children's language and pre-literacy skills, measured by their performance on a standardized assessment.
To determine whether the interventions that had produced significant outcomes at the end of preschool had any lasting positive effects on early school performance, mathematics and reading follow-up assessments were done in the spring of the 2007/2008 and 2008/2009 school years. Of the 1,535 children assessed in the original Florida Upgrade study, follow-up measurements were taken on 1,137 children (74 percent). Also obtained were follow-up measurements on 127 children who were in the study centers in the original randomized design, but who were not present at the time of the initial child assessments.
Citation View help for Citation
Export Citation:
Funding View help for Funding
Subject Terms View help for Subject Terms
Geographic Coverage View help for Geographic Coverage
Distributor(s) View help for Distributor(s)
Time Period(s) View help for Time Period(s)
Date of Collection View help for Date of Collection
Data Collection Notes View help for Data Collection Notes
-
The study was conducted by Abt Associates Inc, with its research partners MDRC and the National Center for Children in Poverty of Columbia University.
-
Project Director: Ann Collins, Abt Associates Inc.
- Information on the OPRE Evaluation of Child Care Subsidy Strategies is provided on the following Web site.
Study Purpose View help for Study Purpose
Project Upgrade was intended to answer important questions about the possibility of training child care staff, many of whom have limited education beyond high school, to deliver curricula with fidelity, and about the impact of the training and support on teachers' behavior in children's language development and emergent literacy.
The hypotheses that shaped the experiment were that: with adequate training and support, teacher knowledge and attitudes will change; changes in knowledge and attitudes will be reflected, in specific ways, in behavior and interactions with children and in the classroom environment that they create; and changes in behavior and interactions with children, combined with changes in the classroom environment, will result in positive impacts on children's language and emergent literacy skills.
The study's major research questions flowed from these hypotheses and examined two major areas of impact: impacts on teacher behavior and the classroom environment (intermediate outcomes); and impacts on children's language development and early literacy skills. In addition, the study examined the differential effectiveness of the three curricula on all three sets of outcomes, and for teachers and children whose first language was not English. The major questions addressed by the study were:
- Does training in and ongoing support for preschool language/literacy curricula have positive impacts on the type and amount of staff language and literacy interactions with children?
- Does training in and ongoing support for preschool language/literacy curricula have positive impacts on aspects of the classroom environment, other than teacher language and interactions, that foster early literacy?
- Does training in and ongoing support for preschool language/literacy curricula have positive impacts on children's language development and emergent literacy skills?
- Do the interventions have different effects on teacher and child outcomes?
- Do the interventions have differential effects on teachers whose primary language is not English?
- Do the interventions have differential effects on children in classrooms with teachers whose primary language is not English?
- Do the interventions have differential effects on children whose home language is not English?
Study Design View help for Study Design
The experiment required a sample size of 162 centers (four-year-olds classrooms) to be randomly assigned -- 36 to each of the three curricula and 54 to the control group.
Child care centers in Miami-Dade County were eligible to participate in the study if they served some children whose care was subsidized. They could also serve, if they chose to, other children from low-income families. The centers had to have at least one classroom with at least five four-year-olds enrolled at the time of recruitment. They could not be already testing or implementing a literacy curriculum. All children in the selected classrooms were eligible to participate.
The design called for a single classroom to be selected and centers to be grouped by agency affiliation and teacher's dominant language (i.e., the language she preferred to be trained in). For centers with more than one four-year-old classroom serving subsidized children, one classroom was chosen for the experiment. If one classroom had more subsidized children than the other(s), that classroom was selected. If two or more classrooms had the same number of subsidized children, then the one with the most children was chosen. If classrooms were equally large and had the same number of subsidized children, then one classroom was chosen randomly.
The recruitment and eligibility determination processes yielded a total of 300 eligible centers. Ultimately, 165 centers signed agreements to participate and received their assignments. There were no refusals after centers learned their assignments. Over the course of two years, eight centers left the study. Five left because the center was closed or sold to an owner who chose not to participate; only three left because the director decided not to continue with the curriculum to which they were assigned.
Two nationally-known curricula, Ready, Set, Leap! (RSL!) and Breakthrough to Literacy (BTL) and one locally developed curriculum, Building Early Language and Literacy (BELL), were chosen for testing. The three curricula selected differed in instructional approach, breadth of approach, materials provided, intensity and cost, but all three focused on the development of early literacy skills and knowledge. All three included take-home components (books and materials to be used by families with children at home) and tools that teachers could use to assess children's progress in the curriculum. Each curricula provided some materials in Spanish for children with the aim of motivating reading, regardless of the language. All three meet the Florida Preschool Language and Literacy Learning Standards; two of the three, RSL! and BTL, also meet the state standards for a comprehensive curriculum, since they include math and science concepts.
For all three interventions, a single professional development model was agreed upon. The model had two important features: a staffing plan with several layers of supervision, and a training plan that featured three sequenced training sessions over an 18-month period, combined with ongoing mentoring and support over the entire period.
Universe View help for Universe
Four-year-old children in Miami-Dade County child care centers that receive state subsidies for at least some of the children enrolled at the center.
Unit(s) of Observation View help for Unit(s) of Observation
Data Type(s) View help for Data Type(s)
Mode of Data Collection View help for Mode of Data Collection
Description of Variables View help for Description of Variables
The data are provided in five separate data files, or parts, that can be merged to one another using the Center_ID and Student_ID variables.
The Project Upgrade Child-Level file includes Topel outcome variables (raw and standardized) and child demographic variables.
The 2003 Baseline is the first of three classroom-level files. It is a baseline from observations taken in 2003, prior to implementation of training in the treatment programs. It also contains variables indicating the language that teachers preferred to be trained in, and indicators for teacher educational level.
The 2004 Classroom Level and 2005 Classroom-Level files are from observations made in the spring of 2004 and 2005, the end of the first and second year of the program implementation. These files contain experimental design variables (randomization blocks and treatment group indicators) on teacher behavior and classroom environment.
The Follow-up Child-Level file contains mathematics and science assessments from the 2007/2008 and 2008/2009 school years.
Presence of Common Scales View help for Presence of Common Scales
- Observation Measures of Language and Literacy Instruction (OMLIT, Goodson et al., 2004)
- Arnett Caregiver Rating Scale (Arnett, 1989)
- Test of Preschool Emergent Literacy (TOPEL: Lonigan, Wagner, Torgesen, and Rashotte, 2002)
Original Release Date View help for Original Release Date
2011-04-27
Version History View help for Version History
- Layzer, Jean. Project Upgrade in Miami-Dade County, Florida, 2003-2009. ICPSR31061-v2. Ann Arbor, MI: Inter-university Consortium for Political and Social Research [distributor], 2011-06-10. http://doi.org/10.3886/ICPSR31061.v2
2011-06-10 A new version of the Follow-up Child-Level Data has been deposited. This version contains additional variables. The codebook is also being updated to reflect these additions.
2011-05-03 Edits were made to the metadata.
2011-04-27 ICPSR data undergo a confidentiality review and are altered when necessary to limit the risk of disclosure. ICPSR also routinely creates ready-to-go data files along with setups in the major statistical software formats as well as standard codebooks to accompany the data. In addition to these procedures, ICPSR performed the following processing steps for this data collection:
- Created variable labels and/or value labels.
- Created online analysis version with question text.
- Checked for undocumented or out-of-range codes.
Notes
The public-use data files in this collection are available for access by the general public. Access does not require affiliation with an ICPSR member institution.
This study is maintained and distributed by the Child and Family Data Archive (CFData). CFData hosts datasets about young children, their families and communities, and the programs that serve them. CFData is supported by Office of Planning, Research and Evaluation (OPRE), an office of the Administration for Children and Families (ACF) in the U.S. Department of Health and Human Services.