The Categorical Ceiling Tax: Interpreting Intervention Outcomes in Educational Research (ICPSR 309013)
Abstract
This position paper formalizes the concept of the Categorical Ceiling Tax (CCT), an interpretive limitation observed in intervention studies that employ quantitative scoring rubrics to classify proficiency levels. The CCT describes a form of structural resistance that occurs when a population mean approaches, but does not cross, a predefined categorical threshold, even when measurable quantitative gains are documented. Using pre–post score data from a one-group design involving the total population of N = 494 Grade 7 students, this paper illustrates how categorical reporting obscured a documented positive mean shift (Δx̅ = +0.20), while the population classification remained at the “Instructional” level. This paper argues that categorical transitions, when interpreted independently, may misrepresent population-level progress in large samples. It further proposes that changes in the deficiency floor—defined as the proportion of learners classified at the Frustration level—be reported as a complementary interpretive indicator alongside categorical outcomes. These observations provide applied insights into the interpretation of outcomes generated through technology-supported assessment and reporting systems commonly used in contemporary educational settings.
Author Biography
Mhel Cedric D. Bendo, College of Business Administration, Polytechnic University of the Philippines, Cavite, Philippines
Mhel Cedric D. Bendo is a student researcher specializing in educational psychology, curriculum and instruction, educational measurement and evaluation, psychometrics, and educational technology. He is pursuing a Bachelor of Science in Entrepreneurship at the Polytechnic University of the Philippines. As of 2026, he holds an honorary appointment as an International Editorial Board Member for SIAR Publications, contributing to peer review, editorial guidance, and interdisciplinary journal development. He also serves as an invited peer reviewer for international peer-reviewed journals in online and distance learning, educational technology, educational evaluation, information literacy, interdisciplinary undergraduate research, and health and science education, including journals indexed in Web of Science (ESCI), Scopus (Q1–Q3, SCImago), ERIC, and DOAJ, supporting rigorous and ethically grounded interdisciplinary scholarship.
AI-Supported Inquiry, AI Literacy, and Authentic Performance Among Preservice Teachers in Central China, 2024 (ICPSR 306435)
This study examined the effects of QUEST+AI, an AI-supported inquiry model, on AI literacy and authentic performance among preservice teachers in Central China. The study used a nonequivalent-groups, quasi-experimental pretest–posttest design with two intact sections of an undergraduate Educational Research Methods course at a public university. Ninety-five preservice teachers participated, including 52 students in the experimental group and 43 students in the comparison group. Both groups received the same face-to-face course instruction over a 10-week period. The experimental group completed two QUEST+AI inquiry cycles with coached use of generative artificial intelligence, while the comparison group completed conventional homework assignments.
The data include participant demographic variables, pretest and posttest responses to a multidimensional AI literacy questionnaire, AI literacy total and subscale scores, final research proposal scores, and group assignment indicators. AI literacy measures cover use and application of AI, knowledge and understanding of AI, AI detection, AI ethics, AI creation, AI-supported problem solving, AI persuasion literacy, and AI emotion regulation. Authentic performance is represented by scores on a final educational research proposal, evaluated with a common rubric by two independent raters. The dataset also includes variables used in the study’s comparative analyses, including group condition, pretest scores, gender, grade level, age, and major.
National Education Longitudinal Study, 1988 (ICPSR 9389)
Measures of Effective Teaching: 4 - District-Wide Files, 2008-2014 (ICPSR 34798)
The Measures of Effective Teaching Project (MET)
The MET project is based on two premises: First, to a significant extent a teacher's evaluation should depend on his/her students' achievement gains; second, any additional components of the evaluation (e.g., classroom observations) should be valid predictors of student achievement gain.
Student achievement was measured in two ways -- through existing state assessments, designed to assess student progress on the state curriculum for accountability purposes, and supplemental assessments, designed to assess higher-order conceptual understanding. The supplemental assessments used were Stanford 9 Open-Ended Reading Assessment in grades 4 through 8, Balanced Assessment in Mathematics (BAM) in grades 4 through 8, and the ACT QualityCore series for Algebra I, English 9, and Biology.
Panoramic digital video of classroom sessions were taken of participating teachers and students, teachers submitted commentary on their lessons (e.g., specifying the learning objective) and then trained raters scored the lesson based on classroom observation protocols using the following five observation protocols:
- Classroom Assessment Scoring System (CLASS), developed by Robert Pianta, University of Virginia
- Framework for Teaching, developed by Charlotte Danielson
- Mathematical Quality of Instruction (MQI), developed by Heather Hill, Harvard University, and Deborah Loewenberg Ball, University of Michigan
- Protocol for Language Arts Teaching Observations (PLATO), developed by Pam Grossman, Stanford University
- Quality Science Teaching (QST) Instrument, developed by Raymond Pecheone, Stanford University
A subset of the videos also are being scored using an observational protocol developed by the National Board for Professional Teaching Standards (NBPTS).
Close to 3,000 teacher volunteers from across the following six, predominantly urban, school districts participated in the MET project: Charlotte-Mecklenburg Schools, Dallas Independent School District, Denver Public Schools, Hillsborough County Public Schools, Memphis City Schools, and the New York City Department of Education. Participants teach math and English language arts (ELA) in grades 4-8, Algebra I, grade 9 English, and high school biology.
The District-Wide Files
The district wide files are comprised of one data file per district for each of the 2008-2009, 2009-2010, 2010-2011, 2011-2012, 2012-2013, and 2013-2014 school years, for a total of thirty-six data files. Each file contains information on each student in the school district including student demographic variables, such as race, age and gender, specialty student status variables such as free lunch, English language learner, and gifted and talented program participation, and student-level test rankings for math and reading. Also included are the aggregate means of those student demographic, specialty status, and test score variables for each teacher.
Two versions of the SAS code used for creating the original value-added measures for teachers in each district are also provided with the data files. The non-aggregated version of the code uses the individual math and reading test rankings for each of a teacher's students to calculate predictive score estimates. The aggregated version of the code uses the mean math and reading test rankings for all of that teacher's students to calculate estimates.
Measures of Effective Teaching: 3c - Base Data: Item-Level Observational Scores, 2009-2011 (ICPSR 34346)
The MET project is based on two premises: First, a teacher's evaluation should depend to a significant extent on his/her students' achievement gains; second, any additional components of the evaluation (e.g., classroom observations) should be valid predictors of student achievement gain.
Student achievement was measured in two ways -- through existing state assessments, designed to assess student progress on the state curriculum for accountability purposes, and supplemental assessments, designed to assess higher-order conceptual understanding.
Panoramic digital video of classroom sessions were taken of participating teachers and students, teachers submitted commentary on their lessons (e.g., specifying the learning objective) and then trained raters scored the lesson based on classroom observation protocols using the following five observation protocols:
- Classroom Assessment Scoring System (CLASS), developed by Robert Pianta, University of Virginia
- Framework for Teaching (FFT), developed by Charlotte Danielson
- Mathematical Quality of Instruction (MQI), developed by Heather Hill, Harvard University, and Deborah Loewenberg Ball, University of Michigan
- Protocol for Language Arts Teaching Observations (PLATO), developed by Pam Grossman, Stanford University
- Quality Science Teaching (QST) Instrument, developed by Raymond Pecheone, Stanford University
A subset of the videos also are being scored using an observational protocol developed by the National Board for Professional Teaching Standards (NBPTS) and using the UTeach Observational Protocol (UTOP), developed by the UTeach Preparation Program.
Close to 3,000 teacher volunteers from across the following 6, predominantly urban, school districts participated in the MET project: Charlotte-Mecklenburg Schools, Dallas Independent School District, Denver Public Schools, Hillsborough County Public Schools, Memphis City Schools, and the New York City Department of Education. Participants teach math and English language arts (ELA) in grades 4-8, Algebra I, grade 9 English, and high school biology.
The Item-Level Observational Scores Release
This release consists of data files for the five observational protocols listed (CLASS, FFT, MQI, PLATO, and QST) and the UTOP subset. Also included are rater comment files explaining rater scores on the CLASS instrument and master coded scores for the CLASS, FFT, PLATO, MQI and QST observational measures.
Measures of Effective Teaching: 1 - Study Information (ICPSR 34771)
The Measures of Effective Teaching Project (MET)
The MET project is based on two premises: First, a teacher's evaluation should depend to a significant extent on his/her students' achievement gains; second, any additional components of the evaluation (e.g., classroom observations) should be valid predictors of student achievement gain.
Student achievement was measured in two ways -- through existing state assessments, designed to assess student progress on the state curriculum for accountability purposes, and supplemental assessments, designed to assess higher-order conceptual understanding. The supplemental assessments used were Stanford 9 Open-Ended Reading Assessment in grades 4 through 8, Balanced Assessment in Mathematics (BAM) in grades 4 through 8, and the ACT QualityCore series for Algebra I, English 9, and Biology.
Panoramic digital video of classroom sessions were taken of participating teachers and students, teachers submitted commentary on their lessons (e.g., specifying the learning objective) and then trained raters scored the lesson based on classroom observation protocols using the following five observation protocols:
- Classroom Assessment Scoring System (CLASS), developed by Robert Pianta, University of Virginia
- Framework for Teaching, developed by Charlotte Danielson
- Mathematical Quality of Instruction (MQI), developed by Heather Hill, Harvard University, and Deborah Loewenberg Ball, University of Michigan
- Protocol for Language Arts Teaching Observations (PLATO), developed by Pam Grossman, Stanford University
- Quality Science Teaching (QST) Instrument, developed by Raymond Pecheone, Stanford University
A subset of the videos also are being scored using an observational protocol developed by the National Board for Professional Teaching Standards (NBPTS) and using the UTeach Observational Protocol (UTOP), developed by the UTeach Preparation Program.
Close to 3,000 teacher volunteers from across the following six, predominantly urban, school districts participated in the MET project: Charlotte-Mecklenburg Schools, Dallas Independent School District, Denver Public Schools, Hillsborough County Public Schools, Memphis City Schools, and the New York City Department of Education. Participants teach math and English language arts (ELA) in grades 4-8, Algebra I, grade 9 English, and high school biology.
The Study Information Release
Contained in this release are a comprehensive user guide, an observation measures report, a randomization file, a video information file, a subject ID file, a teacher demographics file, a student global ID crosswalk file, and a teacher global ID crosswalk file.
- User Guide - The user guide provides information on all data releases included in the MET longitudinal database. The report describes: (1) the educational research and policy context for the study; (2) research questions addressed by MET researchers; (3) the core study design and sub-studies; (4) the realized study sample; (5) additional information on study instruments and derived measures; and (6) the data files available for secondary analysis.
- Observation Measures Report - This report includes a description of the scoring design used for each phase and each year of the video observation measures and final reports of the scoring carried out for each measure.
- Randomization File - Year two of the MET study included a process for randomizing the classroom to which teachers were assigned. Information found in the randomization file includes district, school, section and student IDs, teacher IDs for the teacher a student was randomly assigned to, the actual teacher the student was recorded as having in May of that year, and the actual teacher the student was recorded as having in October of that year. Also included in the file are variables that indicate the grade of the student, their randomization block and exchange group and section each student was assigned to.
- Video Information File - This file contains descriptive information about the videos captured for the MET project. Variables found in the file include the ID of the video, as well as IDs for the district, school, teacher and section related to each video, the subject, grade, and year of the video and whether the file is available for users to view.
- Subject ID Crosswalk - This file contains only ID variables and is included to describe the associations between districts, schools, teachers, sections and students.
- Teacher Demographics File - This file contains descriptive information about the teachers in the MET project. Variables found in the file include the ID of the teacher, as well as IDs for the district, gender, race, years experience, and level of education.
- Student Global ID Crosswalk File - Students were given new and unique IDs in each year of data collection. This file matches those Student IDs across the 2008-09, 2009-10, 2010-11, 2011-12, 2012-13, and 2013-14 academic years.
- Teacher Global ID Crosswalk File - Teachers were given new and unique IDs in each year of data collection. This file matchers those Teachers IDs across the 2008-09, 2009-10, 2010-11, 2011-12, 2012-13, and 2013-14 academic years.
Taiwan Education Panel Study (ICPSR 36051)
The Taiwan Education Panel Survey (TEPS) is a national longitudinal project initiated by Academia Sinica and jointly funded by Ministry of Education, the National Science Council, and Academia Sinica. The objective of TEPS is to stimulate more basic research in the fields of education, sociology, economics, and psychology by employing large scale panel data on representative samples of students, and their parents, teachers, and school administrators. In a nutshell, TEPS has five distinguishing features: (1) Theory driven: The focus is on the skills, behavioral, values, and psychological consequences of schooling institutions and family environments of students. Factors that are found in the literature to affect students' learning outcomes are all included. Specifically speaking, an AOE model of learning outcomes, representing learning capabilities (Ability), learning opportunities (Opportunity), and the amount of effort made by the students (Effort), serves as a guiding framework for questionnaire development. Ability and effort are more on students themselves while opportunities covers family, teachers, and school environment, peers, and so forth.
(2) Student centered and multidimensional and multi-levels: Central to the project were questionnaire surveys of students. The data collection extends to cover the most influential actors in their learning environment: parents, teachers, and schools. It covered nested multiple levels of data - individual students, classes, and schools, etc.
(3) Panel surveys covering multiple programs and multiple cohorts: Students in junior high (G7 to G9), senior high (G10 to G12), vocational (G10 to G12), and junior college (G10 to G14) programs were administered for data collection. All students were followed at least twice. A portion of them were followed four times at G7, G9, G11, and G12. In light of the ongoing transformation of the Taiwanese educational system in 1990s, the project started with two cohorts of approximately 40,000 students, making it possible to employ a quasi-experimental design in future analysis.
(4) National representative samples of the students: Students under data collection were representative samples of the 1984/85 and 1988/89 birth cohorts. Weighting is provided according to the probabilistic sampling design.
(5) Public goods: Data are made available to the public as soon as the data collection and data cleaning is completed, thereby providing an important resource for both academic and policy research.
Measures of Effective Teaching: 3b - Base Data: Item-Level Supplemental Test Files, 2009-2011 (ICPSR 34868)
The MET project is based on two premises: First, a teacher's evaluation should depend to a significant extent on his/her students' achievement gains; second, any additional components of the evaluation (e.g., classroom observations) should be valid predictors of student achievement gain.
Student achievement was measured in two ways -- through existing state assessments, designed to assess student progress on the state curriculum for accountability purposes, and supplemental assessments, designed to assess higher-order conceptual understanding. The supplemental assessments used were:
- Stanford 9 (SAT 9) Open-Ended Reading Assessment in grades 4 through 8
- Balanced Assessment in Mathematics (BAM) in grades 4 through 8
- ACT QualityCore series for Algebra I, English 9, and Biology (ACT)
Close to 3,000 teacher volunteers from across the following 6, predominantly urban, school districts participated in the MET project: Charlotte-Mecklenburg Schools, Dallas Independent School District, Denver Public Schools, Hillsborough County Public Schools, Memphis City Schools, and the New York City Department of Education. Participants teach math and English language arts (ELA) in grades 4-8, Algebra I, grade 9 English, and high school biology.
The Item-Level Supplemental Test Files release consists of data files for the three supplemental assessments (SAT 9, BAM, and ACT).
Measures of Effective Teaching: 3a - Base Data: Section-Level Analytical Files, 2009-2011 (ICPSR 34309)
The MET project is based on two premises: First, a teacher's evaluation should depend to a significant extent on his/her students' achievement gains; second, any additional components of the evaluation (e.g., classroom observations) should be valid predictors of student achievement gain.
Student achievement was measured in two ways--through existing state assessments, designed to assess student progress on the state curriculum for accountability purposes, and supplemental assessments, designed to assess higher-order conceptual understanding. The supplemental assessments used were Stanford 9 Open-Ended Reading Assessment in grades 4 through 8, Balanced Assessment in Mathematics (BAM) in grades 4 through 8, and the ACT QualityCore series for Algebra I, English 9, and Biology.
Panoramic digital video of classroom sessions were taken of participating teachers and students, teachers submitted commentary on their lessons (e.g., specifying the learning objective) and then trained raters scored the lesson based on classroom observation protocols using the following five observation protocols:
Classroom Assessment Scoring System (CLASS), developed by Robert Pianta, University of Virginia
Framework for Teaching, developed by Charlotte Danielson
Mathematical Quality of Instruction (MQI), developed by Heather Hill, Harvard University, and Deborah Loewenberg Ball, University of Michigan
Protocol for Language Arts Teaching Observations (PLATO), developed by Pam Grossman, Stanford University
Quality Science Teaching (QST) Instrument, developed by Raymond Pecheone, Stanford University
A subset of the videos also are being scored using an observational protocol developed by the National Board for Professional Teaching Standards (NBPTS)
Close to 3,000 teacher volunteers from across the following six, predominantly urban, school districts participated in the MET project: Charlotte-Mecklenburg Schools, Dallas Independent School District, Denver Public Schools, Hillsborough County Public Schools, Memphis City Schools, and the New York City Department of Education. Participants teach math and English language arts (ELA) in grades 4-8, Algebra I, grade 9 English, and high school biology.
Measures of Effective Teaching: 2 - Core Files, 2009-2011 (ICPSR 34414)
The MET project is based on two premises: First, a teacher's evaluation should depend to a significant extent on his/her students' achievement gains; second, any additional components of the evaluation (e.g., classroom observations) should be valid predictors of student achievement gain.
Student achievement was measured in two ways -- through existing state assessments, designed to assess student progress on the state curriculum for accountability purposes, and supplemental assessments, designed to assess higher-order conceptual understanding. The supplemental assessments used were:
- Stanford 9 (SAT-9) Open-Ended Reading Assessment in grades 4 through 8
- Balanced Assessment in Mathematics (BAM) in grades 4 through 8
- ACT QualityCore series for Algebra I, English 9, and Biology
Panoramic digital video of classroom sessions were taken of participating teachers and students, teachers submitted commentary on their lessons (e.g., specifying the learning objective) and then trained raters scored the lesson based on classroom observation protocols using the following five observation protocols:
- Classroom Assessment Scoring System (CLASS), developed by Robert Pianta, University of Virginia
- Framework for Teaching (FFT), developed by Charlotte Danielson
- Mathematical Quality of Instruction (MQI), developed by Heather Hill, Harvard University, and Deborah Loewenberg Ball, University of Michigan
- Protocol for Language Arts Teaching Observations (PLATO), developed by Pam Grossman, Stanford University
- Quality Science Teaching (QST) Instrument, developed by Raymond Pecheone, Stanford University
A subset of the videos are also being scored using an observational protocol developed by the National Board for Professional Teaching Standards (NBPTS).
Close to 3,000 teacher volunteers from across the following 6, predominantly urban, school districts participated in the MET project: Charlotte-Mecklenburg Schools, Dallas Independent School District, Denver Public Schools, Hillsborough County Public Schools, Memphis City Schools, and the New York City Department of Education. Participants teach math and English language arts (ELA) in grades 4-8, Algebra I, grade 9 English, and high school biology.
Data File Description- District/School File - This data file contains an ID for the district where MET teachers taught and data on the schools where they taught. All data are from year one of the study. The data included for schools include limited measures of school organization, student composition, and aggregated test score information. The file also includes data collected from school principals about the nature of teacher evaluation processes in a school.
- Teacher File - This data file contains data on those MET teachers who participated in year one of the study only or who participated in both years of the study. There is one data record per teacher. Data in the teacher file was collected (or recorded) only once during the study. Among the variables included in the file are: (1) teacher IDs; (2) ID variables for district and school; (3) variables indicating a teacher's grade, subject, and study status; (4) measures of teachers' personal characteristics and professional background; (5) teacher responses to MET teacher working conditions survey [administered in year one of the study]; (6) teacher responses to the MET teacher survey administered [in year two of the study]; (7) teachers' scaled scores as well as multiple choice and constructed response sub-scores for the CKT measures; and (8) principal ratings of a teacher's effectiveness.
- Class Section File - This data file contains data on the focal class sections taught by MET teachers. There is one data record per section. In most cases, generalists have one class section per year in the study, so that teachers who participated in both years of the study will have a total of 2 class sections of data per teacher record per year. Specialists generally have 2 class sections in year one and 1 class section in year two year, so that teachers who participated in both years of the study will have a total of up to 3 class sections of data per teacher record. Among the variables included for each class section taught by a teacher are: (1) section IDs; (2) ID variables for teacher, school, and district; (3) variables indicating a teacher's grade, subject, and study status; (4) measures of class composition, including aggregated data on students' prior year test scores, ethnic composition, free lunch status, and special education status; and (5) class size. Also included in this data file are: (6) value-added measures of teaching effectiveness based on student achievement scores [aggregated to the section level]; (7) measures of teaching effectiveness based on classroom observation score data [aggregated to the section level]; and (8) measures of teaching effectiveness based on student survey data [aggregated to the section level].
- Student File - These data files contain data on students who were in the focal class sections of MET teachers during either year. Data on each student include: (1) student ID; (2) ID variables for section, teacher, school, and district; (3) measures of current and prior student achievement for all tests/years recorded [e.g., 2010-2011, 2009-2010; and up to three prior years]; (4) measures of student background [sex, ethnicity, lunch status, special education status, program participation]; and (5) student survey responses.
- Classroom Observation Scores File - These data files contain data from all classroom observation sessions conducted on each teacher. There will be one file per observation instrument and each file will have one record for each segment scored by a rater. Data on each observation session include: (1) a segment ID, (2) ID variables for video, section, teacher, school, and district; (3) variables indicating the video's grade, and subject; (4) a variable indicating whether score comes from the primary scorer or a secondary scorer; (5) scores on the dimensions of the given observation instrument; (5) a variable indicating if the rater deferred scoring of the video to the scoring leader. Note that each video will generally have multiple rows because scores were given at the segment level. Additionally, instruments with different segment scoring lengths will not be comparable at the segment level.
Improving Literacy Instruction for Adults: Reading Assessments from Adult Education Learners in Kansas and Missouri, 2005-2008 (ICPSR 34887)
The Improving Literacy Instruction for Adults study commenced in 2005 as a project of the University of Kansas Center for Research on Learning. Research for the project was undertaken with three aims: (1) to identify relationships among reading component skills and global literacy outcomes for adults with low literacy; (2) to design adult literacy interventions based on findings from the first aim (1); and (3) to examine the efficacy of these interventions on learner outcomes in authentic settings. This release contains descriptive datasets from the first aim; data related to the second and third aims will be made available in the future.
Initiation of the study involved the collection of reading assessments from volunteer participants at 13 adult education sites throughout Kansas and Kansas City, Missouri. Data were collected using a number of adult literacy evaluation methods, including but not limited to: General Educational Development (GED) tests, the Woodcock Reading Mastery Tests (WRMT), the Test of Silent Word Reading Fluency (TOSWRF), the Wechsler Adult Intelligence Scale (WAIS), the Test of Word Reading Efficiency (TOWRE), the Tests of Adult Basic Education (TABE), the Comprehensive Adult Student Assessment System (CASAS), the Peabody Picture Vocabulary Test (PPVT), the Comprehensive Test of Phonological Processing (CTOPP), the Gray Oral Reading Test (GORT), the Clinical Evaluation of Language Fundamentals (CELF), and the National Assessment of Educational Progress (NAEP).
Study participants also completed a background questionnaire designed to assess students' learning goals, motivations for seeking adult education classes, and any barriers or difficulties faced while pursuing adult education. Background questions also gathered demographic and personal information, including participant age, gender, ethnicity, language, education level, employment status and history, marital status, number of children, religious participation, health issues, and drug and alcohol abuse.
High School Exit Examinations (HSEE), 1977-2007 [United States] (ICPSR 32661)
Research on the correlates and consequences of state high school exit examinations (HSEEs) requires annual state-level data. This dataset contains information on every year in which a state mandated HSEEs as part of their general graduation requirements. Archival data on each states' HSEE policy was collected in order to (1) test hypotheses about the factors that have lead to the diffusion of state HSEEs over time and across states, and (2) test hypotheses about the impact of state HSEEs on student academic achievement and high school graduation rates. These variables were derived from a variety of primary source materials, including public records, legal archival resources, newspaper reports, and communications with officials in state education agencies. In order to make these materials available to future users, a separate linked data file was created that (1) provides a full bibliographic reference for each piece of source material, (2) gives the three-digit unique identifier that is associated with it, and (3) provides the name of the file that houses the actual document. The data describe not only which graduating classes in which states faced these requirements, but also the level of difficulty of the HSEEs. The data cover graduating classes between the years 1977 and 2007. For data on more recent graduating classes, please see the annual reports on HSEEs issued by the Center on Education Policy.
CBS News/Vanity Fair Monthly Poll #1, January 2010 (ICPSR 31162)
Project Upgrade in Miami-Dade County, Florida, 2003-2009 (ICPSR 31061)
The Evaluation of Child Care Subsidy Strategies is a multi-site, multi-year effort to determine whether and how different child care subsidy policies and procedures and quality improvement efforts help low-income parents obtain and hold onto jobs and improve outcomes for children. Funding from the Child Care and Development Fund (CCDF) administered by the Child Care Bureau are divided into two purposes. The vast majority are aimed at assisting children of low-income working parents whose eligibility is determined by states within broad federal guidelines, while a much smaller portion (4 percent) work with state matching funds to improve the quality of child care for all children. For this studies series, four experiments were conducted, two test alternative subsidy policies for low-income families and two test approaches to the use of set-aside funds for improving child care quality for all children. The four study sites and focus of evaluation include: (1) effectiveness of three language and literacy curricula on teaching practices and children's language and literacy outcomes (Miami-Dade County, Florida); (2) impact of alternative eligibility and re-determination child care subsidy policies on parental employment outcomes (Illinois); (3) impact of alternative child care co-payment structures on use of child care subsidies and employment outcomes (Washington) and (4) effectiveness of training on Learning Games curriculum in changing care-giving practices in family child care homes and children's developmental outcomes (Massachusetts).
A two-year experiment, Project Upgrade tests the effectiveness of three different language and literacy interventions, Ready, Set, Leap! (RSL!), Breakthrough to Literacy (BTL) and Building Early Language and Literacy (BELL) implemented in child care centers in Miami-Dade County, Florida, that served children from low-income families. One hundred and sixty-two centers were randomly assigned to one of three research-based curricula or to a control group that continued with its existing program. The curricula, while grounded in a common set of research findings, differed in intensity, pedagogic strategies, and use of technology. In each center, one classroom that served four-year-old children was selected for the study. Teachers and aides assigned to the three treatment groups received initial and follow-up training as well as ongoing mentoring over a period of approximately 18 months, from Fall 2003 to Spring 2005. The study tested two kinds of outcomes: teacher behavior and interactions with children, and aspects of the classroom environment that support children's language and literacy development, measured through direct observation; and children's language and pre-literacy skills, measured by their performance on a standardized assessment.
To determine whether the interventions that had produced significant outcomes at the end of preschool had any lasting positive effects on early school performance, mathematics and reading follow-up assessments were done in the spring of the 2007/2008 and 2008/2009 school years. Of the 1,535 children assessed in the original Florida Upgrade study, follow-up measurements were taken on 1,137 children (74 percent). Also obtained were follow-up measurements on 127 children who were in the study centers in the original randomized design, but who were not present at the time of the initial child assessments.