The purpose of this study was to evaluate the effectiveness of Healthy Families New York (HFNY), a state-administered home visitation program, in preventing child maltreatment and risks for delinquency by answering four questions:
- To what extent is the home visiting process of Healthy Families New York (HFNY) consistent with the Healthy Families America (HFA) model?
- Does home visiting effectively prevent or reduce child maltreatment?
- Does home visiting limit the emergence of precursors to delinquency?
- Do the long-term benefits of an HFA-based home visiting program outweigh its cost?
In the current study, mothers in both the intervention and control groups (Dataset 1: Mother Interview Data, n=942) were re-interviewed at the time of the target child's seventh birthday. Researchers also completed face-to-face assessments with 800 target children (Dataset 2: Target Child Interview Data). Participating mothers and their children were typically assessed in their homes by a trained interviewer, who was independent of the HFNY program and blind to group assignment.
Interview data were collected using laptop computers equipped with a Computer-Assisted Personal Interviewing (CAPI) system. The mother interview took about 60-75 minutes to complete. If the respondent was unable to complete the interview in a face-to-face setting it was conducted over the phone.
The target child assessment lasted approximately 30-45 minutes and included an automated Delay of Gratification Task that was developed for the project using the touch screen computer to obtain a direct behavioral assessment of self-regulatory processes.
For Dataset 3 (Baseline Covariates Data) researchers used information gathered at the baseline to identify appropriate covariates and to evaluate if individuals and family characteristics and resources differ across the treatment arms.
In addition to the interviews, researchers collected data from several administrative databases. The HFNY Management Information System (MIS) was used to obtain data for the 579 families who were randomly assigned to the intervention portion of the study to better understand how program components, such as visit frequency and content, related to outcomes experienced by families (Dataset 4: Home Visit Logs Data, n=23,176 and Dataset 6: Service Referrals Data, n=6314).
In order to determine whether respondents or their target children were ever the confirmed subject or confirmed victim in an indicated New York State Child Protective Services (CPS) investigation, person-based searches of CONNECTIONS, the NYS Statewide Automated Child Welfare Information System, were conducted (Dataset 5: Child Welfare Data, n=1173). Demographic information was entered into the search engine and potential system matches were then manually reviewed and evaluated by experienced CONNECTIONS users based on a detailed review of the information contained in the study's master person file.
Dataset 5 (Child Welfare Data) also includes information extracted from the NYS Child Care Review Service (CCRS). Target child client information numbers (CIN) were used to perform a computerized search of CCRS and extract information for matching target child who received child preventive, protective, or foster care services at any point from birth (or random assignment for those who were assigned postnatally) through the seventh birthday.
For Dataset 7 (Mothers' Earned Income Data), mother's earned income was calculated as a sum of wages of various jobs that the respondent worked during the study period. In the baseline survey, wage data were collected on one job, but for survey Years 1, 2, and 7, wage data were collected for up to five jobs. In the baseline survey, employment data were collected for the most recent job worked in the last three years prior to the survey. For survey Years 1 and 2, employment data were collected on the most recent jobs worked since the last survey. In Year 7, employment data were collected on the most recent jobs worked in the last five years prior to the survey.
In order to conduct a cost benefit analysis of the Healthy Families New York program (Dataset 8: Cost Benefit Data), researchers calculated the cost of the two distinct service components that are provided by the HFNY program: outreach and assessment, and home visitation. Food stamp and public assistance eligibility and a payment date for the respondent and/or the target child were obtained from the NYS Office of Temporary and Disability Assistance (OTDA). Information describing the actual foster care experience of the target child and whether or not the target child and his/her family received prevention and support services in any given year were obtain from the CCRS. Child protective service reports were extracted from CONNECTIONS from random assignment up through the target child's seventh birthday for the mothers who completed the baseline interview and their target children. To calculate tax revenues from earned income, researchers calculated federal, state, and Social Security and Medicare taxes paid by the respondent using the respondent's annual earned income for each calendar year covered in the analysis.
Recruitment for the baseline randomized controlled trial was conducted between March 2000 and August 2001. Randomization was conducted by way of a computer program at three sites with home visiting programs that had been in operation since the Healthy Families New York (HFNY) inception in 1995. All women were selected for the study following the same screening and assessment procedures used to determine eligibility for HFNY.
Initial study respondents were eligible to participate in the mom interview at Year 7 (Dataset 1: Mother Interview Data) if both the respondent and the target child were still living and women in the control condition had not received the intervention at any time between random assignment and two weeks prior to the Year 7 assessment.
Eligibility for participation in the child interview (Dataset 2: Target Child Interview Data) was more restrictive. In addition to both of the criteria established for the mom interviews, the target children had to live within driving distance of an interviewer in order to facilitate a face-to-face assessment, and the mother had to have custody of the child in order to grant consent for the interview.
Longitudinal: Cohort / Event-based
All mothers and target children eligible for the Healthy Families New York home visiting program between March 2000 and August 2001.
Dataset 1 (Mother Interview Data): Individual. Dataset 2 (Target Child Interview Data): Individual. Dataset 3 (Baseline Covariate Data): Individual. Dataset 4 (Home Visit Logs Data): Home Visit. Dataset 5 (Child Welfare Data): Individual. Dataset 6 (Service Referrals Data): Service Referral. Dataset 7 (Mothers' Earned Income Data): Individual. Dataset 8 (Cost Benefit Data): Individual.
administrative records data
computer-assisted personal interview (CAPI)
Dataset 1, Mother Interview Data, includes variables about parenting, the child, earnings, and household composition.
Dataset 2, Target Child Interview Data, includes variables designed to assess children's receptive vocabulary skills, socio-emotional health, self-regulatory abilities, and problem behaviors.
Potential covariates in Dataset 3 (Baseline Covariates Data) includes dichotomous variables coded to represent the mother's race/ethnicity, the mother's age, the presence of a regular partner, at least one move in the past year, random assignment to the study prenatally or postnatally, and the receipt of at least a GED or high school diploma. The target child's gender and age were also assessed at baseline or the next subsequent interview.
Dataset 4 (Home Visit Logs Data) and Dataset 6 (Service Referrals Data) include variables on the characteristics and needs of the families served, the initial risk assessment, the frequency and content of home visits, the nature and outcome of service referrals, and worker demographic and training information.
Dataset 5, Child Welfare Data, includes variables about the number of confirmed Child Protection Services investigations involving either the mother or the target child, foster care placements, and preventative services provided to the family.
Dataset 7 (Mothers' Earned Income Data) includes variables on earned income for up to five jobs, number of hours worked, start and end dates of employment, time frame of earnings payments, and the amount of federal, state, Social Security and Medicare taxes paid.
Dataset 8 (Cost Benefit Data) includes variables on Healthy Families New York (HFNY) program costs, food stamp and public assistance payments to the respondent, information on the foster care experience of the target child, costs of prevention and support services provided to the target child and family, costs of confirmed Child Protective Services investigations, costs of Medicaid delivery and hospitalizations, and taxes revenues (state and federal) from the mother's earned income.
Dataset 1 (Mother Interview Data): Of the 1,128 mothers still eligible, 942 mothers completed an interview at Year 7, including 479 from the intervention condition and 463 from the control condition. Dataset 2 (Target Child Interview Data): Of the 1,128 families with an eligible target child, 800 children were interviewed. Datasets 3-8: Not applicable.
Dataset 1 (Mother Interview Data) used the revised parent-child Conflict Tactics Scale (CTS-PC: Straus, Hamby, Finkelhor, Moore and Runyan, 1998). Mothers also completed the Child Behavior Checklist for Ages 6-18 (CBCL/6-18: Achenbach and Rescorla, 2001) to assess children's emotional and behavioral problems.
Dataset 2 (Target Child Interview Data) used the Conflict Tactics Scale-Picture Card Version (CTS-PCV: Mebert and Straus, 2002). To provide a measure of receptive language skills, children were administered the Peabody Picture Vocabulary Test 4th Edition (PPVT-IV: Dunn and Dunn, 2007). The Loneliness and Social Dissatisfaction Questionnaire (Cassidy and Asher, 1992) to provide an assessment of children's self-reported feelings of loneliness and social dissatisfaction. To provide an assessment of children's self-reported anti-social tendencies, target children were asked selected questions adapted from the Seattle Social Development Project (Hawkins, 2003) and the Dominic-R (Valla, Bergeron, and Smolla, 2000; Valla et al., 1994).
Dataset 3 (Baseline Covariate Data) selected a series of summarized measures to assess mothers' level of depressive symptoms (Center for Epidemiologic Studies Depression Scale (CES-D), Radloff, 1977), sense of mastery (Mastery of Psychological Coping Resources Scale, Pearlin and Schooler, 1978), and total parenting attitudes (Adolescent and Adult Parenting Inventory (AAPI-II), Bavolek and Keene, 1999). A count variable using items from the Kempe Family Stress Checklist (Korfmacher, 1999) was created to describe the level of moderate to severe risks present in families' lives as of random assignment.