The Source for Crime and Justice Data

Validation of Risk Assessment Tools for Predicting Re-offending at Different Developmental Periods, 1951-2010 (ICPSR 32761) RSS

Principal Investigator(s):

Summary:

The study was a secondary data analysis examining the accuracy of risk assessment tools in predicting re-offending during early adulthood (age 18 to 25 years) compared to their accuracy in predicting re-offending during adolescence (age 12-17 years; youth tools only) or in later adulthood (older than 25 years, adult tools only). The investigators combined datasets that involved the same risk assessment tools. The adolescent risk assessment tools included the North Carolina Assessment of Risk (NCAR), the Youth Level of Service/Case Management Inventory (YLS/CMI), and the Structured Assessment of Violence Risk for Youth (SAVRY). The adult risk assessment tools included the Historical Clinical Risk Management-20 items (HCR-20) and the Violence Risk Appraisal Guide (VRAG). Using the datasets, the study examined the following recidivism outcomes: (1) any type of re-offending (excluded status offenses), and (2) violent re-offending specifically.

Access Notes

  • One or more files in this study are not available for download due to special restrictions ; consult the restrictions note to learn more. You can apply online for access to the data. A login is required to apply for access. (How to apply.)

    Access to these data is restricted. Users interested in obtaining these data must complete a Restricted Data Use Agreement, specify the reasons for the request, and obtain IRB approval or notice of exemption for their research.

Dataset(s)

DS0:  Study-Level Files
DS1:  North Carolina Assessment of Risk (NCAR) Data
Documentation:
Download:
No downloadable data files available.
DS2:  Youth Level of Service/Case Management Inventory (YLS/CMI) Data
Documentation:
Download:
No downloadable data files available.
DS3:  Structured Assessment of Violence Risk for Youth (SAVRY) Data
Documentation:
Download:
No downloadable data files available.
DS4:  Historical Clinical Risk Management (HCR-20) Data
Documentation:
Download:
No downloadable data files available.
DS5:  Violence Risk Appraisal Guide (VRAG) Data
Documentation:
Download:
No downloadable data files available.

Study Description

Citation

Vincent, Gina, Samantha Fusco, Bernice Gershenson, and Laura Guy. Validation of Risk Assessment Tools for Predicting Re-offending at Different Developmental Periods, 1951-2010. ICPSR32761-v1. Ann Arbor, MI: Inter-university Consortium for Political and Social Research[distributor], 2014-02-26. http://doi.org/10.3886/ICPSR32761.v1

Persistent URL:

Export Citation:

  • RIS (generic format for RefWorks, EndNote, etc.)
  • EndNote XML (EndNote X4.0.1 or higher)

Funding

This study was funded by:

  • University of Pittsburgh (2008-IJ-CX-K402)

Scope of Study

Subject Terms:   adults, age groups, juveniles, prediction, recidivism, recidivism prediction, risk assessment, risk factors, youths

Smallest Geographic Unit:   none

Geographic Coverage:   Canada, Connecticut, Netherlands, North Carolina, United States

Time Period:  

  • 1951--2010

Date of Collection:  

  • 1993--2006

Unit of Observation:   Individual

Universe:   All published and unpublished datasets that; (a) had an evidence based risk assessment tool, (b) studied an offender or forensic psychiatric population, and (c) included a measure of re-offending in the community, between 1993 and 2006.

Data Types:   administrative records data

Data Collection Notes:

The project's report (Vincent, Fusco, Gershenson, and Guy, 2010) references an initial sample of 10,245 risk assessments however the data being distributed as part of this collection contains information on 10,617 risk assessments.

The project's report (Vincent, Fusco, Gershenson, and Guy, 2010) references a final sample of 4,056 risk assessments however the data being distributed as part of this collection contains information on 4,031 risk assessments.

For this study, the time frame for data collection across the original studies spanned the years 1993 to 2006, the date variables in the data collection reference dates as early as 1951 and as late as 2010.

Rolf Loeber, PhD, is the primary PI on the NIJ grant 2008-IJ-CX-K402. This particular project was conducted through a sub-award to Gina Vincent.

Methodology

Study Purpose:   The purpose of the study was to determine whether risk assessment tools maintain their predictive accuracy across different developmental periods.

Study Design:  

The study was a secondary data analysis of risk assessment tools in their accuracy for predicting re-offending behavior at different periods of development. This included a search of all published and unpublished datasets which met the following criteria: (a) an evidence-based risk assessment tool, (b) studied an offender (corrections, pretrial detention, or probation) or forensic psychiatric population (civil psychiatric samples were not included), and (c) included a measure of re-offending in the community using self-report or official records. The investigators contacted original authors of these studies and requested their de-identified data sets. Datasets were combined by risk tool to examine recidivism outcomes.

Follow-up periods for tracking re-offending spanned 12 to 85 months. The unit of analysis was each case (e.g., young or adult offender or forensic psychiatric patient). Ten studies were used, located in the Netherlands, Western and Eastern Canada, North Carolina, and Connecticut. While the time frame for data collection spanned from 1993 to 2006, most of the studies selected their sample based on a particular time frame (for example, all individuals released from a forensic psychiatric facility from 1993 to 1999).

The investigators combined data sets that involved the same risk assessment tools to examine the predictive accuracy of each instrument for any re-offending (includes all types of offenses) and for violent re-offending specifically. The datasets were combined according to five scales that examined youth or adult risk assessment.

The adolescent risk assessment tools included the North Carolina Assessment of Risk (NCAR, Dataset 1), the Youth Level of Service/Case Management Inventory (YLS/CMI, Dataset 2), and the Structured Assessment of Violence Risk for Youth (SAVRY, Dataset 3).

The adult risk assessment tools included the Historical Clinical Risk Management-20 items (HCR-20, Dataset 4) and the violence Risk Appraisal Guide (VRAG, Dataset 5).

Each of these tools are valid risk assessments that are completed using clinical rating scales for each item based on a combination of information obtained by an interview with the offenders and correctional information. All studies gathered data using these procedures where live cases were assessed by the researchers or the researchers conducted the assessments completely based on archival correctional/psychiatric file reviews.

Sample:  

The initial sample contained 10,617 risk assessment evaluations, 2,353 adult cases and 8,264 adolescent cases. The distribution of these evaluations among the risk assessment tools were as follows; North Carolina Assessment of Risk (NCAR) = 6,751, Structured Assessment of Violence Risk for Youth (SAVRY) = 972, Youth Level of Service/Case Management Inventory (YLS/CMI) = 541, Violence Risk Appraisal Guide (VRAG) = 1,717, Historical Clinical Risk Management (HCR-20) = 636. The sample included cases from 10 studies from the Netherlands, Western and Eastern Canada, North Carolina, and Connecticut.

To determine whether these tools were as accurate at predicting re-offending during early adulthood (age 18 to 25 years) as predicting re-offending during adolescence (age 12-17 years; youth tools only) or in later adulthood (older than 25 years, adult tools only), the researchers excluded cases that did not have a follow-up period spanning into early adulthood. Thus, the final sample included only cases that had been assessed (or released from an institution) prior or equal to age 23 (for adult tools), or that were tracked until age 19 or older (for youth tools). This procedure resulted in at least a one year follow-up into early adulthood for every case. As such, a considerable number of cases were dropped from many of the datasets. This resulted in a final sample of 4,031 cases. The final sample size for each risk assessment tool was as follows: NCAR = 2,129, SAVRY = 786, YLS/CMI = 400, VRAG = 589, HCR-20 = 127.

Weight:   none

Mode of Data Collection:   record abstracts, face-to-face interview

Data Source:

Data was collected through review of administrative and archival records, interviews and other collateral information. The following studies were used by researchers:

  • North Carolina Department of Juvenile Justice (unpublished data),
  • De Vogel, de Ruiter, Hildebrand, Bos and Va de Ven (2004),
  • Douglas (1999),
  • Harris, Rice, and Cormier (2002),
  • Lodewijks, de Ruiter, and Doreleijers (2008),
  • Loza, Villeneuve, and Loza-Fanous (2002),
  • Rowe (2002),
  • Vincent, Quinlan, Nitschelm, and Ogloff (2003),
  • Vincent, Chapman, and Cook (under review), and
  • Welsh, Schmidt, McKinnon, Chattha, and Meyers (2008).

Description of Variables:  

Dataset 1 variables included offender demographics (age and race), admission information (offense, date, and adjudication), NCAR score, follow up information (age, time at risk, and date), and recidivism information (violence, days to re-offense, and age at recidivism).

Dataset 2 variables included offender demographics (age, gender, and ethnicity), YLS scores, re-offense information (number, violence, age, and months to re-offense), and follow up information (length of period, time at risk, and age).

Dataset 3 variables included offender demographics (age, race and gender), SAVRY scores, re-offense information (number, age, and violence), follow up information (age and days to re-offense), and recidivism (age and violence).

Dataset 4 variables included offender demographics (age, race, gender, and birth place), admission information (age, date, and charges), discharge information (age and date), follow up information (date, age, and time at risk), recidivism information (date, charges, and violence), and HCR-20 score.

Dataset 5 variables included offender demographics (gender, race, and age), admission (age and date), VRAG scores, follow up information (time at risk, age, and parole status), and recidivism information (age and days to re-offense).

Response Rates:   The response rates for studies used in these data were not reported and were not always relevant (some studies used archival data).

Presence of Common Scales:  

  • North Carolina Assessment of Risk (NCAR)
  • Youth Level of Service/Case Management Inventory (YLS/CMI)
  • Structured Assessment of Violence Risk for Youth (SAVRY)
  • Historical Clinical Risk Management (HCR)
  • Violence Risk Appraisal Guide (VRAG)

Extent of Processing:  ICPSR data undergo a confidentiality review and are altered when necessary to limit the risk of disclosure. ICPSR also routinely creates ready-to-go data files along with setups in the major statistical software formats as well as standard codebooks to accompany the data. In addition to these procedures, ICPSR performed the following processing steps for this data collection:

  • Standardized missing values.
  • Checked for undocumented or out-of-range codes.

Version(s)

Original ICPSR Release:  

Related Publications ?

Utilities

Metadata Exports

If you're looking for collection-level metadata rather than an individual metadata record, please visit our Metadata Records page.

Download Statistics