Integrating Causal Inference, Evidence Synthesis, and Research Prioritization Methods [Methods Study], United States, 2013-2018 (ICPSR 39489)

Version Date: Sep 9, 2025

Cite this study |

Principal Investigator(s):
John Wong, Tufts Medical Center

https://doi.org/10.3886/ICPSR39489.v1

Version V1

Slide tabs to view more

Summary

Comparative effectiveness research compares two or more treatments to see which one works better for certain patients. For example, research can see if medicines or stents work better for people with heart problems. Such research may include:

  • Observational studies. A research team studies what happens when patients and their clinicians choose the treatments. Traits, such as age or health, may affect patients' treatment choices. These traits may also affect patients' responses to treatments. It may be hard for the team to tell if a patient's traits, the treatment, or a mix of the two affected how well the treatment worked.
  • Clinical trials. The team assigns patients to a treatment by chance. Traits may affect a patient's ability to join a clinical trial.
    •

    In this study, the team tested ways to improve understanding of which treatment works better. First, the team compared different methods that account for things, such as patients' traits, that could affect results of observational studies. In the second part of the study, the team worked on ways to use all available data with a method called meta-analysis. This method combines data from both study types.

    Citation

    Wong, John. Integrating Causal Inference, Evidence Synthesis, and Research Prioritization Methods [Methods Study], United States, 2013-2018. Inter-university Consortium for Political and Social Research [distributor], 2025-09-09. https://doi.org/10.3886/ICPSR39489.v1

    Export Citation:

    • RIS (generic format for RefWorks, EndNote, etc.)
    • EndNote

    Funding

    Patient-Centered Outcomes Research Institute (PCORI) (ME-1303-5894)

    Subject Terms

    Geographic Coverage

    Distributor(s)

    Inter-university Consortium for Political and Social Research
    Hide

    Time Period(s)

    2013 -- 2018
    Hide

    Study Purpose

    To advance statistical methodologies for comparative effectiveness research by (1) comparing direct and indirect risk adjustments to observational data for causal inference and (2) developing network meta-analytic methods to integrate data from randomized controlled trials (RCTs) and observational studies in the first aim for evidence synthesis.

    Study Design

    Observational studies and RCTs can compare treatment benefits and harms. However, these alternative comparative effectiveness research study designs may yield conflicting conclusions due to differences in eligibility criteria and other confounding factors. This empirical study compared and developed improved statistical methods for comparative effectiveness research.

    Researchers obtained patient data from the Duke Databank for Cardiovascular Disease for three coronary artery disease treatments. First, researchers studied methods to adjust for treatment selection bias with missing data in observational survival data to see if the methods altered causal inferences about relative treatment benefits. To control for confounders in individual-level registry data, researchers compared five regression methodologies (Cox proportional hazards model and two propensity score matching methods: optimal full propensity matching and inverse probability of treatment weighting, each with two methods for combining imputations). Researchers investigated whether these methods led to different comparative effectiveness estimates of the three treatments and whether patient eligibility for trial participation could partly explain such differential effects.

    Next, researchers developed a comprehensive evidence synthesis method called cumulative network meta-analysis that integrated RCT evidence with study- and individual-level registry and observational data. This approach continuously summarized and updated evidence as new studies emerged, offering improvements in power to detect treatment effects and to generalize inferences.

    A stakeholder panel met periodically to review results and provide feedback on methodological approaches. The panel included physicians, frequentist and Bayesian statisticians, database researchers, journal editors, and members of the PCORI Methodology Committee.

    Data Source

    Duke Databank for Cardiovascular Disease for patients treated with the 3 most common interventions: medical therapy, percutaneous coronary intervention, coronary artery bypass surgery

  • Causal inference: observational data from 23,247 registry patients eligible or ineligible for RCTs related to the 3 interventions; created multiple imputed data sets to account for missing data
  • Evidence synthesis: integrated individual-level patient data from 23,247 registry patients and aggregate data from 75,125 patients in 30 RCTs and 8 observational studies

    • Hide

    Original Release Date

    2025-09-09

    Hide

    Notes

    • The public-use data files in this collection are available for access by the general public. Access does not require affiliation with an ICPSR member institution.

    • ICPSR usually offers files in multiple formats for researchers to be able to access data and documentation in formats that work well within their needs. If you have questions about the accessibility of materials distributed by ICPSR or require further assistance, please visit ICPSR’s Accessibility Center.