Assessing Research Quality

Related Information

The quality of social science and policy research can vary dramatically. Research Connections accepts all research and related documents that are disseminated in the field, without judging the quality of their design, methods, findings and general content. It is essential, therefore, that consumers of Research Connections research evaluate the quality of these studies.

Key Questions to Ask

  1. Was the research peer reviewed?

    Peer reviewed research studies have already been evaluated by experienced researchers with relevant expertise. Peer-reviewed research is usually of high quality. A research consumer, however, should still critically evaluate the study's methodology and conclusions. The Research Connections Web site indicates whether a study has been peer reviewed.

  2. Can a study's quality be evaluated with the information provided?

    Every study should include a description of the population of interest, an explanation of the process used to select study subjects, definitions of key variables and concepts, descriptive statistics for main variables, and a description of the analytic techniques. Research Connections users should be cautious when drawing conclusions from studies that do not provide sufficient information about these key research components.

  3. Are there any potential threats to the study's validity?

    A valid study answers research questions in a scientifically rigorous manner. Threats to a study's validity are found in three areas:

Research Assessment Tools

The purpose of the quantitative and qualitative research assessment tools is to provide Research Connections users with a quick and simple means to evaluate the quality of research studies on our site. The Research Connections research assessment tools describe the information that should be available in study reports and the key features of high quality study design.

Quantitative Research Assessment Tool (PDF 46K)

Qualitative Research Assessment Tool (PDF 62K)

Additional Resources for Assessing Research

Research Connections provides links to the following resources as a convenience. The inclusion of any link does not imply endorsement in any way. Research Connections does not control the content of information found in any of the research organization links and Research Connections is not responsible for the contents or the privacy practices of any linked site or any link contained in a linked site. If you feel that information found via a link from www.childcareresearch.org is offensive or counterproductive to the mission of Research Connections, please contact webmaster@childcareresearch.org.

Online Resources

Early childhood program evaluations: A decision-maker's guide
Research Connections Web Site

Early childhood assessment: Why, what, and how?
Research Connections Web Site

Understanding Validity
William M.K. Trochim, Research Methods Knowledge Base

Understanding and Evaluating Education Research
Education Commission of the States (ECS) and Mid-continent Research for Education and Learning (McREL)

Offline Resources

Black, T. R. 2000. Understanding Social Science Research. Thousand Oaks, CA: Sage Publications.

Girden, E. R. 2001. Evaluating Research Articles: From Start to Finish. Thousand Oaks, CA: Sage.

Stern, P. C. 1979. Evaluating Social Science Research. New York: Oxford University Press.