Transparency and Reproducibility Methods for Social Science Research (Berkeley, CA)

Instructor(s):

  • Katherine E. Casey, Stanford University
  • Garret Christensen, University of California at Berkeley
  • Clara Cohen, Unviersity of California at Berkeley
  • Scott Desposato, University of California at San Diego
  • Eric Eich, University of British Columbia
  • Solomon Hsiang, University of California at Berkeley
  • Nicole Janz, University of Cambridge
  • Edward Miguel, University of California at Berkeley
  • Leif Nelson, University of California at Berkeley
  • Maya Petersen, University of California at Berkeley

Research norms are changing faster than ever before. Repeated cases of scientific dishonesty, mistakes in data analysis, irreproducible findings, and publication bias in the literature, have prompted an impressive number of methodological, statistical, and technological innovations. There is a growing quantity of services and resources to archive and share data, report methods used to generate results, pre-register study plans, enable reproducibility of findings, as well as software tools to support transparent and collaborative workflows.

Sponsored by the Berkeley Initiative for Transparency in the Social Sciences, this workshop will provide participants with an overview of cutting-edge mechanisms for open and rigorous social science. The curriculum has been revamped and condensed compared to the 2014 edition, with sharper and more intense sessions, taught by academic leaders in the transparency movement. There will also be more space for collaborative work and hands-on skill building. Here is a non-exhaustive list of topics to be covered at the institute:

  • Emerging Issues in the Practice of Empirical Social Science
  • Ethics in Experimental Research
  • False-positives, P-hacking, P-curve, Power Analysis
  • Data Management & Statistical Analysis in R
  • Pre-registration: Lessons from Medical Trials & Biostatistics
  • Theory and Implementation of Pre-analysis Plans
  • Disclosure & Reporting Standards
  • Registration & Data-sharing through OSF and Dataverse
  • Approaches to the Replication of Research
  • Meta-analyses: New Tools & Techniques
  • Next Steps in Changing Scientific Research Practices

Participants can expect to finish the program with a thorough overview and understanding of best practices for open, reproducible research, allowing them to remain in the vanguard of new scientific frontiers. They are encouraged to bring existing research questions and ideas based on their own interests, and seek support and feedback from instructors and other attendees.

The workshop is designed for researchers across the social science spectrum, from economics to political science, psychology, and other related disciplines. Ideal candidates include: (i) graduate or post-graduate students contemplating a research career, (ii) junior faculty eager to learn about new tools and techniques, (iii) staff from research organizations interested in using these methods, and (iv) journal editors or research funders curious about the implications for their work. Diversity in terms of background and academic discipline is encouraged.

This workshop is generously supported by the Alfred P. Sloan Foundation, the Laura and John Arnold Foundation, and the Center for Open Science.

Application: Participants will be chosen through a competitive selection process. To apply, click on the "Registration" tab at the top of this page, provide your information, and select the course. Applicants must upload the following documentation:

  • Curriculum vita or resume;
  • Cover letter outlining participant's interest in the workshop, how he/she heard about it, and what he/she hopes to get out of the program;
  • A letter of reference (optional).

Deadline: The deadline for submitting applications is April 5, 2015. Accepted participants will be notified within approximately two weeks.

Fee: There are no tuition fees for this workshop.

Stipends for travel and/or accommodation will be available for a limited number of accepted participants.

Please contact Alex Wais (awais [at] berkeley [dot] edu) with any questions.

Agenda for the workshop.

Tags: transparency, replication, reproducibility

Course Sections

Section 1

Location: University of California, Berkeley -- Berkeley, CA

Date(s): June 10 - June 12

Time: 9:00 AM - 5:00 PM

Instructor(s):

  • Katherine E. Casey, Stanford University
  • Garret Christensen, University of California at Berkeley
  • Clara Cohen, Unviersity of California at Berkeley
  • Scott Desposato, University of California at San Diego
  • Eric Eich, University of British Columbia
  • Solomon Hsiang, University of California at Berkeley
  • Nicole Janz, University of Cambridge
  • Edward Miguel, University of California at Berkeley
  • Leif Nelson, University of California at Berkeley
  • Maya Petersen, University of California at Berkeley

Found a problem? Use our Report Problem form to let us know.