Measures of Effective Teaching Longitudinal Database

This study is provided by the Measures of Effective Teaching Longitudinal Database, sponsored by the Bill and Melinda Gates Foundation.

Measures of Effective Teaching: 2 - Core Files, 2009-2011 (ICPSR 34414) RSS

Alternate Title:  MET 2 - Core Files, 2009-2011

Principal Investigator(s):

Summary:

The Measures of Effective Teaching (MET) Project

The MET project is based on two premises: First, a teacher's evaluation should depend to a significant extent on his/her students' achievement gains; second, any additional components of the evaluation (e.g., classroom observations) should be valid predictors of student achievement gain.

Student achievement was measured in two ways -- through existing state assessments, designed to assess student progress on the state curriculum for accountability purposes, and supplemental assessments, designed to assess higher-order conceptual understanding. The supplemental assessments used were:

  • Stanford 9 (SAT-9) Open-Ended Reading Assessment in grades 4 through 8
  • Balanced Assessment in Mathematics (BAM) in grades 4 through 8
  • ACT QualityCore series for Algebra I, English 9, and Biology

Panoramic digital video of classroom sessions were taken of participating teachers and students, teachers submitted commentary on their lessons (e.g., specifying the learning objective) and then trained raters scored the lesson based on classroom observation protocols using the following five observation protocols:

  • Classroom Assessment Scoring System (CLASS), developed by Robert Pianta, University of Virginia
  • Framework for Teaching (FFT), developed by Charlotte Danielson
  • Mathematical Quality of Instruction (MQI), developed by Heather Hill, Harvard University, and Deborah Loewenberg Ball, University of Michigan
  • Protocol for Language Arts Teaching Observations (PLATO), developed by Pam Grossman, Stanford University
  • Quality Science Teaching (QST) Instrument, developed by Raymond Pecheone, Stanford University

A subset of the videos are also being scored using an observational protocol developed by the National Board for Professional Teaching Standards (NBPTS).

Close to 3,000 teacher volunteers from across the following 6, predominantly urban, school districts participated in the MET project: Charlotte-Mecklenburg Schools, Dallas Independent School District, Denver Public Schools, Hillsborough County Public Schools, Memphis City Schools, and the New York City Department of Education. Participants teach math and English language arts (ELA) in grades 4-8, Algebra I, grade 9 English, and high school biology.

Data File Description

  1. District/School File - This data file contains an ID for the district where MET teachers taught and data on the schools where they taught. All data are from year one of the study. The data included for schools include limited measures of school organization, student composition, and aggregated test score information. The file also includes data collected from school principals about the nature of teacher evaluation processes in a school.
  2. Teacher File - This data file contains data on those MET teachers who participated in year one of the study only or who participated in both years of the study. There is one data record per teacher. Data in the teacher file was collected (or recorded) only once during the study. Among the variables included in the file are: (1) teacher IDs; (2) ID variables for district and school; (3) variables indicating a teacher's grade, subject, and study status; (4) measures of teachers' personal characteristics and professional background; (5) teacher responses to MET teacher working conditions survey [administered in year one of the study]; (6) teacher responses to the MET teacher survey administered [in year two of the study]; (7) teachers' scaled scores as well as multiple choice and constructed response sub-scores for the CKT measures; and (8) principal ratings of a teacher's effectiveness.
  3. Class Section File - This data file contains data on the focal class sections taught by MET teachers. There is one data record per section. In most cases, generalists have one class section per year in the study, so that teachers who participated in both years of the study will have a total of 2 class sections of data per teacher record per year. Specialists generally have 2 class sections in year one and 1 class section in year two year, so that teachers who participated in both years of the study will have a total of up to 3 class sections of data per teacher record. Among the variables included for each class section taught by a teacher are: (1) section IDs; (2) ID variables for teacher, school, and district; (3) variables indicating a teacher's grade, subject, and study status; (4) measures of class composition, including aggregated data on students' prior year test scores, ethnic composition, free lunch status, and special education status; and (5) class size. Also included in this data file are: (6) value-added measures of teaching effectiveness based on student achievement scores [aggregated to the section level]; (7) measures of teaching effectiveness based on classroom observation score data [aggregated to the section level]; and (8) measures of teaching effectiveness based on student survey data [aggregated to the section level].
  4. Student File - These data files contain data on students who were in the focal class sections of MET teachers during either year. Data on each student include: (1) student ID; (2) ID variables for section, teacher, school, and district; (3) measures of current and prior student achievement for all tests/years recorded [e.g., 2010-2011, 2009-2010; and up to three prior years]; (4) measures of student background [sex, ethnicity, lunch status, special education status, program participation]; and (5) student survey responses.
  5. Classroom Observation Scores File - These data files contain data from all classroom observation sessions conducted on each teacher. There will be one file per observation instrument and each file will have one record for each segment scored by a rater. Data on each observation session include: (1) a segment ID, (2) ID variables for video, section, teacher, school, and district; (3) variables indicating the video's grade, and subject; (4) a variable indicating whether score comes from the primary scorer or a secondary scorer; (5) scores on the dimensions of the given observation instrument; (5) a variable indicating if the rater deferred scoring of the video to the scoring leader. Note that each video will generally have multiple rows because scores were given at the segment level. Additionally, instruments with different segment scoring lengths will not be comparable at the segment level.

Series: Measures of Effective Teaching (MET) Project Series

Access Notes

  • One or more files in this study are not available for download due to special restrictions ; consult the restrictions note to learn more. You can apply online for access to the data. A login is required to apply for access. (How to apply.)

    The Measures of Effective Teaching Longitudinal Database (MET LDB) is restricted from general dissemination; a Confidential Data Use Agreement must be established prior to access. Researchers interested in gaining access to the data can submit their applications via ICPSR's online Restricted Contracting System, linked above.

    Applicants will be required to:

    • Submit IRB approval/exemption documentation;
    • Scan and email the completed Confidential Data Use Agreement, signed by the Primary Investigator and an Institutional Representative;
    • Pay the access fee ($500 for up to five users, and $250 for each additional user beyond five)

    Please visit the MET LDB Web site for more information.

Dataset(s)

DS0:  Study-Level Files
Documentation:
DS1:  District/School File
Documentation:
Download:
No downloadable data files available.
DS2:  Teacher File
Documentation:
Download:
No downloadable data files available.
DS3:  Class Section File
Documentation:
Download:
No downloadable data files available.
DS4:  Student File
Documentation:
Download:
No downloadable data files available.
DS5:  Classroom Observation Scores - CLASS File
Documentation:
Download:
No downloadable data files available.
DS6:  Classroom Observation Scores - FFT File
Documentation:
Download:
No downloadable data files available.
DS7:  Classroom Observation Scores - MQI File
Documentation:
Download:
No downloadable data files available.
DS8:  Classroom Observation Scores - PLATO File
Documentation:
Download:
No downloadable data files available.
DS9:  Classroom Observation Scores - QST Lab File
Documentation:
Download:
No downloadable data files available.
DS10:  Classroom Observation Scores - QST Non-Lab File
Documentation:
Download:
No downloadable data files available.

Study Description

Citation

Bill and Melinda Gates Foundation. Measures of Effective Teaching: 2 - Core Files, 2009-2011. ICPSR34414-v3. Ann Arbor, MI: Inter-university Consortium for Political and Social Research [distributor], 2013-09-23. http://doi.org/10.3886/ICPSR34414.v3

Persistent URL:

Export Citation:

  • RIS (generic format for RefWorks, EndNote, etc.)
  • EndNote XML (EndNote X4.0.1 or higher)

Funding

This study was funded by:

  • Bill and Melinda Gates Foundation

Scope of Study

Subject Terms:   curriculum, education, educational testing, student attitudes, student behavior, students, teacher attitudes, teacher education, teacher evaluation, teacher student relationship, teachers, teaching conditions, teaching methods

Smallest Geographic Unit:   School Districts

Geographic Coverage:   Charlotte, Colorado, Dallas, Denver, Florida, Memphis, New York (state), New York City, North Carolina, Pennsylvania, Pittsburgh, Tampa, Tennessee, Texas, United States

Time Period:  

  • 2009--2011

Date of Collection:  

  • 2010-01--2011-06

Unit of Observation:   Teachers, Students

Universe:   Teachers and students within the six participating school districts.

Data Types:   administrative records data, observational data, survey data

Data Collection Notes:

Participating academic institutions include Dartmouth College, Harvard University, Stanford University, University of Chicago, University of Michigan, University of Virginia, and University of Washington. Participating non-profit organizations include Educational Testing Service, RAND Corporation, and the New Teacher Center. Participating education consultants include Cambridge Education, Teachscape, and Westat. The National Board for Professional Teaching Standards and Teach For America supported the project and have encouraged their members to participate. The American Federation of Teachers and the National Education Association were involved in discussions about the MET project and supported the research.

Teachscape conducted the classroom video recordings, Educational Testing Service (ETS) managed the lesson-scoring process.

Methodology

Mode of Data Collection:   coded video observation, cognitive assessment test, mail questionnaire, self-enumerated questionnaire

Data Source:

Administrative data were gathered from each of the six participating school districts.

Response Rates:   2746 teachers began the year 1 of the MET project, 1868 completed year 2 of the MET project.

Presence of Common Scales:  

Classroom observational measures include:

  • Classroom Assessment Scoring System (CLASS), developed at the University of Virginia
  • The Framework for Teaching (FFT), developed by Charlotte Danielson
  • Mathematical Quality of Instruction (MQI), developed at the University of Michigan
  • Protocol for Language Arts Teaching Observation (PLATO), developed at Stanford University
  • Quality of Science Teaching (QST), developed at Stanford University
  • UTEACH Observation Protocol (UTOP), developed at the University of Texas-Austin for assessing math and science instruction

Supplemental student assessments include:

  • Stanford 9 (SAT-9) Open-Ended Reading Assessment in grades 4 through 8
  • Balanced Assessment in Mathematics (BAM) in grades 4 through 8
  • ACT QualityCore series for Algebra I, English 9, and Biology

Version(s)

Original ICPSR Release:  

Version History:

  • 2014-07-28 A series wide update to assure that files distributed through internal systems are current with those turned over.
  • 2013-09-27 Discrepancies in the schools associated with teachers were corrected.
  • 2013-09-23 Changed study title and updated documents.
  • 2013-09-16 Updated value labels in the Student File.
  • 2013-08-16 Updated R statistical package files for the Teacher File, Student File, and Classroom Observation Scores - MQI File.
  • 2013-07-30 Updated study title. Added new versions of Video ICPSR IDs for all Classroom Observation Scores files. Corrected variable precision issues in Teacher File and Student File. The Video Information file was removed, and will be re-released as part 0002 of ICPSR Study 34771.
  • 2013-04-26 Updated Grantee User Guide.
  • 2012-12-06 Updated Video Information Files and Codebook
  • 2012-11-16 Added additional data files to the release and reordered file list to reflect new study organization.

Utilities

Metadata Exports

If you're looking for collection-level metadata rather than an individual metadata record, please visit our Metadata Records page.

Download Statistics

Found a problem? Use our Report Problem form to let us know.