From gey at berkeley.edu Mon Aug 1 11:20:41 2005 From: gey at berkeley.edu (Fred Gey) Date: Mon Aug 1 11:22:53 2005 Subject: [DDI-ADG] Ilona and Fred out this week In-Reply-To: <6.0.1.1.2.20050729075553.028c0f60@icpsr.umich.edu> Message-ID: Ilona and I are out this week. Ilona is in Michigan taking care of infirm parents while I am on vacation August 2-6. Have a good call. Fred > -----Original Message----- > From: ddi-adg-bounces@icpsr.umich.edu [mailto:ddi-adg- > bounces@icpsr.umich.edu] On Behalf Of Mary Vardigan > Sent: Friday, July 29, 2005 4:58 AM > To: ddi-adg@icpsr.umich.edu > Subject: [DDI-ADG] Version 3.0 approach to controlled vocabularies > > Hello, everyone. I talked with Wendy earlier this week about the SRG's > strategy for handling controlled vocabularies in Version 3.0. Wendy, could > you please send something to the whole group about this? > > Thanks, > Mary > > Mary Vardigan > Director, Collection Delivery > Inter-university Consortium for Political and Social Research (ICPSR) > University of Michigan > P.O. Box 1248, Ann Arbor, MI 48106-1248 > Phone: 734-615-7908 > Fax: 734-647-8200 > www.icpsr.umich.edu > > _______________________________________________ > DDI-ADG mailing list > DDI-ADG@icpsr.umich.edu > http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg From maryv at icpsr.umich.edu Mon Aug 1 13:07:37 2005 From: maryv at icpsr.umich.edu (Mary Vardigan) Date: Mon Aug 1 13:07:43 2005 Subject: [DDI-ADG] survey definitions In-Reply-To: <5.2.1.1.2.20050727171435.00c09280@po11.mit.edu> References: <5.2.1.1.2.20050727171435.00c09280@po11.mit.edu> Message-ID: <6.0.1.1.2.20050801130320.02d9a998@icpsr.umich.edu> Kate and others, These definitions are really helpful. Should we be thinking about selecting one source as the definitive one? Mary At 05:23 PM 7/27/2005, Katherine McNeill-Harman wrote: >Hi everyone, > >I went through our social science methods reference books and compiled the >attached list of different survey definitions. It's a lengthy Word >document (if anyone can't read this format, I'll put it in a plain-text >email to you). Pages 1-14 are organized by topics, with the different >definitions for a topic listed on a single page; pages 15-20 are the >definitions organized by their source. > >Couple of notes: >- I included those terms that we'd specifically discussed as well as >others that were mentioned or I picked up along the way. >- I didn't really do an analysis, but in typing them in they seemed fairly >consistent in meaning (even if not in exact wording) >- In terms of the likelihood of these changing, several current >dictionaries referenced definitions developed a couple of decades ago, so >it seems unlikely they'd change very often (maybe more likely that new >models would need to be added). > >Kate > >___________________________________________ >Katherine McNeill-Harman >Data Services Librarian >Dewey Library for Management and Social Sciences >Massachusetts Institute of Technology >77 Massachusetts Avenue, E53-100 >Cambridge, MA 02139 >mcneillh@mit.edu >617-253-0787 > > >_______________________________________________ >DDI-ADG mailing list >DDI-ADG@icpsr.umich.edu >http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg Mary Vardigan Director, Collection Delivery Inter-university Consortium for Political and Social Research (ICPSR) University of Michigan P.O. Box 1248, Ann Arbor, MI 48106-1248 Phone: 734-615-7908 Fax: 734-647-8200 www.icpsr.umich.edu From mcneillh at MIT.EDU Mon Aug 1 15:12:29 2005 From: mcneillh at MIT.EDU (Katherine McNeill-Harman) Date: Mon Aug 1 15:12:46 2005 Subject: [DDI-ADG] survey definitions In-Reply-To: <6.0.1.1.2.20050801130320.02d9a998@icpsr.umich.edu> References: <5.2.1.1.2.20050727171435.00c09280@po11.mit.edu> <5.2.1.1.2.20050727171435.00c09280@po11.mit.edu> Message-ID: <5.2.1.1.2.20050801132954.01609100@po11.mit.edu> Considering Wendy's email, "The detailed contents of these lists can be hashed out after the October SRG meeting with representatives of the working groups. What is important at this point is to a) make sure that all fields requiring controlled vocabulary are identified, b) provide justification if its not clear, and c) provide a preliminary list with term (or T1, T2 etc) and definitions. it sounds like we could be working on "c) provide a preliminary list with term (or T1, T2 etc) and definitions." So selecting one of the sources could be one way to do it. I don't have a judgment as to which is more authoritative. And depending upon which terms we want to define, some appeared in one source but not others. Kate At 01:07 PM 8/1/2005 -0400, Mary Vardigan wrote: >Kate and others, > >These definitions are really helpful. Should we be thinking about >selecting one source as the definitive one? > >Mary > >At 05:23 PM 7/27/2005, Katherine McNeill-Harman wrote: >>Hi everyone, >> >>I went through our social science methods reference books and compiled >>the attached list of different survey definitions. It's a lengthy Word >>document (if anyone can't read this format, I'll put it in a plain-text >>email to you). Pages 1-14 are organized by topics, with the different >>definitions for a topic listed on a single page; pages 15-20 are the >>definitions organized by their source. >> >>Couple of notes: >>- I included those terms that we'd specifically discussed as well as >>others that were mentioned or I picked up along the way. >>- I didn't really do an analysis, but in typing them in they seemed >>fairly consistent in meaning (even if not in exact wording) >>- In terms of the likelihood of these changing, several current >>dictionaries referenced definitions developed a couple of decades ago, so >>it seems unlikely they'd change very often (maybe more likely that new >>models would need to be added). >> >>Kate >> >>___________________________________________ >>Katherine McNeill-Harman >>Data Services Librarian >>Dewey Library for Management and Social Sciences >>Massachusetts Institute of Technology >>77 Massachusetts Avenue, E53-100 >>Cambridge, MA 02139 >>mcneillh@mit.edu >>617-253-0787 >> >> >>_______________________________________________ >>DDI-ADG mailing list >>DDI-ADG@icpsr.umich.edu >>http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg > >Mary Vardigan >Director, Collection Delivery >Inter-university Consortium for Political and Social Research (ICPSR) >University of Michigan >P.O. Box 1248, Ann Arbor, MI 48106-1248 >Phone: 734-615-7908 >Fax: 734-647-8200 >www.icpsr.umich.edu ___________________________________________ Katherine McNeill-Harman Data Services Librarian Dewey Library for Management and Social Sciences Massachusetts Institute of Technology 77 Massachusetts Avenue, E53-100 Cambridge, MA 02139 mcneillh@mit.edu 617-253-0787 From mcneillh at MIT.EDU Mon Aug 1 15:25:17 2005 From: mcneillh at MIT.EDU (Katherine McNeill-Harman) Date: Mon Aug 1 15:25:39 2005 Subject: [DDI-ADG] Latest Geography Structure - Take 2 In-Reply-To: <6.0.1.1.2.20050726084948.01ad1b10@icpsr.umich.edu> References: <5.2.1.1.2.20050725163846.010425f0@po11.mit.edu> <005b01c58c7f$61a7cf90$6601a8c0@JGAGERLT> <5.2.1.1.2.20050725163846.010425f0@po11.mit.edu> Message-ID: <5.2.1.1.2.20050801151413.0153e360@po11.mit.edu> Picking up on this again... It's hard to be crystal clear via email. I'm not sure about the issue of whether or not to repeat geography. My recommendation was to list both the overall geographic coverage and the levels of geography (knowing that an area might be represented in both in some cases, but the purpose of the two fields is different). On your #1 below, I did intend for there to be a textual description of the GeographicCoverage. I'd put in there a placeholder for GeographyValues (or some other such element), not to describe the geographic level (that would be w/in the GeographicLevel element) but rather to provide a standardized way to describe the GeographicCoverage. This provides for both a code under GeographicLevelCode and a textual description under GeographicLevelName (this probably should be required, which I didn't note, so that there's at least a description even if it doesn't have a code). Again, I just used GeographyValues b/it was convenient; my main goal was to have w/in the GeographicCoverage element a place to indicate both a textual description and a code. R.e. #2 below, I was thinking of repeating if the area of GeographicCoverage was also technically a geographic level. I'm not sure if a different kind of nesting is necessary if the area of GeographicCoverage is not a geographic level. Hope this helps to clarify, Kate At 09:05 AM 7/26/2005 -0400, Sanda Ionescu wrote: >Hi. >I agree with what Katherine is proposing, with two "amendments": >1. We should leave in the textual description ("Description") of >GeographicCoverage, for those instances where we do not have data at this >level, or, even if we do have data, for people who want to spell out the >total coverage in plain English. Both values and description should be >made optional. >2.If we create yet another container for everything (initially >GeographicCoverage was thought of as a container) then the highest >"Geography" should be nestable under Geographic Coverage (since we're no >longer repeating this level as a Geography.) >Cheers, >Sanda. > >p.s. - Last minute changes for today's call - please e-mail me directly: >sandai@icpsr.umich.edu. Fred - are you taking the call in Ilona's office, >or at another number? > > >At 05:13 PM 7/25/2005, Katherine McNeill-Harman wrote: >>To continue the geography thread: >> >>Continuing our discussion last week, I'd suggest two edits to the >>spreadsheet, a revised version is attached; throwing out several ideas >>for discussion, so look forward to others' reactions/additional ideas: >> >>1) I do believe we should enable some sort of structured description of >>geographic coverage (that is the overall coverage of the study) to enable >>machine actionability on that. (e.g. I'm imagining some great search >>interface in the future that has fields for both geographic coverage and >>geographic level, each of which act on structured metadata) >> >>It seems we have two options for doing this: >> >>a) Right now we just have a place in geographic coverage for a textual >>description, which provides little/no ability for machine actionability >>within that section. However, presumably all overall coverage areas >>would also be listed as a geographic level, whether or not there's data >>available at that level (hence, the sub-element of Geography to indicate >>whether or not that level "HasSummaryData." Each of those can contain >>structured GeographyValues. >> >>b) I would propose the alternative, as I think it's a bit more direct. >>I recall us deciding that we would have separate elements for the overall >>coverage vs. geographic levels (i.e. those levels at which there's data >>in the study). I believe that we said that in the case when the >>geographic coverage/overall area is also a level at which there's data >>available (e.g. the overall coverage is of a country, but you can also >>get info. at the country level, not simply at lower levels like state or >>province), that we would repeat the description of that area in both the >>geographic coverage and the geographic level elements. >> >>However, as compared to what's in "a," I would propose only repeating the >>overall coverage area in Geography if indeed it is a level at which data >>is available (therefore eliminating the for "HasSummaryData," because all >>levels in there would have data). Instead, I propose to enable more >>structured description of the Geographic Coverage within that section >>itself. So I've put in there a place to indicate GeographyValues, >>structured information about the coverage of the study (e.g. if it's a >>country, the author could insert a standard country code that could be >>machine-actionable). I know some people said in the phone conversation >>that if we were to do this it should be called something other than >>GeographyValues. I put that in, but others may have ideas for a better >>name. [Note, now that something like GeographyValues sits w/in >>GeographicCoverage, I'm not sure what would be the relationship between >>the BoundingBox and the Bounding Polygon that's optional w/in GeographyValues]. >> >>2) Plus, I wonder about the hierarchical relationships among the elements >>in the spreadsheet. Right now everything is under "Geographic Coverage," >>when in fact this term is referring to a specific aspect of geography >>that to me isn't logically the "parent" (is that the right use of the >>term?) over the other things. I would propose one of two alternatives >>(listed on sheet 1 and 2 in the attached), and don't know which make more >>sense structurally. >>a) if we want everything nested under one geographic element (option 1), >>then I'd create an additional overall element that's simply a container >>for all the others; I've actually named it Geography, b/this seemed like >>a logical overall name, and renamed the previous "Geography" >>"GeographicLevel," as this seemed a little more descriptive. >>b) If there is no need for a top-level element, then I'd flatten it and >>put GeographicCoverage and GeographicLevel at the same level in the elements. >> >>Not having worked much with version 2.0, some of these ideas may be >>wacky, but I'll at least put them out there and see what others >>say. Look forward to email discussion on this. >> >>Kate >> >>At 12:31 PM 7/19/2005 -0400, J Gager wrote: >>>Sorry for the previous message - I accidently hit send... >>> >>>Here is the latest work up of the Geography structure, I have worked in >>>Wendy's comments and part of our discussion today. We have decided it >>>is time to wrap this up so that we can move on to the our other tasks - >>>Time and Aggregate Data. The plan is that the geography will continue >>>to be reviewed and reworked between meetings via this email list. We >>>should really focus on the definitions, as they are admittedly >>>lacking. Also, it would be helpful to have a few use cases >>>described. If there are any major issues, we can discuss them at the >>>end of our weekly meetings. >>> >>>Thanks, >>> >>>J >>> >>>_______________________________________________ >>>DDI-ADG mailing list >>>DDI-ADG@icpsr.umich.edu >>>http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg >> >>___________________________________________ >>Katherine McNeill-Harman >>Data Services Librarian >>Dewey Library for Management and Social Sciences >>Massachusetts Institute of Technology >>77 Massachusetts Avenue, E53-100 >>Cambridge, MA 02139 >>mcneillh@mit.edu >>617-253-0787 >>_______________________________________________ >>DDI-ADG mailing list >>DDI-ADG@icpsr.umich.edu >>http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg > > > >Sanda Ionescu, >Research Associate >Inter-university Consortium for Political and Social Research (ICPSR) >The University of Michigan >P.O. Box 1248 >Ann Arbor, MI 48106 > >Phone: (734) 615-7890 >Fax: (734) 615-7890 > (734) 647-8200 ___________________________________________ Katherine McNeill-Harman Data Services Librarian Dewey Library for Management and Social Sciences Massachusetts Institute of Technology 77 Massachusetts Avenue, E53-100 Cambridge, MA 02139 mcneillh@mit.edu 617-253-0787 From mcneillh at MIT.EDU Tue Aug 2 12:16:37 2005 From: mcneillh at MIT.EDU (Katherine McNeill-Harman) Date: Tue Aug 2 12:16:54 2005 Subject: [DDI-ADG] minutes, DDI-ADG conference call 8/2/05 Message-ID: <5.2.1.1.2.20050802115113.01654880@po11.mit.edu> Following are brief minutes from today's conference call (let me know any corrections that need to be made); J, please make note of action item #4 for which we volunteered you. Minutes DDI Aggregate Data, Geography & Time Working Group August 2, 2005, 11am-12pm U.S. EDT Present: Sanda Ionescu, Kate McNeill-Harman (minutes), Ken Miller, Wendy Thomas, Mary Vardigan Action Items: 1. Kate will forward to the SRG (addressed to Oliver Watteler) the time method definitions she gathered for their use in creating the controlled vocabulary. She will remind them to include time method indicators for stand-alone data files that might not be considered comparative data, and offer our group's help on this if needed. 2. Kate will try to locate an ISO (or other) standard for describing frequencies. 3. Wendy and Sanda will review the DDI and pull out a list of elements with date stamps. 4. J should summarize the time decisions to date in a spreadsheet (similar to the one for geography), looking at the structure outlined in the TemporalCoverage section of the "reusable classes" sheet of the spreadsheet, DDI-Version3-SRG_TagNames.xls. This should be done this week in order to provide time for review and comment before the next meeting. Minutes: The group continued the discussion of time method. It was indicated that the Comparative Data Group will be developing suggested controlled vocabulary for time method. Members agreed to send that group the information gathered thus far on definitions for them to incorporate, emphasizing their need to include aspects of time method that may not refer to families of datasets. Members then discussed the role of administrative dates and how those should relate to the content-related dates discussed thus far. This included a discussion of the role of versions. Wendy reported that the SRG will be working on this. It was also agreed that it would be helpful to review how dates are used throughout the DDI. For example, it might be helpful to have date stamps in multiple other elements to serve as placeholders for authors to remind them that they might want to indicate the date aspect of a particular element. Wendy and Sanda volunteered to do this. Members agreed to have frequency as a strongly-typed variable with a controlled vocabulary. Kate will try to locate an ISO (or other) standard for describing frequencies. It was agreed that an "other" option should be provided in case the study has a frequency not provided by the given choices. It was mentioned that frequency could apply to groups of studies (e.g. a periodic survey that is done annually), a single study (a time series with annual data), or a variable (a data set with annual data for some variables and quarterly data for others). Therefore it was mentioned that frequency may be helpful as a reusable class that could be applied at the variable level as well. The group agreed that next week should be the last phone conference to discuss time, after which (or even starting in the next meeting, if possible) they would move onto aggregate data. In order to do this, J will need to incorporate today's and previous time discussions into a spreadsheet (similar to the one for geography), looking at the structure outlined in the TemporalCoverage section of the "reusable classes" sheet of the spreadsheet, DDI-Version3-SRG_TagNames.xls. The group will then review this, and the date stamps, at the next meeting, and make final decisions on time. ___________________________________________ Katherine McNeill-Harman Data Services Librarian Dewey Library for Management and Social Sciences Massachusetts Institute of Technology 77 Massachusetts Avenue, E53-100 Cambridge, MA 02139 mcneillh@mit.edu 617-253-0787 From wlt at pop.umn.edu Tue Aug 2 12:31:50 2005 From: wlt at pop.umn.edu (Wendy Thomas) Date: Tue Aug 2 12:32:20 2005 Subject: [DDI-ADG] minutes, DDI-ADG conference call 8/2/05 In-Reply-To: <5.2.1.1.2.20050802115113.01654880@po11.mit.edu> Message-ID: Just a couple of comments. Oliver chairs the CDG (comparative) rather than the SRG (structural reform). Um...I didn't volunteer to go through those tags and will have no time to do so. Sorry about that, but I've really got my hands full with the SRG. Wendy On Tue, 2 Aug 2005, Katherine McNeill-Harman wrote: > Following are brief minutes from today's conference call (let me know any > corrections that need to be made); J, please make note of action item #4 > for which we volunteered you. > > Minutes > DDI Aggregate Data, Geography & Time Working Group > August 2, 2005, 11am-12pm U.S. EDT > Present: Sanda Ionescu, Kate McNeill-Harman (minutes), Ken Miller, Wendy > Thomas, Mary Vardigan > > Action Items: > 1. Kate will forward to the SRG (addressed to Oliver Watteler) the time > method definitions she gathered for their use in creating the controlled > vocabulary. She will remind them to include time method indicators for > stand-alone data files that might not be considered comparative data, and > offer our group's help on this if needed. > 2. Kate will try to locate an ISO (or other) standard for describing > frequencies. > 3. Wendy and Sanda will review the DDI and pull out a list of elements with > date stamps. > 4. J should summarize the time decisions to date in a spreadsheet (similar > to the one for geography), looking at the structure outlined in the > TemporalCoverage section of the "reusable classes" sheet of the > spreadsheet, DDI-Version3-SRG_TagNames.xls. This should be done this week > in order to provide time for review and comment before the next meeting. > > Minutes: > The group continued the discussion of time method. It was indicated that > the Comparative Data Group will be developing suggested controlled > vocabulary for time method. Members agreed to send that group the > information gathered thus far on definitions for them to incorporate, > emphasizing their need to include aspects of time method that may not refer > to families of datasets. > > Members then discussed the role of administrative dates and how those > should relate to the content-related dates discussed thus far. This > included a discussion of the role of versions. Wendy reported that the SRG > will be working on this. > > It was also agreed that it would be helpful to review how dates are used > throughout the DDI. For example, it might be helpful to have date stamps > in multiple other elements to serve as placeholders for authors to remind > them that they might want to indicate the date aspect of a particular > element. Wendy and Sanda volunteered to do this. > > Members agreed to have frequency as a strongly-typed variable with a > controlled vocabulary. Kate will try to locate an ISO (or other) standard > for describing frequencies. It was agreed that an "other" option should be > provided in case the study has a frequency not provided by the given > choices. It was mentioned that frequency could apply to groups of studies > (e.g. a periodic survey that is done annually), a single study (a time > series with annual data), or a variable (a data set with annual data for > some variables and quarterly data for others). Therefore it was mentioned > that frequency may be helpful as a reusable class that could be applied at > the variable level as well. > > The group agreed that next week should be the last phone conference to > discuss time, after which (or even starting in the next meeting, if > possible) they would move onto aggregate data. In order to do this, J will > need to incorporate today's and previous time discussions into a > spreadsheet (similar to the one for geography), looking at the structure > outlined in the TemporalCoverage section of the "reusable classes" sheet of > the spreadsheet, DDI-Version3-SRG_TagNames.xls. The group will then review > this, and the date stamps, at the next meeting, and make final decisions on > time. > > ___________________________________________ > Katherine McNeill-Harman > Data Services Librarian > Dewey Library for Management and Social Sciences > Massachusetts Institute of Technology > 77 Massachusetts Avenue, E53-100 > Cambridge, MA 02139 > mcneillh@mit.edu > 617-253-0787 > > _______________________________________________ > DDI-ADG mailing list > DDI-ADG@icpsr.umich.edu > http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg > Wendy L. Thomas Phone: +1 612.624.4389 Data Access Core Director Fax: +1 612.626.8375 Minnesota Population Center Email: wlt@pop.umn.edu University of Minnesota 50 Willey Hall 225 19th Avenue South Minneapolis, MN 55455 From millk at essex.ac.uk Tue Aug 2 12:37:23 2005 From: millk at essex.ac.uk (Miller, Kenneth P) Date: Tue Aug 2 12:38:05 2005 Subject: [DDI-ADG] minutes, DDI-ADG conference call 8/2/05 Message-ID: <8839697C62E81B4097C7BFFC8F0E6A0102A78B25@sernt14.essex.ac.uk> Hi The following are possible candidates for date stamping, since they contain a URI. Default in majority of cases is probably the of the xml, but do they need an override? 1.1 citation? (ATT == ID, xml-lang, source, MARCURI) 1.1.4.1 distrbtr* (ATT == ID, xml-lang, source, abbr, affiliation, URI) 1.1.4.2 contact* (ATT == ID, xml-lang, source, affiliation, URI, email) 1.1.5 serStmt? (ATT == ID, xml-lang, source, URI) 1.1.8 holdings* (ATT == ID, xml-lang, source, location, callno, URI, media) 1.4 docSrc* (ATT == ID, xml-lang, source, MARCURI) 2.2.1.1 keyword* (ATT == ID, xml-lang, source, vocab, vocabURI) 2.2.1.2 topcClas* (ATT == ID, xml-lang, source, vocab, vocabURI) 2.2.3.3.2 concept (ATT == ID, xml-lang, source, vocab, vocabURI) 2.4.1.1 accsPlac* (ATT == ID, xml-lang, source, URI) 2.4.2.1 confDec? (ATT == ID, xml-lang, source, required, formNo, URI) 2.4.2.2 specPerm? (ATT == ID, xml-lang, source, required, formNo, URI) 3.0 fileDscr* (ATT == ID, xml-lang, source, URI, sdatrefs, methrefs, pubrefs, access) 4.3.16 stdCatgry* (ATT == ID, xml-lang, source, date, URI) 4.3.17.2 catStat* (ATT == ID, xml-lang, source, type, URI, methrefs, wgtd, wgt-var, weight, sdatrefs) 4.3.23 varFormat? (ATT == ID, xml-lang, source, type, formatname, schema, category, URI) 4.3.24 geoMap* (ATT == ID, xml-lang, source, URI, mapformat, levelno) 4.4.11 purpose? (ATT == ID, xml-lang, source, sdatrefs, methrefs, pubrefs, URI) 5.0 otherMat* (ATT == ID, xml-lang, source, type, level, URI) Real reason for email is of course to make you insanely jealous by including a holiday photo of where we were staying. Best regards ken -----Original Message----- From: ddi-adg-bounces@icpsr.umich.edu [mailto:ddi-adg-bounces@icpsr.umich.edu] On Behalf Of Katherine McNeill-Harman Sent: 02 August 2005 17:17 To: ddi-adg@icpsr.umich.edu Subject: [DDI-ADG] minutes, DDI-ADG conference call 8/2/05 Following are brief minutes from today's conference call (let me know any corrections that need to be made); J, please make note of action item #4 for which we volunteered you. Minutes DDI Aggregate Data, Geography & Time Working Group August 2, 2005, 11am-12pm U.S. EDT Present: Sanda Ionescu, Kate McNeill-Harman (minutes), Ken Miller, Wendy Thomas, Mary Vardigan Action Items: 1. Kate will forward to the SRG (addressed to Oliver Watteler) the time method definitions she gathered for their use in creating the controlled vocabulary. She will remind them to include time method indicators for stand-alone data files that might not be considered comparative data, and offer our group's help on this if needed. 2. Kate will try to locate an ISO (or other) standard for describing frequencies. 3. Wendy and Sanda will review the DDI and pull out a list of elements with date stamps. 4. J should summarize the time decisions to date in a spreadsheet (similar to the one for geography), looking at the structure outlined in the TemporalCoverage section of the "reusable classes" sheet of the spreadsheet, DDI-Version3-SRG_TagNames.xls. This should be done this week in order to provide time for review and comment before the next meeting. Minutes: The group continued the discussion of time method. It was indicated that the Comparative Data Group will be developing suggested controlled vocabulary for time method. Members agreed to send that group the information gathered thus far on definitions for them to incorporate, emphasizing their need to include aspects of time method that may not refer to families of datasets. Members then discussed the role of administrative dates and how those should relate to the content-related dates discussed thus far. This included a discussion of the role of versions. Wendy reported that the SRG will be working on this. It was also agreed that it would be helpful to review how dates are used throughout the DDI. For example, it might be helpful to have date stamps in multiple other elements to serve as placeholders for authors to remind them that they might want to indicate the date aspect of a particular element. Wendy and Sanda volunteered to do this. Members agreed to have frequency as a strongly-typed variable with a controlled vocabulary. Kate will try to locate an ISO (or other) standard for describing frequencies. It was agreed that an "other" option should be provided in case the study has a frequency not provided by the given choices. It was mentioned that frequency could apply to groups of studies (e.g. a periodic survey that is done annually), a single study (a time series with annual data), or a variable (a data set with annual data for some variables and quarterly data for others). Therefore it was mentioned that frequency may be helpful as a reusable class that could be applied at the variable level as well. The group agreed that next week should be the last phone conference to discuss time, after which (or even starting in the next meeting, if possible) they would move onto aggregate data. In order to do this, J will need to incorporate today's and previous time discussions into a spreadsheet (similar to the one for geography), looking at the structure outlined in the TemporalCoverage section of the "reusable classes" sheet of the spreadsheet, DDI-Version3-SRG_TagNames.xls. The group will then review this, and the date stamps, at the next meeting, and make final decisions on time. ___________________________________________ Katherine McNeill-Harman Data Services Librarian Dewey Library for Management and Social Sciences Massachusetts Institute of Technology 77 Massachusetts Avenue, E53-100 Cambridge, MA 02139 mcneillh@mit.edu 617-253-0787 _______________________________________________ DDI-ADG mailing list DDI-ADG@icpsr.umich.edu http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg -------------- next part -------------- A non-text attachment was scrubbed... Name: HolidayADG.doc Type: application/msword Size: 1101824 bytes Desc: HolidayADG.doc Url : http://www.icpsr.umich.edu/pipermail/ddi-adg/attachments/20050802/193955a5/HolidayADG-0001.doc From wlt at pop.umn.edu Tue Aug 2 12:42:50 2005 From: wlt at pop.umn.edu (Wendy Thomas) Date: Tue Aug 2 12:43:02 2005 Subject: [DDI-ADG] minutes, DDI-ADG conference call 8/2/05 In-Reply-To: <8839697C62E81B4097C7BFFC8F0E6A0102A78B25@sernt14.essex.ac.uk> Message-ID: and I am...insanely jealous that is :-) wendy On Tue, 2 Aug 2005, Miller, Kenneth P wrote: > Hi > > The following are possible candidates for date stamping, since they > contain a URI. Default in majority of cases is probably the > of the xml, but do they need an override? > > 1.1 citation? (ATT == ID, xml-lang, source, MARCURI) > 1.1.4.1 distrbtr* (ATT == ID, xml-lang, source, abbr, affiliation, URI) > > 1.1.4.2 contact* (ATT == ID, xml-lang, source, affiliation, URI, email) > > 1.1.5 serStmt? (ATT == ID, xml-lang, source, URI) > 1.1.8 holdings* (ATT == ID, xml-lang, source, location, callno, URI, > media) > 1.4 docSrc* (ATT == ID, xml-lang, source, MARCURI) > 2.2.1.1 keyword* (ATT == ID, xml-lang, source, vocab, vocabURI) > 2.2.1.2 topcClas* (ATT == ID, xml-lang, source, vocab, vocabURI) > 2.2.3.3.2 concept (ATT == ID, xml-lang, source, vocab, vocabURI) > 2.4.1.1 accsPlac* (ATT == ID, xml-lang, source, URI) > 2.4.2.1 confDec? (ATT == ID, xml-lang, source, required, formNo, URI) > 2.4.2.2 specPerm? (ATT == ID, xml-lang, source, required, formNo, URI) > 3.0 fileDscr* (ATT == ID, xml-lang, source, URI, sdatrefs, methrefs, > pubrefs, access) > > 4.3.16 stdCatgry* (ATT == ID, xml-lang, source, date, URI) > > 4.3.17.2 catStat* (ATT == ID, xml-lang, source, type, URI, methrefs, > wgtd, wgt-var, weight, sdatrefs) > 4.3.23 varFormat? (ATT == ID, xml-lang, source, type, formatname, > schema, category, URI) > 4.3.24 geoMap* (ATT == ID, xml-lang, source, URI, mapformat, levelno) > 4.4.11 purpose? (ATT == ID, xml-lang, source, sdatrefs, methrefs, > pubrefs, URI) > 5.0 otherMat* (ATT == ID, xml-lang, source, type, level, URI) > > Real reason for email is of course to make you insanely jealous by > including a holiday photo of where we were staying. > > Best regards ken > > > > -----Original Message----- > From: ddi-adg-bounces@icpsr.umich.edu > [mailto:ddi-adg-bounces@icpsr.umich.edu] On Behalf Of Katherine > McNeill-Harman > Sent: 02 August 2005 17:17 > To: ddi-adg@icpsr.umich.edu > Subject: [DDI-ADG] minutes, DDI-ADG conference call 8/2/05 > > Following are brief minutes from today's conference call (let me know > any > corrections that need to be made); J, please make note of action item #4 > > for which we volunteered you. > > Minutes > DDI Aggregate Data, Geography & Time Working Group > August 2, 2005, 11am-12pm U.S. EDT > Present: Sanda Ionescu, Kate McNeill-Harman (minutes), Ken Miller, Wendy > > Thomas, Mary Vardigan > > Action Items: > 1. Kate will forward to the SRG (addressed to Oliver Watteler) the time > method definitions she gathered for their use in creating the controlled > > vocabulary. She will remind them to include time method indicators for > stand-alone data files that might not be considered comparative data, > and > offer our group's help on this if needed. > 2. Kate will try to locate an ISO (or other) standard for describing > frequencies. > 3. Wendy and Sanda will review the DDI and pull out a list of elements > with > date stamps. > 4. J should summarize the time decisions to date in a spreadsheet > (similar > to the one for geography), looking at the structure outlined in the > TemporalCoverage section of the "reusable classes" sheet of the > spreadsheet, DDI-Version3-SRG_TagNames.xls. This should be done this > week > in order to provide time for review and comment before the next meeting. > > Minutes: > The group continued the discussion of time method. It was indicated > that > the Comparative Data Group will be developing suggested controlled > vocabulary for time method. Members agreed to send that group the > information gathered thus far on definitions for them to incorporate, > emphasizing their need to include aspects of time method that may not > refer > to families of datasets. > > Members then discussed the role of administrative dates and how those > should relate to the content-related dates discussed thus far. This > included a discussion of the role of versions. Wendy reported that the > SRG > will be working on this. > > It was also agreed that it would be helpful to review how dates are used > > throughout the DDI. For example, it might be helpful to have date > stamps > in multiple other elements to serve as placeholders for authors to > remind > them that they might want to indicate the date aspect of a particular > element. Wendy and Sanda volunteered to do this. > > Members agreed to have frequency as a strongly-typed variable with a > controlled vocabulary. Kate will try to locate an ISO (or other) > standard > for describing frequencies. It was agreed that an "other" option should > be > provided in case the study has a frequency not provided by the given > choices. It was mentioned that frequency could apply to groups of > studies > (e.g. a periodic survey that is done annually), a single study (a time > series with annual data), or a variable (a data set with annual data for > > some variables and quarterly data for others). Therefore it was > mentioned > that frequency may be helpful as a reusable class that could be applied > at > the variable level as well. > > The group agreed that next week should be the last phone conference to > discuss time, after which (or even starting in the next meeting, if > possible) they would move onto aggregate data. In order to do this, J > will > need to incorporate today's and previous time discussions into a > spreadsheet (similar to the one for geography), looking at the structure > > outlined in the TemporalCoverage section of the "reusable classes" sheet > of > the spreadsheet, DDI-Version3-SRG_TagNames.xls. The group will then > review > this, and the date stamps, at the next meeting, and make final decisions > on > time. > > ___________________________________________ > Katherine McNeill-Harman > Data Services Librarian > Dewey Library for Management and Social Sciences > Massachusetts Institute of Technology > 77 Massachusetts Avenue, E53-100 > Cambridge, MA 02139 > mcneillh@mit.edu > 617-253-0787 > > _______________________________________________ > DDI-ADG mailing list > DDI-ADG@icpsr.umich.edu > http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg > Wendy L. Thomas Phone: +1 612.624.4389 Data Access Core Director Fax: +1 612.626.8375 Minnesota Population Center Email: wlt@pop.umn.edu University of Minnesota 50 Willey Hall 225 19th Avenue South Minneapolis, MN 55455 From maryv at icpsr.umich.edu Tue Aug 2 12:46:13 2005 From: maryv at icpsr.umich.edu (Mary Vardigan) Date: Tue Aug 2 12:46:20 2005 Subject: [DDI-ADG] minutes, DDI-ADG conference call 8/2/05 In-Reply-To: <8839697C62E81B4097C7BFFC8F0E6A0102A78B25@sernt14.essex.ac. uk> References: <8839697C62E81B4097C7BFFC8F0E6A0102A78B25@sernt14.essex.ac.uk> Message-ID: <6.0.1.1.2.20050802124459.02d65398@icpsr.umich.edu> I'm jealous, too! Maybe we can all tag along to Brittany with you next year? Mary At 12:37 PM 8/2/2005, Miller, Kenneth P wrote: >Hi > >The following are possible candidates for date stamping, since they >contain a URI. Default in majority of cases is probably the >of the xml, but do they need an override? > >1.1 citation? (ATT == ID, xml-lang, source, MARCURI) >1.1.4.1 distrbtr* (ATT == ID, xml-lang, source, abbr, affiliation, URI) > >1.1.4.2 contact* (ATT == ID, xml-lang, source, affiliation, URI, email) > >1.1.5 serStmt? (ATT == ID, xml-lang, source, URI) >1.1.8 holdings* (ATT == ID, xml-lang, source, location, callno, URI, >media) >1.4 docSrc* (ATT == ID, xml-lang, source, MARCURI) >2.2.1.1 keyword* (ATT == ID, xml-lang, source, vocab, vocabURI) >2.2.1.2 topcClas* (ATT == ID, xml-lang, source, vocab, vocabURI) >2.2.3.3.2 concept (ATT == ID, xml-lang, source, vocab, vocabURI) >2.4.1.1 accsPlac* (ATT == ID, xml-lang, source, URI) >2.4.2.1 confDec? (ATT == ID, xml-lang, source, required, formNo, URI) >2.4.2.2 specPerm? (ATT == ID, xml-lang, source, required, formNo, URI) >3.0 fileDscr* (ATT == ID, xml-lang, source, URI, sdatrefs, methrefs, >pubrefs, access) > >4.3.16 stdCatgry* (ATT == ID, xml-lang, source, date, URI) > >4.3.17.2 catStat* (ATT == ID, xml-lang, source, type, URI, methrefs, >wgtd, wgt-var, weight, sdatrefs) >4.3.23 varFormat? (ATT == ID, xml-lang, source, type, formatname, >schema, category, URI) >4.3.24 geoMap* (ATT == ID, xml-lang, source, URI, mapformat, levelno) >4.4.11 purpose? (ATT == ID, xml-lang, source, sdatrefs, methrefs, >pubrefs, URI) >5.0 otherMat* (ATT == ID, xml-lang, source, type, level, URI) > >Real reason for email is of course to make you insanely jealous by >including a holiday photo of where we were staying. > >Best regards ken > > > >-----Original Message----- >From: ddi-adg-bounces@icpsr.umich.edu >[mailto:ddi-adg-bounces@icpsr.umich.edu] On Behalf Of Katherine >McNeill-Harman >Sent: 02 August 2005 17:17 >To: ddi-adg@icpsr.umich.edu >Subject: [DDI-ADG] minutes, DDI-ADG conference call 8/2/05 > >Following are brief minutes from today's conference call (let me know >any >corrections that need to be made); J, please make note of action item #4 > >for which we volunteered you. > >Minutes >DDI Aggregate Data, Geography & Time Working Group >August 2, 2005, 11am-12pm U.S. EDT >Present: Sanda Ionescu, Kate McNeill-Harman (minutes), Ken Miller, Wendy > >Thomas, Mary Vardigan > >Action Items: >1. Kate will forward to the SRG (addressed to Oliver Watteler) the time >method definitions she gathered for their use in creating the controlled > >vocabulary. She will remind them to include time method indicators for >stand-alone data files that might not be considered comparative data, >and >offer our group's help on this if needed. >2. Kate will try to locate an ISO (or other) standard for describing >frequencies. >3. Wendy and Sanda will review the DDI and pull out a list of elements >with >date stamps. >4. J should summarize the time decisions to date in a spreadsheet >(similar >to the one for geography), looking at the structure outlined in the >TemporalCoverage section of the "reusable classes" sheet of the >spreadsheet, DDI-Version3-SRG_TagNames.xls. This should be done this >week >in order to provide time for review and comment before the next meeting. > >Minutes: >The group continued the discussion of time method. It was indicated >that >the Comparative Data Group will be developing suggested controlled >vocabulary for time method. Members agreed to send that group the >information gathered thus far on definitions for them to incorporate, >emphasizing their need to include aspects of time method that may not >refer >to families of datasets. > >Members then discussed the role of administrative dates and how those >should relate to the content-related dates discussed thus far. This >included a discussion of the role of versions. Wendy reported that the >SRG >will be working on this. > >It was also agreed that it would be helpful to review how dates are used > >throughout the DDI. For example, it might be helpful to have date >stamps >in multiple other elements to serve as placeholders for authors to >remind >them that they might want to indicate the date aspect of a particular >element. Wendy and Sanda volunteered to do this. > >Members agreed to have frequency as a strongly-typed variable with a >controlled vocabulary. Kate will try to locate an ISO (or other) >standard >for describing frequencies. It was agreed that an "other" option should >be >provided in case the study has a frequency not provided by the given >choices. It was mentioned that frequency could apply to groups of >studies >(e.g. a periodic survey that is done annually), a single study (a time >series with annual data), or a variable (a data set with annual data for > >some variables and quarterly data for others). Therefore it was >mentioned >that frequency may be helpful as a reusable class that could be applied >at >the variable level as well. > >The group agreed that next week should be the last phone conference to >discuss time, after which (or even starting in the next meeting, if >possible) they would move onto aggregate data. In order to do this, J >will >need to incorporate today's and previous time discussions into a >spreadsheet (similar to the one for geography), looking at the structure > >outlined in the TemporalCoverage section of the "reusable classes" sheet >of >the spreadsheet, DDI-Version3-SRG_TagNames.xls. The group will then >review >this, and the date stamps, at the next meeting, and make final decisions >on >time. > >___________________________________________ >Katherine McNeill-Harman >Data Services Librarian >Dewey Library for Management and Social Sciences >Massachusetts Institute of Technology >77 Massachusetts Avenue, E53-100 >Cambridge, MA 02139 >mcneillh@mit.edu >617-253-0787 > >_______________________________________________ >DDI-ADG mailing list >DDI-ADG@icpsr.umich.edu >http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg > >_______________________________________________ >DDI-ADG mailing list >DDI-ADG@icpsr.umich.edu >http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg Mary Vardigan Director, Collection Delivery Inter-university Consortium for Political and Social Research (ICPSR) University of Michigan P.O. Box 1248, Ann Arbor, MI 48106-1248 Phone: 734-615-7908 Fax: 734-647-8200 www.icpsr.umich.edu From mcneillh at MIT.EDU Tue Aug 2 14:35:23 2005 From: mcneillh at MIT.EDU (Katherine McNeill-Harman) Date: Tue Aug 2 14:36:01 2005 Subject: [DDI-ADG] time method controlled vocabulary (Attention: Oliver) Message-ID: <5.2.1.1.2.20050802142238.043c47a0@po11.mit.edu> Oliver (and other members of the SRG), We in the Aggregate Data, Geography & Time Working Group have been considering various time-related elements in the DDI, including 2.3.1.1 (time method). In doing so, we investigated different definitions of items that could be included in this element (e.g. "panel survey") to see how controlled the vocabulary in this element could be. In the process, we learned from Wendy Thomas that the Comparative Data Group will be responsible for recommending controlled vocabulary for this element, as it often relates to groups of related datasets. Oliver, as you are chair of that group, we wanted to pass onto you the information that we collected thus far for your use. I went through several social science methods reference books and compiled the attached list of different survey definitions. It's a lengthy Word document (if you can't read this format, I'll put it in a plain-text email to you). Pages 1-14 are organized by topics, with the different definitions for a topic listed on a single page; pages 15-20 are the definitions organized by their source. It is our hope that this will be helpful to you in selecting vocabulary for this element. However, we would like to call your attention to the fact that this element describes the time method used in creating a data set, but this is not limited to groups or families of data sets. For example, some of the options for this element (e.g. cross-section, time series) could refer to a stand-alone data set with no connection to others in a group. We trust that you will keep this in mind in formatting this element. If our group can provide yours any assistance in this project, or if you have any questions about this, please feel free to contact us. Sincerely, Kate McNeill-Harman for the Aggregate Data, Geography & Time Working Group ddi-adg@icpsr.umich.edu ___________________________________________ Katherine McNeill-Harman Data Services Librarian Dewey Library for Management and Social Sciences Massachusetts Institute of Technology 77 Massachusetts Avenue, E53-100 Cambridge, MA 02139 mcneillh@mit.edu 617-253-0787 -------------- next part -------------- A non-text attachment was scrubbed... Name: Survey definitions.doc Type: application/msword Size: 68608 bytes Desc: not available Url : http://www.icpsr.umich.edu/pipermail/ddi-adg/attachments/20050802/d15db5b0/Surveydefinitions-0001.doc From mcneillh at MIT.EDU Tue Aug 2 15:28:45 2005 From: mcneillh at MIT.EDU (Katherine McNeill-Harman) Date: Tue Aug 2 15:29:00 2005 Subject: [DDI-ADG] standards for frequency (or lack thereof) Message-ID: <5.2.1.1.2.20050802151217.01582620@po11.mit.edu> Hi everyone, I've looked around fruitlessly for any standard list of frequencies. I looked at the ISO web site, but wasn't able to navigate to anything helpful (maybe someone else is more familiar). I did various web searches, to no avail. I looked on the web sites and in reference books for bodies that I know collect/publish data at certain frequencies (e.g. IMF, World Bank). I even looked in the dictionaries in which I found the other definitions, and several economic dictionaries. None of the sources above define/list these terms in any way. I'm beginning to wonder if terms may be too taken-for-granted to be listed in a structured way. However, if nothing else, we could just go to a regular English dictionary for definitions of the terms. For example, my Websters Collegiate Dictionary defines quarterly as "recurring, issued, or spaced at 3-month intervals." This was the best that I found anywhere. This wouldn't take care of our need for a list from which to work in the first place, but I expect we'd be able to brainstorm most. (and then the "other" option would cover the rest) Maybe others have other ideas or techniques they could try, but I think I'm stuck. Kate ___________________________________________ Katherine McNeill-Harman Data Services Librarian Dewey Library for Management and Social Sciences Massachusetts Institute of Technology 77 Massachusetts Avenue, E53-100 Cambridge, MA 02139 mcneillh@mit.edu 617-253-0787 From Sandra.A.Cannon at frb.gov Tue Aug 2 16:24:10 2005 From: Sandra.A.Cannon at frb.gov (Sandra.A.Cannon@frb.gov) Date: Tue Aug 2 16:24:24 2005 Subject: [DDI-ADG] standards for frequency (or lack thereof) In-Reply-To: <5.2.1.1.2.20050802151217.01582620@po11.mit.edu> Message-ID: Kate, This may be where using common definitions from time series data would be useful. There are many possible frequencies in the software that we use (which Arofan says they are contemplating building into SDMX). I don't know if it's authoritative or definitive but it certainly seems to be exhaustive. I've attached a listing in a PDF of an internal webpage I support here. More food for thought.... /san/ who is sorry she is going on holiday this week and will miss the next several calls on this topic... well, not very sorry... ;-) (See attached file: freq.pdf) ------------------------------------------------- San Cannon Chief, Economic Information Management Federal Reserve Board Washington DC 20551 (202) 452-3710 scannon@frb.gov Katherine McNeill-Harman ddi-adg@icpsr.umich.edu Sent by: cc ddi-adg-bounces@i cpsr.umich.edu Subject [DDI-ADG] standards for frequency (or lack thereof) 08/02/2005 03:28 PM Hi everyone, I've looked around fruitlessly for any standard list of frequencies. I looked at the ISO web site, but wasn't able to navigate to anything helpful (maybe someone else is more familiar). I did various web searches, to no avail. I looked on the web sites and in reference books for bodies that I know collect/publish data at certain frequencies (e.g. IMF, World Bank). I even looked in the dictionaries in which I found the other definitions, and several economic dictionaries. None of the sources above define/list these terms in any way. I'm beginning to wonder if terms may be too taken-for-granted to be listed in a structured way. However, if nothing else, we could just go to a regular English dictionary for definitions of the terms. For example, my Websters Collegiate Dictionary defines quarterly as "recurring, issued, or spaced at 3-month intervals." This was the best that I found anywhere. This wouldn't take care of our need for a list from which to work in the first place, but I expect we'd be able to brainstorm most. (and then the "other" option would cover the rest) Maybe others have other ideas or techniques they could try, but I think I'm stuck. Kate ___________________________________________ Katherine McNeill-Harman Data Services Librarian Dewey Library for Management and Social Sciences Massachusetts Institute of Technology 77 Massachusetts Avenue, E53-100 Cambridge, MA 02139 mcneillh@mit.edu 617-253-0787 _______________________________________________ DDI-ADG mailing list DDI-ADG@icpsr.umich.edu http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg -------------- next part -------------- A non-text attachment was scrubbed... Name: freq.pdf Type: application/pdf Size: 15023 bytes Desc: not available Url : http://www.icpsr.umich.edu/pipermail/ddi-adg/attachments/20050802/77e63f91/freq.pdf From mcneillh at MIT.EDU Wed Aug 3 09:06:07 2005 From: mcneillh at MIT.EDU (Katherine McNeill-Harman) Date: Wed Aug 3 09:06:26 2005 Subject: [DDI-ADG] minutes, DDI-ADG conference call 8/2/05 In-Reply-To: References: <5.2.1.1.2.20050802115113.01654880@po11.mit.edu> Message-ID: <5.2.1.1.2.20050803090316.043fbc58@po11.mit.edu> Revision to the minutes: - I intentded to put "Mary and Sanda will review..."; my brain must have swapped the two names ending in a "y"-- I'll send them out again. - We know that Oliver chairs the CDG, but had down that you suggested to send it to the SRG for their information, but address it to Oliver as the chair of the CDG. If you think my email to them was unclear, feel free to reply and add any additional info. Kate At 11:31 AM 8/2/2005 -0500, Wendy Thomas wrote: >Just a couple of comments. Oliver chairs the CDG (comparative) rather than >the SRG (structural reform). Um...I didn't volunteer to go through those >tags and will have no time to do so. Sorry about that, but I've really got >my hands full with the SRG. > >Wendy > >On Tue, 2 Aug 2005, Katherine McNeill-Harman wrote: > > > Following are brief minutes from today's conference call (let me know any > > corrections that need to be made); J, please make note of action item #4 > > for which we volunteered you. > > > > Minutes > > DDI Aggregate Data, Geography & Time Working Group > > August 2, 2005, 11am-12pm U.S. EDT > > Present: Sanda Ionescu, Kate McNeill-Harman (minutes), Ken Miller, Wendy > > Thomas, Mary Vardigan > > > > Action Items: > > 1. Kate will forward to the SRG (addressed to Oliver Watteler) the time > > method definitions she gathered for their use in creating the controlled > > vocabulary. She will remind them to include time method indicators for > > stand-alone data files that might not be considered comparative data, and > > offer our group's help on this if needed. > > 2. Kate will try to locate an ISO (or other) standard for describing > > frequencies. > > 3. Wendy and Sanda will review the DDI and pull out a list of elements with > > date stamps. > > 4. J should summarize the time decisions to date in a spreadsheet (similar > > to the one for geography), looking at the structure outlined in the > > TemporalCoverage section of the "reusable classes" sheet of the > > spreadsheet, DDI-Version3-SRG_TagNames.xls. This should be done this week > > in order to provide time for review and comment before the next meeting. > > > > Minutes: > > The group continued the discussion of time method. It was indicated that > > the Comparative Data Group will be developing suggested controlled > > vocabulary for time method. Members agreed to send that group the > > information gathered thus far on definitions for them to incorporate, > > emphasizing their need to include aspects of time method that may not refer > > to families of datasets. > > > > Members then discussed the role of administrative dates and how those > > should relate to the content-related dates discussed thus far. This > > included a discussion of the role of versions. Wendy reported that the SRG > > will be working on this. > > > > It was also agreed that it would be helpful to review how dates are used > > throughout the DDI. For example, it might be helpful to have date stamps > > in multiple other elements to serve as placeholders for authors to remind > > them that they might want to indicate the date aspect of a particular > > element. Wendy and Sanda volunteered to do this. > > > > Members agreed to have frequency as a strongly-typed variable with a > > controlled vocabulary. Kate will try to locate an ISO (or other) standard > > for describing frequencies. It was agreed that an "other" option should be > > provided in case the study has a frequency not provided by the given > > choices. It was mentioned that frequency could apply to groups of studies > > (e.g. a periodic survey that is done annually), a single study (a time > > series with annual data), or a variable (a data set with annual data for > > some variables and quarterly data for others). Therefore it was mentioned > > that frequency may be helpful as a reusable class that could be applied at > > the variable level as well. > > > > The group agreed that next week should be the last phone conference to > > discuss time, after which (or even starting in the next meeting, if > > possible) they would move onto aggregate data. In order to do this, J will > > need to incorporate today's and previous time discussions into a > > spreadsheet (similar to the one for geography), looking at the structure > > outlined in the TemporalCoverage section of the "reusable classes" sheet of > > the spreadsheet, DDI-Version3-SRG_TagNames.xls. The group will then review > > this, and the date stamps, at the next meeting, and make final decisions on > > time. > > > > ___________________________________________ > > Katherine McNeill-Harman > > Data Services Librarian > > Dewey Library for Management and Social Sciences > > Massachusetts Institute of Technology > > 77 Massachusetts Avenue, E53-100 > > Cambridge, MA 02139 > > mcneillh@mit.edu > > 617-253-0787 > > > > _______________________________________________ > > DDI-ADG mailing list > > DDI-ADG@icpsr.umich.edu > > http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg > > > >Wendy L. Thomas Phone: +1 612.624.4389 >Data Access Core Director Fax: +1 612.626.8375 >Minnesota Population Center Email: wlt@pop.umn.edu >University of Minnesota >50 Willey Hall >225 19th Avenue South >Minneapolis, MN 55455 ___________________________________________ Katherine McNeill-Harman Data Services Librarian Dewey Library for Management and Social Sciences Massachusetts Institute of Technology 77 Massachusetts Avenue, E53-100 Cambridge, MA 02139 mcneillh@mit.edu 617-253-0787 From mcneillh at MIT.EDU Wed Aug 3 09:08:38 2005 From: mcneillh at MIT.EDU (Katherine McNeill-Harman) Date: Wed Aug 3 09:08:55 2005 Subject: [DDI-ADG] revised minutes, DDI-ADG conference call 8/2/05 Message-ID: <5.2.1.1.2.20050803090632.015e6288@po11.mit.edu> Following are the revised minutes from yesterday's conference call: Revised Minutes DDI Aggregate Data, Geography & Time Working Group August 2, 2005, 11am-12pm U.S. EDT Present: Sanda Ionescu, Kate McNeill-Harman (minutes), Ken Miller, Wendy Thomas, Mary Vardigan Action Items: 1. Kate will forward to the SRG (addressed to Oliver Watteler, a member of that group and chair of the Comparative Data Group) the time method definitions she gathered for their use in creating the controlled vocabulary. She will remind them to include time method indicators for stand-alone data files that might not be considered comparative data, and offer our group's help on this if needed. 2. Kate will try to locate an ISO (or other) standard for describing frequencies. 3. Mary and Sanda will review the DDI and pull out a list of elements with date stamps. 4. J should summarize the time decisions to date in a spreadsheet (similar to the one for geography), looking at the structure outlined in the TemporalCoverage section of the "reusable classes" sheet of the spreadsheet, DDI-Version3-SRG_TagNames.xls. This should be done this week in order to provide time for review and comment before the next meeting. Minutes: The group continued the discussion of time method. It was indicated that the Comparative Data Group will be developing suggested controlled vocabulary for time method. Members agreed to send that group (via Oliver Watteler, the chair) the information gathered thus far on definitions for them to incorporate, emphasizing their need to include aspects of time method that may not refer to families of datasets. Members then discussed the role of administrative dates and how those should relate to the content-related dates discussed thus far. This included a discussion of the role of versions. Wendy reported that the SRG will be working on this. It was also agreed that it would be helpful to review how dates are used throughout the DDI. For example, it might be helpful to have date stamps in multiple other elements to serve as placeholders for authors to remind them that they might want to indicate the date aspect of a particular element. Mary and Sanda volunteered to do this. Members agreed to have frequency as a strongly-typed variable with a controlled vocabulary. Kate will try to locate an ISO (or other) standard for describing frequencies. It was agreed that an "other" option should be provided in case the study has a frequency not provided by the given choices. It was mentioned that frequency could apply to groups of studies (e.g. a periodic survey that is done annually), a single study (a time series with annual data), or a variable (a data set with annual data for some variables and quarterly data for others). Therefore it was mentioned that frequency may be helpful as a reusable class that could be applied at the variable level as well. The group agreed that next week should be the last phone conference to discuss time, after which (or even starting in the next meeting, if possible) they would move onto aggregate data. In order to do this, J will need to incorporate today's and previous time discussions into a spreadsheet (similar to the one for geography), looking at the structure outlined in the TemporalCoverage section of the "reusable classes" sheet of the spreadsheet, DDI-Version3-SRG_TagNames.xls. The group will then review this, and the date stamps, at the next meeting, and make final decisions on time. ___________________________________________ Katherine McNeill-Harman Data Services Librarian Dewey Library for Management and Social Sciences Massachusetts Institute of Technology 77 Massachusetts Avenue, E53-100 Cambridge, MA 02139 mcneillh@mit.edu 617-253-0787 From wlt at pop.umn.edu Wed Aug 3 09:30:07 2005 From: wlt at pop.umn.edu (Wendy Thomas) Date: Wed Aug 3 09:30:52 2005 Subject: [DDI-ADG] minutes, DDI-ADG conference call 8/2/05 In-Reply-To: <5.2.1.1.2.20050803090316.043fbc58@po11.mit.edu> Message-ID: Thanks. As for Oliver, yes that will work. It just wasn't clear that there was a difference. But then again...it could just be my fuddled mind :-) wendy On Wed, 3 Aug 2005, Katherine McNeill-Harman wrote: > Revision to the minutes: > - I intentded to put "Mary and Sanda will review..."; my brain must have > swapped the two names ending in a "y"-- I'll send them out again. > - We know that Oliver chairs the CDG, but had down that you suggested to > send it to the SRG for their information, but address it to Oliver as the > chair of the CDG. If you think my email to them was unclear, feel free to > reply and add any additional info. > > Kate > > At 11:31 AM 8/2/2005 -0500, Wendy Thomas wrote: > >Just a couple of comments. Oliver chairs the CDG (comparative) rather than > >the SRG (structural reform). Um...I didn't volunteer to go through those > >tags and will have no time to do so. Sorry about that, but I've really got > >my hands full with the SRG. > > > >Wendy > > > >On Tue, 2 Aug 2005, Katherine McNeill-Harman wrote: > > > > > Following are brief minutes from today's conference call (let me know any > > > corrections that need to be made); J, please make note of action item #4 > > > for which we volunteered you. > > > > > > Minutes > > > DDI Aggregate Data, Geography & Time Working Group > > > August 2, 2005, 11am-12pm U.S. EDT > > > Present: Sanda Ionescu, Kate McNeill-Harman (minutes), Ken Miller, Wendy > > > Thomas, Mary Vardigan > > > > > > Action Items: > > > 1. Kate will forward to the SRG (addressed to Oliver Watteler) the time > > > method definitions she gathered for their use in creating the controlled > > > vocabulary. She will remind them to include time method indicators for > > > stand-alone data files that might not be considered comparative data, and > > > offer our group's help on this if needed. > > > 2. Kate will try to locate an ISO (or other) standard for describing > > > frequencies. > > > 3. Wendy and Sanda will review the DDI and pull out a list of elements with > > > date stamps. > > > 4. J should summarize the time decisions to date in a spreadsheet (similar > > > to the one for geography), looking at the structure outlined in the > > > TemporalCoverage section of the "reusable classes" sheet of the > > > spreadsheet, DDI-Version3-SRG_TagNames.xls. This should be done this week > > > in order to provide time for review and comment before the next meeting. > > > > > > Minutes: > > > The group continued the discussion of time method. It was indicated that > > > the Comparative Data Group will be developing suggested controlled > > > vocabulary for time method. Members agreed to send that group the > > > information gathered thus far on definitions for them to incorporate, > > > emphasizing their need to include aspects of time method that may not refer > > > to families of datasets. > > > > > > Members then discussed the role of administrative dates and how those > > > should relate to the content-related dates discussed thus far. This > > > included a discussion of the role of versions. Wendy reported that the SRG > > > will be working on this. > > > > > > It was also agreed that it would be helpful to review how dates are used > > > throughout the DDI. For example, it might be helpful to have date stamps > > > in multiple other elements to serve as placeholders for authors to remind > > > them that they might want to indicate the date aspect of a particular > > > element. Wendy and Sanda volunteered to do this. > > > > > > Members agreed to have frequency as a strongly-typed variable with a > > > controlled vocabulary. Kate will try to locate an ISO (or other) standard > > > for describing frequencies. It was agreed that an "other" option should be > > > provided in case the study has a frequency not provided by the given > > > choices. It was mentioned that frequency could apply to groups of studies > > > (e.g. a periodic survey that is done annually), a single study (a time > > > series with annual data), or a variable (a data set with annual data for > > > some variables and quarterly data for others). Therefore it was mentioned > > > that frequency may be helpful as a reusable class that could be applied at > > > the variable level as well. > > > > > > The group agreed that next week should be the last phone conference to > > > discuss time, after which (or even starting in the next meeting, if > > > possible) they would move onto aggregate data. In order to do this, J will > > > need to incorporate today's and previous time discussions into a > > > spreadsheet (similar to the one for geography), looking at the structure > > > outlined in the TemporalCoverage section of the "reusable classes" sheet of > > > the spreadsheet, DDI-Version3-SRG_TagNames.xls. The group will then review > > > this, and the date stamps, at the next meeting, and make final decisions on > > > time. > > > > > > ___________________________________________ > > > Katherine McNeill-Harman > > > Data Services Librarian > > > Dewey Library for Management and Social Sciences > > > Massachusetts Institute of Technology > > > 77 Massachusetts Avenue, E53-100 > > > Cambridge, MA 02139 > > > mcneillh@mit.edu > > > 617-253-0787 > > > > > > _______________________________________________ > > > DDI-ADG mailing list > > > DDI-ADG@icpsr.umich.edu > > > http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg > > > > > > >Wendy L. Thomas Phone: +1 612.624.4389 > >Data Access Core Director Fax: +1 612.626.8375 > >Minnesota Population Center Email: wlt@pop.umn.edu > >University of Minnesota > >50 Willey Hall > >225 19th Avenue South > >Minneapolis, MN 55455 > > ___________________________________________ > Katherine McNeill-Harman > Data Services Librarian > Dewey Library for Management and Social Sciences > Massachusetts Institute of Technology > 77 Massachusetts Avenue, E53-100 > Cambridge, MA 02139 > mcneillh@mit.edu > 617-253-0787 > Wendy L. Thomas Phone: +1 612.624.4389 Data Access Core Director Fax: +1 612.626.8375 Minnesota Population Center Email: wlt@pop.umn.edu University of Minnesota 50 Willey Hall 225 19th Avenue South Minneapolis, MN 55455 From maryv at icpsr.umich.edu Wed Aug 3 14:18:13 2005 From: maryv at icpsr.umich.edu (Mary Vardigan) Date: Wed Aug 3 14:18:24 2005 Subject: [DDI-ADG] minutes, DDI-ADG conference call 8/2/05 In-Reply-To: <8839697C62E81B4097C7BFFC8F0E6A0102A78B25@sernt14.essex.ac. uk> References: <8839697C62E81B4097C7BFFC8F0E6A0102A78B25@sernt14.essex.ac.uk> Message-ID: <6.0.1.1.2.20050803141454.02ad2398@icpsr.umich.edu> Attached is a list of all of the fields in Version 2.0 that have "date" attributes. We will probably want to talk about this and Ken's list below on Tuesday. Mary At 12:37 PM 8/2/2005, Miller, Kenneth P wrote: >Hi > >The following are possible candidates for date stamping, since they >contain a URI. Default in majority of cases is probably the >of the xml, but do they need an override? > >1.1 citation? (ATT == ID, xml-lang, source, MARCURI) >1.1.4.1 distrbtr* (ATT == ID, xml-lang, source, abbr, affiliation, URI) > >1.1.4.2 contact* (ATT == ID, xml-lang, source, affiliation, URI, email) > >1.1.5 serStmt? (ATT == ID, xml-lang, source, URI) >1.1.8 holdings* (ATT == ID, xml-lang, source, location, callno, URI, >media) >1.4 docSrc* (ATT == ID, xml-lang, source, MARCURI) >2.2.1.1 keyword* (ATT == ID, xml-lang, source, vocab, vocabURI) >2.2.1.2 topcClas* (ATT == ID, xml-lang, source, vocab, vocabURI) >2.2.3.3.2 concept (ATT == ID, xml-lang, source, vocab, vocabURI) >2.4.1.1 accsPlac* (ATT == ID, xml-lang, source, URI) >2.4.2.1 confDec? (ATT == ID, xml-lang, source, required, formNo, URI) >2.4.2.2 specPerm? (ATT == ID, xml-lang, source, required, formNo, URI) >3.0 fileDscr* (ATT == ID, xml-lang, source, URI, sdatrefs, methrefs, >pubrefs, access) > >4.3.16 stdCatgry* (ATT == ID, xml-lang, source, date, URI) > >4.3.17.2 catStat* (ATT == ID, xml-lang, source, type, URI, methrefs, >wgtd, wgt-var, weight, sdatrefs) >4.3.23 varFormat? (ATT == ID, xml-lang, source, type, formatname, >schema, category, URI) >4.3.24 geoMap* (ATT == ID, xml-lang, source, URI, mapformat, levelno) >4.4.11 purpose? (ATT == ID, xml-lang, source, sdatrefs, methrefs, >pubrefs, URI) >5.0 otherMat* (ATT == ID, xml-lang, source, type, level, URI) > >Real reason for email is of course to make you insanely jealous by >including a holiday photo of where we were staying. > >Best regards ken > > > >-----Original Message----- >From: ddi-adg-bounces@icpsr.umich.edu >[mailto:ddi-adg-bounces@icpsr.umich.edu] On Behalf Of Katherine >McNeill-Harman >Sent: 02 August 2005 17:17 >To: ddi-adg@icpsr.umich.edu >Subject: [DDI-ADG] minutes, DDI-ADG conference call 8/2/05 > >Following are brief minutes from today's conference call (let me know >any >corrections that need to be made); J, please make note of action item #4 > >for which we volunteered you. > >Minutes >DDI Aggregate Data, Geography & Time Working Group >August 2, 2005, 11am-12pm U.S. EDT >Present: Sanda Ionescu, Kate McNeill-Harman (minutes), Ken Miller, Wendy > >Thomas, Mary Vardigan > >Action Items: >1. Kate will forward to the SRG (addressed to Oliver Watteler) the time >method definitions she gathered for their use in creating the controlled > >vocabulary. She will remind them to include time method indicators for >stand-alone data files that might not be considered comparative data, >and >offer our group's help on this if needed. >2. Kate will try to locate an ISO (or other) standard for describing >frequencies. >3. Wendy and Sanda will review the DDI and pull out a list of elements >with >date stamps. >4. J should summarize the time decisions to date in a spreadsheet >(similar >to the one for geography), looking at the structure outlined in the >TemporalCoverage section of the "reusable classes" sheet of the >spreadsheet, DDI-Version3-SRG_TagNames.xls. This should be done this >week >in order to provide time for review and comment before the next meeting. > >Minutes: >The group continued the discussion of time method. It was indicated >that >the Comparative Data Group will be developing suggested controlled >vocabulary for time method. Members agreed to send that group the >information gathered thus far on definitions for them to incorporate, >emphasizing their need to include aspects of time method that may not >refer >to families of datasets. > >Members then discussed the role of administrative dates and how those >should relate to the content-related dates discussed thus far. This >included a discussion of the role of versions. Wendy reported that the >SRG >will be working on this. > >It was also agreed that it would be helpful to review how dates are used > >throughout the DDI. For example, it might be helpful to have date >stamps >in multiple other elements to serve as placeholders for authors to >remind >them that they might want to indicate the date aspect of a particular >element. Wendy and Sanda volunteered to do this. > >Members agreed to have frequency as a strongly-typed variable with a >controlled vocabulary. Kate will try to locate an ISO (or other) >standard >for describing frequencies. It was agreed that an "other" option should >be >provided in case the study has a frequency not provided by the given >choices. It was mentioned that frequency could apply to groups of >studies >(e.g. a periodic survey that is done annually), a single study (a time >series with annual data), or a variable (a data set with annual data for > >some variables and quarterly data for others). Therefore it was >mentioned >that frequency may be helpful as a reusable class that could be applied >at >the variable level as well. > >The group agreed that next week should be the last phone conference to >discuss time, after which (or even starting in the next meeting, if >possible) they would move onto aggregate data. In order to do this, J >will >need to incorporate today's and previous time discussions into a >spreadsheet (similar to the one for geography), looking at the structure > >outlined in the TemporalCoverage section of the "reusable classes" sheet >of >the spreadsheet, DDI-Version3-SRG_TagNames.xls. The group will then >review >this, and the date stamps, at the next meeting, and make final decisions >on >time. > >___________________________________________ >Katherine McNeill-Harman >Data Services Librarian >Dewey Library for Management and Social Sciences >Massachusetts Institute of Technology >77 Massachusetts Avenue, E53-100 >Cambridge, MA 02139 >mcneillh@mit.edu >617-253-0787 > >_______________________________________________ >DDI-ADG mailing list >DDI-ADG@icpsr.umich.edu >http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg > >_______________________________________________ >DDI-ADG mailing list >DDI-ADG@icpsr.umich.edu >http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg Mary Vardigan Director, Collection Delivery Inter-university Consortium for Political and Social Research (ICPSR) University of Michigan P.O. Box 1248, Ann Arbor, MI 48106-1248 Phone: 734-615-7908 Fax: 734-647-8200 www.icpsr.umich.edu -------------- next part -------------- A non-text attachment was scrubbed... Name: date-ddi.doc Type: application/msword Size: 51712 bytes Desc: not available Url : http://www.icpsr.umich.edu/pipermail/ddi-adg/attachments/20050803/b3c080a3/date-ddi-0001.doc From maryv at icpsr.umich.edu Wed Aug 3 14:34:51 2005 From: maryv at icpsr.umich.edu (Mary Vardigan) Date: Wed Aug 3 14:35:00 2005 Subject: [DDI-ADG] standards for frequency (or lack thereof) In-Reply-To: References: <5.2.1.1.2.20050802151217.01582620@po11.mit.edu> Message-ID: <6.0.1.1.2.20050803142942.02be59f8@icpsr.umich.edu> San, Kate, and others, This seems like a really good start on a controlled vocabulary for frequency. Do we need an additional indicator for something like the decennial U.S. Census? Mary At 04:24 PM 8/2/2005, Sandra.A.Cannon@frb.gov wrote: >Kate, >This may be where using common definitions from time series data would be >useful. There are many possible frequencies in the software that we use >(which Arofan says they are contemplating building into SDMX). I don't >know if it's authoritative or definitive but it certainly seems to be >exhaustive. I've attached a listing in a PDF of an internal webpage I >support here. > >More food for thought.... > >/san/ >who is sorry she is going on holiday this week and will miss the next >several calls on this topic... well, not very sorry... ;-) > >(See attached file: freq.pdf) > >------------------------------------------------- >San Cannon >Chief, Economic Information Management >Federal Reserve Board >Washington DC 20551 >(202) 452-3710 >scannon@frb.gov > > > > > Katherine > McNeill-Harman > > ddi-adg@icpsr.umich.edu > Sent by: cc > ddi-adg-bounces@i > cpsr.umich.edu Subject > [DDI-ADG] standards for frequency > (or lack thereof) > 08/02/2005 03:28 > PM > > > > > > > > >Hi everyone, > >I've looked around fruitlessly for any standard list of frequencies. I >looked at the ISO web site, but wasn't able to navigate to anything helpful > >(maybe someone else is more familiar). I did various web searches, to no >avail. I looked on the web sites and in reference books for bodies that I >know collect/publish data at certain frequencies (e.g. IMF, World Bank). >I even looked in the dictionaries in which I found the other definitions, >and several economic dictionaries. > >None of the sources above define/list these terms in any way. I'm >beginning to wonder if terms may be too taken-for-granted to be listed in a > >structured way. > >However, if nothing else, we could just go to a regular English dictionary >for definitions of the terms. For example, my Websters Collegiate >Dictionary defines quarterly as "recurring, issued, or spaced at 3-month >intervals." This was the best that I found anywhere. This wouldn't take >care of our need for a list from which to work in the first place, but I >expect we'd be able to brainstorm most. (and then the "other" option would >cover the rest) > >Maybe others have other ideas or techniques they could try, but I think I'm > >stuck. > >Kate > >___________________________________________ >Katherine McNeill-Harman >Data Services Librarian >Dewey Library for Management and Social Sciences >Massachusetts Institute of Technology >77 Massachusetts Avenue, E53-100 >Cambridge, MA 02139 >mcneillh@mit.edu >617-253-0787 > >_______________________________________________ >DDI-ADG mailing list >DDI-ADG@icpsr.umich.edu >http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg > >_______________________________________________ >DDI-ADG mailing list >DDI-ADG@icpsr.umich.edu >http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg Mary Vardigan Director, Collection Delivery Inter-university Consortium for Political and Social Research (ICPSR) University of Michigan P.O. Box 1248, Ann Arbor, MI 48106-1248 Phone: 734-615-7908 Fax: 734-647-8200 www.icpsr.umich.edu From Sandra.A.Cannon at frb.gov Wed Aug 3 14:39:46 2005 From: Sandra.A.Cannon at frb.gov (Sandra.A.Cannon@frb.gov) Date: Wed Aug 3 14:39:57 2005 Subject: [DDI-ADG] standards for frequency (or lack thereof) In-Reply-To: <6.0.1.1.2.20050803142942.02be59f8@icpsr.umich.edu> Message-ID: Mary, In the time series world, decennial wouldn't buy you much but in the panel study world the same doesn't hold. Is a particular indicator for decennial sufficient or would we be better to use the Yn indicator for such things? Then Y10 would be decennial and Y2 would be biennial, etc. I understand if decennial is considered special enough to have its own code though. /san/ ------------------------------------------------- San Cannon Chief, Economic Information Management Federal Reserve Board Washington DC 20551 (202) 452-3710 scannon@frb.gov Mary Vardigan To Sandra.A.Cannon@frb.gov, Katherine 08/03/2005 02:34 McNeill-Harman PM cc ddi-adg@icpsr.umich.edu Subject Re: [DDI-ADG] standards for frequency (or lack thereof) San, Kate, and others, This seems like a really good start on a controlled vocabulary for frequency. Do we need an additional indicator for something like the decennial U.S. Census? Mary At 04:24 PM 8/2/2005, Sandra.A.Cannon@frb.gov wrote: >Kate, >This may be where using common definitions from time series data would be >useful. There are many possible frequencies in the software that we use >(which Arofan says they are contemplating building into SDMX). I don't >know if it's authoritative or definitive but it certainly seems to be >exhaustive. I've attached a listing in a PDF of an internal webpage I >support here. > >More food for thought.... > >/san/ >who is sorry she is going on holiday this week and will miss the next >several calls on this topic... well, not very sorry... ;-) > >(See attached file: freq.pdf) > >------------------------------------------------- >San Cannon >Chief, Economic Information Management >Federal Reserve Board >Washington DC 20551 >(202) 452-3710 >scannon@frb.gov > > > > > Katherine > McNeill-Harman > > ddi-adg@icpsr.umich.edu > Sent by: cc > ddi-adg-bounces@i > cpsr.umich.edu Subject > [DDI-ADG] standards for frequency > (or lack thereof) > 08/02/2005 03:28 > PM > > > > > > > > >Hi everyone, > >I've looked around fruitlessly for any standard list of frequencies. I >looked at the ISO web site, but wasn't able to navigate to anything helpful > >(maybe someone else is more familiar). I did various web searches, to no >avail. I looked on the web sites and in reference books for bodies that I >know collect/publish data at certain frequencies (e.g. IMF, World Bank). >I even looked in the dictionaries in which I found the other definitions, >and several economic dictionaries. > >None of the sources above define/list these terms in any way. I'm >beginning to wonder if terms may be too taken-for-granted to be listed in a > >structured way. > >However, if nothing else, we could just go to a regular English dictionary >for definitions of the terms. For example, my Websters Collegiate >Dictionary defines quarterly as "recurring, issued, or spaced at 3-month >intervals." This was the best that I found anywhere. This wouldn't take >care of our need for a list from which to work in the first place, but I >expect we'd be able to brainstorm most. (and then the "other" option would >cover the rest) > >Maybe others have other ideas or techniques they could try, but I think I'm > >stuck. > >Kate > >___________________________________________ >Katherine McNeill-Harman >Data Services Librarian >Dewey Library for Management and Social Sciences >Massachusetts Institute of Technology >77 Massachusetts Avenue, E53-100 >Cambridge, MA 02139 >mcneillh@mit.edu >617-253-0787 > >_______________________________________________ >DDI-ADG mailing list >DDI-ADG@icpsr.umich.edu >http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg > >_______________________________________________ >DDI-ADG mailing list >DDI-ADG@icpsr.umich.edu >http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg Mary Vardigan Director, Collection Delivery Inter-university Consortium for Political and Social Research (ICPSR) University of Michigan P.O. Box 1248, Ann Arbor, MI 48106-1248 Phone: 734-615-7908 Fax: 734-647-8200 www.icpsr.umich.edu From maryv at icpsr.umich.edu Wed Aug 3 14:44:40 2005 From: maryv at icpsr.umich.edu (Mary Vardigan) Date: Wed Aug 3 14:44:47 2005 Subject: [DDI-ADG] standards for frequency (or lack thereof) In-Reply-To: References: <6.0.1.1.2.20050803142942.02be59f8@icpsr.umich.edu> Message-ID: <6.0.1.1.2.20050803144155.02be5c98@icpsr.umich.edu> I wasn't sure if Y10 would indicate ten years of data since the definition says "YPP n years per period" or data collected every 10th year. But if it's the latter, that would be great. Mary At 02:39 PM 8/3/2005, Sandra.A.Cannon@frb.gov wrote: >Mary, >In the time series world, decennial wouldn't buy you much but in the panel >study world the same doesn't hold. Is a particular indicator for decennial >sufficient or would we be better to use the Yn indicator for such things? >Then Y10 would be decennial and Y2 would be biennial, etc. I understand if >decennial is considered special enough to have its own code though. > >/san/ > > >------------------------------------------------- >San Cannon >Chief, Economic Information Management >Federal Reserve Board >Washington DC 20551 >(202) 452-3710 >scannon@frb.gov > > > > > Mary Vardigan > h.edu> To > Sandra.A.Cannon@frb.gov, Katherine > 08/03/2005 02:34 McNeill-Harman > PM cc > ddi-adg@icpsr.umich.edu > Subject > Re: [DDI-ADG] standards for > frequency (or lack thereof) > > > > > > > > > > >San, Kate, and others, > >This seems like a really good start on a controlled vocabulary for >frequency. Do we need an additional indicator for something like the >decennial U.S. Census? > >Mary > >At 04:24 PM 8/2/2005, Sandra.A.Cannon@frb.gov wrote: > > > > > >Kate, > >This may be where using common definitions from time series data would be > >useful. There are many possible frequencies in the software that we use > >(which Arofan says they are contemplating building into SDMX). I don't > >know if it's authoritative or definitive but it certainly seems to be > >exhaustive. I've attached a listing in a PDF of an internal webpage I > >support here. > > > >More food for thought.... > > > >/san/ > >who is sorry she is going on holiday this week and will miss the next > >several calls on this topic... well, not very sorry... ;-) > > > >(See attached file: freq.pdf) > > > >------------------------------------------------- > >San Cannon > >Chief, Economic Information Management > >Federal Reserve Board > >Washington DC 20551 > >(202) 452-3710 > >scannon@frb.gov > > > > > > > > > > Katherine > > McNeill-Harman > > To > > > ddi-adg@icpsr.umich.edu > > Sent by: >cc > > ddi-adg-bounces@i > > cpsr.umich.edu >Subject > > [DDI-ADG] standards for frequency > > (or lack thereof) > > 08/02/2005 03:28 > > PM > > > > > > > > > > > > > > > > > >Hi everyone, > > > >I've looked around fruitlessly for any standard list of frequencies. I > >looked at the ISO web site, but wasn't able to navigate to anything >helpful > > > >(maybe someone else is more familiar). I did various web searches, to no > >avail. I looked on the web sites and in reference books for bodies that I > >know collect/publish data at certain frequencies (e.g. IMF, World Bank). > >I even looked in the dictionaries in which I found the other definitions, > >and several economic dictionaries. > > > >None of the sources above define/list these terms in any way. I'm > >beginning to wonder if terms may be too taken-for-granted to be listed in >a > > > >structured way. > > > >However, if nothing else, we could just go to a regular English dictionary > >for definitions of the terms. For example, my Websters Collegiate > >Dictionary defines quarterly as "recurring, issued, or spaced at 3-month > >intervals." This was the best that I found anywhere. This wouldn't take > >care of our need for a list from which to work in the first place, but I > >expect we'd be able to brainstorm most. (and then the "other" option would > >cover the rest) > > > >Maybe others have other ideas or techniques they could try, but I think >I'm > > > >stuck. > > > >Kate > > > >___________________________________________ > >Katherine McNeill-Harman > >Data Services Librarian > >Dewey Library for Management and Social Sciences > >Massachusetts Institute of Technology > >77 Massachusetts Avenue, E53-100 > >Cambridge, MA 02139 > >mcneillh@mit.edu > >617-253-0787 > > > >_______________________________________________ > >DDI-ADG mailing list > >DDI-ADG@icpsr.umich.edu > >http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg > > > >_______________________________________________ > >DDI-ADG mailing list > >DDI-ADG@icpsr.umich.edu > >http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg > >Mary Vardigan >Director, Collection Delivery >Inter-university Consortium for Political and Social Research (ICPSR) >University of Michigan >P.O. Box 1248, Ann Arbor, MI 48106-1248 >Phone: 734-615-7908 >Fax: 734-647-8200 >www.icpsr.umich.edu Mary Vardigan Director, Collection Delivery Inter-university Consortium for Political and Social Research (ICPSR) University of Michigan P.O. Box 1248, Ann Arbor, MI 48106-1248 Phone: 734-615-7908 Fax: 734-647-8200 www.icpsr.umich.edu From Sandra.A.Cannon at frb.gov Wed Aug 3 14:54:02 2005 From: Sandra.A.Cannon at frb.gov (Sandra.A.Cannon@frb.gov) Date: Wed Aug 3 14:54:18 2005 Subject: [DDI-ADG] standards for frequency (or lack thereof) In-Reply-To: <6.0.1.1.2.20050803144155.02be5c98@icpsr.umich.edu> Message-ID: Aren't they the same thing? If there is 10 years per period, doesn't that mean that there is an observation every 10 years? Here's how our documentation describes it: YPP(n, year, month) Specifies data reported at intervals that are multiples of twelve months, where n is a positive integer from 1 to 30, inclusive, indicating the number of years per period. Year is a year number indicating a sample ending year. Month is optional and is a month name indicating a sample ending month. If month is omitted, DECEMBER is assumed. So if I ask for quarterly GDP to be displayed at the frequency y(10,2000), for example, I would get: 1960 427.14 1970 768.55 1980 1839.50 1990 4367.40 2000 7742.50 Isn't that what we are trying to do? I know that this is very time series oriented so let me know if I'm missing something important. /san/ ------------------------------------------------- San Cannon Chief, Economic Information Management Federal Reserve Board Washington DC 20551 (202) 452-3710 scannon@frb.gov Mary Vardigan To Sent by: Sandra.A.Cannon@frb.gov ddi-adg-bounces@i cc cpsr.umich.edu ddi-adg@icpsr.umich.edu Subject Re: [DDI-ADG] standards for 08/03/2005 02:44 frequency (or lack thereof) PM I wasn't sure if Y10 would indicate ten years of data since the definition says "YPP n years per period" or data collected every 10th year. But if it's the latter, that would be great. Mary At 02:39 PM 8/3/2005, Sandra.A.Cannon@frb.gov wrote: >Mary, >In the time series world, decennial wouldn't buy you much but in the panel >study world the same doesn't hold. Is a particular indicator for decennial >sufficient or would we be better to use the Yn indicator for such things? >Then Y10 would be decennial and Y2 would be biennial, etc. I understand if >decennial is considered special enough to have its own code though. > >/san/ > > >------------------------------------------------- >San Cannon >Chief, Economic Information Management >Federal Reserve Board >Washington DC 20551 >(202) 452-3710 >scannon@frb.gov > > > > > Mary Vardigan > h.edu> To > Sandra.A.Cannon@frb.gov, Katherine > 08/03/2005 02:34 McNeill-Harman > PM cc > ddi-adg@icpsr.umich.edu > Subject > Re: [DDI-ADG] standards for > frequency (or lack thereof) > > > > > > > > > > >San, Kate, and others, > >This seems like a really good start on a controlled vocabulary for >frequency. Do we need an additional indicator for something like the >decennial U.S. Census? > >Mary > >At 04:24 PM 8/2/2005, Sandra.A.Cannon@frb.gov wrote: > > > > > >Kate, > >This may be where using common definitions from time series data would be > >useful. There are many possible frequencies in the software that we use > >(which Arofan says they are contemplating building into SDMX). I don't > >know if it's authoritative or definitive but it certainly seems to be > >exhaustive. I've attached a listing in a PDF of an internal webpage I > >support here. > > > >More food for thought.... > > > >/san/ > >who is sorry she is going on holiday this week and will miss the next > >several calls on this topic... well, not very sorry... ;-) > > > >(See attached file: freq.pdf) > > > >------------------------------------------------- > >San Cannon > >Chief, Economic Information Management > >Federal Reserve Board > >Washington DC 20551 > >(202) 452-3710 > >scannon@frb.gov > > > > > > > > > > Katherine > > McNeill-Harman > > To > > > ddi-adg@icpsr.umich.edu > > Sent by: >cc > > ddi-adg-bounces@i > > cpsr.umich.edu >Subject > > [DDI-ADG] standards for frequency > > (or lack thereof) > > 08/02/2005 03:28 > > PM > > > > > > > > > > > > > > > > > >Hi everyone, > > > >I've looked around fruitlessly for any standard list of frequencies. I > >looked at the ISO web site, but wasn't able to navigate to anything >helpful > > > >(maybe someone else is more familiar). I did various web searches, to no > >avail. I looked on the web sites and in reference books for bodies that I > >know collect/publish data at certain frequencies (e.g. IMF, World Bank). > >I even looked in the dictionaries in which I found the other definitions, > >and several economic dictionaries. > > > >None of the sources above define/list these terms in any way. I'm > >beginning to wonder if terms may be too taken-for-granted to be listed in >a > > > >structured way. > > > >However, if nothing else, we could just go to a regular English dictionary > >for definitions of the terms. For example, my Websters Collegiate > >Dictionary defines quarterly as "recurring, issued, or spaced at 3-month > >intervals." This was the best that I found anywhere. This wouldn't take > >care of our need for a list from which to work in the first place, but I > >expect we'd be able to brainstorm most. (and then the "other" option would > >cover the rest) > > > >Maybe others have other ideas or techniques they could try, but I think >I'm > > > >stuck. > > > >Kate > > > >___________________________________________ > >Katherine McNeill-Harman > >Data Services Librarian > >Dewey Library for Management and Social Sciences > >Massachusetts Institute of Technology > >77 Massachusetts Avenue, E53-100 > >Cambridge, MA 02139 > >mcneillh@mit.edu > >617-253-0787 > > > >_______________________________________________ > >DDI-ADG mailing list > >DDI-ADG@icpsr.umich.edu > >http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg > > > >_______________________________________________ > >DDI-ADG mailing list > >DDI-ADG@icpsr.umich.edu > >http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg > >Mary Vardigan >Director, Collection Delivery >Inter-university Consortium for Political and Social Research (ICPSR) >University of Michigan >P.O. Box 1248, Ann Arbor, MI 48106-1248 >Phone: 734-615-7908 >Fax: 734-647-8200 >www.icpsr.umich.edu Mary Vardigan Director, Collection Delivery Inter-university Consortium for Political and Social Research (ICPSR) University of Michigan P.O. Box 1248, Ann Arbor, MI 48106-1248 Phone: 734-615-7908 Fax: 734-647-8200 www.icpsr.umich.edu _______________________________________________ DDI-ADG mailing list DDI-ADG@icpsr.umich.edu http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg From maryv at icpsr.umich.edu Wed Aug 3 15:21:28 2005 From: maryv at icpsr.umich.edu (Mary Vardigan) Date: Wed Aug 3 15:21:38 2005 Subject: [DDI-ADG] standards for frequency (or lack thereof) In-Reply-To: References: <6.0.1.1.2.20050803144155.02be5c98@icpsr.umich.edu> Message-ID: <6.0.1.1.2.20050803151942.02cb0918@icpsr.umich.edu> That sounds right. I was just trying to distinguish between an observation every 10 years and 10 years of observations. But if Y10 means the former, that's great. Thanks for the clarification. Mary At 02:54 PM 8/3/2005, Sandra.A.Cannon@frb.gov wrote: >Aren't they the same thing? If there is 10 years per period, doesn't that >mean that there is an observation every 10 years? > >Here's how our documentation describes it: > >YPP(n, year, month) >Specifies data reported at intervals that are multiples of twelve months, >where n is a positive integer from 1 to 30, inclusive, indicating the >number of years per period. Year is a year number indicating a sample >ending year. Month is optional and is a month name indicating a sample >ending month. If month is omitted, DECEMBER is assumed. > >So if I ask for quarterly GDP to be displayed at the frequency y(10,2000), >for example, I would get: > >1960 427.14 >1970 768.55 >1980 1839.50 >1990 4367.40 >2000 7742.50 > >Isn't that what we are trying to do? > >I know that this is very time series oriented so let me know if I'm missing >something important. > >/san/ > > >------------------------------------------------- >San Cannon >Chief, Economic Information Management >Federal Reserve Board >Washington DC 20551 >(202) 452-3710 >scannon@frb.gov > > > > > Mary Vardigan > h.edu> To > Sent by: Sandra.A.Cannon@frb.gov > ddi-adg-bounces@i cc > cpsr.umich.edu ddi-adg@icpsr.umich.edu > Subject > Re: [DDI-ADG] standards for > 08/03/2005 02:44 frequency (or lack thereof) > PM > > > > > > > > > >I wasn't sure if Y10 would indicate ten years of data since the definition >says "YPP n years per period" or data collected every 10th year. But if >it's the latter, that would be great. > >Mary > > >At 02:39 PM 8/3/2005, Sandra.A.Cannon@frb.gov wrote: > > > > > >Mary, > >In the time series world, decennial wouldn't buy you much but in the panel > >study world the same doesn't hold. Is a particular indicator for >decennial > >sufficient or would we be better to use the Yn indicator for such things? > >Then Y10 would be decennial and Y2 would be biennial, etc. I understand >if > >decennial is considered special enough to have its own code though. > > > >/san/ > > > > > >------------------------------------------------- > >San Cannon > >Chief, Economic Information Management > >Federal Reserve Board > >Washington DC 20551 > >(202) 452-3710 > >scannon@frb.gov > > > > > > > > > > Mary Vardigan > > > h.edu> >To > > Sandra.A.Cannon@frb.gov, Katherine > > 08/03/2005 02:34 McNeill-Harman > > PM >cc > > ddi-adg@icpsr.umich.edu > > >Subject > > Re: [DDI-ADG] standards for > > frequency (or lack thereof) > > > > > > > > > > > > > > > > > > > > > >San, Kate, and others, > > > >This seems like a really good start on a controlled vocabulary for > >frequency. Do we need an additional indicator for something like the > >decennial U.S. Census? > > > >Mary > > > >At 04:24 PM 8/2/2005, Sandra.A.Cannon@frb.gov wrote: > > > > > > > > > > >Kate, > > >This may be where using common definitions from time series data would >be > > >useful. There are many possible frequencies in the software that we use > > >(which Arofan says they are contemplating building into SDMX). I don't > > >know if it's authoritative or definitive but it certainly seems to be > > >exhaustive. I've attached a listing in a PDF of an internal webpage I > > >support here. > > > > > >More food for thought.... > > > > > >/san/ > > >who is sorry she is going on holiday this week and will miss the next > > >several calls on this topic... well, not very sorry... ;-) > > > > > >(See attached file: freq.pdf) > > > > > >------------------------------------------------- > > >San Cannon > > >Chief, Economic Information Management > > >Federal Reserve Board > > >Washington DC 20551 > > >(202) 452-3710 > > >scannon@frb.gov > > > > > > > > > > > > > > > Katherine > > > McNeill-Harman > > > >To > > > > ddi-adg@icpsr.umich.edu > > > Sent by: > >cc > > > ddi-adg-bounces@i > > > cpsr.umich.edu > >Subject > > > [DDI-ADG] standards for >frequency > > > (or lack thereof) > > > 08/02/2005 03:28 > > > PM > > > > > > > > > > > > > > > > > > > > > > > > > > >Hi everyone, > > > > > >I've looked around fruitlessly for any standard list of frequencies. I > > >looked at the ISO web site, but wasn't able to navigate to anything > >helpful > > > > > >(maybe someone else is more familiar). I did various web searches, to >no > > >avail. I looked on the web sites and in reference books for bodies that >I > > >know collect/publish data at certain frequencies (e.g. IMF, World Bank). > > >I even looked in the dictionaries in which I found the other >definitions, > > >and several economic dictionaries. > > > > > >None of the sources above define/list these terms in any way. I'm > > >beginning to wonder if terms may be too taken-for-granted to be listed >in > >a > > > > > >structured way. > > > > > >However, if nothing else, we could just go to a regular English >dictionary > > >for definitions of the terms. For example, my Websters Collegiate > > >Dictionary defines quarterly as "recurring, issued, or spaced at 3-month > > >intervals." This was the best that I found anywhere. This wouldn't >take > > >care of our need for a list from which to work in the first place, but I > > >expect we'd be able to brainstorm most. (and then the "other" option >would > > >cover the rest) > > > > > >Maybe others have other ideas or techniques they could try, but I think > >I'm > > > > > >stuck. > > > > > >Kate > > > > > >___________________________________________ > > >Katherine McNeill-Harman > > >Data Services Librarian > > >Dewey Library for Management and Social Sciences > > >Massachusetts Institute of Technology > > >77 Massachusetts Avenue, E53-100 > > >Cambridge, MA 02139 > > >mcneillh@mit.edu > > >617-253-0787 > > > > > >_______________________________________________ > > >DDI-ADG mailing list > > >DDI-ADG@icpsr.umich.edu > > >http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg > > > > > >_______________________________________________ > > >DDI-ADG mailing list > > >DDI-ADG@icpsr.umich.edu > > >http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg > > > >Mary Vardigan > >Director, Collection Delivery > >Inter-university Consortium for Political and Social Research (ICPSR) > >University of Michigan > >P.O. Box 1248, Ann Arbor, MI 48106-1248 > >Phone: 734-615-7908 > >Fax: 734-647-8200 > >www.icpsr.umich.edu > >Mary Vardigan >Director, Collection Delivery >Inter-university Consortium for Political and Social Research (ICPSR) >University of Michigan >P.O. Box 1248, Ann Arbor, MI 48106-1248 >Phone: 734-615-7908 >Fax: 734-647-8200 >www.icpsr.umich.edu > >_______________________________________________ >DDI-ADG mailing list >DDI-ADG@icpsr.umich.edu >http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg Mary Vardigan Director, Collection Delivery Inter-university Consortium for Political and Social Research (ICPSR) University of Michigan P.O. Box 1248, Ann Arbor, MI 48106-1248 Phone: 734-615-7908 Fax: 734-647-8200 www.icpsr.umich.edu From mcneillh at MIT.EDU Wed Aug 3 15:46:23 2005 From: mcneillh at MIT.EDU (Katherine McNeill-Harman) Date: Wed Aug 3 15:46:42 2005 Subject: [DDI-ADG] standards for frequency (or lack thereof) In-Reply-To: <6.0.1.1.2.20050803151942.02cb0918@icpsr.umich.edu> References: <6.0.1.1.2.20050803144155.02be5c98@icpsr.umich.edu> Message-ID: <5.2.1.1.2.20050803154012.01084eb0@po11.mit.edu> And if these are used in SDMX, I imagine that they're machine actionable? I'm wondering how this would work with my hope that someone could design a search interface where the user could select among several pre-defined frequency options; I was originally imagining a pull-down menu where the user would be able to choose among annual, monthly, etc. But it sound like this would maybe be more compatible with a search box where they could format their search accordingly (e.g. put in Y10 for decennial). I guess it's the difference between giving a set of discrete options vs. defining a system of frequency naming conventions that could hopefully be searched in a standard way. The one San has presented certainly provides a lot more detail. Kate At 03:21 PM 8/3/2005 -0400, Mary Vardigan wrote: >That sounds right. I was just trying to distinguish between an observation >every 10 years and 10 years of observations. But if Y10 means the former, >that's great. Thanks for the clarification. > >Mary > >At 02:54 PM 8/3/2005, Sandra.A.Cannon@frb.gov wrote: > > > > >>Aren't they the same thing? If there is 10 years per period, doesn't that >>mean that there is an observation every 10 years? >> >>Here's how our documentation describes it: >> >>YPP(n, year, month) >>Specifies data reported at intervals that are multiples of twelve months, >>where n is a positive integer from 1 to 30, inclusive, indicating the >>number of years per period. Year is a year number indicating a sample >>ending year. Month is optional and is a month name indicating a sample >>ending month. If month is omitted, DECEMBER is assumed. >> >>So if I ask for quarterly GDP to be displayed at the frequency y(10,2000), >>for example, I would get: >> >>1960 427.14 >>1970 768.55 >>1980 1839.50 >>1990 4367.40 >>2000 7742.50 >> >>Isn't that what we are trying to do? >> >>I know that this is very time series oriented so let me know if I'm missing >>something important. >> >>/san/ >> >> >>------------------------------------------------- >>San Cannon >>Chief, Economic Information Management >>Federal Reserve Board >>Washington DC 20551 >>(202) 452-3710 >>scannon@frb.gov >> >> >> >> >> Mary Vardigan >> > h.edu> To >> Sent by: Sandra.A.Cannon@frb.gov >> ddi-adg-bounces@i cc >> cpsr.umich.edu ddi-adg@icpsr.umich.edu >> Subject >> Re: [DDI-ADG] standards for >> 08/03/2005 02:44 frequency (or lack thereof) >> PM >> >> >> >> >> >> >> >> >> >>I wasn't sure if Y10 would indicate ten years of data since the definition >>says "YPP n years per period" or data collected every 10th year. But if >>it's the latter, that would be great. >> >>Mary >> >> >>At 02:39 PM 8/3/2005, Sandra.A.Cannon@frb.gov wrote: >> >> >> >> >> >Mary, >> >In the time series world, decennial wouldn't buy you much but in the panel >> >study world the same doesn't hold. Is a particular indicator for >>decennial >> >sufficient or would we be better to use the Yn indicator for such things? >> >Then Y10 would be decennial and Y2 would be biennial, etc. I understand >>if >> >decennial is considered special enough to have its own code though. >> > >> >/san/ >> > >> > >> >------------------------------------------------- >> >San Cannon >> >Chief, Economic Information Management >> >Federal Reserve Board >> >Washington DC 20551 >> >(202) 452-3710 >> >scannon@frb.gov >> > >> > >> > >> > >> > Mary Vardigan >> > > > h.edu> >>To >> > Sandra.A.Cannon@frb.gov, Katherine >> > 08/03/2005 02:34 McNeill-Harman >> > PM >>cc >> > ddi-adg@icpsr.umich.edu >> > >>Subject >> > Re: [DDI-ADG] standards for >> > frequency (or lack thereof) >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> >San, Kate, and others, >> > >> >This seems like a really good start on a controlled vocabulary for >> >frequency. Do we need an additional indicator for something like the >> >decennial U.S. Census? >> > >> >Mary >> > >> >At 04:24 PM 8/2/2005, Sandra.A.Cannon@frb.gov wrote: >> > >> > >> > >> > >> > >Kate, >> > >This may be where using common definitions from time series data would >>be >> > >useful. There are many possible frequencies in the software that we use >> > >(which Arofan says they are contemplating building into SDMX). I don't >> > >know if it's authoritative or definitive but it certainly seems to be >> > >exhaustive. I've attached a listing in a PDF of an internal webpage I >> > >support here. >> > > >> > >More food for thought.... >> > > >> > >/san/ >> > >who is sorry she is going on holiday this week and will miss the next >> > >several calls on this topic... well, not very sorry... ;-) >> > > >> > >(See attached file: freq.pdf) >> > > >> > >------------------------------------------------- >> > >San Cannon >> > >Chief, Economic Information Management >> > >Federal Reserve Board >> > >Washington DC 20551 >> > >(202) 452-3710 >> > >scannon@frb.gov >> > > >> > > >> > > >> > > >> > > Katherine >> > > McNeill-Harman >> > > > >To >> > > > ddi-adg@icpsr.umich.edu >> > > Sent by: >> >cc >> > > ddi-adg-bounces@i >> > > cpsr.umich.edu >> >Subject >> > > [DDI-ADG] standards for >>frequency >> > > (or lack thereof) >> > > 08/02/2005 03:28 >> > > PM >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > >Hi everyone, >> > > >> > >I've looked around fruitlessly for any standard list of frequencies. I >> > >looked at the ISO web site, but wasn't able to navigate to anything >> >helpful >> > > >> > >(maybe someone else is more familiar). I did various web searches, to >>no >> > >avail. I looked on the web sites and in reference books for bodies that >>I >> > >know collect/publish data at certain frequencies (e.g. IMF, World Bank). >> > >I even looked in the dictionaries in which I found the other >>definitions, >> > >and several economic dictionaries. >> > > >> > >None of the sources above define/list these terms in any way. I'm >> > >beginning to wonder if terms may be too taken-for-granted to be listed >>in >> >a >> > > >> > >structured way. >> > > >> > >However, if nothing else, we could just go to a regular English >>dictionary >> > >for definitions of the terms. For example, my Websters Collegiate >> > >Dictionary defines quarterly as "recurring, issued, or spaced at 3-month >> > >intervals." This was the best that I found anywhere. This wouldn't >>take >> > >care of our need for a list from which to work in the first place, but I >> > >expect we'd be able to brainstorm most. (and then the "other" option >>would >> > >cover the rest) >> > > >> > >Maybe others have other ideas or techniques they could try, but I think >> >I'm >> > > >> > >stuck. >> > > >> > >Kate >> > > >> > >___________________________________________ >> > >Katherine McNeill-Harman >> > >Data Services Librarian >> > >Dewey Library for Management and Social Sciences >> > >Massachusetts Institute of Technology >> > >77 Massachusetts Avenue, E53-100 >> > >Cambridge, MA 02139 >> > >mcneillh@mit.edu >> > >617-253-0787 >> > > >> > >_______________________________________________ >> > >DDI-ADG mailing list >> > >DDI-ADG@icpsr.umich.edu >> > >http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg >> > > >> > >_______________________________________________ >> > >DDI-ADG mailing list >> > >DDI-ADG@icpsr.umich.edu >> > >http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg >> > >> >Mary Vardigan >> >Director, Collection Delivery >> >Inter-university Consortium for Political and Social Research (ICPSR) >> >University of Michigan >> >P.O. Box 1248, Ann Arbor, MI 48106-1248 >> >Phone: 734-615-7908 >> >Fax: 734-647-8200 >> >www.icpsr.umich.edu >> >>Mary Vardigan >>Director, Collection Delivery >>Inter-university Consortium for Political and Social Research (ICPSR) >>University of Michigan >>P.O. Box 1248, Ann Arbor, MI 48106-1248 >>Phone: 734-615-7908 >>Fax: 734-647-8200 >>www.icpsr.umich.edu >> >>_______________________________________________ >>DDI-ADG mailing list >>DDI-ADG@icpsr.umich.edu >>http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg > >Mary Vardigan >Director, Collection Delivery >Inter-university Consortium for Political and Social Research (ICPSR) >University of Michigan >P.O. Box 1248, Ann Arbor, MI 48106-1248 >Phone: 734-615-7908 >Fax: 734-647-8200 >www.icpsr.umich.edu >_______________________________________________ >DDI-ADG mailing list >DDI-ADG@icpsr.umich.edu >http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg ___________________________________________ Katherine McNeill-Harman Data Services Librarian Dewey Library for Management and Social Sciences Massachusetts Institute of Technology 77 Massachusetts Avenue, E53-100 Cambridge, MA 02139 mcneillh@mit.edu 617-253-0787 From wlt at pop.umn.edu Wed Aug 3 15:57:27 2005 From: wlt at pop.umn.edu (Wendy Thomas) Date: Wed Aug 3 15:57:47 2005 Subject: [DDI-ADG] standards for frequency (or lack thereof) In-Reply-To: <5.2.1.1.2.20050803154012.01084eb0@po11.mit.edu> Message-ID: Kate, Machine actionable means that a value of an element/attribute will occur in a known, predictable, and consistant form. All controlled vocabularies are machine actionable. You design the search system based on the available options. You can group these into broad categories such as single occurance, periodic (and then select the periodicity) or whatever. The person searching is limited only by the software system you devise. When searching topics you can provide a structured pick-list, allow for free searching of strings ("age" results in "age" "mortgage" etc.), a structured list or a word net (where "kids in the house" gets you "children in households"). DDI and other such storage mechanisms only capture the content. They can do this in an unstructured "non-machine actionable" way or in a structured "machine actionable" way. What you do with that information is up to you. Wendy On Wed, 3 Aug 2005, Katherine McNeill-Harman wrote: > And if these are used in SDMX, I imagine that they're machine actionable? > > I'm wondering how this would work with my hope that someone could design a > search interface where the user could select among several pre-defined > frequency options; I was originally imagining a pull-down menu where the > user would be able to choose among annual, monthly, etc. But it sound like > this would maybe be more compatible with a search box where they could > format their search accordingly (e.g. put in Y10 for decennial). > > I guess it's the difference between giving a set of discrete options vs. > defining a system of frequency naming conventions that could hopefully be > searched in a standard way. The one San has presented certainly provides a > lot more detail. > > Kate > > At 03:21 PM 8/3/2005 -0400, Mary Vardigan wrote: > >That sounds right. I was just trying to distinguish between an observation > >every 10 years and 10 years of observations. But if Y10 means the former, > >that's great. Thanks for the clarification. > > > >Mary > > > >At 02:54 PM 8/3/2005, Sandra.A.Cannon@frb.gov wrote: > > > > > > > > > >>Aren't they the same thing? If there is 10 years per period, doesn't that > >>mean that there is an observation every 10 years? > >> > >>Here's how our documentation describes it: > >> > >>YPP(n, year, month) > >>Specifies data reported at intervals that are multiples of twelve months, > >>where n is a positive integer from 1 to 30, inclusive, indicating the > >>number of years per period. Year is a year number indicating a sample > >>ending year. Month is optional and is a month name indicating a sample > >>ending month. If month is omitted, DECEMBER is assumed. > >> > >>So if I ask for quarterly GDP to be displayed at the frequency y(10,2000), > >>for example, I would get: > >> > >>1960 427.14 > >>1970 768.55 > >>1980 1839.50 > >>1990 4367.40 > >>2000 7742.50 > >> > >>Isn't that what we are trying to do? > >> > >>I know that this is very time series oriented so let me know if I'm missing > >>something important. > >> > >>/san/ > >> > >> > >>------------------------------------------------- > >>San Cannon > >>Chief, Economic Information Management > >>Federal Reserve Board > >>Washington DC 20551 > >>(202) 452-3710 > >>scannon@frb.gov > >> > >> > >> > >> > >> Mary Vardigan > >> >> h.edu> To > >> Sent by: Sandra.A.Cannon@frb.gov > >> ddi-adg-bounces@i cc > >> cpsr.umich.edu ddi-adg@icpsr.umich.edu > >> Subject > >> Re: [DDI-ADG] standards for > >> 08/03/2005 02:44 frequency (or lack thereof) > >> PM > >> > >> > >> > >> > >> > >> > >> > >> > >> > >>I wasn't sure if Y10 would indicate ten years of data since the definition > >>says "YPP n years per period" or data collected every 10th year. But if > >>it's the latter, that would be great. > >> > >>Mary > >> > >> > >>At 02:39 PM 8/3/2005, Sandra.A.Cannon@frb.gov wrote: > >> > >> > >> > >> > >> >Mary, > >> >In the time series world, decennial wouldn't buy you much but in the panel > >> >study world the same doesn't hold. Is a particular indicator for > >>decennial > >> >sufficient or would we be better to use the Yn indicator for such things? > >> >Then Y10 would be decennial and Y2 would be biennial, etc. I understand > >>if > >> >decennial is considered special enough to have its own code though. > >> > > >> >/san/ > >> > > >> > > >> >------------------------------------------------- > >> >San Cannon > >> >Chief, Economic Information Management > >> >Federal Reserve Board > >> >Washington DC 20551 > >> >(202) 452-3710 > >> >scannon@frb.gov > >> > > >> > > >> > > >> > > >> > Mary Vardigan > >> > >> > h.edu> > >>To > >> > Sandra.A.Cannon@frb.gov, Katherine > >> > 08/03/2005 02:34 McNeill-Harman > >> > PM > >>cc > >> > ddi-adg@icpsr.umich.edu > >> > > >>Subject > >> > Re: [DDI-ADG] standards for > >> > frequency (or lack thereof) > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> >San, Kate, and others, > >> > > >> >This seems like a really good start on a controlled vocabulary for > >> >frequency. Do we need an additional indicator for something like the > >> >decennial U.S. Census? > >> > > >> >Mary > >> > > >> >At 04:24 PM 8/2/2005, Sandra.A.Cannon@frb.gov wrote: > >> > > >> > > >> > > >> > > >> > >Kate, > >> > >This may be where using common definitions from time series data would > >>be > >> > >useful. There are many possible frequencies in the software that we use > >> > >(which Arofan says they are contemplating building into SDMX). I don't > >> > >know if it's authoritative or definitive but it certainly seems to be > >> > >exhaustive. I've attached a listing in a PDF of an internal webpage I > >> > >support here. > >> > > > >> > >More food for thought.... > >> > > > >> > >/san/ > >> > >who is sorry she is going on holiday this week and will miss the next > >> > >several calls on this topic... well, not very sorry... ;-) > >> > > > >> > >(See attached file: freq.pdf) > >> > > > >> > >------------------------------------------------- > >> > >San Cannon > >> > >Chief, Economic Information Management > >> > >Federal Reserve Board > >> > >Washington DC 20551 > >> > >(202) 452-3710 > >> > >scannon@frb.gov > >> > > > >> > > > >> > > > >> > > > >> > > Katherine > >> > > McNeill-Harman > >> > > >> >To > >> > > > ddi-adg@icpsr.umich.edu > >> > > Sent by: > >> >cc > >> > > ddi-adg-bounces@i > >> > > cpsr.umich.edu > >> >Subject > >> > > [DDI-ADG] standards for > >>frequency > >> > > (or lack thereof) > >> > > 08/02/2005 03:28 > >> > > PM > >> > > > >> > > > >> > > > >> > > > >> > > > >> > > > >> > > > >> > > > >> > >Hi everyone, > >> > > > >> > >I've looked around fruitlessly for any standard list of frequencies. I > >> > >looked at the ISO web site, but wasn't able to navigate to anything > >> >helpful > >> > > > >> > >(maybe someone else is more familiar). I did various web searches, to > >>no > >> > >avail. I looked on the web sites and in reference books for bodies that > >>I > >> > >know collect/publish data at certain frequencies (e.g. IMF, World Bank). > >> > >I even looked in the dictionaries in which I found the other > >>definitions, > >> > >and several economic dictionaries. > >> > > > >> > >None of the sources above define/list these terms in any way. I'm > >> > >beginning to wonder if terms may be too taken-for-granted to be listed > >>in > >> >a > >> > > > >> > >structured way. > >> > > > >> > >However, if nothing else, we could just go to a regular English > >>dictionary > >> > >for definitions of the terms. For example, my Websters Collegiate > >> > >Dictionary defines quarterly as "recurring, issued, or spaced at 3-month > >> > >intervals." This was the best that I found anywhere. This wouldn't > >>take > >> > >care of our need for a list from which to work in the first place, but I > >> > >expect we'd be able to brainstorm most. (and then the "other" option > >>would > >> > >cover the rest) > >> > > > >> > >Maybe others have other ideas or techniques they could try, but I think > >> >I'm > >> > > > >> > >stuck. > >> > > > >> > >Kate > >> > > > >> > >___________________________________________ > >> > >Katherine McNeill-Harman > >> > >Data Services Librarian > >> > >Dewey Library for Management and Social Sciences > >> > >Massachusetts Institute of Technology > >> > >77 Massachusetts Avenue, E53-100 > >> > >Cambridge, MA 02139 > >> > >mcneillh@mit.edu > >> > >617-253-0787 > >> > > > >> > >_______________________________________________ > >> > >DDI-ADG mailing list > >> > >DDI-ADG@icpsr.umich.edu > >> > >http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg > >> > > > >> > >_______________________________________________ > >> > >DDI-ADG mailing list > >> > >DDI-ADG@icpsr.umich.edu > >> > >http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg > >> > > >> >Mary Vardigan > >> >Director, Collection Delivery > >> >Inter-university Consortium for Political and Social Research (ICPSR) > >> >University of Michigan > >> >P.O. Box 1248, Ann Arbor, MI 48106-1248 > >> >Phone: 734-615-7908 > >> >Fax: 734-647-8200 > >> >www.icpsr.umich.edu > >> > >>Mary Vardigan > >>Director, Collection Delivery > >>Inter-university Consortium for Political and Social Research (ICPSR) > >>University of Michigan > >>P.O. Box 1248, Ann Arbor, MI 48106-1248 > >>Phone: 734-615-7908 > >>Fax: 734-647-8200 > >>www.icpsr.umich.edu > >> > >>_______________________________________________ > >>DDI-ADG mailing list > >>DDI-ADG@icpsr.umich.edu > >>http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg > > > >Mary Vardigan > >Director, Collection Delivery > >Inter-university Consortium for Political and Social Research (ICPSR) > >University of Michigan > >P.O. Box 1248, Ann Arbor, MI 48106-1248 > >Phone: 734-615-7908 > >Fax: 734-647-8200 > >www.icpsr.umich.edu > >_______________________________________________ > >DDI-ADG mailing list > >DDI-ADG@icpsr.umich.edu > >http://www.icpsr.umich.edu/mailman/listinfo/ddi-adg > > _________________