Assessment:Metadata: Difference between revisions

From DLF Wiki
Jump to navigation Jump to search
No edit summary
No edit summary
(14 intermediate revisions by 3 users not shown)
Line 1: Line 1:
= DLF Assessment Interest Group: Metadata Working Group =
= DLF Assessment Interest Group: Metadata Working Group =
'''''(Metadata Assessment Working Group)'''''
'''''(Metadata Assessment Working Group)'''''
== Broad Aims + Description of the Metadata Assessment Group within DLF AIG ==


This group is open to anyone who is interested in taking part. There are no minimum or membership requirements, though we hope you’ll take as active a part as you’re able and willing.
This group is open to anyone who is interested in taking part. There are no minimum or membership requirements, though we hope you’ll take as active a part as you’re able and willing.
Line 9: Line 6:
The Metadata Assessment Working Group aims to build guidelines, best practices, tools and workflows around the evaluation and assessment of metadata used by and for digital libraries and repositories. The group hopes to offer deliverables and recommendations that digital library and repository users can implement for metadata assessment and metadata quality control.
The Metadata Assessment Working Group aims to build guidelines, best practices, tools and workflows around the evaluation and assessment of metadata used by and for digital libraries and repositories. The group hopes to offer deliverables and recommendations that digital library and repository users can implement for metadata assessment and metadata quality control.


This group should not focus on prescriptive recommendations for metadata (using one schema versus another, or comparisons of controlled vocabularies, etc.), but rather how (both functionally and to what metrics) to measure, evaluate and assess the metadata as it exists in a variety of digital library systems. Future work could lend itself to then using that assessment work to decide a pathway for metadata enhancement. This framing is very much influenced by the [https://docs.google.com/document/d/15pmA276_fxShkCEagoloJwCXH89PhrF3qWBgB8xSrag/edit#heading=h.mq4e51njyj6 flurry of interest, activity and discussion around metadata assessment that occurred just after DPLAfest 2015].
This group should not focus on prescriptive recommendations for metadata (using one schema versus another, or comparisons of controlled vocabularies, etc.), but rather how (both functionally and to what metrics) to measure, evaluate and assess the metadata as it exists in a variety of digital library systems. Future work could lend itself to then using that assessment work to decide a pathway for metadata enhancement.


== Metadata WG Scope & Aims in 2016 ==
== 2018 Work ==
We set directions, deliverables, and goals for 2018 at the 2018 kick-off meeting in January 2018. You can see more about the group's goals and discussion for 2018 at [https://docs.google.com/document/d/15lJZzpSNbo95ca6MNbDb_7s4aRzqk7j20i6Bl1zAMuQ/edit?usp=sharing]


The goals, aims, and deliverables of the Metadata Working Group were decided in the kick off meeting by participants. Broadly, we aim to:
=== Goals ===
* Work collaboratively on a white paper that will be an aggregate of a number of areas of work...
The goals for 2018, set in our kick-off meeting, include:
** the first being a literature (and tools) review of metadata assessment work so far (current focus of our work) - http://bit.ly/MetadataAssessDraft
* Restructure and document the MWG website
** then further clarifying for our work metadata assessment metrics and definitions
* Review and revise the Metadata Analysis Workshop
** then building out a metadata assessment rubric
* Work towards creating a metadata analysis tools repository
** as well as capturing metadata assessment use cases.
* Begin discussion on creating general benchmarks for metadata quality. This area of work may include gathering tools and methods for measurement of metadata quality, defining benchmarks, and establishing a platform for topic discussion


See more about the group's goals and discussion on them at http://bit.ly/metadataAssessment
== 2017 Work ==


== Ongoing Metadata Assessment Working Group Communication ==
We set directions, deliverables, and goals for 2017 at the 2017 kick-off meeting in January 2017. You can see more about the group's goals and discussion for 2017 at [https://docs.google.com/document/d/1Ssk-dOhK0B699qatDUa7Gnc3QuP1IRXjr5DMaFoIJzE/edit?usp=sharing]


The Metadata Working Group will primarily communicate through the [https://groups.google.com/forum/#!forum/dlf-aig-metadata-assessment-working-group DLF AIG Metadata Working Group Google Group].
=== Goals ===


We have a WG call every 2 weeks with two day/time options to support participation from different time zones. Options are Thursday at 9 AM EST and Fridays at 11 AM EST. The call information (including dates and Webex links) can be found below.
The goals for 2017, set in our kick-off meeting, included:
* Update structure of the Github site created for last year’s Environmental Scan to support expansion and ongoing work including creating mechanism for people to submit updates & feedback.
* Review and expand list of metadata assessment tools gathered as part of the Environmental Scan. Begin testing tools gathered as part of the Environmental Scan in order to eventually create a repository for metadata assessment tools
* Create a Metadata Application Profile Clearinghouse that can be used as a community repository for application profiles, mappings and guidelines for metadata.
* Create a general framework document on how to assess metadata that can be used for the galleries, libraries, archives & museums (GLAM) community.
* Collaborate with other institutions on metadata assessment and analysis workshop work.


We will also have a gathering at the 2016 DLF Forum (attendance to this in person meeting is not required for folks to be involved in this group).
=== Deliverables ===


All the work is being done in this Google Drive space: https://drive.google.com/folderview?id=0B74oOQcTdnHjWk51a283bUVta0E&usp=sharing
* [http://dlfmetadataassessment.github.io/Sandbox An updated site] with new sections for the [http://dlfmetadataassessment.github.io/Framework Metadata Assessment Framework], [http://dlfmetadataassessment.github.io/EnvironmentalScan last year's Environmental Scan], [http://dlfmetadataassessment.github.io/Tools the expanded Metadata Assessment Tools work] and [http://dlfmetadataassessment.github.io/MetadataSpecsClearinghouse the Metadata Application Clearinghouse].
* A Github repository with materials from the Metadata Analysis workshop taught at DLF Forum


This Wikipage will be used to shared decided information - meeting times, decided deliverables and goals, etc.


== General Group Timeframe ==
== 2016 Work ==


* '''December 2015''': Call for all people interested in participating in this group.
=== Goals ===
* '''December 2015 - Mid January 2016''': All interested participants should join the Google Group to then be invited to edit shared documentation (Google documents, like this document) bringing together existing metadata assessment tools, work, resources, use cases, methods, etc.
* '''29 January 2016, 1 PM EST''': The first virtual meeting of the group, through Webex (information at top of this document). At this first meeting, more specific goals will be decided.
* '''February 2016 - April 2016''': Work on the literature + tools review of the white paper/toolkit.
* '''May 2016 - November 2016 (DLF 2016)''': The group will hold regular virtual meetings (the frequency of which will be decided at the first call) for working towards the second round of metadata assessment goals and deliverables.
* '''November 2016''': Meeting at DLF 2016 in Milwaukee (attendance not required to be a part of this group!), as well as next round of planning for metadata assessment meetings and deliverables.


==Meetings==
The 2016 goals, aims, and deliverables of the Metadata Assessment Working Group were decided in the 2016 kickoff meeting by participants. Goals included:
* setting up and testing the Metadata Assessment Working Group infrastructure & logistics;
* pulling together resources and ideas for definitions & metrics for metadata assessment, as well as beginning to uncover how one would perform this assessment;
* generating use cases for metadata assessment functionalities;
* uncovering tools that exist for metadata assessment, including how to use and understand the results


We have working meetings every 2 weeks, with 2 meeting time/day options to accommodate time zone differences:
=== Deliverables ===


Thursdays at 9 AM EST/3 PM CET,  
* [http://dlfmetadataassessment.github.io/ 2016 metadata assessment, evaluation and ‘quality’ environmental scan;]
Fridays at 11 AM EST/8 AM PST.
* [https://docs.google.com/document/d/1xHT_lnIYaN7sxNgu0QzVqeyTU2UFXU8852khEBhQ_DM/edit Use cases and scenarios illustrating metadata assessment practices & needs;]
* [https://docs.google.com/spreadsheets/d/1_xTdsksjukX6R2UQuZabCxExdcvBvLhHhDE2TNlIyiE/edit?usp=sharing Rubric & metrics for performing mostly digital collections, mostly descriptive metadata assessment (in progress);]
* [https://drive.google.com/drive/folders/0B74oOQcTdnHjWk51a283bUVta0E?usp=sharing Working documents (Google Drive);]
* [https://github.com/DLFMetadataAssessment/ GitHub infrastructure / organization]


Folks should aim to just show up to 1 of those calls in a week. Christina will be on both to make sure there is sufficient communication between the groups about our work.
== Get Involved ==


Public Google Calendar with repeating events and webex information: http://bit.ly/MetadataAssessmentCalendar
The Metadata Working Group will primarily communicate through the [https://groups.google.com/forum/#!forum/dlf-aig-metadata-assessment-working-group DLF AIG Metadata Working Group Google Group].


===Every 2 weeks Day/Time Options and Webex Information===
We have a WG call every 2 weeks on Thursdays at 11 AM EST. The call information (including dates and Webex links) can be found below.


====Thursdays 9 AM EST====
We will also have a gathering at the 2017 DLF Forum (attendance to this in person meeting is not required for folks to be involved in this group).
JOIN WEBEX MEETING
https://cornell.webex.com/cornell/j.php?MTID=ma9582cee766312e16465d3d68ec979fa
Meeting number: 644 111 236
Meeting password: Metadata1


JOIN BY PHONE
The majority of the work for 2016 was done in [https://drive.google.com/folderview?id=0B74oOQcTdnHjWk51a283bUVta0E&usp=sharing this Google Drive space], however, we have a significant portion of our work in our [https://github.com/DLFMetadataAssessment GitHub Organization].
1-855-244-8681 Call-in toll-free number (US/Canada)
1-650-479-3207 Call-in toll number (US/Canada)
Access code: 644 111 236


Global call-in numbers:
This wiki page will be used to shared static information - meeting times, decided deliverables and goals for the year, etc.
https://cornell.webex.com/cornell/globalcallin.php?serviceType=MC&ED=416965327&tollFree=1


Toll-free dialing restrictions:
=== Metadata Working Group Meetings ===
http://www.webex.com/pdf/tollfree_restrictions.pdf


====Fridays 11 AM EST====
We have working meetings every 2 weeks: Thursdays at 11 AM Eastern/8 AM Pacific. Agendas go out to the Google Group beforehand.
JOIN WEBEX MEETING
https://cornell.webex.com/cornell/j.php?MTID=mac614f56b6d7b8ff5512874c9cc927e9
Meeting number: 645 110 123
Meeting password: Metadata1


JOIN BY PHONE
==== Upcoming Meetings Schedule ====
1-855-244-8681 Call-in toll-free number (US/Canada)
1-650-479-3207 Call-in toll number (US/Canada)
Access code: 645 110 123


Global call-in numbers:
* Thursday, August 2nd 1 pm Eastern / 12 pm Central / 11 am Mountain / 10 am Pacific
https://cornell.webex.com/cornell/globalcallin.php?serviceType=MC&ED=411354927&tollFree=1
* Thursday, September 13th 1 pm Eastern / 12 pm Central / 11 am Mountain / 10 am Pacific
* Thursday, September 27th 1 pm Eastern / 12 pm Central / 11 am Mountain / 10 am Pacific
* Thursday, October 11th 1 pm Eastern / 12 pm Central / 11 am Mountain / 10 am Pacific


Toll-free dialing restrictions:  
==== Call (Zoom) Information ====
http://www.webex.com/pdf/tollfree_restrictions.pdf
Join from PC, Mac, Linux, iOS or Android:  
https://zoom.us/j/618298833
Or iPhone one-tap https://zoom.us/j/618298833p :
    US: +14087403766,,618298833#  or +16468769923,,618298833#
Or Telephone:
    Dial(for higher quality, dial a number based on your current location):
        US: +1 408 740 3766  or +1 646 876 9923  or +1 669 900 6833
    Meeting ID: 618 298 833
    International numbers available: https://zoom.us/u/mtngk


====Agenda====
==== Meeting Agendas ====
Working on the Metadata Assessment Literature and Tools Review portion of the white paper and toolkit. More specific information will be announced on the Google Group.
See the notes and agenda portion of our shared Google Drive folder: https://drive.google.com/open?id=0B74oOQcTdnHjdlJjU2dfX1gtVzQ


===2016-01-29 - Kick Off Meeting===
----
Friday, January 29, 2016 1:00 pm  |  Eastern Standard Time (New York, GMT-05:00)  |  1 hr


'''Agenda''' - Built off of this document: http://bit.ly/metadataAssessment


* Review of preliminary/broad aims of this group within the context of DLF Assessment Interest Group
[http://wiki.diglib.org/Assessment Back to the Assessment home page]
** What is DLF Assessment Interest Group
** Who can join/when/for what amount of work/etc.
** Broad timeframe
* Introductions
** Name
** Briefly, interest in this group/any deliverables you hope for
* Scope & Deliverables of this Group for 2016
** Definitions of terms used
** Based off discussion in the Google doc (http://bit.ly/metadataAssessment) and the introductions
** Decide on top 2 to tackle, what deliverables need to come from that
** Timeframe
* Logistics
** Working space going forward
** Communication
** Regular meetings - decide on frequency
*Questions, outstanding items

Revision as of 11:02, 25 July 2018

DLF Assessment Interest Group: Metadata Working Group

(Metadata Assessment Working Group)

This group is open to anyone who is interested in taking part. There are no minimum or membership requirements, though we hope you’ll take as active a part as you’re able and willing.

The Metadata Assessment Working Group aims to build guidelines, best practices, tools and workflows around the evaluation and assessment of metadata used by and for digital libraries and repositories. The group hopes to offer deliverables and recommendations that digital library and repository users can implement for metadata assessment and metadata quality control.

This group should not focus on prescriptive recommendations for metadata (using one schema versus another, or comparisons of controlled vocabularies, etc.), but rather how (both functionally and to what metrics) to measure, evaluate and assess the metadata as it exists in a variety of digital library systems. Future work could lend itself to then using that assessment work to decide a pathway for metadata enhancement.

2018 Work

We set directions, deliverables, and goals for 2018 at the 2018 kick-off meeting in January 2018. You can see more about the group's goals and discussion for 2018 at [1]

Goals

The goals for 2018, set in our kick-off meeting, include:

  • Restructure and document the MWG website
  • Review and revise the Metadata Analysis Workshop
  • Work towards creating a metadata analysis tools repository
  • Begin discussion on creating general benchmarks for metadata quality. This area of work may include gathering tools and methods for measurement of metadata quality, defining benchmarks, and establishing a platform for topic discussion

2017 Work

We set directions, deliverables, and goals for 2017 at the 2017 kick-off meeting in January 2017. You can see more about the group's goals and discussion for 2017 at [2]

Goals

The goals for 2017, set in our kick-off meeting, included:

  • Update structure of the Github site created for last year’s Environmental Scan to support expansion and ongoing work including creating mechanism for people to submit updates & feedback.
  • Review and expand list of metadata assessment tools gathered as part of the Environmental Scan. Begin testing tools gathered as part of the Environmental Scan in order to eventually create a repository for metadata assessment tools
  • Create a Metadata Application Profile Clearinghouse that can be used as a community repository for application profiles, mappings and guidelines for metadata.
  • Create a general framework document on how to assess metadata that can be used for the galleries, libraries, archives & museums (GLAM) community.
  • Collaborate with other institutions on metadata assessment and analysis workshop work.

Deliverables


2016 Work

Goals

The 2016 goals, aims, and deliverables of the Metadata Assessment Working Group were decided in the 2016 kickoff meeting by participants. Goals included:

  • setting up and testing the Metadata Assessment Working Group infrastructure & logistics;
  • pulling together resources and ideas for definitions & metrics for metadata assessment, as well as beginning to uncover how one would perform this assessment;
  • generating use cases for metadata assessment functionalities;
  • uncovering tools that exist for metadata assessment, including how to use and understand the results

Deliverables

Get Involved

The Metadata Working Group will primarily communicate through the DLF AIG Metadata Working Group Google Group.

We have a WG call every 2 weeks on Thursdays at 11 AM EST. The call information (including dates and Webex links) can be found below.

We will also have a gathering at the 2017 DLF Forum (attendance to this in person meeting is not required for folks to be involved in this group).

The majority of the work for 2016 was done in this Google Drive space, however, we have a significant portion of our work in our GitHub Organization.

This wiki page will be used to shared static information - meeting times, decided deliverables and goals for the year, etc.

Metadata Working Group Meetings

We have working meetings every 2 weeks: Thursdays at 11 AM Eastern/8 AM Pacific. Agendas go out to the Google Group beforehand.

Upcoming Meetings Schedule

  • Thursday, August 2nd 1 pm Eastern / 12 pm Central / 11 am Mountain / 10 am Pacific
  • Thursday, September 13th 1 pm Eastern / 12 pm Central / 11 am Mountain / 10 am Pacific
  • Thursday, September 27th 1 pm Eastern / 12 pm Central / 11 am Mountain / 10 am Pacific
  • Thursday, October 11th 1 pm Eastern / 12 pm Central / 11 am Mountain / 10 am Pacific

Call (Zoom) Information

Join from PC, Mac, Linux, iOS or Android: https://zoom.us/j/618298833 Or iPhone one-tap https://zoom.us/j/618298833p :

   US: +14087403766,,618298833#  or +16468769923,,618298833#

Or Telephone:

   Dial(for higher quality, dial a number based on your current location):
       US: +1 408 740 3766  or +1 646 876 9923  or +1 669 900 6833
   Meeting ID: 618 298 833
   International numbers available: https://zoom.us/u/mtngk

Meeting Agendas

See the notes and agenda portion of our shared Google Drive folder: https://drive.google.com/open?id=0B74oOQcTdnHjdlJjU2dfX1gtVzQ



Back to the Assessment home page