Difference between revisions of "Assessment:Metadata"

From DLF Wiki
Jump to navigation Jump to search
 
(19 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 
 
= DLF Assessment Interest Group: Metadata Working Group =
 
= DLF Assessment Interest Group: Metadata Working Group =
 
'''''(Metadata Assessment Working Group)'''''
 
'''''(Metadata Assessment Working Group)'''''
 
== Broad Aims + Description of the Metadata Assessment Group within DLF AIG ==
 
  
 
This group is open to anyone who is interested in taking part. There are no minimum or membership requirements, though we hope you’ll take as active a part as you’re able and willing.
 
This group is open to anyone who is interested in taking part. There are no minimum or membership requirements, though we hope you’ll take as active a part as you’re able and willing.
Line 9: Line 6:
 
The Metadata Assessment Working Group aims to build guidelines, best practices, tools and workflows around the evaluation and assessment of metadata used by and for digital libraries and repositories. The group hopes to offer deliverables and recommendations that digital library and repository users can implement for metadata assessment and metadata quality control.
 
The Metadata Assessment Working Group aims to build guidelines, best practices, tools and workflows around the evaluation and assessment of metadata used by and for digital libraries and repositories. The group hopes to offer deliverables and recommendations that digital library and repository users can implement for metadata assessment and metadata quality control.
  
This group should not focus on prescriptive recommendations for metadata (using one schema versus another, or comparisons of controlled vocabularies, etc.), but rather how (both functionally and to what metrics) to measure, evaluate and assess the metadata as it exists in a variety of digital library systems. Future work could lend itself to then using that assessment work to decide a pathway for metadata enhancement. This framing is very much influenced by the [https://docs.google.com/document/d/15pmA276_fxShkCEagoloJwCXH89PhrF3qWBgB8xSrag/edit#heading=h.mq4e51njyj6 flurry of interest, activity and discussion around metadata assessment that occurred just after DPLAfest 2015].
+
This group should not focus on prescriptive recommendations for metadata (using one schema versus another, or comparisons of controlled vocabularies, etc.), but rather how (both functionally and to what metrics) to measure, evaluate and assess the metadata as it exists in a variety of digital library systems. Future work could lend itself to then using that assessment work to decide a pathway for metadata enhancement.
  
== Metadata WG Scope & Aims in 2016 ==
+
== Get Involved ==
  
The goals, aims, and deliverables of the Metadata Working Group were decided in the kick off meeting by participants. Broadly, we aim to:
+
The Metadata Working Group will primarily communicate through the [https://groups.google.com/forum/#!forum/dlf-aig-metadata-assessment-working-group DLF AIG Metadata Working Group Google Group].  
* Work collaboratively on a white paper that will be an aggregate of a number of areas of work...
 
** the first being a literature (and tools) review of metadata assessment work so far (current focus of our work) - http://bit.ly/MetadataAssessDraft
 
** then further clarifying for our work metadata assessment metrics and definitions
 
** then building out a metadata assessment rubric
 
** as well as capturing metadata assessment use cases.
 
  
See more about the group's goals and discussion on them at http://bit.ly/metadataAssessment
+
You can also join the [https://docs.google.com/forms/d/e/1FAIpQLSerRD5r57NGXF3lqtIim4t6Y8UhpLj86O7QmsXnfj1D7sLYFQ/viewform Assessment Interest Group Slack workspace]. There is a channel for the Metadata Interest Group where you can post any questions you may have.
  
== Ongoing Metadata Assessment Working Group Communication ==
+
The majority of the work for 2016 was done in [https://drive.google.com/folderview?id=0B74oOQcTdnHjWk51a283bUVta0E&usp=sharing this Google Drive space], however, we have a significant portion of our work in our [https://github.com/DLFMetadataAssessment GitHub Organization].
  
The Metadata Working Group will primarily communicate through the [https://groups.google.com/forum/#!forum/dlf-aig-metadata-assessment-working-group DLF AIG Metadata Working Group Google Group].  
+
This wiki page will be used to shared static information - meeting times, decided deliverables and goals for the year, etc.
  
We have a WG call every 2 weeks with two day/time options to support participation from different time zones. Options are Thursday at 9 AM EST and Fridays at 11 AM EST. The call information (including dates and Webex links) can be found below.
+
=== Metadata Working Group Meetings ===
  
We will also have a gathering at the 2016 DLF Forum (attendance to this in person meeting is not required for folks to be involved in this group).
+
We have working meetings every 2 weeks from January through DLF Forum in November.  The meetings will take place on Thursdays at 1:15 PM Eastern/10:15 AM Pacific. Agendas are available in the Google Group Drive and are sent to the Google Group beforehand.  The meeting schedule for 2020 is listed below.
  
All the work is being done in this Google Drive space: https://drive.google.com/folderview?id=0B74oOQcTdnHjWk51a283bUVta0E&usp=sharing
+
==== Connection information ====
 +
https://clirdlf.zoom.us/j/767714483
 +
 +
Meeting ID: 767 714 483
 +
 +
Dial by your location
  
This Wikipage will be used to shared decided information - meeting times, decided deliverables and goals, etc.
+
        +1 646 876 9923 US (New York)
  
== General Group Timeframe ==
+
        +1 669 900 6833 US (San Jose)
  
* '''December 2015''': Call for all people interested in participating in this group.
+
        +1 408 638 0968 US (San Jose)
* '''December 2015 - Mid January 2016''': All interested participants should join the Google Group to then be invited to edit shared documentation (Google documents, like this document) bringing together existing metadata assessment tools, work, resources, use cases, methods, etc.
 
* '''29 January 2016, 1 PM EST''': The first virtual meeting of the group, through Webex (information at top of this document). At this first meeting, more specific goals will be decided.
 
* '''February 2016 - April 2016''': Work on the literature + tools review of the white paper/toolkit.
 
* '''May 2016 - November 2016 (DLF 2016)''': The group will hold regular virtual meetings (the frequency of which will be decided at the first call) for working towards the second round of metadata assessment goals and deliverables.
 
* '''November 2016''': Meeting at DLF 2016 in Milwaukee (attendance not required to be a part of this group!), as well as next round of planning for metadata assessment meetings and deliverables.
 
  
==Meetings==
+
Meeting ID: 767 714 483
  
We have working meetings every 2 weeks, with 1 meeting time/day option:
+
Find your local number: https://clirdlf.zoom.us/u/aojCpLuLf
  
Thursdays at 11 AM Eastern/8 AM Pacific.
+
==== Upcoming Meetings Schedule ====
 +
All meetings are held at ''1:15 pm – 2:00 pm Eastern / 12:15 pm - 1 pm Central / 11:15 am - 12 pm Mountain / 10:15 am - 11 am Pacific''
 +
* January 30th, 2020,
 +
* February 13, 2020
 +
* February 27, 2020
 +
* March 12, 2020
 +
* March 26, 2020
 +
* April 9, 2020
 +
* April 23, 2020
 +
* May 7, 2020
 +
* May 21, 2020
 +
* June 4, 2020
 +
* June 18, 2020
 +
* July 2, 2020
 +
* July 16, 2020
 +
* July 30, 2020
 +
* August 13, 2020
 +
* August 27, 2020
 +
* September 10th, 2020
 +
* September 24, 2020
 +
* October 8, 2020
 +
* October 22, 2020
 +
* November 19, 2020
  
Agendas go out to the Google Group the weekend before.
 
  
Public Google Calendar with repeating event and webex information: http://bit.ly/MetadataAssessmentCalendar
+
== Deliverables ==
  
====Meetings Schedule:====
+
* [http://dlfmetadataassessment.github.io/EnvironmentalScan Metadata assessment, evaluation and ‘quality’ environmental scan. First created in 2016, updated in 2019.]
 +
* [https://dlfmetadataassessment.github.io/Framework A framework for assessing descriptive metadata in digital collections.]
 +
* [https://github.com/DLFMetadataAssessment/ GitHub infrastructure / organization]
 +
* [https://dlfmetadataassessment.github.io/MetadataSpecsClearinghouse Metadata Application Profile (MAP) Clearinghouse]
 +
* [https://github.com/DLFMetadataAssessment/Tools/wiki Metadata assessment tools wiki]
 +
* [https://dlfmetadataassessment.github.io/MetadataBenchmarks A survey of metadata assessment and metadata quality practices among various libraries, archives, and museums. Analysis ongoing.]
 +
* [https://dlfmetadataassessment.github.io/MetadataWorkshop A framework for a workshop on metadata analysis]
 +
<br />
  
* Thursday, April 7th, 2016 11 AM Eastern
+
== 2020 Work & Goals ==
* <strike>Thursday, April 21st, 2016 11 AM Eastern</strike> See here for more information: https://groups.google.com/forum/#!topic/dlf-aig-metadata-assessment-working-group/1803gUeMtYQ
+
We set directions, deliverables, and goals for 2020 at the kick-off meeting in January 2020.]
* Thursday, May 5th, 2016 11 AM Eastern
+
<br />
* Thursday, May 19th, 2016 11 AM Eastern
 
* Thursday, June 2nd, 2016 11 AM Eastern
 
* Thursday, June 16th, 2016 11 AM Eastern
 
* Thursday, June 30th, 2016 11 AM Eastern
 
* Thursday, July 14th, 2016 11 AM Eastern
 
* Thursday, July 28th, 2016 11 AM Eastern
 
* Thursday, August 11th, 2016 11 AM Eastern
 
* Thursday, August 25th, 2016 11 AM Eastern
 
* Thursday, September 8th, 2016 11 AM Eastern
 
* Thursday, September 22nd, 2016 11 AM Eastern
 
* Thursday, October 6th, 2016 11 AM Eastern
 
* Thursday, October 20th, 2016 11 AM Eastern
 
* Thursday, November 3rd, 2016 11 AM Eastern
 
* DLF Forum: November 7-10, 2016 (exact meeting time TBD)
 
* No meeting: Thursday, November 17th, 2016 11 AM Eastern (recover from DLF)
 
* Thursday, December 1st, 2016 11 AM Eastern
 
* Thursday, December 15th, 2016 11 AM Eastern
 
  
2017 will be decided at the 2017 'kick off' meeting, where new priorities and plans will be brought up.
+
* High-priority work:
 +
:* Update for Environmental Scan from 2016
 +
:* Benchmarks white paper based on 2019 survey ([http://dlfmetadataassessment.github.io/MetadataBenchmarks published in May 2020])
 +
* Medium-priority work:
 +
:* Determine how to update/manage Metadata Application Profile Clearinghouse
 +
* Lower-priority work:
 +
:* Tools repository updates/changes
 +
:* General website maintenance
  
===Every 2 weeks Day/Time Options and Webex Information===
+
== 2019 Work & Goals ==
 +
We set directions, deliverables, and goals for 2019 at the 2019 kick-off meeting in January 2019.]
 +
<br />
 +
The goals for 2019, set in our kick-off meeting, include:
 +
* Website restructuring and documentation
 +
* Continue work towards creating a metadata analysis tools repository
 +
* Maintenance and promotion of past projects
 +
* Collaborate with other AIG Groups
 +
* Continue work on survey benchmarking metadata quality
 +
<br />
  
====Thursdays 11 AM EST====
+
== 2018 Work & Goals ==
JOIN WEBEX MEETING
+
We set directions, deliverables, and goals for 2018 at the 2018 kick-off meeting in January 2018. More about the group's [https://docs.google.com/document/d/15lJZzpSNbo95ca6MNbDb_7s4aRzqk7j20i6Bl1zAMuQ/edit?usp=sharing goals and discussion for 2018]
https://cornell.webex.com/cornell/j.php?MTID=m10772e85116c02481454a631fb207ad4
+
<br />
Meeting number: 644 111 236
 
Meeting password: Metadata1
 
  
JOIN BY PHONE
+
The goals for 2018, set in our kick-off meeting, include:
1-855-244-8681 Call-in toll-free number (US/Canada)
+
* Restructure and document the MWG website
1-650-479-3207 Call-in toll number (US/Canada)
+
* Review and revise the Metadata Analysis Workshop
Access code: 644 111 236
+
* Work towards creating a metadata analysis tools repository
 +
* Begin discussion on creating general benchmarks for metadata quality. This area of work may include gathering tools and methods for measurement of metadata quality, defining benchmarks, and establishing a platform for topic discussion
 +
<br />
  
Global call-in numbers:
+
== 2017 Work & Goals ==
https://cornell.webex.com/cornell/globalcallin.php?serviceType=MC&ED=416965327&tollFree=1
 
  
Toll-free dialing restrictions:
+
We set directions, deliverables, and goals for 2017 at the 2017 kick-off meeting in January 2017. YMore about the group's [https://docs.google.com/document/d/1Ssk-dOhK0B699qatDUa7Gnc3QuP1IRXjr5DMaFoIJzE/edit?usp=sharing goals and discussion for 2017]
http://www.webex.com/pdf/tollfree_restrictions.pdf
+
<br />
  
====Agenda====
+
The goals for 2017, set in our kick-off meeting, included:
Working on the Metadata Assessment Literature and Tools Review portion of the white paper and toolkit. More specific information will be announced on the Google Group.
+
* Update structure of the Github site created for last year’s Environmental Scan to support expansion and ongoing work including creating mechanism for people to submit updates & feedback.
 +
* Review and expand list of metadata assessment tools gathered as part of the Environmental Scan. Begin testing tools gathered as part of the Environmental Scan in order to eventually create a repository for metadata assessment tools
 +
* Create a Metadata Application Profile Clearinghouse that can be used as a community repository for application profiles, mappings and guidelines for metadata.
 +
* Create a general framework document on how to assess metadata that can be used for the galleries, libraries, archives & museums (GLAM) community.
 +
* Collaborate with other institutions on metadata assessment and analysis workshop work.
 +
<br />
  
See the notes and agenda portion of our shared Google Drive folder: https://drive.google.com/open?id=0B74oOQcTdnHjdlJjU2dfX1gtVzQ
+
== 2016 Work & Goals ==
  
 +
The 2016 goals, aims, and deliverables of the Metadata Assessment Working Group were decided in the 2016 kickoff meeting by participants. Goals included:
 +
* setting up and testing the Metadata Assessment Working Group infrastructure & logistics;
 +
* pulling together resources and ideas for definitions & metrics for metadata assessment, as well as beginning to uncover how one would perform this assessment;
 +
* generating use cases for metadata assessment functionalities;
 +
* uncovering tools that exist for metadata assessment, including how to use and understand the results
  
----
 
  
 
[http://wiki.diglib.org/Assessment Back to the Assessment home page]
 
[http://wiki.diglib.org/Assessment Back to the Assessment home page]

Latest revision as of 15:53, 17 November 2020

DLF Assessment Interest Group: Metadata Working Group[edit]

(Metadata Assessment Working Group)

This group is open to anyone who is interested in taking part. There are no minimum or membership requirements, though we hope you’ll take as active a part as you’re able and willing.

The Metadata Assessment Working Group aims to build guidelines, best practices, tools and workflows around the evaluation and assessment of metadata used by and for digital libraries and repositories. The group hopes to offer deliverables and recommendations that digital library and repository users can implement for metadata assessment and metadata quality control.

This group should not focus on prescriptive recommendations for metadata (using one schema versus another, or comparisons of controlled vocabularies, etc.), but rather how (both functionally and to what metrics) to measure, evaluate and assess the metadata as it exists in a variety of digital library systems. Future work could lend itself to then using that assessment work to decide a pathway for metadata enhancement.

Get Involved[edit]

The Metadata Working Group will primarily communicate through the DLF AIG Metadata Working Group Google Group.

You can also join the Assessment Interest Group Slack workspace. There is a channel for the Metadata Interest Group where you can post any questions you may have.

The majority of the work for 2016 was done in this Google Drive space, however, we have a significant portion of our work in our GitHub Organization.

This wiki page will be used to shared static information - meeting times, decided deliverables and goals for the year, etc.

Metadata Working Group Meetings[edit]

We have working meetings every 2 weeks from January through DLF Forum in November. The meetings will take place on Thursdays at 1:15 PM Eastern/10:15 AM Pacific. Agendas are available in the Google Group Drive and are sent to the Google Group beforehand. The meeting schedule for 2020 is listed below.

Connection information[edit]

https://clirdlf.zoom.us/j/767714483

Meeting ID: 767 714 483

Dial by your location

       +1 646 876 9923 US (New York)
       +1 669 900 6833 US (San Jose)
       +1 408 638 0968 US (San Jose)

Meeting ID: 767 714 483

Find your local number: https://clirdlf.zoom.us/u/aojCpLuLf

Upcoming Meetings Schedule[edit]

All meetings are held at 1:15 pm – 2:00 pm Eastern / 12:15 pm - 1 pm Central / 11:15 am - 12 pm Mountain / 10:15 am - 11 am Pacific

  • January 30th, 2020,
  • February 13, 2020
  • February 27, 2020
  • March 12, 2020
  • March 26, 2020
  • April 9, 2020
  • April 23, 2020
  • May 7, 2020
  • May 21, 2020
  • June 4, 2020
  • June 18, 2020
  • July 2, 2020
  • July 16, 2020
  • July 30, 2020
  • August 13, 2020
  • August 27, 2020
  • September 10th, 2020
  • September 24, 2020
  • October 8, 2020
  • October 22, 2020
  • November 19, 2020


Deliverables[edit]


2020 Work & Goals[edit]

We set directions, deliverables, and goals for 2020 at the kick-off meeting in January 2020.]

  • High-priority work:
  • Update for Environmental Scan from 2016
  • Benchmarks white paper based on 2019 survey (published in May 2020)
  • Medium-priority work:
  • Determine how to update/manage Metadata Application Profile Clearinghouse
  • Lower-priority work:
  • Tools repository updates/changes
  • General website maintenance

2019 Work & Goals[edit]

We set directions, deliverables, and goals for 2019 at the 2019 kick-off meeting in January 2019.]
The goals for 2019, set in our kick-off meeting, include:

  • Website restructuring and documentation
  • Continue work towards creating a metadata analysis tools repository
  • Maintenance and promotion of past projects
  • Collaborate with other AIG Groups
  • Continue work on survey benchmarking metadata quality


2018 Work & Goals[edit]

We set directions, deliverables, and goals for 2018 at the 2018 kick-off meeting in January 2018. More about the group's goals and discussion for 2018

The goals for 2018, set in our kick-off meeting, include:

  • Restructure and document the MWG website
  • Review and revise the Metadata Analysis Workshop
  • Work towards creating a metadata analysis tools repository
  • Begin discussion on creating general benchmarks for metadata quality. This area of work may include gathering tools and methods for measurement of metadata quality, defining benchmarks, and establishing a platform for topic discussion


2017 Work & Goals[edit]

We set directions, deliverables, and goals for 2017 at the 2017 kick-off meeting in January 2017. YMore about the group's goals and discussion for 2017

The goals for 2017, set in our kick-off meeting, included:

  • Update structure of the Github site created for last year’s Environmental Scan to support expansion and ongoing work including creating mechanism for people to submit updates & feedback.
  • Review and expand list of metadata assessment tools gathered as part of the Environmental Scan. Begin testing tools gathered as part of the Environmental Scan in order to eventually create a repository for metadata assessment tools
  • Create a Metadata Application Profile Clearinghouse that can be used as a community repository for application profiles, mappings and guidelines for metadata.
  • Create a general framework document on how to assess metadata that can be used for the galleries, libraries, archives & museums (GLAM) community.
  • Collaborate with other institutions on metadata assessment and analysis workshop work.


2016 Work & Goals[edit]

The 2016 goals, aims, and deliverables of the Metadata Assessment Working Group were decided in the 2016 kickoff meeting by participants. Goals included:

  • setting up and testing the Metadata Assessment Working Group infrastructure & logistics;
  • pulling together resources and ideas for definitions & metrics for metadata assessment, as well as beginning to uncover how one would perform this assessment;
  • generating use cases for metadata assessment functionalities;
  • uncovering tools that exist for metadata assessment, including how to use and understand the results


Back to the Assessment home page