Difference between revisions of "Assessment:Metadata"

From DLF Wiki
Jump to navigation Jump to search
 
(27 intermediate revisions by 3 users not shown)
Line 6: Line 6:
 
The Metadata Assessment Working Group aims to build guidelines, best practices, tools and workflows around the evaluation and assessment of metadata used by and for digital libraries and repositories. The group hopes to offer deliverables and recommendations that digital library and repository users can implement for metadata assessment and metadata quality control.
 
The Metadata Assessment Working Group aims to build guidelines, best practices, tools and workflows around the evaluation and assessment of metadata used by and for digital libraries and repositories. The group hopes to offer deliverables and recommendations that digital library and repository users can implement for metadata assessment and metadata quality control.
  
This group should not focus on prescriptive recommendations for metadata (using one schema versus another, or comparisons of controlled vocabularies, etc.), but rather how (both functionally and to what metrics) to measure, evaluate and assess the metadata as it exists in a variety of digital library systems. Future work could lend itself to then using that assessment work to decide a pathway for metadata enhancement.  
+
This group should not focus on prescriptive recommendations for metadata (using one schema versus another, or comparisons of controlled vocabularies, etc.), but rather how (both functionally and to what metrics) to measure, evaluate and assess the metadata as it exists in a variety of digital library systems. Future work could lend itself to then using that assessment work to decide a pathway for metadata enhancement.
  
== 2017 Work ==
+
== Get Involved ==
 +
 
 +
The Metadata Working Group will primarily communicate through the [https://groups.google.com/forum/#!forum/dlf-aig-metadata-assessment-working-group DLF AIG Metadata Working Group Google Group].
  
We are currently setting directions, deliverables, and goals for 2017 - to be decided at the 2017 kick-off meeting See more about the group's goals and discussion for 2017, our kick-off meeting information, and comment/add your thoughts at [https://docs.google.com/document/d/1Ssk-dOhK0B699qatDUa7Gnc3QuP1IRXjr5DMaFoIJzE/edit?usp=sharing]
+
You can also join the [https://docs.google.com/forms/d/e/1FAIpQLSerRD5r57NGXF3lqtIim4t6Y8UhpLj86O7QmsXnfj1D7sLYFQ/viewform Assessment Interest Group Slack workspace]. There is a channel for the Metadata Interest Group where you can post any questions you may have.
  
=== 2017 General Timeframe ===
+
The majority of the work for 2016 was done in a Google Drive folder, which as been moved to a [https://drive.google.com/drive/folders/0AKjKPIV_XcukUk9PVA shared drive] (accessible to members of the Google Group).  Additionally, we have a significant portion of our work in our [https://github.com/DLFMetadataAssessment GitHub Organization].
  
* '''12 January 2017, 11 AM EST''': The 2017 Metadata Assessment Working Group Kick-off Meeting. 2017 goals and deliverables will be decided at this meeting. See [https://docs.google.com/document/d/1Ssk-dOhK0B699qatDUa7Gnc3QuP1IRXjr5DMaFoIJzE/edit?usp=sharing]
+
This wiki page will be used to shared static information - meeting times, decided deliverables and goals for the year, etc.
* [rest to be filled in after kick-off meeting]
 
* '''November 2017''': Meeting at DLF 2017 in Pittsburgh (attendance not required to be a part of this group!), as well as next round of planning for metadata assessment meetings and deliverables.
 
  
== 2016 Work ==
+
=== Metadata Working Group Meetings ===
  
=== Goals ===
+
We have working meetings every 2 weeks from January through DLF Forum in November.  The meetings will take place on Thursdays at 1:15 PM Eastern/10:15 AM Pacific. Agendas contain connection information and the plan for the meeting; they are available in the Google Group Drive and are sent to the Google Group beforehand.  The meeting schedule for 2021 is listed below.
 +
<br />
  
The 2016 goals, aims, and deliverables of the Metadata Assessment Working Group were decided in the 2016 kickoff meeting by participants. Goals included:
+
'''Upcoming Meetings Schedule'''
* setting up and testing the Metadata Assessment Working Group infrastructure & logistics;
+
<br />
* pulling together resources and ideas for definitions & metrics for metadata assessment, as well as beginning to uncover how one would perform this assessment;
+
All meetings are held at ''1:15 pm – 2:00 pm Eastern / 12:15 pm - 1 pm Central / 11:15 am - 12 pm Mountain / 10:15 am - 11 am Pacific''
* generating use cases for metadata assessment functionalities;
+
* January 21, 2021
* uncovering tools that exist for metadata assessment, including how to use and understand the results
+
* February 4, 2021
 +
* February 18, 2021
 +
* March 4, 2021
 +
* March 18, 2021
 +
* April 1, 2021
 +
* April 15, 2021
 +
* April 29, 2021
 +
* May 13, 2021
 +
* May 27, 2021
 +
* June 10, 2021
 +
* June 24, 2021
 +
* July 8, 2021
 +
* July 22, 2021
 +
* August 5, 2021
 +
* August 19, 2021
 +
* September 2, 2021
 +
* September 16, 2021
 +
* September 30, 2021
 +
* October 14, 2021
 +
* October 28, 2021
 +
* November 11, 2021
  
=== Deliverables ===
+
== Deliverables ==
  
* [http://dlfmetadataassessment.github.io/ 2016 metadata assessment, evaluation and ‘quality’ environmental scan;]
+
* [http://dlfmetadataassessment.github.io/EnvironmentalScan Metadata assessment, evaluation and ‘quality’ environmental scan. First created in 2016, updated in 2019.]
* [https://docs.google.com/document/d/1xHT_lnIYaN7sxNgu0QzVqeyTU2UFXU8852khEBhQ_DM/edit Use cases and scenarios illustrating metadata assessment practices & needs;]
+
* [https://dlfmetadataassessment.github.io/Framework A framework for assessing descriptive metadata in digital collections.]  
* [https://docs.google.com/spreadsheets/d/1_xTdsksjukX6R2UQuZabCxExdcvBvLhHhDE2TNlIyiE/edit?usp=sharing Rubric & metrics for performing mostly digital collections, mostly descriptive metadata assessment (in progress);]
 
* [https://drive.google.com/drive/folders/0B74oOQcTdnHjWk51a283bUVta0E?usp=sharing Working documents (Google Drive);]
 
 
* [https://github.com/DLFMetadataAssessment/ GitHub infrastructure / organization]
 
* [https://github.com/DLFMetadataAssessment/ GitHub infrastructure / organization]
 +
* [https://dlfmetadataassessment.github.io/MetadataSpecsClearinghouse Metadata Application Profile (MAP) Clearinghouse]
 +
* [https://github.com/DLFMetadataAssessment/Tools/wiki Metadata assessment tools wiki]
 +
* [https://dlfmetadataassessment.github.io/MetadataBenchmarks A survey of metadata assessment and metadata quality practices among various libraries, archives, and museums. Analysis ongoing.]
 +
* [https://dlfmetadataassessment.github.io/MetadataWorkshop A framework for a workshop on metadata analysis]
 +
<br />
  
== Get Involved ==
+
== 2021 Work & Goals ==
 
+
We had our kick-off meeting on January 21, 2021.  The group has set some initial goals for immediate work, documented in our [https://docs.google.com/document/d/1SJ9NgUSQTuEP8d3gIbnFQl38lSEKZLePnOjBUoXeci4/edit?usp=sharing 2021 work plan]:
The Metadata Working Group will primarily communicate through the [https://groups.google.com/forum/#!forum/dlf-aig-metadata-assessment-working-group DLF AIG Metadata Working Group Google Group].
+
<br />
  
We have a WG call every 2 weeks on Thursdays at 11 AM EST. The call information (including dates and Webex links) can be found below.
+
* Publish posts on the DLF News/Blog roughly once per month announcing the group's work or discussing related topics
 +
* During the spring, finish website changes already identified or started in 2020
 +
:* Reorganize links and info about projects/resources
 +
:* Establish review & update cycles
 +
:* Clarify information about specific tasks under "participation"
 +
* Review and complete the spreadsheet categorizing tools
 +
:* Determine format and where it should live
  
We will also have a gathering at the 2017 DLF Forum (attendance to this in person meeting is not required for folks to be involved in this group).
+
<br />
  
The majority of the work for 2016 was done in [https://drive.google.com/folderview?id=0B74oOQcTdnHjWk51a283bUVta0E&usp=sharing this Google Drive space], however, we have a significant portion of our work in our [https://github.com/DLFMetadataAssessment GitHub Organization].
+
== 2020 Work & Goals ==
 +
We set directions, deliverables, and goals for 2020 at the kick-off meeting in January 2020.
 +
<br />
  
This wiki page will be used to shared static information - meeting times, decided deliverables and goals for the year, etc.
+
* High-priority work:
 +
:* Update for Environmental Scan from 2016
 +
:* Benchmarks white paper based on 2019 survey ([http://dlfmetadataassessment.github.io/MetadataBenchmarks published in May 2020])
 +
* Medium-priority work:
 +
:* Determine how to update/manage Metadata Application Profile Clearinghouse
 +
* Lower-priority work:
 +
:* Tools repository updates/changes
 +
:* General website maintenance
  
=== Metadata Working Group Meetings ===
+
== 2019 Work & Goals ==
 +
We set directions, deliverables, and goals for 2019 at the 2019 kick-off meeting in January 2019.
 +
<br />
 +
The goals for 2019, set in our kick-off meeting, include:
 +
* Website restructuring and documentation
 +
* Continue work towards creating a metadata analysis tools repository
 +
* Maintenance and promotion of past projects
 +
* Collaborate with other AIG Groups
 +
* Continue work on survey benchmarking metadata quality
 +
<br />
  
We have working meetings every 2 weeks: Thursdays at 11 AM Eastern/8 AM Pacific. Agendas go out to the Google Group beforehand.
+
== 2018 Work & Goals ==
 +
We set directions, deliverables, and goals for 2018 at the 2018 kick-off meeting in January 2018. More about the group's [https://docs.google.com/document/d/15lJZzpSNbo95ca6MNbDb_7s4aRzqk7j20i6Bl1zAMuQ/edit?usp=sharing goals and discussion for 2018]
 +
<br />
  
==== Meetings Schedule ====
+
The goals for 2018, set in our kick-off meeting, include:
 +
* Restructure and document the MWG website
 +
* Review and revise the Metadata Analysis Workshop
 +
* Work towards creating a metadata analysis tools repository
 +
* Begin discussion on creating general benchmarks for metadata quality. This area of work may include gathering tools and methods for measurement of metadata quality, defining benchmarks, and establishing a platform for topic discussion
 +
<br />
  
* Thursday, January 12th, 2017 11 AM Eastern - kick off meeting
+
== 2017 Work & Goals ==
* Thursday, January 26th, 2017 11 AM Eastern
 
* Thursday, February 9th, 2017 11 AM Eastern
 
* Thursday, February 23rd, 2017 11 AM Eastern
 
* Thursday, March 9th, 2017 11 AM Eastern (possibly rescheduled due to Code4Lib)
 
* Thursday, March 23rd, 2017 11 AM Eastern
 
* Thursday, April 6th, 2017 11 AM Eastern
 
* Thursday, April 20th, 2017 11 AM Eastern
 
* Thursday, May 4th, 2017 11 AM Eastern
 
* Thursday, May 18th, 2017 11 AM Eastern
 
* Thursday, June 1st, 2017 11 AM Eastern
 
* Thursday, June 15th, 2017 11 AM Eastern
 
* Thursday, June 29th, 2017 11 AM Eastern
 
* Thursday, July 13th, 2017 11 AM Eastern
 
* Thursday, July 27th, 2017 11 AM Eastern
 
* Thursday, August 10th, 2017 11 AM Eastern
 
* Thursday, August 24th, 2017 11 AM Eastern
 
* Thursday, September 7th, 2017 11 AM Eastern
 
* Thursday, September 21st, 2017 11 AM Eastern
 
* Thursday, October 5th, 2017 11 AM Eastern
 
* Thursday, October 19th, 2017 11 AM Eastern
 
* DLF Forum October 23rd-25th
 
* Thursday, November 2nd, 2017 11 AM Eastern (may be cancelled for sake of meeting week before at DLF Forum)
 
* Thursday, November 16th, 2017 11 AM Eastern
 
* Thursday, November 30th, 2017 11 AM Eastern
 
* Thursday, December 14th, 2017 11 AM Eastern
 
  
==== Webex Information ====
+
We set directions, deliverables, and goals for 2017 at the 2017 kick-off meeting in January 2017. YMore about the group's [https://docs.google.com/document/d/1Ssk-dOhK0B699qatDUa7Gnc3QuP1IRXjr5DMaFoIJzE/edit?usp=sharing goals and discussion for 2017]
 +
<br />
  
JOIN WEBEX MEETING
+
The goals for 2017, set in our kick-off meeting, included:
https://cornell.webex.com/cornell/j.php?MTID=m8919824e5fbf098c530d0e44951101c0
+
* Update structure of the Github site created for last year’s Environmental Scan to support expansion and ongoing work including creating mechanism for people to submit updates & feedback.
Meeting number (access code): 645 170 370
+
* Review and expand list of metadata assessment tools gathered as part of the Environmental Scan. Begin testing tools gathered as part of the Environmental Scan in order to eventually create a repository for metadata assessment tools
Meeting password: Metadata1
+
* Create a Metadata Application Profile Clearinghouse that can be used as a community repository for application profiles, mappings and guidelines for metadata.
 +
* Create a general framework document on how to assess metadata that can be used for the galleries, libraries, archives & museums (GLAM) community.
 +
* Collaborate with other institutions on metadata assessment and analysis workshop work.
 +
<br />
  
JOIN BY PHONE
+
== 2016 Work & Goals ==
1-855-244-8681 Call-in toll-free number (US/Canada)
 
1-650-479-3207 Call-in toll number (US/Canada)
 
  
Global call-in numbers: https://cornell.webex.com/cornell/globalcallin.php?serviceType=MC&ED=518200872&tollFree=1
+
The 2016 goals, aims, and deliverables of the Metadata Assessment Working Group were decided in the 2016 kickoff meeting by participants. Goals included:
Toll-free dialing restrictions: https://www.webex.com/pdf/tollfree_restrictions.pdf
+
* setting up and testing the Metadata Assessment Working Group infrastructure & logistics;
Can't join the meeting? Contact support here: https://cornell.webex.com/cornell/mc
+
* pulling together resources and ideas for definitions & metrics for metadata assessment, as well as beginning to uncover how one would perform this assessment;
 
+
* generating use cases for metadata assessment functionalities;
==== Meeting Agendas ====
+
* uncovering tools that exist for metadata assessment, including how to use and understand the results
See the notes and agenda portion of our shared Google Drive folder: https://drive.google.com/open?id=0B74oOQcTdnHjdlJjU2dfX1gtVzQ
 
 
 
----
 
  
  
 
[http://wiki.diglib.org/Assessment Back to the Assessment home page]
 
[http://wiki.diglib.org/Assessment Back to the Assessment home page]

Latest revision as of 17:37, 5 April 2021

DLF Assessment Interest Group: Metadata Working Group

(Metadata Assessment Working Group)

This group is open to anyone who is interested in taking part. There are no minimum or membership requirements, though we hope you’ll take as active a part as you’re able and willing.

The Metadata Assessment Working Group aims to build guidelines, best practices, tools and workflows around the evaluation and assessment of metadata used by and for digital libraries and repositories. The group hopes to offer deliverables and recommendations that digital library and repository users can implement for metadata assessment and metadata quality control.

This group should not focus on prescriptive recommendations for metadata (using one schema versus another, or comparisons of controlled vocabularies, etc.), but rather how (both functionally and to what metrics) to measure, evaluate and assess the metadata as it exists in a variety of digital library systems. Future work could lend itself to then using that assessment work to decide a pathway for metadata enhancement.

Get Involved

The Metadata Working Group will primarily communicate through the DLF AIG Metadata Working Group Google Group.

You can also join the Assessment Interest Group Slack workspace. There is a channel for the Metadata Interest Group where you can post any questions you may have.

The majority of the work for 2016 was done in a Google Drive folder, which as been moved to a shared drive (accessible to members of the Google Group). Additionally, we have a significant portion of our work in our GitHub Organization.

This wiki page will be used to shared static information - meeting times, decided deliverables and goals for the year, etc.

Metadata Working Group Meetings

We have working meetings every 2 weeks from January through DLF Forum in November. The meetings will take place on Thursdays at 1:15 PM Eastern/10:15 AM Pacific. Agendas contain connection information and the plan for the meeting; they are available in the Google Group Drive and are sent to the Google Group beforehand. The meeting schedule for 2021 is listed below.

Upcoming Meetings Schedule
All meetings are held at 1:15 pm – 2:00 pm Eastern / 12:15 pm - 1 pm Central / 11:15 am - 12 pm Mountain / 10:15 am - 11 am Pacific

  • January 21, 2021
  • February 4, 2021
  • February 18, 2021
  • March 4, 2021
  • March 18, 2021
  • April 1, 2021
  • April 15, 2021
  • April 29, 2021
  • May 13, 2021
  • May 27, 2021
  • June 10, 2021
  • June 24, 2021
  • July 8, 2021
  • July 22, 2021
  • August 5, 2021
  • August 19, 2021
  • September 2, 2021
  • September 16, 2021
  • September 30, 2021
  • October 14, 2021
  • October 28, 2021
  • November 11, 2021

Deliverables


2021 Work & Goals

We had our kick-off meeting on January 21, 2021. The group has set some initial goals for immediate work, documented in our 2021 work plan:

  • Publish posts on the DLF News/Blog roughly once per month announcing the group's work or discussing related topics
  • During the spring, finish website changes already identified or started in 2020
  • Reorganize links and info about projects/resources
  • Establish review & update cycles
  • Clarify information about specific tasks under "participation"
  • Review and complete the spreadsheet categorizing tools
  • Determine format and where it should live


2020 Work & Goals

We set directions, deliverables, and goals for 2020 at the kick-off meeting in January 2020.

  • High-priority work:
  • Update for Environmental Scan from 2016
  • Benchmarks white paper based on 2019 survey (published in May 2020)
  • Medium-priority work:
  • Determine how to update/manage Metadata Application Profile Clearinghouse
  • Lower-priority work:
  • Tools repository updates/changes
  • General website maintenance

2019 Work & Goals

We set directions, deliverables, and goals for 2019 at the 2019 kick-off meeting in January 2019.
The goals for 2019, set in our kick-off meeting, include:

  • Website restructuring and documentation
  • Continue work towards creating a metadata analysis tools repository
  • Maintenance and promotion of past projects
  • Collaborate with other AIG Groups
  • Continue work on survey benchmarking metadata quality


2018 Work & Goals

We set directions, deliverables, and goals for 2018 at the 2018 kick-off meeting in January 2018. More about the group's goals and discussion for 2018

The goals for 2018, set in our kick-off meeting, include:

  • Restructure and document the MWG website
  • Review and revise the Metadata Analysis Workshop
  • Work towards creating a metadata analysis tools repository
  • Begin discussion on creating general benchmarks for metadata quality. This area of work may include gathering tools and methods for measurement of metadata quality, defining benchmarks, and establishing a platform for topic discussion


2017 Work & Goals

We set directions, deliverables, and goals for 2017 at the 2017 kick-off meeting in January 2017. YMore about the group's goals and discussion for 2017

The goals for 2017, set in our kick-off meeting, included:

  • Update structure of the Github site created for last year’s Environmental Scan to support expansion and ongoing work including creating mechanism for people to submit updates & feedback.
  • Review and expand list of metadata assessment tools gathered as part of the Environmental Scan. Begin testing tools gathered as part of the Environmental Scan in order to eventually create a repository for metadata assessment tools
  • Create a Metadata Application Profile Clearinghouse that can be used as a community repository for application profiles, mappings and guidelines for metadata.
  • Create a general framework document on how to assess metadata that can be used for the galleries, libraries, archives & museums (GLAM) community.
  • Collaborate with other institutions on metadata assessment and analysis workshop work.


2016 Work & Goals

The 2016 goals, aims, and deliverables of the Metadata Assessment Working Group were decided in the 2016 kickoff meeting by participants. Goals included:

  • setting up and testing the Metadata Assessment Working Group infrastructure & logistics;
  • pulling together resources and ideas for definitions & metrics for metadata assessment, as well as beginning to uncover how one would perform this assessment;
  • generating use cases for metadata assessment functionalities;
  • uncovering tools that exist for metadata assessment, including how to use and understand the results


Back to the Assessment home page