Latest revision as of 18:13, 16 December 2024

DLF Assessment Interest Group: Metadata Working Group

(Metadata Assessment Working Group)

This group is open to anyone who is interested in taking part. There are no minimum or membership requirements, though we hope you’ll take as active a part as you’re able and willing.

The Metadata Assessment Working Group aims to build guidelines, best practices, tools and workflows around the evaluation and assessment of metadata used by and for digital libraries and repositories. The group hopes to offer deliverables and recommendations that digital library and repository users can implement for metadata assessment and metadata quality control.

This group should not focus on prescriptive recommendations for metadata (using one schema versus another, or comparisons of controlled vocabularies, etc.), but rather how (both functionally and to what metrics) to measure, evaluate and assess the metadata as it exists in a variety of digital library systems. Future work could lend itself to then using that assessment work to decide a pathway for metadata enhancement.

Get Involved

The Metadata Working Group will primarily communicate through the DLF AIG Metadata Working Group Google Group.

The majority of the work for 2016 was done in a Google Drive folder, which as been moved to a shared drive (accessible to members of the Google Group).
Joining the Google Group also gives you access to shared documents and meeting minutes, if you want to stay up-to-date but cannot attend all of the meetings

You can also join the Assessment Interest Group Slack workspace. There is a channel for the Metadata Interest Group where you can post any questions you may have.

Additionally, we have a significant portion of our work in our public-facing GitHub website.

This wiki page will be used to shared static information - meeting times, decided deliverables and goals for the year, etc.

Metadata Working Group Meetings

We have working meetings every 2-4 weeks from January or February through DLF Forum in November. The meetings will take place on Thursdays at 1:15 PM Eastern/10:15 AM Pacific. Agendas contain connection information and the plan for the meeting; they are available in the Google Group Drive and are sent to the Google Group beforehand.

Upcoming Meeting Schedule
All meetings are held at 1:15 pm – 2:00 pm Eastern / 12:15 pm - 1 pm Central / 11:15 am - 12 pm Mountain / 10:15 am - 11 am Pacific

Meeting dates TBD for 2025

Current Projects

Deliverables

GitHub infrastructure / organization
Public-facing website & projects:

Zotero group for metadata assessment publications

2025 Work & Goals

Meeting participants will discuss potential work and priorities during the kick-off meeting(s) TBD, based on the 2025 planning document.

Ongoing projects:

Managing website text and resources (including the MAP Clearinghouse, tools repository, and skill-building resources)
Benchmarking for metadata quality

Previous Work

2024 Work & Goals

Overall maintenance on website and public-facing information

Addition of an Acronyms page for digital-library-related acronyms and initialisms

Progress on metadata quality benchmarks including internal and external feedback on drafts

2023 Work & Goals

Highlights:

Providing public-facing information

Addition of Skillbuilding Resources to the website
Blog posts on Five Tips for Rapid Metadata Assessment and case studies related to authority control

Further work toward drafting quality benchmarks
Started compiling a glossary of terms and acronyms related to digital libraries

2022 Work & Goals

See the 2022 work plan document for more information. (Note that supplemental documents linked from the work plan limit access to members of the group.)
Here are some of the things that were done during 2022:

Updates to the group website format and information, including:

Migration of the Metadata Application Profile Clearinghouse
Migration of the Tools Repository to the website

Blog posts about metadata assessment topics
Information gathering about metadata assessment resources & tutorials
iPres paper and presentation about the Metadata Quality Benchmarks work

2021 Work & Goals

We had our kick-off meeting on January 21, 2021. The group set some initial goals for immediate work, documented in our 2021 work plan:

Publish posts on the DLF News/Blog roughly once per month announcing the group's work or discussing related topics

Posts during 2021:

During the spring, finish website changes already identified or started in 2020

Reorganize links and info about projects/resources
Establish review & update cycles
Clarify information about specific tasks under "participation"

Review and complete the spreadsheet categorizing tools

Determine format and where it should live

2020 Work & Goals

We set directions, deliverables, and goals for 2020 at the kick-off meeting in January 2020.

High-priority work:

Update for Environmental Scan from 2016
Benchmarks white paper based on 2019 survey (published in May 2020)

Medium-priority work:

Determine how to update/manage Metadata Application Profile Clearinghouse

Lower-priority work:

Tools repository updates/changes
General website maintenance

2019 Work & Goals

We set directions, deliverables, and goals for 2019 at the 2019 kick-off meeting in January 2019.
The goals for 2019, set in our kick-off meeting, include:

Website restructuring and documentation
Continue work towards creating a metadata analysis tools repository
Maintenance and promotion of past projects
Collaborate with other AIG Groups
Continue work on survey benchmarking metadata quality

2018 Work & Goals

We set directions, deliverables, and goals for 2018 at the 2018 kick-off meeting in January 2018. More about the group's goals and discussion for 2018

The goals for 2018, set in our kick-off meeting, include:

Restructure and document the MWG website
Review and revise the Metadata Analysis Workshop
Work towards creating a metadata analysis tools repository
Begin discussion on creating general benchmarks for metadata quality. This area of work may include gathering tools and methods for measurement of metadata quality, defining benchmarks, and establishing a platform for topic discussion

2017 Work & Goals

We set directions, deliverables, and goals for 2017 at the 2017 kick-off meeting in January 2017. YMore about the group's goals and discussion for 2017

The goals for 2017, set in our kick-off meeting, included:

Update structure of the Github site created for last year’s Environmental Scan to support expansion and ongoing work including creating mechanism for people to submit updates & feedback.
Review and expand list of metadata assessment tools gathered as part of the Environmental Scan. Begin testing tools gathered as part of the Environmental Scan in order to eventually create a repository for metadata assessment tools
Create a Metadata Application Profile Clearinghouse that can be used as a community repository for application profiles, mappings and guidelines for metadata.
Create a general framework document on how to assess metadata that can be used for the galleries, libraries, archives & museums (GLAM) community.
Collaborate with other institutions on metadata assessment and analysis workshop work.

2016 Work & Goals

The 2016 goals, aims, and deliverables of the Metadata Assessment Working Group were decided in the 2016 kickoff meeting by participants. Goals included:

setting up and testing the Metadata Assessment Working Group infrastructure & logistics;
pulling together resources and ideas for definitions & metrics for metadata assessment, as well as beginning to uncover how one would perform this assessment;
generating use cases for metadata assessment functionalities;
uncovering tools that exist for metadata assessment, including how to use and understand the results

Back to the Assessment home page

@@ Line 10: / Line 10: @@
 == Get Involved ==
-The Metadata Working Group will primarily communicate through the [https://groups.google.com/forum/#!forum/dlf-aig-metadata-assessment-working-group DLF AIG Metadata Working Group Google Group].
+* The Metadata Working Group will primarily communicate through the [https://groups.google.com/forum/#!forum/dlf-aig-metadata-assessment-working-group DLF AIG Metadata Working Group Google Group].
+:* The majority of the work for 2016 was done in a Google Drive folder, which as been moved to a [https://drive.google.com/drive/folders/0AKjKPIV_XcukUk9PVA shared drive] (accessible to members of the Google Group).
+:* Joining the Google Group also gives you access to shared documents and meeting minutes, if you want to stay up-to-date but cannot attend all of the meetings
-You can also join the [https://docs.google.com/forms/d/e/1FAIpQLSerRD5r57NGXF3lqtIim4t6Y8UhpLj86O7QmsXnfj1D7sLYFQ/viewform Assessment Interest Group Slack workspace]. There is a channel for the Metadata Interest Group where you can post any questions you may have.
+* You can also join the [https://docs.google.com/forms/d/e/1FAIpQLSerRD5r57NGXF3lqtIim4t6Y8UhpLj86O7QmsXnfj1D7sLYFQ/viewform Assessment Interest Group Slack workspace]. There is a channel for the Metadata Interest Group where you can post any questions you may have.
-The majority of the work for 2016 was done in a Google Drive folder, which as been moved to a [https://drive.google.com/drive/folders/0AKjKPIV_XcukUk9PVA shared drive] (accessible to members of the Google Group).  Additionally, we have a significant portion of our work in our [https://github.com/DLFMetadataAssessment GitHub Organization].
+* Additionally, we have a significant portion of our work in our public-facing [https://dlfmetadataassessment.github.io/ GitHub website].
-This wiki page will be used to shared static information - meeting times, decided deliverables and goals for the year, etc.
+* This wiki page will be used to shared static information - meeting times, decided deliverables and goals for the year, etc.
 === Metadata Working Group Meetings ===
@@ Line 27: / Line 29: @@
 <br />
 <br />
-Tentative list of meeting dates for 2024:
+Meeting dates TBD for 2025
-* February 29, 2024
+<!--* February 29, 2024
 * March 14, 2024
 * April 11, 2024
 * May 9, 2024
 * June 6, 2024
-* June 20, 2024
-* {July 4, 2024 -- Holiday}
 * July 18, 2024
-* August 1, 2024
 * August 15, 2024
-* August 29, 2024
 * September 12, 2024
-* September 26, 2024
 * October 10, 2024
-* October 24, 2024
 * November 7, 2024
-* November 21, 2024
+* December 5, 2024-->
-* December 5, 2024
 <br />
-== Deliverables ==
-* [https://dlfmetadataassessment.github.io/environmental-scan Metadata assessment, evaluation and ‘quality’ environmental scan. First created in 2016, updated in 2019.]
+==Current Projects==
-* [https://dlfmetadataassessment.github.io/framework A framework for assessing descriptive metadata in digital collections.]
+=== Deliverables ===
 * [https://github.com/DLFMetadataAssessment/ GitHub infrastructure / organization]
-* [https://dlfmetadataassessment.github.io/MetadataSpecsClearinghouse Metadata Application Profile (MAP) Clearinghouse]
+* [https://dlfmetadataassessment.github.io/ Public-facing website] & projects:
-* [https://dlfmetadataassessment.github.io/tools Metadata assessment tools list]
+:* [https://dlfmetadataassessment.github.io/projects/environmental-scan/ Metadata assessment, evaluation and ‘quality’ environmental scan. First created in 2016, updated in 2019.]
-* [https://dlfmetadataassessment.github.io/benchmarks A survey of metadata assessment and metadata quality practices among various libraries, archives, and museums.] (Analysis ongoing)
+:* [https://dlfmetadataassessment.github.io/projects/framework/ A framework for assessing descriptive metadata in digital collections.]
-* [https://dlfmetadataassessment.github.io/metadata-workshop A framework for a workshop on metadata analysis]
+:* [https://dlfmetadataassessment.github.io/projects/metadata-application-profiles/ Metadata Application Profile (MAP) Clearinghouse]
+:* [https://dlfmetadataassessment.github.io/projects/tools/ Metadata assessment tools list]
+:* [https://dlfmetadataassessment.github.io/projects/benchmarks/ A survey of metadata assessment and metadata quality practices among various libraries, archives, and museums.] (Analysis ongoing)
+:* [https://dlfmetadataassessment.github.io/projects/metadata-workshop/ A framework for a workshop on metadata analysis]
+:* [https://dlfmetadataassessment.github.io/projects/skill-building-resources/ Skill-building resources related to metadata analysis technologies and techniques]
+* [https://www.zotero.org/groups/488224/metadata_assessment Zotero group] for metadata assessment publications
 <br />
-==2024 Work & Goals==
+===2025 Work & Goals===
-Meeting participants will discuss potential work and priorities during the kick-off meeting(s) starting February 29, 2024, based on the [https://docs.google.com/document/d/1OcgWkW-a-rOj6-4WTfaz_6N6lEQvgUWCpdD2BOp4X-0/edit?usp=sharing 2024 planning document].
+Meeting participants will discuss potential work and priorities during the kick-off meeting(s) TBD, based on the [https://docs.google.com/document/d/1Fuyw974QpbqPjmVIgLNTr8I5Ad90rwlPzw82cjtzAno/edit?usp=sharing 2025 planning document].
 <br />
 <br />
 Ongoing projects:
 * Managing website text and resources (including the MAP Clearinghouse, tools repository, and skill-building resources)
-* Blog posts about metadata quality & assessment topics
+* Benchmarking for metadata quality
-* Bemchmarking for metadata quality
 <br />
-== 2023 Work & Goals==
+==Previous Work==
+===2024 Work & Goals===
+* Overall maintenance on website and public-facing information
+:* Addition of an [http://dlfmetadataassessment.github.io/projects/acronyms/ Acronyms] page for digital-library-related acronyms and initialisms
+* Progress on metadata quality benchmarks including internal and external feedback on drafts
+<br />
+=== 2023 Work & Goals===
 Highlights:
 * Providing public-facing information
-:* Addition of [dlfmetadataassessment.github.io/resources/ Skillbuilding Resources] to the website
+:* Addition of [https://dlfmetadataassessment.github.io/projects/skill-building-resources/ Skillbuilding Resources] to the website
 :* Blog posts on [https://www.diglib.org/five-tips-for-rapid-metadata-assessment/ Five Tips for Rapid Metadata Assessment] and [https://www.diglib.org/issues-in-authority-control-case-studies-in-name-authority-records-and-platform-user-experience-design/ case studies related to authority control]
 * Further work toward drafting quality benchmarks
@@ Line 78: / Line 83: @@
 <br />
-== 2022 Work & Goals ==
+=== 2022 Work & Goals ===
 See the 2022 [https://docs.google.com/document/d/1aER1mWpjJvSJKiU6g2UyELDzR42d4rLCXfhEtc_Kzoc/edit?usp=sharing work plan document] for more information.  (Note that supplemental documents linked from the work plan limit access to members of the group.)
 <br />
@@ Line 92: / Line 97: @@
 <br />
-== 2021 Work & Goals ==
+=== 2021 Work & Goals ===
 We had our kick-off meeting on January 21, 2021.  The group set some initial goals for immediate work, documented in our [https://docs.google.com/document/d/1SJ9NgUSQTuEP8d3gIbnFQl38lSEKZLePnOjBUoXeci4/edit?usp=sharing 2021 work plan]:
 <br />
@@ Line 110: / Line 115: @@
 <br />
-== 2020 Work & Goals ==
+=== 2020 Work & Goals ===
 We set directions, deliverables, and goals for 2020 at the kick-off meeting in January 2020.
 <br />
@@ Line 124: / Line 129: @@
 <br />
-== 2019 Work & Goals ==
+=== 2019 Work & Goals ===
 We set directions, deliverables, and goals for 2019 at the 2019 kick-off meeting in January 2019.
 <br />
@@ Line 135: / Line 140: @@
 <br />
-== 2018 Work & Goals ==
+=== 2018 Work & Goals ===
 We set directions, deliverables, and goals for 2018 at the 2018 kick-off meeting in January 2018. More about the group's [https://docs.google.com/document/d/15lJZzpSNbo95ca6MNbDb_7s4aRzqk7j20i6Bl1zAMuQ/edit?usp=sharing goals and discussion for 2018]
 <br />
@@ Line 146: / Line 151: @@
 <br />
-== 2017 Work & Goals ==
+=== 2017 Work & Goals ===
 We set directions, deliverables, and goals for 2017 at the 2017 kick-off meeting in January 2017. YMore about the group's [https://docs.google.com/document/d/1Ssk-dOhK0B699qatDUa7Gnc3QuP1IRXjr5DMaFoIJzE/edit?usp=sharing goals and discussion for 2017]
 <br />
@@ Line 158: / Line 163: @@
 <br />
-== 2016 Work & Goals ==
+=== 2016 Work & Goals ===
 The 2016 goals, aims, and deliverables of the Metadata Assessment Working Group were decided in the 2016 kickoff meeting by participants. Goals included: