Assessment:Cultural Assessment: Difference between revisions

From DLF Wiki
Jump to navigation Jump to search
(36 intermediate revisions by 5 users not shown)
Line 1: Line 1:
= DLF Cultural Assessment Working Group =
= DLF Cultural Assessment Working Group =
This sub-group of the DLF [https://wiki.diglib.org/Assessment Assessment Interest Group] (DLF AIG) was formed in February 2016 to discuss ways by which we may assess our digital collections and their cultural impact.  
This sub-group of the DLF [https://wiki.diglib.org/Assessment Assessment Interest Group] (DLF AIG) was formed in February 2016 to discuss ways by which we may assess our digital collections and their cultural impact.  
Members of the DLF AIG for Cultural Assessment aim to first identify institutional data and practices that may be relevant to building a robust understanding of “cultural assessment.” Then, the group will investigate and attempt to surface underlying assumptions within our data and practices to help the community better understand the social structures that both influence our work and result from it. Ideally, the group will develop helpful and nuanced rubrics for institutional measurement and analysis of cultural biases and assumptions. The DLF AIG Cultural Assessment group intends to raise awareness of cultural bias and institutional “blind spots,” as well as recommend a set of data points, to create more inclusive cultures within DLF member organizations.
Members of the DLF AIG for Cultural Assessment aim to first identify institutional data and practices that may be relevant to building a robust understanding of “cultural assessment.” Then, the group will investigate and attempt to surface underlying assumptions within our data and practices to help the community better understand the social structures that both influence our work and result from it. Ideally, the group will develop helpful and nuanced rubrics for institutional measurement and analysis of cultural biases and assumptions. The DLF AIG Cultural Assessment group intends to raise awareness of cultural bias and institutional “blind spots,” as well as recommend a set of data points, to create more inclusive cultures within DLF member organizations.
Line 13: Line 14:


with the understanding that biases and assumptions have concrete impact on digital library collections and services.
with the understanding that biases and assumptions have concrete impact on digital library collections and services.
== Mission ==
To raise awareness of cultural bias and strive for diversity, equity and inclusivity [http://dspace.mit.edu/handle/1721.1/108771 ] in digital collection practice to create more inclusive cultures and to mitigate or expose collection bias. Where such practice is lacking, create new frameworks that uphold CAWG values.
== CAWG Values ==
Pursuing ethics of care in our various institutions by identifying and assessing cultural biases and assumptions underlying digital collection data and practices. We will...
* Recognize implicit and explicit bias in current archiving and collection practice within Libraries, Archives and Museums (LAM) cultural heritage institutions.
* Seek to uphold practices that reflect the goals of diversity, equity and inclusion
* Encourage higher levels of transparency in digital collection creation processes and facilitate critical user engagement.
* Foster sensitivity in the development of access strategies that strive to involve community stakeholders
* Respect community stakeholders' dignity and their right to privacy while expanding access when appropriate.
* Identify methods for sensitive and respectful representation of collections that strive to involve community stakeholders and respect their dignity and their right to privacy.
== Annotated Bibliography ==
The Cultural Assessment Group published their first draft of an annotated bibliography reflects research that is helpful for framing the notion of cultural assessment in the cultural heritage sector with a particular focus on digital libraries. Resources include detailed legislation for cultural heritage stewardship, collaborative cross-cultural case studies, and articles focused on the current methods of digital collection creation. We drew much inspiration from the [http://www.siatoolkit.com/#axzz4YCBEWGzF Social Inclusion Audit] and the [https://www.kdl.kcl.ac.uk/fileadmin/documents/pubs/BalancedValueImpactModel_SimonTanner_October2012.pdf Balanced Value Impact Model] among others.<br />
The group is also soliciting feedback and additional resources in the '''running bibliography''', in an attempt to make the resource more broadly applicable (i.e. not solely focused on North America). Any one can add to and comment on the bibliography. We only ask you do NOT DELETE any items.
[https://docs.google.com/document/d/18EBvHoWLbNx5-NA5_Llm9BQqx3RxOEsALrw5-JD8o4o/edit Ongoing Public Bibliography]
The [https://github.com/cultural-assessment DLF Cultural Assessment Interest Group] welcomes feedback and comments on GitHub as well.
'''2017 Published bibliography''' can be found [https://mfr.osf.io/render?url=https://osf.io/94pgj/?action=download%26mode=render here ]<br />
'''Special Thanks to the following Authors and Contributors:'''<br />
Diana Marsh<br />
Hannah Scates Kettler<br />
Kate Joranson<br />
Liz Lorang<br />
Lorrie McAllister<br />
Rachel Trent<br />
Ricky Punzalan<br />
Sara Rubinow<br />
Sharon Farnel<br />
Susan Barrett<br />


= Current Projects: =
= Current Projects: =
The Cultural Assessment group is moving away from the 5 subgroups in order to pursue an environmental scan of the use of metrics in Cultural Assessment, and how the group might apply metrics to practices that collectively inhabit digital collection creation (see previous projects for an idea on practices).
The Cultural Assessment group is moving away from the 5 subgroups in order to pursue an environmental scan of the use of metrics in Cultural Assessment.  The group hopes to develop a set of metrics specifically for use in the cultural heritage sector to evaluate their digital collection cultural affinities and gaps, and how one might apply metrics to practices of digital collection creation (see previous projects for an idea on said practices).
 
Over the next year, the group will:
* Add Activities as benchmarks to the Selection Workflow Framework (to be the bases for Inclusive Curation and the overall Digital Collections Rubric for Reflection -previously called Cultural Assessment Toolkit)
* Continue to support the User Experience AIG in the development of a Web Resource for ethical Personal Creation
* Develop the collaboration with Metadata AIG to articulate values of Inclusive Metadata practices
* Conduct an environmental scan of 'diversity' related efforts and digital collection creation between 2016 and 2018
 
== 2018 Task Force Charges ==
=== Environmental Scan Task Force ===
Perform an environmental scan of current projects and work being done libraries, museums, and archives as it relates to cultural diversity, equity and inclusion since 2016. This will be the first step to determining goals for the CAWG Oct. 2018.
 
=== Selection Framework Task Force ===


Details on process and timeline, forthcoming.
Develop a workflow related to the selection process that is articulated in broad strokes so that it may be used across many types of institutions, e.g. academic libraries, museums, historical societies, etc. Outline areas of potential cultural friction in the selection process and potential measures of successful navigation of said friction. These benchmarks will be expressed as a set of activities that accompany/augment the questions developed from previous development of the Selection Workflow Framework.
 
=== Inclusive Metadata Task Force ===
Collaborate with the DLF AIG User Experience (UX) Working Group to help develop their User Persona Best Practices project by collaborating on UX’s persona gathering and evaluation task force, personas best practices guidelines, and web resources task force through a lens of cultural awareness and sensitivity that informs digital library user personas are made. This work will result in a culturally responsive set of best practices that will be featured as part of the Cultural Assessment Toolkit and the User Experience Working Group’s corpus of resources and tools.
 
=== Personas Task Force ===
Collaborate with the AIG Metadata Group to conduct an environmental scan of current metadata practices related to the concerns of cultural and social justice. The group will identify avenues for intervention or augmentation possible in current metadata practice. Ultimately, the work will result in set of guidelines and recommendations for the creation and maintenance of equitable, inclusive, culturally respectful metadata that uphold the values articulated by the Metadata Task Force community.
Relevant link: http://dlfmetadataassessment.github.io/entries/about
 
''' Details on their charges can be found in the [https://docs.google.com/document/d/1roR1IJJWCsmn-VJfaGU8yOdfZlPRZoXaIIzw1TYFKCU/edit?usp=sharing 2018 Project Scope Document].'''
   
   
*There is a possible collaboration here with several of the DLF Assessment Working Groups.
There are possible collaborations here with several of the DLF Assessment Working Groups including Metadata, User Experience, and Analytics. The group is welcome and encourages collaboration with people and groups who may be impacted by this work. Feel free to reach out if you have ideas. As the year progresses, the Cultural Assessment group will reach out to groups who they see as having an interest and invite them to participate.
 
Such groups include (running list):
* Internet Archive / "IA/DLF Inclusive Curation Project"
* DLF AIG User Experience (UX) Interest Group
* IMLS Forum Grant recipients - Design for Diversity: An IMLS National Forum at Northeastern University [http://dsg.neu.edu/research/design-for-diversity/ Grant website]
* Association of Tribal Archives, Libraries, and Museums [http://www.atalm.org/ association website]
* Others


= Past Projects: =
= Past Projects: =
== Annotated Bibliography ==
== 2017 ==
The Cultural Assessment group is moving away from the 5 subgroups in order to pursue an environmental scan of the use of metrics in Cultural Assessment.  The group hopes to develop a set of metrics specifically for use in the cultural heritage sector to evaluate their digital collection cultural affinities and gaps, and how one might apply metrics to practices of digital collection creation (see previous projects for an idea on said practices).
 
Over the next year, the group will:
* Create an overarching workflow for cultural heritage digital collection creation
* Contextualize digital collection creation workflows within cultural heritage institution organizational structures
* Develop / articulate personas and narratives that would accompany an eventual Cultural Assessment Toolkit
* Discuss and articulate form and function of the toolkit
There are possible collaborations here with several of the DLF Assessment Working Groups including Metadata, User Experience, and Analytics. The group is welcome and encourages collaboration with people and groups who may be impacted by this work. Feel free to reach out if you have ideas. As the year progresses, the Cultural Assessment group will reach out to groups who they see as having an interest and invite them to participate.
 
Such groups include (running list):
* Internet Archive / "IA/DLF Inclusive Curation Project"
* DLF AIG User Experience (UX) Interest Group
* IMLS Forum Grant recipients - Design for Diversity: An IMLS National Forum at Northeastern University [http://dsg.neu.edu/research/design-for-diversity/ Grant website]
* Association of Tribal Archives, Libraries, and Museums [http://www.atalm.org/ association website]
* Others
 
'''Selection Workflow for Inclusive Curation'''
 
In 2017, the Cultural Assessment group drafted a selection workflow framework that is articulated in broad strokes to be used across many types of institutions, e.g., academic libraries, museums, historical societies. The workflow outlines areas of potential cultural friction in the selection process and creates a supporting bibliography (using the group's 2016 annotated bibliography for reference).
 
This draft framework document has two purposes:
# To inform the Internet Archive’s book selection process for its Open Libraries Initiative (a MacArthur Foundation 100%Change semi-finalist project in which DLF has partnered).
# To serve as a resource on best practices for Digital Library Federation member institutions and the broader digital library community.
 
The framework aims to define parts of a digital collection selection workflow for public cultural heritage and academic institutions, in alignment with the mission of the DLF Cultural Assessment working group.
 
Part of the framework included an open survey requesting digital selection workflows (graphic and text description) from information institutions. The number of responding institutions was small (13 total), but substantive results were obtained. The group plans to expand the breadth and scope of the survey in 2018.
 
'''Open Survey Results'''
 
* Selection and digitization decisions in responding institutions are made by a mix of donors or internal library staff, not by designated selection committees.
* The majority of responding institutions are not relying on codified, published policies that govern selection of cultural materials.
* A majority of responding institutions prioritize decisions based on staff or space capacity, not on collecting priority. Most consider the institution’s collection strengths and importance of the materials prior to accepting new materials.
* A majority of respondents indicate that selection and digitization decisions are made by individuals, not by appointed committees.
* Selection for digitization is prioritized by appraised value, fragility or rarity of materials, and materials that are already part of the institution’s collections.
* Most responding institutions are not actively seeking new materials.
* Collection agendas are dictated by collection development policies that reflect physical collections and do not stand on their own as born-digital or digital-only collection policies.
 
See the [Wiki files][https://osf.io/r78ha/wiki/home/] for detailed documentation.
 
 
== 2016 ==
The Cultural Assessment Group, in its first year, conducted an environmental scan about the cultural surrounding the creation of digital collection in the cultural heritage sector. The result of the first year of group work is a fully annotated bibliography concentrated on the formation of digital collections, the workflows required to create them, and the cultural responsibilities and consideration surrounding their selection, description, discovery and representation of communities. This is not an exhaustive bibliography, but represents the accomplishment of the first several months of work.
The '''fully annotated bibliography''' can be found [https://mfr.osf.io/render?url=https://osf.io/94pgj/?action=download%26mode=render here], with full citation should you wish to use it.
Additionally, feel free to add items of interest to '''the running bibliography''' [https://docs.google.com/document/d/18EBvHoWLbNx5-NA5_Llm9BQqx3RxOEsALrw5-JD8o4o/edit?usp=sharing here]. Demarcate the ones you have added so they are not missed during annotation. Thank you in advance!
 
=== Annotated Bibliography ===
Define Cultural Assessment in collaboration between librarians, archivists and anthropologists in a way that applies to digital collection development and dissemination.
Define Cultural Assessment in collaboration between librarians, archivists and anthropologists in a way that applies to digital collection development and dissemination.
The outcome will be an annotated bibliography that will help set the stage to further discussions about cultural and social responses of library digital collections and potential biases in information structuring and management.
The outcome will be an annotated bibliography that will help set the stage to further discussions about cultural and social responses of library digital collections and potential biases in information structuring and management.
Line 29: Line 144:
'''The Annotated Bibliography Group''' met biweekly on Mondays 12:00pm Central Time beginning Aug until Nov. 2016 (see [https://drive.google.com/drive/u/0/folders/0BxLpGleh8jx7dHlxSEU5UlZRbGc working documents])
'''The Annotated Bibliography Group''' met biweekly on Mondays 12:00pm Central Time beginning Aug until Nov. 2016 (see [https://drive.google.com/drive/u/0/folders/0BxLpGleh8jx7dHlxSEU5UlZRbGc working documents])
   
   
== Metadata & Description Practices ==
=== Metadata & Description Practices ===
Outline potential measures and standards for metadata and description activities that allow our digital collections to be culturally aware. Metadata, in this context does not only refer to Subject Headings (like those maintained by the Library of Congress) but may also include folksonomies and ontologies. The intent  is to uncover ways metadata is currently being produced, identify ways in which one might determine the cultural awareness of metadata and descriptions (if possible), and by pointing to work that intends to expand the boundary of metadata, like the Mukurtu Project (http://mukurtu.org/learn/), develop a set of recommendations on how to generate metadata that is culturally responsible.
Outline potential measures and standards for metadata and description activities that allow our digital collections to be culturally aware. Metadata, in this context does not only refer to Subject Headings (like those maintained by the Library of Congress) but may also include folksonomies and ontologies. The intent  is to uncover ways metadata is currently being produced, identify ways in which one might determine the cultural awareness of metadata and descriptions (if possible), and by pointing to work that intends to expand the boundary of metadata, like the Mukurtu Project (http://mukurtu.org/learn/), develop a set of recommendations on how to generate metadata that is culturally responsible.


'''The Metadata Group''' met bi-weekly on Monday's at 11:00am CDT beginning on Aug until Nov. 2016 (see [https://drive.google.com/drive/u/0/folders/0BxLpGleh8jx7T0NxWTladnU0V28 working documents])
'''The Metadata Group''' met bi-weekly on Monday's at 11:00am CDT beginning on Aug until Nov. 2016 (see [https://drive.google.com/drive/u/0/folders/0BxLpGleh8jx7T0NxWTladnU0V28 working documents])
   
   
== Selection & Digitization ==
=== Selection & Digitization ===
Investigate how institutions of higher education select materials for digitization and how they are prioritized. We will research metrics and decision-making workflows as well as the underlying assumptions regarding selection and decision-making throughout the beginning stages of the digitization process.
Investigate how institutions of higher education select materials for digitization and how they are prioritized. We will research metrics and decision-making workflows as well as the underlying assumptions regarding selection and decision-making throughout the beginning stages of the digitization process.


'''The Selection & Digitization Group''' met biweekly on Mondays at 12:00pm Central Time beginning Aug. until Nov. 2016 (see [https://drive.google.com/drive/u/0/folders/0BxLpGleh8jx7Z0JfcFdOMzdDVFU working documents])
'''The Selection & Digitization Group''' met biweekly on Mondays at 12:00pm Central Time beginning Aug. until Nov. 2016 (see [https://drive.google.com/drive/u/0/folders/0BxLpGleh8jx7Z0JfcFdOMzdDVFU working documents])
   
   
== Levels of Digitization and Preservation ==
=== Levels of Digitization and Preservation ===
Investigate how libraries (which may include archives) determine levels of digitization and preservation for digital collections. This may include a review of how groups are formed to make these decisions, how decision-making groups make determinations about levels of digitization and preservation, and how these decisions are communicated. We will think about how these decisions may be evaluated for cultural factors and influences and/or what impact these decisions may have on various communities.   
Investigate how libraries (which may include archives) determine levels of digitization and preservation for digital collections. This may include a review of how groups are formed to make these decisions, how decision-making groups make determinations about levels of digitization and preservation, and how these decisions are communicated. We will think about how these decisions may be evaluated for cultural factors and influences and/or what impact these decisions may have on various communities.   


'''The Digitization & Preservation Group''' met bi-weekly on Mondays at 11:00am Central Time /beginning Aug. until Nov. 2016 (see [https://drive.google.com/drive/u/0/folders/0B8B77_XUrt8ERWJua2JvS1VzWHc working documents)]
'''The Digitization & Preservation Group''' met bi-weekly on Mondays at 11:00am Central Time /beginning Aug. until Nov. 2016 (see [https://drive.google.com/drive/u/0/folders/0B8B77_XUrt8ERWJua2JvS1VzWHc working documents)]
   
   
== Publicizing Collection and Discoverability ==
=== Publicizing Collection and Discoverability ===
Investigate how libraries (which may include special collections and/or archives) make their collections discoverable and how they publicize collections. This may include how to identify constituents, stakeholders and customers; to craft custom communications; to apply descriptive metadata for searching and sharing in an effort to conquer the digital divide. Publicizing and discoverability should also include considerations for selecting discovery platforms and tools, defining methods to present collections, and user interactions with collections, and “usability”. Defining the standards for community demographics, marginalized and underrepresented groups, and representation of diverse communities within the collections is needed for qualitative and quantitative assessment.
Investigate how libraries (which may include special collections and/or archives) make their collections discoverable and how they publicize collections. This may include how to identify constituents, stakeholders and customers; to craft custom communications; to apply descriptive metadata for searching and sharing in an effort to conquer the digital divide. Publicizing and discoverability should also include considerations for selecting discovery platforms and tools, defining methods to present collections, and user interactions with collections, and “usability”. Defining the standards for community demographics, marginalized and underrepresented groups, and representation of diverse communities within the collections is needed for qualitative and quantitative assessment.


Line 50: Line 165:


= Get Involved =
= Get Involved =
In 2018, there are four Task Forces within the Cultural Assessment Working Group (CAWG) [https://docs.google.com/document/d/1roR1IJJWCsmn-VJfaGU8yOdfZlPRZoXaIIzw1TYFKCU/edit?usp=sharing]. Meetings for all these groups is open to the public, and we welcome your voice in these conversations.
The CAWG also has a publically accessible calendar. Feel free to share relevant events and invites.
[https://www.google.com/calendar/render?cid=dd103td6p8rihjbrqvvmtaoed8@group.calendar.google.com DLF AIG - CAWG Calendar]


== Meeting Schedule ==
== Meeting Schedule ==
The Cultural Assessment Group will meet every two weeks beginning Wednesday January 24, 2017 at 11am CT (UTC -6).


All meeting notes will be posted using Google Docs and will be demarcated by date (https://drive.google.com/open?id=0BxLpGleh8jx7NG5mYVVXU1luMnM).
<big>The Cultural Assessment Group</big> will meet the last Tuesday of every month beginning March 27th, 2018 at 12:00pm CST (-6 UTC) via Skype for Business.<br />
'''[https://meet.uiowa.edu/hannah-s-kettler/J2A3YFD5 Join Skype Meeting]'''
Trouble Joining? [https://meet.uiowa.edu/hannah-s-kettler/J2A3YFD5 Try Skype Web App]
'''Join by phone'''
+1 319 467 1100 (Iowa City)    English (United States)
[https://dialin.uiowa.edu/ Find a local number]
Conference ID: 48083
[https://its.uiowa.edu/support/article/2783 Help]
For details on how to test your connection go to https://its.uiowa.edu/support/article/104972
 
<big>Environmental Scan Task Force</big> meets every two weeks beginning March 26, 2018 at 1:30pm CST (-6 UTC) via Skype for Business.<br/>
'''[https://meet.uiowa.edu/hannah-s-kettler/J2A3YFD5 Join Skype Meeting] ''' 
Trouble Joining? [https://meet.uiowa.edu/hannah-s-kettler/J2A3YFD5?sl=1 Try Skype Web App]
'''Join by phone'''
+1 319 467 1100 (Iowa City)      English (United States)
+[https://dialin.uiowa.edu/ Find a local number]
Conference ID: 48083
[https://its.uiowa.edu/support/article/2783 Help]     
For details on how to test your connection go to https://its.uiowa.edu/support/article/104972
 
<big>Personas Task Force</big> meets every two weeks beginning March 28, 2018 at 10:00am CST (-6UTC). Method of communication TBD.
'''Call Details:'''
Enter your Audio number
                Audio Number: 8005018979
Secondary Audio Number:  +1 3032489662
Enter your access code, then #
                2564960
Web Site: https://conf.cfer.com
 
<big>Selection Activities Task Force</big> will meet every two weeks beginning April 3, 2018 at 1:00pm CST (-6UTC). Method of communication TBD.
'''Call Details:'''
Enter your Audio number
                Audio Number: 8005018979
Secondary Audio Number:  +1 3032489662
Enter your access code, then #
                2564960
Web Site: https://conf.cfer.com
 
Inclusive Metadata Task Force will meet every two weeks beginning April 4, 2018 at 2:00pm CST (-6 UTC). Method of communication TBD.
Conference Line: 1-877-820-7831 (toll free)
Passcode: 898690#
 
'''All meeting notes will be posted using Google Docs and will be demarcated by date (https://drive.google.com/open?id=13FYcbCZvdKuGr4fQybKceZC2y37moSpm).'''


== Social Media ==
== Social Media ==


Join our [https://groups.google.com/forum/#!forum/dlf-cultural-assessment-working-group Google group] or contact group chair Hannah dash s dash Kettler at uiowa dot edu.
Join our [https://groups.google.com/forum/#!forum/dlf-cultural-assessment-working-group/join Google group] or contact group chair Hannah dash s dash Kettler at uiowa dot edu.





Revision as of 16:21, 2 October 2018

DLF Cultural Assessment Working Group

This sub-group of the DLF Assessment Interest Group (DLF AIG) was formed in February 2016 to discuss ways by which we may assess our digital collections and their cultural impact. Members of the DLF AIG for Cultural Assessment aim to first identify institutional data and practices that may be relevant to building a robust understanding of “cultural assessment.” Then, the group will investigate and attempt to surface underlying assumptions within our data and practices to help the community better understand the social structures that both influence our work and result from it. Ideally, the group will develop helpful and nuanced rubrics for institutional measurement and analysis of cultural biases and assumptions. The DLF AIG Cultural Assessment group intends to raise awareness of cultural bias and institutional “blind spots,” as well as recommend a set of data points, to create more inclusive cultures within DLF member organizations.

We will explore whether and how cultural biases/assumptions are embedded in:

  • materials we have available in physical collections - special collections, institutional archives;
  • in librarians’ and archivists’ selections of what to digitize;
  • in the requests their patrons and communities make for content;
  • in choices about levels of digitization and preservation;
  • in metadata-creation/descriptive activities;
  • and in decisions about how/when/whether we publicize collections and make them discoverable.

with the understanding that biases and assumptions have concrete impact on digital library collections and services.

Mission

To raise awareness of cultural bias and strive for diversity, equity and inclusivity [1] in digital collection practice to create more inclusive cultures and to mitigate or expose collection bias. Where such practice is lacking, create new frameworks that uphold CAWG values.

CAWG Values

Pursuing ethics of care in our various institutions by identifying and assessing cultural biases and assumptions underlying digital collection data and practices. We will...

  • Recognize implicit and explicit bias in current archiving and collection practice within Libraries, Archives and Museums (LAM) cultural heritage institutions.
  • Seek to uphold practices that reflect the goals of diversity, equity and inclusion
  • Encourage higher levels of transparency in digital collection creation processes and facilitate critical user engagement.
  • Foster sensitivity in the development of access strategies that strive to involve community stakeholders
  • Respect community stakeholders' dignity and their right to privacy while expanding access when appropriate.
  • Identify methods for sensitive and respectful representation of collections that strive to involve community stakeholders and respect their dignity and their right to privacy.


Annotated Bibliography

The Cultural Assessment Group published their first draft of an annotated bibliography reflects research that is helpful for framing the notion of cultural assessment in the cultural heritage sector with a particular focus on digital libraries. Resources include detailed legislation for cultural heritage stewardship, collaborative cross-cultural case studies, and articles focused on the current methods of digital collection creation. We drew much inspiration from the Social Inclusion Audit and the Balanced Value Impact Model among others.

The group is also soliciting feedback and additional resources in the running bibliography, in an attempt to make the resource more broadly applicable (i.e. not solely focused on North America). Any one can add to and comment on the bibliography. We only ask you do NOT DELETE any items.

Ongoing Public Bibliography

The DLF Cultural Assessment Interest Group welcomes feedback and comments on GitHub as well.


2017 Published bibliography can be found here

Special Thanks to the following Authors and Contributors:
Diana Marsh
Hannah Scates Kettler
Kate Joranson
Liz Lorang
Lorrie McAllister
Rachel Trent
Ricky Punzalan
Sara Rubinow
Sharon Farnel
Susan Barrett

Current Projects:

The Cultural Assessment group is moving away from the 5 subgroups in order to pursue an environmental scan of the use of metrics in Cultural Assessment. The group hopes to develop a set of metrics specifically for use in the cultural heritage sector to evaluate their digital collection cultural affinities and gaps, and how one might apply metrics to practices of digital collection creation (see previous projects for an idea on said practices).

Over the next year, the group will:

  • Add Activities as benchmarks to the Selection Workflow Framework (to be the bases for Inclusive Curation and the overall Digital Collections Rubric for Reflection -previously called Cultural Assessment Toolkit)
  • Continue to support the User Experience AIG in the development of a Web Resource for ethical Personal Creation
  • Develop the collaboration with Metadata AIG to articulate values of Inclusive Metadata practices
  • Conduct an environmental scan of 'diversity' related efforts and digital collection creation between 2016 and 2018

2018 Task Force Charges

Environmental Scan Task Force

Perform an environmental scan of current projects and work being done libraries, museums, and archives as it relates to cultural diversity, equity and inclusion since 2016. This will be the first step to determining goals for the CAWG Oct. 2018.

Selection Framework Task Force

Develop a workflow related to the selection process that is articulated in broad strokes so that it may be used across many types of institutions, e.g. academic libraries, museums, historical societies, etc. Outline areas of potential cultural friction in the selection process and potential measures of successful navigation of said friction. These benchmarks will be expressed as a set of activities that accompany/augment the questions developed from previous development of the Selection Workflow Framework.

Inclusive Metadata Task Force

Collaborate with the DLF AIG User Experience (UX) Working Group to help develop their User Persona Best Practices project by collaborating on UX’s persona gathering and evaluation task force, personas best practices guidelines, and web resources task force through a lens of cultural awareness and sensitivity that informs digital library user personas are made. This work will result in a culturally responsive set of best practices that will be featured as part of the Cultural Assessment Toolkit and the User Experience Working Group’s corpus of resources and tools.

Personas Task Force

Collaborate with the AIG Metadata Group to conduct an environmental scan of current metadata practices related to the concerns of cultural and social justice. The group will identify avenues for intervention or augmentation possible in current metadata practice. Ultimately, the work will result in set of guidelines and recommendations for the creation and maintenance of equitable, inclusive, culturally respectful metadata that uphold the values articulated by the Metadata Task Force community. Relevant link: http://dlfmetadataassessment.github.io/entries/about

Details on their charges can be found in the 2018 Project Scope Document.

There are possible collaborations here with several of the DLF Assessment Working Groups including Metadata, User Experience, and Analytics. The group is welcome and encourages collaboration with people and groups who may be impacted by this work. Feel free to reach out if you have ideas. As the year progresses, the Cultural Assessment group will reach out to groups who they see as having an interest and invite them to participate.

Such groups include (running list):

  • Internet Archive / "IA/DLF Inclusive Curation Project"
  • DLF AIG User Experience (UX) Interest Group
  • IMLS Forum Grant recipients - Design for Diversity: An IMLS National Forum at Northeastern University Grant website
  • Association of Tribal Archives, Libraries, and Museums association website
  • Others

Past Projects:

2017

The Cultural Assessment group is moving away from the 5 subgroups in order to pursue an environmental scan of the use of metrics in Cultural Assessment. The group hopes to develop a set of metrics specifically for use in the cultural heritage sector to evaluate their digital collection cultural affinities and gaps, and how one might apply metrics to practices of digital collection creation (see previous projects for an idea on said practices).

Over the next year, the group will:

  • Create an overarching workflow for cultural heritage digital collection creation
  • Contextualize digital collection creation workflows within cultural heritage institution organizational structures
  • Develop / articulate personas and narratives that would accompany an eventual Cultural Assessment Toolkit
  • Discuss and articulate form and function of the toolkit

There are possible collaborations here with several of the DLF Assessment Working Groups including Metadata, User Experience, and Analytics. The group is welcome and encourages collaboration with people and groups who may be impacted by this work. Feel free to reach out if you have ideas. As the year progresses, the Cultural Assessment group will reach out to groups who they see as having an interest and invite them to participate.

Such groups include (running list):

  • Internet Archive / "IA/DLF Inclusive Curation Project"
  • DLF AIG User Experience (UX) Interest Group
  • IMLS Forum Grant recipients - Design for Diversity: An IMLS National Forum at Northeastern University Grant website
  • Association of Tribal Archives, Libraries, and Museums association website
  • Others

Selection Workflow for Inclusive Curation

In 2017, the Cultural Assessment group drafted a selection workflow framework that is articulated in broad strokes to be used across many types of institutions, e.g., academic libraries, museums, historical societies. The workflow outlines areas of potential cultural friction in the selection process and creates a supporting bibliography (using the group's 2016 annotated bibliography for reference).

This draft framework document has two purposes:

  1. To inform the Internet Archive’s book selection process for its Open Libraries Initiative (a MacArthur Foundation 100%Change semi-finalist project in which DLF has partnered).
  2. To serve as a resource on best practices for Digital Library Federation member institutions and the broader digital library community.

The framework aims to define parts of a digital collection selection workflow for public cultural heritage and academic institutions, in alignment with the mission of the DLF Cultural Assessment working group.

Part of the framework included an open survey requesting digital selection workflows (graphic and text description) from information institutions. The number of responding institutions was small (13 total), but substantive results were obtained. The group plans to expand the breadth and scope of the survey in 2018.

Open Survey Results

  • Selection and digitization decisions in responding institutions are made by a mix of donors or internal library staff, not by designated selection committees.
  • The majority of responding institutions are not relying on codified, published policies that govern selection of cultural materials.
  • A majority of responding institutions prioritize decisions based on staff or space capacity, not on collecting priority. Most consider the institution’s collection strengths and importance of the materials prior to accepting new materials.
  • A majority of respondents indicate that selection and digitization decisions are made by individuals, not by appointed committees.
  • Selection for digitization is prioritized by appraised value, fragility or rarity of materials, and materials that are already part of the institution’s collections.
  • Most responding institutions are not actively seeking new materials.
  • Collection agendas are dictated by collection development policies that reflect physical collections and do not stand on their own as born-digital or digital-only collection policies.

See the [Wiki files][2] for detailed documentation.


2016

The Cultural Assessment Group, in its first year, conducted an environmental scan about the cultural surrounding the creation of digital collection in the cultural heritage sector. The result of the first year of group work is a fully annotated bibliography concentrated on the formation of digital collections, the workflows required to create them, and the cultural responsibilities and consideration surrounding their selection, description, discovery and representation of communities. This is not an exhaustive bibliography, but represents the accomplishment of the first several months of work. The fully annotated bibliography can be found here, with full citation should you wish to use it. Additionally, feel free to add items of interest to the running bibliography here. Demarcate the ones you have added so they are not missed during annotation. Thank you in advance!

Annotated Bibliography

Define Cultural Assessment in collaboration between librarians, archivists and anthropologists in a way that applies to digital collection development and dissemination. The outcome will be an annotated bibliography that will help set the stage to further discussions about cultural and social responses of library digital collections and potential biases in information structuring and management. The project alos entails compiling the bibliographies and initial findings for the other sub-topics and coordinating the eventual creation of the Cultural Assessment Interest Group white-paper.

The Annotated Bibliography Group met biweekly on Mondays 12:00pm Central Time beginning Aug until Nov. 2016 (see working documents)

Metadata & Description Practices

Outline potential measures and standards for metadata and description activities that allow our digital collections to be culturally aware. Metadata, in this context does not only refer to Subject Headings (like those maintained by the Library of Congress) but may also include folksonomies and ontologies. The intent is to uncover ways metadata is currently being produced, identify ways in which one might determine the cultural awareness of metadata and descriptions (if possible), and by pointing to work that intends to expand the boundary of metadata, like the Mukurtu Project (http://mukurtu.org/learn/), develop a set of recommendations on how to generate metadata that is culturally responsible.

The Metadata Group met bi-weekly on Monday's at 11:00am CDT beginning on Aug until Nov. 2016 (see working documents)

Selection & Digitization

Investigate how institutions of higher education select materials for digitization and how they are prioritized. We will research metrics and decision-making workflows as well as the underlying assumptions regarding selection and decision-making throughout the beginning stages of the digitization process.

The Selection & Digitization Group met biweekly on Mondays at 12:00pm Central Time beginning Aug. until Nov. 2016 (see working documents)

Levels of Digitization and Preservation

Investigate how libraries (which may include archives) determine levels of digitization and preservation for digital collections. This may include a review of how groups are formed to make these decisions, how decision-making groups make determinations about levels of digitization and preservation, and how these decisions are communicated. We will think about how these decisions may be evaluated for cultural factors and influences and/or what impact these decisions may have on various communities.

The Digitization & Preservation Group met bi-weekly on Mondays at 11:00am Central Time /beginning Aug. until Nov. 2016 (see working documents)

Publicizing Collection and Discoverability

Investigate how libraries (which may include special collections and/or archives) make their collections discoverable and how they publicize collections. This may include how to identify constituents, stakeholders and customers; to craft custom communications; to apply descriptive metadata for searching and sharing in an effort to conquer the digital divide. Publicizing and discoverability should also include considerations for selecting discovery platforms and tools, defining methods to present collections, and user interactions with collections, and “usability”. Defining the standards for community demographics, marginalized and underrepresented groups, and representation of diverse communities within the collections is needed for qualitative and quantitative assessment.

The Publicizing and Discoverability Group meets bi-weekly on Tuesdays at 11:00am Central Time beginning Aug. 16 (see working documents)

Get Involved

In 2018, there are four Task Forces within the Cultural Assessment Working Group (CAWG) [3]. Meetings for all these groups is open to the public, and we welcome your voice in these conversations.

The CAWG also has a publically accessible calendar. Feel free to share relevant events and invites. DLF AIG - CAWG Calendar

Meeting Schedule

The Cultural Assessment Group will meet the last Tuesday of every month beginning March 27th, 2018 at 12:00pm CST (-6 UTC) via Skype for Business.
Join Skype Meeting Trouble Joining? Try Skype Web App Join by phone +1 319 467 1100 (Iowa City) English (United States) Find a local number Conference ID: 48083 Help For details on how to test your connection go to https://its.uiowa.edu/support/article/104972
Environmental Scan Task Force meets every two weeks beginning March 26, 2018 at 1:30pm CST (-6 UTC) via Skype for Business.
Join Skype Meeting Trouble Joining? Try Skype Web App Join by phone +1 319 467 1100 (Iowa City) English (United States) +Find a local number Conference ID: 48083 Help For details on how to test your connection go to https://its.uiowa.edu/support/article/104972
Personas Task Force meets every two weeks beginning March 28, 2018 at 10:00am CST (-6UTC). Method of communication TBD.
Call Details:
Enter your Audio number
               Audio Number: 8005018979
Secondary Audio Number:  +1 3032489662
Enter your access code, then #
               2564960
Web Site: https://conf.cfer.com
Selection Activities Task Force will meet every two weeks beginning April 3, 2018 at 1:00pm CST (-6UTC). Method of communication TBD.
Call Details:
Enter your Audio number
               Audio Number: 8005018979
Secondary Audio Number:  +1 3032489662
Enter your access code, then #
               2564960
Web Site: https://conf.cfer.com
Inclusive Metadata Task Force will meet every two weeks beginning April 4, 2018 at 2:00pm CST (-6 UTC). Method of communication TBD.
Conference Line: 1-877-820-7831 (toll free)
Passcode: 898690#

All meeting notes will be posted using Google Docs and will be demarcated by date (https://drive.google.com/open?id=13FYcbCZvdKuGr4fQybKceZC2y37moSpm).

Social Media

Join our Google group or contact group chair Hannah dash s dash Kettler at uiowa dot edu.



Back to the Assessment home page