Assessment: Difference between revisions
Thompsonsa82 (talk | contribs) No edit summary |
Thompsonsa82 (talk | contribs) |
||
(39 intermediate revisions by 7 users not shown) | |||
Line 1: | Line 1: | ||
''' | = '''DLF Assessment Interest Group''' = | ||
The [http://www.diglib.org/groups/assessment/ DLF Assessment Interest Group (AIG)], founded in 2014, seeks to engage the community in developing best practices and guidelines for various kinds of digital library assessment. This wiki is a central location for documentation and collection of resources to assist those seeking to assess their digital libraries. | |||
Research and cultural heritage institutions are, as a matter of course, providing online access to converted and born-digital scholarly and cultural content. As the amount of that content continues to grow, there is an increased need to strategically standardize our assessment efforts. | Research and cultural heritage institutions are, as a matter of course, providing online access to converted and born-digital scholarly and cultural content. As the amount of that content continues to grow, there is an increased need to strategically standardize our assessment efforts. | ||
The | The DLF AIG is concerned with: | ||
* determining how to measure the impact of digital collections | |||
* determining how to measure the impact of digital collections | * developing areas of commonality and benchmarks in how we measure collections across various platforms | ||
* developing areas of commonality and benchmarks in how we measure collections across various platforms | * understanding cost and benefit of digital collections | ||
* understanding cost and benefit of digital collections | * exploring how can we best collect, analyze, communicate, and share such information effectively across our various stakeholders—from collection managers to scholars | ||
* exploring how can we best collect, analyze, communicate, and share such information effectively across our various stakeholders—from collection managers to scholars | |||
== Working Groups == | |||
=== Active Groups === | |||
* [[Assessment:Costs]] | |||
* [[Assessment:Cultural Assessment]] | |||
* [[Assessment:Metadata]] | |||
* [[Assessment:User/Reuse]] | |||
* [[Assessment:User/UX]] | |||
=== Inactive Groups === | |||
* [[Assessment:Analytics]] | * [[Assessment:Analytics]] | ||
* [[Assessment:Benefits]] | |||
* [[Assessment:Citations]] | |||
* [[Assessment:User Studies]] | |||
== Background == | |||
[[File:Dlf-assessment-pie-chart-not-transparent.png|left|frameless|250px|https://wiki.diglib.org/File:Dlf-assessment-pie-chart-not-transparent.png]] The DLF AIG was born in the spring following the 2013 DLF Forum working session, “Hunting for Best Practices in Library Assessment,” which garnered over 50 volunteers to continue the discussion after the conference; a second working session on altmetrics was also met with huge interest. A Digital Library Assessment Google Group was established to provide a space for practitioners to discuss assessment efforts. | |||
At the 2014 DLF Forum, the [https://docs.google.com/document/d/1rLdMSPCbR_F-hE0ZhWzS70IBGEMh1450ff0x_ioPrIk/edit#heading=h.v5ec1r31vuuf/ Moving Forward with Digital Library Assessment] panel discussed a new NISO initiative to develop standards for altmetrics, a new web-based cost estimation tool for digitization, and both qualitative and quantitative results from digital library user studies. The panel, like the working group the year before, was followed by a lively discussion about how to further the development of best practices for digital library assessment. Again, many community members volunteered to continue the discussion, and four working groups formed in November 2014. These groups were tasked with developing to best practices centered in the assessment of digital libraries, in the areas of user studies, analytics, cost, and citations as outlined in the [https://docs.google.com/document/d/18kOolh-U0qIrT3tcJg8fXMnN5pnKylFpxvtRL561baU/edit?usp=sharing Digital Library Assessment Framework]. | |||
Each of these four groups worked to develop white papers and tools, which were presented at the 2015 DLF Forum during the [https://docs.google.com/document/d/15-mFHPXjW63srbZ-QZoh5_cAV9BXXNtj5aTQl-DlqO4/edit?usp=sharing/ Collaborative Efforts to Develop Best Practices in Assessment: A Progress Report] panel and lunch sessions. For more information on these working groups and the status of AIG in 2015, see Joyce Chapman, Jody DeRidder, and Santi Thompson's article on the first year of AIG's work in [http://www.dlib.org/dlib/november15/chapman/11chapman.html "Developing Best Practices in Digital Library Assessment: Year One Update"] in D-Lib Magazine's November/December 2015 issue (Volume 21, Number 11/12). | |||
During the 2015 DLF Forum, the AIG discussed the formation of two new groups, focused on metadata and cultural assessment. These two groups were formally established in the months following the 2015 Forum and, along with the analytics, costs, and user studies groups, presented updates at the 2016 DLF Forum. | |||
Prior to the 2018 DLF Forum, User Experience and Content Reuse became their own formal Working Groups, retiring the User Studies Working Group. | |||
== Archived Documentation == | |||
Archived documentation is available at the [https://osf.io/7bawc/ Open Science Framework]. | |||
== Get Involved == | |||
=== Google Group === | |||
To take part in the conversation, join the [https://groups.google.com/forum/#!forum/digital-library-assessment Digital Library Assessment Google Group], which is open to anyone interested in learning about or collaborating on the improvement of digital library assessment. | |||
=== DLF AIG Slack === | |||
The DLF AIG Slack is a space to facilitate collaboration and productivity across AIG working groups. It is also a space for discussion around various aspects of digital library assessment. The workspace is open to all who are interested in learning about or collaborating on the improvement of digital library assessment. No assessment experience is required or assumed. | |||
DLF AIG Slack membership is available via invite. If you'd like to join the DLF AIG Slack workspace, please review and complete the [https://docs.google.com/forms/d/e/1FAIpQLSerRD5r57NGXF3lqtIim4t6Y8UhpLj86O7QmsXnfj1D7sLYFQ/viewform sign-up form] | |||
== Previous Events == | |||
=== 2017-2018 Twitter Chats === | |||
The AIG will be hosting #DLFAIG Twitter chats over the next year seeking to engage the DLF community in developing best practices and guidelines for various kinds of digital library assessment. With these informal discussions we hope to raise awareness for AIG groups for projects/papers/content they have produced and/or working on and get feedback and insight into our current assessment related projects from the community. Stay tuned for more information! | |||
Schedule and topics for Twitter chats using the hashtag #DLFAIG, unless otherwise noted. | |||
{| class="wikitable" | |||
|+Upcoming Chats | |||
|- | |||
| style="text-align:center;" | '''AIG Working Groups''' | |||
|style="text-align:center;" | '''Date and Time''' | |||
|style="text-align:center;" | '''Topic''' | |||
|style="text-align:center;" | '''Hashtag''' | |||
|style="text-align:center;" | '''Archived Chat URL''' | |||
|- | |||
|Metadata Assessment Working Group | |||
|September 18, 2017, 3 PM EDT | |||
|See [https://docs.google.com/document/d/1A9VCTvuA3NExg6uDYonzFUrPMhEf-7ZQjsfwc9sajGE/edit?usp=sharing Planning Document] | |||
|#mashcat <br>#dlfaig | |||
|[https://wakelet.com/wake/ccd1a857-e15c-4442-8c02-47a8ebb91b95 Available here] | |||
|- | |||
|Cultural Assessment and <br>User Experience Working Groups (Joint Chat) | |||
|December 5, 2017, 9 PM EDT | |||
|[http://critlib.org/user-personas-for-digital-collections/ Developing socially inclusive user personas for digital collections and repositories] | |||
|#critlib <br>#dlfaig | |||
|[https://wakelet.com/wake/f3111b7b-7bab-432c-9214-d63e2c2f8f80 Available here] | |||
|- | |||
|Reuse Working Group | |||
|April 25, 2018, 2 PM EDT | |||
|[https://reuse.diglib.org/2018/04/12/analytics-altmetrics-and-reuse-twitter-chat-april-25/ Analytics, Altmetrics, and Reuse Twitter Chat] | |||
|#dlfaig <br>#digreuse | |||
|[http://wke.lt/w/s/7knzI Available here] | |||
|- | |||
|} |
Latest revision as of 12:49, 26 September 2019
DLF Assessment Interest Group
The DLF Assessment Interest Group (AIG), founded in 2014, seeks to engage the community in developing best practices and guidelines for various kinds of digital library assessment. This wiki is a central location for documentation and collection of resources to assist those seeking to assess their digital libraries.
Research and cultural heritage institutions are, as a matter of course, providing online access to converted and born-digital scholarly and cultural content. As the amount of that content continues to grow, there is an increased need to strategically standardize our assessment efforts.
The DLF AIG is concerned with:
- determining how to measure the impact of digital collections
- developing areas of commonality and benchmarks in how we measure collections across various platforms
- understanding cost and benefit of digital collections
- exploring how can we best collect, analyze, communicate, and share such information effectively across our various stakeholders—from collection managers to scholars
Working Groups
Active Groups
- Assessment:Costs
- Assessment:Cultural Assessment
- Assessment:Metadata
- Assessment:User/Reuse
- Assessment:User/UX
Inactive Groups
Background
![https://wiki.diglib.org/File:Dlf-assessment-pie-chart-not-transparent.png](/images/thumb/0/05/Dlf-assessment-pie-chart-not-transparent.png/250px-Dlf-assessment-pie-chart-not-transparent.png)
The DLF AIG was born in the spring following the 2013 DLF Forum working session, “Hunting for Best Practices in Library Assessment,” which garnered over 50 volunteers to continue the discussion after the conference; a second working session on altmetrics was also met with huge interest. A Digital Library Assessment Google Group was established to provide a space for practitioners to discuss assessment efforts.
At the 2014 DLF Forum, the Moving Forward with Digital Library Assessment panel discussed a new NISO initiative to develop standards for altmetrics, a new web-based cost estimation tool for digitization, and both qualitative and quantitative results from digital library user studies. The panel, like the working group the year before, was followed by a lively discussion about how to further the development of best practices for digital library assessment. Again, many community members volunteered to continue the discussion, and four working groups formed in November 2014. These groups were tasked with developing to best practices centered in the assessment of digital libraries, in the areas of user studies, analytics, cost, and citations as outlined in the Digital Library Assessment Framework.
Each of these four groups worked to develop white papers and tools, which were presented at the 2015 DLF Forum during the Collaborative Efforts to Develop Best Practices in Assessment: A Progress Report panel and lunch sessions. For more information on these working groups and the status of AIG in 2015, see Joyce Chapman, Jody DeRidder, and Santi Thompson's article on the first year of AIG's work in "Developing Best Practices in Digital Library Assessment: Year One Update" in D-Lib Magazine's November/December 2015 issue (Volume 21, Number 11/12).
During the 2015 DLF Forum, the AIG discussed the formation of two new groups, focused on metadata and cultural assessment. These two groups were formally established in the months following the 2015 Forum and, along with the analytics, costs, and user studies groups, presented updates at the 2016 DLF Forum.
Prior to the 2018 DLF Forum, User Experience and Content Reuse became their own formal Working Groups, retiring the User Studies Working Group.
Archived Documentation
Archived documentation is available at the Open Science Framework.
Get Involved
Google Group
To take part in the conversation, join the Digital Library Assessment Google Group, which is open to anyone interested in learning about or collaborating on the improvement of digital library assessment.
DLF AIG Slack
The DLF AIG Slack is a space to facilitate collaboration and productivity across AIG working groups. It is also a space for discussion around various aspects of digital library assessment. The workspace is open to all who are interested in learning about or collaborating on the improvement of digital library assessment. No assessment experience is required or assumed.
DLF AIG Slack membership is available via invite. If you'd like to join the DLF AIG Slack workspace, please review and complete the sign-up form
Previous Events
2017-2018 Twitter Chats
The AIG will be hosting #DLFAIG Twitter chats over the next year seeking to engage the DLF community in developing best practices and guidelines for various kinds of digital library assessment. With these informal discussions we hope to raise awareness for AIG groups for projects/papers/content they have produced and/or working on and get feedback and insight into our current assessment related projects from the community. Stay tuned for more information!
Schedule and topics for Twitter chats using the hashtag #DLFAIG, unless otherwise noted.
AIG Working Groups | Date and Time | Topic | Hashtag | Archived Chat URL |
Metadata Assessment Working Group | September 18, 2017, 3 PM EDT | See Planning Document | #mashcat #dlfaig |
Available here |
Cultural Assessment and User Experience Working Groups (Joint Chat) |
December 5, 2017, 9 PM EDT | Developing socially inclusive user personas for digital collections and repositories | #critlib #dlfaig |
Available here |
Reuse Working Group | April 25, 2018, 2 PM EDT | Analytics, Altmetrics, and Reuse Twitter Chat | #dlfaig #digreuse |
Available here |