Assessment:Costs: Difference between revisions
No edit summary |
No edit summary |
||
| (100 intermediate revisions by 9 users not shown) | |||
| Line 1: | Line 1: | ||
=DLF Cost | =DLF Cost Working Group= | ||
The Cost | The Cost group’s primary task has traditionally been to collect, aggregate, and share data on the time (and money) it takes to perform various tasks involved in the digitization process to help with project planning and benchmarking. When the group formed at the 2014 DLF Forum, we found few practical resources geared towards helping the community determine the cost of digitization. To help address this gap, we built a Digitization Cost Calculator [http://dashboard.diglib.org/ Digitization Cost Calculator] that allows individuals to enter information about a project and get back an estimate of the staffing costs and time needed to complete it based on real data from the community. | ||
Over the last few years, we have expanded our focus to work on broader tools and resources to create a more expansive toolkit that will serve a wider range of digitization programs. We currently have six active subgroups working on the following areas of interest: insourcing vs. outsourcing, a registry for vendors, assessing scans per linear feet, best practices, cost estimation (otherwise known as the feature of the cost calculator). And our final group is working on analyzing the results of our Still Image Digitization Costs Assessment Survey administered in 2021. | |||
==Get Involved== | ==Get Involved== | ||
==== | ===Working Group Membership=== | ||
The [https://docs.google.com/document/d/ | If you wish to resurrect the Cost Assessment Working Group, please contact the Coordinators of the Assessment Interest Group and DLF. | ||
====Standing working meetings==== | |||
2023 - 2024 working meetings were held on the '''second Monday''' of each month at '''3pm''' (eastern) / '''2pm''' (central) / '''1pm''' (mountain) / '''12pm''' (pacific). | |||
The Meeting minutes archive is located here: [https://docs.google.com/document/d/1AGH5fb1SBO2TGYp5ZXJecE8H8aOAZnpoSWbBEIBVuhc/edit#heading=h.nvzgguw3itde Meeting & Agenda Notes 2023] and [https://docs.google.com/document/d/1_ivMzIc4DPNjR86Gn7qsRZFGDF6ySotb_D9G-nTZarM/edit#heading=h.nvzgguw3itde Meeting Agendas & Notes 2022]. | |||
'''Meeting Connection Information:''' | |||
Or iPhone one-tap : | Email DLF at info@diglib.org for call-in information. | ||
<!-- '''Zoom''': https://clirdlf.zoom.us/j/486656289 | |||
Or Telephone: | Or '''iPhone one-tap''' : US: +16468769923,,486656289# (New York) or +16699006833,,486656289# (San Jose) | ||
Or '''Telephone''' : Dial(for higher quality, dial a number based on your current location): | |||
US: +1 646 876 9923 (New York) or +1 669 900 6833 (San Jose) or +1 408 638 0968 (San Jose) | |||
Find your local number: https://clirdlf.zoom.us/u/aojCpLuLf | |||
Meeting ID: 486 656 289--> | |||
==Group Work== | |||
===2024 Work=== | |||
== | This year the focus has been on the future of the group. In the Spring, we met to discuss our options which included staying as the Cost Assessment Working Group, sunsetting Cost and create a new group focused on digitization, or keeping Cost and creating a new group. The membership was surveyed during the summer with the results showing the majority wished to sunset Cost and create a new group. We also surveyed the other interest groups for feedback about if our plan would fill a gap in the DLF landscape. | ||
The | |||
In order to wrap up our previous survey work, we are creating a [https://wiki.diglib.org/Assessment:Costs:Toolkit toolkit] that will live within the Cost Assessment wiki. This will be the final project of the Cost Assessment Working Group. | |||
===[https://docs.google.com/document/d/1AGH5fb1SBO2TGYp5ZXJecE8H8aOAZnpoSWbBEIBVuhc/edit 2023 Work]=== | |||
This year we focused on analysis of the data produced by our surveys of current experiences and practices. Our findings can be found in our [https://osf.io/6dnmh/ OSF]. | |||
====The Surveys==== | |||
[[File:Noun-survey-1450024.png|thumb|alt=Survey icon]] | |||
If you work in the field of cultural heritage digitization, we'd appreciate your input via any or all of the following surveys.<br> | |||
'''Best Practices:'''<br> | |||
<nowiki>https://bit.ly/DLFbestpractices</nowiki> | |||
* This survey is designed to gather and share experiences about digitization practices and standards adhered to at different institutions. | |||
* Time estimate: 15-20 minutes | |||
'''Equipment Vendors:'''<br> | |||
<nowiki>https://bit.ly/DLFequipment</nowiki> | |||
* This survey is designed to gather and share experiences working with digitization equipment vendors. | |||
* Time estimate: 5-10 minutes | |||
'''Images per Linear Feet (aka, how many images per box did you get):''' <br> | |||
<nowiki>https://bit.ly/DLFimagesurvey</nowiki> | |||
* This survey is designed to gather data about how many images result from different containers, material type, and capture methodology combinations. This data will be used to help institutions during project planning. | |||
* Time estimate: 5 minutes | |||
'''Reformatting Service Vendors:'''<br> | |||
<nowiki>https://bit.ly/DLFvendorsurvey</nowiki> | |||
* This survey is designed to gather and share experiences working with reformatting service vendors. | |||
* Time estimate: 5-10 minutes | |||
The data gathered through these surveys will assist us in our efforts to produce resources to inform our colleagues in their work around cost assessment of digitization in the cultural heritage field. The surveys do collect email addresses but will not be shared outside of the DLF Assessment Interest Group unless you agree to share your information. | |||
''Thank you for your support!'' | |||
===[https://docs.google.com/document/d/1_ivMzIc4DPNjR86Gn7qsRZFGDF6ySotb_D9G-nTZarM/edit 2022 Work]=== | |||
In 2022, our focus was to support the work of project subgroups. In the Fall of 2022 through January 31, 2023, short surveys were administered to assist us in our efforts to produce resources to inform our colleagues in their work around cost assessment of digitization in the cultural heritage field. The survey topics were: best practices and standards, experience working with equipment vendors, the number of image captured per linear foot for different materials and container types, and experiences working with reformatting service vendors. <br> | |||
===[https://docs.google.com/document/d/1LGMi2H40m0f4ijYxDEdBhgwVvLb99xKtNfA39qcTivg/edit 2021 Work]=== | |||
In 2021, building on the development of the Digitization Cost Calculator, the Cost Group is shifting directions to create a more expansive toolkit that will serve a wider range of digitization labs. Beginning with a survey in early 2021, the Cost group sought information from a variety of digitization stakeholders from across the Digital Library Federation to inform new initiatives. The data collected will be used to help create resources for calculating and assessing institutional commitments necessary for successful digitization projects or starting a digitization program. The group has since formed 6 project subgroups to work on various resources and issues: insourcing vs. outsourcing, a registry for vendors, assessing scans per linear feet, best practices, cost estimation (otherwise known as the feature of the cost calculator), and a survey subgroup to analyze the results of our Still Image Digitization Costs Assessment Survey. <br> | |||
===[https://docs.google.com/document/d/1bDRyFF7SLxR5rcMqpFy7WYAdAogRFNX0hiSiD7S8YYc/edit 2020 Work]=== | |||
Beginning in 2020, the DLF Cost group began to imagine different ways to assess costs. Much of the year has centered on discussions of how, in addition to the cost calculator, the group can facilitate access to useful tools to organizations who want to plan digitization projects. The group drafted a survey to seek information from a variety of digitization stakeholders from across the field to inform new cost assessment initiatives for the group. <br> | |||
===[https://docs.google.com/document/d/1TbUz5mThnxoJKDjCk_L2_p8SKEzye4OO7fnjVCrGjks/edit 2019 Work]=== | |||
2019 was a year of reflection and transition for the Cost Working Group. Members talked about the future directions of the group and how it would continue to proceed with the cost calculator. <br> | |||
===2018 Work=== | ===[https://docs.google.com/document/d/1xl6EsWSMHRd3m-7033o2oOLvU8STj0kVLD3XssezKMY/edit?usp=sharing 2018 Work]=== | ||
The group’s initial goal for 2018 is to survey the community and conduct user interviews | The group’s initial goal for 2018 is to survey the community and conduct user interviews and user testing of the calculator. We plan to use the information captured from the community to help plan and prioritize our future work. <br> | ||
===2017 Work=== | ===[https://docs.google.com/document/d/1j4reOVgVYTsOjMz3aRqP5TLH_nMOkRjMZKAoq1NCeQk/edit?usp=sharing 2017 Work]=== | ||
2017 focused on making improvements to the Calculator. We organized the second annual [https://www.diglib.org/aig-assessments-day-of-data-ii/ Day of Data II] in July to collect additional community data. We also added a number of [calculator enhancements calculator enhancements], including the addition of new fields and new features. | 2017 focused on making improvements to the Calculator. We organized the second annual [https://www.diglib.org/aig-assessments-day-of-data-ii/ Day of Data II] in July to collect additional community data. We also added a number of [calculator enhancements calculator enhancements], including the addition of new fields and new features. <br> | ||
===2016 Work=== | ===[https://docs.google.com/document/d/1eQg8VuX6zlJ4nyPrzhttRKEB1T0ApaZKvjF3aTTCaCk/edit?usp=sharing 2016 Work]=== | ||
The data definitions authored by the cost assessment working group informed a modified structure of the calculator with expanded capabilities that was completed in 2016 with the assistance of Wayne Graham, Technical Director at CLIR and DLF. We needed at least one set of data in each of the 20 categories, as well as for each type of image capture device and for each level of metadata creation and quality control to support the modified structure. We gathered 85 data submissions in summer of 2016 with a Day of Data campaign, spent the fall reviewing and normalizing submissions, and released the 2.0 version of the calculator on November 7, 2016. | The data definitions authored by the cost assessment working group informed a modified structure of the calculator with expanded capabilities that was completed in 2016 with the assistance of Wayne Graham, Technical Director at CLIR and DLF. We needed at least one set of data in each of the 20 categories, as well as for each type of image capture device and for each level of metadata creation and quality control to support the modified structure. We gathered 85 data submissions in summer of 2016 with a Day of Data campaign, spent the fall reviewing and normalizing submissions, and released the 2.0 version of the calculator on November 7, 2016. <br> | ||
===2015 Work=== | ===[https://docs.google.com/a/ucsb.edu/document/d/1YZxppATnracRA9jMNJyxMTpbkXyT5SkPKcXgIWwlUPo/edit?usp=sharing 2015 Work]=== | ||
In 2014 a beta version of a [http://statelibrarync.org/plstats/digitization_calculator.php Library Digitization Cost Calculator] was developed to assist organizations in estimating the costs for digitizing collections and initiate a conversation at the 2014 DLF Forum around cost assessment in digital libraries. The original Digitization Cost Calculator was built as a proof of concept and contains data from only a handful of institutions. In spring of 2014, the Cost Assessment working group of the DLF Assessment Interest Group was subsequently founded. This group was tasked with drafting [https://docs.google.com/document/d/17jTJmCzKsa83BMdlgKj239Shqcbglq7I4EfxJIWWDQo/edit best practices and guidelines for the collection of time data for various digitization processes], which are used to standardize collection of such data in the field as well as to guide data submissions to the Digital Cost Calculator. The guidelines and definitions are organized according to some of the typical stages of a library project. | In 2014 a beta version of a [http://statelibrarync.org/plstats/digitization_calculator.php Library Digitization Cost Calculator] was developed to assist organizations in estimating the costs for digitizing collections and initiate a conversation at the 2014 DLF Forum around cost assessment in digital libraries. The original Digitization Cost Calculator was built as a proof of concept and contains data from only a handful of institutions. In spring of 2014, the Cost Assessment working group of the DLF Assessment Interest Group was subsequently founded. This group was tasked with drafting [https://docs.google.com/document/d/17jTJmCzKsa83BMdlgKj239Shqcbglq7I4EfxJIWWDQo/edit best practices and guidelines for the collection of time data for various digitization processes], which are used to standardize collection of such data in the field as well as to guide data submissions to the Digital Cost Calculator. The guidelines and definitions are organized according to some of the typical stages of a library project. | ||
In August 2015, the group produced [https://drive.google.com/ | In August 2015, the group produced [https://drive.google.com/open?id=0B4veUYJxzAmSUFFQYWNrS0hBLWc wire frames] showing the planned interface and functionality of the Digitization Cost Calculator 2.0, as well as [https://drive.google.com/a/ucsb.edu/file/d/0B4veUYJxzAmSN2FRaXJhdFRELTQ/view?usp=sharing wireframes of how results would appear]. | ||
In September 2015, the group released a [https://docs.google.com/document/d/1s1bHzkB3SSyufaoZS0JZhbVQ1AZfRgUsZ0iOcKZ3Q0k/edit call for data submissions] using the new guidelines and a new [https://duke.qualtrics.com/SE/?SID=SV_3OtqSEAbpl2QDl3 data submission form]. | In September 2015, the group released a [https://docs.google.com/document/d/1s1bHzkB3SSyufaoZS0JZhbVQ1AZfRgUsZ0iOcKZ3Q0k/edit call for data submissions] using the new guidelines and a new [https://duke.qualtrics.com/SE/?SID=SV_3OtqSEAbpl2QDl3 data submission form]. | ||
===Publication Information | ==Digitization Cost Calculator== | ||
The Cost Assessment Working Group's primary project has been to build and maintain the [http://dashboard.diglib.org/ Digitization Cost Calculator]. The source code for the calculator is available via the [https://github.com/clirdlf/digitization_cost_calculator Calculator's GitHub repository]. Starting in 2020, we explored different possible outputs that move beyond the cost calculator, but with the same emphasis on helping practitioners and managers better estimate the costs of digital projects going forward. As of 2024, be aware that there is an error in the data when calculating the cost for metadata. This version of the cost calculator can no longer being support but is still being made available for use. The Cost Assessment Working Group has developed a new iteration of the cost calculator which will be available in our OSF repository by the end of 2024. | |||
==Publication Information== | |||
*[https://docs.google.com/document/d/1yFWNWonZXHEFagI0A4ujeCl6U7SriJbfmqAgFGLA-Os/edit?usp=sharing Cost Assessment Bibliography] | *[https://docs.google.com/document/d/1yFWNWonZXHEFagI0A4ujeCl6U7SriJbfmqAgFGLA-Os/edit?usp=sharing Cost Assessment Bibliography] | ||
*[https://docs.google.com/document/d/17jTJmCzKsa83BMdlgKj239Shqcbglq7I4EfxJIWWDQo/edit Best practices and guidelines for the collection of time data for digitization processes] | *[https://docs.google.com/document/d/17jTJmCzKsa83BMdlgKj239Shqcbglq7I4EfxJIWWDQo/edit Best practices and guidelines for the collection of time data for digitization processes] | ||
==Project Team== | ==Project Team== | ||
===2023=== | |||
* Julia Simic, University of Oregon (co-facilitator) | |||
* Rachel Senese, Georgia State University (co-facilitator and coordinator of the Scans per Linear Feet subgroup) | |||
* Christina Deane, University of Virginia | |||
* Roberta Dupuis-Devlin, University of Illinois, Chicago | |||
* Chrissy Huhn, University of California, Berkeley | |||
* Deirdre Joyce, Syracuse University | |||
* Kimberly Kennedy, Northeastern University (former coordinator of the Registry for Vendors subgroup) | |||
* Marissa Kings, University of California, Los Angeles | |||
* Elizabeth La Beaud, University of Southern Mississippi | |||
* Barb Laufersweiler, University of Oklahoma (coordinator of the Cost Calculator subgroup) | |||
* Jenn Morris, MIT | |||
* Roel Munoz, Princeton University | |||
* Zvi Muskal, United Nations | |||
* Suzanne Preate, Syracuse University | |||
* Dana Reijerkerk, Stony Brook University | |||
* Kelly Riddle, LA County Public Library | |||
* Kathryn Ruddock, University of Calgary | |||
* Emma Stanford, Stanford University (coordinator of the Best Practices subgroup) | |||
* Michael Stasiak, New York University | |||
* Larry Wentzel, University of Michigan (coordinator of the Insourcing vs. Outsourcing subgroup) | |||
* Shannon Willis, Clemson University | |||
* Lisa Wright, University of Rochester | |||
* Biz Gallo, Library of Michigan, (coordinator of the Registry for Vendors subgroup) | |||
* Paula Kiser, Washington & Lee University | |||
* Emily Zinger, Cornell University | |||
===2022=== | |||
* Suzanne Preate, Syracuse University (co-facilitator) | |||
* Julia Simic, University of Oregon (co-facilitator) | |||
* Christina Deane, University of Virginia | |||
* Roberta Dupuis-Devlin, University of Illinois, Chicago | |||
* Biz Gallo, Library of Michigan | |||
* Chrissy Huhn, University of California, Berkeley | |||
* Deirdre Joyce, Syracuse University | |||
* Kimberly Kennedy, Northeastern University (coordinator of the Vendor Registry subgroup) | |||
* Marissa Kings, University of California, Los Angeles | |||
* Elizabeth La Beaud, University of Southern Mississippi | |||
* Barb Laufersweiler, University of Oklahoma (coordinator of the Cost Calculator subgroup) | |||
* Jenn Morris, MIT | |||
* Roel Munoz, Princeton University | |||
* Zvi Muskal, United Nations | |||
* Kelly Riddle, LA County Public Library | |||
* Kathryn Ruddock, University of Calgary | |||
* Rachel Senese, Georgia State University (coordinator of the Linear Feet subgroup) | |||
* Ian Song, Simon Fraser University | |||
* Emma Stanford, Stanford University (coordinator of the Best Practices subgroup) | |||
* Larry Wentzel, University of Michigan (coordinator of the Insourcing v. Outsourcing subgroup) | |||
* Shannon Willis, Clemson University | |||
* Lisa Wright, University of Rochester | |||
===2021=== | |||
* Shannon Willis, University of North Texas (co-facilitator) | |||
* Suzanne Preate, Syracuse University (co-facilitator) | |||
* Christina M. Deane, University of Virginia | |||
* Roberta Dupuis-Devlin, University of Illinois, Chicago | |||
* Laura Gentry, University of Alabama | |||
* Wayne Graham, CLIR (technical lead on Cost Calculator) | |||
* Chrissy Huhn, University of California, Berkeley | |||
* Deirdre Joyce, Syracuse University | |||
* Marissa Kings, University of California, Los Angeles | |||
* Elizabeth La Beaud, University of Southern Mississippi | |||
* Barbara Laufersweiler, University of Oklahoma (coordinator of the Cost Calculator subgroup) | |||
* Roel Munoz, Princeton University | |||
* Zvi Muskal, United Nations | |||
* Timothy Provenzano, University of Arizona (coordinator of the Registry for Vendors subgroup) | |||
* Kelly Riddle, LA County Library | |||
* Kathryn Ruddock, University of Calgary | |||
* Rachel Senese, Georgia State University | |||
* Julia Simic, University of Oregon | |||
* Emma Stanford, Stanford University (coordinator of the Best Practices subgroup) | |||
* Michael Stasiak, New York University | |||
* Emily Weirich, University of Arizona (coordinator of the Survey subgroup) | |||
* Larry Wentzel, University of Michigan (coordinator of the Insourcing v. Outsourcing subgroup) | |||
* Lisa Wright, University of Rochester | |||
===2020=== | |||
* Deirdre Joyce, Syracuse University (co-facilitator) | |||
* Shannon Willis, University of North Texas (co-facilitator) | |||
* Wayne Graham, CLIR (technical lead on Cost Calculator) | |||
* Christina M. Deane, University of Virginia | |||
* Laura Gentry, University of Alabama | |||
* Roel Munoz, Princeton University | |||
* Suzanne Preate, Syracuse University | |||
* Emily Weirich, University of Arizona | |||
* Lisa Wright, University of Rochester | |||
===2019=== | |||
* Chrissy Rissmeyer, University of California, Santa Barbara (co-facilitator) | |||
* Sarah Severson, University of Alberta Libraries, (co-facilitator) | |||
* Deirdre Joyce, Syracuse University (co-facilitator) | |||
* Wayne Graham, CLIR (technical lead on Cost Calculator) | |||
* David Bliss, University of Texas at Austin | |||
* Greg Davis, Iowa State University | |||
* Shannon Willis, University of North Texas Libraries | |||
* Gabriella Williams, University of Miami | |||
* Dan Zellner, Northwestern University | |||
===2018=== | ===2018=== | ||
| Line 72: | Line 203: | ||
* Sarah Severson, McGill University Library | * Sarah Severson, McGill University Library | ||
* Gabriella Williams, University of Miami | * Gabriella Williams, University of Miami | ||
* Dan Zellner, Northwestern University | * Dan Zellner, Northwestern University | ||
Latest revision as of 15:07, 20 November 2024
DLF Cost Working Group
The Cost group’s primary task has traditionally been to collect, aggregate, and share data on the time (and money) it takes to perform various tasks involved in the digitization process to help with project planning and benchmarking. When the group formed at the 2014 DLF Forum, we found few practical resources geared towards helping the community determine the cost of digitization. To help address this gap, we built a Digitization Cost Calculator Digitization Cost Calculator that allows individuals to enter information about a project and get back an estimate of the staffing costs and time needed to complete it based on real data from the community.
Over the last few years, we have expanded our focus to work on broader tools and resources to create a more expansive toolkit that will serve a wider range of digitization programs. We currently have six active subgroups working on the following areas of interest: insourcing vs. outsourcing, a registry for vendors, assessing scans per linear feet, best practices, cost estimation (otherwise known as the feature of the cost calculator). And our final group is working on analyzing the results of our Still Image Digitization Costs Assessment Survey administered in 2021.
Get Involved
Working Group Membership
If you wish to resurrect the Cost Assessment Working Group, please contact the Coordinators of the Assessment Interest Group and DLF.
Standing working meetings
2023 - 2024 working meetings were held on the second Monday of each month at 3pm (eastern) / 2pm (central) / 1pm (mountain) / 12pm (pacific).
The Meeting minutes archive is located here: Meeting & Agenda Notes 2023 and Meeting Agendas & Notes 2022.
Meeting Connection Information:
Email DLF at info@diglib.org for call-in information.
Group Work
2024 Work
This year the focus has been on the future of the group. In the Spring, we met to discuss our options which included staying as the Cost Assessment Working Group, sunsetting Cost and create a new group focused on digitization, or keeping Cost and creating a new group. The membership was surveyed during the summer with the results showing the majority wished to sunset Cost and create a new group. We also surveyed the other interest groups for feedback about if our plan would fill a gap in the DLF landscape.
In order to wrap up our previous survey work, we are creating a toolkit that will live within the Cost Assessment wiki. This will be the final project of the Cost Assessment Working Group.
2023 Work
This year we focused on analysis of the data produced by our surveys of current experiences and practices. Our findings can be found in our OSF.
The Surveys
If you work in the field of cultural heritage digitization, we'd appreciate your input via any or all of the following surveys.
Best Practices:
https://bit.ly/DLFbestpractices
- This survey is designed to gather and share experiences about digitization practices and standards adhered to at different institutions.
- Time estimate: 15-20 minutes
Equipment Vendors:
https://bit.ly/DLFequipment
- This survey is designed to gather and share experiences working with digitization equipment vendors.
- Time estimate: 5-10 minutes
Images per Linear Feet (aka, how many images per box did you get):
https://bit.ly/DLFimagesurvey
- This survey is designed to gather data about how many images result from different containers, material type, and capture methodology combinations. This data will be used to help institutions during project planning.
- Time estimate: 5 minutes
Reformatting Service Vendors:
https://bit.ly/DLFvendorsurvey
- This survey is designed to gather and share experiences working with reformatting service vendors.
- Time estimate: 5-10 minutes
The data gathered through these surveys will assist us in our efforts to produce resources to inform our colleagues in their work around cost assessment of digitization in the cultural heritage field. The surveys do collect email addresses but will not be shared outside of the DLF Assessment Interest Group unless you agree to share your information.
Thank you for your support!
2022 Work
In 2022, our focus was to support the work of project subgroups. In the Fall of 2022 through January 31, 2023, short surveys were administered to assist us in our efforts to produce resources to inform our colleagues in their work around cost assessment of digitization in the cultural heritage field. The survey topics were: best practices and standards, experience working with equipment vendors, the number of image captured per linear foot for different materials and container types, and experiences working with reformatting service vendors.
2021 Work
In 2021, building on the development of the Digitization Cost Calculator, the Cost Group is shifting directions to create a more expansive toolkit that will serve a wider range of digitization labs. Beginning with a survey in early 2021, the Cost group sought information from a variety of digitization stakeholders from across the Digital Library Federation to inform new initiatives. The data collected will be used to help create resources for calculating and assessing institutional commitments necessary for successful digitization projects or starting a digitization program. The group has since formed 6 project subgroups to work on various resources and issues: insourcing vs. outsourcing, a registry for vendors, assessing scans per linear feet, best practices, cost estimation (otherwise known as the feature of the cost calculator), and a survey subgroup to analyze the results of our Still Image Digitization Costs Assessment Survey.
2020 Work
Beginning in 2020, the DLF Cost group began to imagine different ways to assess costs. Much of the year has centered on discussions of how, in addition to the cost calculator, the group can facilitate access to useful tools to organizations who want to plan digitization projects. The group drafted a survey to seek information from a variety of digitization stakeholders from across the field to inform new cost assessment initiatives for the group.
2019 Work
2019 was a year of reflection and transition for the Cost Working Group. Members talked about the future directions of the group and how it would continue to proceed with the cost calculator.
2018 Work
The group’s initial goal for 2018 is to survey the community and conduct user interviews and user testing of the calculator. We plan to use the information captured from the community to help plan and prioritize our future work.
2017 Work
2017 focused on making improvements to the Calculator. We organized the second annual Day of Data II in July to collect additional community data. We also added a number of [calculator enhancements calculator enhancements], including the addition of new fields and new features.
2016 Work
The data definitions authored by the cost assessment working group informed a modified structure of the calculator with expanded capabilities that was completed in 2016 with the assistance of Wayne Graham, Technical Director at CLIR and DLF. We needed at least one set of data in each of the 20 categories, as well as for each type of image capture device and for each level of metadata creation and quality control to support the modified structure. We gathered 85 data submissions in summer of 2016 with a Day of Data campaign, spent the fall reviewing and normalizing submissions, and released the 2.0 version of the calculator on November 7, 2016.
2015 Work
In 2014 a beta version of a Library Digitization Cost Calculator was developed to assist organizations in estimating the costs for digitizing collections and initiate a conversation at the 2014 DLF Forum around cost assessment in digital libraries. The original Digitization Cost Calculator was built as a proof of concept and contains data from only a handful of institutions. In spring of 2014, the Cost Assessment working group of the DLF Assessment Interest Group was subsequently founded. This group was tasked with drafting best practices and guidelines for the collection of time data for various digitization processes, which are used to standardize collection of such data in the field as well as to guide data submissions to the Digital Cost Calculator. The guidelines and definitions are organized according to some of the typical stages of a library project.
In August 2015, the group produced wire frames showing the planned interface and functionality of the Digitization Cost Calculator 2.0, as well as wireframes of how results would appear.
In September 2015, the group released a call for data submissions using the new guidelines and a new data submission form.
Digitization Cost Calculator
The Cost Assessment Working Group's primary project has been to build and maintain the Digitization Cost Calculator. The source code for the calculator is available via the Calculator's GitHub repository. Starting in 2020, we explored different possible outputs that move beyond the cost calculator, but with the same emphasis on helping practitioners and managers better estimate the costs of digital projects going forward. As of 2024, be aware that there is an error in the data when calculating the cost for metadata. This version of the cost calculator can no longer being support but is still being made available for use. The Cost Assessment Working Group has developed a new iteration of the cost calculator which will be available in our OSF repository by the end of 2024.
Publication Information
- Cost Assessment Bibliography
- Best practices and guidelines for the collection of time data for digitization processes
Project Team
2023
- Julia Simic, University of Oregon (co-facilitator)
- Rachel Senese, Georgia State University (co-facilitator and coordinator of the Scans per Linear Feet subgroup)
- Christina Deane, University of Virginia
- Roberta Dupuis-Devlin, University of Illinois, Chicago
- Chrissy Huhn, University of California, Berkeley
- Deirdre Joyce, Syracuse University
- Kimberly Kennedy, Northeastern University (former coordinator of the Registry for Vendors subgroup)
- Marissa Kings, University of California, Los Angeles
- Elizabeth La Beaud, University of Southern Mississippi
- Barb Laufersweiler, University of Oklahoma (coordinator of the Cost Calculator subgroup)
- Jenn Morris, MIT
- Roel Munoz, Princeton University
- Zvi Muskal, United Nations
- Suzanne Preate, Syracuse University
- Dana Reijerkerk, Stony Brook University
- Kelly Riddle, LA County Public Library
- Kathryn Ruddock, University of Calgary
- Emma Stanford, Stanford University (coordinator of the Best Practices subgroup)
- Michael Stasiak, New York University
- Larry Wentzel, University of Michigan (coordinator of the Insourcing vs. Outsourcing subgroup)
- Shannon Willis, Clemson University
- Lisa Wright, University of Rochester
- Biz Gallo, Library of Michigan, (coordinator of the Registry for Vendors subgroup)
- Paula Kiser, Washington & Lee University
- Emily Zinger, Cornell University
2022
- Suzanne Preate, Syracuse University (co-facilitator)
- Julia Simic, University of Oregon (co-facilitator)
- Christina Deane, University of Virginia
- Roberta Dupuis-Devlin, University of Illinois, Chicago
- Biz Gallo, Library of Michigan
- Chrissy Huhn, University of California, Berkeley
- Deirdre Joyce, Syracuse University
- Kimberly Kennedy, Northeastern University (coordinator of the Vendor Registry subgroup)
- Marissa Kings, University of California, Los Angeles
- Elizabeth La Beaud, University of Southern Mississippi
- Barb Laufersweiler, University of Oklahoma (coordinator of the Cost Calculator subgroup)
- Jenn Morris, MIT
- Roel Munoz, Princeton University
- Zvi Muskal, United Nations
- Kelly Riddle, LA County Public Library
- Kathryn Ruddock, University of Calgary
- Rachel Senese, Georgia State University (coordinator of the Linear Feet subgroup)
- Ian Song, Simon Fraser University
- Emma Stanford, Stanford University (coordinator of the Best Practices subgroup)
- Larry Wentzel, University of Michigan (coordinator of the Insourcing v. Outsourcing subgroup)
- Shannon Willis, Clemson University
- Lisa Wright, University of Rochester
2021
- Shannon Willis, University of North Texas (co-facilitator)
- Suzanne Preate, Syracuse University (co-facilitator)
- Christina M. Deane, University of Virginia
- Roberta Dupuis-Devlin, University of Illinois, Chicago
- Laura Gentry, University of Alabama
- Wayne Graham, CLIR (technical lead on Cost Calculator)
- Chrissy Huhn, University of California, Berkeley
- Deirdre Joyce, Syracuse University
- Marissa Kings, University of California, Los Angeles
- Elizabeth La Beaud, University of Southern Mississippi
- Barbara Laufersweiler, University of Oklahoma (coordinator of the Cost Calculator subgroup)
- Roel Munoz, Princeton University
- Zvi Muskal, United Nations
- Timothy Provenzano, University of Arizona (coordinator of the Registry for Vendors subgroup)
- Kelly Riddle, LA County Library
- Kathryn Ruddock, University of Calgary
- Rachel Senese, Georgia State University
- Julia Simic, University of Oregon
- Emma Stanford, Stanford University (coordinator of the Best Practices subgroup)
- Michael Stasiak, New York University
- Emily Weirich, University of Arizona (coordinator of the Survey subgroup)
- Larry Wentzel, University of Michigan (coordinator of the Insourcing v. Outsourcing subgroup)
- Lisa Wright, University of Rochester
2020
- Deirdre Joyce, Syracuse University (co-facilitator)
- Shannon Willis, University of North Texas (co-facilitator)
- Wayne Graham, CLIR (technical lead on Cost Calculator)
- Christina M. Deane, University of Virginia
- Laura Gentry, University of Alabama
- Roel Munoz, Princeton University
- Suzanne Preate, Syracuse University
- Emily Weirich, University of Arizona
- Lisa Wright, University of Rochester
2019
- Chrissy Rissmeyer, University of California, Santa Barbara (co-facilitator)
- Sarah Severson, University of Alberta Libraries, (co-facilitator)
- Deirdre Joyce, Syracuse University (co-facilitator)
- Wayne Graham, CLIR (technical lead on Cost Calculator)
- David Bliss, University of Texas at Austin
- Greg Davis, Iowa State University
- Shannon Willis, University of North Texas Libraries
- Gabriella Williams, University of Miami
- Dan Zellner, Northwestern University
2018
- Joyce Chapman, Duke University (co-coordinator)
- Chrissy Rissmeyer, University of California, Santa Barbara (co-coordinator)
- Wayne Graham, CLIR (technical lead on Cost Calculator)
- David Bliss, University of Texas at Austin
- Greg Davis, Iowa State University
- Ann Hanlon, University of Wisconsin Milwaukee
- Deirdre Joyce, Syracuse University
- Sarah Severson, McGill University Library
- Gabriella Williams, University of Miami
- Dan Zellner, Northwestern University
2017
- Joyce Chapman, Duke University (coordinator)
- Wayne Graham, CLIR (technical lead on Cost Calculator)
- Ann Hanlon, University of Wisconsin Milwaukee
- Deirdre Joyce, Syracuse University
- Genya O'Gara, VIVA
- Chrissy Rissmeyer, University of California, Santa Barbara
- Sarah Severson, McGill University Library
- Dan Zellner, Northwestern University
2016
- Joyce Chapman, Duke University, (coordinator)
- Wayne Graham, CLIR (technical lead on Cost Calculator)
- Jane Davis, Saint Louis Federal Reserve Bank
- Ann Hanlon, University of Wisconsin Milwaukee
- Kinza Masood, University of Utah
- Genya O'Gara, VIVA
- Chrissy Rissmeyer, University of California, Santa Barbara
- Sarah Severson, McGill University Library
- Emily Shaw, Ohio State University Libraries
- Dan Zellner, Northwestern University
2015
- Joyce Chapman, Duke University, (coordinator)
- Kinza Masood, University of Utah
- Chrissy Rissmeyer, University of California, Santa Barbara
- Dan Zellner, Northwestern University