Difference between revisions of "Assessment:Costs"

From DLF Wiki
Jump to navigation Jump to search
 
(54 intermediate revisions by 6 users not shown)
Line 1: Line 1:
''[[Data Collection and Contribution, Digitization Cost Calculator|Click here for instructions on collecting/contributing data to the Digitization Cost Calculator]]''
+
=DLF Cost Working Group=
 +
The Cost group’s primary task has traditionally been to collect, aggregate, and share data on the time (and money) it takes to perform various tasks involved in the digitization process to help with project planning and benchmarking. When the group formed at the 2014 DLF Forum, we found few practical resources geared towards helping the community determine the cost of digitization. To help address this gap, we built a Digitization Cost Calculator [http://dashboard.diglib.org/ Digitization Cost Calculator] that allows individuals to enter information about a project and get back an estimate of the staffing costs and time needed to complete it based on real data from the community.
  
The Cost Assessment working group's tasks are to aggregate and make freely available a large set of data on the time it takes to perform various tasks involved in the digitization process, in order to assist organizations in digitization project planning and benchmarking. To that end, we are building a Digitization Cost Calculator that takes advantage of the contributed data set to provide digitization cost estimates based on various input parameters. Founded in 2014, the Cost Assessment working group of the DLF Assessment Interest Group was tasked with drafting [https://docs.google.com/document/d/17jTJmCzKsa83BMdlgKj239Shqcbglq7I4EfxJIWWDQo/edit best practices and guidelines for the collection of time data for various digitization processes], which are now in use, with the goal of standardizing collection of such data in the field as well as to guide data submissions to the Digitization Cost Calculator.  
+
As we move into a new phase for the group, we seek to continue collecting the above information and look for new ways to share and use this information beyond the cost calculator, even as we continue to improve the data that informs the calculator tool. The Cost Working group is an ideal place for digital lab practitioners and managerial staff alike to come together to talk about practical ways to assess the resources necessary to plan and execute successful digitization projects.
  
==Current projects==
+
==Get Involved==
===Digitization Cost Calculator and associated data set===
+
===Contribute Data===
''Digitization Cost Calculator -- current status'': The data definitions authored by the cost assessment working group have now informed a modified structure of the calculator with expanded capabilities that we are completing in 2016 with the assistance of Wayne Graham, Technical Director at CLIR and DLF. We gathered 80 data submissions in summer of 2016 with a Day of Data campaign, spent the fall reviewing and normalizing submissions, and are now close to having a version of the calculator complete. Stay tuned for updates!
+
We are always looking for more data! [[Data Collection and Contribution, Digitization Cost Calculator|Please click here for instructions on how to collect and contribute data to the Digitization Cost Calculator.]]
 +
 
 +
===Working Group Membership===
 +
The Cost Assessment working group always welcomes new members. Members meet regularly to work on different projects. If you are interested in joining, please join our 
 +
[https://groups.google.com/forum/#!forum/dlf-aig-cost-assessment Digital Library AIG Cost Assessment google group] and speak up!
 +
 
 +
Information on standing meetings in 2020 will be posted after February 21, 2020
 +
 
 +
====Standing working meetings====
 +
2020 working meetings are held on the '''second Monday''' of each month (3/9, 4/13, 5/11, 6/8, 7/13, 8/10, 9/14, 10/12), at '''3pm'''(eastern)/'''2pm'''(central)/'''1pm'''(mountain)/'''12pm'''(pacific)
 +
 
 +
See past meeting minutes at [https://docs.google.com/a/ucsb.edu/document/d/1TbUz5mThnxoJKDjCk_L2_p8SKEzye4OO7fnjVCrGjks/edit?usp=sharing 2019 Agendas and Meeting Notes].
 +
 
 +
'''Meeting Connection Information:'''
 +
 
 +
Email DLF at info@diglib.org for call-in information.
 +
<!--   '''Zoom''': https://clirdlf.zoom.us/j/486656289
 +
    Or '''iPhone one-tap''' : US: +16468769923,,486656289# (New York) or +16699006833,,486656289# (San Jose)
 +
    Or '''Telephone''' : Dial(for higher quality, dial a number based on your current location):
 +
    US: +1 646 876 9923 (New York) or +1 669 900 6833 (San Jose) or +1 408 638 0968 (San Jose)
 +
    Find your local number: https://clirdlf.zoom.us/u/aojCpLuLf
 +
    Meeting ID: 486 656 289-->
 +
 
 +
==Digitization Cost Calculator==
 +
The Cost Assessment Working Group's primary project has been to build and maintain the [http://dashboard.diglib.org/ Digitization Cost Calculator]. The source code for the calculator is available via the [https://github.com/clirdlf/digitization_cost_calculator Calculator's GitHub repository]. In 2020, we will be looking at the different possible outputs that move beyond the cost calculator, but with the same emphasis on helping practitioners and managers better estimate the costs of digital projects going forward.
 +
 
 +
===[https://docs.google.com/document/d/1bDRyFF7SLxR5rcMqpFy7WYAdAogRFNX0hiSiD7S8YYc/edit 2020 Work]===
 +
In 2020, the DLF Cost group began to imagine different ways to assess costs. Much of the year has centered on discussions of how, in addition to the cost calculator, the group has discussed how it can facilitate access to useful tools to organizations who want to plan digitization projects.
 +
 
 +
===[https://docs.google.com/document/d/1TbUz5mThnxoJKDjCk_L2_p8SKEzye4OO7fnjVCrGjks/edit 2019 Work]===
 +
2019 was a year of reflection and transition for the Costs Working Group. Members talked about the future directions of the group and how it would continue to proceed with the cost calculator.
  
''Digitization Cost Calculator -- what's been completed'': In 2014 the Cost Assessment working group developed a beta version of a [http://statelibrarync.org/plstats/digitization_calculator.php Library Digitization Cost Calculator] to assist organizations in estimating the costs for digitizing collections and initiate a conversation at the 2014 DLF Forum around cost assessment in digital libraries. The original Digitization Cost Calculator was built as a proof of concept and contains data from only a handful of institutions. In spring of 2014, the Cost Assessment working group of the DLF Assessment Interest Group was subsequently founded. This group was tasked with drafting [https://docs.google.com/document/d/17jTJmCzKsa83BMdlgKj239Shqcbglq7I4EfxJIWWDQo/edit best practices and guidelines for the collection of time data for various digitization processes], which are used to standardize collection of such data in the field as well as to guide data submissions to the Digital Cost Calculator. The guidelines and definitions are organized according to some of the typical stages of a library project.  
+
===[https://docs.google.com/document/d/1xl6EsWSMHRd3m-7033o2oOLvU8STj0kVLD3XssezKMY/edit?usp=sharing 2018 Work]===
 +
The group’s initial goal for 2018 is to survey the community and conduct user interviews and user testing of the calculator. We plan to use the information captured from the community to help plan and prioritize our future work.
  
'''Processes for which the new calculator will provide data'''
+
===[https://docs.google.com/document/d/1j4reOVgVYTsOjMz3aRqP5TLH_nMOkRjMZKAoq1NCeQk/edit?usp=sharing 2017 Work]===
* Preparation of original materials
+
2017 focused on making improvements to the Calculator. We organized the second annual [https://www.diglib.org/aig-assessments-day-of-data-ii/ Day of Data II] in July to collect additional community data. We also added a number of [calculator enhancements  calculator enhancements], including the addition of new fields and new features.
**Condition review
 
**Disbinding
 
**Fastener removal
 
**Flattening
 
**Rights review
 
**Sorting materials into items
 
**Supporting
 
**Unique identifier assignment
 
* Image capture
 
**Film or transparency scanner
 
**Flatbed scanner
 
**Manual DSLR camera
 
**Medium format camera
 
**Overhead scanner
 
**Sheet feeding scanner
 
* Quality control
 
**Level 1, 2, and 3
 
* Descriptive metadata creation
 
**Level 1, 2, and 3
 
* Post-processing
 
**Alignment/rotation
 
**Background removal
 
**Clean up / dust removal
 
**Color correction and tonal adjustments
 
**Cropping images
 
**Stitching
 
* Post-preparation
 
**De-sorting
 
**Re-binding
 
**Re-fastening
 
  
In August 2015, the group produced [https://drive.google.com/drive/folders/0B4veUYJxzAmSfmpMSE1zVTIxYmtzb1pFeWtiZzNFREp3bFJaYW5rYkJTV1RGWGY4Mm05LWc wire frames] showing the planned interface and functionality of the Digitization Cost Calculator 2.0, as well as [https://drive.google.com/drive/folders/0B4veUYJxzAmSfmpMSE1zVTIxYmtzb1pFeWtiZzNFREp3bFJaYW5rYkJTV1RGWGY4Mm05LWc wireframes of how results would appear].  
+
===[https://docs.google.com/document/d/1eQg8VuX6zlJ4nyPrzhttRKEB1T0ApaZKvjF3aTTCaCk/edit?usp=sharing 2016 Work]===
 +
The data definitions authored by the cost assessment working group informed a modified structure of the calculator with expanded capabilities that was completed in 2016 with the assistance of Wayne Graham, Technical Director at CLIR and DLF. We needed at least one set of data in each of the 20 categories, as well as for each type of image capture device and for each level of metadata creation and quality control to support the modified structure. We gathered 85 data submissions in summer of 2016 with a Day of Data campaign, spent the fall reviewing and normalizing submissions, and released the 2.0 version of the calculator on November 7, 2016.
 +
 
 +
===[https://docs.google.com/a/ucsb.edu/document/d/1YZxppATnracRA9jMNJyxMTpbkXyT5SkPKcXgIWwlUPo/edit?usp=sharing 2015 Work]===
 +
In 2014  a beta version of a [http://statelibrarync.org/plstats/digitization_calculator.php Library Digitization Cost Calculator] was developed to assist organizations in estimating the costs for digitizing collections and initiate a conversation at the 2014 DLF Forum around cost assessment in digital libraries. The original Digitization Cost Calculator was built as a proof of concept and contains data from only a handful of institutions. In spring of 2014, the Cost Assessment working group of the DLF Assessment Interest Group was subsequently founded. This group was tasked with drafting [https://docs.google.com/document/d/17jTJmCzKsa83BMdlgKj239Shqcbglq7I4EfxJIWWDQo/edit best practices and guidelines for the collection of time data for various digitization processes], which are used to standardize collection of such data in the field as well as to guide data submissions to the Digital Cost Calculator. The guidelines and definitions are organized according to some of the typical stages of a library project.
 +
 
 +
In August 2015, the group produced [https://drive.google.com/open?id=0B4veUYJxzAmSUFFQYWNrS0hBLWc wire frames] showing the planned interface and functionality of the Digitization Cost Calculator 2.0, as well as [https://drive.google.com/a/ucsb.edu/file/d/0B4veUYJxzAmSN2FRaXJhdFRELTQ/view?usp=sharing wireframes of how results would appear].  
  
 
In September 2015, the group released a [https://docs.google.com/document/d/1s1bHzkB3SSyufaoZS0JZhbVQ1AZfRgUsZ0iOcKZ3Q0k/edit call for data submissions] using the new guidelines and a new [https://duke.qualtrics.com/SE/?SID=SV_3OtqSEAbpl2QDl3 data submission form].
 
In September 2015, the group released a [https://docs.google.com/document/d/1s1bHzkB3SSyufaoZS0JZhbVQ1AZfRgUsZ0iOcKZ3Q0k/edit call for data submissions] using the new guidelines and a new [https://duke.qualtrics.com/SE/?SID=SV_3OtqSEAbpl2QDl3 data submission form].
  
In 2016, the group solicited enough data contributions to build a functional digitization cost calculator 2.0. We needed at least one set of data in each of the 20 categories, as well as for each type of image capture device and for each level of metadata creation and quality control. In order to further this goal, we held a Day of Data campaign. We currently have the minimum necessary; the calculator will be vastly improved if we have more! Help us by [https://duke.qualtrics.com/SE/?SID=SV_3OtqSEAbpl2QDl3 submitting data here].
+
===Publication Information===
 
 
==Publication information==
 
 
*[https://docs.google.com/document/d/1yFWNWonZXHEFagI0A4ujeCl6U7SriJbfmqAgFGLA-Os/edit?usp=sharing Cost Assessment Bibliography]
 
*[https://docs.google.com/document/d/1yFWNWonZXHEFagI0A4ujeCl6U7SriJbfmqAgFGLA-Os/edit?usp=sharing Cost Assessment Bibliography]
 
*[https://docs.google.com/document/d/17jTJmCzKsa83BMdlgKj239Shqcbglq7I4EfxJIWWDQo/edit Best practices and guidelines for the collection of time data for digitization processes]
 
*[https://docs.google.com/document/d/17jTJmCzKsa83BMdlgKj239Shqcbglq7I4EfxJIWWDQo/edit Best practices and guidelines for the collection of time data for digitization processes]
  
==Get Involved==
+
==Project Team==
The Cost Assessment working group welcomes new members. Ongoing member duties include quarterly review of recent Cost Calculator data submissions. Those who would like to work on new projects or expansions of existing projects are welcome. If you are interested in helping us collect data for the Digitization Cost Calculator, please join our
+
===2020===
[https://groups.google.com/forum/#!forum/digital-library-assessment Digital Library Assessment Google Group] and speak up!
+
* Deirdre Joyce, Syracuse University (co-coordinator)
 +
* Shannon Willis, University of North Texas (co-coordinator)
 +
* Wayne Graham, CLIR (technical lead on Cost Calculator)
 +
* Christina M. Deane, University of Virginia
 +
* Laura Gentry, University of Alabama
 +
* Roel Munoz, Princeton University
 +
* Suzanne Preate, Syracuse University
 +
* Emily Weirich, University of Arizona
 +
* Lisa Wright, University of Rochester
 +
 
 +
===2019===
 +
* Chrissy Rissmeyer, University of California, Santa Barbara (co-coordinator)
 +
* Sarah Severson, University of Alberta Libraries, (co-coordinator)
 +
* Deirdre Joyce, Syracuse University (co-coordinator)
 +
* Wayne Graham, CLIR (technical lead on Cost Calculator)
 +
* David Bliss, University of Texas at Austin
 +
* Greg Davis, Iowa State University
 +
* Shannon Willis, University of North Texas Libraries
 +
* Gabriella Williams, University of Miami
 +
* Dan Zellner, Northwestern University
 +
 
 +
===2018===
 +
* Joyce Chapman, Duke University (co-coordinator)
 +
* Chrissy Rissmeyer, University of California, Santa Barbara (co-coordinator)
 +
* Wayne Graham, CLIR (technical lead on Cost Calculator)
 +
* David Bliss, University of Texas at Austin
 +
* Greg Davis, Iowa State University
 +
* Ann Hanlon, University of Wisconsin Milwaukee
 +
* Deirdre Joyce, Syracuse University
 +
* Sarah Severson, McGill University Library
 +
* Gabriella Williams, University of Miami
 +
* Dan Zellner, Northwestern University
 +
 
 +
===2017===
 +
* Joyce Chapman, Duke University (coordinator)
 +
* Wayne Graham, CLIR (technical lead on Cost Calculator)
 +
* Ann Hanlon, University of Wisconsin Milwaukee
 +
* Deirdre Joyce, Syracuse University
 +
* Genya O'Gara, VIVA
 +
* Chrissy Rissmeyer, University of California, Santa Barbara
 +
* Sarah Severson, McGill University Library
 +
* Dan Zellner, Northwestern University
  
===2015-2016 Members of the Cost Assessment Working Groups===
+
===2016===
 
* Joyce Chapman, Duke University, (coordinator)
 
* Joyce Chapman, Duke University, (coordinator)
 +
* Wayne Graham, CLIR (technical lead on Cost Calculator)
 
* Jane Davis, Saint Louis Federal Reserve Bank
 
* Jane Davis, Saint Louis Federal Reserve Bank
 
* Ann Hanlon, University of Wisconsin Milwaukee
 
* Ann Hanlon, University of Wisconsin Milwaukee
Line 67: Line 115:
 
* Dan Zellner, Northwestern University
 
* Dan Zellner, Northwestern University
  
===2014-2015 Members of the Cost Assessment Working Group===
+
===2015===
 
* Joyce Chapman, Duke University, (coordinator)
 
* Joyce Chapman, Duke University, (coordinator)
 
* Kinza Masood, University of Utah
 
* Kinza Masood, University of Utah
 
* Chrissy Rissmeyer, University of California, Santa Barbara
 
* Chrissy Rissmeyer, University of California, Santa Barbara
 
* Dan Zellner, Northwestern University
 
* Dan Zellner, Northwestern University
 
 
 
----
 
----
  
 
[http://wiki.diglib.org/Assessment Back to the Assessment home page]
 
[http://wiki.diglib.org/Assessment Back to the Assessment home page]

Latest revision as of 13:58, 12 October 2020

DLF Cost Working Group[edit]

The Cost group’s primary task has traditionally been to collect, aggregate, and share data on the time (and money) it takes to perform various tasks involved in the digitization process to help with project planning and benchmarking. When the group formed at the 2014 DLF Forum, we found few practical resources geared towards helping the community determine the cost of digitization. To help address this gap, we built a Digitization Cost Calculator Digitization Cost Calculator that allows individuals to enter information about a project and get back an estimate of the staffing costs and time needed to complete it based on real data from the community.

As we move into a new phase for the group, we seek to continue collecting the above information and look for new ways to share and use this information beyond the cost calculator, even as we continue to improve the data that informs the calculator tool. The Cost Working group is an ideal place for digital lab practitioners and managerial staff alike to come together to talk about practical ways to assess the resources necessary to plan and execute successful digitization projects.

Get Involved[edit]

Contribute Data[edit]

We are always looking for more data! Please click here for instructions on how to collect and contribute data to the Digitization Cost Calculator.

Working Group Membership[edit]

The Cost Assessment working group always welcomes new members. Members meet regularly to work on different projects. If you are interested in joining, please join our Digital Library AIG Cost Assessment google group and speak up!

Information on standing meetings in 2020 will be posted after February 21, 2020

Standing working meetings[edit]

2020 working meetings are held on the second Monday of each month (3/9, 4/13, 5/11, 6/8, 7/13, 8/10, 9/14, 10/12), at 3pm(eastern)/2pm(central)/1pm(mountain)/12pm(pacific)

See past meeting minutes at 2019 Agendas and Meeting Notes.

Meeting Connection Information:

Email DLF at info@diglib.org for call-in information.

Digitization Cost Calculator[edit]

The Cost Assessment Working Group's primary project has been to build and maintain the Digitization Cost Calculator. The source code for the calculator is available via the Calculator's GitHub repository. In 2020, we will be looking at the different possible outputs that move beyond the cost calculator, but with the same emphasis on helping practitioners and managers better estimate the costs of digital projects going forward.

2020 Work[edit]

In 2020, the DLF Cost group began to imagine different ways to assess costs. Much of the year has centered on discussions of how, in addition to the cost calculator, the group has discussed how it can facilitate access to useful tools to organizations who want to plan digitization projects.

2019 Work[edit]

2019 was a year of reflection and transition for the Costs Working Group. Members talked about the future directions of the group and how it would continue to proceed with the cost calculator.

2018 Work[edit]

The group’s initial goal for 2018 is to survey the community and conduct user interviews and user testing of the calculator. We plan to use the information captured from the community to help plan and prioritize our future work.

2017 Work[edit]

2017 focused on making improvements to the Calculator. We organized the second annual Day of Data II in July to collect additional community data. We also added a number of [calculator enhancements calculator enhancements], including the addition of new fields and new features.

2016 Work[edit]

The data definitions authored by the cost assessment working group informed a modified structure of the calculator with expanded capabilities that was completed in 2016 with the assistance of Wayne Graham, Technical Director at CLIR and DLF. We needed at least one set of data in each of the 20 categories, as well as for each type of image capture device and for each level of metadata creation and quality control to support the modified structure. We gathered 85 data submissions in summer of 2016 with a Day of Data campaign, spent the fall reviewing and normalizing submissions, and released the 2.0 version of the calculator on November 7, 2016.

2015 Work[edit]

In 2014 a beta version of a Library Digitization Cost Calculator was developed to assist organizations in estimating the costs for digitizing collections and initiate a conversation at the 2014 DLF Forum around cost assessment in digital libraries. The original Digitization Cost Calculator was built as a proof of concept and contains data from only a handful of institutions. In spring of 2014, the Cost Assessment working group of the DLF Assessment Interest Group was subsequently founded. This group was tasked with drafting best practices and guidelines for the collection of time data for various digitization processes, which are used to standardize collection of such data in the field as well as to guide data submissions to the Digital Cost Calculator. The guidelines and definitions are organized according to some of the typical stages of a library project.

In August 2015, the group produced wire frames showing the planned interface and functionality of the Digitization Cost Calculator 2.0, as well as wireframes of how results would appear.

In September 2015, the group released a call for data submissions using the new guidelines and a new data submission form.

Publication Information[edit]

Project Team[edit]

2020[edit]

  • Deirdre Joyce, Syracuse University (co-coordinator)
  • Shannon Willis, University of North Texas (co-coordinator)
  • Wayne Graham, CLIR (technical lead on Cost Calculator)
  • Christina M. Deane, University of Virginia
  • Laura Gentry, University of Alabama
  • Roel Munoz, Princeton University
  • Suzanne Preate, Syracuse University
  • Emily Weirich, University of Arizona
  • Lisa Wright, University of Rochester

2019[edit]

  • Chrissy Rissmeyer, University of California, Santa Barbara (co-coordinator)
  • Sarah Severson, University of Alberta Libraries, (co-coordinator)
  • Deirdre Joyce, Syracuse University (co-coordinator)
  • Wayne Graham, CLIR (technical lead on Cost Calculator)
  • David Bliss, University of Texas at Austin
  • Greg Davis, Iowa State University
  • Shannon Willis, University of North Texas Libraries
  • Gabriella Williams, University of Miami
  • Dan Zellner, Northwestern University

2018[edit]

  • Joyce Chapman, Duke University (co-coordinator)
  • Chrissy Rissmeyer, University of California, Santa Barbara (co-coordinator)
  • Wayne Graham, CLIR (technical lead on Cost Calculator)
  • David Bliss, University of Texas at Austin
  • Greg Davis, Iowa State University
  • Ann Hanlon, University of Wisconsin Milwaukee
  • Deirdre Joyce, Syracuse University
  • Sarah Severson, McGill University Library
  • Gabriella Williams, University of Miami
  • Dan Zellner, Northwestern University

2017[edit]

  • Joyce Chapman, Duke University (coordinator)
  • Wayne Graham, CLIR (technical lead on Cost Calculator)
  • Ann Hanlon, University of Wisconsin Milwaukee
  • Deirdre Joyce, Syracuse University
  • Genya O'Gara, VIVA
  • Chrissy Rissmeyer, University of California, Santa Barbara
  • Sarah Severson, McGill University Library
  • Dan Zellner, Northwestern University

2016[edit]

  • Joyce Chapman, Duke University, (coordinator)
  • Wayne Graham, CLIR (technical lead on Cost Calculator)
  • Jane Davis, Saint Louis Federal Reserve Bank
  • Ann Hanlon, University of Wisconsin Milwaukee
  • Kinza Masood, University of Utah
  • Genya O'Gara, VIVA
  • Chrissy Rissmeyer, University of California, Santa Barbara
  • Sarah Severson, McGill University Library
  • Emily Shaw, Ohio State University Libraries
  • Dan Zellner, Northwestern University

2015[edit]

  • Joyce Chapman, Duke University, (coordinator)
  • Kinza Masood, University of Utah
  • Chrissy Rissmeyer, University of California, Santa Barbara
  • Dan Zellner, Northwestern University

Back to the Assessment home page