Difference between revisions of "Assessment:Costs"

From DLF Wiki
Jump to: navigation, search
(updated 2017-2018 membership)
(34 intermediate revisions by 2 users not shown)
Line 1: Line 1:
''[[Data Collection and Contribution, Digitization Cost Calculator|Click here for instructions on collecting/contributing data to the Digitization Cost Calculator]]''
+
=DLF Cost Assessment Working Group=
 +
The Cost Assessment group’s primary task is to collect, aggregate, and share data on the time it takes to perform various tasks involved in the digitization process to help with project planning and benchmarking. When the group formed at the 2014 DLF Forum, we found few practical resources geared towards helping the community determine the cost of digitization. To help address this gap, we built a Digitization Cost Calculator [http://dashboard.diglib.org/ Digitization Cost Calculator] that allows individuals to enter information about a project and get back an estimate of the staffing costs and time needed to complete it based on real data from the community.
  
The Cost Assessment working group's tasks are to aggregate and make freely available a large set of data on the time it takes to perform various tasks involved in the digitization process, in order to assist organizations in digitization project planning and benchmarking. To that end, we are building a [http://dashboard.diglib.org/ Digitization Cost Calculator] that takes advantage of the contributed data set to provide digitization cost estimates based on various input parameters. Founded in 2014, the Cost Assessment working group of the DLF Assessment Interest Group was tasked with drafting [https://docs.google.com/document/d/17jTJmCzKsa83BMdlgKj239Shqcbglq7I4EfxJIWWDQo/edit best practices and guidelines for the collection of time data for various digitization processes], which are now in use, with the goal of standardizing collection of such data in the field as well as to guide data submissions to the Digitization Cost Calculator.  
+
==Get Involved==
 +
===Contribute Data===
 +
We are always looking for more data! [[Data Collection and Contribution, Digitization Cost Calculator|Please click here for instructions on how to collect and contribute data to the Digitization Cost Calculator.]]
 +
===Working Group Membership===
 +
The Cost Assessment working group always welcomes new members. Members meet regularly to work on different projects to improve the calculator and help collect more data for the Digitization Cost Calculator. If you are interested in joining, please join our 
 +
[https://groups.google.com/forum/#!forum/dlf-aig-cost-assessment Digital Library AIG Cost Assessment google group] and speak up! You're also welcome to drop into any of our standing meetings which are listed on the [https://digital-conferences-calendar.info/ DLF Community Calendar]
 +
 
 +
====Standing working meetings====
 +
'''2019''': 3rd/4th Monday at 3 pm Eastern / 2pm Central / 1pm Mountain / 12pm Pacific
 +
 
 +
Next meeting will be on '''January 28th'''. You can also go to our [https://docs.google.com/a/ucsb.edu/document/d/1TbUz5mThnxoJKDjCk_L2_p8SKEzye4OO7fnjVCrGjks/edit?usp=sharing 2019 Agendas and Meeting Notes] document to see what is coming up.
 +
 
 +
'''Connection Information:'''
 +
 
 +
    '''Zoom''': https://clirdlf.zoom.us/j/596153583
 +
    Or '''iPhone one-tap''' : US: +14087403766,,596153583#  or +16468769923,,596153583#
 +
    Or '''Telephone''' : Dial(for higher quality, dial a number based on your current location):
 +
    US: +1 408 740 3766  or +1 646 876 9923  or +1 669 900 6833 (International numbers available: https://zoom.us/u/duiWWdTRz
 +
    Meeting ID: 596 153 583
 +
 
 +
==Digitization Cost Calculator==
 +
The Cost Assessment Working Group's primary project has been to build and maintain the [http://dashboard.diglib.org/ Digitization Cost Calculator]. The source code for the calculator is available via the [https://github.com/clirdlf/digitization_cost_calculator Calculator's GitHub repository].
 +
 
 +
===[https://docs.google.com/document/d/1xl6EsWSMHRd3m-7033o2oOLvU8STj0kVLD3XssezKMY/edit?usp=sharing 2018 Work]===
 +
The group’s initial goal for 2018 is to survey the community and conduct user interviews and user testing of the calculator. We plan to use the information captured from the community to help plan and prioritize our future work.
  
==Current Projects==
+
===[https://docs.google.com/document/d/1j4reOVgVYTsOjMz3aRqP5TLH_nMOkRjMZKAoq1NCeQk/edit?usp=sharing 2017 Work]===
===Digitization Cost Calculator and associated data set===
+
2017 focused on making improvements to the Calculator. We organized the second annual [https://www.diglib.org/aig-assessments-day-of-data-ii/ Day of Data II] in July to collect additional community data. We also added a number of [calculator enhancements  calculator enhancements], including the addition of new fields and new features.
''Digitization Cost Calculator -- current status'': The data definitions authored by the cost assessment working group have now informed a modified structure of the calculator with expanded capabilities that we are completing in 2016 with the assistance of Wayne Graham, Technical Director at CLIR and DLF. We gathered 85 data submissions in summer of 2016 with a Day of Data campaign, spent the fall reviewing and normalizing submissions, and are now close to having a new version of the calculator complete. [https://dashboard.diglib.org/ The new Digitization Cost Calculator will be available here] on November 7th 2016.
 
  
''Digitization Cost Calculator -- what's been completed'': In 2014 the Cost Assessment working group developed a beta version of a [http://statelibrarync.org/plstats/digitization_calculator.php Library Digitization Cost Calculator] to assist organizations in estimating the costs for digitizing collections and initiate a conversation at the 2014 DLF Forum around cost assessment in digital libraries. The original Digitization Cost Calculator was built as a proof of concept and contains data from only a handful of institutions. In spring of 2014, the Cost Assessment working group of the DLF Assessment Interest Group was subsequently founded. This group was tasked with drafting [https://docs.google.com/document/d/17jTJmCzKsa83BMdlgKj239Shqcbglq7I4EfxJIWWDQo/edit best practices and guidelines for the collection of time data for various digitization processes], which are used to standardize collection of such data in the field as well as to guide data submissions to the Digital Cost Calculator. The guidelines and definitions are organized according to some of the typical stages of a library project.  
+
===[https://docs.google.com/document/d/1eQg8VuX6zlJ4nyPrzhttRKEB1T0ApaZKvjF3aTTCaCk/edit?usp=sharing 2016 Work]===
 +
The data definitions authored by the cost assessment working group informed a modified structure of the calculator with expanded capabilities that was completed in 2016 with the assistance of Wayne Graham, Technical Director at CLIR and DLF. We needed at least one set of data in each of the 20 categories, as well as for each type of image capture device and for each level of metadata creation and quality control to support the modified structure. We gathered 85 data submissions in summer of 2016 with a Day of Data campaign, spent the fall reviewing and normalizing submissions, and released the 2.0 version of the calculator on November 7, 2016.
  
'''Processes for which the new calculator will provide data'''
+
===[https://docs.google.com/a/ucsb.edu/document/d/1YZxppATnracRA9jMNJyxMTpbkXyT5SkPKcXgIWwlUPo/edit?usp=sharing 2015 Work]===
* Preparation of original materials
+
In 2014  a beta version of a [http://statelibrarync.org/plstats/digitization_calculator.php Library Digitization Cost Calculator] was developed to assist organizations in estimating the costs for digitizing collections and initiate a conversation at the 2014 DLF Forum around cost assessment in digital libraries. The original Digitization Cost Calculator was built as a proof of concept and contains data from only a handful of institutions. In spring of 2014, the Cost Assessment working group of the DLF Assessment Interest Group was subsequently founded. This group was tasked with drafting [https://docs.google.com/document/d/17jTJmCzKsa83BMdlgKj239Shqcbglq7I4EfxJIWWDQo/edit best practices and guidelines for the collection of time data for various digitization processes], which are used to standardize collection of such data in the field as well as to guide data submissions to the Digital Cost Calculator. The guidelines and definitions are organized according to some of the typical stages of a library project.
**Condition review
 
**Disbinding
 
**Fastener removal
 
**Flattening
 
**Rights review
 
**Sorting materials into items
 
**Supporting
 
**Unique identifier assignment
 
* Image capture
 
**Film or transparency scanner
 
**Flatbed scanner
 
**Manual DSLR camera
 
**Medium format camera
 
**Overhead scanner
 
**Sheet feeding scanner
 
* Quality control
 
**Level 1, 2, and 3
 
* Descriptive metadata creation
 
**Level 1, 2, and 3
 
* Post-processing
 
**Alignment/rotation
 
**Background removal
 
**Clean up / dust removal
 
**Color correction and tonal adjustments
 
**Cropping images
 
**Stitching
 
* Post-preparation
 
**De-sorting
 
**Re-binding
 
**Re-fastening
 
  
In August 2015, the group produced [https://drive.google.com/drive/folders/0B4veUYJxzAmSfmpMSE1zVTIxYmtzb1pFeWtiZzNFREp3bFJaYW5rYkJTV1RGWGY4Mm05LWc wire frames] showing the planned interface and functionality of the Digitization Cost Calculator 2.0, as well as [https://drive.google.com/drive/folders/0B4veUYJxzAmSfmpMSE1zVTIxYmtzb1pFeWtiZzNFREp3bFJaYW5rYkJTV1RGWGY4Mm05LWc wireframes of how results would appear].  
+
In August 2015, the group produced [https://drive.google.com/open?id=0B4veUYJxzAmSUFFQYWNrS0hBLWc wire frames] showing the planned interface and functionality of the Digitization Cost Calculator 2.0, as well as [https://drive.google.com/a/ucsb.edu/file/d/0B4veUYJxzAmSN2FRaXJhdFRELTQ/view?usp=sharing wireframes of how results would appear].  
  
 
In September 2015, the group released a [https://docs.google.com/document/d/1s1bHzkB3SSyufaoZS0JZhbVQ1AZfRgUsZ0iOcKZ3Q0k/edit call for data submissions] using the new guidelines and a new [https://duke.qualtrics.com/SE/?SID=SV_3OtqSEAbpl2QDl3 data submission form].
 
In September 2015, the group released a [https://docs.google.com/document/d/1s1bHzkB3SSyufaoZS0JZhbVQ1AZfRgUsZ0iOcKZ3Q0k/edit call for data submissions] using the new guidelines and a new [https://duke.qualtrics.com/SE/?SID=SV_3OtqSEAbpl2QDl3 data submission form].
 
In 2016, the group solicited enough data contributions to build a functional digitization cost calculator 2.0. We needed at least one set of data in each of the 20 categories, as well as for each type of image capture device and for each level of metadata creation and quality control. In order to further this goal, we held a Day of Data campaign. We currently have the minimum necessary; the calculator will be vastly improved if we have more! Help us by [https://duke.qualtrics.com/SE/?SID=SV_3OtqSEAbpl2QDl3 submitting data here].
 
  
 
===Publication Information===
 
===Publication Information===
Line 52: Line 45:
 
*[https://docs.google.com/document/d/17jTJmCzKsa83BMdlgKj239Shqcbglq7I4EfxJIWWDQo/edit Best practices and guidelines for the collection of time data for digitization processes]
 
*[https://docs.google.com/document/d/17jTJmCzKsa83BMdlgKj239Shqcbglq7I4EfxJIWWDQo/edit Best practices and guidelines for the collection of time data for digitization processes]
  
==Get Involved==
+
==Project Team==
The Cost Assessment working group welcomes new members. Ongoing member duties include quarterly review of recent Cost Calculator data submissions. Those who would like to work on new projects or expansions of existing projects are welcome. If you are interested in helping us collect data for the Digitization Cost Calculator, please join our
+
===2019===
[https://groups.google.com/forum/#!forum/digital-library-assessment Digital Library Assessment Google Group] and speak up!
+
* Chrissy Rissmeyer, University of California, Santa Barbara (co-coordinator)
 +
* Sarah Severson, McGill University Library, (co-coordinator)
 +
* Wayne Graham, CLIR (technical lead on Cost Calculator)
 +
* David Bliss, University of Texas at Austin
 +
* Greg Davis, Iowa State University
 +
* Deirdre Joyce, Syracuse University
 +
* Shannon Willis, University of North Texas Libraries
 +
* Gabriella Williams, University of Miami
 +
* Dan Zellner, Northwestern University
  
===2016-2017 Membership===
+
===2018===
 
* Joyce Chapman, Duke University (co-coordinator)
 
* Joyce Chapman, Duke University (co-coordinator)
 
* Chrissy Rissmeyer, University of California, Santa Barbara (co-coordinator)
 
* Chrissy Rissmeyer, University of California, Santa Barbara (co-coordinator)
 
* Wayne Graham, CLIR (technical lead on Cost Calculator)
 
* Wayne Graham, CLIR (technical lead on Cost Calculator)
 
* David Bliss, University of Texas at Austin
 
* David Bliss, University of Texas at Austin
 +
* Greg Davis, Iowa State University
 
* Ann Hanlon, University of Wisconsin Milwaukee
 
* Ann Hanlon, University of Wisconsin Milwaukee
 
* Deirdre Joyce, Syracuse University
 
* Deirdre Joyce, Syracuse University
Line 67: Line 69:
 
* Dan Zellner, Northwestern University
 
* Dan Zellner, Northwestern University
  
===2016-2017 Membership===
+
===2017===
 
* Joyce Chapman, Duke University (coordinator)
 
* Joyce Chapman, Duke University (coordinator)
 
* Wayne Graham, CLIR (technical lead on Cost Calculator)
 
* Wayne Graham, CLIR (technical lead on Cost Calculator)
Line 77: Line 79:
 
* Dan Zellner, Northwestern University
 
* Dan Zellner, Northwestern University
  
===2015-2016 Membership===
+
===2016===
 
* Joyce Chapman, Duke University, (coordinator)
 
* Joyce Chapman, Duke University, (coordinator)
 
* Wayne Graham, CLIR (technical lead on Cost Calculator)
 
* Wayne Graham, CLIR (technical lead on Cost Calculator)
Line 89: Line 91:
 
* Dan Zellner, Northwestern University
 
* Dan Zellner, Northwestern University
  
===2014-2015 Membership===
+
===2015===
 
* Joyce Chapman, Duke University, (coordinator)
 
* Joyce Chapman, Duke University, (coordinator)
 
* Kinza Masood, University of Utah
 
* Kinza Masood, University of Utah

Revision as of 18:57, 15 January 2019

DLF Cost Assessment Working Group

The Cost Assessment group’s primary task is to collect, aggregate, and share data on the time it takes to perform various tasks involved in the digitization process to help with project planning and benchmarking. When the group formed at the 2014 DLF Forum, we found few practical resources geared towards helping the community determine the cost of digitization. To help address this gap, we built a Digitization Cost Calculator Digitization Cost Calculator that allows individuals to enter information about a project and get back an estimate of the staffing costs and time needed to complete it based on real data from the community.

Get Involved

Contribute Data

We are always looking for more data! Please click here for instructions on how to collect and contribute data to the Digitization Cost Calculator.

Working Group Membership

The Cost Assessment working group always welcomes new members. Members meet regularly to work on different projects to improve the calculator and help collect more data for the Digitization Cost Calculator. If you are interested in joining, please join our Digital Library AIG Cost Assessment google group and speak up! You're also welcome to drop into any of our standing meetings which are listed on the DLF Community Calendar

Standing working meetings

2019: 3rd/4th Monday at 3 pm Eastern / 2pm Central / 1pm Mountain / 12pm Pacific

Next meeting will be on January 28th. You can also go to our 2019 Agendas and Meeting Notes document to see what is coming up.

Connection Information:

   Zoom: https://clirdlf.zoom.us/j/596153583
   Or iPhone one-tap : US: +14087403766,,596153583#  or +16468769923,,596153583# 
   Or Telephone : Dial(for higher quality, dial a number based on your current location): 
   US: +1 408 740 3766  or +1 646 876 9923  or +1 669 900 6833 (International numbers available: https://zoom.us/u/duiWWdTRz
   Meeting ID: 596 153 583

Digitization Cost Calculator

The Cost Assessment Working Group's primary project has been to build and maintain the Digitization Cost Calculator. The source code for the calculator is available via the Calculator's GitHub repository.

2018 Work

The group’s initial goal for 2018 is to survey the community and conduct user interviews and user testing of the calculator. We plan to use the information captured from the community to help plan and prioritize our future work.

2017 Work

2017 focused on making improvements to the Calculator. We organized the second annual Day of Data II in July to collect additional community data. We also added a number of [calculator enhancements calculator enhancements], including the addition of new fields and new features.

2016 Work

The data definitions authored by the cost assessment working group informed a modified structure of the calculator with expanded capabilities that was completed in 2016 with the assistance of Wayne Graham, Technical Director at CLIR and DLF. We needed at least one set of data in each of the 20 categories, as well as for each type of image capture device and for each level of metadata creation and quality control to support the modified structure. We gathered 85 data submissions in summer of 2016 with a Day of Data campaign, spent the fall reviewing and normalizing submissions, and released the 2.0 version of the calculator on November 7, 2016.

2015 Work

In 2014 a beta version of a Library Digitization Cost Calculator was developed to assist organizations in estimating the costs for digitizing collections and initiate a conversation at the 2014 DLF Forum around cost assessment in digital libraries. The original Digitization Cost Calculator was built as a proof of concept and contains data from only a handful of institutions. In spring of 2014, the Cost Assessment working group of the DLF Assessment Interest Group was subsequently founded. This group was tasked with drafting best practices and guidelines for the collection of time data for various digitization processes, which are used to standardize collection of such data in the field as well as to guide data submissions to the Digital Cost Calculator. The guidelines and definitions are organized according to some of the typical stages of a library project.

In August 2015, the group produced wire frames showing the planned interface and functionality of the Digitization Cost Calculator 2.0, as well as wireframes of how results would appear.

In September 2015, the group released a call for data submissions using the new guidelines and a new data submission form.

Publication Information

Project Team

2019

  • Chrissy Rissmeyer, University of California, Santa Barbara (co-coordinator)
  • Sarah Severson, McGill University Library, (co-coordinator)
  • Wayne Graham, CLIR (technical lead on Cost Calculator)
  • David Bliss, University of Texas at Austin
  • Greg Davis, Iowa State University
  • Deirdre Joyce, Syracuse University
  • Shannon Willis, University of North Texas Libraries
  • Gabriella Williams, University of Miami
  • Dan Zellner, Northwestern University

2018

  • Joyce Chapman, Duke University (co-coordinator)
  • Chrissy Rissmeyer, University of California, Santa Barbara (co-coordinator)
  • Wayne Graham, CLIR (technical lead on Cost Calculator)
  • David Bliss, University of Texas at Austin
  • Greg Davis, Iowa State University
  • Ann Hanlon, University of Wisconsin Milwaukee
  • Deirdre Joyce, Syracuse University
  • Sarah Severson, McGill University Library
  • Gabriella Williams, University of Miami
  • Dan Zellner, Northwestern University

2017

  • Joyce Chapman, Duke University (coordinator)
  • Wayne Graham, CLIR (technical lead on Cost Calculator)
  • Ann Hanlon, University of Wisconsin Milwaukee
  • Deirdre Joyce, Syracuse University
  • Genya O'Gara, VIVA
  • Chrissy Rissmeyer, University of California, Santa Barbara
  • Sarah Severson, McGill University Library
  • Dan Zellner, Northwestern University

2016

  • Joyce Chapman, Duke University, (coordinator)
  • Wayne Graham, CLIR (technical lead on Cost Calculator)
  • Jane Davis, Saint Louis Federal Reserve Bank
  • Ann Hanlon, University of Wisconsin Milwaukee
  • Kinza Masood, University of Utah
  • Genya O'Gara, VIVA
  • Chrissy Rissmeyer, University of California, Santa Barbara
  • Sarah Severson, McGill University Library
  • Emily Shaw, Ohio State University Libraries
  • Dan Zellner, Northwestern University

2015

  • Joyce Chapman, Duke University, (coordinator)
  • Kinza Masood, University of Utah
  • Chrissy Rissmeyer, University of California, Santa Barbara
  • Dan Zellner, Northwestern University

Back to the Assessment home page