Difference between revisions of "Assessment:Costs"

From DLF Wiki
Jump to navigation Jump to search
 
(36 intermediate revisions by 5 users not shown)
Line 1: Line 1:
=DLF Cost Assessment Working Group=  
+
=DLF Cost Working Group=  
The Cost Assessment group’s primary task is to collect, aggregate, and share data on the time it takes to perform various tasks involved in the digitization process to help with project planning and benchmarking. When the group formed in 2014, we found few practical resources geared towards helping the community determine the cost of digitization. To help address this gap, we built a Digitization Cost Calculator [http://dashboard.diglib.org/ Digitization Cost Calculator] that allows individuals to enter information about a project and get back an estimate of the staffing costs and time needed to complete it based on real data from the community.
+
The Cost group’s primary task has traditionally been to collect, aggregate, and share data on the time (and money) it takes to perform various tasks involved in the digitization process to help with project planning and benchmarking. When the group formed at the 2014 DLF Forum, we found few practical resources geared towards helping the community determine the cost of digitization. To help address this gap, we built a Digitization Cost Calculator [http://dashboard.diglib.org/ Digitization Cost Calculator] that allows individuals to enter information about a project and get back an estimate of the staffing costs and time needed to complete it based on real data from the community.
 +
 
 +
As we move into a new phase for the group, we seek to continue collecting the above information and look for new ways to share and use this information beyond the cost calculator, even as we continue to improve the data that informs the calculator tool. The Cost Working group is an ideal place for digital lab practitioners and managerial staff alike to come together to talk about practical ways to assess the resources necessary to plan and execute successful digitization projects.
  
 
==Get Involved==
 
==Get Involved==
 
===Contribute Data===
 
===Contribute Data===
 
We are always looking for more data! [[Data Collection and Contribution, Digitization Cost Calculator|Please click here for instructions on how to collect and contribute data to the Digitization Cost Calculator.]]
 
We are always looking for more data! [[Data Collection and Contribution, Digitization Cost Calculator|Please click here for instructions on how to collect and contribute data to the Digitization Cost Calculator.]]
===Membership===
 
The Cost Assessment working group welcomes new members. Ongoing member duties include quarterly review of recent Cost Calculator data submissions. Those who would like to work on new projects or expansions of existing projects are welcome. If you are interested in helping us collect data for the Digitization Cost Calculator, please join our
 
[https://groups.google.com/forum/#!forum/digital-library-assessment Digital Library Assessment Google Group] and speak up!
 
  
====Meeting Schedule====
+
===Working Group Membership===
The 2018 Kickoff Meeting is scheduled for '''Tuesday, February 6 from 1-2pm (Pacific) / 4-5pm (Eastern) via Zoom'''. A regular monthly meeting time for 2018 will be identified following that meeting.
+
The Cost Assessment working group always welcomes new members. Members meet regularly to work on different projects. If you are interested in joining, please join our 
 +
[https://groups.google.com/forum/#!forum/dlf-aig-cost-assessment Digital Library AIG Cost Assessment google group] and speak up!
 +
 
 +
Information on standing meetings in 2020 will be posted after February 21, 2020
 +
 
 +
====Standing working meetings====
 +
2020 working meetings are held on the '''second Monday''' of each month (3/9, 4/13, 5/11, 6/8, 7/13, 8/10, 9/14, 10/12), at '''3pm'''(eastern)/'''2pm'''(central)/'''1pm'''(mountain)/'''12pm'''(pacific)
  
Join from PC, Mac, Linux, iOS or Android: https://ucsb.zoom.us/j/361483389
+
See past meeting minutes at [https://docs.google.com/a/ucsb.edu/document/d/1TbUz5mThnxoJKDjCk_L2_p8SKEzye4OO7fnjVCrGjks/edit?usp=sharing 2019 Agendas and Meeting Notes].
  
Or iPhone one-tap :
+
'''Meeting Connection Information:'''
    US: +14086380968,,361483389#  or +16468769923,,361483389#
 
Or Telephone:
 
    Dial(for higher quality, dial a number based on your current location):
 
        US: +1 408 638 0968  or +1 646 876 9923  or +1 669 900 6833
 
    Meeting ID: 361 483 389
 
    International numbers available: https://ucsb.zoom.us/zoomconference?m=oGs_lAVDNwmiDni42ImVcafH1W-lxAo5
 
  
Or an H.323/SIP room system:
+
Email DLF at info@diglib.org for call-in information.
    H.323:  
+
<!--    '''Zoom''': https://clirdlf.zoom.us/j/486656289
        162.255.37.11 (US West)
+
    Or '''iPhone one-tap''' : US: +16468769923,,486656289# (New York) or +16699006833,,486656289# (San Jose)
        162.255.36.11 (US East)
+
    Or '''Telephone''' : Dial(for higher quality, dial a number based on your current location):
        221.122.88.195 (China)
+
    US: +1 646 876 9923 (New York) or +1 669 900 6833 (San Jose) or +1 408 638 0968 (San Jose)
        115.114.131.7 (India)
+
    Find your local number: https://clirdlf.zoom.us/u/aojCpLuLf
        213.19.144.110 (EMEA)
+
     Meeting ID: 486 656 289-->
        202.177.207.158 (Australia)
 
        209.9.211.110 (Hong Kong)
 
        64.211.144.160 (Brazil)
 
        69.174.57.160 (Canada)
 
     Meeting ID: 361 483 389
 
  
    SIP: 361483389@zoomcrc.com
+
==Digitization Cost Calculator==
 +
The Cost Assessment Working Group's primary project has been to build and maintain the [http://dashboard.diglib.org/ Digitization Cost Calculator]. The source code for the calculator is available via the [https://github.com/clirdlf/digitization_cost_calculator Calculator's GitHub repository]. In 2020, we will be looking at the different possible outputs that move beyond the cost calculator, but with the same emphasis on helping practitioners and managers better estimate the costs of digital projects going forward.
  
==Current Projects==
+
===[https://docs.google.com/document/d/1bDRyFF7SLxR5rcMqpFy7WYAdAogRFNX0hiSiD7S8YYc/edit 2020 Work]===
===Digitization Cost Calculator and associated data set===
+
In 2020, the DLF Cost group began to imagine different ways to assess costs. Much of the year has centered on discussions of how, in addition to the cost calculator, the group has discussed how it can facilitate access to useful tools to organizations who want to plan digitization projects.
''[[Data Collection and Contribution, Digitization Cost Calculator|Click here for instructions on collecting/contributing data to the Digitization Cost Calculator]]''
 
  
''Digitization Cost Calculator -- current status'': The data definitions authored by the cost assessment working group have now informed a modified structure of the calculator with expanded capabilities that we are completing in 2016 with the assistance of Wayne Graham, Technical Director at CLIR and DLF. We gathered 85 data submissions in summer of 2016 with a Day of Data campaign, spent the fall reviewing and normalizing submissions, and are now close to having a new version of the calculator complete. [https://dashboard.diglib.org/ The new Digitization Cost Calculator will be available here] on November 7th 2016.
+
===[https://docs.google.com/document/d/1TbUz5mThnxoJKDjCk_L2_p8SKEzye4OO7fnjVCrGjks/edit 2019 Work]===
 +
2019 was a year of reflection and transition for the Costs Working Group. Members talked about the future directions of the group and how it would continue to proceed with the cost calculator.
  
''Digitization Cost Calculator -- what's been completed'': In 2014 the Cost Assessment working group developed a beta version of a [http://statelibrarync.org/plstats/digitization_calculator.php Library Digitization Cost Calculator] to assist organizations in estimating the costs for digitizing collections and initiate a conversation at the 2014 DLF Forum around cost assessment in digital libraries. The original Digitization Cost Calculator was built as a proof of concept and contains data from only a handful of institutions. In spring of 2014, the Cost Assessment working group of the DLF Assessment Interest Group was subsequently founded. This group was tasked with drafting [https://docs.google.com/document/d/17jTJmCzKsa83BMdlgKj239Shqcbglq7I4EfxJIWWDQo/edit best practices and guidelines for the collection of time data for various digitization processes], which are used to standardize collection of such data in the field as well as to guide data submissions to the Digital Cost Calculator. The guidelines and definitions are organized according to some of the typical stages of a library project.  
+
===[https://docs.google.com/document/d/1xl6EsWSMHRd3m-7033o2oOLvU8STj0kVLD3XssezKMY/edit?usp=sharing 2018 Work]===
 +
The group’s initial goal for 2018 is to survey the community and conduct user interviews and user testing of the calculator. We plan to use the information captured from the community to help plan and prioritize our future work.
  
'''Processes for which the new calculator will provide data'''
+
===[https://docs.google.com/document/d/1j4reOVgVYTsOjMz3aRqP5TLH_nMOkRjMZKAoq1NCeQk/edit?usp=sharing 2017 Work]===
* Preparation of original materials
+
2017 focused on making improvements to the Calculator. We organized the second annual [https://www.diglib.org/aig-assessments-day-of-data-ii/ Day of Data II] in July to collect additional community data. We also added a number of [calculator enhancements  calculator enhancements], including the addition of new fields and new features.
**Condition review
 
**Disbinding
 
**Fastener removal
 
**Flattening
 
**Rights review
 
**Sorting materials into items
 
**Supporting
 
**Unique identifier assignment
 
* Image capture
 
**Film or transparency scanner
 
**Flatbed scanner
 
**Manual DSLR camera
 
**Medium format camera
 
**Overhead scanner
 
**Sheet feeding scanner
 
* Quality control
 
**Level 1, 2, and 3
 
* Descriptive metadata creation
 
**Level 1, 2, and 3
 
* Post-processing
 
**Alignment/rotation
 
**Background removal
 
**Clean up / dust removal
 
**Color correction and tonal adjustments
 
**Cropping images
 
**Stitching
 
* Post-preparation
 
**De-sorting
 
**Re-binding
 
**Re-fastening
 
  
In August 2015, the group produced [https://drive.google.com/drive/folders/0B4veUYJxzAmSfmpMSE1zVTIxYmtzb1pFeWtiZzNFREp3bFJaYW5rYkJTV1RGWGY4Mm05LWc wire frames] showing the planned interface and functionality of the Digitization Cost Calculator 2.0, as well as [https://drive.google.com/drive/folders/0B4veUYJxzAmSfmpMSE1zVTIxYmtzb1pFeWtiZzNFREp3bFJaYW5rYkJTV1RGWGY4Mm05LWc wireframes of how results would appear].  
+
===[https://docs.google.com/document/d/1eQg8VuX6zlJ4nyPrzhttRKEB1T0ApaZKvjF3aTTCaCk/edit?usp=sharing 2016 Work]===
 +
The data definitions authored by the cost assessment working group informed a modified structure of the calculator with expanded capabilities that was completed in 2016 with the assistance of Wayne Graham, Technical Director at CLIR and DLF. We needed at least one set of data in each of the 20 categories, as well as for each type of image capture device and for each level of metadata creation and quality control to support the modified structure. We gathered 85 data submissions in summer of 2016 with a Day of Data campaign, spent the fall reviewing and normalizing submissions, and released the 2.0 version of the calculator on November 7, 2016.
 +
 
 +
===[https://docs.google.com/a/ucsb.edu/document/d/1YZxppATnracRA9jMNJyxMTpbkXyT5SkPKcXgIWwlUPo/edit?usp=sharing 2015 Work]===
 +
In 2014  a beta version of a [http://statelibrarync.org/plstats/digitization_calculator.php Library Digitization Cost Calculator] was developed to assist organizations in estimating the costs for digitizing collections and initiate a conversation at the 2014 DLF Forum around cost assessment in digital libraries. The original Digitization Cost Calculator was built as a proof of concept and contains data from only a handful of institutions. In spring of 2014, the Cost Assessment working group of the DLF Assessment Interest Group was subsequently founded. This group was tasked with drafting [https://docs.google.com/document/d/17jTJmCzKsa83BMdlgKj239Shqcbglq7I4EfxJIWWDQo/edit best practices and guidelines for the collection of time data for various digitization processes], which are used to standardize collection of such data in the field as well as to guide data submissions to the Digital Cost Calculator. The guidelines and definitions are organized according to some of the typical stages of a library project.
 +
 
 +
In August 2015, the group produced [https://drive.google.com/open?id=0B4veUYJxzAmSUFFQYWNrS0hBLWc wire frames] showing the planned interface and functionality of the Digitization Cost Calculator 2.0, as well as [https://drive.google.com/a/ucsb.edu/file/d/0B4veUYJxzAmSN2FRaXJhdFRELTQ/view?usp=sharing wireframes of how results would appear].  
  
 
In September 2015, the group released a [https://docs.google.com/document/d/1s1bHzkB3SSyufaoZS0JZhbVQ1AZfRgUsZ0iOcKZ3Q0k/edit call for data submissions] using the new guidelines and a new [https://duke.qualtrics.com/SE/?SID=SV_3OtqSEAbpl2QDl3 data submission form].
 
In September 2015, the group released a [https://docs.google.com/document/d/1s1bHzkB3SSyufaoZS0JZhbVQ1AZfRgUsZ0iOcKZ3Q0k/edit call for data submissions] using the new guidelines and a new [https://duke.qualtrics.com/SE/?SID=SV_3OtqSEAbpl2QDl3 data submission form].
 
In 2016, the group solicited enough data contributions to build a functional digitization cost calculator 2.0. We needed at least one set of data in each of the 20 categories, as well as for each type of image capture device and for each level of metadata creation and quality control. In order to further this goal, we held a Day of Data campaign. We currently have the minimum necessary; the calculator will be vastly improved if we have more! Help us by [https://duke.qualtrics.com/SE/?SID=SV_3OtqSEAbpl2QDl3 submitting data here].
 
  
 
===Publication Information===
 
===Publication Information===
Line 88: Line 58:
 
*[https://docs.google.com/document/d/17jTJmCzKsa83BMdlgKj239Shqcbglq7I4EfxJIWWDQo/edit Best practices and guidelines for the collection of time data for digitization processes]
 
*[https://docs.google.com/document/d/17jTJmCzKsa83BMdlgKj239Shqcbglq7I4EfxJIWWDQo/edit Best practices and guidelines for the collection of time data for digitization processes]
  
==Membership Rosters==
+
==Project Team==
 +
===2020===
 +
* Deirdre Joyce, Syracuse University (co-coordinator)
 +
* Shannon Willis, University of North Texas (co-coordinator)
 +
* Wayne Graham, CLIR (technical lead on Cost Calculator)
 +
* Christina M. Deane, University of Virginia
 +
* Laura Gentry, University of Alabama
 +
* Roel Munoz, Princeton University
 +
* Suzanne Preate, Syracuse University
 +
* Emily Weirich, University of Arizona
 +
* Lisa Wright, University of Rochester
 +
 
 +
===2019===
 +
* Chrissy Rissmeyer, University of California, Santa Barbara (co-coordinator)
 +
* Sarah Severson, University of Alberta Libraries, (co-coordinator)
 +
* Deirdre Joyce, Syracuse University (co-coordinator)
 +
* Wayne Graham, CLIR (technical lead on Cost Calculator)
 +
* David Bliss, University of Texas at Austin
 +
* Greg Davis, Iowa State University
 +
* Shannon Willis, University of North Texas Libraries
 +
* Gabriella Williams, University of Miami
 +
* Dan Zellner, Northwestern University
  
===2016-2017 Membership===
+
===2018===
 
* Joyce Chapman, Duke University (co-coordinator)
 
* Joyce Chapman, Duke University (co-coordinator)
 
* Chrissy Rissmeyer, University of California, Santa Barbara (co-coordinator)
 
* Chrissy Rissmeyer, University of California, Santa Barbara (co-coordinator)
 
* Wayne Graham, CLIR (technical lead on Cost Calculator)
 
* Wayne Graham, CLIR (technical lead on Cost Calculator)
 
* David Bliss, University of Texas at Austin
 
* David Bliss, University of Texas at Austin
 +
* Greg Davis, Iowa State University
 
* Ann Hanlon, University of Wisconsin Milwaukee
 
* Ann Hanlon, University of Wisconsin Milwaukee
 
* Deirdre Joyce, Syracuse University
 
* Deirdre Joyce, Syracuse University
Line 101: Line 93:
 
* Dan Zellner, Northwestern University
 
* Dan Zellner, Northwestern University
  
===2016-2017 Membership===
+
===2017===
 
* Joyce Chapman, Duke University (coordinator)
 
* Joyce Chapman, Duke University (coordinator)
 
* Wayne Graham, CLIR (technical lead on Cost Calculator)
 
* Wayne Graham, CLIR (technical lead on Cost Calculator)
Line 111: Line 103:
 
* Dan Zellner, Northwestern University
 
* Dan Zellner, Northwestern University
  
===2015-2016 Membership===
+
===2016===
 
* Joyce Chapman, Duke University, (coordinator)
 
* Joyce Chapman, Duke University, (coordinator)
 
* Wayne Graham, CLIR (technical lead on Cost Calculator)
 
* Wayne Graham, CLIR (technical lead on Cost Calculator)
Line 123: Line 115:
 
* Dan Zellner, Northwestern University
 
* Dan Zellner, Northwestern University
  
===2014-2015 Membership===
+
===2015===
 
* Joyce Chapman, Duke University, (coordinator)
 
* Joyce Chapman, Duke University, (coordinator)
 
* Kinza Masood, University of Utah
 
* Kinza Masood, University of Utah

Latest revision as of 14:58, 12 October 2020

DLF Cost Working Group[edit]

The Cost group’s primary task has traditionally been to collect, aggregate, and share data on the time (and money) it takes to perform various tasks involved in the digitization process to help with project planning and benchmarking. When the group formed at the 2014 DLF Forum, we found few practical resources geared towards helping the community determine the cost of digitization. To help address this gap, we built a Digitization Cost Calculator Digitization Cost Calculator that allows individuals to enter information about a project and get back an estimate of the staffing costs and time needed to complete it based on real data from the community.

As we move into a new phase for the group, we seek to continue collecting the above information and look for new ways to share and use this information beyond the cost calculator, even as we continue to improve the data that informs the calculator tool. The Cost Working group is an ideal place for digital lab practitioners and managerial staff alike to come together to talk about practical ways to assess the resources necessary to plan and execute successful digitization projects.

Get Involved[edit]

Contribute Data[edit]

We are always looking for more data! Please click here for instructions on how to collect and contribute data to the Digitization Cost Calculator.

Working Group Membership[edit]

The Cost Assessment working group always welcomes new members. Members meet regularly to work on different projects. If you are interested in joining, please join our Digital Library AIG Cost Assessment google group and speak up!

Information on standing meetings in 2020 will be posted after February 21, 2020

Standing working meetings[edit]

2020 working meetings are held on the second Monday of each month (3/9, 4/13, 5/11, 6/8, 7/13, 8/10, 9/14, 10/12), at 3pm(eastern)/2pm(central)/1pm(mountain)/12pm(pacific)

See past meeting minutes at 2019 Agendas and Meeting Notes.

Meeting Connection Information:

Email DLF at info@diglib.org for call-in information.

Digitization Cost Calculator[edit]

The Cost Assessment Working Group's primary project has been to build and maintain the Digitization Cost Calculator. The source code for the calculator is available via the Calculator's GitHub repository. In 2020, we will be looking at the different possible outputs that move beyond the cost calculator, but with the same emphasis on helping practitioners and managers better estimate the costs of digital projects going forward.

2020 Work[edit]

In 2020, the DLF Cost group began to imagine different ways to assess costs. Much of the year has centered on discussions of how, in addition to the cost calculator, the group has discussed how it can facilitate access to useful tools to organizations who want to plan digitization projects.

2019 Work[edit]

2019 was a year of reflection and transition for the Costs Working Group. Members talked about the future directions of the group and how it would continue to proceed with the cost calculator.

2018 Work[edit]

The group’s initial goal for 2018 is to survey the community and conduct user interviews and user testing of the calculator. We plan to use the information captured from the community to help plan and prioritize our future work.

2017 Work[edit]

2017 focused on making improvements to the Calculator. We organized the second annual Day of Data II in July to collect additional community data. We also added a number of [calculator enhancements calculator enhancements], including the addition of new fields and new features.

2016 Work[edit]

The data definitions authored by the cost assessment working group informed a modified structure of the calculator with expanded capabilities that was completed in 2016 with the assistance of Wayne Graham, Technical Director at CLIR and DLF. We needed at least one set of data in each of the 20 categories, as well as for each type of image capture device and for each level of metadata creation and quality control to support the modified structure. We gathered 85 data submissions in summer of 2016 with a Day of Data campaign, spent the fall reviewing and normalizing submissions, and released the 2.0 version of the calculator on November 7, 2016.

2015 Work[edit]

In 2014 a beta version of a Library Digitization Cost Calculator was developed to assist organizations in estimating the costs for digitizing collections and initiate a conversation at the 2014 DLF Forum around cost assessment in digital libraries. The original Digitization Cost Calculator was built as a proof of concept and contains data from only a handful of institutions. In spring of 2014, the Cost Assessment working group of the DLF Assessment Interest Group was subsequently founded. This group was tasked with drafting best practices and guidelines for the collection of time data for various digitization processes, which are used to standardize collection of such data in the field as well as to guide data submissions to the Digital Cost Calculator. The guidelines and definitions are organized according to some of the typical stages of a library project.

In August 2015, the group produced wire frames showing the planned interface and functionality of the Digitization Cost Calculator 2.0, as well as wireframes of how results would appear.

In September 2015, the group released a call for data submissions using the new guidelines and a new data submission form.

Publication Information[edit]

Project Team[edit]

2020[edit]

  • Deirdre Joyce, Syracuse University (co-coordinator)
  • Shannon Willis, University of North Texas (co-coordinator)
  • Wayne Graham, CLIR (technical lead on Cost Calculator)
  • Christina M. Deane, University of Virginia
  • Laura Gentry, University of Alabama
  • Roel Munoz, Princeton University
  • Suzanne Preate, Syracuse University
  • Emily Weirich, University of Arizona
  • Lisa Wright, University of Rochester

2019[edit]

  • Chrissy Rissmeyer, University of California, Santa Barbara (co-coordinator)
  • Sarah Severson, University of Alberta Libraries, (co-coordinator)
  • Deirdre Joyce, Syracuse University (co-coordinator)
  • Wayne Graham, CLIR (technical lead on Cost Calculator)
  • David Bliss, University of Texas at Austin
  • Greg Davis, Iowa State University
  • Shannon Willis, University of North Texas Libraries
  • Gabriella Williams, University of Miami
  • Dan Zellner, Northwestern University

2018[edit]

  • Joyce Chapman, Duke University (co-coordinator)
  • Chrissy Rissmeyer, University of California, Santa Barbara (co-coordinator)
  • Wayne Graham, CLIR (technical lead on Cost Calculator)
  • David Bliss, University of Texas at Austin
  • Greg Davis, Iowa State University
  • Ann Hanlon, University of Wisconsin Milwaukee
  • Deirdre Joyce, Syracuse University
  • Sarah Severson, McGill University Library
  • Gabriella Williams, University of Miami
  • Dan Zellner, Northwestern University

2017[edit]

  • Joyce Chapman, Duke University (coordinator)
  • Wayne Graham, CLIR (technical lead on Cost Calculator)
  • Ann Hanlon, University of Wisconsin Milwaukee
  • Deirdre Joyce, Syracuse University
  • Genya O'Gara, VIVA
  • Chrissy Rissmeyer, University of California, Santa Barbara
  • Sarah Severson, McGill University Library
  • Dan Zellner, Northwestern University

2016[edit]

  • Joyce Chapman, Duke University, (coordinator)
  • Wayne Graham, CLIR (technical lead on Cost Calculator)
  • Jane Davis, Saint Louis Federal Reserve Bank
  • Ann Hanlon, University of Wisconsin Milwaukee
  • Kinza Masood, University of Utah
  • Genya O'Gara, VIVA
  • Chrissy Rissmeyer, University of California, Santa Barbara
  • Sarah Severson, McGill University Library
  • Emily Shaw, Ohio State University Libraries
  • Dan Zellner, Northwestern University

2015[edit]

  • Joyce Chapman, Duke University, (coordinator)
  • Kinza Masood, University of Utah
  • Chrissy Rissmeyer, University of California, Santa Barbara
  • Dan Zellner, Northwestern University

Back to the Assessment home page