Assessment:Costs: Difference between revisions

From DLF Wiki
Jump to navigation Jump to search
(29 intermediate revisions by 4 users not shown)
Line 1: Line 1:
=DLF Cost Assessment Working Group=  
=DLF Cost Working Group=  
The Cost Assessment group’s primary task is to collect, aggregate, and share data on the time it takes to perform various tasks involved in the digitization process to help with project planning and benchmarking. When the group formed in 2014, we found few practical resources geared towards helping the community determine the cost of digitization. To help address this gap, we built a Digitization Cost Calculator [http://dashboard.diglib.org/ Digitization Cost Calculator] that allows individuals to enter information about a project and get back an estimate of the staffing costs and time needed to complete it based on real data from the community.
The Cost group’s primary task has traditionally been to collect, aggregate, and share data on the time (and money) it takes to perform various tasks involved in the digitization process to help with project planning and benchmarking. When the group formed at the 2014 DLF Forum, we found few practical resources geared towards helping the community determine the cost of digitization. To help address this gap, we built a Digitization Cost Calculator [http://dashboard.diglib.org/ Digitization Cost Calculator] that allows individuals to enter information about a project and get back an estimate of the staffing costs and time needed to complete it based on real data from the community.
 
As we move into a new phase for the group, we seek to continue collecting the above information and look for new ways to share and use this information beyond the cost calculator, even as we continue to improve the data that informs the calculator tool. The Cost Working group is an ideal place for digital lab practitioners and managerial staff alike to come together to talk about practical ways to assess the resources necessary to plan and execute successful digitization projects.


==Get Involved==
==Get Involved==
===Contribute Data===
===Contribute Data===
We are always looking for more data! [[Data Collection and Contribution, Digitization Cost Calculator|Please click here for instructions on how to collect and contribute data to the Digitization Cost Calculator.]]
We are always looking for more data! [[Data Collection and Contribution, Digitization Cost Calculator|Please click here for instructions on how to collect and contribute data to the Digitization Cost Calculator.]]
===Membership===
The Cost Assessment working group welcomes new members. Ongoing member duties include quarterly review of recent Cost Calculator data submissions. Those who would like to work on new projects or expansions of existing projects are welcome. If you are interested in helping us collect data for the Digitization Cost Calculator, please join our
[https://groups.google.com/forum/#!forum/digital-library-assessment Digital Library Assessment Google Group] and speak up!


====Meeting Schedule====
===Working Group Membership===
The 2018 Kickoff Meeting is scheduled for '''Tuesday, February 6 from 1-2pm (Pacific) / 4-5pm (Eastern) via Zoom'''. A regular monthly meeting time for 2018 will be identified following that meeting.
The Cost Assessment working group always welcomes new members. Members meet regularly to work on different projects. If you are interested in joining, please join our 
[https://groups.google.com/forum/#!forum/dlf-aig-cost-assessment Digital Library AIG Cost Assessment google group] and speak up!
 
Information on standing meetings in 2020 will be posted after February 21, 2020
 
====Standing working meetings====
2020 working meetings are held on the '''second Monday''' of each month (3/9, 4/13, 5/11, 6/8, 7/13, 8/10, 9/14, 10/12), at '''3pm'''(eastern)/'''2pm'''(central)/'''1pm'''(mountain)/'''12pm'''(pacific)


Join from PC, Mac, Linux, iOS or Android: https://ucsb.zoom.us/j/361483389
See past meeting minutes at [https://docs.google.com/a/ucsb.edu/document/d/1TbUz5mThnxoJKDjCk_L2_p8SKEzye4OO7fnjVCrGjks/edit?usp=sharing 2019 Agendas and Meeting Notes].


Or iPhone one-tap :
'''Meeting Connection Information:'''
    US: +14086380968,,361483389#  or +16468769923,,361483389#
Or Telephone:
    Dial(for higher quality, dial a number based on your current location):
        US: +1 408 638 0968  or +1 646 876 9923  or +1 669 900 6833
    Meeting ID: 361 483 389
    International numbers available: https://ucsb.zoom.us/zoomconference?m=oGs_lAVDNwmiDni42ImVcafH1W-lxAo5


Or an H.323/SIP room system:
Email DLF at info@diglib.org for call-in information.
    H.323:  
<!--    '''Zoom''': https://clirdlf.zoom.us/j/486656289
        162.255.37.11 (US West)
    Or '''iPhone one-tap''' : US: +16468769923,,486656289# (New York) or +16699006833,,486656289# (San Jose)
        162.255.36.11 (US East)
    Or '''Telephone''' : Dial(for higher quality, dial a number based on your current location):
        221.122.88.195 (China)
    US: +1 646 876 9923 (New York) or +1 669 900 6833 (San Jose) or +1 408 638 0968 (San Jose)
        115.114.131.7 (India)
    Find your local number: https://clirdlf.zoom.us/u/aojCpLuLf
        213.19.144.110 (EMEA)
     Meeting ID: 486 656 289-->
        202.177.207.158 (Australia)
        209.9.211.110 (Hong Kong)
        64.211.144.160 (Brazil)
        69.174.57.160 (Canada)
     Meeting ID: 361 483 389


    SIP: 361483389@zoomcrc.com
==Digitization Cost Calculator==
The Cost Assessment Working Group's primary project has been to build and maintain the [http://dashboard.diglib.org/ Digitization Cost Calculator]. The source code for the calculator is available via the [https://github.com/clirdlf/digitization_cost_calculator Calculator's GitHub repository]. In 2020, we will be looking at the different possible outputs that move beyond the cost calculator, but with the same emphasis on helping practitioners and managers better estimate the costs of digital projects going forward.


==Projects==
===[https://docs.google.com/document/d/1xl6EsWSMHRd3m-7033o2oOLvU8STj0kVLD3XssezKMY/edit?usp=sharing 2019 Work]===
The Cost Assessment Working Group's primary project has been to build and maintain the [http://dashboard.diglib.org/ Digitization Cost Calculator]. The source code for the calculator is available via the [https://github.com/clirdlf/digitization_cost_calculator Calculator's GitHub repository].
2019 was a year of reflection and transition for the Costs Working Group. Members talked about the future directions of the group and how it would continue to proceed with the cost calculator.


===2017-2018 Work===
===[https://docs.google.com/document/d/1xl6EsWSMHRd3m-7033o2oOLvU8STj0kVLD3XssezKMY/edit?usp=sharing 2018 Work]===
The group’s initial goal for 2018 is to survey the community and conduct user interviews, both with calculator users and data contributors. We plan to use the information captured from the community to help plan and prioritize additional work for the upcoming year.
The group’s initial goal for 2018 is to survey the community and conduct user interviews and user testing of the calculator. We plan to use the information captured from the community to help plan and prioritize our future work.


===2016-2017 Work===
===[https://docs.google.com/document/d/1j4reOVgVYTsOjMz3aRqP5TLH_nMOkRjMZKAoq1NCeQk/edit?usp=sharing 2017 Work]===
2017 focused on making improvements to the Calculator. We organized the second annual [https://www.diglib.org/aig-assessments-day-of-data-ii/ Day of Data II] in July to collect additional community data. We also added a number of [calculator enhancements  calculator enhancements], including the addition of new fields and new features.  
2017 focused on making improvements to the Calculator. We organized the second annual [https://www.diglib.org/aig-assessments-day-of-data-ii/ Day of Data II] in July to collect additional community data. We also added a number of [calculator enhancements  calculator enhancements], including the addition of new fields and new features.


===2015-2016 Work===  
===[https://docs.google.com/document/d/1eQg8VuX6zlJ4nyPrzhttRKEB1T0ApaZKvjF3aTTCaCk/edit?usp=sharing 2016 Work]===  
The data definitions authored by the cost assessment working group informed a modified structure of the calculator with expanded capabilities that was completed in 2016 with the assistance of Wayne Graham, Technical Director at CLIR and DLF. We needed at least one set of data in each of the 20 categories, as well as for each type of image capture device and for each level of metadata creation and quality control to support the modified structure. We gathered 85 data submissions in summer of 2016 with a Day of Data campaign, spent the fall reviewing and normalizing submissions, and released the 2.0 version of the calculator on November 7, 2016.  
The data definitions authored by the cost assessment working group informed a modified structure of the calculator with expanded capabilities that was completed in 2016 with the assistance of Wayne Graham, Technical Director at CLIR and DLF. We needed at least one set of data in each of the 20 categories, as well as for each type of image capture device and for each level of metadata creation and quality control to support the modified structure. We gathered 85 data submissions in summer of 2016 with a Day of Data campaign, spent the fall reviewing and normalizing submissions, and released the 2.0 version of the calculator on November 7, 2016.


===2014-2015 Work===
===[https://docs.google.com/a/ucsb.edu/document/d/1YZxppATnracRA9jMNJyxMTpbkXyT5SkPKcXgIWwlUPo/edit?usp=sharing 2015 Work]===
In 2014 the Cost Assessment working group developed a beta version of a [http://statelibrarync.org/plstats/digitization_calculator.php Library Digitization Cost Calculator] to assist organizations in estimating the costs for digitizing collections and initiate a conversation at the 2014 DLF Forum around cost assessment in digital libraries. The original Digitization Cost Calculator was built as a proof of concept and contains data from only a handful of institutions. In spring of 2014, the Cost Assessment working group of the DLF Assessment Interest Group was subsequently founded. This group was tasked with drafting [https://docs.google.com/document/d/17jTJmCzKsa83BMdlgKj239Shqcbglq7I4EfxJIWWDQo/edit best practices and guidelines for the collection of time data for various digitization processes], which are used to standardize collection of such data in the field as well as to guide data submissions to the Digital Cost Calculator. The guidelines and definitions are organized according to some of the typical stages of a library project.  
In 2014 a beta version of a [http://statelibrarync.org/plstats/digitization_calculator.php Library Digitization Cost Calculator] was developed to assist organizations in estimating the costs for digitizing collections and initiate a conversation at the 2014 DLF Forum around cost assessment in digital libraries. The original Digitization Cost Calculator was built as a proof of concept and contains data from only a handful of institutions. In spring of 2014, the Cost Assessment working group of the DLF Assessment Interest Group was subsequently founded. This group was tasked with drafting [https://docs.google.com/document/d/17jTJmCzKsa83BMdlgKj239Shqcbglq7I4EfxJIWWDQo/edit best practices and guidelines for the collection of time data for various digitization processes], which are used to standardize collection of such data in the field as well as to guide data submissions to the Digital Cost Calculator. The guidelines and definitions are organized according to some of the typical stages of a library project.  


In August 2015, the group produced [https://drive.google.com/drive/folders/0B4veUYJxzAmSfmpMSE1zVTIxYmtzb1pFeWtiZzNFREp3bFJaYW5rYkJTV1RGWGY4Mm05LWc wire frames] showing the planned interface and functionality of the Digitization Cost Calculator 2.0, as well as [https://drive.google.com/drive/folders/0B4veUYJxzAmSfmpMSE1zVTIxYmtzb1pFeWtiZzNFREp3bFJaYW5rYkJTV1RGWGY4Mm05LWc wireframes of how results would appear].  
In August 2015, the group produced [https://drive.google.com/open?id=0B4veUYJxzAmSUFFQYWNrS0hBLWc wire frames] showing the planned interface and functionality of the Digitization Cost Calculator 2.0, as well as [https://drive.google.com/a/ucsb.edu/file/d/0B4veUYJxzAmSN2FRaXJhdFRELTQ/view?usp=sharing wireframes of how results would appear].  


In September 2015, the group released a [https://docs.google.com/document/d/1s1bHzkB3SSyufaoZS0JZhbVQ1AZfRgUsZ0iOcKZ3Q0k/edit call for data submissions] using the new guidelines and a new [https://duke.qualtrics.com/SE/?SID=SV_3OtqSEAbpl2QDl3 data submission form].
In September 2015, the group released a [https://docs.google.com/document/d/1s1bHzkB3SSyufaoZS0JZhbVQ1AZfRgUsZ0iOcKZ3Q0k/edit call for data submissions] using the new guidelines and a new [https://duke.qualtrics.com/SE/?SID=SV_3OtqSEAbpl2QDl3 data submission form].
Line 61: Line 56:


==Project Team==
==Project Team==
===2020===
* Deirdre Joyce, Syracuse University Libraries (co-coordinator)
* Shannon Willis, University of North Texas Libraries (co-coordinator)
* Wayne Graham, CLIR (technical lead on Cost Calculator)
* David Bliss, University of Texas at Austin
* Greg Davis, Iowa State University
* Suzanne Preate, Syracuse University Libraries
* Gabriella Williams, University of Miami
* Lisa Wright, University of Rochester
===2019===
* Chrissy Rissmeyer, University of California, Santa Barbara (co-coordinator)
* Sarah Severson, University of Alberta Libraries, (co-coordinator)
* Deirdre Joyce, Syracuse University (co-coordinator)
* Wayne Graham, CLIR (technical lead on Cost Calculator)
* David Bliss, University of Texas at Austin
* Greg Davis, Iowa State University
* Shannon Willis, University of North Texas Libraries
* Gabriella Williams, University of Miami
* Dan Zellner, Northwestern University


===2017-2018===
===2018===
* Joyce Chapman, Duke University (co-coordinator)
* Joyce Chapman, Duke University (co-coordinator)
* Chrissy Rissmeyer, University of California, Santa Barbara (co-coordinator)
* Chrissy Rissmeyer, University of California, Santa Barbara (co-coordinator)
* Wayne Graham, CLIR (technical lead on Cost Calculator)
* Wayne Graham, CLIR (technical lead on Cost Calculator)
* David Bliss, University of Texas at Austin
* David Bliss, University of Texas at Austin
* Greg Davis, Iowa State University
* Ann Hanlon, University of Wisconsin Milwaukee
* Ann Hanlon, University of Wisconsin Milwaukee
* Deirdre Joyce, Syracuse University
* Deirdre Joyce, Syracuse University
* Sarah Severson, McGill University Library
* Sarah Severson, McGill University Library
* Gabriella Williams, University of Miami
* Gabriella Williams, University of Miami
* Melissa Wisner, Yale University
* Dan Zellner, Northwestern University
* Dan Zellner, Northwestern University


===2016-2017===
===2017===
* Joyce Chapman, Duke University (coordinator)
* Joyce Chapman, Duke University (coordinator)
* Wayne Graham, CLIR (technical lead on Cost Calculator)
* Wayne Graham, CLIR (technical lead on Cost Calculator)
Line 84: Line 99:
* Dan Zellner, Northwestern University
* Dan Zellner, Northwestern University


===2015-2016===
===2016===
* Joyce Chapman, Duke University, (coordinator)
* Joyce Chapman, Duke University, (coordinator)
* Wayne Graham, CLIR (technical lead on Cost Calculator)
* Wayne Graham, CLIR (technical lead on Cost Calculator)
Line 96: Line 111:
* Dan Zellner, Northwestern University
* Dan Zellner, Northwestern University


===2014-2015===
===2015===
* Joyce Chapman, Duke University, (coordinator)
* Joyce Chapman, Duke University, (coordinator)
* Kinza Masood, University of Utah
* Kinza Masood, University of Utah

Revision as of 12:03, 13 April 2020

DLF Cost Working Group

The Cost group’s primary task has traditionally been to collect, aggregate, and share data on the time (and money) it takes to perform various tasks involved in the digitization process to help with project planning and benchmarking. When the group formed at the 2014 DLF Forum, we found few practical resources geared towards helping the community determine the cost of digitization. To help address this gap, we built a Digitization Cost Calculator Digitization Cost Calculator that allows individuals to enter information about a project and get back an estimate of the staffing costs and time needed to complete it based on real data from the community.

As we move into a new phase for the group, we seek to continue collecting the above information and look for new ways to share and use this information beyond the cost calculator, even as we continue to improve the data that informs the calculator tool. The Cost Working group is an ideal place for digital lab practitioners and managerial staff alike to come together to talk about practical ways to assess the resources necessary to plan and execute successful digitization projects.

Get Involved

Contribute Data

We are always looking for more data! Please click here for instructions on how to collect and contribute data to the Digitization Cost Calculator.

Working Group Membership

The Cost Assessment working group always welcomes new members. Members meet regularly to work on different projects. If you are interested in joining, please join our Digital Library AIG Cost Assessment google group and speak up!

Information on standing meetings in 2020 will be posted after February 21, 2020

Standing working meetings

2020 working meetings are held on the second Monday of each month (3/9, 4/13, 5/11, 6/8, 7/13, 8/10, 9/14, 10/12), at 3pm(eastern)/2pm(central)/1pm(mountain)/12pm(pacific)

See past meeting minutes at 2019 Agendas and Meeting Notes.

Meeting Connection Information:

Email DLF at info@diglib.org for call-in information.

Digitization Cost Calculator

The Cost Assessment Working Group's primary project has been to build and maintain the Digitization Cost Calculator. The source code for the calculator is available via the Calculator's GitHub repository. In 2020, we will be looking at the different possible outputs that move beyond the cost calculator, but with the same emphasis on helping practitioners and managers better estimate the costs of digital projects going forward.

2019 Work

2019 was a year of reflection and transition for the Costs Working Group. Members talked about the future directions of the group and how it would continue to proceed with the cost calculator.

2018 Work

The group’s initial goal for 2018 is to survey the community and conduct user interviews and user testing of the calculator. We plan to use the information captured from the community to help plan and prioritize our future work.

2017 Work

2017 focused on making improvements to the Calculator. We organized the second annual Day of Data II in July to collect additional community data. We also added a number of [calculator enhancements calculator enhancements], including the addition of new fields and new features.

2016 Work

The data definitions authored by the cost assessment working group informed a modified structure of the calculator with expanded capabilities that was completed in 2016 with the assistance of Wayne Graham, Technical Director at CLIR and DLF. We needed at least one set of data in each of the 20 categories, as well as for each type of image capture device and for each level of metadata creation and quality control to support the modified structure. We gathered 85 data submissions in summer of 2016 with a Day of Data campaign, spent the fall reviewing and normalizing submissions, and released the 2.0 version of the calculator on November 7, 2016.

2015 Work

In 2014 a beta version of a Library Digitization Cost Calculator was developed to assist organizations in estimating the costs for digitizing collections and initiate a conversation at the 2014 DLF Forum around cost assessment in digital libraries. The original Digitization Cost Calculator was built as a proof of concept and contains data from only a handful of institutions. In spring of 2014, the Cost Assessment working group of the DLF Assessment Interest Group was subsequently founded. This group was tasked with drafting best practices and guidelines for the collection of time data for various digitization processes, which are used to standardize collection of such data in the field as well as to guide data submissions to the Digital Cost Calculator. The guidelines and definitions are organized according to some of the typical stages of a library project.

In August 2015, the group produced wire frames showing the planned interface and functionality of the Digitization Cost Calculator 2.0, as well as wireframes of how results would appear.

In September 2015, the group released a call for data submissions using the new guidelines and a new data submission form.

Publication Information

Project Team

2020

  • Deirdre Joyce, Syracuse University Libraries (co-coordinator)
  • Shannon Willis, University of North Texas Libraries (co-coordinator)
  • Wayne Graham, CLIR (technical lead on Cost Calculator)
  • David Bliss, University of Texas at Austin
  • Greg Davis, Iowa State University
  • Suzanne Preate, Syracuse University Libraries
  • Gabriella Williams, University of Miami
  • Lisa Wright, University of Rochester

2019

  • Chrissy Rissmeyer, University of California, Santa Barbara (co-coordinator)
  • Sarah Severson, University of Alberta Libraries, (co-coordinator)
  • Deirdre Joyce, Syracuse University (co-coordinator)
  • Wayne Graham, CLIR (technical lead on Cost Calculator)
  • David Bliss, University of Texas at Austin
  • Greg Davis, Iowa State University
  • Shannon Willis, University of North Texas Libraries
  • Gabriella Williams, University of Miami
  • Dan Zellner, Northwestern University

2018

  • Joyce Chapman, Duke University (co-coordinator)
  • Chrissy Rissmeyer, University of California, Santa Barbara (co-coordinator)
  • Wayne Graham, CLIR (technical lead on Cost Calculator)
  • David Bliss, University of Texas at Austin
  • Greg Davis, Iowa State University
  • Ann Hanlon, University of Wisconsin Milwaukee
  • Deirdre Joyce, Syracuse University
  • Sarah Severson, McGill University Library
  • Gabriella Williams, University of Miami
  • Dan Zellner, Northwestern University

2017

  • Joyce Chapman, Duke University (coordinator)
  • Wayne Graham, CLIR (technical lead on Cost Calculator)
  • Ann Hanlon, University of Wisconsin Milwaukee
  • Deirdre Joyce, Syracuse University
  • Genya O'Gara, VIVA
  • Chrissy Rissmeyer, University of California, Santa Barbara
  • Sarah Severson, McGill University Library
  • Dan Zellner, Northwestern University

2016

  • Joyce Chapman, Duke University, (coordinator)
  • Wayne Graham, CLIR (technical lead on Cost Calculator)
  • Jane Davis, Saint Louis Federal Reserve Bank
  • Ann Hanlon, University of Wisconsin Milwaukee
  • Kinza Masood, University of Utah
  • Genya O'Gara, VIVA
  • Chrissy Rissmeyer, University of California, Santa Barbara
  • Sarah Severson, McGill University Library
  • Emily Shaw, Ohio State University Libraries
  • Dan Zellner, Northwestern University

2015

  • Joyce Chapman, Duke University, (coordinator)
  • Kinza Masood, University of Utah
  • Chrissy Rissmeyer, University of California, Santa Barbara
  • Dan Zellner, Northwestern University

Back to the Assessment home page