Digitizing Special Formats: Difference between revisions
|Line 25:||Line 25:|
Working with the ''Digital Library Federation [http://www.diglib.org/groups/assessment/] [[Assessment]] Group'', Joyce Chapman
Working with the ''Digital Library Federation [http://www.diglib.org/groups/assessment/] [[Assessment]] Group'', Joyce Chapman of developed the ''Library Digitization Cost Calculator'' [http://statelibrarync.org/plstats/digitization_calculator.php] using data collected by Duke University, the University of Alabama, and the Triangle Research Libraries Network. The tool can help professionals create rough estimates for standard flatbed digitization of archival collections. The calculator is currently undergoing revision and the Assessment Group is now calling for institutions to contribute data to the effort [http://www.diglib.org/archives/9484/].
Revision as of 15:29, 27 October 2015
This list of resources is curated by the Digital Library Federation for the benefit of cultural heritage professionals planning projects involving the digitization of rare and unique materials. Applicants to the Digitizing Hidden Special Collections and Archives  program of the Council on Library and Information Resources  may find these helpful in planning project proposals.
Rather than providing comprehensive coverage, this list includes introductory and reference materials that are good places to begin an exploration of issues of broad import to digitizing cultural heritage materials.
Content for this wiki page is currently being curated by the following team: Nicholas Graham, Project Coordinator, North Carolina Digital Heritage Center , Lisa Gregory, Digital Projects Librarian, North Carolina Digital Heritage Center, and Tamsyn Rose-Steel, CLIR/DLF Postdoctoral Fellow for Data Curation in Medieval Studies at Johns Hopkins University.
If you would like to suggest a resource for inclusion on this page, send your suggestion to DigiWiki@clir.org. The DLF is currently seeking professionals from DLF member institutions who would like to participate in a curatorial group to develop and maintain the content of this page. Prospective volunteers for this group should also send expressions of interest to DigiWiki@clir.org.
PROJECT PLANNING & MANAGEMENT
This section curated by Nicholas Graham and Lisa Gregory of the North Carolina Digital Heritage Center.
The Federal Agencies Digitization Guidelines Initiative (or FADGI)  is a collaboratively maintained clearinghouse of information related to digitization, from project planning , to digital file formats , to technical specifications . FADGI was launched in 2007 under the auspices of the National Digital Information Infrastructure and Preservation Program (NDIIPP). Two groups of professionals from federal agencies develop FADGI outcomes: (1) the Still Image Working Group  produces guidelines for creating digital images of cultural heritage materials; and (2) the Audio-Visual Working Group  covers the digitization of analog audio and audiovisual recordings as well as the digital reformatting of born-digital audio or audiovisual content. http://www.digitizationguidelines.gov
The Association of Research Libraries (ARL)  developed the Principles to Guide Vendor/Publisher Relations in Large-Scale Digitization Projects of Special Collections Materials  in 2010 to help institutions build strong working relationships with commercial partners while creating broad access to their collections. http://www.arl.org/storage/documents/publications/principles_large_scale_digitization.pdf
Working with the Digital Library Federation  Assessment Group, Joyce Chapman of Duke University developed the Library Digitization Cost Calculator  using data collected by Duke University, the University of Alabama, and the Triangle Research Libraries Network. The tool can help professionals create rough estimates for standard flatbed digitization of archival collections. The calculator is currently undergoing revision and the Assessment Group is now calling for institutions to contribute data to the effort . http://statelibrarync.org/plstats/digitization_calculator.php
The UCLA Libraries Special Collections Digital Project Toolkit  includes many template documents suitable for planning digitization projects, such as a Digitization Cost Estimate Worksheet , a Fair Use Statement , a Vendor Decision Matrix , Digitization Workflow Guidelines , Quality Control Guidelines , and more. http://library.ucla.edu/special-collections/programs-projects/digital-projects-special-collections
A number of cultural heritage institutions and professionals have created videos about their digitization work for YouTube .
Several professional organizations regularly offer webinars on digitization. Lyrasis  includes introductory training as well as more in-depth topics. OCLC often focuses on their own products, but their live and recorded webinars can include helpful information. 
The EU-based IMPACT Project (IMProving ACcess to Text)  provides useful documentation and case studies related to mass digitization of text, optical character recognition (OCR), and estimating digitization costs and storage. http://www.impact-project.eu/taa/strat/pilot-tools
Best Practices for TEI in Libraries  provides a recent (2011) overview of possible approaches to incorporating encoded text into large-scale digitization projects. http://www.tei-c.org/SIG/Libraries/teiinlibraries/
The Guidelines and Resources  page on the National Digital Newspaper Program (NDNP) website  provides information about best practices for digitizing newspapers and making newspaper content broadly accessible and discoverable. The NDNP is a partnership of the National Endowment for the Humanities (NEH) and the Library of Congress. The NEH operates the National Digital Newspaper funding initiative , which offers grants specifically for newspaper digitization. http://www.loc.gov/ndnp/guidelines/
The Center for Research Libraries (CRL)  maintains the International Coalition on Newspapers (ICON)  database, which contains issue and holdings data for nearly 170,000 publications  dating from the seventeenth century through the present. The ICON project also includes a directory of digitization efforts around the globe . CRL is actively seeking new contributors to the ICON database; they invite feedback about the project through the database website . http://icon.crl.edu
Rare Books & Manuscripts
The International Federation of Library Associations  (IFLA) Rare Book and Special Collections Section  published its Guidelines for Planning the Digitization of Rare Book and Manuscript Collections  in 2014, covering project design, metadata creation, dissemination, and project assessment. http://www.ifla.org/files/assets/rare-books-and-manuscripts/rbms-guidelines/ifla_guidelines_for_planning_the_digitization_of_rare_book_and_manuscripts_collections_september_2014.pdf
The International Press Telecommunications Council (IPTC) Core Standard Specification  is a widely used metadata standard for describing photographs and includes details about embedding metadata into digital image files. http://www.iptc.org/cms/site/index.html?channel=CH0099
The International Image Interoperability Framework (IIIF) is a community of research libraries and image repositories collaboratively developing applications and application programming interfaces that can produce an interoperable technology and community framework for image delivery. http://iiif.io/about.html
Audio and Audiovisual Recordings
The State of Recorded Sound Preservation in the United States: A National Legacy at Risk in the Digital Age  is a report commissioned by the National Recording Preservation Board  of the Library of Congress that gives an overview of the complex legal and technical issues facing the preservation of recorded sound. The Board itself also maintains an Audio Preservation Bibliography . http://www.clir.org/pubs/abstract/reports/pub148
The ARSC Guide to Audio Preservation  is a practical introduction to caring for and preserving audio collections. It is aimed at individuals and institutions that have recorded sound collections but lack the expertise in one or more areas to preserve them. http://www.clir.org/pubs/reports/pub164
New York consulting company AVPreserve  maintains a useful list of publications and presentations on tools and techniques for the preservation of audiovisual media . http://www.avpreserve.com/avpsresources/papers-and-presentations/
Barbara Goldsmith's 2013 Digitizing Video for Long-Term Preservation: An RFP Guide and Template  is intended to take an institution step-by-step through the process of drafting a Request for Proposals (RFP) for the transfer of analog video formats to digital carriers for preservation.
A list of National Geospatial Program Standards and Specifications  appears on the United States Geological Survey (USGS)  National Map Project website . http://nationalmap.gov/standards/index.html
DISCOVERABILITY: METADATA AGGREGATION, REGISTRIES, AND SEARCH ENGINE OPTIMIZATION
The Digital Public Library of America (DPLA)  aggregates the metadata of digital collections held in educational and cultural heritage institutions across the United States. Institutions with large digital collections may contribute data as Content Hubs , while smaller organizations may contribute through local or regional Service Hubs . Contributors must abide by the DPLA's data policies  in order to participate. See also: An Introduction to the DPLA Metadata Model (pdf) ; The DPLA Metadata Application Profile ; DPLA Metadata Aggregation Webinar Recording, 1/22/15 . http://dp.la/
Many DPLA Service Hubs and their partners provide useful documentation and links to tools for metadata normalization, quality control, and aggregation through their project websites.
--Digitization Guidelines, North Carolina Digital Heritage Center : http://www.digitalnc.org/about/policies/digitization-guidelines/
--DPLA aggregation tools on GitHub, North Carolina Digital Heritage Center: https://github.com/ncdhc
--Portal Partners Page, The Portal to Texas History : http://www.library.unt.edu/digital-projects-unit/our-partners
The Print Archives Preservation Registry (PAPR)  collects information about serial titles, print holdings, and archiving terms and conditions. It is a valuable resource for assessing the uniqueness of serial collections and determining the degree of need for digitization of those collections. http://papr.crl.edu
Getting Found: the SEO Cookbook  provides a step-by-step video guide to help libraries measure and monitor the search engine optimization (SEO) performance of their digital repositories. The Cookbook includes everything necessary to implement a preconfigured Google Analytics dashboard that continuously monitors SEO performance metrics relevant to digital repositories. http://www.clir.org/pubs/reports/pub165
This section curated by Tamsyn Rose-Steel, CLIR/DLF Postdoctoral Fellow for Data Curation in Medieval Studies.
The Directory of Open Access Repositories (OpenDOAR)  is an international directory of academic open access repositories, useful for those seeking options for depositing digital collections or models for developing new digital repositories. http://www.opendoar.org/index.html
The Trustworthy Repositories Audit & Certification: Criteria and Checklist (TRAC)  describes the characteristics of secure and sustainable digital repository management. http://www.crl.edu/archiving-preservation/digital-archives/metrics-assessing-and-certifying/trac
The Association of Research Libraries (ARL) Web Accessibility Toolkit  explains the principles of accessibility, universal design, and digital inclusion, and offers tips about best practices and checklists for digital repository creators that can help them ensure digitized content is as broadly accessible as possible. http://accessibility.arl.org
This section curated by Tamsyn Rose-Steel, CLIR/DLF Postdoctoral Fellow for Data Curation in Medieval Studies.
The National Digital Stewardship Alliance (NDSA)  has published the 2015 NDSA National Agenda for Digital Stewardship , which provides a broad overview of current "challenges, opportunities, gaps, and trends" related to building and maintaining digital collections in the United States. See also: The NDSA Levels of Digital Preservation . http://www.digitalpreservation.gov/ndsa/documents/2015NationalAgenda.pdf
The Sustainability of Digital Formats page  provides detailed descriptions and notes on sustainability issues for hundreds of digital file formats . http://www.digitalpreservation.gov/formats/intro/intro.shtml
The Northeast Document Conservation Center (NEDCC)  has compiled a Digital Preservation Reading List  that provides a thorough introduction to the challenges of digital preservation as they relate to cultural heritage collections. Additional links to resources related to digital preservation are provided on NEDCC's website . https://www.nedcc.org/assets/media/documents/DigiPres_Biblio_Digital_Directions_2014_update.pdf
From Theory to Action: “Good Enough” Digital Preservation Solutions for Under-Resourced Cultural Heritage Institutions (2014) is a white paper compiling the results of a three-year study of affordable, scalable digital preservation solutions suitable for under-resourced organizations. http://commons.lib.niu.edu/handle/10843/13610
Digital Preservation Management: Short-Term Strategies for Long-Term Problems is a tutorial created by Cornell University Libraries with funding from the National Endowment for the Humanities. It is now hosted by the MIT Libraries: http://www.dpworkshop.org/dpm-eng/eng_index.html
The Guidelines for Digital Newspaper Preservation Readiness  address a specific set of preservation challenges faced by libraries, archives, historical societies, and other organizations that curate substantial collections of digital newspaper content. Guidelines was written by Katherine Skinner and Mat Schultz and was published by the Educopia Institute  in 2014.
COPYRIGHT & INTELLECTUAL PROPERTY
This section curated by Nicholas Graham and Lisa Gregory of the North Carolina Digital Heritage Center.
Introducing Copyright and Cultural Heritage Institutions
Copyright and Cultural Institutions: Guidelines for Digitization for U.S. Libraries, Archives, and Museums  by Peter Hirtle, Emily Hudson, and Andrew Kenyon (2009) provides comprehensive coverage of all major copyright issues relevant to digitization in cultural heritage institutions. This work is also available in print from the Society of American Archivists . http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1495365
The Association of Research Libraries, in particular its initiatives on Transforming Special Collections in the Digital Age  and on Copyright and Intellectual Property , has published a variety of documents relevant to the digitization of special collections and archives, including a 2012 special issue of Research Library Issues that covers legal concerns related to digitizing rare and unique materials. http://publications.arl.org/rli279/1
Determining Copyright Status
The ALA Copyright Slider http://librarycopyright.net/resources/digitalslider/ is a simple, user-friendly guide to determining copyright status of works. http://librarycopyright.net/resources/digitalslider/
Copyright Term and the Public Domain in the United States  contains a helpful and very thorough chart for determining the copyright status of works created and/or published in the United States. https://copyright.cornell.edu/resources/publicdomain.cfm
Copyright and Related Issues Relevant to Digital Preservation and Dissemination of Unpublished Pre-1972 Sound Recordings by Libraries and Archives describes what libraries and archives can legally do to preserve and make accessible holdings of unpublished sound recordings. http://www.clir.org/pubs/abstract/reports/pub144
Recommendations for Standardized International Rights Statements is a white paper summarizing the conclusions of a working group convened by the Digital Public Library of America and Europeana. http://rightsstatements.org/files/151002recommendations_for_standardized_international_rights_statements.pdf
The Statement of Best Practices in Fair Use of Collections Containing Orphan Works for Libraries, Archives, and Other Memory Institutions,  developed by the Center for Media & Social Impact at American University and the UC Berkeley School of Law, includes clear guiding principles for us in determining when to apply fair use in the digitization and online publication of orphan works. The statement was produced after talking with librarians and archivists around the country. http://www.cmsimpact.org/fair-use/best-practices/statement-best-practices-fair-use-orphan-works-libraries-archives
In 2009, the Society of American Archivists  issued Orphan Works: Statement of Best Practices to guide decision-making in conducting research into the copyright status of unpublished collections. The document includes a variety of useful links and appendices. http://www2.archivists.org/sites/all/files/OrphanWorks-June2009.pdf
PROVENANCE, PRIVACY, AND ETHICS
The Society of American Archivists (SAA) has convened a task force to revise and strengthen the Protocols for Native American Archival Materials (PNAAM), based upon a document produced in 2007 . The draft document contains a useful bibliography of general resources on archives and ethics . http://www2.archivists.org/groups/native-american-archives-roundtable/protocols-for-native-american-archival-materials-information-and-resources-page
The SAA case study, Identifying Culturally Sensitive American Indian Material in a Non-tribal Institution , provides one example of how an institution interpreted the Protocols  and the SAA Code of Ethics . http://www2.archivists.org/sites/all/files/AmericanIndianMaterial_CEPC-CaseStudy3.pdf
The Smithsonian National Museum of Natural History  has maintained a bibliography  of online resources titled the Ethics of Exhibiting Culturally Sensitive Materials Online. This bibliography was last updated in 2010. http://anthropology.si.edu/naa/home/culturally_sensitive.html
The National Endowment for the Humanities (NEH)  supports digitization and related activities through the Humanities Collections and Reference Resources program , the National Digital Newspaper Program , and the Preservation and Access Research and Development  grants. http://www.neh.gov/
The National Historical Publications & Records Commission (NHPRC)  offers funding for digitization and related activities through the Access to Historical Records program  and the Digital Dissemination of Archival Collections program . http://www.archives.gov/nhprc/
EDUCATION & TRAINING OPPORTUNITIES
The Digital Public Library of America (DPLA), working in partnership with trainers at the Digital Commonwealth, the Digital Library of Georgia, the Minnesota Digital Library, the Montana Memory Project, and the Mountain West Digital Library, have developed a workshop curriculum based on documented best practices for library digitization. A self-guided version of the curriculum intended for digitization beginners is available on the DPLA website through the Public Library Partnerships Project: http://dp.la/info/about/projects/public-library-partnerships/
Lyrasis offers a variety of classes relevant to digitization and digital content management, such as Introduction to Audio Visual Digitization, Introduction to Digital Project Management Planning, and Digitization for Small Institutions. The classes and events schedule contains up-to-date information about offerings: https://www.lyrasis.org/Pages/Events.aspx
The Northeast Document Conservation Center (NEDCC) offers a variety of programs, including several related to digital collections and digital preservation.
The Sustainable Heritage Network offers a variety of in-person and online tutorials  related to archival best practices, ethics, appraisal, processing, and digitization. http://sustainableheritagenetwork.org/
INFORMATION FROM DIGITIZATION SERVICE PROVIDERS
NOTE: This section is provided for convenience and information only. The Digital Library Federation and the Council on Library and Information Resources do not recommend or endorse any specific digitization service provider, and the use or non-use of any particular provider has no bearing upon any applicant's consideration in the Digitizing Hidden Special Collections and Archives competition.
BMI Imaging Systems, Inc.  enables libraries to transform microfilm records into a digital format that provides easy access and image enhancement capabilities never seen before. In addition to the archival TIFF used for inclusion to the State/National repositories, BMI provides a solution that allows patrons to scroll digital microfilm rolls from a computer and use full text search to find records, articles, and photos for interim access. Adjustable grayscale allows users to turn black and white images into real photos. For more information please contact Jake Walker at (800) 488-3456 ext 406 or firstname.lastname@example.org. https://bmiimaging.com
DataBank  is a National Document & Information Management Company with over 23 years of experience in document conversion and automation. Their areas of expertise include the conversion of photos, archival documents and legacy microfilm or microfiche collections. They offer seamless integration with repositories for storage and retrieval of scanned media. For additional information contact Kathy Berger, Senior Solutions Consultant, at email@example.com or at (603) 463-0154. http://www.databankimx.com
Digital Revolution  is a full service Multi Media facility located in the heart of San Francisco. Founded by Paul Grippaldi in 2004, Digital Revolution is dedicated to helping clients create high quality digital media. From Legacy Media Digitizing : Preservation : Archiving : Video Creation : Post Production : Disc & USB Copying Services, Digital Revolution is the choice of Corporations, Educational Institutions, Non-Profits, Film Companies, Government Agencies and Individuals for their multi-media needs. For additional information call Digital Revolution at 415-398-1200.
The Internet Archive  (IA) is one of the world’s largest public digital libraries, with an extensive collection of human culture. Its mission includes offering free access to all digital knowledge for researchers, historians, scholars, people with disabilities, and the general public to outstanding collections that exist in digital format. The Internet Archive also offers online access and discovery of digital content, including public domain eBooks  and a more selective collection of public domain and non-public domain texts .
IA offers non-destructive digitization services - which include image capture, digital processing, preservation, and future proofing of digital data. Items to be digitized can be sent to one of 33 regional digitization centers around the world, or portable equipment can be placed on-site within libraries and archives. Questions: Robert@archive.org
- Overview of IA Workflow:
- To reach one of the Internet Archive centers:
- To purchase digitization equipment:
Luna Imaging, Inc. offers digitization and software & hosting services for building and maintaining digital collections. Digitization services include:
- Preservation scanning
- Access capture
- Book capture services
- OCR, PDF, BookReader processing
LYRASIS can support special collections and archival digitization projects by providing:
- Digitization and Project Management Services – working through its Digitization Collaborative LYRASIS can digitize a wide range of source materials including print/manuscript/microfilm/photographic materials/audio/video and film and manage the process for you. See more at: http://www.lyrasis.org/digitize/
- Staff Expertise – information on processes and standards for project planning
- Professional Development Opportunities – LYRASIS offers a wide range of classes and can provide specific digitization classes to suit local needs.
The Northeast Document Conservation Center  (NEDCC) is an independent conservation laboratory specializing in the conservation and preservation of paper-based collections. NEDCC provides professional conservation treatment for books, maps, photographs, documents, parchment, papyrus, manuscripts, architectural plans, and works of art on paper. NEDCC’s Imaging Services department provides digital imaging services and specializes in rare, historic, and oversize materials, as well as X-Ray Film scanning and reformatting for black and white and color negative films and color transparencies.
Northern Micrographics  has over 60 years experience partnering with clients in library, academic, commercial and industrial markets to provide superior preservation imaging products and services. They scan a variety of object types including bound and disbound volumes, photos, maps, microfilm and microfiche. Northern Micrographics can also help place digital collections online with custom software products, ProSeek® and PhotoAtlasTM. They also offer a variety of other services including microfilming, microfilm duplication, metadata development, data conversions, hosting and book binding. Contact Northern Micrographics at 800-236-0850 or at firstname.lastname@example.org to learn more.
Stanford University Libraries (SUL) Digitization Services  is a fully-integrated service provider tailored to meet libraries, archives and museums’ heterogeneous collection needs. SUL digitization services support three families of content format: paper-based materials, audiovisual media and born-digital files.
SUL Digitization Services offers:
- Digitization of original materials;
- Large format scanning and image stitching;
- Reformatting of audio and moving image content;
- Reformatting and recovery of files from digital media;
- Preservation-quality master file creation;
- Derivative file creation for discovery and access;
- Secure storage and handling of original materials;
- OCR text processing in plain text, ALTO or PDF;
- Project consultation and planning;
- RFP consultation and vendor management;
- Onsite digitization for fragile content;
- Long-term preservation; and
- Content hosting and discovery solutions.
Stanford University Library's digitization services are provided by Digital Library Systems and Services. For inquiries regarding digitization services, contact email@example.com. SUL Digitization Services' brochure  provides full details for potential partners.
Two Cat Digital  has been providing world-class digital imaging and consulting services since 2003 with a particular emphasis on cultural heritage institutions and materials. Their passion is in designing and managing efficient digitization workflows, and for helping clients bring their valuable collections to light. Two Cat clients include hundreds of institutions including museums, libraries, universities, government agencies, architects, photographers and non-profit organizations. For additional information contact Two Cat at firstname.lastname@example.org.
If you would like to suggest a resource for inclusion on this page, send your suggestion to DigiWiki@clir.org. The DLF is currently seeking professionals from DLF member institutions who would like to participate in a working group to develop and maintain the content of this page. Prospective volunteers for this group should also send expressions of interest to DigiWiki@clir.org.