Digitizing Special Formats

This list of resources is curated by the Digital Library Federation for the benefit of cultural heritage professionals planning projects involving the digitization of rare and unique materials. Applicants to the Digitizing Hidden Special Collections and Archives [1] program of the Council on Library and Information Resources [2] may find these helpful in planning project proposals.

Rather than providing comprehensive coverage, this list includes introductory and reference materials that are good places to begin an exploration of issues of broad import to digitizing cultural heritage materials.

Content for this wiki page is currently being curated by the following team: Nicholas Graham, Project Coordinator, North Carolina Digital Heritage Center [3], Lisa Gregory, Digital Projects Librarian, North Carolina Digital Heritage Center, and Tamsyn Rose-Steel, CLIR/DLF Postdoctoral Fellow for Data Curation in Medieval Studies at Johns Hopkins University.

If you would like to suggest a resource for inclusion on this page, send your suggestion to DigiWiki@clir.org. The DLF is currently seeking professionals from DLF member institutions who would like to participate in a curatorial group to develop and maintain the content of this page. Prospective volunteers for this group should also send expressions of interest to DigiWiki@clir.org.

DISCOVERABILITY: METADATA AGGREGATION, REGISTRIES, AND SEARCH ENGINE OPTIMIZATION

The Digital Public Library of America (DPLA) [4] aggregates the metadata of digital collections held in educational and cultural heritage institutions across the United States. Institutions with large digital collections may contribute data as Content Hubs [5], while smaller organizations may contribute through local or regional Service Hubs [6]. Contributors must abide by the DPLA's data policies [7] in order to participate. See also: An Introduction to the DPLA Metadata Model (pdf) [8]; The DPLA Metadata Application Profile [9]; DPLA Metadata Aggregation Webinar Recording, 1/22/15 [10]. http://dp.la/

Many DPLA Service Hubs and their partners provide useful documentation and links to tools for metadata normalization, quality control, and aggregation through their project websites.

--Digitization Guidelines, North Carolina Digital Heritage Center [11]: http://www.digitalnc.org/about/policies/digitization-guidelines/

--DPLA aggregation tools on GitHub, North Carolina Digital Heritage Center: https://github.com/ncdhc

--Setting Up a Repository for Harvest, Mountain West Digital Library [12]: http://mwdl.org/getinvolved/repository_setup.php

--Portal Partners Page, The Portal to Texas History [13]: http://www.library.unt.edu/digital-projects-unit/our-partners

The Print Archives Preservation Registry (PAPR) [14] collects information about serial titles, print holdings, and archiving terms and conditions. It is a valuable resource for assessing the uniqueness of serial collections and determining the degree of need for digitization of those collections. http://papr.crl.edu

Getting Found: the SEO Cookbook [15] provides a step-by-step video guide to help libraries measure and monitor the search engine optimization (SEO) performance of their digital repositories. The Cookbook includes everything necessary to implement a preconfigured Google Analytics dashboard that continuously monitors SEO performance metrics relevant to digital repositories. http://www.clir.org/pubs/reports/pub165

The Wikipedia Library [16] offers resources to help cultural heritage institutions expose their collections through Wikipedia. As a common starting point for research, Wikipedia can be used to direct researchers to libraries where the resources can be accessed directly. https://en.wikipedia.org/wiki/Wikipedia:The_Wikipedia_Library/Research_libraries#Library_discovery | http://specialcollectionssocialmedia.pbworks.com/w/page/82745872/Wikipedia

DIGITAL REPOSITORIES

This section curated by Tamsyn Rose-Steel, CLIR/DLF Postdoctoral Fellow for Data Curation in Medieval Studies.

The Directory of Open Access Repositories (OpenDOAR) [17] is an international directory of academic open access repositories, useful for those seeking options for depositing digital collections or models for developing new digital repositories. http://www.opendoar.org/index.html

The Trustworthy Repositories Audit & Certification: Criteria and Checklist (TRAC) [18] describes the characteristics of secure and sustainable digital repository management. http://www.crl.edu/archiving-preservation/digital-archives/metrics-assessing-and-certifying/trac

The Association of Research Libraries (ARL) Web Accessibility Toolkit [19] explains the principles of accessibility, universal design, and digital inclusion, and offers tips about best practices and checklists for digital repository creators that can help them ensure digitized content is as broadly accessible as possible. http://accessibility.arl.org

DIGITAL PRESERVATION

This section curated by Tamsyn Rose-Steel, CLIR/DLF Postdoctoral Fellow for Data Curation in Medieval Studies.

Thanks to the WikiProject Digital Preservation [20], the information about digital preservation on Wikipedia [21] is substantial and current. http://en.wikipedia.org/wiki/Digital_preservation

The National Digital Stewardship Alliance (NDSA) [22] has published the 2015 NDSA National Agenda for Digital Stewardship [23], which provides a broad overview of current "challenges, opportunities, gaps, and trends" related to building and maintaining digital collections in the United States. See also: The NDSA Levels of Digital Preservation [24]. http://www.digitalpreservation.gov/ndsa/documents/2015NationalAgenda.pdf

The Sustainability of Digital Formats page [25] provides detailed descriptions and notes on sustainability issues for hundreds of digital file formats [26]. http://www.digitalpreservation.gov/formats/intro/intro.shtml

The Northeast Document Conservation Center (NEDCC) [27] has compiled a Digital Preservation Reading List [28] that provides a thorough introduction to the challenges of digital preservation as they relate to cultural heritage collections. Additional links to resources related to digital preservation are provided on NEDCC's website [29]. https://www.nedcc.org/assets/media/documents/DigiPres_Biblio_Digital_Directions_2014_update.pdf

From Theory to Action: “Good Enough” Digital Preservation Solutions for Under-Resourced Cultural Heritage Institutions (2014) is a white paper compiling the results of a three-year study of affordable, scalable digital preservation solutions suitable for under-resourced organizations. http://commons.lib.niu.edu/handle/10843/13610

Digital Preservation Management: Short-Term Strategies for Long-Term Problems is a tutorial created by Cornell University Libraries with funding from the National Endowment for the Humanities. It is now hosted by the MIT Libraries: http://www.dpworkshop.org/dpm-eng/eng_index.html

The Guidelines for Digital Newspaper Preservation Readiness [30] address a specific set of preservation challenges faced by libraries, archives, historical societies, and other organizations that curate substantial collections of digital newspaper content. Guidelines was written by Katherine Skinner and Mat Schultz and was published by the Educopia Institute [31] in 2014.

COPYRIGHT & INTELLECTUAL PROPERTY

This section curated by Nicholas Graham and Lisa Gregory of the North Carolina Digital Heritage Center.

Introducing Copyright and Cultural Heritage Institutions

Copyright and Cultural Institutions: Guidelines for Digitization for U.S. Libraries, Archives, and Museums [32] by Peter Hirtle, Emily Hudson, and Andrew Kenyon (2009) provides comprehensive coverage of all major copyright issues relevant to digitization in cultural heritage institutions. This work is also available in print from the Society of American Archivists [33]. http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1495365

The Association of Research Libraries, in particular its initiatives on Transforming Special Collections in the Digital Age [34] and on Copyright and Intellectual Property [35], has published a variety of documents relevant to the digitization of special collections and archives, including a 2012 special issue of Research Library Issues that covers legal concerns related to digitizing rare and unique materials. http://publications.arl.org/rli279/1

Determining Copyright Status

The ALA Copyright Slider http://librarycopyright.net/resources/digitalslider/ is a simple, user-friendly guide to determining copyright status of works. http://librarycopyright.net/resources/digitalslider/

Copyright Term and the Public Domain in the United States [36] contains a helpful and very thorough chart for determining the copyright status of works created and/or published in the United States. https://copyright.cornell.edu/resources/publicdomain.cfm

Copyright and Related Issues Relevant to Digital Preservation and Dissemination of Unpublished Pre-1972 Sound Recordings by Libraries and Archives describes what libraries and archives can legally do to preserve and make accessible holdings of unpublished sound recordings. http://www.clir.org/pubs/abstract/reports/pub144

Recommendations for Standardized International Rights Statements[37] is a white paper summarizing the conclusions of a working group convened by the Digital Public Library of America and Europeana. http://rightsstatements.org/files/151002recommendations_for_standardized_international_rights_statements.pdf

Orphan Works

The Statement of Best Practices in Fair Use of Collections Containing Orphan Works for Libraries, Archives, and Other Memory Institutions, [38] developed by the Center for Media & Social Impact at American University and the UC Berkeley School of Law, includes clear guiding principles for us in determining when to apply fair use in the digitization and online publication of orphan works. The statement was produced after talking with librarians and archivists around the country. http://www.cmsimpact.org/fair-use/best-practices/statement-best-practices-fair-use-orphan-works-libraries-archives

In 2009, the Society of American Archivists [39] issued Orphan Works: Statement of Best Practices to guide decision-making in conducting research into the copyright status of unpublished collections. The document includes a variety of useful links and appendices. http://www2.archivists.org/sites/all/files/OrphanWorks-June2009.pdf

PROVENANCE, PRIVACY, AND ETHICS

The Association of Tribal Archives, Libraries, and Museums [40] maintains a list of resources relevant to the care of cultural materials of indigenous peoples. http://www.atalm.org/node/52

The Society of American Archivists (SAA) has convened a task force to revise and strengthen the Protocols for Native American Archival Materials (PNAAM), based upon a document produced in 2007 [41]. The draft document contains a useful bibliography of general resources on archives and ethics [42]. http://www2.archivists.org/groups/native-american-archives-roundtable/protocols-for-native-american-archival-materials-information-and-resources-page

The SAA case study, Identifying Culturally Sensitive American Indian Material in a Non-tribal Institution [43], provides one example of how an institution interpreted the Protocols [44] and the SAA Code of Ethics [45]. http://www2.archivists.org/sites/all/files/AmericanIndianMaterial_CEPC-CaseStudy3.pdf

Archives and Digital Inequality, annotated collaborative bibliography, is a collections of resources and readings by the Archives and Digital Inequality pop-up session at SAA 2016. [46] https://docs.google.com/document/d/15Pg7Pb9EklNxp9ZCvkSCe5QyyYq78vKXdSI4of3TFo4/edit

The Smithsonian National Museum of Natural History [47] has maintained a bibliography [48] of online resources titled the Ethics of Exhibiting Culturally Sensitive Materials Online. This bibliography was last updated in 2010. http://anthropology.si.edu/naa/home/culturally_sensitive.html

FUNDING OPPORTUNITIES

The National Endowment for the Humanities (NEH) [49] supports digitization and related activities through the Humanities Collections and Reference Resources program [50], the National Digital Newspaper Program [51], and the Preservation and Access Research and Development [52] grants. http://www.neh.gov/

The National Historical Publications & Records Commission (NHPRC) [53] offers funding for digitization and related activities through the Access to Historical Records program [54] and the Digital Dissemination of Archival Collections program [55]. http://www.archives.gov/nhprc/

EDUCATION & TRAINING OPPORTUNITIES

The Digital Public Library of America (DPLA), working in partnership with trainers at the Digital Commonwealth, the Digital Library of Georgia, the Minnesota Digital Library, the Montana Memory Project, and the Mountain West Digital Library, have developed a workshop curriculum based on documented best practices for library digitization. A self-guided version of the curriculum intended for digitization beginners is available on the DPLA website through the Public Library Partnerships Project: http://dp.la/info/about/projects/public-library-partnerships/

Lyrasis offers a variety of classes relevant to digitization and digital content management, such as Introduction to Audio Visual Digitization, Introduction to Digital Project Management Planning, and Digitization for Small Institutions. The classes and events schedule contains up-to-date information about offerings: https://www.lyrasis.org/Pages/Events.aspx

The Northeast Document Conservation Center (NEDCC) offers a variety of programs, including several related to digital collections and digital preservation.

The Sustainable Heritage Network offers a variety of in-person and online tutorials [56] related to archival best practices, ethics, appraisal, processing, and digitization. http://sustainableheritagenetwork.org/

INFORMATION FROM DIGITIZATION SERVICE PROVIDERS

NOTE: This section is provided for convenience and information only. The Digital Library Federation and the Council on Library and Information Resources do not recommend or endorse any specific digitization service provider, and the use or non-use of any particular provider has no bearing upon any applicant's consideration in the Digitizing Hidden Special Collections and Archives competition.

BMI Imaging Systems, Inc. [57] enables libraries to transform microfilm records into a digital format that provides easy access and image enhancement capabilities never seen before. In addition to the archival TIFF used for inclusion to the State/National repositories, BMI provides a solution that allows patrons to scroll digital microfilm rolls from a computer and use full text search to find records, articles, and photos for interim access. Adjustable grayscale allows users to turn black and white images into real photos. For more information please contact Jake Walker at (800) 488-3456 ext 406 or jwalker@bmiimaging.com. https://bmiimaging.com

DataBank [58] is a National Document & Information Management Company with over 23 years of experience in document conversion and automation. Their areas of expertise include the conversion of photos, archival documents and legacy microfilm or microfiche collections. They offer seamless integration with repositories for storage and retrieval of scanned media. For additional information contact Kathy Berger, Senior Solutions Consultant, at kberger@databankimx.com or at (603) 463-0154. http://www.databankimx.com

Digital Revolution [59] is a full service Multi Media facility located in the heart of San Francisco. Founded by Paul Grippaldi in 2004, Digital Revolution is dedicated to helping clients create high quality digital media. From Legacy Media Digitizing : Preservation : Archiving : Video Creation : Post Production : Disc & USB Copying Services, Digital Revolution is the choice of Corporations, Educational Institutions, Non-Profits, Film Companies, Government Agencies and Individuals for their multi-media needs. For additional information call Digital Revolution at 415-398-1200.

The Internet Archive [60] (IA) is one of the world’s largest public digital libraries, with an extensive collection of human culture. The goal is to provide free access to all knowledge in an accessible, digital format for researchers, historians, people with disabilities, and the general public. The Internet Archive also offers online access and discovery of digital content, including public domain eBooks [61] and a more selective collection of public domain and non-public domain texts available for lending at OpenLibrary.org [62].

IA offers non-destructive digitization with a range of analog and born-digital formats, including: printed materials that are bound and unbound (books, magazines, yearbooks, etc.), archival materials, photographs, microfilm, microfiche, film and video (8mm and 16mm). Services include photographic imaging, digital processing, preservation, and access to digital data. Items to be digitized can be sent to one of 33 regional digitization centers around the world, or portable equipment can be placed on-site within libraries and archives. Questions: DigitalLibraries@archive.org

• Overview of IA Workflow:

http://archive.org/details/ProcessDocument

• To reach one of the Internet Archive centers, see contact info at:

http://archive.org/scanning

• To purchase digitization equipment:

http://archive.org/scanning/tabletopscribe

Luna Imaging, Inc.[63] offers digitization and software & hosting services for building and maintaining digital collections. Digitization services include:

• Preservation scanning
• Access capture
• Book capture services
• OCR, PDF, BookReader processing

LYRASIS can support special collections and archival digitization projects by providing:

• Digitization and Project Management Services – working through its Digitization Collaborative LYRASIS can digitize a wide range of source materials including print/manuscript/microfilm/photographic materials/audio/video and film and manage the process for you. See more at: http://www.lyrasis.org/digitize/

• Staff Expertise – information on processes and standards for project planning

• Professional Development Opportunities – LYRASIS offers a wide range of classes and can provide specific digitization classes to suit local needs.

http://lyrasisnow.org/clir-hidden-collections-grants/

The Northeast Document Conservation Center [64] (NEDCC) is an independent conservation laboratory specializing in the conservation and preservation of paper-based collections. NEDCC provides professional conservation treatment for books, maps, photographs, documents, parchment, papyrus, manuscripts, architectural plans, and works of art on paper. NEDCC’s Imaging Services department provides digital imaging services and specializes in rare, historic, and oversize materials, as well as X-Ray Film scanning and reformatting for black and white and color negative films and color transparencies.

Northern Micrographics [65] has over 60 years experience partnering with clients in library, academic, commercial and industrial markets to provide superior preservation imaging products and services. They scan a variety of object types including bound and disbound volumes, photos, maps, microfilm and microfiche. Northern Micrographics can also help place digital collections online with custom software products, ProSeek® and PhotoAtlasTM. They also offer a variety of other services including microfilming, microfilm duplication, metadata development, data conversions, hosting and book binding. Contact Northern Micrographics at 800-236-0850 or at sales@nmt.com to learn more.

Stanford University Libraries (SUL) Digitization Services [66] is a fully-integrated service provider tailored to meet libraries, archives and museums’ heterogeneous collection needs. SUL digitization services support three families of content format: paper-based materials, audiovisual media and born-digital files.

SUL Digitization Services offers:

• Digitization of original materials;
• Large format scanning and image stitching;
• Reformatting of audio and moving image content;
• Reformatting and recovery of files from digital media;
• Preservation-quality master file creation;
• Derivative file creation for discovery and access;
• Secure storage and handling of original materials;
• OCR text processing in plain text, ALTO or PDF;
• Project consultation and planning;
• RFP consultation and vendor management;
• Onsite digitization for fragile content;
• Long-term preservation; and
• Content hosting and discovery solutions.

Stanford University Library's digitization services are provided by Digital Library Systems and Services. For inquiries regarding digitization services, contact digitization-contact@lists.stanford.edu. SUL Digitization Services' brochure [67] provides full details for potential partners.

http://digitization.stanford.edu/

Two Cat Digital [68] has been providing world-class digital imaging and consulting services since 2003 with a particular emphasis on cultural heritage institutions and materials. Their passion is in designing and managing efficient digitization workflows, and for helping clients bring their valuable collections to light. Two Cat clients include hundreds of institutions including museums, libraries, universities, government agencies, architects, photographers and non-profit organizations. For additional information contact Two Cat at info@twocatdigital.com.

---

If you would like to suggest a resource for inclusion on this page, send your suggestion to DigiWiki@clir.org. The DLF is currently seeking professionals from DLF member institutions who would like to participate in a working group to develop and maintain the content of this page. Prospective volunteers for this group should also send expressions of interest to DigiWiki@clir.org.