DLF Wiki - User contributions [en]

NDSA:June 4 Meeting Minutes

2014-06-09T22:45:26Z

Cathy.hartman: /* AGENDA and MINUTES */

June 4, 2014 CWG Meeting Minutes

==Attendees (38)==

*Linda Reib - AZ State Archives
*Chris
*Deborah Rossum
*erin engle
*Edward McCain
*Sara Holladay
*Paul/Sara/Xiaomei, U Iowa
*Jennie Knies, University of Maryland
*Christie Moffatt
*Joel Wurl
*Glen McAninch
*Lori Donovan
*Amy Kirchhoff
*Jennifer Weintraub
*Rebecca Johnson Melvin/U Delaware
*Amy Hodge
*Rachel Howard
*JR
*Midge Coates (Auburn)
*Lisa Schmidt
*Rachel Wise
*Mitchell Brown
*Butch Lazorchak
*Mark Phillips
*Aaisha Haykal, CSU
*Cathy Hartman
*Sara Holladay
*Gail Truman
*Abbie Grotke
*Amy Hodge
*Jaime - NIU
*Kevin McCarthy
*Ricc Ferrante (Smithsonian Institution)
*Alex Duryee (AVPreserve)
*Chad Garrett
*Gail McMillan

==AGENDA and MINUTES==

This is the fourth and last in our series of talks about the Content Areas outlined in the 2014 National Agenda. This month we focused on Research Data. We had two presentations:

1. Paul Soderdahl (along with his colleauges Sara Scheib and Xiaomei Gu) was up first, discussing Data Management at the University of Iowa and their Data Management Survey. Their slides are here: [[file:NDSA_Content_WG_presentation_on_Data_Management_at_UI.pdf‎]]

Questions that followed included:

Gail McMillan: Could you say a little more about publishing vs. other dissemination?

Just like with a university press or other traditional academic publisher, a significant part of the publisher’s task is to disseminate the publication as far and wide as possible, so to a large extent these two are closely related. But other dissemination can happen outside of the publisher’s control and/or beyond the lifespan of the publisher’s involvement. For instance, if a data publication is released with CC0 license, others are permitted to redistribute. Another data repository might acquire one of our publications for inclusion in their repository, meaning there are more possibilities for dissemination beyond the publisher’s own “marketing strategy.”

Glen McAninch: Which of the models works best for you or are you working on a hybrid approach

The idea behind the model is to acknowledge that we wear multiple hats with different motivations that have varying lifespans, and they all need to coexist. This model arose out of conversations where we had multiple library staff – e.g., an archivist, a preservationist, a technologist, and a publisher – gathered together and realize we were looking at the same problem through different lenses and each had different expectations about what would need to happen and where the concentration of effort was most needed.

Rebecca Johnson Melvin/U Delaware: For each of these horizons, are you suggesting all be handled throught library repository?

Yes, ideally a generalized repository could handle the same object along its path on all four horizons.

2. Then we heard from Mark Phillips from UNT. His slides are here: http://digital.library.unt.edu/ark:/67531/metadc288009/

Questions that followed:

Chris: Ever run into a retiring professor who discovers his closet full of mainframe tapes? Mark: Not yet, but in future he expects this to be more common.

Rebecca Johnson Melvin/U Delaware: what generic metadata are you using to describe the data deposits versus the readme.txt description? Mark: Duplin core-based UNT-L. It's all documented, and a generic library view of metadata, straightforward. The guide is here: http://www.library.unt.edu/digital-projects-unit/quick-start-metadata-guide . They also have style guide for how readmes should be done.

Aaisha Haykal, CSU: sorry, if I missed this, but is this system home grown or is it open source? Mark: it is "purpose built" locally to manage collections, based on CDL's microservices. Various components should be released open source but works for their specific environment.

Rebecca Johnson Melvin/U Delaware: Do you have any evidence yet of other researchers using this collected data? Mark: Not yet - hard to show true re-use. Have some download stats but hard to interpret.

Cathy Hartman: could you talk a bit about the preservation part of the system. Mark: Preservation repository to manage bag-it bags. A large scale system, with replication of content, fixity info, verifications. Access system (Django) to dsiplay content.

Joel Wurl: Re. the issue of "uptake," are you noticing any patterns in terms of which faculty from which disciplines are most inclined to cooperate/participate? Mark: The faculty cooperating are the ones we work with already, so not much uptake. Haven't strongarmed any others really, haven't made a huge effort to push it. Waiting to see. Need to do more outreach, people don't full understand.

Rebecca Johnson Melvin/U Delaware: Are any of the data sets deposited to meet a federally funded grant requirement? Mark: Not yet, except one library-related IMLS project (written into data management plan).

Rebecca Johnson Melvin/U Delaware: Would you accept data deposits with limited access restrictions or limited size restrictions? Mark: So far we are open to the world. We can limit pretty easily to UNT community, and can provide embargo periods if need be. The system manages/handles that.

==Other announcements==

Christie Moffatt from NLM will be taking on co-chair role after the summer meeting. Welcome Christie! Many thanks to Cathy!

We're working on details for the July meeting at DC. Will make a decision about holding one early July at our normal time. Abbie is on leave then so not sure... keep an eye on the listserv for more details.

NDSA:2014 National Agenda Outline

2013-03-06T23:57:46Z

Cathy.hartman: /* Web and Social Media */

Draft Outline

==Introduction==

a. Description of the National Agenda for Digital Stewardship

i. The document is inspiration for the planning of digital preservation work and observations of the joint leadership group. It is also an evaluation of the state of digital preservation activity and key emerging issues for the year

ii. The document is not intended to be prescriptive, a directive to working groups, and it is not intended to replace any organizational efforts, planning, goals or opinions.

iii. Hoped for impact

b. Description of the NDSA, NDSA goals and how the 2014 Agenda furthers those goals (i.e inform and inspire individual, working group, and organizational work plans)

c. Intended audience: NDSA members and the wider digital preservation community

d. Authored by the joint leadership group

==Section topics ==
===Trends in Digital Content===

====Electronic Records====

Electronic records, and the loss of the underlying information it contains poses a significant threat to the American memory. Whether it’s an electronic diary, email correspondence, or documenting government transactions, all of these records are at risk of disappearing without thoughtful action to preserve important information. Preserving electronic records efficiently and in a cost effective manner remains a tremendous challenge. Culling through the volume of records generated and held by individuals and institutions in electronic format is requiring changes to traditional paper-based procedures. Rather than relying on files clerks to organize and store information, the information creator – each of us – will be responsible for properly managing his or her own electronic records. Education and a proper infrastructure will be a critical factor in teaching the public about the deficiencies of long-term electronic preservation and how to properly save important materials.

====Research Data====
Curating digital research data illustrates some of the most acute challenges with digital content. The sheer '''''scale''''' of research data represents a daunting curation task. With new scientific instrumentation being developed and the growing use of computer simulations, a research team can generate many terabytes of data per day. Data curators face managing at the petabyte scale (a petabyte equals 1,000 terabytes) and well beyond. Scientific fields such as particle physics with its collider data and astronomy with its sky surveys as well as research fields and methods such as bioinformatics, crystallography, and engineering design generate massive amounts of digital data. Large scale digitized content being created by initiatives like the Google Books project pose similar challenges. Digital research data are '''''complex''''' objects to curate. They are very heterogeneous, ranging from numeric and image-based, to text, geospatial, and other forms. There are many different information standards used (and not used) as well as many different approaches to information structure (e.g., XML-structured documents vs. fixed image and textual file formats). The research '''''communities''''' that produce data are equally diverse; their data management practices vary greatly within a discipline as well as between disciplines. There can also be commercial interests in the data and associated data practices. Perhaps the overriding challenges in all respects to digital research data are the affiliated costs. Domain researchers, technologists, information scientists, and policymakers are searching for sustainable economic models with the ability to accurately predict costs and to balance them across the lifecycle (e.g. costs for ingest, archival management, and dissemination), and through federated inter-institutional repository systems. There is no “one size fits all” approach when it comes to resolving the management challenges of research data. A path forward would be to galvanize digital preservation/curation community members around these four data challenges – scale, complexity, research communities’ practices, and costs -- study the issues more in-depth and begin recommending new solutions.

====Web and Social Media====
'''DRAFT DRAFT'''

While cultural heritage organizations and others have been preserving web content since 1996, challenges continue in preserving born digital web content as websites become more complex and the scale of the web continues to grow. Crawlers used to collect content, as well as access tools used to render the web archives, are increasingly challenged in keeping up with the explosion of ever-complex technologies: multimedia, mashups, deep-web, databases, and the increasing prevalence of heavily scripted site navigational paradigms that do not prevent the collection of data but make replay nearly impossible without changes to the browser configuration of a visitor to the archive. More and more content published and created on the web is unable to be preserved using available tools.

The International Internet Preservation Consortium (netpreserve.org) developed the Heritrix web crawler and is working to develop a community to stabilize, improve, and support this open source tool in the future. Broader involvement by web archivists not involved directly in IIPC is critical. Development and exploration of improvements to access tools, including data mining tools for large datasets of web archives, are also needed. Full-text indexing of web archives continues to challenge researchers and the community of web archivists, particularly as archives expand and reach multiple terabyte and petabyte size.

The increasing use of social media by organizations and individuals can also be a challenge to preserve, as services hosting this content do not have preservation as a business model and changes they make in how they serve up content can upset the preservation process. The rate of publication/site implementations and change for large social media aggregation sites is, on average, every 3-6 weeks. This makes it virtually impossible to keep pace with an archival quality capture of these resources without direct access to the site feeds which are not available to most cultural heritage institutions even for a fee.

Tools being developed in recent years, primarily to meet the needs of business compliance regulations, are able to capture more of this type of material on a small scale. While they show exciting advancements in the tools available for web archiving, the technologies available have not yet translated to open source tools that scale to the needs of cultural heritage institutions and others collecting large amounts of data.

====Motion Picture Film and Video====
''[rough notes from Carolyn - need a writeup]''
The challenges are outlined here:
http://www.digitalpreservation.gov/series/challenge/DigitizationGuidelinesPart3.html

Digital preservation and stewardship of motion picture film and video presents a multitude of challenges. There is a lack of standards for preservation quality reformatting and a slew of issues that come from producing such large files-- not only storage of these monster files, but the ability to playback such files, etc. And also the clash or the potential synergy between the movie industry and cultural heritage institutions.

====Digital content stored on obsolete or deteriorating media====

As more archives and repositories come to terms with managing born digital content there will be a growing need for the management of disk images. The first rule for managing born digital content is to remove a copy of all the digital files from the physical media. This means digitally transforming hard drives, CD, DVD, floppies, zip disks, etc., often working with media that is obsolete (ie., older, not still in use). These transformed materials can be either forensic or logical disk images of the physical media. The main challenge in this first step is that the organization may not have the means to adequately process the digital files right away. This will then require rights-sensitive and potentially huge amount of storage until these materials can be appropriately treated and made available. As hard drives get larger and the storage capacity for an individual can easily jump to the terabytes this will pose a significant long term challenge for digital preservation, particularly at smaller organizations. Additionally, with obsolete media it may be difficult to identify and obtain working drives or drivers needed to access the data, and with older files it could be difficult to obtain software needed to open and view files as originally written.

'''Start input from S&P Working Group on trends in digital content'''
* Web archiving
* Research data
* Big data
** Computational consumption of archives
* How do you connect annotations to content? Should we preserve those connections?
* How do we provide access with appropriate limits
** (government classification, copyright restrictions, donor agreements, licenses, human subject research restrictions). ** Rights metadata standards?
* Compound, complex objects
** Dynamic content, integrating resources
** Not just documents (video, digital art / new media, etc.)
* Preservation of social media
* How to connect related publications (within and between repositories)
* Findability and discoverability of content
* Accessibility of digital content (e.g., usable via screen reader)
** Accessibility of data sets
** In the context of open access requirements / mandates / etc.
'''End input from S&P Working Group on trends in digital content'''

===Research Priorities===
The Research Priorities section focuses on two distinct aspects of research: the long term preservation of research data such as e-science, data sets, and so forth; and the need for research on digital preservation activities.

====Research Data====
[EXAMPLE] Education Workforce Development Research: Sentence to paragraph description with rationale for including the topic in the ''2014 National Agenda.'' Recommendation for action included if relevant.

====Research Related to Digital Preservation Practices====

=====''Applied Research''=====

In the near term future, there are specific areas of applied research around digital preservation lifecycle issues that need attention. Currently there are limited models for cost estimation for ongoing storage of digital content. Cost estimation models need to be robust and flexible. Different approaches to cost estimation should be explored and comparisons of existing models made with emphasis on reproducibility of results. Auditing models also need to be strengthened and further developed. The SafeArchive system and other bit-level auditing practices could be connected to the NDSA Levels of Preservation work to help organizations determine and validate the costs of scaling different auditing schemes. Around both topics, research needs to address multiple storage models: locally stored data, distributed preservation networks, data cooperatives, cloud storage, brokered cloud storage systems and hybrid systems need to be addressed in cost models and auditing practices so that organizations can make informed cost-effective digital preservation decisions.

=====''Research in Curriculum Development''=====

=====''Theoretical Framework''=====
(3-6 Year horizon) ["helen"]
1. Information valuation/selection. Models for estimating future private & public value of information.
2. Models for estimating future risks

=====''Information Equivalence''=====
(3-6 year) [''Jefferson'']: Significant properties, fingerprints, authenticity

iv. preservation at scale (3-6 year): [''Jefferson'']
1. Preserving 'big data' -- storage scale
2. preserving high-velocity/dynamic
3. Scalable models for information provenance, equivalence, and quality
4. Information valuation and portfolio management
5. Privacy & confidentiality @ scale

=====''Policy Research''=====
(3-6 year): ["Micah"]
1.Trust engineering, trust frameworks

=====''Education Workforce Development Research''=====
(3-6 year) [''Helen'']
=====''Evidence-Based for Preservation Methodologies & Policies''=====
(Cross-Cutting/10 years/Grand Challenge) ["Micah"]
1. experimental: labs/testbeds/field experiments
• Methodologies for digital preservation research that can provide useful results with simulation of long time periods.
• Methodologies for digital preservation research that provide reliable test plans.
• Methodologies that combine aspects of different research areas (e.g., computer science, materials science
2. observational: random sampling/systematic trend/coverage
3. computational: replicable theoretically grounded computer models
4. Research in a lab or test-bed environment, with a focus on methods to test research results and implement effective strategies from the research lab or test-bed. Frameworks that allow people to apply their specialized knowledge and skills to specific problems

'''Start input from S&P Working Group on research'''
* Findability and discoverability of content
* Large scale integration of emulation into delivery (connect to work done internationally)
* Format migration testing
* Integration of emulation and migration (hybrid approach)
* How do we leverage tools and practices in the digital forensics community (and other fields)?
'''End input from S&P Working Group on research'''

Research Priorities References:
* www.safearhive.org
* http://blogs.loc.gov/digitalpreservation/2012/11/ndsa-levels-of-digital-preservation-release-candidate-one/

===Infrastructure Development===

i. Infrastructure can be generally defined as the set of interconnected structural elements that provide framework supporting an entire structure of development. This includes both physical and institutional elements.
--[[NDSA:User:Micah altman|Micah altman]] 18:31, 13 February 2013 (UTC)

ii.Examples:

• Trends in data protection standards

• Best practices for using cloud concepts within a digital preservation strategy

• Cost-benefit analysis techniques for infrastructure planning

====Integration of Digital Forensics Tools into Production Workflows for Collections of Born Digital Materials====
* Building on exploratory work on using digital forensics (CLIR report, recent DPC report)
* Leveraging underdevelopment tools (like bit curator) and implementing workflows like those laid out in the AIMS report.
* Mention OCLC SWAT project as a great example of a potential way forward.
* CLEAR NEED: Considerable ground has been made on preservation, but access remains problematic. Advances here in infrastructure development suggest the need for further development of both policies and tools that work based on those policies.

====Implementation of tools and services for ongoing implementation of File Format Action Plans====
As organizations are now amassing considerable and in many cases diverse and heterogeneous collections of digital files there is both a need and an opportunity for organizations to begin to mine and monitor this material. We are now getting to the point where we have an array of digital files under stewardship of various vintages and there is a clear need for organizations to begin surveying their digital content and files and developing techniques to identify threats and risks to this material. We would like to suggest that there is clear value in organizations beginning to document what kinds of files they have and share this information to prioritize the development of approaches for format actions based on the clear current needs.

====Need for targeted help to move organizations up through the NDSA Levels of Digital Preservation====
The work of the NDSA Levels of Digital Preservation team has produced a useful chart for helping to prioritize digital preservation work at organizations. At this point, it would be beneficial for the community to use this chart as a means to help identify the low level infrastructure requirements that many member organizations are not currently meeting and try to focus time and energy on helping make it easier for organizations to move up the chart.

'''Start input from Digital Content group'''

>>file system - linear tape file system (transport between tape, into cloud)

We were thinking about passing it to you for consideration in your section as it doesn't feel contenty, it feels more infrastructurey (to us at least, who admittedly don't fully understand what the issue is :)

Gail Truman was the one who'd brought it up, and she forwarded some additional details, below. I think Bradley Daigle also discussed this on our call, but he's not responded to a request yet for more details.

'''End input from Digital Content group'''

'''Start input from S&P Working Group on infrastructure'''

* Development of commercial products for digital preservation; creating and maintaining relationships with the private sector
* Consolidating and keeping alive the palette of tools we need to do our work of digital preservation, and for rendering in the future
** Shared tool development or reusing tools developed by other communities
* Common packaging (general and specialized)
** In a perfect world, record-keeping systems in federal agencies would all know how to create a package, so that all sorts of systems become interoperable; would achieve huge economies for the government
* Use and access – tends to be divorced from preservation, but needs to be more integrated
** Preservation is ensuring access over time
** Need to involve researchers more
** “Archlive” – shouldn’t be places of storage, but of dynamic activities
** Have yet to pursue the other end of the OAIS model – the consumer archive
** New demands for API and federated access to our content coming out of initiatives like DPLA, edX, jdarchive
* What tools are available to do things like package and annotate content (i.e., in lieu of PDF/A-3)
* Storage concerns at scale.
* Tools for risk assessment or other archive management tasks (e.g. preservation planning)
'''End input from S&P Working Group on infrastructure'''

===Organizational Roles, Policies, and Practices===

'''Issues: What is the critical organizational problem facing digital preservation work today?'''

* Organizational pressures
** Increased scope of responsibilities (data management, education of content creators, etc.)
** financial pressures - increased costs
** lack of inadequate staff (refer to the staffing survey)
** volume, increased complexity of data (see the comments in the content section)
** changing context (compliance rules, etc.)
** lack of prioritization of dp by higher administration and those controlling budgets
** continued preservation mandates

'''What potential solutions could address this challenge in a practical way?'''

* Work together as a community to raise the profile of DP and campaign for more resources, higher priority given to DP

and/or

* Increased organizational cooperation and division of labor to multiply the breadth of impact of investments made within individual institutions
** If it is impractical for every institution to develop expertise in every aspect of the digital preservation challenge, different institutions could specialize in different aspects and rely on each other for some functions
** If each institution does not have the resources to fully fund all the digital preservation responsibilities and activities, having each institution spend on something different and sharing capabilities with each other would help address the cost
** If each institution cannot hire the number of staff and the variety of types of expertise, collaborative hiring and sharing of staff and skills could help

and/or

* Identification of more cost-efficient methods of preservation

and/or

* DP training and staffing resources (training materials, hiring materials, etc.)

'''What are barriers to realizing collaborations and cooperative ? on a large scale?'''

* Lack of knowledge on where natural collaborations could occur
* Immature certification and trust frameworks
* Lack of widely accepted standards and certifications that would allow organizations to rely on each other more easily for predictable and equivalent outcomes
* Lack of assurance that the digital preservation community is participating in all relevant standards bodies so that institutions can trust that their digital preservation interests are being represented by someone in the community when it matters. We need comprehensive coverage on all critically relevant standards bodies, and coordination so that it is clear who has taken responsibility for what.

'''In order to address these barriers, we recommend focused work in the following areas:'''

* Build and strengthen interdependent [??] preservation networks regionally, nationally and internationally
** Identify preservation functions that could be outsourced (staffing survey revealed some functions) and functions that each organization prefers to or must do for itself (planning, alignment with parent organization’s goals, and alignment with designated communities might be examples in this category)
** Create greater visibility into the different services offered, areas of expertise, and standards activities of organizations active in the digital preservation community
** Use that visibility to analyze gaps where something necessary is not getting done and find opportunities where multiple organizations could benefit from a division of labor.
** Identify potential specializations, then publicize commitments of organizations to specialize in a particular function so others can begin to rely on it.

'''Raw notes from S&P Working Group:'''
* Sustainable budgetary models for long-term preservation
* Articulating the compendium of best practices
* Continuum of policies ranging from high-level organizational policies to lower-level rules
* Role of national efforts, e.g. DPN, Academic Preservation Trust
* International efforts and leveraging other preservation groups
* Aligning National Approaches to Digital Preservation publication as a reference
* Need for creation of more dedicated FTEs to staff digital preservation initiatives
** Findings from the staffing survey (needs gaps, characteristics of needed staff)
* What are the barriers to hiring qualified staff? Is it training? Budget? Finding people?
* Collection of position descriptions that people could use as models.
* How do we convince management that digital preservation is important and deserves resources?
* Audit and certification
* Scope of what we’re responsible for as practitioners has been broadening (data management,...) Also at different levels (department, institution, community)
* Role of disciplinary repositories (how does our organization’s repository fit into the network of repositories?)
* Changing rules for compliance

==Conclusion==
a. Possible ways to engage with the topics and issues detailed in the agenda

NDSA:Digital E-Prints of Newspapers

2013-01-15T22:47:04Z

Cathy.hartman:

Return to [[NDSA:News,_Media,_and_Journalism]]

= At Risk Content: Newspaper E-Prints =

==Historical Value==
A newspaper defines its community’s identity, and the loss of even a few months of their newspaper creates gaps in that community’s recorded history. High usage of the digitized historical newspapers demonstrates the value of this content to many user groups indicating that the preservation of current newspapers should be a high priority. Cultural memory organizations should coordinate with multiple partners to preserve newspapers and make them freely available online.

==Recognized Opportunities==
Since the shift to "digital-first" publishing, publishers increasingly have abandoned microfilming of newspapers or maintaining their print morgues. Now, newspapers produce a PDF printmaster to send to their printer. Most newspaper publishers neither preserve the PDF printmasters nor do they microfilm the printed issues, resulting in a loss of current newspaper content for future generations. The fact that the vast majority of current U.S. newspapers are printed from an "e-print" file offers a unique, cost effective opportunity to work with publishers to capture and preserve that file.

==Target Audiences==
These audiences share multiple levels of local, state, national, and international interest, but based on user feedback, discussions, and publications, the newspapers have proven of relevance to:
*Local communities: public libraries; newspaper publishers; genealogical societies; county and local governments; K-12 educators
*State-wide communities: Academic researchers; lay historians; university students and professors; archives
*National and International communities: Trending researchers; political scholars; economic analysts

==Educating Stakeholders==
Cultural memory organizations should communicate the role that newspaper preservation plays in community history to stakeholders through multiple venues:
*Publishers: state press association conferences; trade shows; and presentations to publishing office staff and at publishers’ meetings. Engage publishers as advocates of their own newspapers’ preservation.
*K-12 educators: Involve them in creation of grade-specific lesson plans - public school conferences, presentations to university Education students.
*Public libraries: panel presentations with partner public libraries about working together on newspaper preservation; workshop presentations at district library association meetings; conference calls with public library directors.
*Researchers, teachers, archivists, and librarians: Connect at historical association meetings and conferences; panel presentations at archivist society conferences; vendor booths, brochures, and flyers about newspaper preservation at relevant conferences.
*Standards: Follow digital preservation standards and provide education to stakeholders about the standards.

==Obstacles and Risk Factors==
Possible risk factors and obstacles in e-prints newspaper preservation include:
*PDF printmasters are not routinely maintained by many publishers.
*Neither libraries nor publishers currently recognize PDF printmasters as preservation master copies that need to be actively preserved on a regular basis.
*Many newspapers don't have the technical expertise or the management policy to preserve their content before it is lost.
*One preservation solution does not fit all newspapers.
*Publishers and libraries do not have a highly successful track record of cooperation to date. Each have different motivations and do not always understand each others importance.
*Publishers are uncomfortable giving permission to third parties to make newspapers freely available online.
*Funding for digital preservation may not be readily available nor is there awareness of the urgency for this "at risk" content.
*Grant-funded staffing is common in most digital newspaper programs across the U.S. right now, and funding any preservation project on grant support raises sustainability concerns.

==Actionable Items==
*Encourage content creators and publishers to archive and preserve news content.
*Educate newspaper publishers on the use of web archiving technologies through online tutorials, etc.
*Print PDF versions of electronic prints of newspapers. (The Library requires publishers to provide us with these versions of the newspapers.)

NDSA:Digital E-Prints of Newspapers

2012-08-14T22:10:57Z

Cathy.hartman: /* At Risk Content: Newspaper E-Prints */

Return to [[NDSA:News,_Media,_and_Journalism]]

== At Risk Content: Newspaper E-Prints ==

'''Establish Value:''' A newspaper defines its community’s identity, and the loss of even a few months of their newspaper creates gaps in that community’s recorded history. High usage of the digitized historical newspapers demonstrates the value of this content to many user groups indicating that the preservation of current newspapers should be a high priority. Cultural memory organizations should coordinate with multiple partners to preserve newspapers and make them freely available online.

'''Recognize Opportunities:''' Now, newspapers produce a PDF printmaster to send to their printer. Most newspaper publishers neither preserve the PDF printmasters nor do they microfilm the printed issues, resulting in a loss of current newspaper content for future generations. The fact that all current newspapers are printed from an "e-print" file offers a unique opportunity to work with publishers to capture and preserve that file.

'''Target Audiences:''' These audiences share multiple levels of local, state, national, and international interest, but based on user feedback, discussions, and publications, the newspapers have proven of relevance to:
*Local communities: public libraries; newspaper publishers; genealogical societies; county and local governments; K-12 educators
*State-wide communities: Academic researchers; lay historians; university students and professors; archives
*National and International communities: Trending researchers; political scholars; economic analysts

'''Educating Stakeholders:''' Cultural memory organizations should communicate the role that newspaper preservation plays in community history to stakeholders through multiple venues:
*Publishers: state press association conferences; trade shows; and presentations to publishing office staff and at publishers’ meetings. Engage publishers as advocates of their own newspapers’ preservation.
*K-12 educators: Involve them in creation of grade-specific lesson plans - public school conferences, presentations to university Education students.
*Public libraries: panel presentations with partner public libraries about working together on newspaper preservation; workshop presentations at district library association meetings; conference calls with public library directors.
*Researchers, teachers, archivists, and librarians: Connect at historical association meetings and conferences; panel presentations at archivist society conferences; vendor booths, brochures, and flyers about newspaper preservation at relevant conferences.
*Standards: Follow digital preservation standards and provide education to stakeholders about the standards.

'''Obstacles and Risk Factors:''' Possible risk factors and obstacles in e-pring newspaper preservation.
*Publishers are uncomfortable giving permission to make newspapers available online.
*Public libraries and publishers do not always understand each other’s importance.
*Funding for digital preservation may not be readily available.
*Since the shift to PDF printmaster, publishers no longer microfilm newspapers.
*PDF printmasters are not recognized by publishers or public libraries as being preservation master copies. However, PDF printmaster newspapers can be OCRed, preserved, and made openly available relatively cheaply because they are in a digital file format.
*Grant-funded staffing is common in most digital newspaper programs across the U.S. right now, and funding any preservation project on grant support raises sustainability concerns.

'''Actionable Items'''
*
*
*

NDSA:Digital E-Prints of Newspapers

2012-08-14T22:02:28Z

Cathy.hartman: /* At Risk Content: Newspaper E-Prints */

Return to [[NDSA:News,_Media,_and_Journalism]]

== At Risk Content: Newspaper E-Prints ==

'''Establish Value:''' A newspaper defines its community’s identity, and the loss of even a few months of their newspaper creates gaps in that community’s recorded history. High usage of the digitized historical newspapers demonstrates the value of this content to many user groups indicating that the preservation of current newspapers a high priority. Cultural memory organizations should coordinate with multiple partners to preserve newspapers and make them freely available online. The fact that all current newspapers are printed from an "e-print" file offers a unique opportunity to work with publishers to capture and preserve that file.

'''Recognize Opportunities:''' Now, newspapers produce a PDF printmaster to send to their printer. Most newspaper publishers neither preserve the PDF printmasters nor do they microfilm the issues, resulting in a loss of current newspaper content for future generations. Recognizing the value of this content, the UNT Libraries began creating a workflow for preserving newspapers that are born digital.

'''Target Audiences:''' These audiences share multiple levels of local, state, national, and international interest, but based on user feedback, discussions, and publications, the newspapers have proven of relevance to:
*Local communities: public libraries; newspaper publishers; genealogical societies; county and local governments; K-12 educators
*State-wide communities: Academic researchers; lay historians; university students and professors; archives
*National and International communities: Trending researchers; political scholars; economic analysts

'''Educating Stakeholders:''' UNT Libraries communicates the role that newspaper preservation plays in community history to stakeholders through multiple venues:
*Publishers: state press association conferences; trade shows; and presentations to publishing office staff and at publishers’ meetings. Engage publishers as advocates of their own newspapers’ preservation.
*K-12 educators: Involve them in creation of grade-specific lesson plans - public school conferences, presentations to university Education students.
*Public libraries: panel presentations with partner public libraries about working together on newspaper preservation; workshop presentations at district library association meetings; conference calls with public library directors.
*Historical researchers, professors, and students: Connect at historical association meetings and conferences; panel presentations at archivist society conferences; vendor booths, brochures, and flyers about newspaper preservation at relevant conferences.
*Standards: Follow digital preservation standards and provide education to stakeholders about the standards.

'''Obstacles and Risk Factors:''' Possible risk factors and obstacles in digital newspaper preservation.
*Publishers are uncomfortable giving permission to make newspapers available online.
*Public libraries and publishers do not always understand each other’s importance.
*Funding for digital preservation may not be readily available.
*Since the shift to PDF printmaster, publishers no longer microfilm newspapers.
*PDF printmasters are not recognized by publishers or public libraries as being preservation master copies. However, PDF printmaster newspapers can be OCRed, preserved, and made openly available relatively cheaply because they are in a digital file format.
*Grant-funded staffing is common in most digital newspaper programs across the U.S. right now, and funding any preservation project on grant support raises sustainability concerns.

'''Actionable Items'''
*
*
*

NDSA:Digital E-Prints of Newspapers

2012-08-14T21:52:47Z

Cathy.hartman:

Return to [[NDSA:News,_Media,_and_Journalism]]

== At Risk Content: Newspaper E-Prints ==

'''Establish Value:''' A newspaper defines its community’s identity, and the loss of even a few months of that newspaper creates gaps in that community’s recorded history. The University of North Texas (UNT) Libraries’ Digital Newspaper Program coordinates with multiple partners to preserve Texas historical newspapers and make them freely available online. Taking advantage of the fact that historical newspapers were first preserved by microfilming programs like USNP, UNT began digitizing from the microfilm as a partner in the NDNP program. High usage of the digitized historical newspapers demonstrates the value of this content to many user groups.

'''Recognize Opportunities:''' Now, newspapers produce a PDF printmaster to send to their printer. Most newspaper publishers neither preserve the PDF printmasters nor do they microfilm the issues, resulting in a loss of current newspaper content for future generations. Recognizing the value of this content, the UNT Libraries began creating a workflow for preserving newspapers that are born digital.

'''Target Audiences:''' These audiences share multiple levels of local, state, national, and international interest, but based on user feedback, discussions, and publications, the newspapers have proven of relevance to:
*Local communities: public libraries; newspaper publishers; genealogical societies; county and local governments; K-12 educators
*State-wide communities: Academic researchers; lay historians; university students and professors; archives
*National and International communities: Trending researchers; political scholars; economic analysts

'''Educating Stakeholders:''' UNT Libraries communicates the role that newspaper preservation plays in community history to stakeholders through multiple venues:
*Publishers: state press association conferences; trade shows; and presentations to publishing office staff and at publishers’ meetings. Engage publishers as advocates of their own newspapers’ preservation.
*K-12 educators: Involve them in creation of grade-specific lesson plans - public school conferences, presentations to university Education students.
*Public libraries: panel presentations with partner public libraries about working together on newspaper preservation; workshop presentations at district library association meetings; conference calls with public library directors.
*Historical researchers, professors, and students: Connect at historical association meetings and conferences; panel presentations at archivist society conferences; vendor booths, brochures, and flyers about newspaper preservation at relevant conferences.
*Standards: Follow digital preservation standards and provide education to stakeholders about the standards.

'''Obstacles and Risk Factors:''' Possible risk factors and obstacles in digital newspaper preservation.
*Publishers are uncomfortable giving permission to make newspapers available online.
*Public libraries and publishers do not always understand each other’s importance.
*Funding for digital preservation may not be readily available.
*Since the shift to PDF printmaster, publishers no longer microfilm newspapers.
*PDF printmasters are not recognized by publishers or public libraries as being preservation master copies. However, PDF printmaster newspapers can be OCRed, preserved, and made openly available relatively cheaply because they are in a digital file format.
*Grant-funded staffing is common in most digital newspaper programs across the U.S. right now, and funding any preservation project on grant support raises sustainability concerns.

'''Actionable Items'''
*
*
*

NDSA:News, Media, and Journalism

2012-08-14T21:51:49Z

Cathy.hartman: /* Current Activities */

Back to [[NDSA:Content teams]]

==Scope==
The News, Media, and Journalism Content Team is interested in the preservation of national, local, regional news, citizen journalism and community news, whether eprints or websites of news organizations.

==Team Facilitator==
*Hanna, Kristine | Director, Archiving Services, Internet Archive / kristine@archive.org

==Team Members==
*Grotke, Abbie | Web Archiving Team Lead, Library of Congress, and Co-Chair of the NDSA Content Working Group | abgr@LOC.GOV | 202-707-2833 | @agrotke
*Hartman, Cathy | Associate Dean of Libraries, University of North Texas/ Co-Chair of the NDSA Content Working Group | cathy.hartman@UNT.EDU
*Moffatt, Christie | National Library of Medicine | moffattc@mail.nlm.nih.gov
*Simon, James | Center for Research Libraries | jsimon@crl.edu
*Weise, John | Manager of the Digital Library Production Service (DLPS) at the University of Michigan | jweise@UMICH.EDU
*McMillan, Gail | Virginia Polytechnic Institute and State University | gailmac@vt.edu
*Paranick, Amber | Library of Congress | ampa@loc.gov

==Current Activities==
*8/14: Begin work on case studies. Have drafts available by next meeting, September 18 at 12pm ET.

[[NDSA:Categories of News Content]]

'''Draft Case Studies:'''

[[NDSA:Community and Hyperlocal News]]

[[NDSA:Citizen Journalism]]

[[NDSA:Digital E-Prints of Newspapers]]

==Meetings==

'''Meeting Minutes'''
(link to meeting minutes)
*[[NDSA:March 22, 2012]]

NDSA:News, Media, and Journalism

2012-08-14T21:49:21Z

Cathy.hartman: /* Current Activities */

Back to [[NDSA:Content teams]]

==Scope==
The News, Media, and Journalism Content Team is interested in the preservation of national, local, regional news, citizen journalism and community news, whether eprints or websites of news organizations.

==Team Facilitator==
*Hanna, Kristine | Director, Archiving Services, Internet Archive / kristine@archive.org

==Team Members==
*Grotke, Abbie | Web Archiving Team Lead, Library of Congress, and Co-Chair of the NDSA Content Working Group | abgr@LOC.GOV | 202-707-2833 | @agrotke
*Hartman, Cathy | Associate Dean of Libraries, University of North Texas/ Co-Chair of the NDSA Content Working Group | cathy.hartman@UNT.EDU
*Moffatt, Christie | National Library of Medicine | moffattc@mail.nlm.nih.gov
*Simon, James | Center for Research Libraries | jsimon@crl.edu
*Weise, John | Manager of the Digital Library Production Service (DLPS) at the University of Michigan | jweise@UMICH.EDU
*McMillan, Gail | Virginia Polytechnic Institute and State University | gailmac@vt.edu
*Paranick, Amber | Library of Congress | ampa@loc.gov

==Current Activities==
*8/14: Begin work on case studies. Have drafts available by next meeting, September 18 at 12pm ET.

[[NDSA:Categories of News Content]]

'''Draft Case Studies:'''

[[NDSA:Community and Hyperlocal News]]

[[NDSA:Citizen Journalism]]

[[NDSA:Newspaper E-Prints]]

==Meetings==

'''Meeting Minutes'''
(link to meeting minutes)
*[[NDSA:March 22, 2012]]

NDSA:Digital E-Prints of Newspapers

2012-08-14T21:48:22Z

Cathy.hartman: /* At Risk Content: Born Digital Newspapers [original title from Cathy's doc - Change title?] */

Return to [[NDSA:News,_Media,_and_Journalism]]

== At Risk Content: Newspaper E-Prints

'''Establish Value:''' A newspaper defines its community’s identity, and the loss of even a few months of that newspaper creates gaps in that community’s recorded history. The University of North Texas (UNT) Libraries’ Digital Newspaper Program coordinates with multiple partners to preserve Texas historical newspapers and make them freely available online. Taking advantage of the fact that historical newspapers were first preserved by microfilming programs like USNP, UNT began digitizing from the microfilm as a partner in the NDNP program. High usage of the digitized historical newspapers demonstrates the value of this content to many user groups.

'''Recognize Opportunities:''' Now, newspapers produce a PDF printmaster to send to their printer. Most newspaper publishers neither preserve the PDF printmasters nor do they microfilm the issues, resulting in a loss of current newspaper content for future generations. Recognizing the value of this content, the UNT Libraries began creating a workflow for preserving newspapers that are born digital.

'''Target Audiences:''' These audiences share multiple levels of local, state, national, and international interest, but based on user feedback, discussions, and publications, the newspapers have proven of relevance to:
*Local communities: public libraries; newspaper publishers; genealogical societies; county and local governments; K-12 educators
*State-wide communities: Academic researchers; lay historians; university students and professors; archives
*National and International communities: Trending researchers; political scholars; economic analysts

'''Educating Stakeholders:''' UNT Libraries communicates the role that newspaper preservation plays in community history to stakeholders through multiple venues:
*Publishers: state press association conferences; trade shows; and presentations to publishing office staff and at publishers’ meetings. Engage publishers as advocates of their own newspapers’ preservation.
*K-12 educators: Involve them in creation of grade-specific lesson plans - public school conferences, presentations to university Education students.
*Public libraries: panel presentations with partner public libraries about working together on newspaper preservation; workshop presentations at district library association meetings; conference calls with public library directors.
*Historical researchers, professors, and students: Connect at historical association meetings and conferences; panel presentations at archivist society conferences; vendor booths, brochures, and flyers about newspaper preservation at relevant conferences.
*Standards: Follow digital preservation standards and provide education to stakeholders about the standards.

'''Obstacles and Risk Factors:''' Possible risk factors and obstacles in digital newspaper preservation.
*Publishers are uncomfortable giving permission to make newspapers available online.
*Public libraries and publishers do not always understand each other’s importance.
*Funding for digital preservation may not be readily available.
*Since the shift to PDF printmaster, publishers no longer microfilm newspapers.
*PDF printmasters are not recognized by publishers or public libraries as being preservation master copies. However, PDF printmaster newspapers can be OCRed, preserved, and made openly available relatively cheaply because they are in a digital file format.
*Grant-funded staffing is common in most digital newspaper programs across the U.S. right now, and funding any preservation project on grant support raises sustainability concerns.

'''Actionable Items'''
*
*
*

NDSA:Big Picture Group

2012-05-29T15:59:06Z

Cathy.hartman:

Back to [[NDSA:Content teams]]

==Scope/Vision==
'''DRAFT'''

As much of the effort of the Content Working Group breaks down into specific format- and genre-focused teams, the purpose of the “Big Picture Team” is to provide a venue for continued discussion of the broader perspective on content preservation. On the one hand the group will observe the work of the specific action teams and look for gaps not being covered or natural alliances between the activities of various teams. On the other hand the group will seek to place the work of the Content teams within the larger context of NDSA’s mission and of activities taking place beyond NDSA.

==Team Facilitator==
'''Co-facilitator: Grotke, Abbie | Library of Congress, and Co-Chair of the NDSA Content Working Group | abgr@LOC.GOV '''

'''Co-facilitator: Hartman, Cathy | University of North Texas/ Co-Chair of the NDSA Content Working Group | cathy.hartman@UNT.EDU '''

==Team Members==

*Hanna, Kristine | Director, Archiving Services, Internet Archive / kristine@archive.org
*Stoller, Michael | New York University | Michael.stoller@NYU.EDU
*Potter, Abbey | Library of Congress | abpo@LOC.GOV
*Wurl, Joel | National Endowment for the Humanities | jwurl@neh.gov
*Cruse, Patricia | California Digital Library | patricia.cruse@UCOP.EDU
*Anderson, Martha | Director, NDIIPP, Library of Congress | mande@loc.gov
*Wilkin, John | University of Michigan / Hathi Trust | jpwilkin@UMICH.EDU
*Rumsey, Abby Smith | Library of Congress/NDIIPP | abby@arumsey.com
*Frick, Rachel | Council on Independent and Research Libraries (CLIR) | rfrick@clir.org

==Current Activities==
*Drafting and finalizing "vision" statement.
*Revisiting and reworking description of CWG scope of work.

==Meetings==

Next meeting is schedule for:

'''Meeting Minutes'''
(link to meeting minutes)

*[[NDSA:May 2012]]

NDSA:Content Working Group

2012-03-23T20:07:13Z

Cathy.hartman: /* Meeting Schedule and Minutes */

== Statement of Purpose ==

The Content [[NDSA:Terms#Working_Group|Working Group]] will focus on identifying content already preserved, investigating guidelines for the selection of significant content, discovery of at-risk digital content or collections, and matching orphan content with NDSA partners who will acquire the content, preserve it, and provide access to it.

== Members ==
A list of current participants is posted here: [[NDSA:Content Working Group Members]].

== How to Get Involved ==
Contact [[NDSA:Terms#Working_Group_Co-Chairs|co-chairs]] Cathy Hartman (Cathy.Hartman@unt.edu) and Abbie Grotke (abgr@loc.gov) to join the working group or to learn more about how to get involved.

Every member is encouraged to join one or more [[NDSA:content teams]]. We encourage all members to participate in the working group in some capacity: whether by calling into a meeting, joining an
[[NDSA:Terms#Action_Team|Action Team]] and helping with small or large tasks to accomplish Action Team goals, helping take minutes for our meetings, or contributing ideas via the listserv or phone calls. Any contributions are welcome! New members or existing members interested in getting more involved in the Content Working Group should review the current scope of work and action team information below. Contact your co-chairs Cathy or Abbie, or any of the Action Team leads, for more information or to jump right in and participate.

If you have a new idea for an action team or something that the Content Working Group might take on, please offer it up to the group! We want to be doing things of interest to the entire working group.

== Current Scope of Work ==
The Content Working Group’s current scope of work is to:

'''A)''' Develop or contribute to a registry of content already preserved by NDSA members.

'''B)''' Develop a clearinghouse that will enable a variety of stakeholders (content producers, archives and libraries and other potential preservationists) to:
*Determine what specific types of content or collections are at risk.
*Identify at-risk content or collections for preservation.
*Match orphan collections with appropriate trusted partner for access and preservation.

=== Message from the Co-Chairs about Restructuring in 2012 ===
See the [[NDSA:Plan for 2012]] page for the message sent to the list January 18, 2012 about restructuring to break into content teams.

=== Content Teams ===

Content teams are a new concept - these pages are a work in progress:

[[NDSA:About the Content Teams]]

See a list of [[NDSA:content teams]] and sign up to join one!

[[NDSA:Content Team To-Dos]]

=== Content Registry Action Team ===
Visit the [[NDSA:Content Registry Action Team]] (Group A) page for information about work plans, meetings, and participants.

If you have a collection that you have commited to preserving, please enter the collection in our [https://docs.google.com/spreadsheet/viewform?pli=1&formkey=dHAwVE9odEVpTzZYdDJqcDJuZzdqRXc6MQ#gid=0 preservation registry].

=== Clearinghouse Action Team ===
Visit the [[NDSA:Clearinghouse Action Team]] (Group B) page for information about work plans, meetings, and participants.

=== Appraisal of Local Government Information Action Team ===

An outcome of the CWG workshop, a need was determined for guidance on appraisal for local government information. This group has since been absorbed into the Government Content Team. http://www.loc.gov/extranet/wiki/osi/ndiip/ndsa/index.php?title=Content_teams

=== Blog Preservation Action Team ===

An outcome of the CWG workshop, an action team was formed to explore the idea of a blog preservation plugin. Visit the [[NDSA:Blog Preservation]] page for more information.

=== Web Archiving Survey ===
LC took the lead on developing a survey of Web Archiving organizations in the U.S. to see what the scope of collecting is. The survey was out in October 2011 and some CWG members are analyzing results now. Here's a page [[NDSA:Web Archiving Survey]] where the draft survey questions were worked on. For more information, contact Abbie (abgr@loc.gov).

== Meeting Schedule and Minutes ==

'''2012 Meetings'''

*January 2012 - No meeting - Happy New Year!
*February 1, 2012 - [[NDSA:Content WG February 1, 2012 Meeting Minutes]]
*March 7, 2012 - 11:00AM - 12:00PM ET - [[NDSA:Content WG March 7, 2012 Meeting Minutes]]
*April 4, 2012 - 11:00AM - 12:00 PM EDT

Will move to bi-monthly meetings after the April meeting, with the next meeting on June 6, 2012.

'''2011 Meetings'''

In 2011, regular Webex meetings were from 11:00 AM – 12:00 PM ET the first Wednesday of each month.

*January 5, 2011 - [[NDSA:Content WG January 5, 2011 Meeting Minutes]]
*February 2, 2011 - [[NDSA:Content WG February 2, 2011 Meeting Minutes]]
*March 2, 2011 - [[NDSA:Content WG March 2, 2011 Meeting Minutes]]
*April 6, 2011 - [[NDSA:Content WG April 6, 2011 Meeting Minutes]]
*May 4, 2011 - [[NDSA:Content WG May 4, 2011 Meeting Minutes]]
*June 1, 2011 - [[NDSA:Content WG June 1, 2011 Meeting Minutes]]
*July 7, 2011 - [[NDSA:Content WG July 6, 2011 Meeting Minutes]]
*July 19, 2011 (in person, in DC) - [[NDSA:Content WG July 19, 2011 Meeting Minutes]]
*August 3, 2011 - [[NDSA:Content WG August 3, 2011 Meeting Minutes]]
*September 7, 2011 - [[NDSA:Content WG September 7, 2011 Meeting Minutes]]
*October 5, 2011 - [[NDSA:Content WG October 5, 2011 Meeting Minutes]]
*November 2, 2011 - No general meeting this month; Blog Preservation meeting instead (minutes here: [[NDSA:November_2_Blog_Preservation_Meeting_Minutes]])
*December 7, 2011 - [[NDSA:Content WG Decembr 7, 2011 Meeting Minutes]]

'''2010 Meetings'''

Two meetings were held in 2010 to kick-off the Working Group and to develop the charter:

*November 5, 2010 from 11:00 AM – 12:00 PM ET - [[NDSA:Content WG November 5, 2010 Meeting Minutes]]
*December 8, 2010 from 11:00 AM – 12:00 PM ET - [[NDSA:Content WG December 8, 2010 Meeting Minutes]]

==Practices==

The group will work and collaborate using the following tools and mechanisms:
*Listserv: contact Abbie (abgr@loc.gov) to be added or removed. The [http://list.digitalpreservation.gov/scripts/wa-DIGITAL.exe?A0=NDSA-CONTENT&X=0EA593253F4C274AA2&Y=abgr%40loc.gov list archives] are available to members (requires login).
*Regular conference calls/Webex: see meetings section below.
*Annual conference
*Wiki: you're here!
*IdeaScale: http://ndsa.ideascale.com/

NDSA:Content teams

2012-01-30T23:46:01Z

Cathy.hartman:

NDSA:Content WG Decembr 7, 2011 Meeting Minutes

2011-12-08T00:54:46Z

Cathy.hartman:

===Attendees (13)===

*Allen, Vickie | PBS | vlallen@pbs.org
*Hanna, Kristine | Internet Archive | kristine@ARCHIVE.ORG
*Hartman, Cathy | Associate Dean of Libraries, University of North Texas/ Co-Chair of the NDSA Content Working Group | cathy.hartman@UNT.EDU
*Haws, Barabara | New York Philharmonic | hawsb@nyphil.org
*Howard, Rachel | University of Louisville | rachel.howard@LOUISVILLE.EDU
*Kepley, David | NARA | david.kepley@nara.gov
*McAninch, Glen | Kentucky Department for Libraries and Archives | Glen.McAninch@ky.gov
*Maes, Margaret | Legal Information Preservation Alliance | mkmaes@gmail.com
*Moffatt, Christie | National Library of Medicine | moffattc@mail.nlm.nih.gov
*Muller, Chris | Muller Media Conversions | chris.muller@mullermedia.com
*Potter, Abbey | Library of Congress | abpo@LOC.GOV
*Rumsey, Abby Smith | Library of Congress/NDIIPP | abby@arumsey.com
*Stoller, Michael | New York University | Michael.stoller@NYU.EDU
*Stierholz, Katrina |Federal Reserve Bank of St. Louis | katrina.l.stierholz@stls.frb.org

'''1) Report from the Content Registry Action Team (Daniel)''' (submitted after meeting)

A) Finalized digital preservation levels in consultation with NDSA e-mail lists

B) Settled on ViewShare formerly Recollection to hold registry data

C) Created an online spreadsheet for alliance members to gather collection information.

'''Web form at:''' https://docs.google.com/spreadsheet/viewform?hl=en_US&formkey=dHAwVE9odEVpTzZYdDJqcDJuZzdqRXc6MQ#gid=0
'''Underlying spreadsheet at''' https://docs.google.com/spreadsheet/ccc?key=0As38O3bxTxXvdHAwVE9odEVpTzZYdDJqcDJuZzdqRXc&hl=en_US#gid=0

Guidance desired from CWG - Reactions to web form? What should we change? When form ready is e-mail to NDSA-all sufficient or should we take a different approach to getting people to input collections?

'''2) Report from the State and Local Government Information Action Team (Margie)''' No progress yet but has been a good discussion about state record retention requirements on BP Exchange email list serve.
Will set up a conference call for January

'''3)Brief update from the Blog Preservation group (Cathy)''' There was a meeting in early November to discuss project. Working with Word Press for a generic "preservation plug in" to make it easy for bloggers to request that their content be captured and archived. The meeting was well attended and ended with some action items.

'''4)Brief update on the Web Archiving survey (Cathy)'''
Survey was completed. Information is available and posted on the wiki. We need some analysis -anybody have the skill set in their organization to help. Michael from NYU could ask his data services librarian.

'''5)Discussion: Managing a working group with almost 70 members.''' (Cathy and everyone)
We have gotten so large. How do we get this large group functioning - on phone etc
Asking Steering Committee for input. For example, should we form action groups with 10-15 people with regular check ins and then perhaps we have quarterly crawls for the larger Content WG.
The large calls are helpful but perhaps have them less frequently which give us more time to get things done/make things happen.
The monthly WG calls are not well attended - maybe it is the technology makes it hard to hear/get through. Working in smaller chunks makes sense. When we have a concrete task (like plug in)
it is easier to engage more people. Can we use the list serve/wiki for more communication and stay in touch? Sometimes hard to remember to look at the wiki/list serve as we are all so busy.
We have the largest group. We might be more successful if we have specific projects. How do we move forward the work of this large group when people are so busy? Please send ideas onto Cathy and Abbie if you have any ideas.

'''6)Our one year anniversary'''
Anybody have any thoughts? Have we made progress? We have made some tremendous beginnings given the scale we are undertaking we have some coherence and have taken shape.
Team leaders have helped get this going. It is great that we have so many people and we can handle this many people on this important issue as in "what do we collect?". People have jumped in and
started figuring it out.

'''7)Announcements or other discussion'''
No meeting scheduled for January yet. '''Next meeting set for February 1st at 11 AM EST.'''

NDSA:Content Working Group Members

2011-09-09T23:22:56Z

Cathy.hartman:

NDSA:Web Archiving Survey

2011-08-04T17:48:35Z

Cathy.hartman: -----------------------------------------------------------------------------------

The goals of the survey are to find out the scope of collecting web content in the United States: what organizations collection development policies state (if they have one), what they are actually collecting, and what services are being used to archive, among other things.

If anyone is interested in helping develop this survey, contact Abbie Grotke (abgr@loc.gov).

==Draft Survey Questions==

*Organization information (name, URL, contact, etc.)
**Type of organization:
***Historical Society
***College or University
***Museum
***Public Library
***Consortium
***K-12 School
***Federal Government
***State Government (including Archives, state records centers, or Libraries (or keep separate?)(I would include. They generally do this work based on state statute or regs.)
***Local Government (what is the difference in "local" and "city"?)
***City Government
***County Government
***Other (please describe)
*How long have you been archiving
*Are you using a service or company to archive, or crawling in-house
**if service what one (Archive-IT, IA's crawling services, Hanzo, Iterasi etc.)
**if in-house, what crawling tools used (heritrix, httrack, other)
*Does your organization have collection policies that cover web archiving?
**are these publicly accessible (provide URL)
**If not but you are willing to share... (give instructions for emailing?)
*Scope of collecting, various Qs about what they archive (initial list from Archive-IT, will flesh this out to include more, allow for comments or description):
**Arts & Humanities
***Dance
***Music
***Art
***Literature
***Architecture
***Film/Television (?)
**Blogs and Social Media
***Blogs
***Facebook
***Twitter
***Youtube and other video
***All of above as part of regular collecting of websites
**Computers and Technology
***software
***gaming
***other?
**Government
***State
***Federal
***City
***County
**Spontaneous Events, for example: natural disasters, tragedy, environmental events, spontaneous political demonstrations
**Politics and Elections
***Local elections
***State elections
***Federal elections
**Science and Health
**Society and Culture
**Universities and Libraries
**News
***Newspapers
***Citizen Journalism/Community News
***Broadcast/Television
**International content (leave open-ended, let them describe what they are collecting internationally?)
***topical (specific subject area - sports, political parties, cultural events)
***geographical (one country or many)
*Permissions/Copyright
**Crawl permissions
**Access permissions
**Respect robots (?)
*Access
**Access tool
**Full text indexing?
**Public access URL:
*Researchers (do we want any questions on research use?)(Yes. Could ask in an open-ended way how researchers are using the content)
*Ever participated in a collaborative web archive (give examples), yes/no
**if so, describe role/project
*Interested in collaborating on future projects?

==Distribution==
*NDSA/NDIIPP listservs/blog/twitter, etc.
*IIPC Curators list
*Archive-IT list
*ALA groups (need to find people we don't normally talk to)

NDSA:Content WG July 6, 2011 Meeting Minutes

2011-07-06T23:37:38Z

Cathy.hartman: /* CWG Schedule at the NDIIPP/NDSA Meeting in July */

Return to [[NDSA:Content Working Group]] Home

== NDSA Content Meeting Minutes ==

DRAFT

Wednesday, July 6, 2011 11am EST

===Attendees (14)===

[Note to attendees: If we left anyone off, please add your name or let Abbie know and I'll add it]

*Abrams, Brett | National Records and Archives Administration | Brett.Abrams@nara.gov
*Cornwall, Daniel | Alaska State Library | daniel.cornwall@ALASKA.GOV
*Frick, Rachel | Council on Independent and Research Libraries (CLIR) | rfrick@clir.org
*Grotke, Abbie | Web Archiving Team Lead, Library of Congress, and Co-Chair of the NDSA Content Working Group | abgr@LOC.GOV | 202-707-2833 | @agrotke
*Hanna, Kristine | Internet Archive | kristine@ARCHIVE.ORG
*Hartman, Cathy | Associate Dean of Libraries, University of North Texas/ Co-Chair of the NDSA Content Working Group | cathy.hartman@UNT.EDU
*Knies, Jennie | Manager, Digital Collections, University of Maryland | levjen@UMD.EDU
*Maes, Margaret | Legal Information Preservation Alliance | mkmaes@gmail.com
*Maynard, Marc | University of Connecticut | marc.maynard@UCONN.EDU
*Ogilvie, Kris | Digital Programs Consultant, California State Library | kogilvie@LIBRARY.CA.GOV
*Lyle, Jared (for Pienta, Amy) | University of Michigan/Data-PASS |
*Rossum, Deborah |Digital Content Manager| SCOLA |712-566-2202| drossum@SCOLA.ORG
*Rumsey, Abby Smith | Library of Congress/NDIIPP | abby@arumsey.com
*Stoller, Michael | New York University | Michael.stoller@NYU.EDU

==CWG Schedule at the NDIIPP/NDSA Meeting July 19-21==

Cathy kicked off the discussion. The CWG meeting will be 10:30-11:30/noon on Tuesday, and we will try to get a webex for that. Will depend on the meeting room configuration but we are hopeful this will be okay.

The Clearinghouse Workshop will be 3:30-5pm Wednesday. Not sure about call-in - more unlikely that room will allow for it but we will keep everyone posted.

==Report from Action Team A ==
Daniel reported out from Action team A - we decided we want to build the registry off of Recollection. Using subject fields in NDIIPP partner registry in Recollection as starting point, we narrowed to current listing of fields (which he showed). We've knocked out a few of these and narrowed down (for instance, not using project name, seemed NDIIPP specific). Definition of digital preservation: we are probably going to have a few more fields to cover that, to allow members to self-identify which ALA definition/criteria they fit in. He put this list out for comment, but early summer not good for gathering feedback, so we need more time to finalize fields, then the group will do another survey to NDSA. After July meeting we'll have survey for all alliance members.

Daniel will try to get the list of fields on wiki later today.

Additional issue: the group agreed to make the registry as easy to possible to join/participate. Asking people to submit spreadsheets to load to recollection seems the way we will go; may not be the easiest solution but not sure what else we can do to make easier.

==Report from Action Team B==

Clearinghouse workshop is July 20 at 3:30. Hoping to get remote participation but not sure what the room configuration will allow. This will be open to anyone at the NDIIPP/NDSA who wants to participate so may be more than CWG members there.

Objective: to continue work of group B, identifying at-risk categories and whittle down selections into an action-oriented list. Excel sheet that she and Glen put together, had some participation on phone calls, but probably overwhelming for others. They are working on assembling diagram of at-risk selections, a more user-friendly visual to look at. Also assembling examples of as many categories as possible in Google docs, with links to examples. Plan to look at them in workshop, help stimulate some ideas and discussion. Hopefully it will help clarify what we are talking about.

Cathy added that we will have a facilitator for the group; we have asked for someone specific but it hasn't been confirmed yet.

==Web Archiving Survey==

Abbie reported that LC is very interested in conducting a survey of anyone in the US doing web archiving, to get a better idea of the scope and reach of various web archiving programs and what people are collecting (or what is not being collected). Maybe the NDSA CWG could sponsor the survey?

Cathy and Kristine expressed interested in such a survey. If anyone is interested in helping draft the survey, let Abbie know. We would also welcome help from members in distributing it once it is done.

==Other items or announcements==

Brett mentioned a conference/panel he was invited to that he is unable to speak at. He will send information to the list, in case someone else can do it. It is the Geological Society of America (GSA) a session called "Data Preservation and Management in the Coming Decade" - if anyone is interested feel free to jump on it!

Abbie is sitting in on the GPO talk on their digital registry that Daniel sent information about recently. She resent to the list so others could have a reminder of the details.

See some of you in a few weeks!

=== Next Meeting ===
Our next in-person meeting will be Tuesday, July 19, 10:30-12:00, in DC (hotel conference room assignment to come).
Our next call will be August 3 at 11am EST. Agenda and call details to be sent a few days prior.

-End-

NDSA:Content Working Group Members

2011-01-17T18:22:14Z

Cathy.hartman:

Return to [[NDSA:Content Working Group]] Home

== Current Content Working Group Members ==

Members: To help us get to know each other a bit better, please add your job title or other information you'd like to share with the group (phone #, Twitter handle, etc.).

===By Last Name===
*Abrahamson, Mark | Roper Center | m.abrahamson@COX.NET
*Abrams, Brett | National Records and Archives Administration | Brett.Abrams@nara.gov
*Anderson, Martha | Director, NDIIPP, Library of Congress | mande@loc.gov
*Baker, Timothy D. | Maryland State Archives | timb@MDSA.NET
*Cariani, Karen | WGHB | karen_cariani@WGBH.ORG
*Cornwall, Daniel | Alaska State Library | daniel.cornwall@ALASKA.GOV
*Cook, Glenn | Alaska State Library | glenn.cook@ALASKA.GOV
*Crabtree, Johnathan | University of North Carolina | jonathan_crabtree@UNC.EDU
*Cruse, Patricia | California Digital Library | patricia.cruse@UCOP.EDU
*Falk, Elizabeth | Idaho Historical Society | elizabeth.falk@ISHS.IDAHO.GOV
*Fenton, Eileen | Ithaka | eileen.fenton@ITHAKA.ORG
*Grotke, Abbie | Web Archiving Team Lead, Library of Congress, and Co-Chair of the NDSA Content Working Group | abgr@LOC.GOV | 202-707-2833 | @agrotke
*Halbert, Martin | MetaArchive Alliance | martin.halbert@UNT.EDU
*Hanna, Kristing | Internet Archive | kristine@ARCHIVE.ORG
*Hartman, Cathy | Associate Dean of Libraries, University of North Texas/ Co-Chair of the NDSA Content Working Group | cathy.hartman@UNT.EDU
*Horton, Robert | Minnesota Historical Society | robert.horton@MNHS.ORG
*Howard, Rachel | Digital Initiatives Librarian, University of Louisville | rachel.howard@LOUISVILLE.EDU
*Jaja, Joseph | University of Maryland | josephj@UMD.EDU
*Kirschenbaum, Mathew | University of Maryland | mkirschenbaum@GMAIL.COM
*Knies, Jennie | Manager, Digital Collections, University of Maryland | levjen@UMD.EDU
*Marchionini, Gary | University of North Carolina | gary@ILS.UNC.EDU
*Maynard, Marc | University of Connecticut | marc.maynard@UCONN.EDU
*McAninch, Glen | Kentucky Department for Libraries and Archives | Glen.McAninch@ky.gov
*Moffatt, Christie | National Library of Medicine | moffattc@mail.nlm.nih.gov
*Norman, Jody | Division of Libraries and Information Services, Florida Department of State | jnorman@DOS.STATE.FL.US
*Ogilvie, Kris | California State Library | kogilvie@LIBRARY.CA.GOV
*Owens, Trevor | Library of Congress | trow@loc.gov
*Pienta, Amy | University of Michigan/Data-PASS | apienta@umich.edu
*Potter, Abbey | Library of Congress | abpo@LOC.GOV
*Pulford, Curtis | Wisconsin Department of Administration | curtis.pulford@WISCONSIN.GOV
*Rossum, Deborah | SCOLA | drossum@SCOLA.ORG
*Rumsey, Abby Smith | Library of Congress/NDIIPP | abby@arumsey.com
*Smorul, Mike | University of Maryland | toaster@umiacs.umd.edu
*Steele, Patricia | University of Maryland | pasteele@umd.edu
*Stoller, Michael | New York University | Michael.stoller@NYU.EDU
*Swanson, Kevin | Maryland State Archives | kevins@MDARCHIVES.STATE.MD.US
*Teague, Barbara | Kentucky Department for Libraries and Archives | barbara.teague@KY.GOV
*Timmons, Michelle | Minnesota Office of the Revisor of Statutes | michele.timmons@REVISOR.MN.GOV
*Timms-Ferrara, Lois | University of Connecticut | lois.timmsferrara@UCONN.EDU
*Tracy, Toni | Portico | Toni.Tracy@ithaka.org
*Watters, Pete | Arizona State Library, Archives, and Public Records | pwatters@LIB.AZ.US
*Weible, Arlene | Oregon State Library | arlene.weible@STATE.OR.US
*Weise, John | Manager of the Digital Library Production Service (DLPS) at the University of Michigan | jweise@UMICH.EDU

===By Organization===

*Alaska State Library
**Daniel Cornwall - daniel.cornwall@ALASKA.GOV
**Glenn Cook - glenn.cook@ALASKA.GOV
*Arizona State Library, Archives, and Public Records - Pete Watters - pwatters@LIB.AZ.US
*California Digital Library - Patricia Cruse - patricia.cruse@UCOP.EDU
*California State Library - Kris Ogilvie - kogilvie@LIBRARY.CA.GOV
*Division of Libraries and Information Services, Florida Department of State - Jody Norman - jnorman@DOS.STATE.FL.US
*Idaho Historical Society - Elizabeth Falk - elizabeth.falk@ISHS.IDAHO.GOV,
*Internet Archive - Kristine Hanna - kristine@ARCHIVE.ORG
*Ithaka - Eileen Fenton - eileen.fenton@ITHAKA.ORG
*Kentucky Department for Libraries and Archives
**Barbara Teague -barbara.teague@KY.GOV
**Glen McAninch - Glen.McAninch@ky.gov
*Library of Congress
**Abbey Potter - abpo@LOC.GOV
**Abbie Grotke - abgr@LOC.GOV
**Martha Anderson - mande@LOC.GOV
**Trevor Owens – trow@loc.gov
**Abby Smith Rumsey – abby@arumsey.com
*Maryland State Archives
**Kevin Swanson - kevins@MDARCHIVES.STATE.MD.US
**Timothy D. Baker - timb@MDSA.NET
*MetaArchive Alliance - Martin Halbert - martin.halbert@UNT.EDU
*Minnesota Historical Society - Robert Horton - robert.horton@MNHS.ORG
*Minnesota Office of the Revisor of Statutes - Michele Timmons - michele.timmons@REVISOR.MN.GOV
*National Library of Medicine - Christie Moffatt | moffattc@mail.nlm.nih.gov
*National Records and Archives Administration – Brett Abrams - ‎ Brett.Abrams@nara.gov
*New York University - Michael Stoller - Michael.stoller@NYU.EDU
*Oregon State Library - Arlene Weible - arlene.weible@STATE.OR.US
*Portico - Toni Tracy - Toni.Tracy@ithaka.org
*Roper Center - Mark Abrahamson - m.abrahamson@COX.NET
*SCOLA - Deborah Rossum - drossum@SCOLA.ORG
*University of Connecticut
**Lois Timms-Ferrara - lois.timmsferrara@UCONN.EDU
**Marc Maynard - marc.maynard@UCONN.EDU
*University of Louisville - Rachel Howard (Digital Initiatives Librarian) - rachel.howard@LOUISVILLE.EDU
*University of Maryland
**Jennie Knies (Manager, Digital Collections) levjen@UMD.EDU
**Patricia Steele pasteele@umd.edu
**Mathew Kirschenbaum - mkirschenbaum@GMAIL.COM
**Mike Smorul - toaster@umiacs.umd.edu
**Joseph JaJa - josephj@UMD.EDU
*University of Michigan – Data-PASS - Amy Pienta - apienta@umich.edu
*University of Michigan- Manager of the Digital Library Production Service (DLPS) - John Weise - jweise@UMICH.EDU
*University of North Carolina
**Gary Marchionini - gary@ILS.UNC.EDU
**Johnathan Crabtree - jonathan_crabtree@UNC.EDU
*University of North Texas - Cathy Hartman - cathy.hartman@UNT.EDU
*WGHB - Karen Cariani - karen_cariani@WGBH.ORG
*Wisconsin Department of Administration - Curtis Pulford - curtis.pulford@WISCONSIN.GOV

NDSA:Clearinghouse Action Team

2011-01-06T18:36:44Z

Cathy.hartman:

Return to [[NDSA:Content Working Group]] Home

==Clearinghouse Action Team (Group B)==

=== Description of Work ===

Develop a clearinghouse that will enable a variety of stakeholders (content producers, archives and libraries and other potential preservationists) to:
*Determine what specific types of content or collections are at risk.
*Identify at-risk content or collections for preservation.
*Match orphan collections with appropriate trusted partner for access and preservation.

At the December 8th call, it was decided that this group would start with determining what specific types of content or collections are at risk.

===Action Team Members===

*'''LEADER:''' Kristine Hanna, Internet Archive (kristine@archive.org)
*Michael Stoller, New York University (Michael.stoller@NYU.EDU)
*Glen McAninch, Kentucky Department for Libraries and Archives (Glen.McAninch@ky.gov)
*Matt Kirschenbaum, University of Maryland (mkirschenbaum@GMAIL.COM)
*Deborah Rossum, SCOLA (drossum@SCOLA.ORG)
*Pat Steele, University of Maryland (pasteele@umd.edu)
*John Weise, University of Michigan (jweise@UMICH.EDU)
*Amy Pienta, University of Michigan/Data-PASS (apienta@umich.edu)
*Tricia Cruse, California Digital Library (patricia.cruse@ucop.edu)
*Curtis Pulford, Wisconsin Department of Administration (curtis.pulford@wisconsin.gov)
*Cathy Hartman, University of North Texas (cathy.hartman@unt.edu)
*Guest Participant: John Faundeen, US Geological Service (faundeen@usgs.gov)

If you are interesting in joining this Action Team, please contact Kristine Hanna to sign up.