NDSA:Digital Preservation X-Challenges - Revision history

Dlfadm: 10 revisions imported: Migrate NDSA content from Library of Congress

2016-02-11T19:17:53Z

10 revisions imported: Migrate NDSA content from Library of Congress

← Older revision		Revision as of 15:17, 11 February 2016
(No difference)

Mbeck: /* Action Team Members */

2011-07-07T16:02:56Z

Action Team Members

← Older revision		Revision as of 12:02, 7 July 2011
Line 3:		Line 3:
	==Action Team Members==		==Action Team Members==
	*Micah Beck, University of Tennessee		*Micah Beck, University of Tennessee
	*Jane Mandelbaum, Library of Congress		*Jane Mandelbaum, Library of Congress

			*Dean Farrel, State Library of North Carolina
			*James S. Plank, University of Tennessee
	*John Spencer, BMS/Chace		*John Spencer, BMS/Chace
	*Dean Farrel, State Library of North Carolina
	*Micah Altman, Harvard University		*Micah Altman, Harvard University
	*Mike Smorul, University of Maryland		*Mike Smorul, University of Maryland
	*James S. Plank, University of Tennessee

	==Project Overview==		==Project Overview==

Mbeck: /* Action Team Members */

2011-07-07T16:01:55Z

Action Team Members

← Older revision		Revision as of 12:01, 7 July 2011
Line 8:		Line 8:
	*Micah Altman, Harvard University		*Micah Altman, Harvard University
	*Mike Smorul, University of Maryland		*Mike Smorul, University of Maryland
			*James S. Plank, University of Tennessee

	==Project Overview==		==Project Overview==
	This group will plan and launch a set of challenges and/or prizes in to spur innovation in digital preservation. Group members will focus on defining the challenges, promoting them, and exploring ways to identify funding to support challenges if it is determined that funding would be appropriate. The action team will communicate over email and report their work on their wiki page. Email Jane Mandelbaum (jman@loc.gov) if you would like to participate.		This group will plan and launch a set of challenges and/or prizes in to spur innovation in digital preservation. Group members will focus on defining the challenges, promoting them, and exploring ways to identify funding to support challenges if it is determined that funding would be appropriate. The action team will communicate over email and report their work on their wiki page. Email Jane Mandelbaum (jman@loc.gov) if you would like to participate.

Mbeck: /* BitStab */

2011-06-30T18:41:32Z

BitStab

← Older revision		Revision as of 14:41, 30 June 2011
Line 27:		Line 27:
	The pursuit of the second goal in particular will require that the metrics used will be developed in cooperation with the operators of data archives and the developers and vendors of storage technologies.		The pursuit of the second goal in particular will require that the metrics used will be developed in cooperation with the operators of data archives and the developers and vendors of storage technologies.

	The first step, which will be discussed at the Digital Preservation Challenges workshop at the upcoming NDIIPP/NDSA Partners meeting, will be to organize efforts to define one or more metrics that could be used as the basis for ranking the most massive data archives. Working group co-chair and action team leader Micah Beck has written up some notes on his proposed approach to the problem. He proposed the development of "service level agreements (SLAs)" for access to archived data, and then simply measuring bit-years maintained under a specific SLA. In such a framework, the key problem is to define appropriate SLA to match the intended characteristics of a particular class of data archives. Beck's notes on the subject can be found ~~here~~ [[NDSA: ~~File~~:Defining_Bit_Stability.pdf ]].		The first step, which will be discussed at the Digital Preservation Challenges workshop at the upcoming NDIIPP/NDSA Partners meeting, will be to organize efforts to define one or more metrics that could be used as the basis for ranking the most massive data archives. Working group co-chair and action team leader Micah Beck has written up some notes on his proposed approach to the problem. He proposed the development of "service level agreements (SLAs)" for access to archived data, and then simply measuring bit-years maintained under a specific SLA. In such a framework, the key problem is to define appropriate SLA to match the intended characteristics of a particular class of data archives. Beck's notes on the subject can be found [[NDSA: Media:Defining_Bit_Stability.pdf \|here ]].

	===Real-World Reliability of Long-Term Digital Storage===		===Real-World Reliability of Long-Term Digital Storage===

Mbeck: /* BitStab */

2011-06-30T18:39:34Z

BitStab

← Older revision		Revision as of 14:39, 30 June 2011
Line 27:		Line 27:
	The pursuit of the second goal in particular will require that the metrics used will be developed in cooperation with the operators of data archives and the developers and vendors of storage technologies.		The pursuit of the second goal in particular will require that the metrics used will be developed in cooperation with the operators of data archives and the developers and vendors of storage technologies.

	The first step, which will be discussed at the Digital Preservation Challenges workshop at the upcoming NDIIPP/NDSA Partners meeting, will be to organize efforts to define one or more metrics that could be used as the basis for ranking the most massive data archives. Working group co-chair and action team leader Micah Beck has written up some notes on his proposed approach to the problem. He proposed the development of "service level agreements (SLAs)" for access to archived data, and then simply measuring bit-years maintained under a specific SLA. In such a framework, the key problem is to define appropriate SLA to match the intended characteristics of a particular class of data archives. Beck's notes on the subject can be found [[NDSA: ~~here~~ ]].		The first step, which will be discussed at the Digital Preservation Challenges workshop at the upcoming NDIIPP/NDSA Partners meeting, will be to organize efforts to define one or more metrics that could be used as the basis for ranking the most massive data archives. Working group co-chair and action team leader Micah Beck has written up some notes on his proposed approach to the problem. He proposed the development of "service level agreements (SLAs)" for access to archived data, and then simply measuring bit-years maintained under a specific SLA. In such a framework, the key problem is to define appropriate SLA to match the intended characteristics of a particular class of data archives. Beck's notes on the subject can be found here [[NDSA: File:Defining_Bit_Stability.pdf ]].

	===Real-World Reliability of Long-Term Digital Storage===		===Real-World Reliability of Long-Term Digital Storage===

Mbeck: Action Team: Bit Stability (BitStab) Challenge

2011-06-30T18:33:43Z

Action Team: Bit Stability (BitStab) Challenge

← Older revision		Revision as of 14:33, 30 June 2011
Line 21:		Line 21:
	===BitStab===		===BitStab===
	Develop and promote a specific technical competition, analogous to the Top 500 supercomputer ranking (http://www.top500.org), but more relevant to Digital Preservation. Learning from the Top 500 experience, such a competition requires a good metric (in the case of Top 500 the Linpack benchmark) which is widely understood and accepted, and which is not too difficult/expensive to implement nor too easy to game. Then it requires buy-in from a community that is wide acknowledged to include "the best contenders."Proposal for such a metric: bulk bit stability (stable bit-years). For some definition of "without change", we simply ask for evidence of the product of how much data is stored without change (stable bits) and the length of time it was stored for.		Develop and promote a specific technical competition, analogous to the Top 500 supercomputer ranking (http://www.top500.org), but more relevant to Digital Preservation. Learning from the Top 500 experience, such a competition requires a good metric (in the case of Top 500 the Linpack benchmark) which is widely understood and accepted, and which is not too difficult/expensive to implement nor too easy to game. Then it requires buy-in from a community that is wide acknowledged to include "the best contenders."Proposal for such a metric: bulk bit stability (stable bit-years). For some definition of "without change", we simply ask for evidence of the product of how much data is stored without change (stable bits) and the length of time it was stored for.

			Our ability to preserve and interpret digital objects rests on underlying storage facilities that can accurately maintain the bit patterns that represent them.
			The goal of the Bit Stability (BitStab) Challenge is to define a metric for the size and duration of stored data that meets specified characteristics including accuracy and accessibility, to facilitate the measurement of this metric by data archives, and to publicize the results.
			The intent is two-fold: 1) to bring glory and publicity to the most successful data archives, and 2) to measure and understand the realistic characteristics of the most massive data archives.
			The pursuit of the second goal in particular will require that the metrics used will be developed in cooperation with the operators of data archives and the developers and vendors of storage technologies.

			The first step, which will be discussed at the Digital Preservation Challenges workshop at the upcoming NDIIPP/NDSA Partners meeting, will be to organize efforts to define one or more metrics that could be used as the basis for ranking the most massive data archives. Working group co-chair and action team leader Micah Beck has written up some notes on his proposed approach to the problem. He proposed the development of "service level agreements (SLAs)" for access to archived data, and then simply measuring bit-years maintained under a specific SLA. In such a framework, the key problem is to define appropriate SLA to match the intended characteristics of a particular class of data archives. Beck's notes on the subject can be found [[NDSA: here ]].

	===Real-World Reliability of Long-Term Digital Storage===		===Real-World Reliability of Long-Term Digital Storage===

Trow: /* Digital Preservation X-Challenges */ Pulled Micah and Micah's ideas for different chalanges from the email list and posted them here

2011-03-09T14:45:29Z

Digital Preservation X-Challenges: Pulled Micah and Micah's ideas for different chalanges from the email list and posted them here

← Older revision		Revision as of 10:45, 9 March 2011
Line 1:		Line 1:
	This is where this action team will make its plans.		This is where this action team will make its plans.

	~~==Digital Preservation X-Challenges==~~		==Action Team Members==
	===Action Team Members===
	*Micah Beck, University of Tennessee		*Micah Beck, University of Tennessee
	*Jane Mandelbaum, Library of Congress		*Jane Mandelbaum, Library of Congress
Line 9:		Line 8:
	*Micah Altman, Harvard University		*Micah Altman, Harvard University
	*Mike Smorul, University of Maryland		*Mike Smorul, University of Maryland
	===Project Overview===		==Project Overview==
	This group will plan and launch a set of challenges and/or prizes in to spur innovation in digital preservation. Group members will focus on defining the challenges, promoting them, and exploring ways to identify funding to support challenges if it is determined that funding would be appropriate. The action team will communicate over email and report their work on their wiki page. Email Jane Mandelbaum (jman@loc.gov) if you would like to participate.		This group will plan and launch a set of challenges and/or prizes in to spur innovation in digital preservation. Group members will focus on defining the challenges, promoting them, and exploring ways to identify funding to support challenges if it is determined that funding would be appropriate. The action team will communicate over email and report their work on their wiki page. Email Jane Mandelbaum (jman@loc.gov) if you would like to participate.

	===Examples of different prize/challenge models===		==Examples of different prize/challenge models==
	* Digital Story Telling Challenge: http://forums.techsoup.org/cs/p/tsdigs.aspx		* Digital Story Telling Challenge: http://forums.techsoup.org/cs/p/tsdigs.aspx
	* Knight News Challenge: http://www.newschallenge.org/		* Knight News Challenge: http://www.newschallenge.org/
Line 18:		Line 17:
	* Kickstarter: http://www.kickstarter.com/		* Kickstarter: http://www.kickstarter.com/
	* High Performance Computing Challenge: http://www.hpcchallenge.org/		* High Performance Computing Challenge: http://www.hpcchallenge.org/

			==Potential Grand Challenges==
			===BitStab===
			Develop and promote a specific technical competition, analogous to the Top 500 supercomputer ranking (http://www.top500.org), but more relevant to Digital Preservation. Learning from the Top 500 experience, such a competition requires a good metric (in the case of Top 500 the Linpack benchmark) which is widely understood and accepted, and which is not too difficult/expensive to implement nor too easy to game. Then it requires buy-in from a community that is wide acknowledged to include "the best contenders."Proposal for such a metric: bulk bit stability (stable bit-years). For some definition of "without change", we simply ask for evidence of the product of how much data is stored without change (stable bits) and the length of time it was stored for.

			===Real-World Reliability of Long-Term Digital Storage===
			How to assess and quantify the real-world reliability of long-term digital storage, when in the long term dominant threats are likely to be economic, and organizational?

			===Format migration===
			Format migration remains a central technical strategy for digital preservation, but creates a risk of loss of information in formatting. A grand challenge might be to identify a process for verifying that the semantic content of digital objects in different forms is (approximately) the same. Note that industry has made much more progress in practical application of semantic fingerprints (primarily for DRM) and similar technologies for this -- but the aims differ somewhat.

			===Other Potential Challenge Issues===
			Other grand challenge problems seem less technical to me. Rereading the Blue Ribbon Task Force report suggests that selection criteria appropriate for the data deluge; realistic cost models for long-term preservation activities; business models for funding preservation and access to public goods; and legal strategies for enabling long term access in the face of short-term copyright, IP and confidentiality restrictions are central challenges.

Trow: /* Example of different prize/challenge models */

2011-03-09T14:25:52Z

Example of different prize/challenge models

← Older revision		Revision as of 10:25, 9 March 2011
Line 12:		Line 12:
	This group will plan and launch a set of challenges and/or prizes in to spur innovation in digital preservation. Group members will focus on defining the challenges, promoting them, and exploring ways to identify funding to support challenges if it is determined that funding would be appropriate. The action team will communicate over email and report their work on their wiki page. Email Jane Mandelbaum (jman@loc.gov) if you would like to participate.		This group will plan and launch a set of challenges and/or prizes in to spur innovation in digital preservation. Group members will focus on defining the challenges, promoting them, and exploring ways to identify funding to support challenges if it is determined that funding would be appropriate. The action team will communicate over email and report their work on their wiki page. Email Jane Mandelbaum (jman@loc.gov) if you would like to participate.

	===~~Example~~ of different prize/challenge models===		===Examples of different prize/challenge models===
	* Digital Story Telling Challenge: http://forums.techsoup.org/cs/p/tsdigs.aspx		* Digital Story Telling Challenge: http://forums.techsoup.org/cs/p/tsdigs.aspx
	* Knight News Challenge: http://www.newschallenge.org/		* Knight News Challenge: http://www.newschallenge.org/

Trow: /* Example of different prize/challenge models */ Seeded this page with content from the meeting notes

2011-03-09T14:25:41Z

Example of different prize/challenge models: Seeded this page with content from the meeting notes

← Older revision		Revision as of 10:25, 9 March 2011
Line 1:		Line 1:
	This is where this action team will make its plans.		This is where this action team will make its plans.

			==Digital Preservation X-Challenges==
			===Action Team Members===
			*Micah Beck, University of Tennessee
			*Jane Mandelbaum, Library of Congress
			*John Spencer, BMS/Chace
			*Dean Farrel, State Library of North Carolina
			*Micah Altman, Harvard University
			*Mike Smorul, University of Maryland
			===Project Overview===
			This group will plan and launch a set of challenges and/or prizes in to spur innovation in digital preservation. Group members will focus on defining the challenges, promoting them, and exploring ways to identify funding to support challenges if it is determined that funding would be appropriate. The action team will communicate over email and report their work on their wiki page. Email Jane Mandelbaum (jman@loc.gov) if you would like to participate.

	===Example of different prize/challenge models===		===Example of different prize/challenge models===

Trow: Added a list of examples of various chalanges

2011-01-13T16:06:27Z

Added a list of examples of various chalanges

← Older revision		Revision as of 12:06, 13 January 2011
Line 1:		Line 1:
	This is where this action team will make its plans.		This is where this action team will make its plans.

			===Example of different prize/challenge models===
			* Digital Story Telling Challenge: http://forums.techsoup.org/cs/p/tsdigs.aspx
			* Knight News Challenge: http://www.newschallenge.org/
			* X-Prize: http://www.newschallenge.org/
			* Kickstarter: http://www.kickstarter.com/
			* High Performance Computing Challenge: http://www.hpcchallenge.org/