NDSA:Future projects - Revision history

Dlfadm: 5 revisions imported: Migrate NDSA content from Library of Congress

2016-02-11T19:17:52Z

5 revisions imported: Migrate NDSA content from Library of Congress

← Older revision		Revision as of 15:17, 11 February 2016
(No difference)

Trow: /* Working beyond digital preservation */ removed as it is now one of the current projects

2011-02-23T20:26:19Z

Working beyond digital preservation: removed as it is now one of the current projects

← Older revision		Revision as of 16:26, 23 February 2011
Line 4:		Line 4:
	==Experimentation and analysis.==		==Experimentation and analysis.==
	There are a number of experiments that could shed light on the processes of Data Stewardship and measurements and analyses that could be applied to the body of data currently being preserved in a variety of contexts, from the academic and governmental to the industrial and consumer. For example, there is little public information about failure statistics of disk drives. Industry efforts at evaluation tend to be closely held for reasons of commercial sensitivity. A detailed long-term study of disks in controlled environments would be one way to pursue this information. Another way would be to catalog, monitor and tabulate the track record of disks deployed in the field.		There are a number of experiments that could shed light on the processes of Data Stewardship and measurements and analyses that could be applied to the body of data currently being preserved in a variety of contexts, from the academic and governmental to the industrial and consumer. For example, there is little public information about failure statistics of disk drives. Industry efforts at evaluation tend to be closely held for reasons of commercial sensitivity. A detailed long-term study of disks in controlled environments would be one way to pursue this information. Another way would be to catalog, monitor and tabulate the track record of disks deployed in the field.

	~~==Working beyond digital preservation==~~
	This could mean collaborating with fields that may not currently be considered part of digital preservation (such as Digital Archeology/Forensics) to apply their techniques. Some areas, such as virtualization of programming environments, may be of fundamental importance to digital preservation but are thought of as part of programming languages and operating systems. Other areas, such as material sciences, have a direct impact on what properties of physical objects are measured and recorded during digitization.

Trow: Removed x-prizes and statement on digital stewardship which are now in the current actions part of the innovation homepage

2010-12-21T16:50:45Z

Removed x-prizes and statement on digital stewardship which are now in the current actions part of the innovation homepage

← Older revision		Revision as of 12:50, 21 December 2010
Line 1:		Line 1:
	~~==Defining goals and principles, presenting new approaches.==~~
	One of the immediate challenges to the NDSA is that there is no clear statement of the goals and principles of Data Stewardship. Without such a statement, the formulation of new approaches to meet these goals while adhering to appropriate principles is difficult. Anything that is too different from current approaches may be met with skepticism and challenged as diverging from tradition. More abstract statements of goals and principles that are independent of current practice are necessary in order to allow innovation to be evaluated in a fair and meaningful way.

	An example of such a question is this: Does Data Stewardship have a requirement to store the original sequence of bits (format) that defines each digital object preserved, and the sequence of formats into which this original sequence has been transformed? Is it acceptable if the original or some of the intermediate forms are lost or allowed to deteriorate? Is the preservation of bits sufficient, or is the preservation of functionality in interpreting those bits required? What does preservation of functionality mean?

	==Prototype implementations and procedures.==		==Prototype implementations and procedures.==
	This suggestion is a reaction to the idea that the other working groups will be working on services and infrastructure that are at least "pre-production", meaning that they have some expected level of service. Ideas that are not yet at the stage of stability that these working groups require would go on within the Innovation Working Group, and so would be clearly identified as falling into a different category. Prototype implementations might attract funding from agencies such as the NSF or from industry or from participating organizations. Such activities might be completely contained within the NDSA or they might be a collaboration with other organizations.		This suggestion is a reaction to the idea that the other working groups will be working on services and infrastructure that are at least "pre-production", meaning that they have some expected level of service. Ideas that are not yet at the stage of stability that these working groups require would go on within the Innovation Working Group, and so would be clearly identified as falling into a different category. Prototype implementations might attract funding from agencies such as the NSF or from industry or from participating organizations. Such activities might be completely contained within the NDSA or they might be a collaboration with other organizations.
Line 9:		Line 4:
	==Experimentation and analysis.==		==Experimentation and analysis.==
	There are a number of experiments that could shed light on the processes of Data Stewardship and measurements and analyses that could be applied to the body of data currently being preserved in a variety of contexts, from the academic and governmental to the industrial and consumer. For example, there is little public information about failure statistics of disk drives. Industry efforts at evaluation tend to be closely held for reasons of commercial sensitivity. A detailed long-term study of disks in controlled environments would be one way to pursue this information. Another way would be to catalog, monitor and tabulate the track record of disks deployed in the field.		There are a number of experiments that could shed light on the processes of Data Stewardship and measurements and analyses that could be applied to the body of data currently being preserved in a variety of contexts, from the academic and governmental to the industrial and consumer. For example, there is little public information about failure statistics of disk drives. Industry efforts at evaluation tend to be closely held for reasons of commercial sensitivity. A detailed long-term study of disks in controlled environments would be one way to pursue this information. Another way would be to catalog, monitor and tabulate the track record of disks deployed in the field.

	~~==Digital preservation X-challenges.==~~
	There was a lot of interest in challenging the preservation community to innovate and to coordinate and organize such efforts. It would seem that such efforts might be most productive if our working group came up with specific "X-Prize" type challenges that the community could address. If the working group formulated ideas that were then endorsed by the NDSA as a whole, some of them might be appealing enough to attract prizes or recognition for the winners.

	An example might be to organize a huge database (an Exabyte? 10 Exabytes) and keep it functional for a minimal period of time (a month? a year?). Maybe that's an uninteresting example, but it gives the idea of a project that would have to involve the community, would attract attention, and would face considerable technical challenges.

	==Working beyond digital preservation==		==Working beyond digital preservation==
	This could mean collaborating with fields that may not currently be considered part of digital preservation (such as Digital Archeology/Forensics) to apply their techniques. Some areas, such as virtualization of programming environments, may be of fundamental importance to digital preservation but are thought of as part of programming languages and operating systems. Other areas, such as material sciences, have a direct impact on what properties of physical objects are measured and recorded during digitization.		This could mean collaborating with fields that may not currently be considered part of digital preservation (such as Digital Archeology/Forensics) to apply their techniques. Some areas, such as virtualization of programming environments, may be of fundamental importance to digital preservation but are thought of as part of programming languages and operating systems. Other areas, such as material sciences, have a direct impact on what properties of physical objects are measured and recorded during digitization.

Trow at 16:45, 21 December 2010

2010-12-21T16:45:09Z

← Older revision		Revision as of 12:45, 21 December 2010
Line 1:		Line 1:
	==1) Defining goals and principles, presenting new approaches.==		==Defining goals and principles, presenting new approaches.==
	One of the immediate challenges to the NDSA is that there is no clear statement of the goals and principles of Data Stewardship. Without such a statement, the formulation of new approaches to meet these goals while adhering to appropriate principles is difficult. Anything that is too different from current approaches may be met with skepticism and challenged as diverging from tradition. More abstract statements of goals and principles that are independent of current practice are necessary in order to allow innovation to be evaluated in a fair and meaningful way.		One of the immediate challenges to the NDSA is that there is no clear statement of the goals and principles of Data Stewardship. Without such a statement, the formulation of new approaches to meet these goals while adhering to appropriate principles is difficult. Anything that is too different from current approaches may be met with skepticism and challenged as diverging from tradition. More abstract statements of goals and principles that are independent of current practice are necessary in order to allow innovation to be evaluated in a fair and meaningful way.

	An example of such a question is this: Does Data Stewardship have a requirement to store the original sequence of bits (format) that defines each digital object preserved, and the sequence of formats into which this original sequence has been transformed? Is it acceptable if the original or some of the intermediate forms are lost or allowed to deteriorate? Is the preservation of bits sufficient, or is the preservation of functionality in interpreting those bits required? What does preservation of functionality mean?		An example of such a question is this: Does Data Stewardship have a requirement to store the original sequence of bits (format) that defines each digital object preserved, and the sequence of formats into which this original sequence has been transformed? Is it acceptable if the original or some of the intermediate forms are lost or allowed to deteriorate? Is the preservation of bits sufficient, or is the preservation of functionality in interpreting those bits required? What does preservation of functionality mean?

	==2) Prototype implementations and procedures.==		==Prototype implementations and procedures.==
	This suggestion is a reaction to the idea that the other working groups will be working on services and infrastructure that are at least "pre-production", meaning that they have some expected level of service. Ideas that are not yet at the stage of stability that these working groups require would go on within the Innovation Working Group, and so would be clearly identified as falling into a different category. Prototype implementations might attract funding from agencies such as the NSF or from industry or from participating organizations. Such activities might be completely contained within the NDSA or they might be a collaboration with other organizations.		This suggestion is a reaction to the idea that the other working groups will be working on services and infrastructure that are at least "pre-production", meaning that they have some expected level of service. Ideas that are not yet at the stage of stability that these working groups require would go on within the Innovation Working Group, and so would be clearly identified as falling into a different category. Prototype implementations might attract funding from agencies such as the NSF or from industry or from participating organizations. Such activities might be completely contained within the NDSA or they might be a collaboration with other organizations.

	==3) Experimentation and analysis.==		==Experimentation and analysis.==
	There are a number of experiments that could shed light on the processes of Data Stewardship and measurements and analyses that could be applied to the body of data currently being preserved in a variety of contexts, from the academic and governmental to the industrial and consumer. For example, there is little public information about failure statistics of disk drives. Industry efforts at evaluation tend to be closely held for reasons of commercial sensitivity. A detailed long-term study of disks in controlled environments would be one way to pursue this information. Another way would be to catalog, monitor and tabulate the track record of disks deployed in the field.		There are a number of experiments that could shed light on the processes of Data Stewardship and measurements and analyses that could be applied to the body of data currently being preserved in a variety of contexts, from the academic and governmental to the industrial and consumer. For example, there is little public information about failure statistics of disk drives. Industry efforts at evaluation tend to be closely held for reasons of commercial sensitivity. A detailed long-term study of disks in controlled environments would be one way to pursue this information. Another way would be to catalog, monitor and tabulate the track record of disks deployed in the field.

	==4) Digital preservation X-challenges.==		==Digital preservation X-challenges.==
	There was a lot of interest in challenging the preservation community to innovate and to coordinate and organize such efforts. It would seem that such efforts might be most productive if our working group came up with specific "X-Prize" type challenges that the community could address. If the working group formulated ideas that were then endorsed by the NDSA as a whole, some of them might be appealing enough to attract prizes or recognition for the winners.		There was a lot of interest in challenging the preservation community to innovate and to coordinate and organize such efforts. It would seem that such efforts might be most productive if our working group came up with specific "X-Prize" type challenges that the community could address. If the working group formulated ideas that were then endorsed by the NDSA as a whole, some of them might be appealing enough to attract prizes or recognition for the winners.

	An example might be to organize a huge database (an Exabyte? 10 Exabytes) and keep it functional for a minimal period of time (a month? a year?). Maybe that's an uninteresting example, but it gives the idea of a project that would have to involve the community, would attract attention, and would face considerable technical challenges.		An example might be to organize a huge database (an Exabyte? 10 Exabytes) and keep it functional for a minimal period of time (a month? a year?). Maybe that's an uninteresting example, but it gives the idea of a project that would have to involve the community, would attract attention, and would face considerable technical challenges.

	==5) Working beyond digital preservation==		==Working beyond digital preservation==
	This could mean collaborating with fields that may not currently be considered part of digital preservation (such as Digital Archeology/Forensics) to apply their techniques. Some areas, such as virtualization of programming environments, may be of fundamental importance to digital preservation but are thought of as part of programming languages and operating systems. Other areas, such as material sciences, have a direct impact on what properties of physical objects are measured and recorded during digitization.		This could mean collaborating with fields that may not currently be considered part of digital preservation (such as Digital Archeology/Forensics) to apply their techniques. Some areas, such as virtualization of programming environments, may be of fundamental importance to digital preservation but are thought of as part of programming languages and operating systems. Other areas, such as material sciences, have a direct impact on what properties of physical objects are measured and recorded during digitization.

Trow: /* 1) Defining goals and principles, presenting new approaches. */

2010-12-21T16:44:43Z

1) Defining goals and principles, presenting new approaches.

← Older revision		Revision as of 12:44, 21 December 2010
Line 3:		Line 3:

	An example of such a question is this: Does Data Stewardship have a requirement to store the original sequence of bits (format) that defines each digital object preserved, and the sequence of formats into which this original sequence has been transformed? Is it acceptable if the original or some of the intermediate forms are lost or allowed to deteriorate? Is the preservation of bits sufficient, or is the preservation of functionality in interpreting those bits required? What does preservation of functionality mean?		An example of such a question is this: Does Data Stewardship have a requirement to store the original sequence of bits (format) that defines each digital object preserved, and the sequence of formats into which this original sequence has been transformed? Is it acceptable if the original or some of the intermediate forms are lost or allowed to deteriorate? Is the preservation of bits sufficient, or is the preservation of functionality in interpreting those bits required? What does preservation of functionality mean?
	~~2) Prototype implementations and procedures.~~

			==2) Prototype implementations and procedures.==
	This suggestion is a reaction to the idea that the other working groups will be working on services and infrastructure that are at least "pre-production", meaning that they have some expected level of service. Ideas that are not yet at the stage of stability that these working groups require would go on within the Innovation Working Group, and so would be clearly identified as falling into a different category. Prototype implementations might attract funding from agencies such as the NSF or from industry or from participating organizations. Such activities might be completely contained within the NDSA or they might be a collaboration with other organizations.		This suggestion is a reaction to the idea that the other working groups will be working on services and infrastructure that are at least "pre-production", meaning that they have some expected level of service. Ideas that are not yet at the stage of stability that these working groups require would go on within the Innovation Working Group, and so would be clearly identified as falling into a different category. Prototype implementations might attract funding from agencies such as the NSF or from industry or from participating organizations. Such activities might be completely contained within the NDSA or they might be a collaboration with other organizations.

Trow: Added full list of proposed scope of work from the mailing list

2010-12-21T16:44:20Z

Added full list of proposed scope of work from the mailing list

New page

==1) Defining goals and principles, presenting new approaches.==
One of the immediate challenges to the NDSA is that there is no clear statement of the goals and principles of Data Stewardship. Without such a statement, the formulation of new approaches to meet these goals while adhering to appropriate principles is difficult. Anything that is too different from current approaches may be met with skepticism and challenged as diverging from tradition. More abstract statements of goals and principles that are independent of current practice are necessary in order to allow innovation to be evaluated in a fair and meaningful way.

An example of such a question is this: Does Data Stewardship have a requirement to store the original sequence of bits (format) that defines each digital object preserved, and the sequence of formats into which this original sequence has been transformed? Is it acceptable if the original or some of the intermediate forms are lost or allowed to deteriorate? Is the preservation of bits sufficient, or is the preservation of functionality in interpreting those bits required? What does preservation of functionality mean?
2) Prototype implementations and procedures.

This suggestion is a reaction to the idea that the other working groups will be working on services and infrastructure that are at least "pre-production", meaning that they have some expected level of service. Ideas that are not yet at the stage of stability that these working groups require would go on within the Innovation Working Group, and so would be clearly identified as falling into a different category. Prototype implementations might attract funding from agencies such as the NSF or from industry or from participating organizations. Such activities might be completely contained within the NDSA or they might be a collaboration with other organizations.

==3) Experimentation and analysis.==
There are a number of experiments that could shed light on the processes of Data Stewardship and measurements and analyses that could be applied to the body of data currently being preserved in a variety of contexts, from the academic and governmental to the industrial and consumer. For example, there is little public information about failure statistics of disk drives. Industry efforts at evaluation tend to be closely held for reasons of commercial sensitivity. A detailed long-term study of disks in controlled environments would be one way to pursue this information. Another way would be to catalog, monitor and tabulate the track record of disks deployed in the field.

==4) Digital preservation X-challenges.==
There was a lot of interest in challenging the preservation community to innovate and to coordinate and organize such efforts. It would seem that such efforts might be most productive if our working group came up with specific "X-Prize" type challenges that the community could address. If the working group formulated ideas that were then endorsed by the NDSA as a whole, some of them might be appealing enough to attract prizes or recognition for the winners.

An example might be to organize a huge database (an Exabyte? 10 Exabytes) and keep it functional for a minimal period of time (a month? a year?). Maybe that's an uninteresting example, but it gives the idea of a project that would have to involve the community, would attract attention, and would face considerable technical challenges.

==5) Working beyond digital preservation==
This could mean collaborating with fields that may not currently be considered part of digital preservation (such as Digital Archeology/Forensics) to apply their techniques. Some areas, such as virtualization of programming environments, may be of fundamental importance to digital preservation but are thought of as part of programming languages and operating systems. Other areas, such as material sciences, have a direct impact on what properties of physical objects are measured and recorded during digitization.