NDSA:Cloud Presentations: Difference between revisions

← Older edit Newer edit →

Revision as of 07:40, 22 March 2011

In each case we would want to identify who would present, who will contact them. Then when they will present.

From there we can include specific questions we would like them to respond to.

Presentation Schedule and Slides

Feb 1, Tues, 1:00 EST call with iRods Reagan Moore (presentation)
Feb 14, Monday, 11:00 EST call with Duracloud (presentation)
Feb 17, Thurs, 11:00 EST call with MetaArchive/GDDP Katherine Skinner, Matt Schultz and Martin Halbert MetaArchive NDSA (presentation)

People/Projects to Contact

Chronopolis (Mike Smorul will contact)
Open questions from the Educopia Guide to Distributed Digital Preservation
Commercial providers? (Who specifically would we want here? Please add them.)
- Azure (Leslie to contact)
- Amazon (Who will contact?)

General Questions for Cloud Service Presenters

Here we are working on a set of general questions for presenters to develop talks around.

What sort of use cases is your system designed to support? What doesn't this support?
What preservation standards would your system support?
What resources are required to support a solution implemented in your environment?
What infrastructure do you rely on?
How can your system impact digital preservation activities?
If we put data in your system today what systems and processes are in place so that we can get it back 10 years from now? (Take for granted a sophisticated audience that knows about multiple copies etc.)
What types of materials does your system handle? (documents, audio files, video file, stills, data sets, etc) And give examples of those types in practice

Questions for Implementers of Large Scale Storage and Cloud Services

What is the particular preservation goal or challenge you need to accomplish? (for example, re-use, public access, internal access, legal mandate, etc.)
What large scale storage or cloud technologies are you using to meet that challenge?
Specifically, what kind of materials are you preserving (text, data sets, images, moving images, web pages, etc.)
How big is your collection? (In terms of number of objects and storage space required)
What are your performance requirements?
What storage media have you elected to use? (Disk, Tape, etc)
What do you think the key advantages of the system you use?
What do you think are the key problems or disadvantages your system present?
What important principles informed your decision about the particular tool or service you chose to use?
Which service providers or tools did you consider and how did you make your choice?
How frequently do you migrate from one system to another?
What characteristics of the storage system(s) you use do you feel are particularly well-suited to long-term digital preservation? (High levels of redundancy/resiliency, internal checksumming capabilities, automated tape refresh, etc)
What functionality or processes have you developed to augment your storage systems in order to meet preservation goals? (Periodic checksum validation, limited human access or novel use of permissions schemes)
Are there tough requirements for digital preservation, e.g. TRAC certification, that you wish were more readily handled by your storage system?

Responses to questions

iRODS

...

Other general notes:

[Snavely] The need for each storage target to support a specific set of operations, and consistently with other storage targets, seems like a risk that comes along with the elegant abstraction that iRODS provides. Clear specifications help mitigate this risk.

DuraCloud

...

Other general notes:

[Snavely] Treatment of cloud provider is generally as a black box, without a strong sense of actual reliability of underlying storage systems. Cloud providers tend to promise checksum validation of contents, but recourse if validation fails was unknown (right?). Additional checksum validation has been augmented on top of cloud storage service by Duracloud.

MetaArchive/GDDP

...

Other general notes:

[Snavely] Built on LOCKSS, so data integrity assurances are provided by robust networked software model augmented to commodity hardware and storage. Federated nature provides integrity assurance but also a lack of central control in that the accidental loss of multiple caches is unlikely but e.g. scheduled maintenance or upgrades could coincidentally collide.

Chronopolis

...

MicroSoft Azure

...

Amazon S3/EC2

...

General Concerns

confidential data
encrypted data
auditing
preservation risks
legal compliance
...

Solution Models and Environments

Name	Offered as Service	Deployed Locally	Opensource	Authentication Scheme	Ingest Mechanism	Export Mechanism	Integrity/Validation Mechanism	Replication Mechanism	Administration Model (Federated, etc.)	Tiering Support
iRODS
DuraCloud
MetaArchive/GDDP
Chronopolis
Microsoft Azure
Amazon S3/EC2

@@ Line 15: / Line 15: @@
 **Amazon (Who will contact?)
-==General Guiding Questions for Presenters==
+==General Questions for Cloud Service Presenters==
 Here we are working on a set of general questions for presenters to develop talks around.
@@ Line 25: / Line 25: @@
 # If we put data in your system today what systems and processes are in place so that we can get it back 10 years from now? (Take for granted a sophisticated audience that knows about multiple copies etc.)
 # What types of materials does your system handle? (documents, audio files, video file, stills, data sets, etc) And give examples of those types in practice
+==Questions for Implementers of Large Scale Storage and Cloud Services==
+#What is the particular preservation goal or challenge you need to accomplish? (for example, re-use, public access, internal access, legal mandate, etc.)
+#What large scale storage or cloud technologies are you using to meet that challenge?
+#Specifically, what kind of materials are you preserving (text, data sets, images, moving images, web pages, etc.)
+#How big is your collection? (In terms of number of objects and storage space required)
+#What are your performance requirements?
+#What storage media have you elected to use? (Disk, Tape, etc)
+#What do you think the key advantages of the system you use?
+#What do you think are the key problems or disadvantages your system present?
+#What important principles informed your decision about the particular tool or service you chose to use?
+#Which service providers or tools did you consider and how did you make your choice?
+#How frequently do you migrate from one system to another?
+# What characteristics of the storage system(s) you use do you feel are particularly well-suited to long-term digital preservation? (High levels of redundancy/resiliency, internal checksumming capabilities, automated tape refresh, etc)
+# What functionality or processes have you developed to augment your storage systems in order to meet preservation goals? (Periodic checksum validation, limited human access or novel use of permissions schemes)
+# Are there tough requirements for digital preservation, e.g. TRAC certification, that you wish were more readily handled by your storage system?
 ===Responses to questions===
@@ Line 150: / Line 166: @@
 |-
 |}
-==Questions for Implementers of Large Scale Storage and Cloud Services==
-#What is the particular preservation goal or challenge you need to accomplish? (for example, re-use, public access, internal access, legal mandate, etc.)
-#What large scale storage or cloud technologies are you using to meet that challenge?
-#Specifically, what kind of materials are you preserving (text, data sets, images, moving images, web pages, etc.)
-#How big is your collection? (In terms of number of objects and storage space required)
-#What are your performance requirements?
-#What storage media have you elected to use? (Disk, Tape, etc)
-#What do you think the key advantages of the system you use?
-#What do you think are the key problems or disadvantages your system present?
-#What important principles informed your decision about the particular tool or service you chose to use?
-#Which service providers or tools did you consider and how did you make your choice?
-#How frequently do you migrate from one system to another?
-# What characteristics of the storage system(s) you use do you feel are particularly well-suited to long-term digital preservation? (High levels of redundancy/resiliency, internal checksumming capabilities, automated tape refresh, etc)
-# What functionality or processes have you developed to augment your storage systems in order to meet preservation goals? (Periodic checksum validation, limited human access or novel use of permissions schemes)
-# Are there tough requirements for digital preservation, e.g. TRAC certification, that you wish were more readily handled by your storage system?