NDSA:November 2 Blog Preservation Meeting Minutes - Revision history

Dlfadm: 21 revisions imported: Migrate NDSA content from Library of Congress

2016-02-11T19:18:46Z

21 revisions imported: Migrate NDSA content from Library of Congress

← Older revision		Revision as of 15:18, 11 February 2016
(No difference)

Abgr: /* Discussion */

2011-11-07T20:32:35Z

Discussion

← Older revision		Revision as of 16:32, 7 November 2011
Line 42:		Line 42:

	The idea is that mostly likely, yes: IA will crawl everything that is flagged by site owners for preservation. Other NDSA members will be able to select from the list what they would like to include in their own archives. Multiple organizations may collect the same URLs (duplication is not a bad thing).		The idea is that mostly likely, yes: IA will crawl everything that is flagged by site owners for preservation. Other NDSA members will be able to select from the list what they would like to include in their own archives. Multiple organizations may collect the same URLs (duplication is not a bad thing).
	'''
	*Will blog owners expect backup services if they opt-in?'''		'''*Will blog owners expect backup services if they opt-in?'''

	We talked quite a bit about making sure the purpose of the pilot is clear to site owners, and that this particular plugin is not meant to be able to provide backup services. Ideas #1 and #2 about downloading a for personal backup would cover this sort of request, most likely.		We talked quite a bit about making sure the purpose of the pilot is clear to site owners, and that this particular plugin is not meant to be able to provide backup services. Ideas #1 and #2 about downloading a for personal backup would cover this sort of request, most likely.
Line 57:		Line 57:

	We discussed frequency of archiving a bit but didn't go into great detail about the frequency of notifications. Basically this will occur real time - as the site owner clicks to opt-in, data will be sent to our NDSA database. If the site owner changes his/her mind and decides to STOP participating, that notice will also be sent. We need to make it very clear that if they OPT OUT after opting in, we will not DELETE their content already preserved. We will just stop archiving moving forward.		We discussed frequency of archiving a bit but didn't go into great detail about the frequency of notifications. Basically this will occur real time - as the site owner clicks to opt-in, data will be sent to our NDSA database. If the site owner changes his/her mind and decides to STOP participating, that notice will also be sent. We need to make it very clear that if they OPT OUT after opting in, we will not DELETE their content already preserved. We will just stop archiving moving forward.
	'''
	*Is a license/agreement needed?'''		'''*Is a license/agreement needed?'''

	We didn't really go into details about this specifically, but there were concerns about copyright and whether or not preservation could include comments, posts by people other than the site owner who installs the plugins. We discussed whether parts of the sites could be identified for archiving; these seems too difficult to manage.		We didn't really go into details about this specifically, but there were concerns about copyright and whether or not preservation could include comments, posts by people other than the site owner who installs the plugins. We discussed whether parts of the sites could be identified for archiving; these seems too difficult to manage.

Abgr: /* Next Steps/Action Items */

2011-11-07T20:25:28Z

Next Steps/Action Items

← Older revision		Revision as of 16:25, 7 November 2011
Line 113:		Line 113:

	Andrew will code the plugin (under 4 hrs he said) and send it out for testing. Interested NDSA members will be asked to install and test before we open up the pilot more widely.		Andrew will code the plugin (under 4 hrs he said) and send it out for testing. Interested NDSA members will be asked to install and test before we open up the pilot more widely.
	'''
	*LC CLEARANCES FOR HOW TO DESCRIBE PARTNERSHIPS/Etc.'''		'''*LC CLEARANCES FOR HOW TO DESCRIBE PARTNERSHIPS/Etc.'''

	While the above is happening, LC needs to talk to public affairs and lawyers to make sure we describe this appropriately. Wordpress or Andrew will be the author of the plugin with sponsorship by LC, IA. Idea is "Joint project of LC, IA, Wordpress" with a mention of NDSA. Wording of description within plugin - how we talk about this with the public, etc. will need to be run past folks at LC.		While the above is happening, LC needs to talk to public affairs and lawyers to make sure we describe this appropriately. Wordpress or Andrew will be the author of the plugin with sponsorship by LC, IA. Idea is "Joint project of LC, IA, Wordpress" with a mention of NDSA. Wording of description within plugin - how we talk about this with the public, etc. will need to be run past folks at LC.

Abgr: /* Discussion */

2011-11-07T20:24:44Z

Discussion

← Older revision		Revision as of 16:24, 7 November 2011
Line 89:		Line 89:
	**If NDSA members are interested in encouraging blog owners to install the plugin so that archiving is easier, they could send a link to the plugin page with instructions for installing. The pilot project will not include a "permissions letter" per se since the plugin opt-in grants the permissions required.		**If NDSA members are interested in encouraging blog owners to install the plugin so that archiving is easier, they could send a link to the plugin page with instructions for installing. The pilot project will not include a "permissions letter" per se since the plugin opt-in grants the permissions required.
	**Mention of Creative Commons licenses - we hope that we can encourage blog owners to put these on their sites.		**Mention of Creative Commons licenses - we hope that we can encourage blog owners to put these on their sites.
	*Andrew suggested he could also code the plugin to do a look-up in archive.org to show what's already been archived. Bring awareness to archiving in general.		**Andrew suggested he could also code the plugin to do a look-up in archive.org to show what's already been archived. Bring awareness to archiving in general.
	**Should the embargo be consistant among all NDSA members participating?		**Should the embargo be consistant among all NDSA members participating?
	**NDSA members participating should agree to some set of basic requirements for archiving that is consistent.		**NDSA members participating should agree to some set of basic requirements for archiving that is consistent.

Abgr: /* Discussion */

2011-11-07T20:24:00Z

Discussion

← Older revision		Revision as of 16:24, 7 November 2011
Line 38:		Line 38:
	==Discussion==		==Discussion==
	Some of the questions received before the meeting included:		Some of the questions received before the meeting included:

	'''*If a blog owner opts-in, would that guarantee preservation?'''		'''*If a blog owner opts-in, would that guarantee preservation?'''

Line 83:		Line 84:
	Andrew provided some statistics about Wordpress.org sites. 2/3rds of them are from the international community (so IIPC should have high interest). We hope to discuss the pilot at the IIPC GA in May.		Andrew provided some statistics about Wordpress.org sites. 2/3rds of them are from the international community (so IIPC should have high interest). We hope to discuss the pilot at the IIPC GA in May.

	~~[[NDSA:~~'''		'''*Other topics that came up during the discussion:'''
	Other topics that came up during the discussion:''']]		**Archiving will capture the look and feel/functionality, images, etc. not just the text. We discussed capture of feeds but at this time we're not exploring that.
			**This would not include FTP access to content
	*Archiving will capture the look and feel/functionality, images, etc. not just the text. We discussed capture of feeds but at this time we're not exploring that.		**If NDSA members are interested in encouraging blog owners to install the plugin so that archiving is easier, they could send a link to the plugin page with instructions for installing. The pilot project will not include a "permissions letter" per se since the plugin opt-in grants the permissions required.
	*This would not include FTP access to content		**Mention of Creative Commons licenses - we hope that we can encourage blog owners to put these on their sites.
	*If NDSA members are interested in encouraging blog owners to install the plugin so that archiving is easier, they could send a link to the plugin page with instructions for installing. The pilot project will not include a "permissions letter" per se since the plugin opt-in grants the permissions required.
	*Mention of Creative Commons licenses - we hope that we can encourage blog owners to put these on their sites.
	*Andrew suggested he could also code the plugin to do a look-up in archive.org to show what's already been archived. Bring awareness to archiving in general.		*Andrew suggested he could also code the plugin to do a look-up in archive.org to show what's already been archived. Bring awareness to archiving in general.
			**Should the embargo be consistant among all NDSA members participating?
	*Should the embargo be consistant among all NDSA members participating?		**NDSA members participating should agree to some set of basic requirements for archiving that is consistent.
	*NDSA members participating should agree to some set of basic requirements for archiving that is consistent.		**What if a site owner doesn't want to be preserved by a particular NDSA member? We talked about but decided they won't have an option to pick and choose if they opt-in. If it becomes an issue we will discuss further during the pilot.
	*What if a site owner doesn't want to be preserved by a particular NDSA member? We talked about but decided they won't have an option to pick and choose if they opt-in. If it becomes an issue we will discuss further during the pilot.		**If a site owner changes their mind, they can opt out of future archiving, but none of their previously archived content will be deleted.
	*If a site owner changes their mind, they can opt out of future archiving, but none of their previously archived content will be deleted.		**Could a statement of opt-in also be inserted into the robots.txt file? We may explore this during the pilot.
	*Could a statement of opt-in also be inserted into the robots.txt file? We may explore this during the pilot.		**Other stats from Andrew: 14% of web are wordpress sites, and 22 of every 100 new domains registered become wordpress sites.
	*Other stats from Andrew: 14% of web are wordpress sites, and 22 of every 100 new domains registered become wordpress sites.		**This project is a great opportunity for outreach about the importance of preservation and re: NDSA.
	*This project is a great opportunity for outreach about the importance of preservation and re: NDSA.

	==Next Steps/Action Items==		==Next Steps/Action Items==

Abgr: /* AGENDA */

2011-11-07T20:17:32Z

AGENDA

← Older revision		Revision as of 16:17, 7 November 2011
Line 28:		Line 28:
	(Attendees from NDSA member organizations in bold)		(Attendees from NDSA member organizations in bold)

	=~~AGENDA~~=		=Agenda=

	==Welcome/Introductions==		==Welcome/Introductions==

Abgr at 20:14, 7 November 2011

2011-11-07T20:14:51Z

← Older revision		Revision as of 16:14, 7 November 2011
Line 78:		Line 78:

	The list of sites/blogs who opt-in, and ideally who has agreed to archive what, will be initially published to NDSA members, but wider distribution was discussed. For the pilot, we will focus on just NDSA members but we will explore this issue further. There was talk of opening it up at least to IIPC members and allowing them access.		The list of sites/blogs who opt-in, and ideally who has agreed to archive what, will be initially published to NDSA members, but wider distribution was discussed. For the pilot, we will focus on just NDSA members but we will explore this issue further. There was talk of opening it up at least to IIPC members and allowing them access.

			We talked about this plugin being a two-way communication - this is not only alerting NDSA of sites to archive, but we could also send back information to the site owner about who has selected their site for archiving. We talked about providing links to the archived sites - though since some organizations make content available after an embargo period (which is not always consistent between organizations), this could be tricky, but something to consider.

	Andrew provided some statistics about Wordpress.org sites. 2/3rds of them are from the international community (so IIPC should have high interest). We hope to discuss the pilot at the IIPC GA in May.		Andrew provided some statistics about Wordpress.org sites. 2/3rds of them are from the international community (so IIPC should have high interest). We hope to discuss the pilot at the IIPC GA in May.

	'''		[[NDSA:'''
	Other topics that came up during the discussion:'''		Other topics that came up during the discussion:''']]

	*Archiving will capture the look and feel/functionality, images, etc. not just the text. We discussed capture of feeds but at this time we're not exploring that.		*Archiving will capture the look and feel/functionality, images, etc. not just the text. We discussed capture of feeds but at this time we're not exploring that.
Line 89:		Line 91:
	*Mention of Creative Commons licenses - we hope that we can encourage blog owners to put these on their sites.		*Mention of Creative Commons licenses - we hope that we can encourage blog owners to put these on their sites.
	*Andrew suggested he could also code the plugin to do a look-up in archive.org to show what's already been archived. Bring awareness to archiving in general.		*Andrew suggested he could also code the plugin to do a look-up in archive.org to show what's already been archived. Bring awareness to archiving in general.
	*We talked about it being a two-way communication - this is alerting NDSA of sites to archive, but we could also send back information to the site owner about who has selected their site for archiving with links to the archive. Since some organizations make content available after an embargo period (which is not always consistent between organizations), this could be tricky but something to think about.
	*Should the embargo be consistant among all NDSA members participating?		*Should the embargo be consistant among all NDSA members participating?
	*NDSA members participating should agree to some set of basic requirements for archiving that is consistent.		*NDSA members participating should agree to some set of basic requirements for archiving that is consistent.
Line 96:		Line 98:
	*Could a statement of opt-in also be inserted into the robots.txt file? We may explore this during the pilot.		*Could a statement of opt-in also be inserted into the robots.txt file? We may explore this during the pilot.
	*Other stats from Andrew: 14% of web are wordpress sites, and 22 of every 100 new domains registered become wordpress sites.		*Other stats from Andrew: 14% of web are wordpress sites, and 22 of every 100 new domains registered become wordpress sites.
			*This project is a great opportunity for outreach about the importance of preservation and re: NDSA.

			==Next Steps/Action Items==

	~~==Next Steps~~/~~Action Items==~~		A smaller group (Abbie, Andrew, Martha, Leslie, Nicholas, Trevor, and Kris met after the call ended to discuss next steps based on the discussions with the larger group. Objective for the controlled pilot will be a proof of concept, eventually we hope to engage wider web archiving community (IIPC).

			The outcome was:

			'''*CODE THE PLUGIN / TEST'''

			In next couple of weeks:

			Abbie will work on drafting initial text to go with the opt-in buttons and fields of data to collect to send onto Andrew - this won't be the "perfect" list of categories but something to start with, so we can get something up quickly to show to the wider group and respond to and improve upon.

			Kris will have Vanay to work with Andrew -- IA will be hosting (at least for the pilot) the "database" of URLs and data. Plugin will be set up to ping IA's database when sites are updated (so we can get an idea of frequency of change)

			Andrew will code the plugin (under 4 hrs he said) and send it out for testing. Interested NDSA members will be asked to install and test before we open up the pilot more widely.
			'''
			*LC CLEARANCES FOR HOW TO DESCRIBE PARTNERSHIPS/Etc.'''

			While the above is happening, LC needs to talk to public affairs and lawyers to make sure we describe this appropriately. Wordpress or Andrew will be the author of the plugin with sponsorship by LC, IA. Idea is "Joint project of LC, IA, Wordpress" with a mention of NDSA. Wording of description within plugin - how we talk about this with the public, etc. will need to be run past folks at LC.

			'''*ROLL OUT'''

			Time frame of pilot start date/end date still TBD. When we are ready, we plan to ppen it up for anyone to install. See how it goes.

			'''*SORTING OUT OF WHO ARCHIVES WHAT'''

			Once we start seeing the results of who is opting-in, then interested NDSA members will need to get active to figure out how to pick and choose from the list, how to get that recorded, etc. Future meetings of NDSA Content Work Group will be set up to discuss further as we go.

Abgr at 19:59, 7 November 2011

2011-11-07T19:59:06Z

← Older revision		Revision as of 15:59, 7 November 2011
Line 79:		Line 79:
	The list of sites/blogs who opt-in, and ideally who has agreed to archive what, will be initially published to NDSA members, but wider distribution was discussed. For the pilot, we will focus on just NDSA members but we will explore this issue further. There was talk of opening it up at least to IIPC members and allowing them access.		The list of sites/blogs who opt-in, and ideally who has agreed to archive what, will be initially published to NDSA members, but wider distribution was discussed. For the pilot, we will focus on just NDSA members but we will explore this issue further. There was talk of opening it up at least to IIPC members and allowing them access.

	~~===~~Other topics that came up during the discussion:~~===~~		Andrew provided some statistics about Wordpress.org sites. 2/3rds of them are from the international community (so IIPC should have high interest). We hope to discuss the pilot at the IIPC GA in May.

			'''
			Other topics that came up during the discussion:'''

	*Archiving will capture the look and feel/functionality, images, etc. not just the text. We discussed capture of feeds but at this time we're not exploring that.		*Archiving will capture the look and feel/functionality, images, etc. not just the text. We discussed capture of feeds but at this time we're not exploring that.
Line 85:		Line 88:
	*If NDSA members are interested in encouraging blog owners to install the plugin so that archiving is easier, they could send a link to the plugin page with instructions for installing. The pilot project will not include a "permissions letter" per se since the plugin opt-in grants the permissions required.		*If NDSA members are interested in encouraging blog owners to install the plugin so that archiving is easier, they could send a link to the plugin page with instructions for installing. The pilot project will not include a "permissions letter" per se since the plugin opt-in grants the permissions required.
	*Mention of Creative Commons licenses - we hope that we can encourage blog owners to put these on their sites.		*Mention of Creative Commons licenses - we hope that we can encourage blog owners to put these on their sites.
	*~~One~~ option Andrew ~~brought up was~~		*Andrew suggested he could also code the plugin to do a look-up in archive.org to show what's already been archived. Bring awareness to archiving in general.
			*We talked about it being a two-way communication - this is alerting NDSA of sites to archive, but we could also send back information to the site owner about who has selected their site for archiving with links to the archive. Since some organizations make content available after an embargo period (which is not always consistent between organizations), this could be tricky but something to think about.
			*Should the embargo be consistant among all NDSA members participating?
			*NDSA members participating should agree to some set of basic requirements for archiving that is consistent.
			*What if a site owner doesn't want to be preserved by a particular NDSA member? We talked about but decided they won't have an option to pick and choose if they opt-in. If it becomes an issue we will discuss further during the pilot.
			*If a site owner changes their mind, they can opt out of future archiving, but none of their previously archived content will be deleted.
			*Could a statement of opt-in also be inserted into the robots.txt file? We may explore this during the pilot.
			*Other stats from Andrew: 14% of web are wordpress sites, and 22 of every 100 new domains registered become wordpress sites.


	==Next Steps/Action Items==		==Next Steps/Action Items==

Abgr at 19:46, 7 November 2011

2011-11-07T19:46:14Z

← Older revision		Revision as of 15:46, 7 November 2011
Line 77:		Line 77:
	'''*Do we want data shared about who is preserving what? If organizations are picking and choosing what to preserve from the available blogs, might be good to have that information available to others (publicly or among NDSA members?)'''		'''*Do we want data shared about who is preserving what? If organizations are picking and choosing what to preserve from the available blogs, might be good to have that information available to others (publicly or among NDSA members?)'''

			The list of sites/blogs who opt-in, and ideally who has agreed to archive what, will be initially published to NDSA members, but wider distribution was discussed. For the pilot, we will focus on just NDSA members but we will explore this issue further. There was talk of opening it up at least to IIPC members and allowing them access.

	===Other topics that came up during the discussion:===		===Other topics that came up during the discussion:===
Line 85:		Line 85:
	*If NDSA members are interested in encouraging blog owners to install the plugin so that archiving is easier, they could send a link to the plugin page with instructions for installing. The pilot project will not include a "permissions letter" per se since the plugin opt-in grants the permissions required.		*If NDSA members are interested in encouraging blog owners to install the plugin so that archiving is easier, they could send a link to the plugin page with instructions for installing. The pilot project will not include a "permissions letter" per se since the plugin opt-in grants the permissions required.
	*Mention of Creative Commons licenses - we hope that we can encourage blog owners to put these on their sites.		*Mention of Creative Commons licenses - we hope that we can encourage blog owners to put these on their sites.
			*One option Andrew brought up was

	==Next Steps/Action Items==		==Next Steps/Action Items==

Abgr at 19:34, 7 November 2011

2011-11-07T19:34:58Z

← Older revision		Revision as of 15:34, 7 November 2011
Line 2:		Line 2:

	=Attendees=		=Attendees=


	*'''Anderson, Janice Snyder''' \| Georgetown University Law Library \| anderjan@law.georgetown.edu		*'''Anderson, Janice Snyder''' \| Georgetown University Law Library \| anderjan@law.georgetown.edu