NDSA:August 21, 2013 Meeting Minutes - Revision history

Dlfadm: 14 revisions imported: Migrate NDSA content from Library of Congress

2016-02-11T19:20:18Z

14 revisions imported: Migrate NDSA content from Library of Congress

← Older revision		Revision as of 15:20, 11 February 2016
(No difference)

Abgr: /* Next Steps */

2013-08-21T21:57:56Z

Next Steps

← Older revision		Revision as of 17:57, 21 August 2013
Line 72:		Line 72:
	==Next Steps==		==Next Steps==

	Abbie offered to compile minutes and share with listserv. Joel pointed out there are a lot of questions and we haven't agreed on dropping any old ones yet, so we'll need to figure out how best to shape this. We discussed making more questions multiple choice and less open-ended, which will help with compiling results at the end. Nicholas and Edward offered to help draft questions. We'll figure out where to go from here after everyone reviews these minutes. Survey will take place in October, so we have a ~~few months~~ to prepare it.		Abbie offered to compile minutes and share with listserv. Joel pointed out there are a lot of questions and we haven't agreed on dropping any old ones yet, so we'll need to figure out how best to shape this. We discussed making more questions multiple choice and less open-ended, which will help with compiling results at the end. Nicholas and Edward offered to help draft questions. We'll figure out where to go from here after everyone reviews these minutes. Survey will take place in October, so we have a month to prepare it.

	-end-		-end-

Abgr: /* Discussion Notes */

2013-08-21T21:57:14Z

Discussion Notes

← Older revision		Revision as of 17:57, 21 August 2013
Line 25:		Line 25:

	* I think it would be extremely helpful to see the progress organizations have made in the last two years. Sort of a "are you better or worse off than in 2011" type of polling.		* I think it would be extremely helpful to see the progress organizations have made in the last two years. Sort of a "are you better or worse off than in 2011" type of polling.
	* I keep hearing over and over gain the need to understand internal work flows, skill sets required, resources needed to initiate and sustain a web archiving program.		* I keep hearing over and over gain the need to understand internal work flows, skill sets required, resources needed to initiate and sustain a web archiving program. And the answers might be different for a one person shop than with a five person team. Or they may be the same. Perhaps we could have more in depth questions around this area.
	And the answers might be different for a one person shop than with a five person team. Or they may be the same. Perhaps we could have more in depth questions around this area.

	Michael found it comforting in reading original survey that things they were struggling with, others were struggling with too.		Michael found it comforting in reading original survey that things they were struggling with, others were struggling with too.

Abgr: /* Discussion Notes */

2013-08-21T21:56:59Z

Discussion Notes

← Older revision		Revision as of 17:56, 21 August 2013
Line 24:		Line 24:
	Kristine Hanna (IA) couldn't join us today but submitted these comments to Abbie, which she shared with group:		Kristine Hanna (IA) couldn't join us today but submitted these comments to Abbie, which she shared with group:

	* I think it would be extremely helpful to see the progress organizations have made in the last two years.		* I think it would be extremely helpful to see the progress organizations have made in the last two years. Sort of a "are you better or worse off than in 2011" type of polling.
	Sort of a "are you better or worse off than in 2011" type of polling.
	* I keep hearing over and over gain the need to understand internal work flows, skill sets required, resources needed to initiate and sustain a web archiving program.		* I keep hearing over and over gain the need to understand internal work flows, skill sets required, resources needed to initiate and sustain a web archiving program.
	And the answers might be different for a one person shop than with a five person team. Or they may be the same. Perhaps we could have more in depth questions around this area.		And the answers might be different for a one person shop than with a five person team. Or they may be the same. Perhaps we could have more in depth questions around this area.

Abgr: /* Discussion Notes */

2013-08-21T21:56:50Z

Discussion Notes

← Older revision		Revision as of 17:56, 21 August 2013
Line 24:		Line 24:
	Kristine Hanna (IA) couldn't join us today but submitted these comments to Abbie, which she shared with group:		Kristine Hanna (IA) couldn't join us today but submitted these comments to Abbie, which she shared with group:

	1) I think it would be extremely helpful to see the progress organizations have made in the last two years.		* I think it would be extremely helpful to see the progress organizations have made in the last two years.
	Sort of a "are you better or worse off than in 2011" type of polling.		Sort of a "are you better or worse off than in 2011" type of polling.
			* I keep hearing over and over gain the need to understand internal work flows, skill sets required, resources needed to initiate and sustain a web archiving program.
	2) I keep hearing over and over gain the need to understand internal work flows, skill sets required, resources needed to initiate and sustain a web archiving program.
	And the answers might be different for a one person shop than with a five person team. Or they may be the same. Perhaps we could have more in depth questions around this area.		And the answers might be different for a one person shop than with a five person team. Or they may be the same. Perhaps we could have more in depth questions around this area.

Abgr: /* What to repeat */

2013-08-21T21:48:51Z

What to repeat

← Older revision		Revision as of 17:48, 21 August 2013
Line 38:		Line 38:
	===What to repeat===		===What to repeat===

	We didn't get too much into this but talked about problematic questions that we might drop or restructure for this year. Jefferson reported that in analyzing results, respondents seemed to have trouble with questions 13-15 (those about "what subjects in your archives" - we discussed possibly reformulating these questions but no solutions proposed yet. There was interest in keeping in some questions about news, media and journalism. Maybe we can tie those with policy questions regarding certain types of content?		We didn't get too much into this but talked about problematic questions that we might drop or restructure for this year. Jefferson reported that in analyzing results, respondents seemed to have trouble with questions 13-15 (those about "what subjects in your archives" - we discussed possibly reformulating these questions but no solutions proposed yet. There was interest in keeping in some questions about news, media and journalism. Maybe we can tie those with policy questions regarding certain types of content?


	===Possible New Areas To Explore===		===Possible New Areas To Explore===

Abgr: /* Next Steps */

2013-08-21T21:48:33Z

Next Steps

← Older revision		Revision as of 17:48, 21 August 2013
Line 76:		Line 76:
	==Next Steps==		==Next Steps==

	Abbie offered to compile minutes and share with listserv. Joel pointed out there are a lot of questions and we haven't agreed on dropping any old ones yet, so we'll need to figure out how best to shape this. We discussed making more questions multiple choice and less open-ended, which will help with compiling results at the end. Nicholas and Edward offered to help draft questions. We'll figure out where to go from here after everyone reviews these minutes.		Abbie offered to compile minutes and share with listserv. Joel pointed out there are a lot of questions and we haven't agreed on dropping any old ones yet, so we'll need to figure out how best to shape this. We discussed making more questions multiple choice and less open-ended, which will help with compiling results at the end. Nicholas and Edward offered to help draft questions. We'll figure out where to go from here after everyone reviews these minutes. Survey will take place in October, so we have a few months to prepare it.

	-end-		-end-

Abgr: /* Expand on topics from 2011 Survey */

2013-08-21T21:48:16Z

Expand on topics from 2011 Survey

← Older revision		Revision as of 17:48, 21 August 2013
Line 64:		Line 64:
	PRESERVATION METHODS - Glen found the section on downloading copies/transferring data (Q20) interesting, would like this asked again but also go into what preservation methods are used: checksums, validation of files, etc. How long do people intend to keep their web archive content? Forever, or are there other retention schedules being followed?		PRESERVATION METHODS - Glen found the section on downloading copies/transferring data (Q20) interesting, would like this asked again but also go into what preservation methods are used: checksums, validation of files, etc. How long do people intend to keep their web archive content? Forever, or are there other retention schedules being followed?

	ACCESS: expand on questions		ACCESS: expand on questions - what are add-ons to access or UI issues. Are people linking to external collections or related non-web archive content in their displays?

	COLLECTION/SELECTION POLICIES: We asked about policies before in Q8-9-10 (links to #9 responses only available to NDSA members, not in final report) how are you making decisions about frequency and depth of collections? Is it budgetary or curatorial? Are your collections related to existing (print?) collections or are they new and different things?		COLLECTION/SELECTION POLICIES: We asked about policies before in Q8-9-10 (links to #9 responses only available to NDSA members, not in final report) how are you making decisions about frequency and depth of collections? Is it budgetary or curatorial? Are your collections related to existing (print?) collections or are they new and different things?
Line 73:		Line 73:

	RESEARCH USE/ USAGE STATISTICS - a bit along the lines of researcher use in original survey, we wonder about usage statistics that people might be gathering, how they are doing this, what types of "hits" are they getting. We did not that Archive-IT doesn't currently track this but a future release will make that easier. We discussed how Q25 was open ended and many of the answers were "we're not sure, too soon to tell". We also talked about a question about citations - are people tracking citations to their web archives?		RESEARCH USE/ USAGE STATISTICS - a bit along the lines of researcher use in original survey, we wonder about usage statistics that people might be gathering, how they are doing this, what types of "hits" are they getting. We did not that Archive-IT doesn't currently track this but a future release will make that easier. We discussed how Q25 was open ended and many of the answers were "we're not sure, too soon to tell". We also talked about a question about citations - are people tracking citations to their web archives?

			==Next Steps==

			Abbie offered to compile minutes and share with listserv. Joel pointed out there are a lot of questions and we haven't agreed on dropping any old ones yet, so we'll need to figure out how best to shape this. We discussed making more questions multiple choice and less open-ended, which will help with compiling results at the end. Nicholas and Edward offered to help draft questions. We'll figure out where to go from here after everyone reviews these minutes.

			-end-

Abgr: /* Discussion Notes */

2013-08-21T21:45:41Z

Discussion Notes

← Older revision		Revision as of 17:45, 21 August 2013
Line 30:		Line 30:
	And the answers might be different for a one person shop than with a five person team. Or they may be the same. Perhaps we could have more in depth questions around this area.		And the answers might be different for a one person shop than with a five person team. Or they may be the same. Perhaps we could have more in depth questions around this area.

	~~===General Comments===~~		Michael found it comforting in reading original survey that things they were struggling with, others were struggling with too.

	*Michael found it comforting in ~~reading original~~ survey ~~that things they were struggling with, others were struggling with too~~.		Nicholas suggested we standardize language in survey to say "Collecting" rather than "capture".

			The more sample policies we can gather the better, for those starting out, to refer to. If we can gather these and share more broadly would be very useful.

	===What to repeat===		===What to repeat===
Line 51:		Line 52:
	METRICS - how are people counting their data? how much do they have/volume/size of data? TB, URLs archived, other metrics in use?		METRICS - how are people counting their data? how much do they have/volume/size of data? TB, URLs archived, other metrics in use?

			DATA EXTRACTION: Are people using web harvesting to extract PDFs or other content for other purposes? If so, how? We talked about the CINCH tool and UNT's PDF extraction of EOT content as examples.

			QR/Post-processing: Some tools support removing data or deindexing/suppressing data that you don't want shown or is a "mistake" - are people doing this, if so, when/why? Is this a quality review workflow? Cathy will check with Brenda from UNT to see latest on QR survey. Do we want to add QR questions or look at what she's asked and responses separately? (or both?)

			MISC: What policies are in place that affect social media archiving? How are people approaching it? Are your collections memento-enabled?

	===Expand on topics from 2011 Survey===		===Expand on topics from 2011 Survey===

	TOOLS (Besides crawling and access): Curator tools, supplemental capture tools, other non-crawling modes of aquiring content.		TOOLS (Besides crawling and access): Curator tools, supplemental capture tools, other non-crawling modes of aquiring content. Full text indexing tools? other technologies that people are using with/for their archives?

	~~COLLECTION~~/~~SELECTION POLICIES: We asked about policies before in Q8-9-10~~ (~~links to #9 responses only available to NDSA members~~, ~~not in final report) how~~ are ~~you making decisions about frequency and depth~~ of ~~collections? Is it budgetary or curatorial? Are your collections related~~ to ~~existing (print~~?~~) collections~~ or are ~~they new and different things~~?		PRESERVATION METHODS - Glen found the section on downloading copies/transferring data (Q20) interesting, would like this asked again but also go into what preservation methods are used: checksums, validation of files, etc. How long do people intend to keep their web archive content? Forever, or are there other retention schedules being followed?

	~~PRESERVATION METHODS - Glen found the section~~ on ~~downloading copies/transferring data (Q20) interesting, would like this asked again but also go into what preservation methods are used: checksums, validation of files, etc.~~		ACCESS: expand on questions

	~~ACCESS~~: ~~expand on questions~~		COLLECTION/SELECTION POLICIES: We asked about policies before in Q8-9-10 (links to #9 responses only available to NDSA members, not in final report) how are you making decisions about frequency and depth of collections? Is it budgetary or curatorial? Are your collections related to existing (print?) collections or are they new and different things?

	ROBOTS POLICIES: expand Q28 re: robots.txt to get more details. Nicholas said open-ended comments about this hint at some possible checkbox options if not respecting robots: 1) organizations own copyright 2) we seek permissions so we ignore robots 3) discretionary (if this, ask for details - why would be ignored or not).		ROBOTS POLICIES: expand Q28 re: robots.txt to get more details. Nicholas said open-ended comments about this hint at some possible checkbox options if not respecting robots: 1) organizations own copyright 2) we seek permissions so we ignore robots 3) discretionary (if this, ask for details - why would be ignored or not).
Line 67:		Line 72:
	PERMISSIONS POLICIES: Get more granularity on permissions policies - has something changed in your policies since ARL guidance issued? Are people relying on embargoes (time frame for those)? Are there other external policies that influence your approach?		PERMISSIONS POLICIES: Get more granularity on permissions policies - has something changed in your policies since ARL guidance issued? Are people relying on embargoes (time frame for those)? Are there other external policies that influence your approach?

	RESEARCH USE/ USAGE STATISTICS - a bit along the lines of researcher use in original survey, we wonder about usage statistics that people might be gathering, how they are doing this, what types of "hits" are they getting. We did not that Archive-IT doesn't currently track this but a future release will make that easier. We discussed how Q25 was open ended and many of the answers were "we're not sure, too soon to tell" -		RESEARCH USE/ USAGE STATISTICS - a bit along the lines of researcher use in original survey, we wonder about usage statistics that people might be gathering, how they are doing this, what types of "hits" are they getting. We did not that Archive-IT doesn't currently track this but a future release will make that easier. We discussed how Q25 was open ended and many of the answers were "we're not sure, too soon to tell". We also talked about a question about citations - are people tracking citations to their web archives?

Abgr at 21:36, 21 August 2013

2013-08-21T21:36:56Z

← Older revision		Revision as of 17:36, 21 August 2013
Line 43:		Line 43:

	WORKFLOWS - would be helpful to learn more about what workflows people have in place for acquisition of web content.		WORKFLOWS - would be helpful to learn more about what workflows people have in place for acquisition of web content.
	Multiple choice might be hard; descriptive open-ended comment field?		Multiple choice might be hard; descriptive open-ended comment field? (see additional workflow comment in metadata below)

	STAFFING/SKILLSETS - All agreed that questions about staffing would be useful. Jefferson suggested we look at the infrastructure wg's staffing survey to see how they asked questions about this (full time vs part time, who is doing what? what skills do they need?		STAFFING/SKILLSETS - All agreed that questions about staffing would be useful. Jefferson suggested we look at the infrastructure wg's staffing survey to see how they asked questions about this (full time vs part time, who is doing what? what skills do they need? Who is selecting what is being captured?

	METADATA = In Q24 we ask about whether people do catalog records, but didn't get into more detail. Would be good to inquire about how you structure descriptions, what fields are used, what formats (MODS, DUBLIN CORE, etc.). What data is auto-generated/extracted from archive vs. manually created or edited? What percent of auto generated data needs to be corrected? What is the workflow for metadata creation? Are there difficulties resolving descriptions with existing standards?		METADATA - In Q24 we ask about whether people do catalog records, but didn't get into more detail. Would be good to inquire about how you structure descriptions, what fields are used, what formats (MODS, DUBLIN CORE, etc.). What data is auto-generated/extracted from archive vs. manually created or edited? What percent of auto generated data needs to be corrected? What is the workflow for metadata creation? Are there difficulties resolving descriptions with existing standards?

			METRICS - how are people counting their data? how much do they have/volume/size of data? TB, URLs archived, other metrics in use?


Line 53:		Line 55:
	===Expand on topics from 2011 Survey===		===Expand on topics from 2011 Survey===

	TOOLS (Besides crawling and access)		TOOLS (Besides crawling and access): Curator tools, supplemental capture tools, other non-crawling modes of aquiring content.

			COLLECTION/SELECTION POLICIES: We asked about policies before in Q8-9-10 (links to #9 responses only available to NDSA members, not in final report) how are you making decisions about frequency and depth of collections? Is it budgetary or curatorial? Are your collections related to existing (print?) collections or are they new and different things?

	PRESERVATION METHODS - Glen found the section on downloading copies/transferring data (Q20) interesting, would like this asked again but also go into what preservation methods are used: checksums, validation of files, etc.		PRESERVATION METHODS - Glen found the section on downloading copies/transferring data (Q20) interesting, would like this asked again but also go into what preservation methods are used: checksums, validation of files, etc.

	ACCESS: expand on questions		ACCESS: expand on questions

			ROBOTS POLICIES: expand Q28 re: robots.txt to get more details. Nicholas said open-ended comments about this hint at some possible checkbox options if not respecting robots: 1) organizations own copyright 2) we seek permissions so we ignore robots 3) discretionary (if this, ask for details - why would be ignored or not).

			PERMISSIONS POLICIES: Get more granularity on permissions policies - has something changed in your policies since ARL guidance issued? Are people relying on embargoes (time frame for those)? Are there other external policies that influence your approach?

			RESEARCH USE/ USAGE STATISTICS - a bit along the lines of researcher use in original survey, we wonder about usage statistics that people might be gathering, how they are doing this, what types of "hits" are they getting. We did not that Archive-IT doesn't currently track this but a future release will make that easier. We discussed how Q25 was open ended and many of the answers were "we're not sure, too soon to tell" -