NetarchiveSuite
Articles about web archiving in general
''Collecting and preserving the World Wide Web: A feasibility study undertaken for the JISC and Wellcome Trust'', Michael Day, UKOLN, University of Bath, Version 1.0, 25 February 2003
Articles about NetarchiveSuite
''A formal analysis of recovery in a preservational data grid'', Niels H. Christensen, Royal Library of Denmark, Dept. of Digital Preservation & Netarkivet.dk, presented at MSST2006, the 14th NASA Goddard - 23rd IEEE Conference on Mass Storage Systems and Technologies, May 15-18, 2006, College Park, Maryland, USA
Articles about harvesting
''Crawling the Hidden Web'', Sriram Raghavan and Hector Garcia-Molina, Computer Science Department, Stanford University, Stanford, CA 94305, USA, Proceedings of the 27th VLDB Conference, Roma, Italy, 2001
''Accessibility of information on the web'', Steve Lawrence and C. Lee Giles, Nature, Vol 400, 8 July 1999
''Effective Web Data Extraction with Standard XML Technologies'', Jussi Myllymaki, IBM Almaden Research Center, 650 Harry Road, San Jose, CA 95120, USA, WWW10, May 2-5, 2001, Hong Kong
''Learning to invoke Web forms'', Nicholas Kushmerick, Computer Science Department, University College Dublin, Ireland, Proc. Int. Conf. Ontologies, Databases & Applications of Semantics (Catania, 2003).
''Information retrieval in the Web: beyond current search engines'', Ricardo Baeza-Yates, Center for Web Research, Department of Computer Science, University of Chile, Blanco Encalada, 2120, Santiago, Chile, International Journal of Approximate Reasoning, Volume 34, Issues 2-3, November 2003, Pages 97-104
''Search engines and Web dynamics'', Knut Magne Risvik, Rolf Michelsen, Fast Search and Transfer ASA, Stoperigata 2, P.O. Box 1677, Vika NO-0120 Oslo, Norway, Computer Networks, Volume 39, Issue 3, 21 June 2002, Pages 289-302
''Invisible Web: Uncovering Information Sources Search Engines Can't See'', Chris Sherman and Gary Price, NJ: Information Today, Inc., 2001. 439 p. $29.95. ISBN 0-910965-51-X
''High-performance web crawling'', Marc Najork, Compaq Computer Corporation Systems Research Center, Palo Alto, CA and Allan Heydon, Model N, Inc., South San Francisco, CA, Handbook of massive data sets, pages 25 - 45, 2002, 1-4020-0489-3
Alias detection
''Classifying Web sites and Web pages: the use of metrics and URL characteristics as markers'', Wallace C. Koehler, Jr., University of Oklahoma, Journal of Librarianship and Information Science, Vol. 31, No. 1, 21-31 (1999)
''Aliasing on the world wide web: prevalence and performance implications'', Terence Kelly, University of Michigan, Ann Arbor, MI and Jeffrey Mogul, Compaq Western Research Lab, Palo Alto, CA, Proceedings of the 11th international conference on World Wide Web, Honolulu, Hawaii, USA, pages 281 - 292, 2002, 1-58113-449-5
''Finding replicated web collections.'', J. Cho,N. Shivakumar,H. Garcia-Molina, Proceedings of 2000 ACM International Conference on Management of Data (SIGMOD) Conference, May 2000
''Discovering large dense subgraphs in massive graphs'', David Gibson, Ravi Kumar, and Andrew Tomkins, IBM Almaden Research Center, San Jose, CA, Proceedings of the 31st international conference on Very large data bases, Trondheim, Norway, pages 721 - 732, 1-59593-154-6
''Mirror, mirror on the Web: a study of host pairs with replicated content'', Krishna Bharat, and Andrei Broder, Compaq Systems Research Center, 130 Lytton Avenue, Palo Alto, CA 94301, USA, Computer Networks, Volume 31, Issues 11-16, 17 May 1999, Pages 1579-1590
''A comparison of techniques to find mirrored hosts on the WWW'', Krishna Bharat, Andrei Broder, and Jeffrey Dean, Google Inc., 2400 Bayshore Ave., Mountain View, CA 94043, and Monika R. Henzinger, AltaVista Company, 1825 S. Grant St., San Mateo, CA 94402, Journal of the American Society for Information Science, Volume 51, Issue 12, Pages 1114 - 1122
''Defining Logical Domains in a Web Site'', Wen-Syan Li, Okan Kolak, Quoc Vu, and Hajime Takano, Proceedings of the eleventh ACM Conference on Hypertext and hypermedia, San Antonio, Texas, United States, pages: 123 - 132, 1-58113-227-1
Etags, datestamps, and adaptive revisiting
''Managing duplicates across sequential crawls'', Kristinn Sigurðsson, National and University Library of Iceland, Arngrímsgötu 3, 107 Reykjavík, Iceland, Proceedings of the 5th International Web Archving Workshop, Alicante, Spain, September 21-22, 2006.
''Towards a better understanding of Web resources and server responses for improved caching'', Craig E. Wills1 and Mikhail Mikhailov, Computer Science Department, Worcester Polytechnic Institute, Worcester, MA 01609, USA, Computer Networks, Volume 31, Issues 11-16, 17 May 1999, Pages 1231-1243
''Examining the cacheability of user-requested Web resources'', C. E. Wills and M. Mikhailov, Proc. of the Fourth Int. Workshop on Web Content Caching and Distribution, Apr. 1999.
''Errors in timestamp-based HTTP header values'', Mogul, J., Tech. rep. 99/3, (Dec.) Compaq Computer Corporation, Western Research Laboratory.
''Efficient crawling through URL ordering'', Junghoo Cho, Hector Garcia-Molina, and Lawrence Page, Proceedings of the Seventh International Conference on World Wide Web 7, Brisbane, Australia, pages 161 - 172, ISSN:0169-7552
''Computing web page importance without storing the graph of the web (extended abstract)'', S. Abiteboul, M. Preda, and G. Cobena, IEEE-CS Data Engineering Bulletin, Volume 25, 2002.
''Issues in Monitoring Web Data'', Serge Abiteboul, INRIA and Xyleme, France, R. Cicchetti et al. (Eds.): DEXA 2002, LNCS 2453, pp. 1â8, 2002.
''Towards Continuous Web Archiving: First Results and an Agenda for the Future'', Julien Masanès, Bibliothèque Nationale de France, D-Lib Magazine, December 2002, Volume 8 Number 12, ISSN 1082-9873
Articles about archiving and preservation
An Architectural Framework for the IIPC Toolset, Svein Arne Solbakk and Sverre Bang, National Library of Norway, IIPC working draft, October 2005
''Information and documentation - The WARC File Format'', ISO TC 46/SC 4 N 595, Working Draft.
''AONS System Documentation'', Joseph Curtis, Joseph, Australian Partnership for Sustainable Repositories, The Australian National University, Revision 169 2006-09-29, September 2006.
''Risks associated with the Use of Recordable CDs and DVDs as Reliable storage Media in Archival Collections - Strategies and Alternatives'', Kevin Bradley, Memory of the World Programme Sub-Committee on Technology, CI/INF/2006/1/REV, October 2006.
Articles about browsing harvested material
Description of other harvesting systems/archives
[Web Curator Tool], Philip Beresford, British Library, Ariadne, Issue 50, January 2007
Other bibliographies of related matter
Unclassified related material
Arms, William: [ARMS-01a]
- ”Web Preservation Project – Interim Report” Connell University, Januar 2001
Arms, William: [ARMS-01b]
- ”Web Preservation Project – Final Report” Connell University, September 2001
Aschenbrenner, Andreas: [ASCHENBRENNER-01]
- “Long-Term Preservation of Digital Material - Building an Archive to Preserve Digital Cultural Heritage from the Internet” Master Thesis, Technical University Vienna, December 2001.
http://www.ifs.tuwien.ac.at/~aola/publications/thesis-ando.pdf
Cho, Junghoo & Garcia-Monila, Hector: [CHO-00]
- “The Evolution of the web and Implications for an Incremental Crawler” Proceedings of the 26th VLDB Conference Cairo, Egypten, 2000
Lymann, Peter: [LYMAN-02]
- “Archiving the World Wide Web”
i “Building a National Strategy for Digital Preservation: Issues in Digital Media Archiving” Library of Congress & Council on Library and Information Resources, April 2002
Phillips, Margaret E: [PHILLIPS-02] “Archiving the Web: The national collection of Australian online publications”
- International Symposium on web archiving Tokyo, Japan, Januar 2002
Raghavan, Siriam & Garcia-Molina, Hector: [RAGHAVAN-01]
- “Crawling the Hidden Web” Proceedings of the 27th VLDB Conference Rom, Italien, 2001
UNESCO & National Library of Australia: [UNLA-03]
- "Guidelines for the Preservation of Digital Heritage" UNESCO, 2003
Webb, Colin: [WEBB-00]
- “Towards a Preserved National Collection of Selected Australian Digital Publications” Paper fra “Preservation 2000 Conference”, York, December 2000