Differences between revisions 22 and 23
Revision 22 as of 2007-07-02 08:25:22
Size: 1395
Editor: EldZierau
Comment:
Revision 23 as of 2007-07-03 08:58:14
Size: 1603
Editor: EldZierau
Comment:
Deletions are marked like this. Additions are marked like this.
Line 2: Line 2:
Line 4: Line 3:
The primary function of the !NetarchiveSuite is to plan, schedule and run web harvests of parts of the Internet. The !NetarchiveSuite is built
around the Heritrix web crawler and is scalable to national domain level crawls as well as built for small selective and thematic harvests.
The software has built-in bit preservation functionality as well as the overall architecture is distributed among machines and geographical
locations. For more information please refer to ["Overview"]
The primary function of the !NetarchiveSuite is to plan, schedule and run web harvests of parts of the Internet. It scales to a wide range of tasks, from small, thematic harvests (e.g. related to special events, or special domains) to harvesting and archiving the content of an entire national domain.
The software has built-in bit preservation functionality. The systems architecture allows for the software to be distributed among several machines, possibly on more than one geographical location.
The !NetarchiveSuite is built around the Heritrix web crawler, which is fundamental for the NetarchiveSuite behavior in harvests of the web.
You find more information in the [:Overview:overview].

Welcome to the NetarchiveSuite

The NetarchiveSuite is the complete web archiving software package developed within the netarchive.dk project from 2004 and onwards. The primary function of the NetarchiveSuite is to plan, schedule and run web harvests of parts of the Internet. It scales to a wide range of tasks, from small, thematic harvests (e.g. related to special events, or special domains) to harvesting and archiving the content of an entire national domain. The software has built-in bit preservation functionality. The systems architecture allows for the software to be distributed among several machines, possibly on more than one geographical location. The NetarchiveSuite is built around the Heritrix web crawler, which is fundamental for the NetarchiveSuite behavior in harvests of the web. You find more information in the [:Overview:overview].

Include(News)

To get started trying out the software in a simple setup. This should contain all needed information to get a simple test system up and running on a standard linux machine. Please refer to ["Get NetarchiveSuite"] and use the [:QuickStart Manual:Quick Start Manual] for the installation. Everything is released with full source under the LGPL license.

The NetarchiveSuite software was developed by the two national deposit libraries in Denmark, [http://www.kb.dk/ The Royal Library] and [http://www.statsbiblioteket.dk The State and University Library], and has been running in production, harvesting the Danish world wide web for two years. The Danish netarchive currently contains over 30 TB of data.

Welcome (last edited 2012-04-10 10:43:03 by MikisSethSorensen)