NetarchiveSuite|
Size: 1394
Comment:
|
Size: 1395
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 4: | Line 4: |
| The primary function of the NetarchiveSuite is to plan, schedule and run web harvests of parts of the Internet. The !NetarchiveSuite is built | The primary function of the !NetarchiveSuite is to plan, schedule and run web harvests of parts of the Internet. The !NetarchiveSuite is built |
Welcome to the NetarchiveSuite
The NetarchiveSuite is the complete web archiving software package developed within the netarchive.dk project from 2004 and onwards. The primary function of the NetarchiveSuite is to plan, schedule and run web harvests of parts of the Internet. The NetarchiveSuite is built around the Heritrix web crawler and is scalable to national domain level crawls as well as built for small selective and thematic harvests. The software has built-in bit preservation functionality as well as the overall architecture is distributed among machines and geographical locations. For more information please refer to ["Overview"]
To get started trying out the software in a simple setup. This should contain all needed information to get a simple test system up and running on a standard linux machine. Please refer to ["Get NetarchiveSuite"] and use the [:QuickStart Manual:Quick Start Manual] for the installation. Everything is released with full source under the LGPL license.
The NetarchiveSuite software was developed by the two national deposit libraries in Denmark, [http://www.kb.dk/ The Royal Library] and [http://www.statsbiblioteket.dk The State and University Library], and has been running in production, harvesting the Danish world wide web for two years. The Danish netarchive currently contains over 30 TB of data.