attachment:transparent_logo.png

Introduction

Software to harvest and preserve websites.

The NetarchiveSuite software consists of harvesting, preserving and making available parts of the world wide web.

Its harvesting capabilities are built around the Heritrx web crawler from internet archive, but the focus of the NetarchiveSuite is to make the power of Heritrix available to the common librarian or curator.

The archiving module supports distributed storage with active bit integrity checking of large amounts of data, and support for batch runs over the data.

The access module gives a proxy-based approach, where setting a proxy in your browser will give you access to the web, as it looked at the time of harvest.

Everything is released with full source under the LGPL license.

About the Netarchive/us

The NetarchiveSuite software was developed by the two national deposit libraries in Denmark, [http://www.kb.dk/ The Royal Library] and [http://www.statsbiblioteket.dk The State and University Library], and has been running in production, harvesting the Danish world wide web for two years. The Danish netarchive currently contains over 30 TB of data.

News

Include(News)

Getting Started