Projects in pipeline

edit

Assignments

Assignments have not yet been generally moved to from our internal wiki to this wiki, but new assignments will show up here until we get the rest moved. The assignments are divided by module.

For further description of the modules, please refer to Module description in System Design document.

For further descripttion of naming conventions of assignments, please refer to the Assignment Description Guidelines in section Guidelines & Policies.

Assignments for module Access

• Access Assignment 1 Develop working prototype for Wayback access
  (older version: WaybackAssignments20081119.odt )

  • Configuration of Wayback Test System

  • Configuration of Wayback Prototype (beta-version)

• Access Assignment 2 Integrate Wayback development into main project

  • Integrate Wayback Development into Main Project

  • Tools for Generation of Wayback-ready Indexes - Specifically Deduplication and Correct HTTP-return codes

• Access Assignment 3 Tools for Automatic Maintenance of Wayback Installation

• Access Assignment 4 NutchWAX integration into NetarchiveSuite.

Assignments for module Archive

• Assignment Group B.2 Improve and isolate bit preservation GUI.( >50% DONE)

• Assignment Group B.4 Improve batch job architecture (>30% DONE)

Assignments for module Common

There are currently no new assignments for the Common module.

Assignments for module Deploy

• Deploy Assignment 1 Rewrite deploy based on settings overwrite (DONE)

Assignments for module Harvester

• Harvester Assignment 1 Upgrade to Heritrix release 3

• Harvester Assignment 2 Move to WARC writing instead of ARC writing

• Harvester Assignment 3 A tool for monitoring broad crawls (DONE)

• Harvester Assignment 4 Global Crawler Traps (An upgraded version of this has been released in 3.12, that stores the crawlertraps in the harvester database)

• Discussion Harvester 1 Migration of Harvest Definition database to Hibernate

Assignments for module Monitor

There are currently no new assignments for the Monitor module.

Prioritize assignments from Viena workshop

The following priority is made by the Netarkiv development group (SB/KB):

• 1. Replace GForge by a more modern/efficient system

• 2. Improve on deduplication

• 3. Support of data analysis of metadata ARCs

• 4. WARC support

• 5. Automation of release testing

• 6. Study the impacts of moving to Heritrix 3

The following wishes might be too complex (rewrite of a large part of NAS's core functionality)

• 7. Introduction of Hibernate

• 8. Introduction of Spring

The following wish should be in cooperation with project “National Bitmagasin” as it is a complex task. Might not be a NAS task

• 9. POC for other messaging systems

The following wish is from BNF (not a priority from UDV SB/KB. Therefore not estimated ):

• 10. User authentication and management P.O.C

Old Assignments

These are only represented on the old wiki:

• Old Assignment Descriptions

• Old Assignment Overview

Requirement list

These only exist on the old Wiki as requirement list. There are in the process of being put into Feature Requests.