Task list and timetable for iteration 37

Use IterationTaskListTemplate template to start new review pages

Status

OK/Not Ok

1. Highlights approved

2. Assignment of tasks

3. Task list and time table approved

4. Implementation phase started

5. Release test phase started

6. Assignment phase for next iteration started

7. Iteration 37 completed

Highlights for Iteration

Development procedure

Table of tasks

Tasks for iteration 37. Updated 64. June 2009

Estimate md

Main responsible

Reviewer

Remaining md at 4. June 2009

Comments

Status

Implementation phase (task x-n)

Open Source release + bugs and feature request

Total x

-

-

Total x

-

Support of Open Source Release

1. [http://kb-prod-udv-001.kb.dk/twiki/bin/view/Netarkiv/SupportNetarchiveSuite Support] of released NetarchiveSuite

2

All (Google calender)

Ongoing

2. Implement translateprocess. Adjustment to Open Source partners.

1

KFC

ELZI

..

Bugs and Features requests

Prioritized bugs according to [https://kb-prod-udv-001.kb.dk/twiki/bin/view/Netarkiv/BugPrioFebruar2009 list from February 2009] and [:TaskTableFromMay2009Workshop:list] of priority 4 tasks.

Total x

-

-

SubTotal x

-

: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1254 Bug 1254] Database connections to MySQL close down intermittently?

?

Nicolas

..

..

: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1566 Bug 1566] Several Deduplicating processes started by error - only one should be possible

?

JOLF

...

..

: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=555 Bug 555] JMS connections cannot reconnect

0

...

..

: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1172 Bug 1172] password protected domain was not harvested

3

..

: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1336 Bug 1336] Harvester job dies suddenly

3

...

..

..

1

...

..

: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1218 Bug 1218] Exception while adding listeners to JMSConnection

?

...

..

: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1275 Bug 1299] Network I/O errors shuts down JMSConnection

?

..

Information: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1645 Bug 1645] JMS connections very unstable.

?

..

..

Information: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1656 Bug 1656] WARNING: Aborting crawl because og inactivity. URLS's in queue:19".

?

.

..

..

..

..

..

..

..

..

Prioritized Feature Requests according to [https://kb-prod-udv-001.kb.dk/twiki/bin/view/Netarkiv/BugPrioFebruar2009 list from February 2009] and [:TaskTableFromMay2009Workshop:list] of priority 4 tasks

Total x

-

-

SubTotal x

-

QA: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=623 Feature request 623] We need to normalize URLs when browsing data

2

See bug 1152 for a discussion on the themes of this bug. Trivial cases is solved by fixing bug 1152. For the remaining parts of this FR an assignment is required.

..

QA: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=680 Feature request 680] Cannot browse harvested password protected material.

10

..

QA: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1172 Feature request 1172] password protected domain was not harvested.

10

..

Dev help: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1436 Feature request 1436] Find replacement for com.sun.jndi.rmi.registry.RegistryContextFactory.

?

..

[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1654 Feature request 1654] second-level domains for .at in settings.xml

Andreas

..

..

..

..

..

..

..

..

..

..

Roadmap tasks <season>.

Total x

-

-

Total x

-

Tasks from ...

[:AssignmentWaybackIntegration:Task Access 2.1] Wayback Into Version Control

1,5

CSR

KFC

..

[:AssignmentWaybackIntegration:Task Access 2.2] Ant target for deployable wayback

2

CSR

JOLF

..

[:AssignmentWaybackIntegration:Task Access 2.3] Create a PROPER version of NetarchiveResourceStore

5

HBK

CSR

..

Assignment for enhanced QA tools

2

KFC

SVC

..

Finalize [:AssignmentHarvester2:Assigment] for Harvester for support of WARC format

?

SVC

KFC

..

Finalize assignment for [:AssignmentGroupB2:Assignment group B.2.2]

0,5

ELZI

KFC

..

Implement [:AssignmentGroupB2:Assignment B.2.2a] - Generalise replica to include all checksum voters

14?

JOLF

KFC

..

Implement [:AssignmentGroupB2:Assignment B.2.2b] - Store bit preservation information in a database

8

..

Implement [:AssignmentGroupB2:Assignment B.2.3] - Use segments in bitarchives

6

..

Implement [:AssignmentGroupB2:Assignment B.2.4] - Write BitPreservation scheduler

5

..

Implement [:AssignmentGroupB2:Assignment B.2.5] - Write BitPreservation webinterface

6

..

Finalize assignment for [:AssignmentGroupB4:Assignment group B.4.4] - Yet more better infrastructure

2

..

..

..

Wayback/Nutchwax tasks independent of NetarchiveSuite code-freeze.

Total x

-

-

Total x

-

Tasks from ...

..

5

..

[:AssignmentWaybackIntegration:Task Access 2.4] Deduplicated CDX Indexing (Technical investigation)

1

..

Evaluation of NutchWax.

2?

..

Technical decision on type of production HW for Wayback and Nutchwax.

2?

..

..

Converting old Web collections to Netarchive.dk. See [http://udvikling.kb.dk/cvsshadow/digiliv/ProjektDokumenter/omkostninger%20ved%20indsamling%20af%20gammelt%20materiale-3.doc proposal]. These task will be independent of NetarchiveSuite code-freeze.

Total x

-

-

Total x

-

Tasks from ...

Investigation in dataformat as well as methods

?

SVC

HBK

..

Generic converter prototype

?

SVC

HBK

..

Old KB Webarchive

?

SVC

HBK

..

Old Webarchive harvested with ARC-Httrack

?

HBK

SVC

..

Old Webarchive harvested with Wget

?

HBK

SVC

..

Old Webarchive harvested with NedLib

?

SVC

HBK

..

Old Webarchive from Niels Brugger in waf format

?

HBK

JOLF

..

Old Webarchive from Kurt Vest Nielsen (Ingeniøren from 1995)

?

JOLF

HBK

..

Webarchive from the library of The Danish Parliament

?

SVC

HBK

..

Old Webarchives from Net-papers

?

SVC

HBK

..

Digital publications of The Danish Law Gazette from the missing period

?

SVC

HBK

..

..

..

..

Common tasks calculated as implementation tasks

Total x

-

-

Total x

-

Others

Total x

-

-

SubTotal x

-

Setup of new KB test system

TLR

..

Setup open Crucible server

KFC

..

Prepare release test

Total x

-

-

SubTotal x

-

Prepare [http://kb-prod-udv-001.kb.dk/twiki/bin/view/Netarkiv/Iteration37ReleaseTest release test]

..

Available man-days for implementation phase

Total x

-

-

Total x

-

Release test phase (task ...)

Release test

Total x

-

-

Total 10

-

Execute [http://kb-prod-udv-001.kb.dk/twiki/bin/view/Netarkiv/Iteration37ReleaseTest release test].

'

..

'

..

Release notes

Total x

-

-

Total 0,5

-

-

Available man-days for release test phase

Total x

-

-

Total 10

-

Assignment phase for next iteration (task ...)

..

..

Available man-days for assigment phase

Total x

-

-

Total 22

-

Timetable

Timetable iteration 37. Updated 6. June 2009

Start time

End time

Responsible

Baseline 2. June 2009 . Start time

Baseline 2. June 2009 . End time

1. Implementation of decided tasks

2. June 2009

2. July 2009

dd-mm-yyyy

dd-mm-yyyy

2. Code freeze. Create the build for release test and notify when build is ready

27. July 2009

KFC

dd-mm-yyyy

3. Release test

27. July 2009

29. July 2009

TLR

dd-mm-yyyy

dd-mm-yyyy

4. Code unfreeze

30. July 2009

KFC

dd-mm-yyyy

5. Assignments, bug components and bug fixes

30. July 2009

31 July 2009

dd-mm-yyyy

dd-mm-yyyy'