Differences between revisions 76 and 77
Revision 76 as of 2009-06-06 19:05:54
Size: 34649
Comment:
Revision 77 as of 2009-06-06 19:11:10
Size: 35062
Comment:
Deletions are marked like this. Additions are marked like this.
Line 69: Line 69:
||<style="VERTICAL-ALIGN: top">'''''QA''': [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=680 Feature request 680] Cannot browse harvested password protected material. '' ||<style="TEXT-ALIGN: center">10 ||<style="TEXT-ALIGN: center"> ||<style="TEXT-ALIGN: center"> ||<style="TEXT-ALIGN: center"> ||<style="TEXT-ALIGN: center"> ||<bgcolor="#cccccc" style="TEXT-ALIGN: center">'''.. ''' ||

Task list and timetable for iteration 37

Use IterationTaskListTemplate template to start new review pages

Status

OK/Not Ok

1. Highlights approved

2. Assignment of tasks

3. Task list and time table approved

4. Implementation phase started

5. Release test phase started

6. Assignment phase for next iteration started

7. Iteration 37 completed

Highlights for Iteration

  • [http://kb-prod-udv-001.kb.dk/twiki/bin/edit/Netarkiv/SupportNetarchiveSuite Support] of released NetarchiveSuite (http://netarchive.dk/suite).

  • Enhance NetarchiveSuite wiki according to [:UpdateNetarchiveSuiteWiki:decided structure].

  • Implement bugs and feature request from [https://kb-prod-udv-001.kb.dk/twiki/bin/view/Netarkiv/BugPrioFebruar2009 this prioritized list]

  • Implementation of some of the priority 4 feature request from [:TaskTableFromMay2009Workshop:task list]

  • Enhancement of QA
  • Enhancement of Batch support
  • Finalize the support of Wayback in the Netarchive.dk production site. See [:IntegrationOfWaybck:List of tasks] and [:AssignmentWaybackIntegration:Assignment] for Wayback Integration

  • Migration of old Web materials to Netarchive.dk
  • Start of task according to roadmap
    • Module Archive

      • Enhanced support for Batch
    • Module Harvester

      • ...
    • Module Access

      • Support for Wayback
      • Test of Nutchwax
    • Module Common

      • ...
  • Bug fixes according to updated prioritized bug list
  • Iteration 37 is planned as a development release candidate.

Development procedure

Table of tasks

Tasks for iteration 37. Updated 4. June 2009

Estimate md

Main responsible

Reviewer

Remaining md at 4. June 2009

Comments

Status

Implementation phase (task x-n)

Open Source release + bugs and feature request

Total x

-

-

Total x

-

Support of Open Source Release

1. [http://kb-prod-udv-001.kb.dk/twiki/bin/view/Netarkiv/SupportNetarchiveSuite Support] of released NetarchiveSuite

2

All (Gforge list)

Ongoing

2. Implement translateprocess. Adjustment to Open Source partners.

1

..

Bugs and Features requests

Prioritized bugs according to [https://kb-prod-udv-001.kb.dk/twiki/bin/view/Netarkiv/BugPrioFebruar2009 list from February 2009] and [:TaskTableFromMay2009Workshop:list] of priority 4 tasks.

Total x

-

-

SubTotal x

-

Harvester stability: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1154 Bug 1154] Timeout kills non finished job because harvester gets stuck?

?

Also, see bug 1174. This may be the same bug on smaller scale

..

Harvester stability: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1171 Bug 1171] Heritrix initialization errors are not caught by JMXHeritrixController

?

...

..

Harvester stability: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1174 Bug 1174] Poor error message on dead job

0

This should be fixed by fixing bug 1188. No further work is required.

..

Harvester stability: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1188 Bug 1188] Heritrix side exceptions on JMX calls are ignored

3

..

Harvester stability: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1336 Bug 1336] Harvester job dies suddenly

3

Fixed with update to new Heritrix version?

..

Harvest configuration: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=688 Bug 688] hosts-report should be IDNA decoded when writing harvestInfo to the DB

1

This and 596 must be solved together.

..

Harvest configuration: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=928 Bug 928] The guess of initial size of unharvested domains is very bad on harvests with a large object limit

?

Depends on bug 929

..

Documentation: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1069 Bug 1069] Set up proxy in [http://kb-prod-udv-001.kb.dk/twiki/bin/view/Netarkiv/Dagsorden2Juni2009 Installation] manual.

?

..

Information: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1260 Bug 1260] Too much and wrong feedback information on "Missing pages".

?

This bug will automatically be solved if we chose to implement feature request #1380 "Avoid double initiations of commands by doubble click"

..

..

..

..

..

..

..

..

Prioritized Feature Requests according to [https://kb-prod-udv-001.kb.dk/twiki/bin/view/Netarkiv/BugPrioFebruar2009 list from February 2009] and [:TaskTableFromMay2009Workshop:list] of priority 4 tasks

Total x

-

-

SubTotal x

-

QA: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=623 Feature request 623] We need to normalize URLs when browsing data

2

See bug 1152 for a discussion on the themes of this bug. Trivial cases is solved by fixing bug 1152. Assignment for the remaining parts will be the task instead

..

QA: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=680 Feature request 680] Cannot browse harvested password protected material.

10

..

QA: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=680 Feature request 680] Cannot browse harvested password protected material.

10

..

Dev help: [https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1436 Feature request 1436] Find replacement for com.sun.jndi.rmi.registry.RegistryContextFactory.

?

..

[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1654 Feature request 1654] second-level domains for .at in settings.xml

Andreas

..

..

..

..

..

..

..

..

..

..

Roadmap tasks <season>.

Total x

-

-

Total x

-

Tasks from ...

..

[:AssignmentWaybackIntegration:Task Access 2.1] Wayback Into Version Control

1,5

..

Assignment for enhanced QA tools

2

..

Finalize [:AssignmentHarvester2:Assigment] for Harvester for support of WARC format

?

..

Finalize asignment for [:AssignmentGroupB2:Assignment group B.2.2]

0,5

..

Implement [:AssignmentGroupB2:Assignment B.2.2a] - Generalise replica to include all checksum voters

14?

..

Implement [:AssignmentGroupB2:Assignment B.2.2b] - Store bit preservation information in a database

8

..

Implement [:AssignmentGroupB2:Assignment B.2.3] - Use segments in bitarchives

6

..

Implement [:AssignmentGroupB2:Assignment B.2.4] - Write BitPreservation scheduler

5

..

Implement [:AssignmentGroupB2:Assignment B.2.5] - Write BitPreservation webinterface

6

..

Finalize assignment for [:AssignmentGroupB4:Assignment group B.4.4] - Yet more better infrastructure

2

..

..

..

Wayback/Nutchwax tasks independent of NetarchiveSuite code-freeze.

Total x

-

-

Total x

-

Tasks from ...

[:AssignmentWaybackIntegration:Task Access 2.2] Ant target for deployable wayback

2

..

[:AssignmentWaybackIntegration:Task Access 2.3] Create a PROPER version of NetarchiveResourceStore

5

..

[:AssignmentWaybackIntegration:Task Access 2.4] Deduplicated CDX Indexing (Technical investigation)

1

..

Evaluation of NutchWax.

2?

..

Technical decision on type of production HW for Wayback and Nutchwax.

2?

..

..

Converting old Web collections to Netarchive.dk. See [http://udvikling.kb.dk/cvsshadow/digiliv/ProjektDokumenter/omkostninger%20ved%20indsamling%20af%20gammelt%20materiale-3.doc proposal]. These task will be independent of NetarchiveSuite code-freeze.

Total x

-

-

Total x

-

Tasks from ...

Investigation in dataformat as well as methods

?

SVC

HBK

..

Generic converter prototype

?

SVC

HBK

..

Old KB Webarchive

?

SVC

HBK

..

Old Webarchive harvested with ARC-Httrack

?

HBK

SVC

..

Old Webarchive harvested with Wget

?

HBK

SVC

..

Old Webarchive harvested with NedLib

?

SVC

HBK

..

Old Webarchive from Niels Brugger in waf format

?

HBK

JOLF

..

Old Webarchive from Kurt Vest Nielsen (Ingeniøren from 1995)

?

JOLF

HBK

..

Webarchive from the library of The Danish Parliament

?

SVC

HBK

..

Old Webarchives from Net-papers

?

SVC

HBK

..

Digital publications of The Danish Law Gazette from the missing period

?

SVC

HBK

..

..

..

..

Common tasks calculated as implementation tasks

Total x

-

-

Total x

-

Others

Total x

-

-

SubTotal x

-

Setup of new KB test system

TLR

..

..

Prepare release test

Total x

-

-

SubTotal x

-

Prepare [http://kb-prod-udv-001.kb.dk/twiki/bin/view/Netarkiv/Iteration37ReleaseTest release test]

..

Available man-days for implementation phase

Total x

-

-

Total x

-

Release test phase (task ...)

Release test

Total x

-

-

Total 10

-

Execute [http://kb-prod-udv-001.kb.dk/twiki/bin/view/Netarkiv/Iteration37ReleaseTest release test].

'

..

'

..

Release notes

Total x

-

-

Total 0,5

-

-

Available man-days for release test phase

Total x

-

-

Total 10

-

Assignment phase for next iteration (task ...)

..

..

Available man-days for assigment phase

Total x

-

-

Total 22

-

Timetable

Timetable iteration 37. Updated 2. June 2009

Start time

End time

Responsible

Baseline 2. June 2009 . Start time

Baseline 2. June 2009 . End time

1. Implementation of decided tasks

2. June 2009

21. August 2009

dd-mm-yyyy

dd-mm-yyyy

2. Code freeze. Create the build for release test and notify when build is ready

24. August 2009

KFC

dd-mm-yyyy

3. Release test

24. August 2009

26. August 2009

TLR

dd-mm-yyyy

dd-mm-yyyy

4. Code unfreeze

27. August 2009

KFC

dd-mm-yyyy

5. Assignments, bug components and bug fixes

27. August 2009

28 August 2009

dd-mm-yyyy

dd-mm-yyyy'

Iteration37TaskList (last edited 2010-08-16 10:24:48 by localhost)