Task list and timetable for iteration 44

Status

OK/Not Ok

1. Highlights approved

OK

2. Assignment of tasks

OK

3. Task list and time table approved

OK

4. Implementation phase started

OK

5. Release test phase started

OK

6. Assignment phase for next iteration started

OK

7. Iteration 44 completed

OK

Highlights for Iteration

Development procedure

Table of tasks

Tasks for iteration 44. Updated 24. August 2010

Estimate md

Main responsible

Reviewer

Remaining md at 24. August 2010

Comments

Status

Implementation phase (task x-n)

Open Source release + bugs and feature request

-

-

-

Support of Open Source Release

1. Support of released NetarchiveSuite

2

All (Google calender)

2

Ongoing

2. Implement translateprocess. Adjustment to Open Source partners.

1

CSR

SVC

Ongoing

3. Maintain French Translation files.

1

Nicolas/Sara

SVC

Ongoing

4. Maintain Italian and german Translation files.

1

Andreas

SVC

Ongoing

Bugs and Feature requests

Prioritized bugs according to list of priority 4 and priority 3 tasks.

-

-

SubTotal 0

..

-

Priority 5 bug

5 Module monitor?: Bug 1895 Running checksum gives Garbage Collector OutOfMemoryError and schedule stops

1

SVC

CSR

Max heap for Bitarchive monitors raised to 1936MB in prod. Awaiting results of observations after upgrade of java in production environment and installation of version 3.12.1

Need info

Priority 4 bugs

6. Module test Bug 1739 Missing information in System State GUI

TLR

CSR

.

OK

7. Module harvester: Bug 2001 No results when startdate equals enddate on page harveststatus-alljobs.jsp

Nicolas

SVC

Fixed. And reviewed

8. Module Archive: Bug 1962 Batchjob fails when ArcRepository is overloaded

JOLF

CSR

Awaiting results of observations after upgrade to 3.12.1

Need Info

9. Module Common: Bug 1849 Invalid javadoc for DomainUtils#DOMAINNAME_CHAR_REGEX_STRING

CSR

SVC

Documentation issue.

Fixed, awaiting review

10. Module harvester: Bug 1961 Possible to store invalid set of crawlertraps to domain causing the domain to be unreadable

1

SVC

JOLF

.

Fixed. and reviewed

11. Module harvester: Bug 1972 Resubmit selected failed job does not do anything and gives a webpage error

Nicolas

SVC

11b. Module Access: Bug 1980 Wayback deploy script does not rebuild wayback.war

1

CSR

Test script used as template for prod deploy

Fixed (Review not needed)

11c. Module Common: Bug 2017 Changes in default configuration

JOLF

Sara

JOLF mailed Sara

Won't fix

11d. Module Harvester : Bug 2016 Still missing Heritrix reports

Nicolas

SVC

Review in branch

11e. Module Monitor : Bug 2018 Scheduling is not always working

Nicolas

SVC

Review in branch

Priority 3 bugs

12. Module harvester: Bug 688 hosts-report should be IDNA decoded when writing harvestInfo to the DB

-

13. Module Access: Bug 823 No index = Internal server error

14. Module Monitor: Bug 1756 JMX status page does not update when a new application is started on previously used JMX port

15. Module Archive: Bug 1782 Same datetime repeated many times, while logging batch checksum of files

16. Module Documentation: Bug 1779 Improve documentation of the additional tools

Task 16 was fixed by JOLF in iteration 43

OK

17. Module Archive: Bug 1708 bitpreservation logic offers "add to archive" for file that is not in either location

18. Module Archive: Bug 1193 Exceptions from FileBatchJob stop batch job processing

19. Module Archive: Bug 1260 Too much and wrong feedback information on "Missing pages"

20. Module Monitor: Bug 1205 Security policy for unit tests contains hardcoded path to development environment

20a. Module Havester: Bug 1851 Close connexions with Heritrix on unfinished jobs

??

20b. Module Harvester: Bug 2019 Select of Harvest name may not work

Nicolas

..

Prioritized Feature Requests according to list of priority 4 and priority 3 tasks

-

-

SubTotal 21

-

Priority 4 Feature request

23. Module Harvester: Feature request 1928 Ability to easily resubmit a selection of failed jobs

Nicolas/Sara

CSR

Implemented. See outstanding bug 1972

Fixed. Awaiting review

24. Module Harvester:Feature request 1813 An extra resubmit button to make it visible which jobs have already been handled

MSS

JOLF

Depends on whether feature still required after implementing FR 1928

Postponed

25. Module Harvester:Feature request 929 Documentation needed for how we split jobs (incl. maybe additional splitting modularity)

2

SVC

JOLF

Postponed

26. Module Harvester:Feature request 1774 Stop using the JMS queues for queuing snapshot harvests

MSS

SVC

Review in branch

In progress

27. Module harvester: Feature request 1963 Make a HarvestSchedulerApplication that runs the HarvestScheduler

MSS

JOLF

Review in branch

In progress

28. Module access: Feature request 1956 Shared dependency links harvester and wayback modules

0.5

SVC

CSR

OK

Priority 3 Feature request

28a. Module harvester: Feature request 2011 Harvest documentation : generate an optional arcfiles-report.txt

Nicolas

-

28b. Module harvester: Feature request 1969 Missing start and end date columns in Job status to search after

Nicolas

29. Module Harvester:Feature request 1681 Add seed to DB via webservice (via Browser Extension/Rich Client)

Andreas

-

30. Module Harvester:Feature request 1682 Statistics (DB access, scripts, batch jobs ....)

Andreas

-

31. Module Harvester:Feature request 1683 Util for regenerate admin.data file

Andreas

-

32. Module Harvester:Feature request 1684 Activity when domain is to be crawled. One table for seed

Andreas

-

33. Module Archive:Feature request 1743 When accessing Bitpreservation this takes really long time

JOLF

-

34. Module Harvester:Feature request 1120 Crawlertrap info should be shareable between institutions

Andreas

SVC will add comments to this FR. Might be an easy solution to share Crawlertraps by emailing files with crawler trap informations.

Redundant (Copy of ??)

35. Module Harvester:Feature request 1066 Show whether seed URL existed

Andreas

-

36. Module Archive:Feature request 1809 Write assignment for improving batchjob interface

JOLF

See FR 1881

DONE

Roadmap tasks

Total 52?

-

-

Total 8,5

-

Tasks from ...

37. QA: Assignment for enhanced QA tools

2

SVC

CSR

High priority

On going

38. WARC: Finalize Assigment for Harvester for support of WARC format

?

39. Archive: Implement Assignment B.2.3 - Use segments in bitarchives

6

40. Archive: Implement Assignment B.2.4 - Write BitPreservation scheduler

5

41. Archive: Implement Assignment B.2.5 - Write BitPreservation webinterface

6

-

..

Crawl-problems (Netarchive.dk) .

Total x

-

-

Total x

-

Focus on following crawl-problems

42. Support to Crawl-problems

CSR

SVC

1

High priority

On going

43. Feature Request 1881 Quality assurance through a batchjob interface

JOLF

MSS

High priority

Fixed and Reviewed

Wayback/Nutchwax tasks independent of NetarchiveSuite code-freeze.

Total x

-

-

Total x

-

Tasks from ...

44. Wayback: Implement Index Aggregator

4

MSS

JOLF

High Priority

Done

45.Wayback: Documentation of Indexer/Aggregator

2

CSR

JOLF

1

High priority

Done (Additonal Tools + Config Manual). To be reviewed.

46. Wayback deploy: Complete Wayback deploy

2

JOLF

CSR

2

High priority

-

..

Converting old Web collections to Netarchive.dk. See proposal. These task will be independent of NetarchiveSuite code-freeze.

Total x

-

-

Total x

-

Tasks from ...

47. Old Web collection: Old KB Webarchive

SVC

JOLF

High priority

In progress

48. Old Web collection: Old Webarchive from Niels Brugger collected by HTTrack

MSS

SVC

High priority

Awaiting metadata definition

49. Old Web collection: Prepare ingest of extracted data from Internet Archive into Netarkivet.dk

SVC

MSS

High priority

In progress

50. Old Web collection: Ingest received data from Internet Archive into Netarkivet.dk

CLO

SVC

-

Common tasks calculated as implementation tasks

Total x

-

-

Total x

-

Others

Total x

-

-

SubTotal 2

-

51. Upgrade: New KB-PROD-UDV

5

SVC

TLR

High priority

OK

52. Batch: Create/execute a batch test script specified by 1 or 2 researchers

2

JOLF

TLR

High priority

Postponed

..

..

Prepare release test

Total x

-

-

SubTotal 12

-

53. Prepare release test

6

TLR

6

-

Available man-days for implementation phase

Total x

-

-

Total x

-

Release test phase (task ...)

Release test

Total x

-

-

Total 12

-

54. Execute release test.

12

TLR

All

12

In progress

'

..

Release notes

Total x

-

-

Total 0,5

-

55. Write release notes

0,5

SVC

-

Available man-days for release test phase

Total x

-

-

Total 10

-

Assignment phase for next iteration (task ...)

56. Component bug/feature fix/management

QA

..

57. Define goals for Iteration 45 task list

CHH

..

58. Presentation of goals and tasks for Iteration 45. Achieve a common understanding of the purpose of the iteration and each task on status meeting

SVC

..

59. Assignment of tasks, bugs and feature request

QA

..

60. Update release test procedure

TLR

..

Available man-days for assigment phase

Total x

-

-

Total 22

-

Timetable

Timetable iteration 44. Updated 8. September 2010

Start time

End time

Responsible

Baseline 9. June 2010. Start time

Baseline 9. June 2010. End time

1. Implementation of decided tasks

14. June 2010

30. August 2010

14. June 2010

23. August 2010

2. Code freeze. Create the build for release test and notify when build is ready

31. August 2010

SVC

24. August

3. Release test

31. August 2010

3. September 2010

TLR

24. August

24. August

4. Code unfreeze

8. September 2010

SVC

27. August

5. Assignments, bug components and bug fixes

2. September 2010

3. September 2010

25. August

26. August

Iteration44TaskList (last edited 2010-09-09 09:58:45 by ChristenHedegaard)