Differences between revisions 18 and 19
Revision 18 as of 2010-11-08 15:24:37
Size: 35672
Comment:
Revision 19 as of 2010-11-08 15:26:41
Size: 35786
Comment:
Deletions are marked like this. Additions are marked like this.
Line 52: Line 52:
||<style="vertical-align: top;">'''18. Module Harvester: '''''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1851|Bug 1851]]'' Close connexions with Heritrix on unfinished jobs ||<style="text-align: center;"> ||<style="text-align: center;">?? ||<style="text-align: center;">Ask BNF for status||<style="text-align: center;"> ||<style="text-align: center;"> ||<#cccccc style="text-align: center;"> ||
||<style="vertical-align: top;">'''19. Module Harvester:'''[[https://gforge.statsbiblioteket.dk/tracker/?group_id=7&atid=105&func=detail&aid=2019|Bug 2019]] Select of Harvest name may not work ||<style="text-align: center;"> ||<style="text-align: center;">Nicolas ||<style="text-align: center;"> ||<style="text-align: center;"> ||<style="text-align: center;"> ||<#cccccc style="text-align: center;"> ||
||<style="vertical-align: top;">'''18. Module Harvester: '''''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1851|Bug 1851]]'' Close connexions with Heritrix on unfinished jobs ||<style="text-align: center;"> ||<style="text-align: center;">?? ||<style="text-align: center;"> ||<style="text-align: center;"> ||<style="text-align: center;">Ask BNF for status||<#cccccc style="text-align: center;"> ||
||<style="vertical-align: top;">'''19. Module Harvester:'''[[https://gforge.statsbiblioteket.dk/tracker/?group_id=7&atid=105&func=detail&aid=2019|Bug 2019]] Select of Harvest name may not work ||<style="text-align: center;"> ||<style="text-align: center;">Nicolas ||<style="text-align: center;"> ||<style="text-align: center;"> ||<style="text-align: center;">Fixed and part of stable release 3.14.0||<#cccccc style="text-align: center;"> ||
Line 68: Line 68:
||<style="vertical-align: top;">'''29. Module harvester: '''''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1956|Feature request 2011]] ''Harvest documentation : generate an optional arcfiles-report.txt ||<style="text-align: center;"> ||<style="text-align: center;">Nicolas ||<style="text-align: center;"> ||<style="text-align: center;"> ||<style="text-align: center;"> ||<#cccccc style="text-align: center;">-''' ''' ||
||<style="vertical-align: top;">'''30. Module harvester:''' ''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1956|Feature request 1969]]'' Missing start and end date columns in Job status to search after ||<style="text-align: center;"> ||<style="text-align: center;">Nicolas ||<style="text-align: center;"> ||<style="text-align: center;"> ||<style="text-align: center;"> ||<#cccccc style="text-align: center;"> ||
||<style="vertical-align: top;">'''29. Module harvester: '''''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1956|Feature request 2011]] ''Harvest documentation : generate an optional arcfiles-report.txt ||<style="text-align: center;"> ||<style="text-align: center;">Nicolas ||<style="text-align: center;"> ||<style="text-align: center;"> ||<style="text-align: center;">Fixed and part of stable release 3.14.0||<#cccccc style="text-align: center;">-''' ''' ||
||<style="vertical-align: top;">'''30. Module harvester:''' ''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1956|Feature request 1969]]'' Missing start and end date columns in Job status to search after ||<style="text-align: center;"> ||<style="text-align: center;">Nicolas ||<style="text-align: center;"> ||<style="text-align: center;"> ||<style="text-align: center;">Fixed and part of stable release 3.14.0||<#cccccc style="text-align: center;"> ||

Task list and timetable for iteration 46

Status

OK/Not Ok

1. Highlights approved

2. Assignment of tasks

3. Task list and time table approved

4. Implementation phase started

5. Release test phase started

6. Assignment phase for next iteration started

7. Iteration 46 completed

Highlights for Iteration

  • Implement high priority FR from BNF, ONB and Netarkivet
  • Support of released NetarchiveSuite (http://netarchive.dk/suite).

  • Fix prioritized bugs
  • Support of Wayback in the Netarchive.dk production site. See List of tasks and Assignment for Wayback Integration

  • Migration of old Web materials to Netarchive.dk
  • Iteration 46 is planned as a development release.

Development procedure

Table of tasks

Tasks for iteration 46. Updated 3. September 2010

Estimate md

Main responsible

Reviewer

Remaining md at 24. August 2010

Comments

Status

Implementation phase (task x-n)

Open Source release + bugs and feature request

-

-

-

Support of Open Source Release

1. Support of released NetarchiveSuite

2

All (Google calender)

2

Ongoing

2. Implement translateprocess. Adjustment to Open Source partners.

1

CSR

SVC

Ongoing

3. Maintain French Translation files.

1

Nicolas/Sara

SVC

Ongoing

4. Maintain Italian and german Translation files.

1

Andreas

SVC

Ongoing

Bugs and Feature requests

Prioritized bugs according to list of priority 4 and priority 3 tasks.

-

-

SubTotal 0

..

-

Priority 5 bug. Patch release 3.14.1

5 Module Harvester: Bug 2059 java.lang.OutOfMemoryError:Out of swap space? etc

1

MSS

SVC

Test in test enviroment indicates the bug is solved temporarly. Proper and stable fix is required before start of next Netarkiv snap shot.

Starts when 3.14.0 is released.

Priority 4 bugs

6.

7.

8.

9.

Priority 3 bugs

10. Module harvester: Bug 688 hosts-report should be IDNA decoded when writing harvestInfo to the DB

-

11. Module Access: Bug 823 No index = Internal server error

12. Module Monitor: Bug 1756 JMX status page does not update when a new application is started on previously used JMX port

13. Module Archive: Bug 1782 Same datetime repeated many times, while logging batch checksum of files

14. Module Archive: Bug 1708 bitpreservation logic offers "add to archive" for file that is not in either location

15. Module Archive: Bug 1193 Exceptions from FileBatchJob stop batch job processing

16. Module Archive: Bug 1260 Too much and wrong feedback information on "Missing pages"

17. Module Monitor: Bug 1205 Security policy for unit tests contains hardcoded path to development environment

18. Module Harvester: Bug 1851 Close connexions with Heritrix on unfinished jobs

??

Ask BNF for status

19. Module Harvester:Bug 2019 Select of Harvest name may not work

Nicolas

Fixed and part of stable release 3.14.0

20. Module Harvester: Bug 2073 Document postgres database

MSS

21. Module Harvester: Bug 2074 Trim HarvestJobManager related documentation on the wiki

MSS

..

22. Module Harvester: Bug 1968 Unable to run unit tests from ant

MSS

..

23. Module Harvester: Bug 2005 Trim HarvestJobManager related documentation on the wiki

MSS

..

Prioritized Feature Requests according to list of priority 4 and priority 3 tasks

-

-

SubTotal 21

-

Priority 4 Feature request

24

25. Module Harvester:Feature request 1813 An extra resubmit button to make it visible which jobs have already been handled

MSS

JOLF

Depends on whether feature still required after implementing FR 1928

TBD whether or not to postpone this issue.

26. Module Harvester:Feature request 929 Documentation needed for how we split jobs (incl. maybe additional splitting modularity)

2

SVC

JOLF

27.

28.

Priority 3 Feature request

29. Module harvester: Feature request 2011 Harvest documentation : generate an optional arcfiles-report.txt

Nicolas

Fixed and part of stable release 3.14.0

-

30. Module harvester: Feature request 1969 Missing start and end date columns in Job status to search after

Nicolas

Fixed and part of stable release 3.14.0

31. Module Harvester:Feature request 1681 Add seed to DB via webservice (via Browser Extension/Rich Client)

Andreas

-

32. Module Harvester:Feature request 1682 Statistics (DB access, scripts, batch jobs ....)

Andreas

-

33. Module Harvester:Feature request 1683 Util for regenerate admin.data file

Andreas

-

34. Module Harvester:Feature request 1684 Activity when domain is to be crawled. One table for seed

Andreas

-

35. Module Archive:Feature request 1743 When accessing Bitpreservation this takes really long time

JOLF

-

36. Module Harvester:Feature request 1120 Crawlertrap info should be shareable between institutions

Andreas

SVC will add comments to this FR. Might be an easy solution to share Crawlertraps by emailing files with crawler trap informations.

Redundant (Copy of ??)

37. Module Harvester:Feature request 1066 Show whether seed URL existed

Andreas

-

38. Module Archive:Feature request 1809 Write assignment for improving batchjob interface

JOLF

See FR 1881

DONE

Roadmap tasks

Total 52?

-

-

Total 8,5

-

Tasks from ...

39. QA: Assignment for enhanced QA tools

2

SVC

CSR

High priority

On going

40. WARC: Finalize Assigment for Harvester for support of WARC format

?

41. Archive: Implement Assignment B.2.3 - Use segments in bitarchives

6

42. Archive: Implement Assignment B.2.4 - Write BitPreservation scheduler

5

43. Archive: Implement Assignment B.2.5 - Write BitPreservation webinterface

6

-

..

Crawl-problems (Netarchive.dk) .

Total x

-

-

Total x

-

Focus on following crawl-problems

44. Support to Crawl-problems

CSR

SVC

1

High priority

On going

45. Feature Request 1881 Quality assurance through a batchjob interface

JOLF

MSS

High priority

Fixed and Reviewed

Wayback/Nutchwax tasks independent of NetarchiveSuite code-freeze.

Total x

-

-

Total x

-

Tasks from ...

46.Wayback: Documentation of Indexer/Aggregator

2

CSR

JOLF

1

High priority

Done (Additonal Tools + Config Manual). To be reviewed.

47. Wayback deploy: Complete Wayback deploy

2

JOLF

CSR

2

High priority

-

..

Converting old Web collections to Netarchive.dk. See proposal. These task will be independent of NetarchiveSuite code-freeze.

Total x

-

-

Total x

-

Tasks from ...

48. Old Web collection: Old KB Webarchive

SVC

JOLF

High priority

In progress

49. Old Web collection: Old Webarchive from Niels Brugger collected by HTTrack

MSS

SVC

High priority

Awaiting metadata definition

50. Old Web collection: Prepare ingest of extracted data from Internet Archive into Netarkivet.dk

SVC

MSS

High priority

In progress

51. Old Web collection: Ingest received data from Internet Archive into Netarkivet.dk

CLO

SVC

-

Common tasks calculated as implementation tasks

Total x

-

-

Total x

-

Others

Total x

-

-

SubTotal 2

-

52. Batch: Create/execute a batch test script specified by 1 or 2 researchers

2

JOLF

TLR

High priority

Postponed

53. Snapshot: Tasks from SG. See mail fra GJA,CHH and document with tasks

..

..

Prepare release test

Total x

-

-

SubTotal 12

-

54. Prepare release test

6

TLR

6

-

Available man-days for implementation phase

Total x

-

-

Total x

-

Release test phase (task ...)

Release test

Total x

-

-

Total 12

-

55. Execute release test.

12

TLR

All

12

In progress

'

..

Release notes

Total x

-

-

Total 0,5

-

56. Write release notes

0,5

SVC

-

Available man-days for release test phase

Total x

-

-

Total 10

-

Assignment phase for next iteration (task ...)

57. Component bug/feature fix/management

QA

..

58. Define goals for Iteration 47 task list

CHH

..

59. Presentation of goals and tasks for Iteration 46. Achieve a common understanding of the purpose of the iteration and each task on status meeting

SVC

..

60. Assignment of tasks, bugs and feature request

QA

..

61. Update release test procedure

TLR

..

Available man-days for assigment phase

Total x

-

-

Total 22

-

Timetable

Timetable iteration 46. Updated 8. September 2010

Start time

End time

Responsible

Baseline 8. November 2010. Start time

Baseline 8. November 2010. End time

1. Implementation of decided tasks

8. November 2010

17. January 2011

8. November 2010

17. January 2011

2. Code freeze. Create the build for release test and notify when build is ready

18. January 2011

SVC

18. January 2011

3. Release test

18. January 2011

21. January 2011

TLR

18. January 2011

21. January 2011

4. Code unfreeze

24. January 2011

SVC

24. January 2011

5. Assignments, bug components and bug fixes

19. January 2011

20. January 2011

19. January 2011

20. January 2011

Iteration46TaskList (last edited 2011-03-02 07:32:31 by ChristenHedegaard)