27979
Comment:
|
27980
|
Deletions are marked like this. | Additions are marked like this. |
Line 38: | Line 38: |
||<style="vertical-align: top">'''5 Module monitor?:''' ''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1895|Bug 1895]]'' Running checksum gives Garbage Collector !OutOfMemoryError and schedule stops and ''Bug [[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=2030|Bug 2030]]'' Message saturation of bitarchive applications result in OOM ||<style="text-align: center">1 ||<style="text-align: center">SVC ||<style="text-align: center">CSR ||<style="text-align: center"> ||<style="text-align: center">Max heap for Bitarchive monitors raised to 1936MB in prod. Awaiting results of observations after upgrade of java in production environment and installation of version 3.12.1 ||<#cccccc style="text-align: center">Need info || | ||<style="vertical-align: top">'''5 Module monitor?:''' ''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1895|Bug 1895]]'' Running checksum gives Garbage Collector !OutOfMemoryError and schedule stops and ''Bug [[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=2030|Bug 2030]]'' Message saturation of bitarchive applications result in OOM ||<style="text-align: center">1 ||<style="text-align: center">JOLF ||<style="text-align: center">SVC ||<style="text-align: center"> ||<style="text-align: center">Max heap for Bitarchive monitors raised to 1936MB in prod. Awaiting results of observations after upgrade of java in production environment and installation of version 3.12.1 ||<#cccccc style="text-align: center">Need info || |
Task list and timetable for iteration 45
Status |
OK/Not Ok |
1. Highlights approved |
|
2. Assignment of tasks |
|
3. Task list and time table approved |
|
4. Implementation phase started |
|
5. Release test phase started |
|
6. Assignment phase for next iteration started |
|
7. Iteration 45 completed |
|
Highlights for Iteration
- Implement high priority FR from BNF, ONB and Netarkivet
Support of released NetarchiveSuite (http://netarchive.dk/suite).
- Fix prioritized bugs
Support of Wayback in the Netarchive.dk production site. See List of tasks and Assignment for Wayback Integration
- Migration of old Web materials to Netarchive.dk
- Iteration 45 is planned as a stable release.
Development procedure
Implementation according to implementation methodology
Implementation and release test mainly in intensive period
- Target release: August Primo October 2010
Table of tasks
Tasks for iteration 45. Updated 3. September 2010 |
Estimate md |
Main responsible |
Reviewer |
Remaining md at 24. August 2010 |
Comments |
Status |
||||
Implementation phase (task x-n) |
||||||||||
Open Source release + bugs and feature request |
|
- |
- |
|
|
- |
||||
Support of Open Source Release |
||||||||||
1. Support of released NetarchiveSuite |
2 |
All (Google calender) |
|
2 |
|
Ongoing |
||||
2. Implement translateprocess. Adjustment to Open Source partners. |
1 |
CSR |
SVC |
|
|
Ongoing |
||||
3. Maintain French Translation files. |
1 |
Nicolas/Sara |
SVC |
|
|
Ongoing |
||||
4. Maintain German Translation files. |
1 |
Andreas |
SVC |
|
|
Ongoing |
||||
5. Maintain Italian Translation files |
1 |
SVC |
|
|
|
Ongoing |
||||
Bugs and Feature requests |
||||||||||
Prioritized bugs according to list of priority 4 and priority 3 tasks. |
|
- |
- |
SubTotal 0 |
.. |
- |
||||
Priority 5 bug |
||||||||||
5 Module monitor?: Bug 1895 Running checksum gives Garbage Collector OutOfMemoryError and schedule stops and Bug Bug 2030 Message saturation of bitarchive applications result in OOM |
1 |
JOLF |
SVC |
|
Max heap for Bitarchive monitors raised to 1936MB in prod. Awaiting results of observations after upgrade of java in production environment and installation of version 3.12.1 |
Need info |
||||
Priority 4 bugs |
||||||||||
6. Module Archive: Bug 1962 Batchjob fails when ArcRepository is overloaded |
|
JOLF |
CSR |
|
Awaiting results of observations after upgrade to 3.12.1 |
Need Info |
||||
7. Module harvester: Bug 1972 Resubmit selected failed job does not do anything and gives a webpage error |
|
Nicolas |
SVC |
|
|
|
||||
8. Module Harvester : Bug 2016 Still missing Heritrix reports |
|
Nicolas |
SVC |
|
Review in branch |
|
||||
9. Module Monitor : Bug 2018 Scheduling is not always working |
|
Nicolas |
SVC |
|
Review in branch |
|
||||
Priority 3 bugs |
||||||||||
18. Module Havester: Bug 1851 Close connexions with Heritrix on unfinished jobs |
|
?? |
|
|
|
|
||||
19. Module Harvester: Bug 2019 Select of Harvest name may not work |
|
Nicolas |
|
|
|
|
||||
|
|
|
|
|
|
|
||||
|
|
|
|
|
|
.. |
||||
Prioritized Feature Requests according to list of priority 4 and priority 3 tasks |
|
- |
- |
SubTotal 21 |
|
- |
||||
Priority 4 Feature request |
||||||||||
20. Module Harvester: Feature request 1928 Ability to easily resubmit a selection of failed jobs |
|
Nicolas/Sara |
CSR |
|
Implemented. See outstanding bug 1972 |
Fixed. Awaiting review |
||||
21. Module Harvester:Feature request 1813 An extra resubmit button to make it visible which jobs have already been handled |
|
MSS |
JOLF |
|
Depends on whether feature still required after implementing FR 1928 |
TBD whether or not to postpone this issue. |
||||
24. Module harvester: Feature request 1963 Make a HarvestSchedulerApplication that runs the HarvestScheduler |
|
MSS |
JOLF |
|
Review in branc. Depends on FR 2039 |
In progress |
||||
24a. Module common/archive: Feature request 2040 Enable retrieval of WARCRecords from the bitarchives |
|
SVC |
JOLF |
|
Development under way in branch svc_warc |
|
||||
|
|
|
|
|
|
|
||||
Priority 3 Feature request |
||||||||||
25. Module harvester: Feature request 2011 Harvest documentation : generate an optional arcfiles-report.txt |
|
Nicolas |
|
|
|
- |
||||
26. Module harvester: Feature request 1969 Missing start and end date columns in Job status to search after |
|
Nicolas |
|
|
|
|
||||
31. Module Archive:Feature request 1743 When accessing Bitpreservation this takes really long time |
|
JOLF |
|
|
|
- |
||||
|
|
|
|
|
|
|
||||
|
|
|
|
|
|
|
||||
Roadmap tasks |
Total 52? |
- |
- |
Total 8,5 |
|
- |
||||
Tasks from ... |
||||||||||
35. QA: Assignment for enhanced QA tools |
2 |
SVC |
CSR |
|
High priority |
On going |
||||
36. WARC: Finalize Assigment for Harvester for support of WARC format |
? |
|
|
|
|
|
||||
37. Archive: Implement Assignment B.2.3 - Use segments in bitarchives |
6 |
|
|
|
|
|
||||
38. Archive: Implement Assignment B.2.4 - Write BitPreservation scheduler |
5 |
|
|
|
|
|
||||
39. Archive: Implement Assignment B.2.5 - Write BitPreservation webinterface |
6 |
|
|
|
|
|
||||
|
|
|
|
|
|
- |
||||
|
|
|
|
|
|
.. |
||||
Crawl-problems (Netarchive.dk) . |
Total x |
- |
- |
Total x |
|
- |
||||
Focus on following crawl-problems |
||||||||||
40. Support to Crawl-problems |
|
CSR |
SVC |
1 |
High priority |
On going |
||||
41. Feature Request 1881 Quality assurance through a batchjob interface |
|
JOLF |
MSS |
|
High priority |
Fixed and Reviewed |
||||
|
|
|
|
|
|
|
||||
|
|
|
|
|
|
|
||||
Wayback/Nutchwax tasks independent of NetarchiveSuite code-freeze. |
Total x |
- |
- |
Total x |
|
- |
||||
Tasks from ... |
||||||||||
42.Wayback: Documentation of Indexer/Aggregator |
2 |
CSR |
JOLF |
1 |
High priority |
Done (Additonal Tools + Config Manual). To be reviewed. |
||||
43. Wayback deploy: Complete Wayback deploy |
2 |
JOLF |
CSR |
2 |
High priority |
- |
||||
|
|
|
|
|
|
.. |
||||
Converting old Web collections to Netarchive.dk. See proposal. These task will be independent of NetarchiveSuite code-freeze. |
Total x |
- |
- |
Total x |
|
- |
||||
Tasks from ... |
||||||||||
44. Old Web collection: Old KB Webarchive |
|
SVC |
JOLF |
|
High priority |
In progress |
||||
45. Old Web collection: Old Webarchive from Niels Brugger collected by HTTrack |
|
MSS |
SVC |
|
High priority |
Awaiting metadata definition |
||||
46. Old Web collection: Prepare ingest of extracted data from Internet Archive into Netarkivet.dk |
|
SVC |
MSS |
|
High priority |
In progress |
||||
47. Old Web collection: Ingest received data from Internet Archive into Netarkivet.dk |
|
CLO |
SVC |
|
|
- |
||||
Common tasks calculated as implementation tasks |
Total x |
- |
- |
Total x |
|
- |
||||
Others |
Total x |
- |
- |
SubTotal 2 |
|
- |
||||
48. Batch: Create/execute a batch test script specified by 1 or 2 researchers |
2 |
JOLF |
TLR |
|
High priority |
Postponed |
||||
|
|
|
|
|
|
.. |
||||
|
|
|
|
|
|
.. |
||||
Prepare release test |
Total x |
- |
- |
SubTotal 12 |
|
- |
||||
49. Prepare release test |
6 |
TLR |
|
6 |
|
- |
||||
Available man-days for implementation phase |
Total x |
- |
- |
Total x |
|
- |
||||
Release test phase (task ...) |
||||||||||
Release test |
Total x |
- |
- |
Total 12 |
|
- |
||||
50. Execute release test. |
12 |
TLR |
All |
12 |
|
In progress |
||||
|
|
' |
|
|
|
.. |
||||
Release notes |
Total x |
- |
- |
Total 0,5 |
|
- |
||||
51. Write release notes |
0,5 |
SVC |
|
|
|
- |
||||
Available man-days for release test phase |
Total x |
- |
- |
Total 10 |
|
- |
||||
Assignment phase for next iteration (task ...) |
||||||||||
52. Component bug/feature fix/management |
|
QA |
|
|
|
.. |
||||
53. Define goals for Iteration 46 task list |
|
CHH |
|
|
|
.. |
||||
54. Presentation of goals and tasks for Iteration 46. Achieve a common understanding of the purpose of the iteration and each task on status meeting |
|
SVC |
|
|
|
.. |
||||
55. Assignment of tasks, bugs and feature request |
|
QA |
|
|
|
.. |
||||
56. Update release test procedure |
|
TLR |
|
|
|
.. |
||||
Available man-days for assigment phase |
Total x |
- |
- |
Total 22 |
|
- |
Timetable
Timetable iteration 44. Updated 3. September 2010 |
Start time |
End time |
Responsible |
Baseline 3. September 2010. Start time |
Baseline 3. September '2010. End time |
1. Implementation of decided tasks |
7. September 2010 |
28. September 2010 |
|
7. September 2010 |
28. September 2010 |
2. Code freeze. Create the build for release test and notify when build is ready |
29. september 2010 |
|
SVC |
29. September |
|
3. Release test |
29. September 2010 |
1. October 2010 |
TLR |
29. September |
1. October |
4. Code unfreeze |
4. October 2010 |
|
SVC |
4. October |
|
5. Assignments, bug components and bug fixes |
30. September 2010 |
1. October 2010 |
|
30. September |
1. October |