Differences between revisions 14 and 15
Revision 14 as of 2010-09-07 10:33:10
Size: 27980
Comment:
Revision 15 as of 2010-09-07 11:15:29
Size: 27844
Comment:
Deletions are marked like this. Additions are marked like this.
Line 26: Line 26:
||<tablewidth="100%"#cccccc style="text-align: center">'''Tasks for iteration 45. Updated 3. September 2010''' ||<#cccccc style="text-align: center">'''Estimate md''' ||<#cccccc style="text-align: center">'''Main responsible''' ||<#cccccc style="text-align: center">'''Reviewer ''' ||<10% #cccccc style="text-align: center">'''Remaining md at 24. August 2010''' ||<20% #cccccc style="text-align: center">'''Comments''' ||<#cccccc style="text-align: center">'''Status''' || ||<tablewidth="100%"#cccccc style="text-align: center">'''Tasks for iteration 45. Updated 8. September 2010''' ||<#cccccc style="text-align: center">'''Estimate md''' ||<#cccccc style="text-align: center">'''Main responsible''' ||<#cccccc style="text-align: center">'''Reviewer ''' ||<10% #cccccc style="text-align: center">'''Remaining md at 8. September 2010''' ||<20% #cccccc style="text-align: center">'''Comments''' ||<#cccccc style="text-align: center">'''Status''' ||
Line 38: Line 38:
||<style="vertical-align: top">'''5 Module monitor?:''' ''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1895|Bug 1895]]'' Running checksum gives Garbage Collector !OutOfMemoryError and schedule stops and ''Bug [[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=2030|Bug 2030]]'' Message saturation of bitarchive applications result in OOM ||<style="text-align: center">1 ||<style="text-align: center">JOLF ||<style="text-align: center">SVC ||<style="text-align: center"> ||<style="text-align: center">Max heap for Bitarchive monitors raised to 1936MB in prod. Awaiting results of observations after upgrade of java in production environment and installation of version 3.12.1 ||<#cccccc style="text-align: center">Need info || ||<style="vertical-align: top">'''6 Module archive: '''''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1895|Bug 1895]]'' Running checksum gives Garbage Collector !OutOfMemoryError and schedule stops and ''Bug [[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=2030|Bug 2030]]'' Message saturation of bitarchive applications result in OOM ||<style="text-align: center">1 ||<style="text-align: center">JOLF ||<style="text-align: center">SVC ||<style="text-align: center"> ||<style="text-align: center">Max heap for Bitarchive monitors raised to 1936MB in prod. Awaiting results of observations after upgrade of java in production environment and installation of version 3.12.1 ||<#cccccc style="text-align: center">Need info ||
Line 40: Line 40:
||<style="vertical-align: top">'''6. Module Archive:''' ''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1962|Bug 1962]]'' Batchjob fails when !ArcRepository is overloaded ||<style="text-align: center"> ||<style="text-align: center">JOLF ||<style="text-align: center">CSR ||<style="text-align: center"> ||<style="text-align: center">Awaiting results of observations after upgrade to 3.12.1 ||<#cccccc style="text-align: center">Need Info ||
||<style="vertical-align: top">'''7. Module harvester:''' ''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1972|Bug 1972]]'' Resubmit selected failed job does not do anything and gives a webpage error ||<style="text-align: center"> ||<style="text-align: center">Nicolas ||<style="text-align: center">SVC ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center"> ||
||<style="vertical-align: top">'''8. Module Harvester'''''' : '''''Bug 2016 ''Still missing Heritrix reports ||<style="text-align: center"> ||<style="text-align: center">Nicolas ||<style="text-align: center">SVC ||<style="text-align: center"> ||<style="text-align: center">Review in branch ||<#cccccc style="text-align: center"> ||
||<style="vertical-align: top">'''9. Module Monitor''' : ''Bug 2018'' Scheduling is not always working ||<style="text-align: center"> ||<style="text-align: center">Nicolas ||<style="text-align: center">SVC ||<style="text-align: center"> ||<style="text-align: center">Review in branch ||<#cccccc style="text-align: center"> ||
||<style="vertical-align: top">'''7. Module Archive:''' ''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1962|Bug 1962]]'' Batchjob fails when !ArcRepository is overloaded ||<style="text-align: center"> ||<style="text-align: center">JOLF ||<style="text-align: center">CSR ||<style="text-align: center"> ||<style="text-align: center">Awaiting results of observations after upgrade to 3.12.1 ||<#cccccc style="text-align: center">Need Info ||
||<style="vertical-align: top">'''8. Module harvester:''' ''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1972|Bug 1972]]'' Resubmit selected failed job does not do anything and gives a webpage error ||<style="text-align: center"> ||<style="text-align: center">Nicolas ||<style="text-align: center">SVC ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center"> ||
||<style="vertical-align: top">'''9. Module Harvester'''''' : '''''Bug 2016 ''Still missing Heritrix reports ||<style="text-align: center"> ||<style="text-align: center">Nicolas ||<style="text-align: center">SVC ||<style="text-align: center"> ||<style="text-align: center">Review in branch ||<#cccccc style="text-align: center"> ||
||<style="vertical-align: top">'''10. Module Monitor''' : ''Bug 2018'' Scheduling is not always working ||<style="text-align: center"> ||<style="text-align: center">Nicolas ||<style="text-align: center">SVC ||<style="text-align: center"> ||<style="text-align: center">Review in branch ||<#cccccc style="text-align: center"> ||
Line 45: Line 45:
||<style="vertical-align: top">'''18. Module Havester: '''''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1205|Bug 1851]]'' Close connexions with Heritrix on unfinished jobs ||<style="text-align: center"> ||<style="text-align: center">?? ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center"> ||
||<style="vertical-align: top">'''19. Module Harvester:''' ''Bug 2019'' Select of Harvest name may not work ||<style="text-align: center"> ||<style="text-align: center">Nicolas ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center"> ||
||<style="vertical-align: top">'''11. Module Havester: '''''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1205|Bug 1851]]'' Close connexions with Heritrix on unfinished jobs ||<style="text-align: center"> ||<style="text-align: center">?? ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center"> ||
||<style="vertical-align: top">'''12. Module Harvester:''' ''Bug 2019'' Select of Harvest name may not work ||<style="text-align: center"> ||<style="text-align: center">Nicolas ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center"> ||
Line 51: Line 51:
||<style="vertical-align: top">'''20. Module Harvester: ''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1928|Feature request 1928]]''''' Ability to easily resubmit a selection of failed jobs ||<style="text-align: center"> ||<style="text-align: center">Nicolas/Sara ||<style="text-align: center">CSR ||<style="text-align: center"> ||<style="text-align: center">Implemented. See outstanding bug 1972 ||<#cccccc style="text-align: center">Fixed. Awaiting review ||
||<style="vertical-align: top">'''21. Module Harvester:'''''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1813|Feature request 1813]]'' An extra resubmit button to make it visible which jobs have already been handled ||<style="text-align: center"> ||<style="text-align: center">MSS ||<style="text-align: center">JOLF ||<style="text-align: center"> ||<style="text-align: center">Depends on whether feature still required after implementing FR 1928 ||<#cccccc style="text-align: center">TBD whether or not to postpone this issue. ||
||<style="vertical-align: top">'''24. Module harvester:''' ''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1963|Feature request 1963]]'' Make a !HarvestSchedulerApplication that runs the !HarvestScheduler ||<style="text-align: center"> ||<style="text-align: center">MSS ||<style="text-align: center">JOLF ||<style="text-align: center"> ||<style="text-align: center">Review in branc. Depends on FR 2039 ||<#cccccc style="text-align: center">In progress ||
||<style="vertical-align: top">'''24a. Module common/archive:''' ''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=2040|Feature request 2040]]'' Enable retrieval of WARCRecords from the bitarchives ||<style="text-align: center"> ||<style="text-align: center">SVC ||<style="text-align: center">JOLF ||<style="text-align: center"> ||<style="text-align: center">Development under way in branch svc_warc ||<#cccccc style="text-align: center"> ||
||<style="vertical-align: top">'''13. Module Harvester: ''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1928|Feature request 1928]]''''' Ability to easily resubmit a selection of failed jobs ||<style="text-align: center"> ||<style="text-align: center">Nicolas/Sara ||<style="text-align: center">CSR ||<style="text-align: center"> ||<style="text-align: center">Implemented. See outstanding bug 1972 ||<#cccccc style="text-align: center">Fixed. Awaiting review ||
||<style="vertical-align: top">'''14. Module Harvester:'''''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1813|Feature request 1813]]'' An extra resubmit button to make it visible which jobs have already been handled ||<style="text-align: center"> ||<style="text-align: center">MSS ||<style="text-align: center">JOLF ||<style="text-align: center"> ||<style="text-align: center">Depends on whether feature still required after implementing FR 1928 ||<#cccccc style="text-align: center">TBD whether or not to postpone this issue. ||
||<style="vertical-align: top">'''15. Module harvester:''' ''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1963|Feature request 1963]]'' Make a !HarvestSchedulerApplication that runs the !HarvestScheduler ||<style="text-align: center"> ||<style="text-align: center">MSS ||<style="text-align: center">JOLF ||<style="text-align: center"> ||<style="text-align: center">Review in branc. Depends on FR 2039 ||<#cccccc style="text-align: center">In progress ||
||<style="vertical-align: top">'''16. Module common/archive:''' ''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=2040|Feature request 2040]]'' Enable retrieval of WARCRecords from the bitarchives ||<style="text-align: center"> ||<style="text-align: center">SVC ||<style="text-align: center">JOLF ||<style="text-align: center"> ||<style="text-align: center">Development under way in branch svc_warc ||<#cccccc style="text-align: center"> ||
Line 57: Line 57:
||<style="vertical-align: top">'''25. Module harvester: '''''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1956|Feature request 2011]] ''Harvest documentation : generate an optional arcfiles-report.txt ||<style="text-align: center"> ||<style="text-align: center">Nicolas ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center">-''' ''' ||
||<style="vertical-align: top">'''26. Module harvester:''' ''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1956|Feature request 1969]]'' Missing start and end date columns in Job status to search after ||<style="text-align: center"> ||<style="text-align: center">Nicolas ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center"> ||
||<style="vertical-align: top">'''31. Module Archive''':''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1743|Feature request 1743]]'' When accessing Bitpreservation this takes really long time ||<style="text-align: center"> ||<style="text-align: center">JOLF ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center">- ||
||<style="vertical-align: top">'''17. Module harvester: '''''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1956|Feature request 2011]] ''Harvest documentation : generate an optional arcfiles-report.txt ||<style="text-align: center"> ||<style="text-align: center">Nicolas ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center">-''' ''' ||
||<style="vertical-align: top">'''18. Module harvester:''' ''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1956|Feature request 1969]]'' Missing start and end date columns in Job status to search after ||<style="text-align: center"> ||<style="text-align: center">Nicolas ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center"> ||
||<style="vertical-align: top">'''19. Module Archive''':''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1743|Feature request 1743]]'' When accessing Bitpreservation this takes really long time ||<style="text-align: center"> ||<style="text-align: center">JOLF ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center">- ||
Line 64: Line 64:
||<style="vertical-align: top">'''35. QA:''' [[QaTools|Assignment for enhanced QA tools]] ||<style="text-align: center">2 ||<style="text-align: center">SVC ||<style="text-align: center">CSR ||<style="text-align: center"> ||<style="text-align: center">High priority ||<#cccccc style="text-align: center">On going ||
||<style="vertical-align: top">'''36. WARC:''' Finalize [[AssignmentHarvester2|Assigment]] for Harvester for support of WARC format ||<style="text-align: center">? ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center"> ||
||<style="vertical-align: top">'''37. Archive: '''Implement [[AssignmentGroupB2|Assignment B.2.3]] - Use segments in bitarchives ||<style="text-align: center">6 ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center"> ||
||<style="vertical-align: top">'''38. Archive: '''Implement [[AssignmentGroupB2|Assignment B.2.4]] - Write !BitPreservation scheduler ||<style="text-align: center">5 ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center"> ||
||<style="vertical-align: top">'''39. Archive: '''Implement [[AssignmentGroupB2|Assignment B.2.5]] - Write !BitPreservation webinterface ||<style="text-align: center">6 ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center"> ||
||<style="vertical-align: top">'''20. QA:''' [[QaTools|Assignment for enhanced QA tools]] ||<style="text-align: center">2 ||<style="text-align: center">SVC ||<style="text-align: center">CSR ||<style="text-align: center"> ||<style="text-align: center">High priority ||<#cccccc style="text-align: center">On going ||
||<style="vertical-align: top">'''21. WARC:''' Finalize [[AssignmentHarvester2|Assigment]] for Harvester for support of WARC format ||<style="text-align: center">? ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center"> ||
||<style="vertical-align: top">'''22. Archive: '''Implement [[AssignmentGroupB2|Assignment B.2.3]] - Use segments in bitarchives ||<style="text-align: center">6 ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center"> ||
||<style="vertical-align: top">'''23. Archive: '''Implement [[AssignmentGroupB2|Assignment B.2.4]] - Write !BitPreservation scheduler ||<style="text-align: center">5 ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center"> ||
||<style="vertical-align: top">'''24. Archive: '''Implement [[AssignmentGroupB2|Assignment B.2.5]] - Write !BitPreservation webinterface ||<style="text-align: center">6 ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center"> ||
Line 73: Line 73:
||<style="vertical-align: top">40. Support to [[http://netarkivet.dk/netarkivet/index.php?title=Kendte_problemer|Crawl-problems]] ||<style="text-align: center"> ||<style="text-align: center">CSR ||<style="text-align: center">SVC ||<style="text-align: center">1 ||<style="text-align: center">High priority ||<#cccccc style="text-align: center">On going ||
||<style="vertical-align: top">41. [[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1881|Feature Request 1881]] Quality assurance through a batchjob interface ||<style="text-align: center"> ||<style="text-align: center">JOLF ||<style="text-align: center">MSS ||<style="text-align: center"> ||<style="text-align: center">High priority ||<#cccccc style="text-align: center">Fixed and Reviewed ||
||<style="vertical-align: top">25. Support to [[http://netarkivet.dk/netarkivet/index.php?title=Kendte_problemer|Crawl-problems]] ||<style="text-align: center"> ||<style="text-align: center">CSR ||<style="text-align: center">SVC ||<style="text-align: center">1 ||<style="text-align: center">High priority ||<#cccccc style="text-align: center">On going ||
||<style="vertical-align: top">26. Test of conclusion from LIWA project ||<style="text-align: center"> ||<style="text-align: center">MSS ||<style="text-align: center">SVC ||<style="text-align: center"> ||<style="text-align: center">High priority ||<#cccccc style="text-align: center"> ||
Line 79: Line 79:
||<style="vertical-align: top">'''42.Wayback: '''Documentation of Indexer/Aggregator ||<style="text-align: center">2 ||<style="text-align: center">CSR ||<style="text-align: center">JOLF ||<style="text-align: center">1 ||<style="text-align: center">High priority ||<#cccccc style="text-align: center">Done (Additonal Tools + Config Manual). To be reviewed. ||
||<style="vertical-align: top">'''43. Wayback deploy: '''Complete Wayback deploy ||<style="text-align: center">2 ||<style="text-align: center">JOLF ||<style="text-align: center">CSR ||<style="text-align: center">2 ||<style="text-align: center">High priority ||<#cccccc style="text-align: center">- ||
||<style="vertical-align: top">'''27.Wayback: '''Documentation of Indexer/Aggregator ||<style="text-align: center">2 ||<style="text-align: center">CSR ||<style="text-align: center">JOLF ||<style="text-align: center">1 ||<style="text-align: center">High priority ||<#cccccc style="text-align: center">Done (Additonal Tools + Config Manual). To be reviewed. ||
||<style="vertical-align: top">'''28. Wayback deploy: '''Complete Wayback deploy ||<style="text-align: center">2 ||<style="text-align: center">JOLF ||<style="text-align: center">CSR ||<style="text-align: center">2 ||<style="text-align: center">High priority ||<#cccccc style="text-align: center">- ||
Line 84: Line 84:
||<style="vertical-align: top">'''44. Old Web collection:''' Old KB Webarchive ||<style="text-align: center"> ||<style="text-align: center">SVC ||<style="text-align: center">JOLF ||<style="text-align: center"> ||<style="text-align: center">High priority ||<#cccccc style="text-align: center">In progress ||
||<style="vertical-align: top">'''45.''' '''Old Web collection: '''Old Webarchive from Niels Brugger collected by HTTrack ||<style="text-align: center"> ||<style="text-align: center">MSS ||<style="text-align: center">SVC ||<style="text-align: center"> ||<style="text-align: center">High priority ||<#cccccc style="text-align: center">Awaiting metadata definition ||
||<style="vertical-align: top">'''46.''' '''Old Web collection: '''Prepare ingest of extracted data from Internet Archive into Netarkivet.dk ||<style="text-align: center"> ||<style="text-align: center">SVC ||<style="text-align: center">MSS ||<style="text-align: center"> ||<style="text-align: center">High priority ||<#cccccc style="text-align: center">In progress ||
||<style="vertical-align: top">'''47.''' '''Old Web collection:''' Ingest received data from Internet Archive into Netarkivet.dk ||<style="text-align: center"> ||<style="text-align: center">CLO ||<style="text-align: center">SVC ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center">- ||
||<style="vertical-align: top">'''29. Old Web collection:''' Old KB Webarchive ||<style="text-align: center"> ||<style="text-align: center">SVC ||<style="text-align: center">JOLF ||<style="text-align: center"> ||<style="text-align: center">High priority ||<#cccccc style="text-align: center">In progress ||
||<style="vertical-align: top">'''30.''' '''Old Web collection: '''Old Webarchive from Niels Brugger collected by HTTrack ||<style="text-align: center"> ||<style="text-align: center">MSS ||<style="text-align: center">SVC ||<style="text-align: center"> ||<style="text-align: center">High priority ||<#cccccc style="text-align: center">Awaiting metadata definition ||
||<style="vertical-align: top">'''31.''' '''Old Web collection: '''Prepare ingest of extracted data from Internet Archive into Netarkivet.dk ||<style="text-align: center"> ||<style="text-align: center">SVC ||<style="text-align: center">MSS ||<style="text-align: center"> ||<style="text-align: center">High priority ||<#cccccc style="text-align: center">In progress ||
||<style="vertical-align: top">'''32.''' '''Old Web collection:''' Ingest received data from Internet Archive into Netarkivet.dk ||<style="text-align: center"> ||<style="text-align: center">CLO ||<style="text-align: center">SVC ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center">- ||
Line 90: Line 90:
||<style="vertical-align: top">'''48. Batch:''' Create/execute a batch test script specified by 1 or 2 researchers ||<style="text-align: center">2 ||<style="text-align: center">JOLF ||<style="text-align: center">TLR ||<style="text-align: center"> ||<style="text-align: center">High priority ||<#cccccc style="text-align: center">Postponed || ||<style="vertical-align: top">'''33. Batch:''' Create/execute a batch test script specified by 1 or 2 researchers ||<style="text-align: center">2 ||<style="text-align: center">JOLF ||<style="text-align: center">TLR ||<style="text-align: center"> ||<style="text-align: center">High priority ||<#cccccc style="text-align: center"> ||
Line 94: Line 94:
||<style="vertical-align: top">49. Prepare [[http://netarchive.dk/suite/Iteration45Releasetest|release test]] ||<style="text-align: center">6 ||<style="text-align: center">TLR ||<style="text-align: center"> ||<style="text-align: center">6 ||<style="text-align: center"> ||<#cccccc style="text-align: center">- || ||<style="vertical-align: top">34. Prepare [[http://netarchive.dk/suite/Iteration45Releasetest|release test]] ||<style="text-align: center">6 ||<style="text-align: center">TLR ||<style="text-align: center"> ||<style="text-align: center">6 ||<style="text-align: center"> ||<#cccccc style="text-align: center">- ||
Line 98: Line 98:
||<style="vertical-align: top">50. Execute [[http://netarchive.dk/suite/Iteration45Releasetest|release test]]. ||<style="text-align: center">12 ||<style="text-align: center">TLR ||<style="text-align: center">All ||<style="text-align: center">12 ||<style="text-align: center"> ||<#cccccc style="text-align: center">In progress || ||<style="vertical-align: top">35. Execute [[http://netarchive.dk/suite/Iteration45Releasetest|release test]]. ||<style="text-align: center">12 ||<style="text-align: center">TLR ||<style="text-align: center">All ||<style="text-align: center">12 ||<style="text-align: center"> ||<#cccccc style="text-align: center">In progress ||
Line 101: Line 101:
||<style="vertical-align: top">51. Write release notes ||<style="text-align: center">0,5 ||<style="text-align: center">SVC ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center">- || ||<style="vertical-align: top">36. Write release notes ||<style="text-align: center">0,5 ||<style="text-align: center">SVC ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center">- ||
Line 104: Line 104:
||<style="vertical-align: top">52. Component bug/feature fix/management ||<style="text-align: center"> ||<style="text-align: center">QA ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center">.. ||
||<style="vertical-align: top">53. Define goals for [[http://netarchive.dk/suite/Iteration46TaskList|Iteration 46 task list]] ||<style="text-align: center"> ||<style="text-align: center">CHH ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center">.. ||
||<style="vertical-align: top">54. Presentation of goals and tasks for Iteration 46. Achieve a common understanding of the purpose of the iteration and each task on status meeting ||<style="text-align: center"> ||<style="text-align: center">SVC ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center">.. ||
||<style="vertical-align: top">55. Assignment of tasks, bugs and feature request ||<style="text-align: center"> ||<style="text-align: center">QA ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center">.. ||
||<style="vertical-align: top">56. Update release test procedure ||<style="text-align: center"> ||<style="text-align: center">TLR ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center">.. ||
||<style="vertical-align: top">37. Component bug/feature fix/management ||<style="text-align: center"> ||<style="text-align: center">QA ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center">.. ||
||<style="vertical-align: top">38. Define goals for [[http://netarchive.dk/suite/Iteration46TaskList|Iteration 46 task list]] ||<style="text-align: center"> ||<style="text-align: center">CHH ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center">.. ||
||<style="vertical-align: top">39. Presentation of goals and tasks for Iteration 46. Achieve a common understanding of the purpose of the iteration and each task on status meeting ||<style="text-align: center"> ||<style="text-align: center">SVC ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center">.. ||
||<style="vertical-align: top">40. Assignment of tasks, bugs and feature request ||<style="text-align: center"> ||<style="text-align: center">QA ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center">.. ||
||<style="vertical-align: top">41. Update release test procedure ||<style="text-align: center"> ||<style="text-align: center">TLR ||<style="text-align: center"> ||<style="text-align: center"> ||<style="text-align: center"> ||<#cccccc style="text-align: center">.. ||
Line 113: Line 113:
||<#cccccc style="text-align: center">Timetable iteration 44. Updated 3. September 2010 ||<#cccccc style="vertical-align: top">Start time ||<#cccccc style="vertical-align: top">End time ||<#cccccc style="vertical-align: top">Responsible ||<#cccccc style="vertical-align: top">Baseline 3. September ''2010''. Start time ||<#cccccc style="vertical-align: top">''Baseline 3. September ''''2010'''.''''' End time ''' ||
||1. Implementation of decided tasks ||<style="text-align: center">7. September 2010 ||<style="text-align: center">28. September 2010 || ||<style="text-align: center">7. September 2010 ||<style="text-align: center">28. September 2010 ||
||<#cccccc style="text-align: center">Timetable iteration 45. Updated 7. September 2010 ||<#cccccc style="vertical-align: top">Start time ||<#cccccc style="vertical-align: top">End time ||<#cccccc style="vertical-align: top">Responsible ||<#cccccc style="vertical-align: top">Baseline 3. September ''2010''. Start time ||<#cccccc style="vertical-align: top">''Baseline 3. September ''''2010'''.''''' End time ''' ||
||1. Implementation of decided tasks ||<style="text-align: center">8. September 2010 ||<style="text-align: center">28. September 2010 || ||<style="text-align: center">7. September 2010 ||<style="text-align: center">28. September 2010 ||

Task list and timetable for iteration 45

Status

OK/Not Ok

1. Highlights approved

2. Assignment of tasks

3. Task list and time table approved

4. Implementation phase started

5. Release test phase started

6. Assignment phase for next iteration started

7. Iteration 45 completed

Highlights for Iteration

  • Implement high priority FR from BNF, ONB and Netarkivet
  • Support of released NetarchiveSuite (http://netarchive.dk/suite).

  • Fix prioritized bugs
  • Support of Wayback in the Netarchive.dk production site. See List of tasks and Assignment for Wayback Integration

  • Migration of old Web materials to Netarchive.dk
  • Iteration 45 is planned as a stable release.

Development procedure

Table of tasks

Tasks for iteration 45. Updated 8. September 2010

Estimate md

Main responsible

Reviewer

Remaining md at 8. September 2010

Comments

Status

Implementation phase (task x-n)

Open Source release + bugs and feature request

-

-

-

Support of Open Source Release

1. Support of released NetarchiveSuite

2

All (Google calender)

2

Ongoing

2. Implement translateprocess. Adjustment to Open Source partners.

1

CSR

SVC

Ongoing

3. Maintain French Translation files.

1

Nicolas/Sara

SVC

Ongoing

4. Maintain German Translation files.

1

Andreas

SVC

Ongoing

5. Maintain Italian Translation files

1

SVC

Ongoing

Bugs and Feature requests

Prioritized bugs according to list of priority 4 and priority 3 tasks.

-

-

SubTotal 0

..

-

Priority 5 bug

6 Module archive: Bug 1895 Running checksum gives Garbage Collector OutOfMemoryError and schedule stops and Bug Bug 2030 Message saturation of bitarchive applications result in OOM

1

JOLF

SVC

Max heap for Bitarchive monitors raised to 1936MB in prod. Awaiting results of observations after upgrade of java in production environment and installation of version 3.12.1

Need info

Priority 4 bugs

7. Module Archive: Bug 1962 Batchjob fails when ArcRepository is overloaded

JOLF

CSR

Awaiting results of observations after upgrade to 3.12.1

Need Info

8. Module harvester: Bug 1972 Resubmit selected failed job does not do anything and gives a webpage error

Nicolas

SVC

9. Module Harvester : Bug 2016 Still missing Heritrix reports

Nicolas

SVC

Review in branch

10. Module Monitor : Bug 2018 Scheduling is not always working

Nicolas

SVC

Review in branch

Priority 3 bugs

11. Module Havester: Bug 1851 Close connexions with Heritrix on unfinished jobs

??

12. Module Harvester: Bug 2019 Select of Harvest name may not work

Nicolas

..

Prioritized Feature Requests according to list of priority 4 and priority 3 tasks

-

-

SubTotal 21

-

Priority 4 Feature request

13. Module Harvester: Feature request 1928 Ability to easily resubmit a selection of failed jobs

Nicolas/Sara

CSR

Implemented. See outstanding bug 1972

Fixed. Awaiting review

14. Module Harvester:Feature request 1813 An extra resubmit button to make it visible which jobs have already been handled

MSS

JOLF

Depends on whether feature still required after implementing FR 1928

TBD whether or not to postpone this issue.

15. Module harvester: Feature request 1963 Make a HarvestSchedulerApplication that runs the HarvestScheduler

MSS

JOLF

Review in branc. Depends on FR 2039

In progress

16. Module common/archive: Feature request 2040 Enable retrieval of WARCRecords from the bitarchives

SVC

JOLF

Development under way in branch svc_warc

Priority 3 Feature request

17. Module harvester: Feature request 2011 Harvest documentation : generate an optional arcfiles-report.txt

Nicolas

-

18. Module harvester: Feature request 1969 Missing start and end date columns in Job status to search after

Nicolas

19. Module Archive:Feature request 1743 When accessing Bitpreservation this takes really long time

JOLF

-

Roadmap tasks

Total 52?

-

-

Total 8,5

-

Tasks from ...

20. QA: Assignment for enhanced QA tools

2

SVC

CSR

High priority

On going

21. WARC: Finalize Assigment for Harvester for support of WARC format

?

22. Archive: Implement Assignment B.2.3 - Use segments in bitarchives

6

23. Archive: Implement Assignment B.2.4 - Write BitPreservation scheduler

5

24. Archive: Implement Assignment B.2.5 - Write BitPreservation webinterface

6

-

..

Crawl-problems (Netarchive.dk) .

Total x

-

-

Total x

-

Focus on following crawl-problems

25. Support to Crawl-problems

CSR

SVC

1

High priority

On going

26. Test of conclusion from LIWA project

MSS

SVC

High priority

Wayback/Nutchwax tasks independent of NetarchiveSuite code-freeze.

Total x

-

-

Total x

-

Tasks from ...

27.Wayback: Documentation of Indexer/Aggregator

2

CSR

JOLF

1

High priority

Done (Additonal Tools + Config Manual). To be reviewed.

28. Wayback deploy: Complete Wayback deploy

2

JOLF

CSR

2

High priority

-

..

Converting old Web collections to Netarchive.dk. See proposal. These task will be independent of NetarchiveSuite code-freeze.

Total x

-

-

Total x

-

Tasks from ...

29. Old Web collection: Old KB Webarchive

SVC

JOLF

High priority

In progress

30. Old Web collection: Old Webarchive from Niels Brugger collected by HTTrack

MSS

SVC

High priority

Awaiting metadata definition

31. Old Web collection: Prepare ingest of extracted data from Internet Archive into Netarkivet.dk

SVC

MSS

High priority

In progress

32. Old Web collection: Ingest received data from Internet Archive into Netarkivet.dk

CLO

SVC

-

Common tasks calculated as implementation tasks

Total x

-

-

Total x

-

Others

Total x

-

-

SubTotal 2

-

33. Batch: Create/execute a batch test script specified by 1 or 2 researchers

2

JOLF

TLR

High priority

..

..

Prepare release test

Total x

-

-

SubTotal 12

-

34. Prepare release test

6

TLR

6

-

Available man-days for implementation phase

Total x

-

-

Total x

-

Release test phase (task ...)

Release test

Total x

-

-

Total 12

-

35. Execute release test.

12

TLR

All

12

In progress

'

..

Release notes

Total x

-

-

Total 0,5

-

36. Write release notes

0,5

SVC

-

Available man-days for release test phase

Total x

-

-

Total 10

-

Assignment phase for next iteration (task ...)

37. Component bug/feature fix/management

QA

..

38. Define goals for Iteration 46 task list

CHH

..

39. Presentation of goals and tasks for Iteration 46. Achieve a common understanding of the purpose of the iteration and each task on status meeting

SVC

..

40. Assignment of tasks, bugs and feature request

QA

..

41. Update release test procedure

TLR

..

Available man-days for assigment phase

Total x

-

-

Total 22

-

Timetable

Timetable iteration 45. Updated 7. September 2010

Start time

End time

Responsible

Baseline 3. September 2010. Start time

Baseline 3. September '2010. End time

1. Implementation of decided tasks

8. September 2010

28. September 2010

7. September 2010

28. September 2010

2. Code freeze. Create the build for release test and notify when build is ready

29. september 2010

SVC

29. September

3. Release test

29. September 2010

1. October 2010

TLR

29. September

1. October

4. Code unfreeze

4. October 2010

SVC

4. October

5. Assignments, bug components and bug fixes

30. September 2010

1. October 2010

30. September

1. October

Iteration45TaskList (last edited 2010-10-11 11:48:58 by ChristenHedegaard)