== Task list and timetable for iteration 47 == ||<#cccccc style="text-align: center;">'''Status''' ||<#cccccc>'''OK/Not Ok''' || ||1. Highlights approved ||OK || ||2. Assignment of tasks ||OK || ||3. Task list and time table approved ||OK || ||4. Implementation phase started ||OK || ||5. Release test phase started || || ||6. Assignment phase for next iteration started || || ||7. Iteration 47 completed || || === Highlights for Iteration === * Implement high priority FR from BNF, ONB and Netarkivet * [[http://kb-prod-udv-001.kb.dk/twiki/bin/edit/Netarkiv/SupportNetarchiveSuite|Support]] of released !NetarchiveSuite (http://netarchive.dk/suite). * Fix prioritized bugs * Support of Wayback in the Netarchive.dk production site. See [[IntegrationOfWaybck|List of tasks]] and [[AssignmentWaybackIntegration|Assignment]] for Wayback Integration * Migration of old Web materials to Netarchive.dk * Iteration 47 is planned as a stable release. === Development procedure === * Implementation according to [[http://netarchive.dk/suite/Development|implementation methodology]] * Implementation and release test mainly in [[http://www.google.com/calendar/render?gsessionid=tjZgbhGt6eNBB1mrlNwt3A|intensive period]] * Target release: End of March 2011 === Table of tasks === ||'''Tasks for iteration 47. Updated 1. March 2011''' ||<#cccccc style="text-align: center;">'''Estimate md''' ||<#cccccc style="text-align: center;">'''Main responsible''' ||<#cccccc style="text-align: center;">'''Reviewer ''' ||<10% #cccccc style="text-align: center;">'''Remaining md at 14. February 2011''' ||<20% #cccccc style="text-align: center;">'''Comments''' ||<#cccccc style="text-align: center;">'''Status''' || ||||||||||||||||||||||<#cccccc style="text-align: center;">'''Implementation phase (task x-n)''' || ||<#cccccc style="text-align: center;">'''Open Source release + bugs and feature request''' ||<#cccccc style="text-align: center;"> ||<#cccccc style="text-align: center;">'''-''' ||<#cccccc style="text-align: center;">'''-''' ||<#cccccc style="text-align: center;"> ||<#cccccc style="text-align: center;"> ||<#cccccc style="text-align: center;">'''-''' || ||||||||||||||||||||||<#cccccc style="text-align: center;">'''Support of Open Source Release''' || ||1. [[http://kb-prod-udv-001.kb.dk/twiki/bin/view/Netarkiv/SupportNetarchiveSuite|Support]] of released !NetarchiveSuite ||2 ||'''All (Google calender)''' || ||2 || ||<#cccccc style="text-align: center;">Ongoing || ||2. Implement translateprocess. Adjustment to Open Source partners. ||1 ||CSR ||SVC || || ||<#cccccc style="text-align: center;">Ongoing || ||3. Maintain French Translation files. ||1 ||Nicolas/Sara ||SVC || || ||<#cccccc style="text-align: center;">Ongoing || ||4. Maintain Italian and german Translation files. ||1 ||Andreas ||SVC || || ||<#cccccc style="text-align: center;">Ongoing || ||||||||||||||||||||||<#cccccc style="text-align: center;">'''Bugs and Feature requests''' || ||<#cccccc style="text-align: center;">Prioritized bugs according to [[https://gforge.statsbiblioteket.dk/tracker/index.php?group_id=7&atid=105|list]] of priority 4 and priority 3 tasks. ||<#cccccc style="text-align: center;"> ||<#cccccc style="text-align: center;">'''-''' ||<#cccccc style="text-align: center;">'''-''' ||<#cccccc style="text-align: center;">'''!SubTotal 0''' ||<#cccccc style="text-align: center;">.. ||<#cccccc style="text-align: center;">'''-''' || ||||||||||||||||||||||<#cccccc style="text-align: center;">'''Priority 4 bugs''' || ||'''5. Module Archive: '''[[https://gforge.statsbiblioteket.dk/tracker/?group_id=7&atid=105&func=detail&aid=1962|Bug 1962]]: Batchjob fails when ArcRepository is overloaded || ||JOLF ||CSR || ||Installation of JOLF script on Windows servers. Awaiting test in Netarkviet.dk ||<#cccccc style="text-align: center;"> || ||'''6. ''' || || || || || ||<#cccccc style="text-align: center;"> || ||'''7. ''' || || || || || ||<#cccccc style="text-align: center;"> || ||'''8. ''' || || || || || ||<#cccccc style="text-align: center;"> || ||||||||||||||||||||||<#cccccc style="text-align: center;">'''Priority 3 bugs''' || ||'''9. Module harvester:''' ''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=688|Bug 688]]'' hosts-report should be IDNA decoded when writing harvestInfo to the DB || || || || || ||<#cccccc style="text-align: center;">- || ||'''10. Module Access:''' ''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=823|Bug 823]]'' No index = Internal server error || || || || || ||<#cccccc style="text-align: center;"> || ||'''11. Module Monitor:''' ''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1756|Bug 1756]]'' JMX status page does not update when a new application is started on previously used JMX port || || || || || ||<#cccccc style="text-align: center;"> || ||'''12. Module Archive:''' ''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1782|Bug 1782]]'' Same datetime repeated many times, while logging batch checksum of files || || || || || ||<#cccccc style="text-align: center;"> || ||'''13. Module Archive: '''''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1708|Bug 1708]]'' bitpreservation logic offers "add to archive" for file that is not in either location || || || || || ||<#cccccc style="text-align: center;"> || ||'''14. Module Archive:''' ''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1193|Bug 1193]]'' Exceptions from !FileBatchJob stop batch job processing || || || || || ||<#cccccc style="text-align: center;"> || ||'''15. Module Archive:''' ''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1260|Bug 1260]]'' Too much and wrong feedback information on "Missing pages" || || || || || ||<#cccccc style="text-align: center;"> || ||'''16. Module Monitor:''' ''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1205|Bug 1205]]'' Security policy for unit tests contains hardcoded path to development environment || || || || || ||<#cccccc style="text-align: center;"> || ||'''17. Module Harvester:''' [[https://gforge.statsbiblioteket.dk/tracker/?func=detail&aid=2073&group_id=7&atid=105|Bug 2073]] Document postgres database || ||MSS || || || ||<#cccccc style="text-align: center;"> || ||'''18. Module Harvester:''' [[http://netarchive.dk/suite/https://gforge.statsbiblioteket.dk/tracker/?func=detail&aid=2074&group_id=7&atid=105|Bug 2074]] Trim HarvestJobManager related documentation on the wiki || ||MSS || || || ||<#cccccc style="text-align: center;">.. || ||'''19. Module Harvester:''' [[https://gforge.statsbiblioteket.dk/tracker/?func=detail&aid=2005&group_id=7&atid=105|Bug 2005]] Remove Common and Testutils test class references to other modules || ||MSS || || || ||<#cccccc style="text-align: center;"> || ||'''20 Module Harvester: '''''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=2059|Bug 2059]]'' java.lang.OutOfMemoryError:Out of swap space? etc || ||MSS || || || ||<#cccccc style="text-align: center;">Closed, fixed as part of FR 1774 || || || || || || || ||<#cccccc style="text-align: center;">.. || ||<#cccccc style="text-align: center;">Prioritized Feature Requests according to [[TaskTableFromMay2009Workshop|list]] of priority 4 and priority 3 tasks ||<#cccccc style="text-align: center;"> ||<#cccccc style="text-align: center;">'''-''' ||<#cccccc style="text-align: center;">'''-''' ||<#cccccc style="text-align: center;">'''!SubTotal 21''' ||<#cccccc style="text-align: center;"> ||<#cccccc style="text-align: center;">'''-''' || ||||||||||||||||||||||<#cccccc style="text-align: center;">'''Priority 4 Feature request''' || ||'''21 Modeule Access: '''[[https://gforge.statsbiblioteket.dk/tracker/?group_id=7&atid=108&func=detail&aid=1614|FR 1614]] Automated Quality assurance of the output from the harvest jobs. At first only a technical assignment. || ||SVC ||MSS || || ||<#cccccc style="text-align: center;">. || ||'''22. Module Harvester:'''''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1813|Feature request 1813]]'' An extra resubmit button to make it visible which jobs have already been handled || ||MSS ||JOLF || ||Is still required after implementing FR 1928. ||<#cccccc style="text-align: center;">-. || ||'''23. Module Harvester:'''[[https://gforge.statsbiblioteket.dk/tracker/?group_id=7&atid=108&func=detail&aid=1826|FR 1826]] Better QA tools to search AFTER Heritrix application is ended. Technical assignment and test using batch. || ||SVC ||CSR || || ||<#cccccc style="text-align: center;"> || ||'''24. Module Harvester: '''[[https://gforge.statsbiblioteket.dk/tracker/?group_id=7&atid=108&func=detail&aid=1774|Feature request 1774]]Stop using the JMS queues for queuing snapshot harvests . || ||Nicolas ||MSS || || ||<#cccccc style="text-align: center;">Ready for review || ||'''25''' || || || || || ||<#cccccc style="text-align: center;"> || ||'''26.''' || || || || || ||<#cccccc style="text-align: center;"> || ||||||||||||||||||||||<#cccccc style="text-align: center;">Priority 3 Feature request || ||27. Module Harvester''':''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1681|Feature request 1681]]''''' '''Add seed to DB via webservice (via Browser Extension/Rich Client)''' || ||Andreas || || || ||<#cccccc style="text-align: center;">- || ||28. Module Harvester:'''''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1682|Feature request 1682]]'' Statistics (DB access, scripts, batch jobs ....) ''' || ||Andreas || || || ||<#cccccc style="text-align: center;">- || ||29. Module Harvester''':''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1683|Feature request 1683]]'' Util for regenerate admin.data file''' || ||Andreas || || || ||<#cccccc style="text-align: center;">- || ||30. Module Harvester:'''''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1684|Feature request 1684]]'' Activity when domain is to be crawled. One table for seed ''' || ||Andreas || || || ||<#cccccc style="text-align: center;">- || ||31. Module Archive''':''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1743|Feature request 1743]]'' When accessing Bitpreservation this takes really long time ''' || ||JOLF || || || ||<#cccccc style="text-align: center;">- || ||32. Module Harvester:'''''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1120|Feature request 1120]]'' Crawlertrap info should be shareable between institutions ''' || ||Andreas || || ||SVC will add comments to this FR. Might be an easy solution to share Crawlertraps by emailing files with crawler trap informations. ||<#cccccc style="text-align: center;">Redundant (Copy of ??) || ||33. Module Harvester''':''[[https://gforge.statsbiblioteket.dk/tracker/index.php?func=detail&aid=1066|Feature request 1066]]'' Show whether seed URL existed''' || ||Andreas || || || ||<#cccccc style="text-align: center;">- || || || || || || || ||<#cccccc style="text-align: center;"> || || || || || || || ||<#cccccc style="text-align: center;"> || || || || || || || ||<#cccccc style="text-align: center;"> || ||<#cccccc style="text-align: center;">Roadmap tasks ||<#cccccc style="text-align: center;">Total 52? ||<#cccccc style="text-align: center;">- ||<#cccccc style="text-align: center;">- ||<#cccccc style="text-align: center;">Total 8,5 ||<#cccccc style="text-align: center;"> ||<#cccccc style="text-align: center;">- || ||||||||||||||||||||||<#cccccc style="text-align: center;">Tasks from ... || ||41. || || || || || ||<#cccccc style="text-align: center;"> || ||42. || || || || || ||<#cccccc style="text-align: center;"> || ||43. || || || || || ||<#cccccc style="text-align: center;"> || ||44. || || || || || ||<#cccccc style="text-align: center;"> || ||45. || || || || || ||<#cccccc style="text-align: center;"> || || || || || || || ||<#cccccc style="text-align: center;">- || || || || || || || ||<#cccccc style="text-align: center;">.. || ||<#cccccc style="text-align: center;">[[http://netarkivet.dk/netarkivet/index.php?title=Kendte_problemer|Crawl-problems]] (Netarchive.dk) . ||<#cccccc style="text-align: center;">Total x ||<#cccccc style="text-align: center;">- ||<#cccccc style="text-align: center;">- ||<#cccccc style="text-align: center;">Total x ||<#cccccc style="text-align: center;"> ||<#cccccc style="text-align: center;">- || ||||||||||||||||||||||<#cccccc style="text-align: center;">Focus on following crawl-problems || ||46. Support to [[http://netarkivet.dk/netarkivet/index.php?title=Kendte_problemer|Crawl-problems]] || ||CSR ||SVC ||1 ||High priority ||<#cccccc style="text-align: center;">On going || || || || || || || ||<#cccccc style="text-align: center;"> || || || || || || || ||<#cccccc style="text-align: center;"> || || || || || || || ||<#cccccc style="text-align: center;"> || ||<#cccccc style="text-align: center;">Wayback/Nutchwax tasks independent of !NetarchiveSuite code-freeze. ||<#cccccc style="text-align: center;">Total x ||<#cccccc style="text-align: center;">- ||<#cccccc style="text-align: center;">- ||<#cccccc style="text-align: center;">Total x ||<#cccccc style="text-align: center;"> ||<#cccccc style="text-align: center;">- || ||||||||||||||||||||||<#cccccc style="text-align: center;">Tasks from ... || ||47. '''Module Access: '''[[http://sbforge.statsbiblioteket.dk/jira/browse/NARC-45|Narc45]]''':''' Researchers are not allowed to get access to E-books through Wayback || ||CSR ||SVC || || ||<#cccccc style="text-align: center;">Done. Writing production documentation || ||47b. [[http://sbforge.statsbiblioteket.dk/jira/browse/NARK-13|NARK-13]]: Upgrade to Wayback 1.6 || ||CSR ||TLR || || ||<#cccccc style="text-align: center;">- || || || || || || || ||<#cccccc style="text-align: center;">.. || ||<#cccccc style="text-align: center;">Converting old Web collections to Netarchive.dk. . These task will be independent of !NetarchiveSuite code-freeze. ||<#cccccc style="text-align: center;">Total x ||<#cccccc style="text-align: center;">- ||<#cccccc style="text-align: center;">- ||<#cccccc style="text-align: center;">Total x ||<#cccccc style="text-align: center;"> ||<#cccccc style="text-align: center;">- || ||||||||||||||||||||||<#cccccc style="text-align: center;">Tasks from ... || ||48. See [[http://sbforge.statsbiblioteket.dk/display/MIG/Gamle+arkiver|table]] of old collections to be migrated || || || || || ||<#cccccc style="text-align: center;">In progress || ||49.''' ''' || || || || || ||<#cccccc style="text-align: center;"> || ||50.''' ''' || || || || || ||<#cccccc style="text-align: center;"> || ||51.''' ''' || || || || || ||<#cccccc style="text-align: center;">- || ||<#cccccc style="text-align: center;">Common tasks calculated as implementation tasks ||<#cccccc style="text-align: center;">Total x ||<#cccccc style="text-align: center;">- ||<#cccccc style="text-align: center;">- ||<#cccccc style="text-align: center;">Total x ||<#cccccc style="text-align: center;"> ||<#cccccc style="text-align: center;">- || ||<#cccccc style="text-align: center;">Others ||<#cccccc style="text-align: center;">Total x ||<#cccccc style="text-align: center;">- ||<#cccccc style="text-align: center;">- ||<#cccccc style="text-align: center;">!SubTotal 2 ||<#cccccc style="text-align: center;"> ||<#cccccc style="text-align: center;">- || ||52. Batch:''' Create/execute a batch test script specified by 1 or 2 researchers ''' ||2 ||JOLF ||TLR || || ||<#cccccc style="text-align: center;"> || ||53. Infra-structure: '''[[http://sbforge.statsbiblioteket.dk/display/SBF/SBForge|Migration to SBforge]] ''' || ||MSS ||SVC || || ||<#cccccc style="text-align: center;">In progress || ||54. Release test:''' [[http://sbforge.statsbiblioteket.dk/jira/browse/NARC-23|Automate system test]] ''' || ||MSS ||TLR || || ||<#cccccc style="text-align: center;">In progress || ||55. || || || || || ||<#cccccc style="text-align: center;"> || || || || || || || ||<#cccccc style="text-align: center;">.. || || || || || || || ||<#cccccc style="text-align: center;">.. || || || || || || || ||<#cccccc style="text-align: center;">.. || ||<#cccccc style="text-align: center;">Prepare release test ||<#cccccc style="text-align: center;">Total x ||<#cccccc style="text-align: center;">- ||<#cccccc style="text-align: center;">- ||<#cccccc style="text-align: center;">!SubTotal 12 ||<#cccccc style="text-align: center;"> ||<#cccccc style="text-align: center;">- || ||56. Prepare [[http://netarchive.dk/suite/Iteration47Releasetest|release test]] ||6 ||TLR || ||6 || ||<#cccccc style="text-align: center;">- || ||<#cccccc style="text-align: center;">Available man-days for implementation phase ||<#cccccc style="text-align: center;">Total x ||<#cccccc style="text-align: center;">- ||<#cccccc style="text-align: center;">- ||<#cccccc style="text-align: center;">Total x ||<#cccccc style="text-align: center;"> ||<#cccccc style="text-align: center;">- || ||||||||||||||||||||||<#cccccc style="text-align: center;">Release test phase (task ...) || ||<#cccccc style="text-align: center;">Release test ||<#cccccc style="text-align: center;">Total x ||<#cccccc style="text-align: center;">- ||<#cccccc style="text-align: center;">- ||<#cccccc style="text-align: center;">Total 12 ||<#cccccc style="text-align: center;"> ||<#cccccc style="text-align: center;">- || ||57. Execute [[http://netarchive.dk/suite/Iteration47Releasetest|release test]]. ||12 ||TLR ||All ||12 || ||<#cccccc style="text-align: center;">In progress || || || ||' || || || ||<#cccccc style="text-align: center;">.. || ||<#cccccc style="text-align: center;">Release notes ||<#cccccc style="text-align: center;">Total x ||<#cccccc style="text-align: center;">- ||<#cccccc style="text-align: center;">- ||<#cccccc style="text-align: center;">Total 0,5 ||<#cccccc style="text-align: center;"> ||<#cccccc style="text-align: center;">- || ||58. Write release notes ||0,5 ||SVC || || || ||<#cccccc style="text-align: center;">- || ||<#cccccc style="text-align: center;">Available man-days for release test phase ||<#cccccc style="text-align: center;">Total x ||<#cccccc style="text-align: center;">- ||<#cccccc style="text-align: center;">- ||<#cccccc style="text-align: center;">Total 10 ||<#cccccc style="text-align: center;"> ||<#cccccc style="text-align: center;">- || ||||||||||||||||||||||<#cccccc style="text-align: center;">Assignment phase for next iteration (task ...) || ||59. Component bug/feature fix/management || ||QA || || || ||<#cccccc style="text-align: center;">.. || ||60. Define goals for [[http://netarchive.dk/suite/Iteration48TaskList|Iteration 48 task list]] || ||CHH || || || ||<#cccccc style="text-align: center;">.. || ||61. Presentation of goals and tasks for Iteration 46. Achieve a common understanding of the purpose of the iteration and each task on status meeting || ||SVC || || || ||<#cccccc style="text-align: center;">.. || ||62. Assignment of tasks, bugs and feature request || ||QA || || || ||<#cccccc style="text-align: center;">.. || ||63. Update release test procedure || ||TLR || || || ||<#cccccc style="text-align: center;">.. || ||<#cccccc style="text-align: center;">Available man-days for assigment phase ||<#cccccc style="text-align: center;">Total x ||<#cccccc style="text-align: center;">- ||<#cccccc style="text-align: center;">- ||<#cccccc style="text-align: center;">Total 22 ||<#cccccc style="text-align: center;"> ||<#cccccc style="text-align: center;">- || === Timetable === ||<#cccccc style="text-align: center;">Timetable iteration 47. Updated 14. February 2011 ||<#cccccc style="vertical-align: top;">Start time ||<#cccccc style="vertical-align: top;">End time ||<#cccccc style="vertical-align: top;">Responsible ||<#cccccc style="vertical-align: top;">Baseline 14. February ''2011''. Start time ||<#cccccc style="vertical-align: top;">''Baseline ''14. February ''2011''. End time || ||1. Implementation of decided tasks ||21. February 2011 ||5. April 2011 || ||21. February 2011 ||5. April 2011 || ||2. Code freeze. Create the build for release test and notify when build is ready ||6. April 2011 || ||SVC ||6. April 2011 || || ||3. Release test ||6. April 2011 ||8. April 2011 ||TLR ||6. April 2011 ||8. April 2011 || ||4. Code unfreeze ||11. April 2011 || ||SVC ||11. April 2011 || || ||5. Assignments, bug components and bug fixes ||7. April 2011 ||8. April 2011 || ||7. April 2011 ||8. April 2011 ||