Diff for "TEST2" - NetarchiveSuite

Differences between revisions 139 and 140

TEST2: Std-2 (snapshotharvesting, configurations, bytelimits, alias's and domainlists)

Testgoals: Test snaphots harvesting in detail and subsequent follow-up harvesting

To testwriters: This test should not contain non-standard snapshotharvesting behavior. After install it should not be necessary to use shell script or commandline statements.

Follow the instructions in the section 10. Easy Installation of NetarchiveSuite in Installation manualBefore start, set <deduplication><enabled>false</enabled></deduplication> in deploy_example_one_machine.xml

If you are netarkiv.dk tester, then follow these instructions : Netarkiv Installation setup

Items	Status 1	Status 2	Status 3	Notes	Known open bugs	Bugs tested	New bugs found	Previous bugs
1. Check single domain creation, harvest config and domain statistics					1060 is still not fixed			873,892, 973,1051,1033,1060
1.a Check global crawlertraps							Bug 1889
2. Update bytelimits for 6 domains
3. Search and add alias in ADM GUI								894,895,896
4. Check that chains of alias is prevented								954
6. Start a snapshot harvest with max 100000 bytes				Odd warnings in GUIApplication about unknown database tables.
7. Verify that alias domain is not harvested
8. Check that the 1. snapshot harvest has reached the expected byte limits				Some domains had different 'stop due to' code than expected				998
9. Add sulnudu-alias via ADM GUI
10. Change byte limit on a domain
11. Start of a snapshot harvest with max bytes limit 5 mb. (takes min. 1 hour)
12. Go to Heritrix GUI, verify the job is running and "pause" the job					Bug 1741, 1791
13. Go to the System overview in ADM GUI and check the job is paused and there are no error messages
14. Go to Heritrix GUI , do some overrides and resume the job						FR 1765
15. Go to the System overview in ADM GUI and check the job is running again and there are no error messages
15.a Check , that overrides are in the QA reports						FR 1765
15.b Restart the system	-			Job was finished
15.c Resubmit the failed job and verify it is DONE
16. Verify that no alias domains are harvested
17. Check that the 2. snapshot harvest has reached the expected byte limits
18. Check , that objects limits are respected
19. Check , that objects are not deduplicated

If you are netarkiv.dk tester, here is the shutdown instructions: Shutdown the system

-  ⇤ ← Revision 139 as of 2010-08-16 10:24:37 → 
  Size: 3913
  Editor: localhost
  Comment: converted to 1.6 markup
+   ← Revision 140 as of 2010-09-01 07:38:20 → ⇥
  Size: 3871
  Editor: TueLarsen
  Comment:
-Deletions are marked like this.
+Additions are marked like this.
 Line 11:
-||[[It24CheckHarvConfig  |1. Check single domain creation, harvest config and domain statistics ]] ||OK || || || ||1060 is still not fixed || || ||873,892, 973,1051,1033,1060 ||
||[[It42CheckGlobalCrwalerTraps  |1.a Check global crawlertraps]] ||OK || || || || || ||Bug 1889 || ||
||[[It17ByteLimit |2. Update bytelimits for 6 domains ]] ||OK || || || || || || || ||
||[[It16AliasGui |3. Search and add alias in ADM GUI ]] ||OK || || || || || || ||894,895,896 ||
||[[It16AliasNoTransitiveGui |4. Check that chains of alias is prevented ]] ||OK || || || || || || ||954 ||
||[[It10DefCrossHarv  |6. Start a snapshot harvest with max 100000 bytes ]] ||OK || || ||Odd warnings in GUIApplication about unknown database tables. || || || || ||
||[[It16VerificerUdenAlias |7. Verify that alias domain is not harvested ]] ||OK || || || || || || || ||
||[[It17VerifyLimits |8. Check that the 1. snapshot harvest has reached the expected byte limits ]] ||OK || || ||Some domains had different 'stop due to' code than expected || || || ||998 ||
||[[It16AliasSulnuduGui |9. Add sulnudu-alias via ADM GUI ]] ||OK || || || || || || || ||
||[[It17ChangeLimit  |10. Change byte limit on a domain ]] ||OK || || || || || || || ||
||[[It13Def5mbTvHarvestNetarkiv  |11. Start of a snapshot harvest with max bytes limit 5 mb. (takes min. 1 hour) ]] ||OK || || || || || || || ||
||[[It39SGotoSelHarvUsingHeritrix |12. Go to Heritrix GUI, verify the job is running and "pause" the job ]] ||OK || || || ||Bug 1741, 1791 || || || ||
||[[It31VerifySelHarvUsingADMGUI |13. Go to the System overview in ADM GUI and check the job is paused and there are no error messages ]] ||OK || || || || || || || ||
||[[It31SChangeSelHarvUsingHeritrix |14. Go to Heritrix GUI , do some overrides and resume the job ]] ||OK || || || || ||FR 1765 || || ||
||[[It31VerifySelHarvUsingADMGUIrun |15. Go to the System overview in ADM GUI and check the job is running again and there are no error messages ]] ||OK || || || || || || || ||
||[[It39CheckFR1765 |15.a Check , that overrides are in the QA reports]] ||OK || || || || ||FR 1765 || || ||
+||[[It24CheckHarvConfig  |1. Check single domain creation, harvest config and domain statistics ]] || || || || ||1060 is still not fixed || || ||873,892, 973,1051,1033,1060 ||
||[[It42CheckGlobalCrwalerTraps  |1.a Check global crawlertraps]] || || || || || || ||Bug 1889 || ||
||[[It17ByteLimit |2. Update bytelimits for 6 domains ]] || || || || || || || || ||
||[[It16AliasGui |3. Search and add alias in ADM GUI ]] || || || || || || || ||894,895,896 ||
||[[It16AliasNoTransitiveGui |4. Check that chains of alias is prevented ]] || || || || || || || ||954 ||
||[[It10DefCrossHarv  |6. Start a snapshot harvest with max 100000 bytes ]] || || || ||Odd warnings in GUIApplication about unknown database tables. || || || || ||
||[[It16VerificerUdenAlias |7. Verify that alias domain is not harvested ]] || || || || || || || || ||
||[[It17VerifyLimits |8. Check that the 1. snapshot harvest has reached the expected byte limits ]] || || || ||Some domains had different 'stop due to' code than expected || || || ||998 ||
||[[It16AliasSulnuduGui |9. Add sulnudu-alias via ADM GUI ]] || || || || || || || || ||
||[[It17ChangeLimit  |10. Change byte limit on a domain ]] || || || || || || || || ||
||[[It13Def5mbTvHarvestNetarkiv  |11. Start of a snapshot harvest with max bytes limit 5 mb. (takes min. 1 hour) ]] || || || || || || || || ||
||[[It39SGotoSelHarvUsingHeritrix |12. Go to Heritrix GUI, verify the job is running and "pause" the job ]] || || || || ||Bug 1741, 1791 || || || ||
||[[It31VerifySelHarvUsingADMGUI |13. Go to the System overview in ADM GUI and check the job is paused and there are no error messages ]] || || || || || || || || ||
||[[It31SChangeSelHarvUsingHeritrix |14. Go to Heritrix GUI , do some overrides and resume the job ]] || || || || || ||FR 1765 || || ||
||[[It31VerifySelHarvUsingADMGUIrun |15. Go to the System overview in ADM GUI and check the job is running again and there are no error messages ]] || || || || || || || || ||
||[[It39CheckFR1765 |15.a Check , that overrides are in the QA reports]] || || || || || ||FR 1765 || || ||
 Line 28:
-||[[It43resubmit |15.c Resubmit the failed job and verify it is DONE ]] ||OK || || || || || || || ||
||[[It16VerificerUdenSulnuduAlias |16. Verify that no alias domains are harvested ]] ||OK || || || || || || || ||
||[[It16VerifyExpectedDomains |17. Check that the 2. snapshot harvest has reached the expected byte limits ]] ||OK || || || || || || || ||
||[[It38CheckObjectLimits |18. Check , that objects limits are respected]] ||OK || || || || || || || ||
||[[It38CheckHarvestNotDeduplicated |19. Check , that objects are not deduplicated ]] ||OK || || || || || || || ||
+||[[It43resubmit |15.c Resubmit the failed job and verify it is DONE ]] || || || || || || || || ||
||[[It16VerificerUdenSulnuduAlias |16. Verify that no alias domains are harvested ]] || || || || || || || || ||
||[[It16VerifyExpectedDomains |17. Check that the 2. snapshot harvest has reached the expected byte limits ]] || || || || || || || || ||
||[[It38CheckObjectLimits |18. Check , that objects limits are respected]] || || || || || || || || ||
||[[It38CheckHarvestNotDeduplicated |19. Check , that objects are not deduplicated ]] || || || || || || || || ||