NetarchiveSuite|
Size: 4336
Comment: Step 8:
|
Size: 6729
Comment: Step 8:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 10: | Line 10: |
| ||<tablestyle="width: 1134px; height: 2900px;">'''Items ''' ||'''Status 1''' ||'''Status 2''' ||'''Status 3''' ||'''Notes ''' ||'''Known open bugs ''' ||'''Bugs tested ''' ||'''New bugs found ''' ||'''Previous bugs''' || ||[[It24CheckHarvConfig|1. Check single domain creation, harvest config and domain statistics]] ||OK|| || || ||1060 is still not fixed || || ||873,892, 973,1051,1033,1060 || ||[[It42CheckGlobalCrwalerTraps|1.a Check global crawlertraps]] ||OK|| || || || || || ||1889 || ||[[It17ByteLimit|2. Update bytelimits for 6 domains]] ||OK|| || || || || || || || ||[[It16AliasGui|3. Search and add alias in ADM GUI]] ||OK|| || || || || || ||894,895,896 || ||[[It16AliasNoTransitiveGui|4. Check that chains of alias is prevented]] ||OK|| || || || || || ||954 || ||[[It10DefCrossHarv|6. Start a snapshot harvest with max 100000 bytes]] ||OK|| || || || || || || || ||[[It16VerificerUdenAlias|7. Verify that alias domain is not harvested]] ||OK|| || || || || || || || ||[[It17VerifyLimits|8. Check that the 1. snapshot harvest has reached the expected byte limits]] ||Incoherent bytes counts and stop reasons: Domain Domain-config byte limit Bytes Harvested Stop reason lecanardenchaine.fr 150,000 116,234 Max Bytes limit reached gameblog.fr 100,000 148,863 Domain-config byte limit reached gamekult.com 150,000 154,329 Domain-config byte limit reached lexpansion.com 100,000 139,100 Domain-config byte limit reached lemonde.fr 150,000 369,745 Domain-config byte limit reached allocine.fr 50,000 157,480 Domain-config byte limit reached || || || || || || ||998 || ||[[It16AliasSulnuduGui|9. Add sulnudu-alias via ADM GUI]] ||???|| || || || || || || || ||[[It17ChangeLimit|10. Change byte limit on a domain]] ||OK|| || || || || || || || ||[[It13Def5mbTvHarvestNetarkiv|11. Start of a snapshot harvest with max bytes limit 5 mb. (takes min. 1 hour)]] ||OK|| || || || || || || || |
---- /!\ '''Edit conflict - other version:''' ---- ||<tablewidth="1134px" tableheight="2900px" tablestyle="">'''Items ''' ||'''Status 1''' ||'''Status 2''' ||'''Status 3''' ||'''Notes ''' ||'''Known open bugs ''' ||'''Bugs tested ''' ||'''New bugs found ''' ||'''Previous bugs''' || ||[[It24CheckHarvConfig|1. Check single domain creation, harvest config and domain statistics]] ||OK || || || ||1060 is still not fixed || || ||873,892, 973,1051,1033,1060 || ||[[It42CheckGlobalCrwalerTraps|1.a Check global crawlertraps]] ||OK || || || || || || ||1889 || ||[[It17ByteLimit|2. Update bytelimits for 6 domains]] ||OK || || || || || || || || ||[[It16AliasGui|3. Search and add alias in ADM GUI]] ||OK || || || || || || ||894,895,896 || ||[[It16AliasNoTransitiveGui|4. Check that chains of alias is prevented]] ||OK || || || || || || ||954 || ||[[It10DefCrossHarv|6. Start a snapshot harvest with max 100000 bytes]] ||OK || || || || || || || || ||[[It16VerificerUdenAlias|7. Verify that alias domain is not harvested]] ||OK || || || || || || || || ||[[It17VerifyLimits|8. Check that the 1. snapshot harvest has reached the expected byte limits]] ||Incoherent bytes counts and stop reasons: Domain Domain-config byte limit Bytes Harvested Stop reason lecanardenchaine.fr 150,000 116,234 Max Bytes limit reached gameblog.fr 100,000 148,863 Domain-config byte limit reached gamekult.com 150,000 154,329 Domain-config byte limit reached lexpansion.com 100,000 139,100 Domain-config byte limit reached lemonde.fr 150,000 369,745 Domain-config byte limit reached allocine.fr 50,000 157,480 Domain-config byte limit reached || || || || || || ||998 || ||[[It16AliasSulnuduGui|9. Add sulnudu-alias via ADM GUI]] ||??? || || || || || || || || ||[[It17ChangeLimit|10. Change byte limit on a domain]] ||OK || || || || || || || || ||[[It13Def5mbTvHarvestNetarkiv|11. Start of a snapshot harvest with max bytes limit 5 mb. (takes min. 1 hour)]] ||OK || || || || || || || || ---- /!\ '''Edit conflict - your version:''' ---- Comments: Step 8: here are the actual numbers, these seem incoherent. ||<tablewidth="800px">Domain ||Domain-config byte limit ||Bytes Harvested ||Stop Reason || ||<tablewidth="800px">lecanardenchaine.fr ||150,000 ||116,234 ||Max Bytes limit reached || ||gameblog.fr ||100,000 ||148,863 ||Domain-config byte limit reached || ||gamekult.com ||150,000 ||154,239 ||Domain-config byte limit reached || ||lexpansion.com ||100,000 ||139,100 ||Domain-config byte limit reached || ||lemonde.fr ||150,000 ||369,745 ||Domain-config byte limit reached || ||allocine.fr ||50,000 ||157,480 ||Domain-config byte limit reached || Maybe harvested byte count includes bytes harvested on other domains reached from the domain's seeds? '''Items ''' ||<tablewidth="943px" tableheight="2896px" tablestyle="">'''Status 1''' ||'''Status 2''' ||'''Status 3''' ||'''Notes ''' ||'''Known open bugs ''' ||'''Bugs tested ''' ||'''New bugs found ''' ||'''Previous bugs''' || ||[[It24CheckHarvConfig|1. Check single domain creation, harvest config and domain statistics]] ||OK || || || ||1060 is still not fixed || || ||873,892, 973,1051,1033,1060 || ||[[It42CheckGlobalCrwalerTraps|1.a Check global crawlertraps]] ||OK || || || || || || ||1889 || ||[[It17ByteLimit|2. Update bytelimits for 6 domains]] ||OK || || || || || || || || ||[[It16AliasGui|3. Search and add alias in ADM GUI]] ||OK || || || || || || ||894,895,896 || ||[[It16AliasNoTransitiveGui|4. Check that chains of alias is prevented]] ||OK || || || || || || ||954 || ||[[It10DefCrossHarv|6. Start a snapshot harvest with max 100000 bytes]] ||OK || || || || || || || || ||[[It16VerificerUdenAlias|7. Verify that alias domain is not harvested]] ||OK || || || || || || || || ||[[It17VerifyLimits|8. Check that the 1. snapshot harvest has reached the expected byte limits]] ||FAILED || || || || || || ||998 || ||[[It16AliasSulnuduGui|9. Add sulnudu-alias via ADM GUI]] ||??? || || || || || || || || ||[[It17ChangeLimit|10. Change byte limit on a domain]] ||OK || || || || || || || || ||[[It13Def5mbTvHarvestNetarkiv|11. Start of a snapshot harvest with max bytes limit 5 mb. (takes min. 1 hour)]] ||OK || || || || || || || || ---- /!\ '''End of edit conflict''' ---- |
TEST2: Std-2 (snapshotharvesting, configurations, bytelimits, alias's and domainlists)
Testgoals: Test snaphots harvesting in detail and subsequent follow-up harvesting
To testwriters: This test should not contain non-standard snapshotharvesting behavior. After install it should not be necessary to use shell script or commandline statements.
Follow the instructions in the section 10. Easy Installation of NetarchiveSuite in Installation manualBefore start, set <deduplication><enabled>false</enabled></deduplication> in deploy_example_one_machine.xml
If you are netarkiv.dk tester, then follow these instructions : Netarkiv Installation setup
![/!\](/suite/moin_static1911/modern/img/alert.png "/!\"){kind=small}
Edit conflict - other version:
Items |
Status 1 |
Status 2 |
Status 3 |
Notes |
Known open bugs |
Bugs tested |
New bugs found |
Previous bugs |
1. Check single domain creation, harvest config and domain statistics |
OK |
|
|
|
1060 is still not fixed |
|
|
873,892, 973,1051,1033,1060 |
OK |
|
|
|
|
|
|
1889 |
|
OK |
|
|
|
|
|
|
|
|
OK |
|
|
|
|
|
|
894,895,896 |
|
OK |
|
|
|
|
|
|
954 |
|
OK |
|
|
|
|
|
|
|
|
OK |
|
|
|
|
|
|
|
8. Check that the 1. snapshot harvest has reached the expected byte limits |
Incoherent bytes counts and stop reasons: Domain Domain-config byte limit Bytes Harvested Stop reason lecanardenchaine.fr 150,000 116,234 Max Bytes limit reached gameblog.fr 100,000 148,863 Domain-config byte limit reached gamekult.com 150,000 154,329 Domain-config byte limit reached lexpansion.com 100,000 139,100 Domain-config byte limit reached lemonde.fr 150,000 369,745 Domain-config byte limit reached allocine.fr 50,000 157,480 Domain-config byte limit reached |
|
|
|
|
|
|
998 |
??? |
|
|
|
|
|
|
|
|
OK |
|
|
|
|
|
|
|
|
11. Start of a snapshot harvest with max bytes limit 5 mb. (takes min. 1 hour) |
OK |
|
|
|
|
|
|
|
Edit conflict - your version:
Comments:
Step 8: here are the actual numbers, these seem incoherent.
Domain |
Domain-config byte limit |
Bytes Harvested |
Stop Reason |
lecanardenchaine.fr |
150,000 |
116,234 |
Max Bytes limit reached |
gameblog.fr |
100,000 |
148,863 |
Domain-config byte limit reached |
gamekult.com |
150,000 |
154,239 |
Domain-config byte limit reached |
lexpansion.com |
100,000 |
139,100 |
Domain-config byte limit reached |
lemonde.fr |
150,000 |
369,745 |
Domain-config byte limit reached |
allocine.fr |
50,000 |
157,480 |
Domain-config byte limit reached |
Maybe harvested byte count includes bytes harvested on other domains reached from the domain's seeds?
Items
Status 1 |
Status 2 |
Status 3 |
Notes |
Known open bugs |
Bugs tested |
New bugs found |
Previous bugs |
|
1. Check single domain creation, harvest config and domain statistics |
OK |
|
|
|
1060 is still not fixed |
|
|
873,892, 973,1051,1033,1060 |
OK |
|
|
|
|
|
|
1889 |
|
OK |
|
|
|
|
|
|
|
|
OK |
|
|
|
|
|
|
894,895,896 |
|
OK |
|
|
|
|
|
|
954 |
|
OK |
|
|
|
|
|
|
|
|
OK |
|
|
|
|
|
|
|
|
8. Check that the 1. snapshot harvest has reached the expected byte limits |
FAILED |
|
|
|
|
|
|
998 |
??? |
|
|
|
|
|
|
|
|
OK |
|
|
|
|
|
|
|
|
11. Start of a snapshot harvest with max bytes limit 5 mb. (takes min. 1 hour) |
OK |
|
|
|
|
|
|
|
End of edit conflict
12. Go to Heritrix GUI, verify the job is running and "pause" the job |
|
|
|
|
Bug 1791 |
|
|
1741 |
13. Go to the System overview in ADM GUI and check the job is paused and there are no error messages |
|
|
|
|
|
|
|
|
14. Go to Heritrix GUI , do some overrides and resume the job |
|
|
|
|
|
FR 1765 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
FR 1765 |
|
|
|
|
|
|
Job was finished |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
17. Check that the 2. snapshot harvest has reached the expected byte limits |
|
|
|
oernhoej.dk Domain harvest completed contrary to testspecification |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
If you are netarkiv.dk tester, here is the shutdown instructions: Shutdown the system