NetarchiveSuite|
Size: 5594
Comment:
|
Size: 5656
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 9: | Line 9: |
| Generate a sample archive with ARC-files by making a selective harvest of the netarkivet.dk domain. Use the "Once_an_hour" schedule, and let it run 3 or 4 times. Use step '''1-5''' of [Quick_Start_Manual: the quick start manual]. |
Generate a sample archive with ARC-files by making a selective harvest of the netarkivet.dk domain. Use the "Once_an_hour" schedule, and let it run 3 or 4 times. Use step '''1-5''' of [Quick_Start_Manual: the quick start manual]. |
| Line 24: | Line 23: |
| ''$ cd conf;'' ''$ ln -s ../examples/wayback wayback '' ''$ cd ..'' |
|
| Line 26: | Line 27: |
| Line 34: | Line 34: |
| ''$ mv ~/netarchivesuite_trunk/ROOT.war ~/tomcat/webapps/'' ''$ export TOMCAT_DIR=~/tomcat'' |
''$ mv ~/netarchivesuite_trunk/ROOT.war ~/tomcat/webapps/'' ''$ export TOMCAT_DIR=~/tomcat'' |
| Line 46: | Line 45: |
| Line 49: | Line 47: |
| Line 51: | Line 48: |
| for arc in $ARCS | for arc in $ARCS |
| Line 54: | Line 51: |
| ./wayback/bin/arc-indexer /arcs/filedir/$arc >> unsorted.cdx | ./wayback/bin/arc-indexer /arcs/filedir/$arc >> unsorted.cdx |
| Line 57: | Line 54: |
| Line 63: | Line 59: |
| Line 67: | Line 64: |
| Line 95: | Line 91: |
| ''$ cd ~/tomcat/'' | ''$ cd ~/tomcat/'' |
| Line 99: | Line 95: |
| ''$ ./bin/startup.sh'' | ''$ ./bin/startup.sh'' |
| Line 101: | Line 97: |
| ''Check that there are reported no errors in '''~/tomcat/log/catalina.out'''. | ''Check that there are reported no errors in '''~/tomcat/log/catalina.out'''. '' |
| Line 103: | Line 99: |
| ''Goto http://localhost:8080/wayback in a browser and browser some material the the ARC/CDX files. '' | ''''Goto http://localhost:8080/wayback in a browser and browser some material the the ARC/CDX files. '' '' |
| Line 105: | Line 101: |
| ''If you get the following error: | ''''If you get the following error: |
| Line 119: | Line 116: |
| Line 122: | Line 120: |
| and then restart tomcat: | and then restart tomcat: |
| Line 124: | Line 123: |
| cd ~/tomcat; ./bin/shutdown.sh ; sleep 5 ; ./bin/startup.sh | cd ~/tomcat; ./bin/shutdown.sh ; sleep 5 ; ./bin/startup.sh |
| Line 126: | Line 125: |
| === 6. Clean up things === Stop Tomcat: ''$ cd ~/tomcat/'' ''$ ./bin/shutdown.sh'' |
|
| Line 127: | Line 128: |
| === 6. Clean up things === Stop Tomcat: ''$ cd ~/tomcat/'' ''$ ./bin/shutdown.sh'' Stop archive: ''$ cd ~/standalone/STANDALONE/'' |
Stop archive: ''$ cd ~/standalone/STANDALONE/'' |
| Line 139: | Line 134: |
| ''$ rm -r ~/tomcat/'' | ''$ rm -r ~/tomcat/'' |
| Line 141: | Line 136: |
| ''$ rm -r ~/standalone'' | ''$ rm -r ~/standalone'' |
| Line 143: | Line 138: |
| ''$ rm -r ~/netarchivesuite_trunk'' | ''$ rm -r ~/netarchivesuite_trunk'' |
Release test Wayback
This test tests the setup of a Wayback installation and the cooperation between Wayback and the NetarchiveSuite archive, via the NetarchiveResourceStore. It doesn't test Wayback's functionality, which are tested by archive.org.
Paths and name are chosen to make this test as easy as possible, feel free to change these to suit your system.
The following commands (lines starting with '$' can be run directly from a terminal. *Remember to change the text in bold.
1. Generate a sample archive
Generate a sample archive with ARC-files by making a selective harvest of the netarkivet.dk domain. Use the "Once_an_hour" schedule, and let it run 3 or 4 times. Use step 1-5 of [Quick_Start_Manual: the quick start manual].
Your ARC/WARC files are located here /home/test/QUICKSTART/bitarkiv/filedir/.
Remember to make these directories readable/writable for the user conducting the test.
2. Download NetarchiveSuite from trunk (after code freeze) and make wayback war file:
$ svn checkout --username developername https://gforge.statsbiblioteket.dk/svn/netarchivesuite/trunk/ ~/netarchivesuite_trunk/ (Note: currently does not work using svn 1.6.6, but does work with svn 1.4.4)
$ cd ~/netarchivesuite_trunk/
$ wget http://downloads.sourceforge.net/project/archive-access/wayback/1.4.2/wayback-1.4.2.tar.gz?use_mirror=dfn -O wayback-1.4.2.tar.gz
$ tar xzf wayback-1.4.2.tar.gz $ cd conf; $ ln -s ../examples/wayback wayback $ cd .. $ ant jarfiles $ ant -f wayback.build.xml warfile
Check that there are no errors.
3. Download Apache Tomcat http://tomcat.apache.org/, binary version 6.XX is recommended. And prepare wayback webapp.
Download and unpack Tomcat to ~/tomcat/
$ mv ~/netarchivesuite_trunk/ROOT.war ~/tomcat/webapps/ $ export TOMCAT_DIR=~/tomcat
Make sure Tomcat loads ~/netarchivesuite_trunk/conf/wayback/settings.xml. This settings.xml file is copied to the WEB-INF directory in the ROOT.war generated above. This can be done my add the following line to ~/tomcat/bin/catalina.sh
CATALINA_OPTS='-Ddk.netarkivet.settings.file=$TOMCAT_DIR/webapps/ROOT/WEB-INF/settings.xml'
$ cd ~/tomcat/bin/
Edit catalina.sh and add the above line just below #!/bin/bash or #!/bin/sh
4. Make CDX files and setup standalone archive.
cd ~/netarchivesuite_trunk export ARCS=`ls /arcs/filedir | grep -v metadata` for arc in $ARCS do echo Adding index of $arc to file unsorted.cdx ./wayback/bin/arc-indexer /arcs/filedir/$arc >> unsorted.cdx done
$ mkdir /wayback/
Remember to make /wayback/ readable/writable for the user conducting the test.
Sort cdx files by using the sort command in linux, and move the sorted file to /wayback/file.sorted.cdx.
export LANG=C sort unsorted.cdx > /wayback/file.sorted.cdx
Start an local JMS broker with username 'admin' and password 'admin'.
Check that there are no errors
$ mkdir ~/standalone
$ cd ~/netarchivesuite_trunk
$ ant releasezipball
Check that there are no errors
$ cp ~/netarchivesuite_trunk/NetarchiveSuite.zip ~/standalone
$ cp ~/netarchivesuite_trunk/conf/wayback/standalone_archive.xml ~/standalone/
Change relevant settings in standalone/standalone_archive.xml like deployGlobal.thisPhysicalLocation.deployInstallDir and deployGlobal.thisPhysicalLocation.deployMachineUserName.
Downlad RunNetarchiveSuite.sh from http://netarchive.dk/suite/Installation_Manual_3.10/AppendixC?action=AttachFile&do=get&target=RunNetarchiveSuite.sh and save it in ~/standalone/.
$ cd ~/standalone/
$ ./RunNetarchiveSuite.sh NetarchiveSuite.zip standalone_archive.xml STANDALONE
Check that std. output and log files don't report any errors. Log files lies in ~/standalone/STANDALONE/log/*.
5. Start Tomcat and browse the archive
$ cd ~/tomcat/
$ chmod goa+x *.sh
$ ./bin/startup.sh
Check that there are reported no errors in ~/tomcat/log/catalina.out.
'Goto http://localhost:8080/wayback in a browser and browser some material the the ARC/CDX files. 'If you get the following error:
Unable to find a javac compiler;
com.sun.tools.javac.Main is not on the classpath.
Perhaps JAVA_HOME does not point to the JDK
at org.apache.tools.ant.taskdefs.compilers.CompilerAdapterFactory.getCompiler(CompilerAdapterFactory.java:105)
at org.apache.tools.ant.taskdefs.Javac.compile(Javac.java:924)
at org.apache.tools.ant.taskdefs.Javac.execute(Javac.java:757)
at org.apache.jasper.compiler.Compiler.generateClass(Compiler.java:320)
at org.apache.jasper.compiler.Compiler.compile(Compiler.java:370)
at org.apache.jasper.JspCompilationContext.compile(JspCompilationContext.java:473)
at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:190)add $JAVA_HOME/lib/tools.jar to the classpath explicitly:
export CLASSPATH=$JAVA_HOME/lib/tools.jar:$CLASSPATH
and then restart tomcat:
cd ~/tomcat; ./bin/shutdown.sh ; sleep 5 ; ./bin/startup.sh
6. Clean up things
Stop Tomcat: $ cd ~/tomcat/ $ ./bin/shutdown.sh
Stop archive: $ cd ~/standalone/STANDALONE/
$ ./killall_NATIONAL_LIBRARY.sh
Remove installed application:
$ rm -r ~/tomcat/
$ rm -r ~/standalone
$ rm -r ~/netarchivesuite_trunk
Optional remove /arcs and /wayback.