Differences between revisions 28 and 29
Revision 28 as of 2009-12-21 12:25:13
Size: 4349
Comment:
Revision 29 as of 2009-12-22 12:44:42
Size: 4611
Comment:
Deletions are marked like this. Additions are marked like this.
Line 8: Line 8:
Execute step '''1-3''' of the quick start manual. === 1. Generate a sample archive ===
Generate a sample archive with ARC-files by making a selective harvest of the netarkivet.dk domain. Use the "Once_an_hour" schedule, and let it run 3 or 4 times.
Use step '''1-5''' of [Quick_Start_Manual: the quick start manual].
Line 10: Line 12:
=== Download NetarchiveSuite from trunk (after code freeze) and make wayback war file: ===
''$ svn checkout --username '''developername''' https://gforge.statsbiblioteket.dk/svn/netarchivesuite/trunk/ ~/netarchivesuite_trunk/''
Then move the ARC/WARC files to '''/arcs/filedir/'''.

'''Remember''' to make these directories readable/writable for the user conducting the test.

=== 2.
Download NetarchiveSuite from trunk (after code freeze) and make wayback war file: ===
''$ svn checkout --username '''developername''' https://gforge.statsbiblioteket.dk/svn/netarchivesuite/trunk/ ~/netarchivesuite_trunk/'' (Note: currently does not work using svn 1.6.6, but does work with svn 1.4.4)
Line 25: Line 31:
=== Download Apache Tomcat http://tomcat.apache.org/, version 6.XX is recommended. And prepare wayback webapp. === === 3. Download Apache Tomcat http://tomcat.apache.org/, version 6.XX is recommended. And prepare wayback webapp. ===
Line 29: Line 35:
''$ export TOMCAT_DIR=~/tomcat''
Line 30: Line 37:
Make sure Tomcat loads ''~/netarchivesuite_trunk/conf/wayback/settings.xml''. This can be done my add the following line to ~/tomcat/bin/catalina.sh Make sure Tomcat loads ''~/netarchivesuite_trunk/conf/wayback/settings.xml''. This settings.xml file is copied to the WEB-INF directory in the ROOT.war generated above. This can be done my add the following line to ~/tomcat/bin/catalina.sh
Line 32: Line 39:
CATALINA_OPTS='-Ddk.netarkivet.settings.file=~/tomcat/webapps/ROOT/WEB-INF/settings.xml' CATALINA_OPTS='-Ddk.netarkivet.settings.file=$TOMCAT_DIR/webapps/ROOT/WEB-INF/settings.xml'
Line 38: Line 45:
=== Make/WARC ARC and CDX files and setup standalone archive. ===
Use the NetarchiveSuite to create sample ARC files as described in the Quick Start manual step 4 and/or 5.

Then move the ARC/WARC files to '''/arcs/filedir/'''.

'''Remember''' to make these directories readable/writable for the user conducting the test.

__'''Make CDX files'''__:
=== 4. Make CDX files and setup standalone archive. ===
Line 49: Line 49:
''$ ./wayback/bin/'''{warc-/arc--indexer} [-identity] PATH [CDX_PATH]''' '' ''$ ./wayback/bin/arc--indexer PATH [CDX_PATH]''' ''
Line 114: Line 114:
''$ rm -r ~/netarchiveiute_trunk'' ''$ rm -r ~/netarchivesuite_trunk''

Release test Wayback

This test tests the setup of a Wayback installation and the cooperation between Wayback and the NetarchiveSuite archive, via the NetarchiveResourceStore. It doesn't test Wayback's functionality, which are tested by archive.org.

Paths and name are chosen to make this test as easy as possible, feel free to change these to suit your system.

The following commands (lines starting with '$' can be run directly from a terminal. *Remember to change the text in bold.

1. Generate a sample archive

Generate a sample archive with ARC-files by making a selective harvest of the netarkivet.dk domain. Use the "Once_an_hour" schedule, and let it run 3 or 4 times. Use step 1-5 of [Quick_Start_Manual: the quick start manual].

Then move the ARC/WARC files to /arcs/filedir/.

Remember to make these directories readable/writable for the user conducting the test.

2. Download NetarchiveSuite from trunk (after code freeze) and make wayback war file:

$ svn checkout --username developername https://gforge.statsbiblioteket.dk/svn/netarchivesuite/trunk/ ~/netarchivesuite_trunk/ (Note: currently does not work using svn 1.6.6, but does work with svn 1.4.4)

$ cd ~/netarchivesuite_trunk/

$ wget http://downloads.sourceforge.net/project/archive-access/wayback/1.4.2/wayback-1.4.2.tar.gz?use_mirror=dfn -O wayback-1.4.2.tar.gz

$ tar xzf wayback-1.4.2.tar.gz

$ ant jarfiles

$ ant -f wayback.build.xml warfile

Check that there are no errors.

3. Download Apache Tomcat http://tomcat.apache.org/, version 6.XX is recommended. And prepare wayback webapp.

Download and unpack Tomcat to ~/tomcat/

$ mv ~/netarchivesuite_trunk/ROOT.war ~/tomcat/webapps/ $ export TOMCAT_DIR=~/tomcat

Make sure Tomcat loads ~/netarchivesuite_trunk/conf/wayback/settings.xml. This settings.xml file is copied to the WEB-INF directory in the ROOT.war generated above. This can be done my add the following line to ~/tomcat/bin/catalina.sh

CATALINA_OPTS='-Ddk.netarkivet.settings.file=$TOMCAT_DIR/webapps/ROOT/WEB-INF/settings.xml'

$ cd ~/tomcat/bin/

Edit catalina.sh and add the above line just below #!/bin/bash or #!/bin/sh

4. Make CDX files and setup standalone archive.

$ cd ~/netarchivesuite_trunk

$ ./wayback/bin/arc--indexer PATH [CDX_PATH]

$ mkdir /wayback/

Remember to make /wayback/ readable/writable for the user conducting the test.

Sort cdx files, eg. by using the sort command in linux, and move the sorted file to /wayback/file.sorted.cdx. Eg. $ sort unsorted.cdx > /wayback/file.sorted.cdx.

Move created ARC files to /arcs/filedir/

Start an local JMS broker with username 'admin' and password 'admin'.

Check that there are no files(DON'T YOU MEAN errors HERE).

$ mkdir ~/standalone

$ cd ~/netarchivesuite_trunk

$ ant releasezipball

Check that there are no files (DON'T YOU MEAN errors HERE).

$ cp ~/netarchivesuite_trunk/NetarchiveSuite.zip ~/standalone

$ cp ~/netarchivesuite_trunk/conf/wayback/standalone_archive.xml ~/standalone/

Change relevant settings in standalone/standalone_archive.xml like deployGlobal.thisPhysicalLocation.deployInstallDir and deployGlobal.thisPhysicalLocation.deployMachineUserName.

Downlad RunNetarchiveSuite.sh from http://netarchive.dk/suite/Installation_Manual_3.10/AppendixC?action=AttachFile&do=get&target=RunNetarchiveSuite.sh and save it in ~/standalone/.

$ cd ~/standalone/

$ ./RunNetarchiveSuite.sh NetarchiveSuite.zip standalone_archive.xml STANDALONE

Check that std. output and log files don't report any errors. Log files lies in ~/standalone/STANDALONE/log/*.

Start Tomcat and browse the archive

$ cd ~/tomcat/

$ chmod goa+x *.sh

$ ./bin/startup.sh

Check that there are reported no errors in ~/tomcat/log/catalina.out.

Furthermore the line INFO: Deploying web application archive ROOT.war should be in the log.

Goto http://localhost:8080/wayback in a browser and browser some material the the ARC/CDX files.

Clean up things

Stop Tomcat: $ cd ~/tomcat/ $ ./bin/shutdown.sh

Stop archive: $ cd ~/standalone/STANDALONE/

$ ./killall_NATIONAL_LIBRARY.sh

Remove installed application:

$ rm -r ~/tomcat/

$ rm -r ~/standalone

$ rm -r ~/netarchivesuite_trunk

Optional remove /arcs and /wayback.

TEST12 (last edited 2011-08-23 11:47:25 by JonasFrellesen)