Differences between revisions 6 and 7
⇤ ← Revision 6 as of 2010-06-16 11:06:41 →
Size: 12668
Editor: SoerenCarlsen
Comment:
← Revision 7 as of 2010-06-16 11:09:13 → ⇥
Size: 12576
Editor: SoerenCarlsen
Comment:
Deletions are marked like this. Additions are marked like this.
Line 7: Line 7:
This release has primarily focused on integrating code into the main NetarchiveSuite branch implemented at BNF.
Additionally, there has been done work in the deploy and wayback packages.		 This release has primarily focused on integrating code into the main !NetarchiveSuite branch implemented at BNF. Additionally, there has been done work in the deploy and wayback packages.
Line 14: Line 13:
Line 18: Line 16:
Line 22: Line 19:
Line 26: Line 22:
Line 37: Line 32:
== Upgrade instructions ==
=== New settings ===
==== New settings in the common module ====
'''settings.common.webinterface.harvestStatus.defaultPageSize''': The default number of jobs to show in the harvest status section on one result page. The default number is 100.
Line 38: Line 37:
== Upgrade instructions == '''settings.common.batch.batchjobs.batchjob.class''': The list of batchjobs to be runnable from the GUI. Must be the complete path to the batchjob classes (e.g. dk.netarkivet.archive.arcrepository.bitpreservation.!ChecksumJob). Must inherit !FileBatchJob. The default is the following:
Line 40: Line 39:
=== New settings ===

==== New settings in the common module ====

'''settings.common.webinterface.harvestStatus.defaultPageSize''':
The default number of jobs to show in the harvest status section
on one result page. The default number is 100.

'''settings.common.batch.batchjobs.batchjob.class''':
The list of batchjobs to be runnable from the GUI. Must be the complete
path to the batchjob classes (e.g. dk.netarkivet.archive.arcrepository.bitpreservation.ChecksumJob).
Must inherit FileBatchJob. The default is the following:
Line 64: Line 51:
'''settings.common.batch.batchjobs.batchjob.arcfile''': The list of the corresponding jar-files containing the batchjob. This will be used for !LoadableJarBatchJobs.
Line 65: Line 53:
'''settings.common.batch.batchjobs.batchjob.arcfile''':
The list of the corresponding jar-files containing the batchjob. This will be used for LoadableJarBatchJobs.
 If no file is specified, it is assumed, that the batchjob exists with 
the default classpath of the involved applications (BitarchiveMonitor, ArcRepository,
GUIWebServer and BitArchive).		  . If no file is specified, it is assumed, that the batchjob exists with
the default classpath of the involved applications (!BitarchiveMonitor, ArcRepository,  GUIWebServer and !BitArchive).
Line 71: Line 56:
'''settings.common.batch.baseDir''':
The directory where the resulting files will be placed when running a
batchjob through the GUI interface. The default is the relative dir "batch"		 '''settings.common.batch.baseDir''': The directory where the resulting files will be placed when running a batchjob through the GUI interface. The default is the relative dir "batch"
Line 76: Line 59:
'''settings.harvester.harvesting.heritrix.monitorResetInterval''': The time interval in seconds after which the !HarvestMonitorServer will reset the job state data. This is a simple way to detect the end of a job. The default is 300 seconds (5 minutes).
Line 77: Line 61:
'''settings.harvester.harvesting.heritrix.monitorResetInterval''':
The time interval in seconds after which the HarvestMonitorServer will reset the job state data.
This is a simple way to detect the end of a job. The default is 300 seconds (5 minutes).		 '''settings.harvester.harvesting.heritrix.crawlLoopWaitTime''': Time interval in seconds to wait during a crawl loop in the harvest controller. The default is 20 seconds.
Line 81: Line 63:
'''settings.harvester.harvesting.heritrix.crawlLoopWaitTime''':
Time interval in seconds to wait during a crawl loop in the harvest controller.
The default is 20 seconds.		 '''settings.harvester.harvesting.heritrix.abortIfConnectionLost''': A boolean flag. If set to true, the harvest controller will abort the current crawl when the JMX connection is lost. If set to false it will only log a warning, leaving the crawl operator shutting down harvester manually. Used only by the !BnfHeritrixController. The default is true.
Line 85: Line 65:
'''settings.harvester.harvesting.heritrix.abortIfConnectionLost''':
A boolean flag. If set to true, the harvest controller will abort the
current crawl when the JMX connection is lost. If set to false it will
only log a warning, leaving the crawl operator shutting down harvester
manually. Used only by the BnfHeritrixController. The default is true.		 '''settings.harvester.harvesting.heritrix.waitForReportGenerationTimeout''': Maximum time in seconds to wait for Heritrix to generate report files once crawling is over. The default is 600 seconds (10 minutes).
Line 91: Line 67:
'''settings.harvester.harvesting.heritrix.waitForReportGenerationTimeout''':
Maximum time in seconds to wait for Heritrix to generate report files once crawling is over.
The default is 600 seconds (10 minutes).

'''settings.harvester.harvesting.heritrixLauncherClass''':
The implementation of the HeritrixLauncher abstract class to be used.
The default is dk.netarkivet.harvester.harvesting.controller.DefaultHeritrixLauncher.		 '''settings.harvester.harvesting.heritrixLauncherClass''': The implementation of the !HeritrixLauncher abstract class to be used. The default is dk.netarkivet.harvester.harvesting.controller.!DefaultHeritrixLauncher.
Line 100: Line 70:
A lot of new settings has appeared, that configures hibernation, and its database connection manager used by hibernate (c3p0). Documentation about the c3p0 settings and c3p0 in general can be found here: About configuring c3p0: http://www.mchange.com/projects/c3p0/index.html#configuration_properties <br>About c3p0 in general: http://www.mchange.com/projects/c3p0/index.html
Line 101: Line 72:
A lot of new settings has appeared, that configures hibernation, and its database connection manager used by hibernate (c3p0).
Documentation about the c3p0 settings and c3p0 in general can be found here:
About configuring c3p0: http://www.mchange.com/projects/c3p0/index.html#configuration_properties
<br>About c3p0 in general: http://www.mchange.com/projects/c3p0/index.html		 '''settings.wayback.hibernate.c3p0.acquire_increment''': Determines how many connections at a time c3p0 will try to acquire when the pool is exhausted. Defines the value of hibernate configuration key "hibernate.c3p0.acquire_increment" which is the same as the c3p0-native property name "c3p0.acquireIncrement". The default is 1.
Line 106: Line 74:
'''settings.wayback.hibernate.c3p0.acquire_increment''':
Determines how many connections at a time c3p0 will try to acquire when the pool is exhausted.
Defines the value of hibernate configuration key "hibernate.c3p0.acquire_increment" which is the same as
the c3p0-native property name "c3p0.acquireIncrement".
The default is 1.
 
'''settings.wayback.hibernate.c3p0.idle_test_period''':
If this is a number greater than 0, c3p0 will test all idle, pooled but unchecked-out connections, every this number of seconds.
Defines the value of hibernate configuration key "hibernate.c3p0.idle_test_period" which is the same as
the c3p0-native property name "c3p0.idleConnectionTestPeriod".
The default is 100.		 '''settings.wayback.hibernate.c3p0.idle_test_period''': If this is a number greater than 0, c3p0 will test all idle, pooled but unchecked-out connections, every this number of seconds. Defines the value of hibernate configuration key "hibernate.c3p0.idle_test_period" which is the same as the c3p0-native property name "c3p0.idleConnectionTestPeriod". The default is 100.
Line 118: Line 76:
'''settings.wayback.hibernate.c3p0.max_size''':
Maximum number of Connections a pool will maintain at any given time.
Defines the value of hibernate configuration key "hibernate.c3p0.max_size" which is the same as
the c3p0-native property name "c3p0.maxPoolSize".
The default is 100.		 '''settings.wayback.hibernate.c3p0.max_size''': Maximum number of Connections a pool will maintain at any given time. Defines the value of hibernate configuration key "hibernate.c3p0.max_size" which is the same as  the c3p0-native property name "c3p0.maxPoolSize". The default is 100.
Line 124: Line 78:
'''settings.wayback.hibernate.c3p0.max_statements''':
The size of c3p0's global PreparedStatement cache.
Defines the value of hibernate configuration key "hibernate.c3p0.max_statements" which is the same as
the c3p0-native property name "c3p0.maxStatements".  The default is 100.		 '''settings.wayback.hibernate.c3p0.max_statements''': The size of c3p0's global !PreparedStatement cache. Defines the value of hibernate configuration key "hibernate.c3p0.max_statements" which is the same as  the c3p0-native property name "c3p0.maxStatements".      The default is 100.
Line 130: Line 80:
'''settings.wayback.hibernate.c3p0.min_size''':
Minimum number of Connections a pool will maintain at any given time.
Defines the value of hibernate configuration key "hibernate.c3p0.min_size" which is the same as
the c3p0-native property name "c3p0.minPoolSize".  The default is 10.		 '''settings.wayback.hibernate.c3p0.min_size''': Minimum number of Connections a pool will maintain at any given time. Defines the value of hibernate configuration key "hibernate.c3p0.min_size" which is the same as  the c3p0-native property name "c3p0.minPoolSize".        The default is 10.
Line 136: Line 82:
'''settings.wayback.hibernate.c3p0.timeout'''
Defines the value of hibernate configuration key "hibernate.c3p0.timeout" which is the same as
the c3p0-native property name "c3p0.maxIdleTime".  The default is 100.		 '''settings.wayback.hibernate.c3p0.timeout''' Defines the value of hibernate configuration key "hibernate.c3p0.timeout" which is the same as  the c3p0-native property name "c3p0.maxIdleTime".        The default is 100.
Line 141: Line 84:
'''settings.wayback.hibernate.connection_url''': The hibernate connection url. The default is "jdbc:derby:derbyDB/wayback_indexer_db;create=true"
Line 142: Line 86:
'''settings.wayback.hibernate.connection_url''':
The hibernate connection url.
The default is "jdbc:derby:derbyDB/wayback_indexer_db;create=true"		 '''settings.wayback.hibernate.db_driver_class''': The hibernate client driver class. The default is "org.apache.derby.jdbc.!ClientDriver"
Line 146: Line 88:
'''settings.wayback.hibernate.db_driver_class''':
The hibernate client driver class.
The default is "org.apache.derby.jdbc.ClientDriver"		 '''settings.wayback.hibernate.use_reflection_optimizer''': Look in the hibernation documentation for its meaning. The default is "false".
Line 150: Line 90:
'''settings.wayback.hibernate.use_reflection_optimizer''':
Look in the hibernation documentation for its meaning.
The default is "false".		 '''settings.wayback.hibernate.transaction_factory''': Look in the hibernation documentation for its meaning. The default is org.hibernate.transaction.JDBCTransactionFactory.
Line 154: Line 92:
'''settings.wayback.hibernate.transaction_factory''':
Look in the hibernation documentation for its meaning.
The default is org.hibernate.transaction.JDBCTransactionFactory.		 '''settings.wayback.hibernate.dialect''': Look in the hibernation documentation for its meaning. The default is "org.hibernate.dialect.!DerbyDialect"
Line 158: Line 94:
'''settings.wayback.hibernate.dialect''':
Look in the hibernation documentation for its meaning.
The default is "org.hibernate.dialect.DerbyDialect"		 '''settings.wayback.hibernate.show_sql''': Look in the hibernation documentation for its meaning. The default is "true".
Line 162: Line 96:
'''settings.wayback.hibernate.show_sql''':
Look in the hibernation documentation for its meaning.
The default is "true".		 '''settings.wayback.hibernate.format_sql''': Look in the hibernation documentation for its meaning. The default is "true".
Line 166: Line 98:
'''settings.wayback.hibernate.format_sql''':
Look in the hibernation documentation for its meaning.
The default is "true".		 '''settings.wayback.hibernate.hbm2ddl_auto''': Look in the hibernation documentation for its meaning. The default is "update".
Line 170: Line 100:
'''settings.wayback.hibernate.hbm2ddl_auto''':
Look in the hibernation documentation for its meaning.
The default is "update".		 '''settings.wayback.hibernate.user''': Look in the hibernation documentation for its meaning. The default is "".
Line 174: Line 102:
'''settings.wayback.hibernate.user''':
Look in the hibernation documentation for its meaning.
The default is "".		 '''settings.wayback.hibernate.password''': Look in the hibernation documentation for its meaning. The default is "".
Line 178: Line 104:
'''settings.wayback.hibernate.password''':
Look in the hibernation documentation for its meaning.
The default is "".		 '''settings.wayback.indexer.replicaId''': The replica to be used by the wayback indexer. Default value is "ONE".
Line 182: Line 106:
'''settings.wayback.indexer.replicaId''':
The replica to be used by the wayback indexer.
Default value is "ONE".		 '''settings.wayback.indexer.temp_batch_output_dir''': The directory to which batch output is written during indexing. The default value is "tempdir".
Line 186: Line 108:
'''settings.wayback.indexer.temp_batch_output_dir''':
The directory to which batch output is written during indexing.
The default value is "tempdir".		 '''settings.wayback.indexer.final_batch_output_dir''': The directory to which batch output is moved after a batch indexing job is successfully completed. The default value is "batchOutputDir".
Line 190: Line 110:
'''settings.wayback.indexer.final_batch_output_dir''':
The directory to which batch output is moved after a batch indexing
job is successfully completed. The default value is "batchOutputDir".		 '''settings.wayback.indexer.maxFailedAttempts''': The maximum number of times an archive file may generate a batch error during indexing before we give up on it. The default value is "3";
Line 194: Line 112:
'''settings.wayback.indexer.maxFailedAttempts''':
The maximum number of times an archive file may generate a batch error
during indexing before we give up on it.
The default value is "3";		 '''settings.wayback.indexer.producerDelay''': The delay in milliseconds before the producer thread is started. The default value is "0";
Line 199: Line 114:
'''settings.wayback.indexer.producerDelay''':
The delay in milliseconds before the producer thread is started.
The default value is "0";		 '''settings.wayback.indexer.producerInterval''': The interval, in milliseconds, between successive runs of the producer thread. The default value is "86400000";
Line 203: Line 116:
'''settings.wayback.indexer.producerInterval''':
The interval, in milliseconds, between successive runs of the
producer thread.
The default value is "86400000";		 '''settings.wayback.indexer.consumerThreads''': The number of consumer threads to run. The default value is "5";
Line 208: Line 118:
'''settings.wayback.indexer.consumerThreads''':
The number of consumer threads to run.
The default value is "5";		 '''settings.wayback.indexer.initialFiles''': A file containing a list of files which have been archived and therefore do not need to be archived again. This key may be unset. The default value is "";
Line 212: Line 120:
'''settings.wayback.indexer.initialFiles''':
A file containing a list of files which have been archived and
therefore do not need to be archived again. This key may be unset.
The default value is "";		 '''settings.wayback.aggregator.index_file-input_dir''': The directory the Aggregator consumes raw index files from The default value is "batchOutputDir";
Line 217: Line 122:
'''settings.wayback.aggregator.index_file-input_dir''':
The directory the Aggregator consumes raw index files from
The default value is "batchOutputDir";		 '''settings.wayback.aggregator.index_file-output_dir''': The directory the Aggregator places the Aggregated and sorted files into The default value is "indexDir";
Line 221: Line 124:
'''settings.wayback.aggregator.index_file-output_dir''':
The directory the Aggregator places the Aggregated and sorted files into
The default value is "indexDir";		 '''settings.wayback.aggregator.temp_aggregator_dir''': The directory used by the aggregator to store temporary files. The default value is "aggregator_tempdir";
Line 225: Line 126:
'''settings.wayback.aggregator.temp_aggregator_dir''':
The directory used by the aggregator to store temporary files.
The default value is "aggregator_tempdir";		 '''settings.wayback.aggregator.aggregation_interval''': The time to between each scheduled aggregation run (in miliseconds). The default value is "86400000";
Line 229: Line 128:
'''settings.wayback.aggregator.aggregation_interval''':
The time to between each scheduled aggregation run (in miliseconds).
The default value is "86400000";		 '''settings.wayback.aggregator.max_intermediate_index_file_size''': The maximum size of the Intermediate index file in MB. When this limit is reached a new index file is created and new indexes are added to this file. In case of a 0 value, the intermediate index file will always be merged into the main index file. The default value is "102400";
Line 233: Line 130:
'''settings.wayback.aggregator.max_intermediate_index_file_size''':
The maximum size of the Intermediate index file in MB. When this limit is reached
a new index file is created and new indexes are added to this file. In
case of a 0 value, the intermediate index file will always be merged into
the main index file.
The default value is "102400";

'''settings.wayback.aggregator.max_main_index_file_size''':
The maximum size of the main wayback index file in MB. When this limit is reached
a new index file is created and new indexes are added to this file. The
old index file will be rename to ${finalIndexFileSizeLimit}.1
The default value is "104857600";
 '''settings.wayback.aggregator.max_main_index_file_size''': The maximum size of the main wayback index file in MB. When this limit is reached a new index file is created and new indexes are added to this file. The old index file will be rename to ${finalIndexFileSizeLimit}.1 The default value is "104857600";
Line 249: Line 134:
Line 252: Line 138:
Line 254: Line 141:
Line 257: Line 143:
Line 260: Line 147:
Line 262: Line 150:

Release Notes for NetarchiveSuite 3.13.0

This version of NetarchiveSuite was released on 2010-06-15

TableOfContents

New features since NetarchiveSuite 3.12.*

This release has primarily focused on integrating code into the main NetarchiveSuite branch implemented at BNF. Additionally, there has been done work in the deploy and wayback packages.

The following bugs and features have been fixed since 3.12

Common Module



Deploy Module




Harvester Module




Access Module




Archive Module




Documentation Module




Monitor Module




Upgrade instructions




New settings




New settings in the common module


settings.common.webinterface.harvestStatus.defaultPageSize: The default number of jobs to show in the harvest status section on one result page. The default number is 100. 
settings.common.batch.batchjobs.batchjob.class: The list of batchjobs to be runnable from the GUI. Must be the complete  path to the batchjob classes (e.g. dk.netarkivet.archive.arcrepository.bitpreservation.ChecksumJob). Must inherit FileBatchJob. The default is the following: 
<batchjobs>
                <batchjob>
                    <class>dk.netarkivet.archive.arcrepository.bitpreservation.ChecksumJob</class>
                    <jarfile></jarfile>
                </batchjob>
                <batchjob>
                    <class>dk.netarkivet.archive.arcrepository.bitpreservation.FileListJob</class>
                    <jarfile></jarfile>
                </batchjob>
            </batchjobs>
settings.common.batch.batchjobs.batchjob.arcfile: The list of the corresponding jar-files containing the batchjob. This will be used for LoadableJarBatchJobs. 
  • If no file is specified, it is assumed, that the batchjob exists with 
the default classpath of the involved applications (BitarchiveMonitor, ArcRepository,  GUIWebServer and BitArchive). 
settings.common.batch.baseDir: The directory where the resulting files will be placed when running a batchjob through the GUI interface. The default is the relative dir "batch" 


New settings in the harvester module


settings.harvester.harvesting.heritrix.monitorResetInterval: The time interval in seconds after which the HarvestMonitorServer will reset the job state data.  This is a simple way to detect the end of a job. The default is 300 seconds (5 minutes). 
settings.harvester.harvesting.heritrix.crawlLoopWaitTime: Time interval in seconds to wait during a crawl loop in the harvest controller. The default is 20 seconds. 
settings.harvester.harvesting.heritrix.abortIfConnectionLost: A boolean flag. If set to true, the harvest controller will abort the  current crawl when the JMX connection is lost. If set to false it will only log a warning, leaving the crawl operator shutting down harvester  manually. Used only by the BnfHeritrixController. The default is true. 
settings.harvester.harvesting.heritrix.waitForReportGenerationTimeout: Maximum time in seconds to wait for Heritrix to generate report files once crawling is over.  The default is 600 seconds (10 minutes). 
settings.harvester.harvesting.heritrixLauncherClass: The implementation of the HeritrixLauncher abstract class to be used. The default is dk.netarkivet.harvester.harvesting.controller.DefaultHeritrixLauncher. 


New settings in the wayback module


A lot of new settings has appeared, that configures hibernation, and its database connection manager used by hibernate (c3p0). Documentation about the c3p0 settings and c3p0 in general can be found here: About configuring c3p0: http://www.mchange.com/projects/c3p0/index.html#configuration_properties <br>About c3p0 in general: http://www.mchange.com/projects/c3p0/index.html 
settings.wayback.hibernate.c3p0.acquire_increment: Determines how many connections at a time c3p0 will try to acquire when the pool is exhausted. Defines the value of hibernate configuration key "hibernate.c3p0.acquire_increment" which is the same as  the c3p0-native property name "c3p0.acquireIncrement".   The default is 1. 
settings.wayback.hibernate.c3p0.idle_test_period: If this is a number greater than 0, c3p0 will test all idle, pooled but unchecked-out connections, every this number of seconds. Defines the value of hibernate configuration key "hibernate.c3p0.idle_test_period" which is the same as  the c3p0-native property name "c3p0.idleConnectionTestPeriod".   The default is 100. 
settings.wayback.hibernate.c3p0.max_size: Maximum number of Connections a pool will maintain at any given time. Defines the value of hibernate configuration key "hibernate.c3p0.max_size" which is the same as  the c3p0-native property name "c3p0.maxPoolSize". The default is 100. 
settings.wayback.hibernate.c3p0.max_statements: The size of c3p0's global PreparedStatement cache. Defines the value of hibernate configuration key "hibernate.c3p0.max_statements" which is the same as  the c3p0-native property name "c3p0.maxStatements".      The default is 100. 
settings.wayback.hibernate.c3p0.min_size: Minimum number of Connections a pool will maintain at any given time. Defines the value of hibernate configuration key "hibernate.c3p0.min_size" which is the same as  the c3p0-native property name "c3p0.minPoolSize".        The default is 10. 
settings.wayback.hibernate.c3p0.timeout Defines the value of hibernate configuration key "hibernate.c3p0.timeout" which is the same as  the c3p0-native property name "c3p0.maxIdleTime".        The default is 100. 
settings.wayback.hibernate.connection_url: The hibernate connection url. The default is "jdbc:derby:derbyDB/wayback_indexer_db;create=true" 
settings.wayback.hibernate.db_driver_class: The hibernate client driver class. The default is "org.apache.derby.jdbc.ClientDriver" 
settings.wayback.hibernate.use_reflection_optimizer: Look in the hibernation documentation for its meaning. The default is "false". 
settings.wayback.hibernate.transaction_factory: Look in the hibernation documentation for its meaning. The default is org.hibernate.transaction.JDBCTransactionFactory. 
settings.wayback.hibernate.dialect: Look in the hibernation documentation for its meaning. The default is "org.hibernate.dialect.DerbyDialect" 
settings.wayback.hibernate.show_sql: Look in the hibernation documentation for its meaning. The default is "true". 
settings.wayback.hibernate.format_sql: Look in the hibernation documentation for its meaning. The default is "true". 
settings.wayback.hibernate.hbm2ddl_auto: Look in the hibernation documentation for its meaning. The default is "update". 
settings.wayback.hibernate.user: Look in the hibernation documentation for its meaning. The default is "". 
settings.wayback.hibernate.password: Look in the hibernation documentation for its meaning. The default is "". 
settings.wayback.indexer.replicaId: The replica to be used by the wayback indexer. Default value is "ONE". 
settings.wayback.indexer.temp_batch_output_dir: The directory to which batch output is written during indexing. The default value is "tempdir". 
settings.wayback.indexer.final_batch_output_dir: The directory to which batch output is moved after a batch indexing job is successfully completed. The default value is "batchOutputDir". 
settings.wayback.indexer.maxFailedAttempts: The maximum number of times an archive file may generate a batch error during indexing before we give up on it. The default value is "3"; 
settings.wayback.indexer.producerDelay: The delay in milliseconds before the producer thread is started. The default value is "0"; 
settings.wayback.indexer.producerInterval: The interval, in milliseconds, between successive runs of the producer thread. The default value is "86400000"; 
settings.wayback.indexer.consumerThreads: The number of consumer threads to run. The default value is "5"; 
settings.wayback.indexer.initialFiles: A file containing a list of files which have been archived and therefore do not need to be archived again. This key may be unset. The default value is ""; 
settings.wayback.aggregator.index_file-input_dir: The directory the Aggregator consumes raw index files from The default value is "batchOutputDir"; 
settings.wayback.aggregator.index_file-output_dir: The directory the Aggregator places the Aggregated and sorted files into The default value is "indexDir"; 
settings.wayback.aggregator.temp_aggregator_dir: The directory used by the aggregator to store temporary files. The default value is "aggregator_tempdir"; 
settings.wayback.aggregator.aggregation_interval: The time to between each scheduled aggregation run (in miliseconds). The default value is "86400000"; 
settings.wayback.aggregator.max_intermediate_index_file_size: The maximum size of the Intermediate index file in MB. When this limit is reached a new index file is created and new indexes are added to this file. In case of a 0 value, the intermediate index file will always be merged into the main index file. The default value is "102400"; 
settings.wayback.aggregator.max_main_index_file_size: The maximum size of the main wayback index file in MB. When this limit is reached a new index file is created and new indexes are added to this file. The old index file will be rename to ${finalIndexFileSizeLimit}.1 The default value is "104857600"; 


New translation strings


harvester/Translations.properties 
monitor/Translation.properties 


Deleted translation strings


harvester/Translation.properties 
archive/Translation.properties: 


Version History


  
Version 3.12.0 

  
 2010-05-03 

  
 New Bitpreservation infrastructure, and upgrade of Apache Derby to version 10.5.3.0 




  
Version 3.11.* 

  
 

  
Development versions aiming for 3.12.0 




  
Version 3.10.0 

  
 2009-11-16 

  
 New deploy application; JMX stability issues fixed; JMS stability issues also fixed 




  
Version 3.9.* 

  
 

  
Development versions aiming for 3.10.0 




  
Version 3.8.2 

  
2009-09-10 

  
Fix an important index synchronization bug 




  
Version 3.8.1 

  
2009-07-15 

  
Fix of important bug leading to unresponsive harvesters 




  
Version 3.8.0 

  
2009-05-23 

  
Java 1.6, Heritrix 1.14.1, Derby 10.4.2.0, complete rewrite of settings, new supported deploy module, gui access to harvest logs 




  
Version 3.7.0 

  
2008-11-04 

  
Develop version aiming for 3.8.0 




  
Version 3.6.0 

  
2008-07-03 

  
Improvement of archive component with regard to security, batch, and preservation; greater JMS stability; important bug fixes 




  
Version 3.5.* 

  
 

  
Develop versions aiming for 3.6.0 




  
Version 3.4.2 

  
2008-03-14 

  
Bug fix release, fixing JMX timeout 




  
Version 3.4.1 

  
2008-01-16 

  
Bug fix release, fixing out of memory on very large indexes 




  
Version 3.4.0 

  
2008-01-03 

  
Separation of Heritrix, work on developing our open source platform, two-part TLDs like co.uk, and lots of bugfixes 




  
Version 3.3.* 

  
 

  
Develop versions aiming for 3.4.0 




  
Version 3.2.3 

  
2007-09-27 

  
Bugfix of 3.2.2 with patched deduplicator, that fixes problem in parallel indexing 




  
Version 3.2.2 

  
2007-08-03 

  
Bugfix of 3.2.1 with patched Heritrix 1.12.1, that supports ARCRecords larger than 2GBs 




  
Version 3.2.1 

  
2007-07-04 

  
Bugfix of 3.2.0 fixing trouble using the quick start manual. 




  
Version 3.2.0 

  
2007-07-04 

  
Open source release 




  
Version 3.1.* 

  
 

  
Development versions. Version 3.1.7 was kindly reviewed by Internet Archive and the Norwegian national library. 




  
Version 3.0.0 

  
2007-02-02 

  
Marked the naming of the NetarchiveSuite, the splitting of NetarchiveSuite into independent modules, and the licensing of NetarchiveSuite under LGPL 




  
Version 2.* 

  
 

  
Various features and updates 




  
Version 2.0 

  
2006-08-30 

  
Marked a general restructuring of the code, where harvest definition data was backed by a database, the viewerproxy was trimmed and rewritten. 




  
Version 1.* 

  
 

  
Various features and updates 




  
Version 1.0 

  
2005-07-01 

  
The first version of the netarchive| software put in production for harvesting the entire Danish web 




  
Version 0.* 

  
 

  
Various pre-production development versions 




ReleaseNotes3_13_0  (last edited 2010-08-16 10:24:53 by localhost)