Configuring Purger Properties for High Volume Data Handling
Over time, a very large number of log records accumulates in the CentraSite Registry Repository, which makes handling of log records difficult and directly affects the performance of a Registry Repository. Therefore, it is important to purge unwanted log records from the CentraSite Registry Repository occasionally.
However, purging large number of log records at one time would definitely result in system failures. In order to avoid such failures, CentraSite supports purging of the log records in a batch mode. Purging of log records in a batch mode can be initiated by enabling the enable.partial.commit property to true in the purger.properties file. The purger.properties file is located in the logpurging/resources folder under the CentraSite installation directory.
Note:
Disabling the enable.partial.commit=true property would lead to failures if the system is not able to process the huge amount of log records.
Basically, the log records accumulate at a different rate for each log unit. CentraSite defines a default threshold value for batch purging each of the log units as follows:
##partial commit enabled/disabled
enable.partial.commit=true
##policy log threshold
policy.log.partial.commit.threshold=1000
##approval log threshold
approval.log.partial.commit.threshold=500
##events threshold
runtime.events.partial.commit.threshold=1000
##metrics log threshold
runtime.performance.log.partial.commit.threshold=1000
## No of days before the current day for which the data does not be included
## in the purging
## in case of Export Log Entries & Delete Log Entries
## (i.e. No date criteria specified).
## purge.older.than=1
You can modify the threshold values for batch purging the log units as required.
Note:
If the purging type in the config.xml file is set to Export (No date criteria), then purging would exclude the log records by the number of days defined in the purge.older.than property. For example, if the purging is scheduled with purge.older.than=7, then log records that are available ahead of the 7 days would be purged from the CentraSite Registry Repository.
To change the batch purging properties
1. Open the purger.properties file in a rich text editor. You can find the file in the Software AG_directory/CentraSite/logpurging/resources directory.
2. Set the batch purging property, enable.partial.commit, to true or false, as required. The default value is true.
3. Specify the threshold values in the partial.commit.threshold property for a log unit.
4. Save and close the file.
The changes take effect in the next purging.