Implementing Guaranteed Event Storage in Optimize
Guaranteed event storage functionality in Optimize uses a custom Monitor API (MAPI) configuration and batching techniques to deliver events and provide for enhanced notification of event delivery problems. When implemented appropriately, this functionality supports robust event delivery and, in the event of an event delivery problem, helps users correct problems before they cause significant data corruption. Also, it enables you to configure your system to persist cached event data to disk. Note that for most Optimize configurations, there is a trade-off between event delivery integrity and performance; there are several variables involved in this trade-off, and some experimentation may be necessary to achieve the desired balance for your system.
This feature includes two customer-configurable components that support guaranteed event storage.
Setting a MAPI flag to support synchronous event delivery to Analytic Engines.
Setting System Properties that determine whether system caches are configured for high event delivery integrity (persistence) or high performance.
Note:
The Analytic Engine is designed to recover from Broker connectivity and database connectivity issues. There is no need to restart the Analytic Engine when a database and/or Broker connectivity issue arises. Once the connectivity issue is addressed, Analytic Engine will continue to process data as expected.