Building Your Event-Driven Architecture : Communicating between SoftwareAG Products Using Event Routing : Administering Event Routing : Configuring Services and Service Groups : Creating Event Persistence Services : Creating Event Persistence Services for HDFS
Creating Event Persistence Services for HDFS
With Event Persistence services, you can store events to a Hadoop Distributed File System (HDFS) storage engine. You create and administer Event Persistence services using the Software AG Command Central web interface.
To use HDFS as the storage engine for Event Persistence, you must first configure the Hadoop cluster by deploying the custom Hive SerDe and Joda Date/Time libraries from your Event Persistence installation as described in Using Event Persistence with HDFS.
To create Event Routing services of type Event Persistence for HDFS:
1. In Command Central, navigate to Environments > Instances > All > <profile_name> > Event Routing > Configuration tab, select Event Persistence from the drop-down menu, and then click Add.
2. In the Select Configuration dialog, select HDFS for the service type and click OK.
3. In the Configuration Details dialog, define the following parameters for the service:
Parameter
Description
Service Name
Custom name for the new service. Specify a unique service name that starts with a character. Valid separator characters are periods (.) and dashes (-). The service name is not case-sensitive.
Important:  
You cannot rename a service which has already been created. If you wish to modify a service name, you must delete the old one and recreate a new one with a different name.
Service Description
Custom description for the new service.
NameNode Hostname
The host name of the HDFS namenode.
NameNode Port
The port number of the HDFS namenode. The default value is 8020.
Max File Size(MB)
The HDFS block size in megabytes. The default value is 65.
Hostname
The host name of the Hive server.
Port
The port number of the Hive server. The default value is 10000.
Database
The name of the Hive database.
Warehouse Location
The location of the Hive warehouse. The default value is /user/hive/warehouse.
User Id
The user name for the Hive user account.
Password
The password for the Hive user account.
Batch Size
The number of events that are written to HDFS with a single write operation. The default value is 10000.
Note:  
If the HDFS service enqueues a batch of events before the batch write timer expires, it will immediately persist all enqueued events to HDFS.
Batch Write Timer Sec(sec)
Batch write frequency in seconds. The default value is 15.
Note:  
If the batch write timer expires before the HDFS service enqueues a batch of events, all currently enqueued events will be persisted to HDFS.
4. Save your changes.
Event Routing Event Routing detects that the configuration has been updated, and starts to use the new settings automatically.
Copyright © 2016 - 2016 Software AG, Darmstadt, Germany.
Product LogoContact Support   |   Community   |   Feedback