Calling Natural from REST

This document covers the following topics:


Introduction

Scenario: "I have a Natural server subprogram and want to call this from a REST client."

This scenario uses the tools IDL Extractor for Natural and Integration Server Wrapper of the Designer.

graphics/simple.png

Solution: Take an existing Natural server subprogram graphics/blue_1.gif and generate the integration logic graphics/blue_2.gif to call it from a REST client graphics/blue_3.gif, as shown below.

graphics/solution.png

graphics/blue_1.gif Extract the interface of the Natural server program. See Using the Software AG IDL Extractor for Natural.
graphics/blue_2.gif Generate REST resources, connection and adapter services in Integration Server.
graphics/blue_3.gif Execute the call from the REST client to the Natural server program.

This scenario makes the following important assumptions:

For Task 1:

  • You have a working Natural subprogram, also known as a CALLNAT program.

  • You have access to the sources of this Natural subprogram. These must be stored either

    • locally, that is, on the same machine where NaturalONE is running

      graphics/intro-local.png

    • or remotely and accessed via the Natural RPC Server (1), and either EntireX Broker or Integration Server.

      graphics/intro-remote.png

      Instead of NaturalONE, you can also use the Designer.

      graphics/intro-remote-exx.png

    (1) See your Natural documentation for setting up the Natural RPC Server.

For Tasks 2 and 3:

  • You have an Integration Server with EntireX Adapter installed.

  • You have a REST client.

  • You can call the Natural server subprogram at runtime using different methods:

    • For the EntireX RPC connection method you need

      • EntireX Broker on one of the supported platforms: z/OS | UNIX | Windows | BS2000

      • the Natural RPC Server (1)

      graphics/intro-rpc.png

    • For the EntireX Direct RPC connection method you need:

      • the Natural RPC Server (1)

      graphics/intro-direct.png

    (1) See your Natural documentation for setting up the Natural RPC Server.

Task 1: Extract the Interface of a Natural Server

Introduction

Follow the instructions for extracting Natural under Using the Software AG IDL Extractor for Natural:

This process creates the following EntireX metafiles:

  • IDL file. A Software AG IDL file contains definitions of the interface between client and server. See Software AG IDL File in the IDL Editor documentation.

  • Server mapping file (optional). The mapping file is a Designer file with extension .cvm that contains Natural-specific mapping information. See Server Mapping Files for Natural in the Designer documentation.

Sample Natural Server used in the Examples

The following Natural server is used to illustrate the features of the IDL Extractor for Natural.

Imagine an existing Natural server called EMPLOYEE. It implements the access logic for a LIST and DETAILS function to a database view EMPLOYEE. Its parameter data area is shown below:

DEFINE DATA PARAMETER
1 OPERATION        (A1)    /* 'L' => List; 'D' => Details
1 ID               (A10)   /* Input
1 EMPLOYEE                 /* Output
  2 FIRSTNAME      (A20)   /* First name
  2 SURNAME        (A20)   /* Surname
  2 DATE-BIRTH     (D)     /* Date of birth
  2 DETAILS        (A100)
  2 REDEFINE DETAILS
    3 ANNUAL-SALARY(P9)    /* Annual salary
    3 VACATION     (N2)    /* Vacation days per year
    3 LANGUAGE     (A3)    /* Language
1 EMPLOYEES        (1:*)   /* Out
  2 IDENT          (A10)   /* Identification number
  2 FIRSTNAME      (A20)   /* First name
  2 SURNAME        (A20)   /* Surname
  2 DATE-BIRTH     (D)     /* Date of birth             
END-DEFINE

Two approaches for extracting the Natural server are described below:

  • Fast-track
    Learn how EntireX helps you to connect the Natural Server with quick results, even without specific Natural knowledge. See Extracting a Natural Server - Fast-track Method.

  • User-defined Mapping
    With a user-defined mapping, you can shape the interface to your Natural server. You can minimize the interface by suppressing Natural server fields or by providing constant values. Renaming interfaces allows you to specify a readable long name. These two features together - constants and renaming of interfaces - are most powerful when multiple interfaces are implemented in a single Natural server. Each function of the Natural server triggered by an operation code or function code can be modelled as a separate REST resource method/operation. See Extracting a Natural Server - Modern Method with User-defined Mapping.

Extracting a Natural Server - Fast-track Method

Start of instruction setTo extract the Natural server

  1. Switch to the EntireX perspective.

  2. Invoke the IDL Extractor for Natural.

  3. Select the Natural server subprogram, in this example EMPLOYEE, and press Finish.

    graphics/extract_fast-1.png

    The default extraction settings ensure you get useful results. The outcome is a Software AG IDL file (interface definition language), a Designer file with extension .idl:

    graphics/extract_fast-2.png

    By default, the interface name EMPLOYEE is taken from the Natural server subprogram name.

Extracting a Natural Server - Modern Method with User-defined Mapping

EntireX allows you to extract all implemented interfaces of the Natural server separately. Instead of a large EMPLOYEE interface, separate interfaces getListOfEmployees and getDetailsOfEmployee are extracted. Each interface contains required parameters; obsolete parameters for an interface are suppressed, improving its usability.

Start of instruction setTo extract a Natural server with a user-defined mapping

  1. Call the IDL Extractor for Natural, select the Natural server EMPLOYEE, check Redesign the interfaces and press Next.

    graphics/natExtractor_examples_userMap-1.png

  2. Model the extracted interface to suit your needs by creating a function getListOfEmployees.

    1. Mark the parameter OPERATION in the Natural Subprogram Source view or the Natural Parameters pane

    2. Set Constant 'L' for the parameter OPERATION.

    In the Natural Parameters pane, constant [L] is shown in brackets after the Natural parameter. OPERATION is removed from the IDL Parameters pane.

    At runtime, EntireX passes L as the value for the OPERATION parameter. This forces the EMPLOYEE LIST function to be executed.

    graphics/natExtractor_examples_userMap-2.png

  3. Suppress the Natural group EMPLOYEE, which is unused in the LIST function. This removes the IDL group EMPLOYEE from the IDL Parameters pane. The Natural parameter EMPLOYEE remains. Parameters that are suppressed in the IDL Parameters pane are displayed in italic font in the Natural Parameters pane.

    graphics/natExtractor_examples_userMap-3.png

    Note:
    Parameters set to constant are also displayed in italic font, because Set Constant suppresses them in the IDL Parameters pane too (see Step 2).

  4. Also suppress Natural parameter ID, similar as already done for Natural group EMPLOYEE in the previous step.

  5. Specify a readable name getListOfEmployees for the IDL Parameters, using the toolbar button graphics/icon_rename.png. The new name appears on the tab.

    graphics/natExtractor_examples_userMap-4.png

  6. Create a getDetailsOfEmployees function for the DETAILS operation. A new interface is needed for this. Use the toolbar button graphics/icon_add.png and open a new tab. The IDL parameters are reset to defaults. The previously extracted getListOfEmployees interface still exists in the first tab. Once you reactivate the first tab, you will see the interface of getListOfEmployees again.

    graphics/natExtractor_examples_userMap-5.png

  7. Specify a readable name getDetailsOfEmployee for the IDL Parameters, using the toolbar button graphics/icon_rename.png. The name is displayed on the tab.

    graphics/natExtractor_examples_userMap-6.png

  8. Set constant 'D' for Natural parameter OPERATION to execute the EMPLOYEE DETAILS operation at runtime. The IDL parameter OPERATION is removed from the IDL Parameters pane and displayed in the Natural Parameters pane. The italic font indicates suppression.

    graphics/natExtractor_examples_userMap-7.png

  9. Suppress the Natural X-array EMPLOYEES, which is not needed in the DETAILS interface. The IDL parameter EMPLOYEES is removed from the IDL Parameters pane and displayed in italic font in the Natural Parameters pane.

    graphics/natExtractor_examples_userMap-8.png

  10. By default, the Natural parameter DETAILS is mapped. In this case, the redefinition of DETAILS in the Natural Subprogram Source pane contains information of more value.

    graphics/natExtractor_examples_userMap-9.png

  11. You can map the redefinition of DETAILS in the Natural Subprogram pane if you prefer to use this rather than the DETAILS parameter. Select REDEFINE DETAILS in the Natural Subprogram pane and press Map to Out. The IDL parameter DETAILS is turned into a group containing parameters that match the Natural redefinition.

    graphics/natExtractor_examples_userMap-10.png

  12. Press Finish to retrieve the extraction result in the form of a Software AG IDL file. At the same time, a Server Mapping Files for Natural (Designer file with extension .cvm) is created. The Software AG IDL File describes the interfaces from the , while the server mapping file contains the mapping to the real Natural server. Both of these files must be kept together and in sync, otherwise a call to the Natural server may fail.

    graphics/natExtractor_examples_userMap-11.png

    To summarize: We created two IDL interfaces. In the IDL file, these resulted in two IDL programs: getListOfEmployees and getDetailsOfEmployee. Both IDL programs were given readable names (Steps 4 and 6). Meaningful fields were kept, while superfluous fields were suppressed (Steps 3 and 8). The program getDetailsOfEmployee contains the redefined fields of parameter DETAILS (see below) mapped during extraction (step 9).

    Note:
    At runtime the RPC client generated with the extracted interface will send data for the redesigned interfaces, while your Natural server still expects EMPLOYEE data. The EntireX runtime transforms the incoming data stream from the RPC client, using the server mapping file.

    graphics/natExtractor_examples_userMap-12.png

Comparison Chart: Fast-track versus User-defined Mapping

The following table highlights the differences when shaping an interface with a user-defined mapping compared with a fast-path extraction.

  Interface Shaping with User-defined Mapping Fast-path Extraction
General User-defined interface with dedicated mapping. For our example, the interfaces are small and tidy and more self-explanatory with long, readable interface names. They are easier to use with the hidden OPERATION field and the suppressed Natural fields, which are not needed. Automatic, quick result extraction with Natural-like interfaces on IS. For our example, the IS interface EMPLOYEE matches exactly 1:1, field by field.
IS service(s) Multiple small and handy IS services; each OPERATION code is mapped to a separate IS service. One big IS service.
IS service name Readable long name. Short Subprogram name; up to 8 characters.
IS fields Usage of Suppress and Set Constant reduces the message length. This keeps focus on relevant data itmes and keeps the client's interface clean. It may also improve performance. The IS fields and Natural server subprogram parameters match 1:1. As Natural layout descriptions are sometimes used for many different purposes, irrelevant data items appear and clutter up the IS interface.
OPERATIONparameter Suppressed: the OPERATION parameter does not exist in the IS service as an IS field. The OPERATION parameter exists in the IS service as an IS field and needs to be filled in by the client endpoint.
OPERATION code The OPERATION code is provided internally by EntireX runtime in the OPERATION field. The OPERATION code needs to be specified in the IS service in the OPERATION field by the client endpoint.
REDEFINE parameters Either the parameter that is redefined or one of its redefinitions is available as an IS field. Only the parameter that is redefined is available as an IS field. Redefinitions of the parameter are not available as IS fields.

A user-defined mapping enables you also to define alternative mappings for Natural paraneters (REDEFINEs, etc.). These enable scenarios with Natural servers where data exchange is not fully described by the PDA of the Natural subprogram. For more information refer to the User-defined Mapping in the IDL Extractor for Natural documentation.

Testing the Extraction Results

The following pictures use the extraction results described under Extracting a Natural Server - Modern Method with User-defined Mapping.

Start of instruction setTo test the extraction results (optional)

  1. You can test the results of the extraction operation and the REST server back end, using the EntireX IDL Tester. From the context menu of the IDL file in the Designer, choose Software AG IDL Tester.

    graphics/many2many_extract_test-1.png

  2. Select getDetailsOfEmployee.

    graphics/nat2many_extract_test-2.png

    Note that the broker and server parameters contain the explicit route to call the server program, and you can optionally ping the connection from this client. With the File > Options dialog, check Natural Logon. If required set:

    • User and Password for broker authentication

    • RPC User ID and RPC Password for server authentication

    See EntireX IDL Tester in the Designer documentation.

  3. Check the Integration Server log, the EntireX Adapter log or the RPC logs. Applies to all connection methods.

Task 2: Generate the REST Resources, Connection and Adapter Services in Integration Server

This section describes your first steps to create a new Integration Server connection. This is described in more detail under Using the Integration Server Wrapper, for example working with existing Integration Server connections. This section covers the following topics:

Step 1: Start the Integration Server Wrapper Wizard

Start of instruction setTo start the Integration Server Wrapper wizard

  1. In the context menu of a Software AG IDL file, choose Integration Server > Generate webMethods IS Connection.

    This starts the wizard with a list of existing Integration Server Wrapper connections.

    Note:
    If the selected IDL file is not valid because of a syntax error, an error dialog comes up and the wizard does not start.

  2. Continue with Step 2: Create a New Integration Server Connection.

Step 2: Create a New Integration Server Connection

graphics/using_createNew.png

Start of instruction setTo create a new Integration Server connection

  1. Define the new Integration Server connection on the wizard page.

    Notes:

    1. The only required field is Server. Enter the hostname of the Integration Server including an optional port number. If no port number is specified, port number defaults to "5555". The Integration Server Authentication can be passed with the User and Password fields.
    2. Optional settings are for secure connections. The Truststore for HTTPS contains all signed certificates and must be a valid truststore.
    3. The check box Verify host name checks that the hostname is entered in the stored certificate.
    4. When the Integration Server has Client Authentication enabled, you can specify your Keystore file and keystore Password.
    5. For managing Integration Server connections, see Integration Server Preferences in the Integration Server Wrapper documentation.
  2. Choose Next and continue with Step 3: Select the Connection Type.

Step 3: Select the Connection Type

graphics/using_connectionType.png

Start of instruction setTo create a new connection

  1. Select a connection type from the drop down list. Connection types are described under EntireX Adapter Connections in the EntireX Adapter documentation and Introduction to the Integration Server Wrapper.

    Note:
    The list of connection types is filtered: connection types that require a license are only shown if a corresponding license file is available. Reliable RPC connections are only shown if all IDL programs contain only IN parameters. Also, if a server mapping file is available, only those connection types that support the interface type specified in the server mapping file are shown.

  2. Check the box Create or Update REST resource.
  3. Click Next and continue with Step 4: Define Adapter Services for an RPC Connection.

Step 4: Define Adapter Services for an RPC Connection

graphics/using_define-rpc.png

Start of instruction setTo create a connection and related adapter services

  1. Select a package for the created objects.

  2. Define a folder name. If the folder does not exist, it will be created.

  3. Define a connection name.

  4. Define the parameters of the connection type. For details, see the EntireX and your webMethods Integration Server Applications.

    As a result, the folder will contain the connection and the adapter services (one for each IDL program). The name of a service is the same as the respective IDL program.

The default settings for the adapter services are:

  • the Default package; if not available, the first package

  • the IDL library name for the Folder Name

  • the IDL library name with the suffix "Connection" for the Connection Name

Note:
When creating a connection, a package dependency is added such that the selected package depends on webMethods EntireX (the package WmEntireX) with the version currently used.

Step 5: Create or Update a REST Resource

Start of instruction setTo create or update a REST resource

Make sure checkbox Create or Update REST resource is checked.

  1. Select a package.

    graphics/using_define-rpc-rest.png

  2. Define a folder name. If the folder does not exist, it will be created.

  3. Define the REST Resource name.

  4. Check Update existing Resource if you want to add additional services to an existing resource.

Step 6: Edit the REST Resource

Start of instruction setTo edit the REST resource

  1. Switch to the Service Development perspective of Software AG Designer.

    graphics/generate_edit-rest.png

  2. Refresh the package where you generated the REST Resource in the previous step.

  3. Open the REST Resource.

  4. Edit the REST URLs and HTTP Methods to match the functionality of your application.

For more information see:

  • REST Developer's Guide in the webMethods Integration Server documentation for information on using the generated REST resources

  • Configuring a REST Resource Using the URL Template-Based Approach in the online help provided under Software AG Designer Guides > webMethods Service Development Help > Working with REST

Task 3: Execute the Call from Integration Server to Natural

Use an appropriate REST client, specify URL, Method and Headers and invoke your REST resource:

graphics/many2rest_test.png