Define partial data extraction

You can define a partial data extraction for tables with the SAP and JDBC data connection types.

The Extract all data option is enabled by default during the configuration of an analysis realm or during migration of an older client to PPM version 9.9.

After the analysis realm configuration, you can define a partial data extraction by specifying an extraction time or value from which the data is to be extracted.

Procedure

  1. Double-click an analysis realm in the Analysis realms of the client list.

    The overview page of the analysis realm is displayed.

  2. On the Analysis realm tables tab, select a table of the SAP or JDBC type, for which you want to define a partial data extraction.

    The required settings are displayed in the Table criteria window.

  3. Enable the Extract all data option to extract all data in the table without restrictions.
  4. Enable the Extract data from option, if only specific data of the table is to be extracted.
  5. In the selection box, specify whether you want to extract from an extraction time (Last point in time extracted) or an extraction value (Last value extracted).

    Depending on your selection and the data connection type of the table, various options are available (see table below).

  6. Specify your settings.
  7. Click Save.

Your settings are applied.

Option

Description

Extract data from "Last point in time extracted"

The extraction starts from a specific point in time and ends with the current point in time.

Next extraction starts from

Indicates the next extraction time. Only data with a time stamp equal to or greater than the point in time defined are extracted.

Initial extraction starts from

Indicates the initial extraction date which ensures that all data of the table are going to be extracted. Default date is 01.01.1970.00.00. Enter a date and time.

Overlap

Time value subtracted during extraction from the current execution time as the end time. Data extraction will end earlier by the specified value (in seconds).

Without specifying a time offset value, data records that have been created but not written explicitly to the database to be extracted might not be extracted in any of two subsequent extraction operations due to their offset time stamp.

Detailed information is available in the documentation PPM Process Extractors.

Time zone

Indicates the time zone of the time stamp in the database. If you do not select a time zone, the default time zone applies.

Source system field

Field (table column) with the time stamps in the source system that is used for controlling the extraction. All source system fields are available for selection. The default selection is the first field. Select a source system field.

Source system type

(applies to JDBC data sources only)

Depending on the data type of the source field, a source system type is automatically set (date, time stamp (default), and text). You can change the preset value.

Format

(only available for Text source system type)

Indicates the time format of the source data, e.g., yyyyMMdd.

For SAP data sources, the format is automatically extracted from the source system field defined.

For JDBC data sources, you can set the format only for the Text source system type.

 

 

Extract data from "Last value extracted"

Extraction starts from a specific value.

Next extraction starts from value

Value from which the next extraction starts. Enter a value. Default value is 0.

Initial extraction starts from value

Indicates the initial extraction value which ensures that all data of the table are going to be extracted. Default value is 0. Specify a value.

Overlap

Offset value subtracted during extraction from the start value (lastreadvalue from the data source file). If the result of your data is a negative value, this value is handled like a positive value.

An offset value specified in the data source configuration is included in data extraction only if the lower limit is not explicitly specified.

Detailed information is available in the documentation PPM Process Extractors.

Source system field

Field (table column) in the source system that is used for controlling the extraction. All source system fields are available for selection. The default selection is the first field. Select a source system field.