Integration Server 10.11 | Built-In Services Reference Guide | Parquet Folder | Summary of Elements in this Folder | pub.parquet:getNextBatch
 
pub.parquet:getNextBatch
WmParquet. Gets the next batch of Parquet records from the iterator object returned by the pub.parquet:getBatchIterator service. This service returns records based on the batch size (batchSize) provided as input. The batch size can vary across invocations of the service.
To retrieve all records from a Parquet file, invoke this service in a loop till all the records are retrieved (till the hasNext output parameter of this service is not false).
Input Parameters
iterator
Object The iterator object from which the records have to be retrieved. This object is obtained from the pub.parquet:getBatchIterator service.
batchSize
String. Number of records to be fetched in the current iteration.
Output Parameters
records
Document List A batch of Parquet records converted to an IData array. The number of records returned is less than or equal to the batchSize parameter.
iterationStatus
Document Details about the iteration are provided in the following fields:
hasNext
String. Returns true if the iterator has more records to read after this iteration.
iteration
String The current iteration count, with the first iteration being 1.
noOfElementsInBatch
String The number of records retrieved in the current iteration.
totalElementsProccesed
String Total number of records retrieved till the current iteration (including the current noOfElementsInBatch).
Usage Notes
The getNextBatch service may run into a memory limitation when reading a batch with a large number of records. Consider using a smaller batch size or allocating more memory to the Integration Server instance.