pub.parquet:getNextBatch

WmParquet. Gets the next batch of Parquet records from the iterator object returned by the pub.parquet:getBatchIterator service. This service returns records based on the batch size (batchSize) provided as input. The batch size can vary across invocations of the service.

To retrieve all records from a Parquet file, invoke this service in a loop till all the records are retrieved (till the hasNext output parameter of this service is not false).

iterator	Object The iterator object from which the records have to be retrieved. This object is obtained from the pub.parquet:getBatchIterator service.
batchSize	String. Number of records to be fetched in the current iteration.

records	Document List A batch of Parquet records converted to an IData array. The number of records returned is less than or equal to the batchSize parameter.
iterationStatus	Document Details about the iteration are provided in the following fields:
	hasNext	String. Returns true if the iterator has more records to read after this iteration.
	iteration	String The current iteration count, with the first iteration being 1.
	noOfElementsInBatch	String The number of records retrieved in the current iteration.
	totalElementsProccesed	String Total number of records retrieved till the current iteration (including the current noOfElementsInBatch).

The getNextBatch service may run into a memory limitation when reading a batch with a large number of records. Consider using a smaller batch size or allocating more memory to the Integration Server instance.