Advanced Configuration
By default, Apache Spark engine utilizes up to four CPU cores and 1 GB of RAM per core. If more resources are available on the machine running MashZone NextGen Explorer, you can configure the maximal number of CPU cores and RAM to be used by Spark.
Procedure
1. Open the config.json configuration file in a text editor.
2. Add the following code line and save your changes.
Your settings are applied.
Thereby, <number of cores> is a numeric value, such as 3, 7, 15. It is recommended to not assign all cores of the machine to Spark, i.e., when N is the number of cores of the machine, then use N-1 cores at max for Spark.
<amount of memory> is a numeric value followed by the unit, e.g., 1g for for 1 GiByte, 512m for 512 MiB etc.
Note: | The amount of memory is defined per CPU core, i.e., 1g with 16 cores equals an allowed total memory consumption of 16 GiB of RAM. |
Allowed units are
1b (bytes)
1k or 1kb (kibibytes = 1024 bytes)
1m or 1mb (mebibytes = 1024 kibibytes)
1g or 1gb (gibibytes = 1024 mebibytes)
1t or 1tb (tebibytes = 1024 gibibytes)
1p or 1pb (pebibytes = 1024 tebibytes)
Contact Support
|
Community
|
Feedback