How can we change the parameters in Spark Submit Default Command line options in Qubole.
Though there is a option to override the values if needed under "Spark Submit Command Line Options" but this option is not available in Spark "Command Line".
How can we change the parameters in Spark Submit Default Command line options in Qubole.
Though there is a option to override the values if needed under "Spark Submit Command Line Options" but this option is not available in Spark "Command Line".
Copyright © 2021 Jogjafile Inc.
In case of Spark Command Line, you can pass the configuration in the code itself, as below:
Reference Link: https://docs.qubole.com/en/latest/user-guide/analyze/compose-spark.html#compose-a-spark-application-using-the-command-line