How to change log level in dataproc serverless spark

72 Views Asked by At

In dataproc serverless, the underlying vm is hidden. How to change log level in dataproc serverless spark?

--properties ^@^spark.executor.extraJavaOptions=-Dlog4j.configuration=spark-log4j2.properties \
--files spark-log4j2.properties \
1

There are 1 best solutions below

0
On

Adding file: prefix worked.

--properties ^@^spark.executor.extraJavaOptions=-Dlog4j.configuration=file:spark-log4j2.properties \
--files spark-log4j2.properties \