Can I use spark-submit to run a non-pyspark python code on spark, that is, without or with minimal changes?

35 Views Asked by At

Can I use spark-submit to run a non-pyspark python code on spark, that is, without or with minimal changes? Example, abc.py is a python script having non-pyspark, native python code I cannot make changes to the code but want to run the above python file in spark to use its distributive compute, can I do that using spark-submit or any other way?? Note: I can not make any changes to the python file I have and this python file has no code written in pyspark

abc.py is a python script having non-pyspark, native python code I cannot make changes to the code but want to run the above python file in spark to use its distributive compute, can I do that using spark-submit or any other way?? Note: I can not make any changes to the python file I have and this python file has no code written in pyspark

0

There are 0 best solutions below