I have a Dataproc cluster running in GCP. The cluster has a spark job which is always running and listening for requests. Upon receiving the requests, it needs to process it and returns the result in a json.
The requests to the cluster will always be coming from my organisation's on-prem machines.
How can I have this setup? can I get some guidance please.
Thanks