Can anyone illustrate the difference between deploying the Spark Operator with Argoflow & Apache Spark with Knative. Which route will help to achieve a pure serverless application stack over Kubernretes.
Argo Workflow + Spark Operator Or Spark with Knative leads to Server less Deployment
316 Views Asked by Aman Raparia At
1
There are 1 best solutions below
Related Questions in APACHE-SPARK
- Spark .mapValues setup with multiple values
- Where do 'normal' println go in a scala jar, under Spark
- How to query JSON data according to JSON array's size with Spark SQL?
- How do I set the Hive user to something different than the Spark user from within a Spark program?
- How to add a new event to Apache Spark Event Log
- Spark streaming + kafka throughput
- dataframe or sqlctx (sqlcontext) generated "Trying to call a package" error
- Spark pairRDD not working
- How to know which worker a partition is executed at?
- Using HDFS with Apache Spark on Amazon EC2
- How to create a executable jar reading files from local file system
- How to keep a SQLContext instance alive in a spark streaming application's life cycle?
- Cassandra spark connector data loss
- Proper way to provide spark application a parameter/arg with spaces in spark-submit
- sorting RDD elements
Related Questions in KUBERNETES
- How to know a Pod's own IP address from inside a container in the Pod?
- Who will decide the "specified number of pods" for replication controller in kubernetes?
- Access other containers of a pod in Kubernetes
- Kubernetes cluster using Vagrant not working after restart
- kubectl not installed with gcloud SDK
- How do I access the Kubernetes api from within a pod container?
- Exposing several services with Vagrant and Kubernetes on my own server
- Does Kubernetes provision new VMs for pods on my cloud platform?
- Any suggestion for running Aerospike on Kubernetes on CoreOS on GCE?
- Kubernetes - kubectl exec bash - session drop and line width
- Google Container Engine (GKE): "Hello Wordpress" tutorial not working (ERR_CONNECTION_REFUSED)
- Kubernetes Pod Creation Speed
- How can i set max count of pods for replication-controller per node?
- Is there a way to tell kubernetes to update your containers?
- Postgres with Kubernetes and persistentDisk
Related Questions in GOOGLE-KUBERNETES-ENGINE
- Cannot access google cloud SQL from google container engine
- Cluster communication and firewalls in Google Container Engine
- Google Container Engine (GKE): "Hello Wordpress" tutorial not working (ERR_CONNECTION_REFUSED)
- Setting up continuous deployment to Google Compute Engine running Kubernetes
- Does Google Container Registry undergo issues?
- How to mount volume for docker container via yaml manifest?
- LogSeverity on aggregated logs in Google Container Engine
- How do I permanently edit cluster/saltbase/pillar/privilege.sls to allow_privledged with Google Container Engine?
- Static outgoing IP in Kubernetes
- Docker container curl to web
- enable stackdriver monitoring agent google container engine clusters on gci image
- Networking between flex environment app engine and cluster engine?
- Set vm.max_map_count on cluster nodes
- How to reduce nodes(vm) running in a Kubernetes cluster of GKE gracefully?
- Google Container Engine StatefulSets in kubernetes 1.5.1 don't seem to work
Related Questions in KNATIVE
- How to create the knative serving
- /busybox/sh: syntax error: bad substitution with Tekton
- How to generate code using the code generator for the custom resource definition
- GCP Cloud Run for Anthos - no healthy upstream
- How should I add HTTP authentication to KNative services?
- knative domain mapping is not working properly. error: 111 occured. how to use?
- Trying to create a Domain Claim in a AKS Cluster using Knative API
- Knative Serving just returns default Apache Webpage
- docker desktop & knative & knative func
- Disabling proxy protocol for the in-cluster communication in Istio
- Google cloud run sudden latency spikes and container instance time increase
- Knative - kubernetes yaml to mount data from google cloud storage
- local knative serving and ambassador wihtout TLS
- How to tells Knative Pod Autoscaler not to kill in-progress long running pod
- Can I set a revision tag for my google cloud run service via terraform?
Related Questions in ARGO
- No '<||?' candidates produce the expected contextual result type 'Decoded<_>'
- Argo: how to repeat until a specific (half-hour) time, every x minutes with a Forbid concurrencyPolicy?
- How to update a property in Argo cron?
- ArgoWF steps output is not getting right value
- 400 Bad Request The plain HTTP request was sent to HTTPS port when deploying Harbor behind NLB
- Argo workflows Result and error are unresolved
- Argocd - Brand new cluster and brand new error - ooohooo
- Getting a value from a ConfigMap in my Argo Workflow
- Argo parameters' comparison doesn't work?
- argocd applicationset template with values from helm
- integrate Argo rollouts dashboard into react application
- Argo Rollout AnalysisRun datadog with incomplete options
- ArgoCD - When deploying one app in monorepo with multiple application, all app re-sync triggers
- Jenkins steps to update helm files
- How to pass list of arguments from argo workflow and use it in argo workflowtemplate
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
I'm not sure what configuration you're imagining for Apache Spark + Knative. Knative is intended to provide developers a serverless deployment and management experience, but AIUI Spark is an independent project which does not specifically target Kubernetes execution.
Similarly, it looks like Argoflow aims to simplify deployment of Kubeflow (ML training) applications specifically, whereas Spark is a general-purpose data processing framework. Your question is a bit like asking "what's better for getting around, a Tesla or a Cessna"? Without knowing where you're going, it's a bit hard to make a recommendation.