Question

How to keep a SQLContext instance alive in a spark streaming application's life cycle?

score 633 · Answer 1 · 2024-12-26 12:54:43

633

Views

How to keep a SQLContext instance alive in a spark streaming application's life cycle?

Published on 26 December 2024 at 12:54

score 9.7k · Answer 2 · 2025-01-01 16:43:44

9.7k

Views

Getting java.lang.IllegalArgumentException: requirement failed while calling Sparks MLLIB StreamingKMeans from java application

Published on 01 January 2025 at 16:43

score 169 · Answer 3 · 2025-01-01 16:40:07

169

Views

Output shows "ResultSet" instead of value in Scala Spark

Published on 01 January 2025 at 16:40

score 651 · Answer 4 · 2025-01-01 16:39:02

651

Views

Spark/Spark Streaming in production without HDFS

Published on 01 January 2025 at 16:39

score 7.5k · Answer 5 · 2025-01-01 16:39:31

7.5k

Views

HashMap as a Broadcast Variable in Spark Streaming?

Published on 01 January 2025 at 16:39

score 389 · Answer 6 · 2025-01-01 16:40:48

389

Views

Parallel reduceByKeyAndWindow()s with different time values

Published on 01 January 2025 at 16:40

score 4k · Answer 7 · 2024-12-30 07:01:21

4k

Views

All masters are unresponsive ! ? Spark master is not responding with datastax architecture

Published on 30 December 2024 at 07:01

score 13.4k · Answer 8 · 2025-01-01 16:37:40

13.4k

Views

How to find spark master URL on Amazon EMR

Published on 01 January 2025 at 16:37

score 54.9k · Answer 9 · 2025-01-01 16:40:29

54.9k

Views

How to optimize shuffle spill in Apache Spark application

Published on 01 January 2025 at 16:40

score 374 · Answer 10 · 2025-01-06 00:12:06

374

Views

Offsets for Kafka Direct Approach in Spark 1.3.1

Published on 06 January 2025 at 00:12

score 601 · Answer 11 · 2025-01-01 16:43:36

601

Views

How to use spark for map-reduce flow to select N columns, top M rows of all csv files under a folder?

Published on 01 January 2025 at 16:43

score 3.9k · Answer 12 · 2025-01-01 16:36:00

3.9k

Views

scala.MatchError: in Dataframes

Published on 01 January 2025 at 16:36

score 865 · Answer 13 · 2025-01-06 00:32:31

865

Views

Kafka ->Spark streaming -> Hbase. Task not serializable Error Caused by: java.lang.IllegalStateException: Job in state DEFINE instead of RUNNING

Published on 06 January 2025 at 00:32

score 791 · Answer 14 · 2025-01-01 16:43:24

791

Views

display the content of clusters after clustering in streaming-k-means.scala code source in spark

Published on 01 January 2025 at 16:43

score 854 · Answer 15 · 2025-01-01 16:42:11

854

Views

Is the DStream return by updateStateByKey function only contains one RDD?

Published on 01 January 2025 at 16:42

score 1k · Answer 16 · 2025-01-01 16:41:36

1k

Views

Spark stream unable to read files created from flume in hdfs

Published on 01 January 2025 at 16:41

score 59 · Answer 17 · 2025-01-01 16:37:39

59

Views

Algorithm/Programming for processing

Published on 01 January 2025 at 16:37

score 1.8k · Answer 18 · 2025-01-01 16:43:43

1.8k

Views

Apache Spark-Kafka.TaskCompletionListenerException & KafkaRDD$KafkaRDDIterator.close NPE on local cluster(Client Mode)

Published on 01 January 2025 at 16:43

score 2.4k · Answer 19 · 2025-01-01 16:42:49

2.4k

Views

How to trigger a spark job without using "spark-submit"? real-time instead of batch

Published on 01 January 2025 at 16:42

score 3.8k · Answer 20 · 2025-01-01 16:41:35

3.8k

Views

apache spark - creating RDD from Iterable from groupByKey results

Published on 01 January 2025 at 16:41

List Question

How to keep a SQLContext instance alive in a spark streaming application's life cycle?

Getting java.lang.IllegalArgumentException: requirement failed while calling Sparks MLLIB StreamingKMeans from java application

Output shows "ResultSet" instead of value in Scala Spark

Spark/Spark Streaming in production without HDFS

HashMap as a Broadcast Variable in Spark Streaming?

Parallel reduceByKeyAndWindow()s with different time values

All masters are unresponsive ! ? Spark master is not responding with datastax architecture

How to find spark master URL on Amazon EMR

How to optimize shuffle spill in Apache Spark application

Offsets for Kafka Direct Approach in Spark 1.3.1

How to use spark for map-reduce flow to select N columns, top M rows of all csv files under a folder?

scala.MatchError: in Dataframes

Kafka ->Spark streaming -> Hbase. Task not serializable Error Caused by: java.lang.IllegalStateException: Job in state DEFINE instead of RUNNING

display the content of clusters after clustering in streaming-k-means.scala code source in spark

Is the DStream return by updateStateByKey function only contains one RDD?

Spark stream unable to read files created from flume in hdfs

Algorithm/Programming for processing

Apache Spark-Kafka.TaskCompletionListenerException & KafkaRDD$KafkaRDDIterator.close NPE on local cluster(Client Mode)

How to trigger a spark job without using "spark-submit"? real-time instead of batch

apache spark - creating RDD from Iterable from groupByKey results

Trending Questions

Popular # Hahtags

Popular Questions