Question

dataframe or sqlctx (sqlcontext) generated "Trying to call a package" error

score 755 · Answer 1 · 2025-01-07 20:55:28

755

Views

dataframe or sqlctx (sqlcontext) generated "Trying to call a package" error

Published on 07 January 2025 at 20:55

score 914 · Answer 2 · 2024-12-25 18:23:28

914

Views

Importing modules for code that runs in the workers

Published on 25 December 2024 at 18:23

score 1.2k · Answer 3 · 2024-12-25 18:28:04

1.2k

Views

Is possible to run spark (specifically pyspark) in process?

Published on 25 December 2024 at 18:28

score 177 · Answer 4 · 2024-12-30 01:53:11

177

Views

More than expected jobs running in apache spark

Published on 30 December 2024 at 01:53

score 2.1k · Answer 5 · 2024-12-25 18:34:41

2.1k

Views

OutOfMemoryError when using PySpark to read files in local mode

Published on 25 December 2024 at 18:34

score 10.6k · Answer 6 · 2025-01-04 13:29:02

10.6k

Views

Can I change SparkContext.appName on the fly?

Published on 04 January 2025 at 13:29

score 39.9k · Answer 7 · 2024-12-25 18:09:49

39.9k

Views

Read ORC files directly from Spark shell

Published on 25 December 2024 at 18:09

score 139 · Answer 8 · 2024-12-25 18:44:19

139

Views

Is there a way to mimic R's higher order (binary) function shorthand syntax within spark or pyspark?

Published on 25 December 2024 at 18:44

score 2.1k · Answer 9 · 2024-12-25 18:16:55

2.1k

Views

Accessing csv file placed in hdfs using spark

Published on 25 December 2024 at 18:16

score 2.5k · Answer 10 · 2024-12-29 14:00:57

2.5k

Views

one job takes extremely long on multiple left join in Spark-SQL (1.3.1)

Published on 29 December 2024 at 14:00

score 598 · Answer 11 · 2025-01-01 16:43:36

598

Views

How to use spark for map-reduce flow to select N columns, top M rows of all csv files under a folder?

Published on 01 January 2025 at 16:43

score 112.7k · Answer 12 · 2025-01-02 12:39:28

112.7k

Views

Spark context 'sc' not defined

Published on 02 January 2025 at 12:39

score 6.5k · Answer 13 · 2024-12-25 18:34:41

6.5k

Views

How lambda function in takeOrdered function works in pySpark?

Published on 25 December 2024 at 18:34

score 850 · Answer 14 · 2025-01-01 16:42:11

850

Views

Is the DStream return by updateStateByKey function only contains one RDD?

Published on 01 January 2025 at 16:42

score 42k · Answer 15 · 2024-12-30 06:47:07

42k

Views

What to set `SPARK_HOME` to?

Published on 30 December 2024 at 06:47

score 11.3k · Answer 16 · 2024-12-25 18:07:11

11.3k

Views

PySpark reduceByKey on multiple values

Published on 25 December 2024 at 18:07

score 1k · Answer 17 · 2024-12-25 18:13:10

1k

Views

Pyspark: using filter for feature selection

Published on 25 December 2024 at 18:13

score 1.5k · Answer 18 · 2024-12-25 18:16:55

1.5k

Views

Removing duplicates from Spark RDDPair values

Published on 25 December 2024 at 18:16

score 514 · Answer 19 · 2025-01-02 13:32:33

514

Views

Spark rdd write in global list

Published on 02 January 2025 at 13:32

score 45.4k · Answer 20 · 2024-12-25 18:28:03

45.4k

Views

How to specify the path where saveAsTable saves files to?

Published on 25 December 2024 at 18:28

List Question

dataframe or sqlctx (sqlcontext) generated "Trying to call a package" error

Importing modules for code that runs in the workers

Is possible to run spark (specifically pyspark) in process?

More than expected jobs running in apache spark

OutOfMemoryError when using PySpark to read files in local mode

Can I change SparkContext.appName on the fly?

Read ORC files directly from Spark shell

Is there a way to mimic R's higher order (binary) function shorthand syntax within spark or pyspark?

Accessing csv file placed in hdfs using spark

one job takes extremely long on multiple left join in Spark-SQL (1.3.1)

How to use spark for map-reduce flow to select N columns, top M rows of all csv files under a folder?

Spark context 'sc' not defined

How lambda function in takeOrdered function works in pySpark?

Is the DStream return by updateStateByKey function only contains one RDD?

What to set `SPARK_HOME` to?

PySpark reduceByKey on multiple values

Pyspark: using filter for feature selection

Removing duplicates from Spark RDDPair values

Spark rdd write in global list

How to specify the path where saveAsTable saves files to?

Trending Questions

Popular # Hahtags

Popular Questions