Question

Group by then filter logic for dataset in scala using spark 1.x

score 76 · Answer 1 · 2023-11-09T20:11:21.497000

76

Views

Group by then filter logic for dataset in scala using spark 1.x

Published on 09 November 2023 at 20:11

score 304 · Answer 2 · 2020-08-19T12:07:34.090000

304

Views

Convert a (String, List[(String, String)]) to JSON object

Published on 19 August 2020 at 12:07

score 506 · Answer 3 · 2020-08-11T12:41:41.620000

506

Views

How to add double quotes to the string?

Published on 11 August 2020 at 12:41

score 59 · Answer 4 · 2020-02-27T13:26:23.887000

59

Views

How to display mismatched report with a label in spark 1.6 - scala except function?

Published on 27 February 2020 at 13:26

score 503 · Answer 5 · 2019-09-26T21:51:27.347000

503

Views

Repartition() causes spark job to fail

Published on 26 September 2019 at 21:51

score 120 · Answer 6 · 2019-09-20T14:45:49.163000

120

Views

Delete Unicode value in output of Spark 1.6 using Scala

Published on 20 September 2019 at 14:45

score 45 · Answer 7 · 2019-09-20T10:11:06.103000

45

Views

Reading Encoded value in spark 1.6 throwing Error

Published on 20 September 2019 at 10:11

score 187 · Answer 8 · 2019-09-20T06:07:19.610000

187

Views

Saving output of spark to csv in spark 1.6

Published on 20 September 2019 at 06:07

score 99 · Answer 9 · 2019-09-19T18:25:22.137000

99

Views

UDF in Spark 1.6 Reassignment to val error

Published on 19 September 2019 at 18:25

score 3.9k · Answer 10 · 2019-06-24T10:47:06.647000

3.9k

Views

How to list All Databases using HiveContext in PySpark 1.6

Published on 24 June 2019 at 10:47

score 1.2k · Answer 11 · 2019-02-14T17:04:39.853000

1.2k

Views

Iterating over a grouped dataset in Spark 1.6

Published on 14 February 2019 at 17:04

score 848 · Answer 12 · 2019-02-14T05:43:19.123000

848

Views

Pyspark - DataFrame persist() errors out java.lang.OutOfMemoryError: GC overhead limit exceeded

Published on 14 February 2019 at 05:43

score 185 · Answer 13 · 2019-02-01T19:36:39.070000

185

Views

Spark Program twice as slow in Spark 2.2 than Spark 1.6

Published on 01 February 2019 at 19:36

score 1.1k · Answer 14 · 2018-12-19T16:48:22.717000

1.1k

Views

cast method results in null values in java spark

Published on 19 December 2018 at 16:48

score 517 · Answer 15 · 2018-10-12T01:02:49.193000

517

Views

How to split the input data into several files based of date field in pyspark?

Published on 12 October 2018 at 01:02

score 11.3k · Answer 16 · 2018-10-08T14:54:17.863000

11.3k

Views

How to read a CSV file with commas within a field using pyspark?

Published on 08 October 2018 at 14:54

score 5.1k · Answer 17 · 2018-08-27T05:15:46.037000

5.1k

Views

Why does persist(StorageLevel.MEMORY_AND_DISK) give different results than cache() with HBase?

Published on 27 August 2018 at 05:15

score 176 · Answer 18 · 2018-07-19T09:47:41.443000

176

Views

Spark 1.6 - Overwrite directory with avro files failing using dataframes

Published on 19 July 2018 at 09:47

score 1.1k · Answer 19 · 2018-07-18T15:17:54.133000

1.1k

Views

Spark Streaming 1.6 + Kafka: Too many batches in "queued" status

Published on 18 July 2018 at 15:17

score 3.6k · Answer 20 · 2018-07-06T10:54:40.407000

3.6k

Views

How to drop duplicates considering only subset of columns?

Published on 06 July 2018 at 10:54

List Question

Group by then filter logic for dataset in scala using spark 1.x

Convert a (String, List[(String, String)]) to JSON object

How to add double quotes to the string?

How to display mismatched report with a label in spark 1.6 - scala except function?

Repartition() causes spark job to fail

Delete Unicode value in output of Spark 1.6 using Scala

Reading Encoded value in spark 1.6 throwing Error

Saving output of spark to csv in spark 1.6

UDF in Spark 1.6 Reassignment to val error

How to list All Databases using HiveContext in PySpark 1.6

Iterating over a grouped dataset in Spark 1.6

Pyspark - DataFrame persist() errors out java.lang.OutOfMemoryError: GC overhead limit exceeded

Spark Program twice as slow in Spark 2.2 than Spark 1.6

cast method results in null values in java spark

How to split the input data into several files based of date field in pyspark?

How to read a CSV file with commas within a field using pyspark?

Why does persist(StorageLevel.MEMORY_AND_DISK) give different results than cache() with HBase?

Spark 1.6 - Overwrite directory with avro files failing using dataframes

Spark Streaming 1.6 + Kafka: Too many batches in "queued" status

How to drop duplicates considering only subset of columns?

Trending Questions

Popular # Hahtags

Popular Questions