Question

How do I retrieve the schema fields that pyarrow has inferred from the Hive partitioning of a Dataset?

score 22 · Answer 1 · 2024-02-16T10:01:17.550000

22

Views

How do I retrieve the schema fields that pyarrow has inferred from the Hive partitioning of a Dataset?

Published on 16 February 2024 at 10:01

score 76 · Answer 2 · 2024-01-29T12:13:33.043000

76

Views

Delta Tables...do we need partitions for concurrent write/update?

Published on 29 January 2024 at 12:13

score 19 · Answer 3 · 2023-10-03T11:17:17.040000

19

Views

why hive explain command always shows same result on different conditisions?

Published on 03 October 2023 at 11:17

score 4.6k · Answer 4 · 2022-08-31T06:38:50.703000

4.6k

Views

How to read filtered partitioned parquet files efficiently using pandas's read_parquet?

Published on 31 August 2022 at 06:38

score 1.9k · Answer 5 · 2022-07-08T01:30:55.887000

1.9k

Views

Hive insert into partitioned table with colums list from select

Published on 08 July 2022 at 01:30

score 303 · Answer 6 · 2022-06-29T17:48:07.090000

303

Views

In Foundry, how can I Hive partition with only 1 parquet file per value?

Published on 29 June 2022 at 17:48

score 655 · Answer 7 · 2022-05-20T13:44:30.897000

655

Views

Databricks / Spark storage mechanism for Delta Tables, Delta Logs, Partitions etc

Published on 20 May 2022 at 13:44

score 611 · Answer 8 · 2022-04-19T11:12:46.847000

611

Views

Need to merge multiple hive partitions into one partition in spark

Published on 19 April 2022 at 11:12

score 1.4k · Answer 9 · 2022-02-13T18:13:08.230000

1.4k

Views

How to automatically update the Hive external table metadata partitions for streaming data

Published on 13 February 2022 at 18:13

score 834 · Answer 10 · 2021-12-19T07:34:52.697000

834

Views

Performance of pyspark + hive when a table has many partition columns

Published on 19 December 2021 at 07:34

score 402 · Answer 11 · 2021-12-13T10:49:53.630000

402

Views

Hive - incomplete rows in select from managed partitioned table

Published on 13 December 2021 at 10:49

score 190 · Answer 12 · 2021-11-30T15:28:38.487000

190

Views

How to retain last N partitions for a hive external table?

Published on 30 November 2021 at 15:28

score 1.1k · Answer 13 · 2021-09-07T15:49:19.803000

1.1k

Views

HIVE: Exception: Partition Already Exists while ADDING a NEW Partition to an EXISTING EXTERNAL Table

Published on 07 September 2021 at 15:49

score 900 · Answer 14 · 2021-08-11T10:16:00.303000

900

Views

Repartition in Hadoop

Published on 11 August 2021 at 10:16

score 1.2k · Answer 15 · 2021-07-24T18:06:57.097000

1.2k

Views

Querying based on Partition and non-partition column in Hive

Published on 24 July 2021 at 18:06

score 345 · Answer 16 · 2021-07-21T06:53:56.327000

345

Views

Hive: read table partitions defined in subselect

Published on 21 July 2021 at 06:53

score 3.4k · Answer 17 · 2021-07-13T17:35:40.930000

3.4k

Views

Filtering is supported only on partition keys of type string Hive

Published on 13 July 2021 at 17:35

score 1.3k · Answer 18 · 2021-07-10T16:16:32.720000

1.3k

Views

How to create partitions (year,month,day) in hive from date column which have MM/dd/yyyy format

Published on 10 July 2021 at 16:16

score 1k · Answer 19 · 2021-06-26T14:43:59.283000

1k

Views

Data Loaded wrongly into Hive Partitioned table after adding a new column using ALTER

Published on 26 June 2021 at 14:43

score 566 · Answer 20 · 2021-06-15T07:04:48.187000

566

Views

Hive Query is going for full table scan when filtering on the partitions from the results of subquery/joins

Published on 15 June 2021 at 07:04

List Question

How do I retrieve the schema fields that pyarrow has inferred from the Hive partitioning of a Dataset?

Delta Tables...do we need partitions for concurrent write/update?

why hive explain command always shows same result on different conditisions?

How to read filtered partitioned parquet files efficiently using pandas's read_parquet?

Hive insert into partitioned table with colums list from select

In Foundry, how can I Hive partition with only 1 parquet file per value?

Databricks / Spark storage mechanism for Delta Tables, Delta Logs, Partitions etc

Need to merge multiple hive partitions into one partition in spark

How to automatically update the Hive external table metadata partitions for streaming data

Performance of pyspark + hive when a table has many partition columns

Hive - incomplete rows in select from managed partitioned table

How to retain last N partitions for a hive external table?

HIVE: Exception: Partition Already Exists while ADDING a NEW Partition to an EXISTING EXTERNAL Table

Repartition in Hadoop

Querying based on Partition and non-partition column in Hive

Hive: read table partitions defined in subselect

Filtering is supported only on partition keys of type string Hive

How to create partitions (year,month,day) in hive from date column which have MM/dd/yyyy format

Data Loaded wrongly into Hive Partitioned table after adding a new column using ALTER

Hive Query is going for full table scan when filtering on the partitions from the results of subquery/joins

Trending Questions

Popular # Hahtags

Popular Questions