Question

Cannot read parquet files in s3 bucket with Pyspark 2.4.4

score 4.2k · Answer 1 · 2020-10-19 17:47:20

4.2k

Views

Cannot read parquet files in s3 bucket with Pyspark 2.4.4

Published on 19 October 2020 at 17:47

score 242 · Answer 2 · 2023-10-19 11:33:58

242

Views

S3FS fails when given aiobotocore session to initialize the File System

Published on 19 October 2023 at 11:33

score 55 · Answer 3 · 2023-11-13 15:28:56

55

Views

Making s3fs work alongside ProcessPoolExecutor

Published on 13 November 2023 at 15:28

score 112 · Answer 4 · 2023-12-19 21:01:06

112

Views

How to use S3FS copy with recursive on folders?

Published on 19 December 2023 at 21:01

score 1.3k · Answer 5 · 2020-11-23 19:36:49

1.3k

Views

Can you use xr.open_mfdataset when reading files from S3 via s3fs?

Published on 23 November 2020 at 19:36

score 3k · Answer 6 · 2020-11-30 03:54:22

3k

Views

How to stream a large gzipped .tsv file from s3, process it, and write back to a new file on s3?

Published on 30 November 2020 at 03:54

score 789 · Answer 7 · 2020-11-30 17:27:05

789

Views

programmatically deleting parquet partitions from S3 bucket using pyspark

Published on 30 November 2020 at 17:27

score 1.3k · Answer 8 · 2020-12-04 02:57:30

1.3k

Views

Why do I get ConnectionResetError when reading and writing from and to s3 using smart_open?

Published on 04 December 2020 at 02:57

score 3.8k · Answer 9 · 2020-12-15 07:32:55

3.8k

Views

s3fs timeout on big S3 files

Published on 15 December 2020 at 07:32

score 1.7k · Answer 10 · 2022-04-08 18:28:36

1.7k

Views

Pandas 1.4.2 gives errors for installing s3fs while reading csv from S3 bucket

Published on 08 April 2022 at 18:28

score 676 · Answer 11 · 2022-04-15 09:03:44

676

Views

s3fs local filecache of versioned flies

Published on 15 April 2022 at 09:03

score 1.1k · Answer 12 · 2022-05-05 21:11:07

1.1k

Views

Read timeout in pd.read_parquet from S3, and understanding configs

Published on 05 May 2022 at 21:11

score 5.2k · Answer 13 · 2021-04-21 18:17:48

5.2k

Views

cannot import s3fs in pyspark

Published on 21 April 2021 at 18:17

score 1.7k · Answer 14 · 2021-04-28 04:28:52

1.7k

Views

use AWS_PROFILE in pandas.read_parquet

Published on 28 April 2021 at 04:28

score 585 · Answer 15 · 2021-04-29 21:33:04

585

Views

h5py slow when reading through an s3fs file object

Published on 29 April 2021 at 21:33

score 420 · Answer 16 · 2020-09-04 13:35:12

420

Views

Do I need to check integrity use pandas to upload and download file from s3?

Published on 04 September 2020 at 13:35

score 276 · Answer 17 · 2021-06-06 01:29:49

276

Views

Accessing S3 bucket object in TFX pipeline with S3FS

Published on 06 June 2021 at 01:29

score 210 · Answer 18 · 2022-12-12 13:34:47

210

Views

Want to create S3 Filesystem in python with stable library

Published on 12 December 2022 at 13:34

score 1.1k · Answer 19 · 2023-01-11 19:43:11

1.1k

Views

How to connect python s3fs client to a running Minio docker container?

Published on 11 January 2023 at 19:43

score 3.7k · Answer 20 · 2020-07-08 01:13:31

3.7k

Views

Attempting to Cache s3 files

Published on 08 July 2020 at 01:13

List Question

Cannot read parquet files in s3 bucket with Pyspark 2.4.4

S3FS fails when given aiobotocore session to initialize the File System

Making s3fs work alongside ProcessPoolExecutor

How to use S3FS copy with recursive on folders?

Can you use xr.open_mfdataset when reading files from S3 via s3fs?

How to stream a large gzipped .tsv file from s3, process it, and write back to a new file on s3?

programmatically deleting parquet partitions from S3 bucket using pyspark

Why do I get ConnectionResetError when reading and writing from and to s3 using smart_open?

s3fs timeout on big S3 files

Pandas 1.4.2 gives errors for installing s3fs while reading csv from S3 bucket

s3fs local filecache of versioned flies

Read timeout in pd.read_parquet from S3, and understanding configs

cannot import s3fs in pyspark

use AWS_PROFILE in pandas.read_parquet

h5py slow when reading through an s3fs file object

Do I need to check integrity use pandas to upload and download file from s3?

Accessing S3 bucket object in TFX pipeline with S3FS

Want to create S3 Filesystem in python with stable library

How to connect python s3fs client to a running Minio docker container?

Attempting to Cache s3 files

Trending Questions

Popular # Hahtags

Popular Questions