AWS S3 file upload - 1 gb file

990 Views Asked by At

I am trying to upload large files (less than 5 GB, hence not multipart upload, normal upload) using java sdk. Smaller files gets uploaded in no time. but files which are above 1 MB, doesnt upload. My code gets stuck in the lince where actual upload happens. I tried using transfer manager (TransferManager.upload) function, when I check the number of bytes transferred, it keeps transferring more than 1 MB and keeps running until I force stop my java application. what could be the reason, where am I going wrong. same code works for smaller files. Issue is only with larger files.

DefaultAWSCredentialsProviderChain credentialProviderChain = new DefaultAWSCredentialsProviderChain(); TransferManager tx = new TransferManager(credentialProviderChain.getCredentials()); Upload myUpload = tx.upload(S3bucket,fileKey, file);

        while(myUpload.isDone() == false) {
            System.out.println("Transfer: " + myUpload.getDescription());
            System.out.println("  - State: " + myUpload.getState());
            System.out.println("  - Progress: "
                    + myUpload.getProgress().getBytesTransferred());
        }

s3Client.upload(new PutObjectRequest(S3bucket,fileKey, file));

Tried both transfer manager upload and putobject methods. Same issue with both.

TIA.

0

There are 0 best solutions below