Devpi-Postgres: Cannot upload large files

38 Views Asked by At

I am getting the following error while uploading files bigger than 1 GB to devpi using postgres.

pg8000.exceptions.DatabaseError: {'S': 'ERROR', 'V': 'ERROR', 'C': '54000', 'M': 'out of memory', 'D': 'Cannot enlarge string buffer containing 0 bytes by 1391196735 more bytes.', 'W': 'COPY files, line 1, column data', 'F': 'stringinfo.c', 'L': '303', 'R': 'enlargeStringInfo'}

Any idea how I could solve this issue ? Thanks

I have tried using the --max-request-body-size, and increased the max_wal_size in postgres, but keep getting the following error:

Update:

  • I using a python script along with twine to upload the files.
  • Postgres version 16.2.
  • The table definitions are generated by devPi.
  • Currently, the problem comes up while uploading a file which is about 1350 MBs large
0

There are 0 best solutions below