How to import external library py7zr into AWS Glue Job?

71 Views Asked by At

I am working with AWS Glue. A 7z file must be extracted from S3 and subsequently transformed and loaded the lines of a resulting .txt into an RDS database. I need to use the py7zr library to be able to extract the file.

I already imported py7zr as external in the Glue Job configuration in my CloudFormation template. However, it forces me to import the other libraries it depends on, and I'm mainly having problems with the pybcj library, but I have the following error:

pybcj error

This is how I have configured the parameters of my glue job, I also have the --extra-py-files where I declare the s3 repositories of py7zr and and other of its dependencies:

Default Arguments

--additional-python-modules seems to have no effect. Could you tell me how I can import py7zr and all its dependencies successfully? Thanks.

0

There are 0 best solutions below