I am running a DataBrew recipe job on a pipe-delimited file and received this error: ValueError: Could not parse datatype: decimal(1,-3317)
I have successfully run this DataBrew job with similar files (i.e., files from the same client) many times and have never had this error before. I have also manually inspected the file and the data types of all the columns are no different than previous months.
A Google search has provided me with few helpful answers and hence, I wanted to know if anyone had an idea why this error is being raised?
Thanks in advance.
I used to see this issue for values with negative exponents on it like
1.23456e-78
. This issue is no longer happening, probably it is fixed.