Using SAP BODS to load data to Snowflake it is taking a lot of time

512 Views Asked by At

Using SAP BODS to load data to Snowflake it is taking a lot of time.

BODS job is simple source (HANA table) query then Target as Snowflake table.

Just to load 6 records with 10 columns it is taking more than half an hour.

I analyzed where most of the time is going in checking metadata data. I tried updating the ODBC driver to 2.24.0 still loading time is high.

Observe select/insert takes very less but searching metadata is very time consuming:

Observe select/insert takes very less but searching metadata is very time consuming

2

There are 2 best solutions below

0
On

You can also enable ODBC logging to check if there is any specific Driver call that is taking the extra amount of time.

0
On

​Finally able to reduce time by very minimum by setting

CLIENT_METADATA_REQUEST_USE_CONNECTION_CTX='TRUE'

But still, all the target table columns are checked in db.schema, which is unnecessary now trying to find the answer.