I have few TBs of TS data in parquet and csv files, I need to upload them to adx table is there any efficient or faster ways.
(this data ingestion is one time thing)
I tried Queued ingestion in SDK but found out the Max size of Queue is 6GB and it takes around 5min to upload 1gb data.
One possible way would be to upload your data to plain blob storage and set an Event Subscription "on create". Link the Subscription to an Event Hub and connect your ADX db to this Event Hub in the Azure portal. Your data will be ingested automatically once you upload it to the blob storage.