My team is working on various options to pipeline data out of a Log Analytics Workspace. But in the meantime I need to run some analyses on the data so am striving to export the data directly. How can I export the whole table instead of just the first 30K rows of the query? (If it were like a few hundred K rows i'd do windowing/paging but it's a few million rows so that is too unwieldy.
Log Analytics workspace has the limit of only 30000 rows. To achieve your requirement, you can try Azure Data explorer as a workaround.
Create an ADX cluster and go to the Query tab. Create a Log analytics workspace connection like below.
Follow this documentation for step-by-step process of this.
ADX also, has 500000 rows limitation. To overcome it, use
set notruncation;in query and now you can query your log analytics table and export the required amount of data like below sample.Check this documentation to know more about this.