Integrating Azure Log Analytics Workspace with Kafka: Azure LA -> Kafka

347 Views Asked by At

I have a centralised log analytics workspace in Azure and a use-case for streaming (or otherwise ingesting) all Log Analytics data in the centralised workspace to a kafka "data backbone".

My question is:

Are there recommended patterns for this specific use case?

I've done some research but found nothing out of the box in terms of kafka connectors or integration patterns for ingesting Azure log analytics data wholesale into Kafka directly.

(I suspect this is a rare use case)

1

There are 1 best solutions below

0
On

It appears the recommended integration pattern (from Microsoft) is via Azure data export to Azure storage account:

Data export in a Log Analytics workspace lets you continuously export data per selected tables in your workspace. You can export to an Azure Storage account or Azure Event Hubs as the data arrives to an Azure Monitor pipeline. This article provides details on this feature and steps to configure data export in your workspaces.

https://learn.microsoft.com/en-us/azure/azure-monitor/logs/logs-data-export?tabs=portal

(anecdotal: it appears this solution is acceptable to some enterprise customers)