MLRun, Issue with view to REST API throughput

95 Views Asked by At

How does it possible to identify throughput in MLRun solution (I use MLRun 1.3.0 with Iguazio version 3.5.2)?

I am using MLRun real-time function 'nuclio-risk-sentiment' and I would like to see request/response time of MLRun.

It is easy to see e.g. view to the Memory, CPU, Network I/O usage (see the board in grafana 'private / Kubernetes Pods'):

Grafana

Do you know where to see the duration of the response/request (real throughput)?

1

There are 1 best solutions below

0
On BEST ANSWER

The Iguazio uses for monitoring standard technology stack Prometheus and Grafana, it means, it is possible to see performance of NGINX (web server in Iguazio).

Grafana dashboard see 'private / NGINX - Request Handling Performance' and view to the 'Total request handling time':

Total request handling time