what are the numbers in the operation names when profiling an application

25 Views Asked by At

What are the numbers in "fusion_2", "fusion_4"? Where do they come from? Thank you!

JAX profiling

1

There are 1 best solutions below

3
jakevdp On BEST ANSWER

These numbers exist to de-duplicate the names of generated HLO operations. The first fusion operation created by the compiler is called fusion, the next is fusion_2, then fusion_3, and so on.

Note that the order of creation does not necessarily match the order of execution.