Datapoints over the rooflines in Intel-Advisor run on Intel-processors

Question

I am using Intel-Advisor (2024.0 version) on top of a C++ program ran on one MPI-process and 20 OpenMP threads (and MKL threads because the program uses cblas_zgemv(...) from this library).

$ lscpu returns:

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              20
On-line CPU(s) list: 0-19
Thread(s) per core:  1
Core(s) per socket:  10
Socket(s):           2
NUMA node(s):        2
Vendor ID:           GenuineIntel
CPU family:          6
Model:               62
Model name:          Intel(R) Xeon(R) CPU E5-2680 v2 @ 2.80GHz
Stepping:            4
CPU MHz:             1197.097
CPU max MHz:         3600.0000
CPU min MHz:         1200.0000
BogoMIPS:            5585.91
Virtualization:      VT-x
L1d cache:           32K
L1i cache:           32K
L2 cache:            256K
L3 cache:            25600K
NUMA node0 CPU(s):   0-9
NUMA node1 CPU(s):   10-19
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm cpuid_fault epb pti intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear flush_l1d

The commands I ran to obtain the below graph are:

export MKL_NUM_THREADS=20
export OMP_NUM_THREADS=20

source ../../Intel_Advisor_install_dir/advisor/2024.0/advisor-vars.sh

mpirun advixe-cl --collect=survey --project-dir=advisor -- ./solver_intel.x
mpirun advixe-cl --collect=tripcounts --flop --project-dir=advisor -- ./solver_intel.x

I obtain that some datapoints are above the rooflines Intel-Advisor reports.

Is this possible or is it a bug I am seeing?

If yes, does anyone know why this is the case?

I was thinking of rooflines of the type FMA, but they do not come out from the Advisor analysis by any means ... Is there a way to make these appear on the plot?

Attached is a picture. Please observe the top green datapoints. I would be grateful for any insights into this. Thank you!

EDIT: At the moment, I am trying to run the second step of the data-collection as:

mpirun advixe-cl --collect=tripcounts --flop --enable-cache-simulation --project-dir=advisor -- ./solver_intel.x

EDIT2: Now, after the second step of the data collection, I do not get any datapoint above the rooflines: