I enabled adaptive using spark 3.1 but still see some long running tasks compared to other tasks. I tried to filter most frequent keys but it didn’t help and I am getting FetchFailedException at the end. There are several joins and group by executed.
Does adaptive always handle skew joins ? What can help with FetchFailedException?