Haskell debugger does support post-mortem debugging (setting breakpoints on raised exception).
So it should be possible to drop into debugger on testing failtures, as pytest --pdb does it.
In principle you should load test runner in ghci/ghcid with exception breakpoints enabled, and somehow make test runner raise errors on test failure.
But I do not know how to do it in practice. Are there any known ways?