I'm running a couple of instances of pytest.main() and once they are all complete I want to quickly see the failures across all the runs without rooting through all the individual reports. How can I do that?
Do I have to parse the textual reports or can I get py.test to return an object with failure data? (so far as I've seen it just returns an integer)
I use Allure reports (https://docs.qameta.io/allure/#_pytest) for that.
You can run each pytest.main() with option --alluredir= where each instance has different path, for example /path/to/reports/report1, /path/to/reports/report2.
After all runs are completed, you can generate one combined report by running command allure serve /path/to/reports. More about reports generating here: https://docs.qameta.io/allure/#_get_started