Flaky test report on on TestMatrix completion after Firebase Test Lab run

308 Views Asked by At

Where is possible to see the list of tests marked as FLAKY from firebase test LAB?

I'm using:

functions.testLab.testMatrix().onComplete(testMatrix => {})

to receive the TestMatrix object and

--num-flaky-test-attempts=int

because they say:

Specifies the number of times a test execution should be reattempted if one or more of its test cases fail for any reason. An execution that initially fails but succeeds on any reattempt is reported as FLAKY.

In the documentation there is this part: enter image description here

But there is no reference to the test marked as Flaky. Where we can see the list of tests flaky?

In the TestMatrix object received as an output on onComplete, there is also no reference for flaky tests.

1

There are 1 best solutions below

0
On

Unfortunately, flaky outcome is not reported at the matrix level at this point. The flaky results are shown in History, Device, and Test Case views.

History view: history view

Test Case view: test case view

Device view: device view