Negative smoke tests / defect seeding for validating PACT implementation

70 Views Asked by At

We're implementing Pact framework for testing couple of microservices (Scala Backend & iOS-Android Frontend). So to test the Pact implementation itself, what sort of negative tests / defect seeding we can do to make sure that - the implemented Pact is catching what it supposed to catch? i.e. once our Pact work’s complete we’re thinking to do defect seeding & see if errors like Query parameters, API response structure change , spelling changes in API paths etc are getting caught correctly by the PACT or not? So on that line what other -ve tests & defect seeding, could we run on the implemented PACT framework? viz- Checklist for smoke test / exploratory tests to quickly test implemented PACT framework before its launched to live.

Thanks

1

There are 1 best solutions below

3
Matthew Fellows On

Pact is not really designed for those types of tests. It can be done, but the extra variations in data often becomes an issue for providers [1].

There is a proposal to be able to "annotate" interactions by adding arbitrary labels for purposes such as this. If you'd like to add your thoughts to https://github.com/pact-foundation/pact-specification/issues/75 that would be helpful.

  1. https://docs.pact.io/consumer#use-pact-for-isolated-unit-tests