I'm seeing some strange things on a currently running experiment.
- The Observed Conversion Rate is noticeably higher on the Original, however Optimize's analysis is that the variant is more likely to be best. What should I trust here?
- The Modeled Conversion Rate seems also way off, with a median CR of 1.2% (original) and 1.3% (variant). Why would the model overshoot reality so much?
Thanks for your guidance!