If you selected an x/y split and it isn't reflected in the searches or users for each variant, check the following:
- How is a variant's search performing? It could be worse than expected, and your users are struggling to find things.
- Is there unexpected traffic? Algolia attempts to identify and ignore any unusual data (outliers) when calculating A/B test results. However, bots could still be affecting the A/B test. Ensure you turn off A/B testing before investigating unexpected traffic by setting enableABTest to false.
Please note, the results should be considered unreliable if you see a difference higher than 20% from the expected number.