You can use Algolia's A/B testing tool to test different indexing settings and search parameters as described here https://www.algolia.com/doc/guides/ab-testing/what-is-ab-testing
If you're using Algolia's Magento 2 extension to index your data and build your search experience on your front end, you will need to take some extra steps to ensure that scheduled indexing via the extension is not going to cause problems with your A/B test set-up.
Things to consider while setting up your A/B test:
- Make sure to use a Standard Replica of your main
_productsindex, as Variant B in your test. - The replica's name prefix used for the variant B in your A/B testing is not arbitrary - it must differ from what Magento uses under Stores → Configuration → Algolia Search → Credentials and Basic Setup → Index Name Prefix. This will ensure that Magento does not interfere with the replica when performing indexing operations.
- It is recommended that you do not alter your Algolia configuration in Magento for the duration of the A/B test.
You can find more recommendations, regarding A/B testing best practises here: https://www.algolia.com/doc/guides/ab-testing/what-is-ab-testing/how-to/create-and-run-an-ab-test#recommendations
Lastly, please ensure that the extension version that you are using is the latest, as there have been a number of changes made to how the extension handles replicas in recent versions - https://github.com/algolia/algoliasearch-magento-2/releases, especially since 3.14.0 as documented here https://www.algolia.com/doc/integration/magento-2/troubleshooting/back-end-issues#migrate-to-granular-virtual-replicas .