What impacts indexing time in Magento?

How frequently and how much data you are indexing will affect the indexing time in Magento. 

To improve indexing time, check if  you are using the indexing queue.

You may also want to review this article on build time: What impacts build time?

The extension helps you control how many jobs to send to Algolia, but once those are sent, the build time may vary.