If your reindexing gets blocked because of the error, "The difference between the number of records: from: 29.8k to: 0 is too large (100 %)", it is because the crawler has noticed a large difference between the number of records that have been most recently crawled and the number that were originally available.
You can try the following solutions:
- Re-run the crawler to see if the error persists. You can do so by clicking the “Cancel” button and retrying.
- You can use the
aggregateContent: true
option during crawling to help get rid of the error. Here’s a link to the documentation around it: Record Extractor | DocSearch by Algolia. - You can set the 'maxLostRecordsPercentage' higher in your configuration. This documentation may be helpful to understand the issue.
The free DocSearch plan, doesn't include technical web support from the Support team. For further assistance, you can post your question on the Algolia Community Forum or Discord. For front-end issues, you can raise the issue directly on GitHub. In addition, you can review our DocSearch Documentation and FAQ.