Why does the Crawler block reindexing with "The difference between the number of records is too large"

This is a safety check designed to prevent the loss of valid records. The threshold is set via the maxLostRecordsPercentage config option. If you are getting this error after making changes to your site and not changing the crawler config, that is likely the source of the error. You need to update your config to match your new DOM.