Skip to main content

Algolia DevCon - June 28-29, 2023

Discover the future of the AI Stack with Algolia, be the first to see new platform demos and announcements, and get the most out of Algolia through interactive workshops.

REGISTER FOR FREE DON'T SHOW AGAIN
×
Algolia Help Center home page
Support policies Algolia Academy Status
Sign in
  1. Algolia
  2. Crawler
  3. Crawler: FAQs

Crawler: FAQs

  • Why the number of records in .bak index is not the same as the primary index?
  • What is a "SafeReindexingError" (Crawler)?
  • Is there a reason the .bak index would show 0 records even when the main index has records?
  • How do I unblock my Crawler?
  • Why doesn't the automatic Crawler validation work?
  • Where do I find my crawler-api-key?
  • Where do I find my crawler-user-id ?
  • Is there a free crawler option?
  • How can I index to multiple indices in one crawler?
  • How can I split my crawled data?
  • Do we have a way of tracking external links that are broken using the Crawler?
  • What happens if I pause the Crawler?
  • How long will it take to index Zendesk article when first connecting?
  • How can I crawl a page without indexing it?
  • How do I troubleshoot the crawler?
  • Why does the Crawler block reindexing with "The difference between the number of records is too large"
  • How can I remove specific text from the crawler attribute?
  • Why is my page not indexed by the crawler even though it was processed?
  • Is there a way to ignore a redirect?
  • Why is the crawler admin saying that I have been blocked?
  • What are the Crawler technical limitations?
  • « First
  • ‹ Previous

Enable anyone to build great Search & Discovery

Start free >_Get a demo >_

  • Privacy policy
  • Terms of service
  • Acceptable use policy
  • Anti-Modern Slavery Statement
Algolia mark white ©2024 Algolia - All rights reserved.