Domain verification issue

There is a number of different ways you can verify your domain before being able to use our Crawler listed on our documentation:

•  https://www.algolia.com/doc/tools/crawler/getting-started/create-crawler#verify-your-domain.
   

If you are having issues verifying your domain, for instance, the platform you are using prevents you from updating the robots.txt file, you can contact the Algolia support to manually add the domains for you.