No. To exclude some pages only for the Algolia Crawler, you can leverage a robots.txt file with some specific rules for our user agent.
The free Netlify plan, doesn't include technical web support from the Support team.
Algolia DevCon - June 28-29, 2023
Discover the future of the AI Stack with Algolia, be the first to see new platform demos and announcements, and get the most out of Algolia through interactive workshops.
No. To exclude some pages only for the Algolia Crawler, you can leverage a robots.txt file with some specific rules for our user agent.
The free Netlify plan, doesn't include technical web support from the Support team.