The Algolia Crawler is available on all Algolia plans including the free Build plan:
Build: 10,000 free crawls/month
Grow: 10,000 free crawls/month, after that $0.80 per 1,000 crawls
Additional information on the crawler Pricing can be found on the Algolia Pricing Page
If you want to use the Crawler to index a technical documentation site, consider DocSearch, which also comes with a search UI. If you use Netlify to host your website, use the Netlify Crawler plugin:
1) If you meet the criteria, you can apply for our DocSearch feature. This is a great solution for technical blogs and open-source projects for technical documentation.
2) - You can create a Netlify account (if you don't have one already) to create an instant search on your site using our plugin. Here is a helpful QuickStart guide for Algolia on Netlify