The Algolia Crawler is available on the latest Algolia plans. You can review our current plan offerings and limitations on our pricing page.
If you want to use the Crawler to index a technical documentation site, you may want to consider our free DocSearch plan, which also comes with a search UI. You can apply for DocSearch by following the steps in our DocSearch guide: https://docsearch.algolia.com/docs/who-can-apply
If you use Netlify, you can also create an instant search on your site using our Netlify plugin. Here is a helpful QuickStart guide for Algolia on Netlify.