There are a couple of options if you encounter this error:
1. You can re-run the crawler to see if it continues. You'll need to click “Cancel” and retry.
2. If you have removed the login wall but still try to login, the request fails since there is no login page anymore. You can remove the password field in your Netlify site configuration and the crawler won’t try to login anymore.
The free Netlify plan, doesn't include technical web support from the Support team.