You can absolutely verify and crawl the same domain from multiple Algolia applications and crawlers (ie: crawling your production domain from both your production application and a sandbox application).
After you add the application-specific verification codes to the domain's robots.txt file, the Crawler uses RegEx to look for the presence of the correct code throughout the entire robots.txt file without "stopping" if it encounters any additional verification codes from other applications .