Check whether ChatGPT, Claude, Perplexity and other AI crawlers are allowed to read a site, based on its robots.txt.