Free tool, no signup

Is AI reading your site?

Check whether ChatGPT, Claude, Perplexity and other AI crawlers are allowed to read a site, based on its robots.txt.

Result for
twitter.com
Blocked

This site's robots.txt blocks the major AI crawlers from reading it.

0 of 16 AI crawlers allowed
Does AI actually recommend you?
AI knows you, but won't recommend you
ChatGPT: Mentioned

Assistants mention this site, but don't put it forward as a top pick.

ChatGPT pointed buyers to
thryv.com techradar.com kompass.com

Prompt sampled: “find social media management tools” · a point-in-time sample of one assistant; answers vary by phrasing and run.

See the full report: all 3 assistants & who they recommend instead
Crawler Vendor Access
OAI-SearchBot OpenAI Blocked
ChatGPT-User OpenAI Blocked
GPTBot OpenAI Blocked
Claude-SearchBot Anthropic Blocked
Claude-User Anthropic Blocked
ClaudeBot Anthropic Blocked
Perplexity-User Perplexity Blocked
PerplexityBot Perplexity Blocked
Google-Extended Google Blocked
Meta-ExternalAgent Meta Blocked
Bytespider ByteDance Blocked
CCBot Common Crawl Blocked
Cohere Cohere Blocked
MistralAI-User Mistral Blocked
YouBot You.com Blocked
DuckAssistBot DuckDuckGo Blocked
Agent discovery
Signals that help AI agents find, read and reuse this site the way you intend.
  • Content Signals
    robots.txt declares how AI may use your content (search, ai-input, ai-train).
    Missing
  • Markdown for agents
    The homepage returns clean markdown when an agent asks for it (Accept: text/markdown).
    Missing
  • Link headers
    Response Link headers (RFC 8288) point agents to related resources.
    Missing
  • llms.txt
    A plain-text guide to your most important pages for AI assistants.
    Missing

This checks what your robots.txt allows, plus the discovery signals agents look for. llms.txt is reported for completeness; there's no evidence yet that it affects AI citations.

Allowed is not the same as reading you

robots.txt only says AI can read you. usrPeek shows whether GPTBot, ClaudeBot and PerplexityBot actually crawl your pages, and whether AI assistants send you visitors who convert.

See if AI is really reading your site