AI crawler access
What the file says,
and what the page sends.
Paste any address and see what your robots.txt says for a curated, sourced list of named AI crawlers — OpenAI’s, Anthropic’s, Google’s and others — and whether the page’s own HTML carries readable text before anything runs. Both are things this tool can actually observe. Whether any system ranks, cites or prefers the page is not, and nothing here claims to know.
This tool works differently from the generator. The generator never uploads your image — it runs in your browser. The checker cannot: it fetches the public address you type, from our server, and reads that page’s robots.txt and its HTML. Only the address you enter is sent. The addresses you check are then kept in this browser, so it can tell you what changed since last time; they go nowhere, and you can clear them.
Questions
Which files does this read?
Two, fetched together: your robots.txt and the page itself. The rules that decide whether an AI crawler may read a page live in one and the directives on the page live in the other, and a report built from only one of them would miss the half that contradicts it.
Does a rule here actually stop an AI crawler?
This reports what your files say, not what any crawler does. robots.txt is a request honoured by convention rather than enforced, so a crawler that ignores it will not appear here. What the report can tell you is whether you have asked at all, and whether you asked clearly.