Does theregister.com allow AI crawlers?
Live robots.txt, llms.txt, and ai.txt verdict for theregister.com. We report stated policy, not enforcement.
Machine-readable JSON/api/ai-crawler-access/site?domain=theregister.comFAQ
- Does theregister.com block GPTBot?
- The verdict above reads theregister.com's live robots.txt for OpenAI's GPTBot. We report the stated policy in robots.txt, not whether the bot honors it. Compliance is voluntary.
- What does "partial" mean?
- Partial means theregister.com disallows the bot from some paths but not the site root. Blocked means the root is disallowed. Unknown means the robots.txt could not be read.
- How fresh is this?
- TensorFeed re-crawls each tracked domain on a weekly rolling cadence. The last-checked time is shown with the verdict.