Analyzing crawl logs
See which search and AI crawlers reached your pages, and what each one got back. Use it to prove a bot took your content, or to find where it didn't.
Who crawls your site and what they get back
Every visit from Googlebot, GPTBot, ClaudeBot and the rest, with the status and response each one received.
Read your crawl log
Check which crawlers reached your site in the last 30 days, which pages they took, and what each visit returned.
Confirm a bot got your content
Check a single page: which bots fetched it, what they received, and whether the snapshot they got was complete.