crawlradar.xyz
LiveLast 30 days · real data, read-only
AI crawlers
Crawls
490
Pages crawled
231
56%
verified
Verification
- Verified274 · 56%Came from an address the vendor publishes for its crawler.Verified27456%
- Unchecked216 · 44%The vendor publishes no way to check, or the check could not be completed.Unchecked21644%
- Spoofed0 · 0%Claimed to be a known crawler from an address that vendor does not crawl from.Spoofed00%
5 verified · 0 spoofed · 0 unchecked
By crawler
Most-crawled pagesAI crawlers only. Search engines, SEO tools and CrawlRadar scans are counted under “Outside the AI funnel”.
- /robots.txt191Indexing: 84, Training: 101, Unclassified: 6
- /sitemap.xml106Indexing: 7, Training: 99
- /12AI answers: 1, Indexing: 11
- /login8Indexing: 6, Unclassified: 2
- /about7AI answers: 1, Indexing: 6
- /tools/geo-score-checker7Indexing: 7
- /crawlers/chatgpt-user7Indexing: 7
- /blog/answer-first-writing6Indexing: 6
- /blog/how-to-get-cited-by-chatgpt6Indexing: 6
- /blog/what-is-generative-engine-optimization6Indexing: 6
Engine coverageWhich answer engines fetched your pages this period, and what for. An empty row is an engine that can’t cite you yet. Google’s row covers NotebookLM and Vertex grounding; Googlebot is listed under general search.
| Engine | Answer fetches | Index crawls | Training crawls |
|---|---|---|---|
| ChatGPT | 4 | none | none |
| 1 | none | none | |
| Perplexity | none | 10 | none |
| Claude | none | none | 197 |
| Bing | none | 52 | none |
| Grok | none | none | none |
| CrawlRadar | none | none | none |
| Amazon | none | 128 | none |
| Apple | none | 79 | none |
| Moz | none | none | none |
| Ahrefs | none | none | none |
| Meta AI | none | none | none |
| Baidu | none | 6 | none |
| ByteDance | none | none | 3 |
| Semrush | none | none | none |
| Majestic | none | none | none |
Stray URLsURLs crawlers requested that your sitemap doesn’t account for. Not on your site: the URL fails to load — redirect it or let it 404. Not in sitemap: the page exists, but your sitemap doesn’t list it. The busiest are checked live on your site.
Checking your sitemap…
Outside the AI funnelEverything your collector saw that isn’t a citation signal. Counted here, never in the AI numbers above.
General search
Search engine crawlers like Googlebot and Bingbot. Google’s AI Overviews draw on this crawl, but no request shows which fetch fed an answer — so it’s counted, not credited.33SEO tools
Backlink and SEO crawlers. They index the web for their own products — no bearing on AI citations, but they do use crawl budget.98Unrecognised
Crawlers we couldn’t match to a known bot. They’re counted only here — nothing is guessed. Once identified, they move to the right group for every site.1,505AI traffic
Read by AI answersTimes an assistant — ChatGPT, Claude, Perplexity… — fetched one of your pages to answer someone’s question. Counted by the collector, whether or not anyone clicked.
5
2 assistants
Visits from AIVisits that arrived from an AI assistant’s answer, counted by the tag. Many assistants hide where a visit came from, so this is a floor, not a total.
0
of 49 visits tracked
Click-throughVisits from AI per answer that read your pages. Approximate: an assistant can send a visit without a live fetch, and many answers show no link at all.
0%
of answers led to a visit
This is crawlradar.xyz. See the same dashboard for your site.
Add your website