# AI crawler analytics: know if AI can find your website > Know if AI can find and recommend your website: which AI crawlers visit, the traffic ChatGPT, Perplexity, Gemini and Claude send you, and what to fix. CrawlRadar is AI search analytics: see which AI bots crawl your site and which visitors AI assistants send you, so you know what to fix. - [Add your website](https://www.crawlradar.xyz/dashboard/new) - [Live demo](https://www.crawlradar.xyz/demo): CrawlRadar's own dashboard for crawlradar.xyz, real data. ## What Google Analytics can't show you AI crawlers don't run JavaScript, so your analytics never sees them. - **Which AI bots crawl you.** GPTBot, ClaudeBot, PerplexityBot and the rest, by page and by day. Verified against each vendor's IP ranges, so spoofed bots don't count. - **What stops them.** A 0–100 score for every page from 14 checks, with blockers flagged first and fixes ranked by impact. - **How many visitors AI sends.** Visits from ChatGPT, Perplexity, Gemini, Claude and Copilot, and the pages they land on. Most analytics file them as direct. ## Live in 2 minutes 1. **Add your website.** Enter your domain. Sign in with Google or email. 2. **Paste two snippets.** A tag for AI traffic, a collector for crawlers. Or install the WordPress plugin. 3. **Watch and fix.** AI crawls and visits show up live. Fix what is flagged. ## Why AI skips pages that rank fine on Google Google links to your page. AI has to quote it. Three problems cause most misses. - **The answer is buried** (13 points at stake). AI quotes the first passage that answers the question. An intro that restates it gives the engine nothing to lift. - **The paragraph does not stand alone** (10 points at stake). Answers are built from chunks, not pages. A paragraph that opens with a bare pronoun makes no sense on its own, so it never gets quoted. - **The page is invisible** (8 points at stake). A robots.txt rule, a stray noindex, or content that only renders in JavaScript. Fixable in minutes, fatal until then. ## A score you can check 14 checks, every weight published: 25 points for access, 15 for trust, 60 for a passage worth quoting. [Every check and its weight](https://www.crawlradar.xyz/checks). ## Every major AI crawler, by name Logged when they visit, checked against your robots.txt. - `GPTBot`: OpenAI model training - `OAI-SearchBot`: ChatGPT Search index - `ChatGPT-User`: ChatGPT live page fetch - `ClaudeBot`: Anthropic model training - `Claude-SearchBot`: Claude search index - `Claude-User`: Claude live page fetch - `anthropic-ai`: Anthropic (legacy token) - `PerplexityBot`: Perplexity search index - `Perplexity-User`: Perplexity live page fetch - `Google-Extended`: Gemini training and grounding (not AI Overviews) - `CCBot`: Common Crawl (feeds many models) - `Bytespider`: ByteDance model training - `Amazonbot`: Amazon (Alexa answers, may train models) - `Applebot-Extended`: Apple Intelligence training What each one does, and which you can safely block: [the AI crawler directory](https://www.crawlradar.xyz/crawlers). ## Hey, it's Iliass. Here is why this exists SEO and analytics tools measure a search box people use less every month. None of them tell you whether OAI-SearchBot can reach your pages, or whether ChatGPT sent you anyone last week. CrawlRadar measures what can be observed: the crawls, the AI visits, and whether a page can be read. Then it hands you the fix, not just the finding. **No tool can promise you citations.** CrawlRadar shows you what it can prove, and says so when a signal is unproven. — [Iliass El Barhoumi](https://www.crawlradar.xyz/about), founder of crawlradar This page scores 91 on CrawlRadar's own engine. Every public page on this site must clear 85, or the build fails. ## Simple pricing. Free for 14 days. From $9 a month. Every feature on both plans, and AI crawls never count toward your bill. - **Starter**: $9 a month for 1 website. - **Growth**: $19 a month for 10 websites. Both are priced on human pageviews. 14-day free trial with no card, 30-day money-back guarantee. Launch offer: code PH20OFF takes 20% off the first 3 months. [Full pricing](https://www.crawlradar.xyz/pricing). ## Frequently asked questions ### What does CrawlRadar do? CrawlRadar tells you whether AI can find, read and recommend your website. It shows which AI crawlers visit your site and which pages they fetch, counts the visitors ChatGPT, Perplexity, Gemini, Claude and Copilot send you, and scores each page 0–100 on whether an answer engine can use it, with the fixes ranked by impact. ### How do I know if ChatGPT is sending me traffic? Add your website and install the tracking tag, one script tag in your site header. It recognises visits that arrive from AI assistants, which most analytics tools file under direct or unknown, and shows them by assistant and by landing page. The AI crawler collector is a separate snippet that shows the crawls that come before those visits. ### How much does CrawlRadar cost? Starter is $9 a month for one website and 10k pageviews; Growth is $19 a month for 10 websites. Both scale with your monthly pageviews, extra websites on Growth are $2 a month each, and yearly billing gives you 3 months free. AI crawler visits never count toward your plan. ### Is there a discount right now? Yes: code PH20OFF takes 20% off your first 3 months on every plan, for our Product Hunt launch. On yearly billing that is 20% off your first year. Checkout applies it for you, after the 14-day free trial. ### Is there a free plan? No, there is a 14-day free trial of everything, with no card. The free tools stay free with no account: the GEO score checker, the AI crawler checker, the llms.txt and schema generators, and the Chrome extension. ### Do I need a credit card for the trial? No. You add your website and sign in with Google or email, and the 14 days start there. Nothing is charged when the trial ends, because there is no card on file: you pick Starter or Growth with your own numbers in front of you. ### What counts as a pageview? A page a person loads on a website where the tracking tag is installed. AI crawler visits reported by the collector are never counted, on any plan, so a spike from GPTBot or ClaudeBot cannot change your bill. ### What if I go over my pageviews? We keep tracking and email you to suggest the next tier. Nothing is charged automatically, and nothing stops recording because your site had a good month. ### How is GEO different from SEO? SEO optimises for a ranked list of links; GEO optimises for being quoted inside a generated answer. The overlap is real but partial: a page can rank first on Google and still be unusable to ChatGPT because its answer is buried under three paragraphs of setup, or because robots.txt blocks OAI-SearchBot. ### Does blocking GPTBot in robots.txt stop ChatGPT citing me? No. OpenAI documents GPTBot as its model-training crawler. ChatGPT Search cites pages crawled by OAI-SearchBot, a separate token with its own robots.txt rule, so a site can block GPTBot and still be cited. Blocking OAI-SearchBot is what removes you from ChatGPT Search, and CrawlRadar flags that as a blocking issue rather than a scoring deduction. ### What exactly does the score measure? 14 checks across three levers: whether a crawler can retrieve the page at all (25 points), whether the source reads as trustworthy and current (15 points), and whether there is a passage worth lifting and quoting (60 points). Every weight is published. The heaviest single check is answer-first structure at 13 points. Every weight is the same on every plan, and the free scan runs the identical engine. ### Does CrawlRadar run JavaScript when it scans a page? No, and neither do the crawlers. The server fetches your HTML once, as an unauthenticated crawler, and never executes the page’s JavaScript. That is deliberate: most AI crawlers do not execute JavaScript either, so what CrawlRadar parses is what they actually see. The render-dependency check exists to tell you how much of your page only appears after JavaScript runs. ### Can I scan staging sites or pages behind a login? Yes, with the Chrome extension. It scores the page in front of you, in your browser, using the session you are already signed in with, so staging sites, drafts in your CMS and pages behind a login all work. The web scanner cannot reach those, because it fetches from our server as an anonymous crawler would. ### What does the Chrome extension send to your servers? Nothing about the pages you scan. The scoring engine runs on your machine, results are held only while the popup is open, and no page content, URL or score is transmitted, whatever your plan. The extension requests activeTab and scripting at install and no host permissions, which is why Chrome shows no site-access warning. ### Do the AI checks cost extra? No, and they run on your own API key. You paste an OpenAI, Anthropic or Perplexity key into the extension, it is stored locally in your browser, and the calls go straight from your browser to that provider. CrawlRadar never receives the key and never sees the bill, which is also why those checks are included rather than metered. ### How do I see which AI crawlers actually hit my site? You install the collector. AI crawlers such as GPTBot do not run JavaScript, so no analytics tag sees them. The only way to observe an AI crawl is from your own request path. CrawlRadar generates three snippets for that: a Cloudflare Worker, a Next.js middleware and a Node/Express handler. Each hit is then checked against the vendor’s published IP ranges and reported as verified, spoofed, or unchecked when nobody could tell. ### Can I audit a whole sitemap? Yes. Point CrawlRadar at a sitemap and it scores every URL in one run, up to 100 on Starter and 500 on Growth, then ranks the whole site by points recoverable so you know which pages to fix first. ### What happens if I cancel? You keep your plan until the end of the period you already paid for, and there is no exit fee. Your data is kept for 30 days after you leave, and if you cancel within 30 days of your first payment you get a full refund. ### What do you store, and is CrawlRadar GDPR compliant? For an account we hold an email address, a plan status, the scans you saved, and for each website you add, the pageviews its tag reports and the crawls its collector reports. The tag has a cookieless mode. A scan you do not save is never written down, and the extension keeps results only while its popup is open. We do not sell data, share it with advertisers, or run advertising, fingerprinting or cross-site tracking. ## Scan any page from Chrome Score the page you're on, even staging or behind a login. No site access requested, nothing sent to us. [Install the Chrome extension](https://chromewebstore.google.com/detail/crawlradar-ai-seo-checker/lmcjapacpcbakmehggpnjofhofjdmaib). ## More for agents - [llms.txt](https://www.crawlradar.xyz/llms.txt): every public page, one line each. - [AGENTS.md](https://www.crawlradar.xyz/AGENTS.md): how to read this site and how to help someone set up CrawlRadar.