New: see if ChatGPT, Perplexity and Claude can read your pages. Scan your site free →
Indexidia
AI Crawler Radar

What AI crawlers are doing right now

Real requests from sites that use Indexidia and logs people chose to share. Anonymous totals only. Updated hourly.
Add your log
Live
AI crawler requests
171,572
last 30 days
aAmazon62,121
GGoogle43,030
◆Microsoft21,408
Apple16,907
This week
76,811−9.8%
against the week before
Read for a person
1%
ChatGPT-User, Perplexity-User, Claude-User
Fake bots
0.1%
of requests we could check
Sites counted
1
tracked sites and shared logs
Sep 25Sep 30Oct 5Oct 10Oct 15Oct 20Oct 24

Every crawler

last 30 days
CrawlerPurposeRequestsWeek changeFake
a Amazonbot
Alexa answers
Search62,121+104.7%0%
G Googlebot
Google Search and AI Overviews
Search43,030−71.2%0.2%
◆ Bingbot
Bing, ChatGPT search and Copilot
Search21,408+44.8%0%
Applebot
Siri and Spotlight
Search16,907−54.5%0%
✳ PerplexityBot
Perplexity answers
Search15,237−72%0%
◎ OAI-SearchBot
ChatGPT search
Search8,904+44.4%0.1%
◎ ChatGPT-User
ChatGPT reading a page for a user
User request1,651+27.5%2.4%
✺ ClaudeBot
Anthropic model training
Training941+7641.7%–
B Bytespider
ByteDance model training
Training653−99.2%–
C CCBot
Open dataset used by many AI models
Training361−100%–
D DuckAssistBot
DuckDuckGo AI answers
Search137+30.8%–
✺ Claude-User
Claude reading a page for a user
User request107−16.4%–
◎ GPTBot
OpenAI model training
Training95+1366.7%6.3%
∞ meta-externalagent
Meta AI
Training18+400%–
✺ Claude-SearchBot
Claude search
Search2––

How we count

  • A request is counted when its user agent names a known AI or search crawler.
  • "Fake" means the request used a crawler's name from an address its company does not use (checked against published IP lists or reverse DNS). Crawlers with no published list are not checked.
  • No page addresses, IP addresses or site names are ever shown. Sites are counted only as totals.

Scan your site free

Just your domain. We find the pages Google is likely to skip. About 10 seconds.