Findings · measured, dated, recomputable
When an AI answer engine crawls a site thousands of times, how often does it actually cite that site to a human?
| Verified ingestion fetches | 52,413 |
| Distinct URLs ingested | 52,333 |
| Days observed | 20 |
| Verified live-answer retrievals | 5 |
| Ingest : live-answer | 10483 : 1 |
| Search-bot identity claims that were forged | 3 of 7 (42.9%) |
Ingestion volume is not citation. These observations indicate that a site can be read exhaustively and continuously by an answer engine while almost never being retrieved to answer a person — and that crawler identity asserted in a user-agent string is sometimes asserted by something else entirely.
Every request is matched to the crawler operator's OWN PUBLISHED IP RANGES (openai.com/gptbot.json, chatgpt-user.json, searchbot.json). A user-agent claim from an out-of-range address is counted as forged, never as a visit. Ingestion crawlers and live-answer retrievals are counted separately because only the second indicates a person asked a question.
The files these figures were derived from, on the machine that published this page
/home/marcus/state/agent-visitor-log.jsonl
/home/marcus/state/aeo/openai-gptbot.json
Built 2026-10-30T22:17:03.185Z · JSON