How AI agents fetched /review/screaming-frog-seo-spider/ on BlockSentient
Reporting period: May 18 – May 24, 2026 (Mon–Sun, 7 days)
Screaming Frog SEO Spider was fetched 88 times by AI agents this week, down from 165 the prior week (-47%), with ChatGPT-User accounting for 84 of those fetches.
Activity was distributed across all seven days, with daily counts ranging from 8 to 16. This pattern indicates established AI-agent awareness of the URL rather than event-driven discovery.
| Agent | Operator | Mode | Fetches | Share |
|---|---|---|---|---|
| chatgpt-user | OpenAI | Live retrieval | 84 | 95.5% |
| meta-externalagent | Meta | Training/index | 3 | 3.4% |
| oai-searchbot | OpenAI | Live retrieval | 1 | 1.1% |
Methodology: every AI agent fetch of the Screaming Frog SEO Spider review is logged by our servers and classified by its user-agent string. We distinguish live retrieval (a real user asked an AI chatbot a question, the chatbot fetched this page to answer it) from training/index (scheduled AI crawling for model updates). We publish a fresh AI Visibility report every Monday at 02:00 UTC, covering the most recent complete Mon–Sun week.
This weekly report is free and public. We're currently scoping a paid vendor product with historical trends, query-intent classification, and cross-site comparison.