Is that really GPTBot? How to verify AI crawlers in your logs
DEV · 13.11.2026 · 21:58
Open any access log today and you'll see GPTBot, ClaudeBot, PerplexityBot and friends. The problem: a user agent is just a string. Anyone can send User-Agent: GPTBot from a $5 VPS, and…