The Agentic Web Index
Summary
The Agentic Web Index analyzes bot traffic across 5,000+ websites, detailing AI scraping, AI fetching, and robots.txt compliance. It highlights an active spoofing campaign impersonating AI bot identities to probe for vulnerabilities and credential paths, and provides insights into top agent types, spoofed identities, and robots.txt effectiveness.