Seeing the Web
Summary
A hands-on look at Cloudflare's new Crawl API and its relation to web archiving. The author tests how the crawler interacts with a static site, discusses implications for data delivery to ML models, and outlines observations and potential directions for future experiments.