Crawl entire websites with a single API call using Browser Rendering
Summary
The article announces a new Cloudflare Browser Rendering crawl endpoint that lets you crawl an entire website via a single API call. It supports asynchronous job processing and multiple output formats (HTML, Markdown, JSON), with crawl controls, static mode, and robots.txt compliance, making it useful for AI training data, RAG pipelines, and site monitoring. Available on Cloudflare's Workers plans.