Cloudflare is launching a new marketplace that reimagines the relationship between publishers and AI companies.

Cloudflare’s Pay-Per-Crawl is a clever idea. It’s the first genuine attempt to attach a meter to data before it gets ...

CEO Matthew Prince unveils powerful new tools to block AI companies from freely scraping web content, a move that could ...

A report published by the French developer community site Developpez.com has revealed that the chatgpt agent from openai has ...

Google declined Ars' request to confirm whether talks were underway or if the company was open to separating its crawlers.

07-14-2025 TECH The era of free AI scraping may be coming to an end Cloudflare takes a stand on AI crawlers, which could enable publishers to finally make peace with the bots scooping up their ...

Roughly 16% of global internet traffic goes directly through Cloudflare's CDN, the firm estimated in a 2023 report. "AI crawlers have been scraping content without limits. Our goal is to put the ...

Starting Tuesday, every new web domain that signs up to Cloudflare will be asked if they want to allow or block AI crawlers. At least 16% of the world's internet traffic gets routed through ...