🤖 Patreon Starts Blocking AI Scraper Bots Instead of Just Asking Them to Stop
By Dillip Chowdary • Jul 17, 2026 • Source: TechCrunch
Patreon has stopped politely asking AI crawlers to stay away and started slamming the door. The creator platform is now actively blocking AI training bots using Cloudflare's AI Crawl Control, replacing a robots.txt approach that scrapers had simply learned to ignore.
The results were stark: in testing, weekly access attempts from AI crawlers dropped “from thousands of attempts to zero,” a gap that shows just how little the old honor-system defenses were doing. Patreon's framing is blunt — “consent shouldn't depend on whether a scraper chooses to behave” — a direct shot at the robots.txt model that has governed crawler etiquette for decades.
Two things pushed the change. Scraping has grown far more sophisticated since 2023, and Patreon's newer surfaces — its Home Feed and short-form Quips — expose more creator content to anything crawling the site. Left unguarded, that's a rich, freely harvested training set built from work creators are actively being paid for.
Crucially, Patreon isn't blocking everything. It still welcomes indexing bots that drive traffic back to creators, while cutting off crawlers whose purpose is to harvest content for model training. That distinction — discovery good, unlicensed training bad — is quickly becoming the default posture for content platforms deciding how to live alongside AI.
Key details
- The change: Patreon moved from robots.txt requests to active blocking via Cloudflare's AI Crawl Control.
- The result: Weekly AI-crawler attempts fell from thousands to zero in testing.
- The trigger: More aggressive scraping since 2023, plus new surfaces like the Home Feed and Quips.
- The nuance: Indexing bots that send traffic back are still allowed; training scrapers are blocked.
Why it matters
The robots.txt honor system is quietly dying. As platforms like Patreon move to enforce consent at the network layer, the fight over AI training data is shifting from politely-worded files to hard technical blocks — and creators, not crawlers, are starting to hold the leverage.
Source: TechCrunch. Reporting cross-referenced by Tech Bytes on Jul 17, 2026.
🔎 More interesting news
- Apple Intelligence Wins China Approval, Powered by Alibaba's Qwen
- Amazon Races to Fix an AWS Billing Bug That Showed Charges in the Billions
- Zoox Recalls Robotaxi Software After a Car Was Confused by Heavy Smoke
- San Francisco Orders Apple and Google to Pull 'Nudify' Apps From Their Stores
- Today's full Tech Pulse briefing →