Newsletter platform beehiiv has integrated Cloudflare’s AI Crawl Control tool directly into its dashboard, giving writers a straightforward way to decide whether AI crawlers can access their content. Duncan Riley reports for SiliconANGLE that the feature is rolling out to beehiiv’s roughly 135,000 publishers starting today.
Until now, blocking AI bots meant editing robots.txt files or writing firewall rules, technical tasks most independent creators never tackled. The new integration removes that barrier entirely.
What the dashboard shows
- Which AI crawlers are attempting to access a publication
- What is currently being blocked
- How much referral traffic each crawler sends back
That last data point sits at the core of the decision publishers now face. Allowing AI crawlers can bring discovery and traffic. Blocking them keeps content available for potential licensing deals. Writers can also mix approaches, blocking one crawler while allowing another, with a single click per crawler.
Cloudflare says its list of known crawlers updates automatically as new ones appear. The integration connects to Cloudflare’s application programming interfaces (APIs), the technical layer that links the two platforms.
The partnership fits into a broader Cloudflare strategy. The company switched on default AI-scraper blocking for new customers in 2025 and launched a Pay Per Crawl marketplace, where publishers can charge AI companies for access to their content. In January, it acquired data marketplace startup Human Native to strengthen its licensed-content tools.
Cloudflare co-founder and CEO Matthew Prince described the beehiiv deal as the next step in giving newsletter operators transparency and control over how AI companies interact with their work. Beehiiv CEO Tyler Denk framed it as a bargaining chip for writers at a moment when AI is reshaping how readers discover content.
Beehiiv takes no cut of subscription revenue and publishers retain ownership of their audiences, which makes the platform a notable foothold for Cloudflare in the creator economy.
Stay up to date
AI for content creation: the latest tools, tips and trends. Every two weeks in your inbox: