Get started

Membership today. Pay Per Crawl when Cloudflare opens it to you.

Membership opens your portal immediately: a guided setup path, a yield estimate for your zone, and connect requests handled by Boson IT engineering. Cloudflare’s Pay Per Crawl is in closed beta and controls when crawlers can be charged on your zone; the guide below walks you through it when it arrives.


Three stages

Prepare, measure, go live.

01

Start membership

Your portal opens the moment checkout completes. Enter your zone and current flat rate to personalize your yield estimate.

Start membership · $200/mo

02

Enable Pay Per Crawl

Request beta access from Cloudflare if you have not already, then follow the six configuration steps below.

Request access · Setup guide

03

Shadow mode, then live

Request connect from your portal. CrawlYield measures alongside your static rate first; you choose when to switch to dynamic pricing.

Connect (members)


Pay Per Crawl setup guide

Enable it, set a price, choose who pays.

Six steps in the Cloudflare dashboard. Each one links to Cloudflare’s official site-owner documentation.

Closed beta

Request access from Cloudflare first.

Pay Per Crawl is currently a closed beta. If it is not yet visible on your account, request access below; Cloudflare will confirm by email when your account is admitted.

Request Pay Per Crawl access Cloudflare overview

01

Prerequisites

You need a Cloudflare account, the zone on Cloudflare DNS or nameservers, and Administrator or Super Administrator access for account-level settings.

Enable in account settings

02

Make the domain visible

Manage Account → Settings → Pay Per Crawl. In Domain Access, set Visibility to Visible for the zone you want to charge.

Visible is not the same as charging. Domain Access Visible only unlocks the controls. You start charging after you Enable and pick crawlers. Account settings

03

Enable and set a default price

AI Crawl Control → Payments → Enable. Set a default price per successful crawl. Cloudflare’s documented minimum is $0.001.

Set a pay per crawl price

04

Choose who to charge

AI Crawl Control → Security. For each crawler pick Charge, Allow, or Block. Do not charge or block search engines lightly — that can hurt how your site is indexed.

Select crawlers to charge

05

Monitor activity

AI Crawl Control → Metrics. Watch which crawlers hit you, how often they are charged, and whether anything looks off.

Accrued balance may not show in the dashboard yet — ask Cloudflare if you need a payout snapshot. Monitor activity

06

Connect publisher payouts

Manage Account → Settings → Pay Per Crawl → Connect. Cloudflare is merchant of record. You create a dedicated Stripe Connect account through that dashboard — an existing Stripe account will not work.

Manage payouts


Connecting CrawlYield

Shadow mode first. Live when you decide.

Once Pay Per Crawl is active, CrawlYield prices each request in the background and compares it with the static rate you already charge. Nothing changes in production until you switch to live pricing.

01

Start membership

Checkout takes a minute. Your portal opens immediately with a setup path that saves your progress.

Start membership · $200/mo

02

Enter your zone and flat rate

The hostname you want to price and the per-request rate crawlers pay today. This personalizes your yield estimate.

03

Request connect

Send a connect request from the portal. Boson IT engineering provisions the Worker and confirms shadow mode is measuring.

Connect (members)

04

Review, then go live

Compare shadow results with your static rate on real traffic. Switch to dynamic pricing when the numbers earn your confidence.


Ready when you are

Start today, or follow along first.

Membership is open now. If you would rather hear about product updates before subscribing, leave a work email.

Start membership · $200/mo Sign in

Questions? hello@bosonit.org


Common questions

Before you begin

Do I need Pay Per Crawl access before subscribing?

No. Membership opens your portal today. Pay Per Crawl determines when crawlers can be charged on your zone, and the setup guide above covers it when it arrives.

Who pays me for crawls?

Cloudflare. Crawler payments settle through Pay Per Crawl and the Stripe Connect account you create in the Cloudflare dashboard. CrawlYield membership is billed separately by Boson IT LLC.

Can I cancel?

Yes, at any time from the billing page in your portal. The 10% performance share applies only to measured yield above your baseline once you are live.