CrawlYield

For publishers on Cloudflare Pay Per Crawl

A flat ¢ donates revenue to crawlers.
CrawlYield recovers the gap.

AI crawlers are not one buyer. Demand is not one hour. Your hubs are not your stubs. We price crawler access by demand, crawler identity, and content type — then you keep what a static price leaves on the table.

$200/mo platform 10% take on incremental yield Shadow-mode first
Join the waitlist Run the counterfactual

Counterfactual

See the number a flat ¢ hides.

Crawls per month, your static ¢, and an expected lift. The ledger is local — no account, no backend. Industry-typical, not a promise.

¢ prices of 0.1–0.5 are a common public range for pay-per-crawl experiments — illustrative, not a quote. Lift is an input you set, not a guarantee. Take is 10% of the incremental gap only. Platform is $200/mo.

Your picture

Flat baseline $150
Dynamic revenue $195
Yield gap (incremental) $45
CrawlYield take (10%) $4.50
Platform $200

Bar: flat baseline · you keep of the gap · 10% take

After take, you keep $40.50 of the gap. Subtract the $200 platform and the monthly net versus staying flat is −$159.50.

Industry averages · illustrative

Public framing — not a publisher’s books.

These figures come from Cloudflare’s published industry view. They are averages and worked examples, not CrawlYield customer results and not a guarantee of lift.

Cloudflare Radar · 2025

~4%

AI bots averaged about 4.2% of HTML requests in 2025 (range 2.4–6.4%). A small slice of traffic — and a large slice of unpaid extraction.

Source: Cloudflare Radar Year in Review

Typical PPC ¢ · public range

0.1–0.5¢

Pay Per Crawl prices operators discuss in public commonly sit in tenths of a cent. A static ¢ is easy to set and easy to get wrong across hubs, archives, and stubs.

Illustrative market range, not a quote or SLA.

Cloudflare Radar · crawl-to-refer

100s : 1

Training-heavy bots often crawl hundreds to thousands of pages for every referral click. Anthropic’s July 2025 ratio was still tens of thousands to one; OpenAI sat around a thousand to one.

Source: Cloudflare: the crawl-to-click gap

Worked example

150k crawls × 0.1¢ = $150 flat. Thirty percent lift is $45.

Same ¢, same lift, three volumes. The gap scales linearly. Platform stays $200; take stays 10% of the gap — never of the baseline.

Assumes 0.1¢ static price and ~30% lift. Industry-typical math, not a specific publisher.
AI crawls / mo Flat (0.1¢) Dynamic (~30%) Gap 10% take
50,000 $50 $65 $15 $1.50
150,000 $150 $195 $45 $4.50
500,000 $500 $650 $150 $15.00

50,000 crawls / mo

Flat at 0.1¢
$50
Dynamic ~30%
$65
Gap
$15
10% take
$1.50

150,000 crawls / mo

Flat at 0.1¢
$150
Dynamic ~30%
$195
Gap
$45
10% take
$4.50

500,000 crawls / mo

Flat at 0.1¢
$500
Dynamic ~30%
$650
Gap
$150
10% take
$15.00

On your existing Cloudflare path

Price the crawl. Keep the floor. Charge the difference.

01

Read the buyer

Each request carries a crawler identity, a moment of demand, and a content type. A homepage hub is not a comment stub. A training bot is not a referral engine.

02

Set a live ¢

CrawlYield emits Cloudflare’s native Crawler-Price header. Your floor and ceiling stay yours. Settlement stays on Pay Per Crawl.

03

Keep the lift

We take 10% of revenue above your old static baseline — and none of the baseline. The $200 platform keeps the intelligence current.

Offer · shadow-mode first

Instrument free. See your own number. Then go live.

We wire a counterfactual against the static ¢ you already charge — or would charge. You watch the gap accrue without changing what crawlers pay. When the picture is yours, you flip the switch.

  • No live price change until you say so.
  • Your baseline stays the control. The lift is the experiment.
  • Designed for publishers already on Cloudflare Pay Per Crawl.
Join the waitlist Write hello@bosonit.org

Commercial

$200 to run the intelligence. 10% of what it finds.

Two lines. No take on the money you already make at a flat ¢. Shadow mode first so the picture is yours before a charge goes live.

Platform

$200 / month

Seeded pricing intelligence and ongoing updates for your zone.

  • Live prices by demand, crawler, and content type
  • Your floor and ceiling remain yours
  • Fits the Cloudflare Pay Per Crawl path you already have

Alignment

10% of the gap

Take only on incremental crawl revenue above your static baseline.

  • Baseline is yours — we never tax the flat ¢
  • Gap scales linearly with crawl volume
  • Shadow instrument before any live take

Crawl settlement remains with Cloudflare Pay Per Crawl. The platform and take are a CrawlYield commercial. Start on the waitlist — we will not ask you to go live on a number you have not seen.

Waitlist

Get the shadow-mode seat.

Leave a work email. We will send the instrument brief — no live price change, no billing in this step.

Or skip the form: mailto:hello@bosonit.org