Cloudflare gives AI crawlers a September deadline to pay up



Cloudflare has set the AI industry a deadline. From September, it will block the crawlers that hoover up content for AI training. Any page that carries ads becomes off-limits, unless the site’s owner says otherwise. The pitch is simple: stop giving the web away for free.

The company sits in front of a large share of the world’s web traffic. It announced the change on Wednesday. From 15 September, new Cloudflare sites will keep letting search engines index their pages. They will block AI training and AI agents from any page with advertising by default.

The rule also catches “mixed-use” crawlers, the bots that blend search, training, and agent tasks into one. If a crawler will not let a site owner separate those uses, it gets blocked on ad-supported pages.

The defaults apply to new customers and to new sites from existing customers. They also cover every free user who has not changed their settings. Owners can always let the bots back in from their dashboard. But the starting position has flipped. Content that earns money is now off-limits to AI unless its owner opts in.

Why now

Cloudflare’s argument rests on a stark number. Automated bots now drive more than half of all web traffic, a milestone the company says arrived earlier than expected. Chief executive Matthew Prince said most internet traffic is now non-human. Cloudflare, he argued, “must go further and act faster so that a sustainable ecosystem can emerge.”

The deeper problem is a trap publishers know well. Most sites want to appear in AI answers, just as they want to rank in search. But the same crawl often feeds a model that then answers the user directly. The visit, and the ad revenue, never arrive.

Cloudflare singled out the “world’s largest search engine,” a clear jab at Google. Its Googlebot blends indexing with AI training. That gives Google roughly twice the data access of rival AI firms. Blocking the bot risks vanishing from search. Microsoft’s Bing and Apple’s Applebot raise the same dilemma.

From tollbooth to meter

Blocking is only half the plan. Cloudflare is turning last year’s “Pay Per Crawl” tollbooth into “Pay Per Use.” It now pays publishers when their content shapes an AI answer, not just when it is fetched. Early partners are the AI search firms Ceramic.ai and You.com.

Cloudflare is also adding a dashboard so publishers can see which bots take their work and how little traffic those firms send back. It gives the behaviour a name, Answer Engine Optimisation, the AI-era heir to SEO.

That reframing lands in a market already tilting this way. A wave of startups now sells tools to help brands stay visible inside chatbots, betting that GEO is the new SEO. Cloudflare wants to own the plumbing beneath it.

The open web at stake

The backdrop is grim for publishers. AI-generated answers are cutting the clicks that fund the web. They keep users on Google or inside a chatbot, rather than on the sites that did the work. One field study found Google’s AI Overviews cut outbound clicks by about 40 per cent. Economists have even started to model an outright collapse of the open web if the bargain is not repaired.

Whether one company can repair it is doubtful. Google and Apple already offer opt-out crawlers that may slip past Cloudflare’s block, and rivals could route around it. Regulators are circling the same problem from another angle. The UK is forcing Google to let publishers opt out of AI search without losing their ranking, and news publishers are suing OpenAI over training.

Cloudflare’s move is the most aggressive attempt yet to make AI pay for what it reads. The deadline is 15 September. The rest of the web will be watching what the AI giants do next.



Source link

Leave a Reply

Subscribe to Our Newsletter

Get our latest articles delivered straight to your inbox. No spam, we promise.

Recent Reviews


What Is Invoice Factoring in Plain English?

At its core, invoice factoring (also known as accounts receivable financing) is about selling your invoices to a factoring company in exchange for immediate cash. You’ll usually get 70–90% upfront, then the remainder (minus fees) once your customer pays.

This is not a loan. You’re not creating new debt or taking on monthly repayments. You’re simply trading tomorrow’s receivables for today’s working capital.

👉 Forbes Advisor explains invoice factoring as one of the most practical ways small businesses improve liquidity.


How Does Invoice Factoring Work?

Here’s the play-by-play:

  1. You invoice your customer for goods or services.

  2. Instead of waiting for them to pay, you sell that invoice to a factoring company.

  3. The factoring company advances you 70–90% of the invoice value.

  4. They collect directly from your customer.

  5. When the customer pays, you receive the remaining balance, minus factoring fees.

Example: You invoice a client for $50,000. A factor gives you 85% upfront ($42,500). Your client pays in 45 days. After collecting their fee (say 2%), the factor pays you the rest ($6,500). End result: You didn’t wait 45 days to get paid.

đź’ˇ Pro Tip: Pair invoice factoring with a revolving line of credit for maximum flexibility in managing cash flow gaps.


Invoice Factoring vs. Invoice Financing

They sound similar, but there’s a big difference:

Invoice Factoring Invoice Financing
Sell invoices outright Borrow against invoices
Factor collects payment You still collect
Not treated as debt Loan repayment required
Transparent but higher cost Often cheaper but more responsibility

👉 If you prefer to stay in control of collections, invoice financing might work better. But if you just want fast cash and less admin, factoring is the way to go.


Pros and Cons of Invoice Factoring

Pros Cons
✅ Immediate access to working capital ❌ More expensive than bank loans
✅ Based on customer creditworthiness ❌ Customers know factoring is in place
✅ No new debt or repayments ❌ Limited to B2B invoices
✅ Supports cash flow management ❌ Recourse factoring = you take the risk

💡 Pro Tip: If you’re worried about non-paying customers, look for non-recourse factoring. It costs more, but the factor—not you—takes the hit if your client defaults.


Who Uses Invoice Factoring?

Certain industries rely heavily on factoring because slow-paying customers are the norm. Top sectors include:

  • Trucking & logistics: Carriers often wait 30–90 days for brokers or shippers to pay. Factoring ensures they cover fuel and payroll immediately.

  • Staffing agencies: Weekly payroll but client invoices that pay monthly? Factoring bridges that gap.

  • Construction & subcontracting: Payment delays are common due to project milestones. Receivables financing through construction business loans keep crews running.

  • Wholesale & manufacturing: Large-volume orders often come with long terms. Factoring maintains liquidity.

  • Marketing & creative agencies: Agencies billing retainers or project-based fees often use factoring to smooth out revenue cycles.

👉 Fun fact: Staffing and trucking together account for the majority of factoring volume in the U.S.


How to Choose the Right Factoring Company

Not all factoring companies are created equal. Before signing a deal, compare:

  • Fees & transparency: Is it a flat fee or tiered by days outstanding?

  • Advance rates: Some offer 70%, others 95%.

  • Contract length: Month-to-month is flexible; year-long contracts can trap you.

  • Industry expertise: A factor that knows trucking ≠ one that specializes in creative agencies.

  • Non-recourse vs. recourse: Decide how much risk you want to carry.

For a deeper look, read Wolters Kluwer’s guide on factoring and cash flow.


Costs & Fees of Factoring Receivables

Typical fees run 1–5% per month depending on invoice size, industry, and risk. The longer your client takes to pay, the higher the fee.

Two key costs to look for:

  1. Factoring Fee (Discount Rate): Percentage of the invoice charged.

  2. Reserve Hold: Portion of the invoice held back until payment clears.

đź’ˇ Pro Tip: Always check if the factor files a UCC-1 lien. This filing can block you from getting other types of financing until the lien is released.


Real Case: Startup Scales With Invoice Factoring

A small tech startup wanted to grow but didn’t want to take on venture capital or debt. By factoring their invoices, they accessed quick cash, hired aggressively, and scaled operations. Within three years, they sold for $35 million—without giving up equity.

That’s the power of cash flow management through factoring.


Alternatives to Invoice Factoring

Invoice factoring is great—but it’s not the only way to fund your business. Alternatives include:

  • SBA 7a loans: Lower cost, but longer approval timelines. 

  • Business credit cards: Fast but can carry high interest.

  • Lines of credit: Flexible but harder to qualify for.

  • Revenue-based financing: Funding based on your sales.

đź’ˇ Pro Tip: Use factoring for short-term cash flow gaps, but consider long-term financing for expansion projects.





Source link