Improve your site with free and paid apps:

Cloudflare Developer Fund

Cloudflare and world class investment firms invest $100 Million to deliver powerful tools for the Internet. The Cloudflare Developer Fund is looking for companies that are building apps on Cloudflare’s platform.

Always Online

Always Online™ is a feature that caches a static version of your pages in case your server goes offline.

If your origin server is ever unavailable, Cloudflare will serve a limited copy of your cached website to keep it online for your visitors. Cloudflare builds the Always Online version of your website, so your most popular pages are represented. Cloudflare is caching pages when you see the crawler in your logs.

Contact Our Team
1 (888) 99 FLARE
1 (888) 993 5273

Technical Details

Our User Agent

Mozilla/5.0 (compatible; CloudFlare-AlwaysOnline/1.0; +https://www.cloudflare.com/always-online) AppleWebKit/534.34

Crawling Frequency

We crawl free customers once every 7 days, Pro customers once every 3 days, and Business and Enterprise customers daily. More details

Want to Stop the Crawler?

If you’re a Cloudflare customer, you can turn this crawler off in the settings overview page of your Cloudflare settings.