FOR INFRASTRUCTURE
Advanced Security
DDoS Protection WAF Bot Management Magic Transit Rate Limiting SSL / TLS Cloudflare Spectrum
Video Streaming & Delivery
Cloudflare Stream Stream Delivery
 
Performance & Reliability
CDN DNS Argo Smart Routing Load Balancing China Network
Insights
Analytics Cloudflare Logs
Domain Registration
Cloudflare Registrar
FOR TEAMS
Cloudflare Access Cloudflare Gateway
FOR SERVERLESS APPLICATIONS
Cloudflare Workers Cloudflare Workers KV Workers Sites
FOR EVERYONE
1.1.1.1 1.1.1.1 for Families Cloudflare Apps
Performance
Accelerate Internet Applications Accelerate Mobile Experiences Ensure Application Availability
Security
Mitigate DDoS Attacks Prevent Customer Data Breaches Stop Malicious Bot Abuse Protect Users and Devices
Industries
Gaming SaaS eCommerce Media and Entertainment Public Sector Public Interest Groups State & Local Government
Partnerships
Partner Network
Technology Partners
Technology Partners Overview Peering Portal Bandwidth Alliance Analytics Partners
Integrations
IBM Cloud WordPress Google Cloud Magento Acquia Rackspace Microsoft Azure Kubernetes WP Engine Tanium
Develop
API Guide Developer Hub Developer Fund
Explore
Case Studies Analysts Cloudflare in China Network Map Webinars What's New? White Papers GDPR
Learn
Welcome Center DDoS Learning Center CDN Learning Center DNS Learning Center Security Learning Center Performance Learning Center Serverless Learning Center SSL Learning Center Bots Learning Center Cloud Learning Center Access Management Learning Center Network Layer Learning Center
Connect
Blog Contact Sales Community Support
Contact
+1 650 319 8930
Advanced Cloudflare Configuration
Explore Cloudflare API v4 Expose a Secure Local Tunnel Configure with Terraform Documentation
Customize Your Site
Customize Using Workers Altering Headers Conditional Request Routing A/B Testing Browse All Code Snippets
Build Serverless Applications
Deploy a Static Site Deploy Using Workers.dev Get Started with Tutorials Clone Examples on GitHub

Always Online

Always Online™ is a feature that caches a static version of your pages in case your server goes offline.

If your origin server is ever unavailable, Cloudflare will serve a limited copy of your cached website to keep it online for your visitors. Cloudflare builds the Always Online version of your website, so your most popular pages are represented. Cloudflare is caching pages when you see the crawler in your logs.

Contact Our Team
Related Products

Technical Details

Our User Agent

Mozilla/5.0 (compatible; CloudFlare-AlwaysOnline/1.0; +https://www.cloudflare.com/always-online) AppleWebKit/534.34

Crawling Frequency

We crawl free customers once every 7 days, Pro customers once every 3 days, and Business and Enterprise customers daily. More details

Want to Stop the Crawler?

If you’re a Cloudflare customer, you can turn this crawler off in the settings overview page of your Cloudflare settings.

To provide you with the best possible experience on our website, we may use cookies, as described here.
By clicking accept, closing this banner, or continuing to browse our websites, you consent to the use of such cookies.