Performance & Reliability
CDN DNS Argo Smart Routing Load Balancing AMP Real URL Web Optimizations China Network
Video Streaming & Delivery
Cloudflare Stream Stream Delivery
Advanced Security
Magic Transit DDoS Protection WAF Bot Management Rate Limiting SSL / TLS DNSSEC Cloudflare Access Cloudflare Spectrum Argo Tunnel
Insights
Analytics Cloudflare Logs
Cloudflare for Developers
Cloudflare Workers Cloudflare Workers KV Mobile SDK
Domain Registration
Cloudflare Registrar
Cloudflare Marketplace
Cloudflare Apps
Cloudflare for Everyone
1.1.1.1
Performance
Accelerate Internet Applications Accelerate Mobile Experiences Ensure Application Availability
Security
Mitigate DDoS Attacks Prevent Customer Data Breaches Stop Malicious Bot Abuse
Industries
Gaming SaaS eCommerce Media and Entertainment Public Sector Public Interest Groups State & Local Government
Partnerships
Partner Program
Solutions Partners
Services Program
Technology Partners
Peering Portal Bandwidth Alliance Analytics Partners
Integrations
IBM Cloud WordPress Google Cloud Magento Acquia Rackspace Microsoft Azure Kubernetes WP Engine
Develop
API Guide Developer Hub Developer Fund Documentation
Explore
Case Studies Analysts Cloudflare in China Network Map Webinars What's New? White Papers GDPR
Learn
DDoS Learning Center CDN Learning Center DNS Learning Center Security Learning Center Performance Learning Center Serverless Learning Center SSL Learning Center Bots Learning Center Cloud Learning Center
Connect
Blog Contact Sales Community Support
Contact
+1 650 319 8930
Advanced Cloudflare Configuration
Explore Cloudflare API v4 Expose a Secure Local Tunnel Configure with Terraform Documentation
Customize Your Site
Customize Using Workers Altering Headers Conditional Request Routing A/B Testing Browse All Code Snippets
Build Serverless Applications
Deploy Using Workers.dev Get Started with Tutorials Clone Examples on GitHub

Always Online

Always Online™ is a feature that caches a static version of your pages in case your server goes offline.

If your origin server is ever unavailable, Cloudflare will serve a limited copy of your cached website to keep it online for your visitors. Cloudflare builds the Always Online version of your website, so your most popular pages are represented. Cloudflare is caching pages when you see the crawler in your logs.

Contact Our Team
Related Products

Technical Details

Our User Agent

Mozilla/5.0 (compatible; CloudFlare-AlwaysOnline/1.0; +https://www.cloudflare.com/always-online) AppleWebKit/534.34

Crawling Frequency

We crawl free customers once every 7 days, Pro customers once every 3 days, and Business and Enterprise customers daily. More details

Want to Stop the Crawler?

If you’re a Cloudflare customer, you can turn this crawler off in the settings overview page of your Cloudflare settings.

To provide you with the best possible experience on our website, we may use cookies, as described here.
By clicking accept, closing this banner, or continuing to browse our websites, you consent to the use of such cookies.