Cloudflare’s R2 Is the Infrastructure Powering Leading AI Companies
R2 provides an affordable, zero egress solution to support the architectural freedom needed to train AI models
Groundbreaking generative AI companies, including Character.ai, Leonardo.ai., Lexica.art, and SiteGPT.ai, rely on Cloudflare
San Francisco, CA, May 16, 2023 – Cloudflare, Inc. (NYSE: NET), the security, performance, and reliability company helping to build a better Internet, today announced that Cloudflare R2 Storage, the distributed object storage that eliminates egress costs, is providing essential infrastructure for leading generative artificial intelligence (AI) companies. Cloudflare is announcing several partnerships with AI infrastructure companies to help companies avoid vendor lock-in and make training generative AI models accessible and affordable.
Generative AI requires massive amounts of computing power and relies on graphics processing units (GPUs) to quickly and efficiently process enormous amounts of data to train the large language models (LLMs) that are at the core of their offerings. With the sudden acceleration of generative AI companies coming on the market, these companies are now facing a scarcity of processing power from their cloud providers. This requires companies to move data across multiple clouds or regions to find available GPUs, resulting in skyrocketing costs that cloud providers typically charge for data transfer – especially transfers that are frequent or over large distances. In addition, as new GPU chips optimized for AI workloads are released, AI startups want the flexibility to use the best technology available and not be locked into a single ecosystem. Cloudflare R2 Storage solves both these challenges by providing zero-cost egress – making it simple to migrate large volumes of data across clouds and easily use best-in-class technology.
“Cloudflare is providing the first developer platform built for the age of AI,” said Matthew Prince, co-founder and CEO of Cloudflare. “AI companies understand that Cloudflare is designed for speed and efficiency, enabling them to be competitive in this rapidly changing market. As they grow in popularity and traffic, we’re there to help with storage, security, and performance as costs and bots sneak up on them. Our global network and zero egress fees means these developers can focus on innovating fast, and worry less on the cost and technical decisions that sneak up on them.”
“AI has always put a high demand on storage needs, and Generative AI will only accelerate that trend,’ says Dave McCarthy, Research Vice President at IDC. “While the cloud has become a logical place to store data, 64% of technology decision makers claim they are spending more than their budgets. The secret is out – data transfer fees are a big factor in overall cloud costs.”
Cloudflare Partners with AI Infrastructure Companies
Cloudflare is announcing several new partnerships to support generative AI companies using R2 Storage as part of the infrastructure for their training models. These partnerships will ensure that the innovation around AI-specialized and distributed GPUs works the way it was intended, eliminating vendor lock-in and making training generative AI models accessible and affordable:
- CoreWeave is a specialized cloud provider, delivering a massive scale of GPUs on top of the industry’s fastest and most flexible infrastructure. "At CoreWeave, we build infrastructure for compute intensive use cases, empowering businesses to transform how we engage with technology through Generative AI and LLMs. This specialization unlocks access to the scale and variety of GPUs that our clients require, on an infrastructure purpose-built for performance, agility, and efficiency that AI workloads rely on," said Max Hjelm, VP of Sales, CoreWeave. "By partnering with Cloudflare’s R2 Storage, we're able to further alleviate data lock-in driven by ballooning egress fees on the hyperscalers and empower multi-cloud for businesses that benefit from it in a meaningful way."
- Lambda, Inc. is the world’s best deep learning cloud and the only public cloud designed for and focused on training LLMs & foundation models. “Lambda provides the easiest way to launch training and inference jobs on NVIDIA GPUs - and with our latest on-demand NVIDIA H100 launch at world’s best price - you can go from signing up to the cloud platform to train or finetune a Gen AI/LLM model within minutes,” said Mitesh Agrawal, Lambda COO and head of cloud. “Our partnership with Cloudflare R2 will help joint customers extend this amazing solution with a best of breed object storage solution without having to worry about egress costs, which is a very common issue in the multi-cloud world."
- MosaicML helps customers easily train and deploy large AI models with full data privacy and model ownership, and will now support R2 in their open source libraries and training platform. “With the MosaicML training platform, customers can efficiently use Cloudflare R2 as the durable storage backend for training LLMs on any compute provider with zero egress fees,” said Naveen Rao, CEO and co-founder, MosaicML. “AI companies are facing outrageous cloud costs, and they are on the hunt for the tools that can provide them with the speed and flexibility to train their best model at the best price.”
AI Companies Rely on Cloudflare
AI companies like Character.ai, Leonardo.ai, Lexica.art, and SiteGPT.ai rely on Cloudflare to provide the tools needed to serve up real-time inferences, images, conversations, and more with users around the world.
- "Character AI is building the next generation of dialog agents across industries spanning entertainment, education, and more. R2 has been the glue behind our multi-cloud architecture for training and processing requests. We are now able to store our training and production data in R2 for access by any cloud, without egress fees, and get the best prices and performance across multiple cloud providers. Cloudflare is helping us rapidly expand our infrastructure and envision the future of conversational AI." – Myle Ott, Founding Researcher, Character AI
- “Leonardo.ai brings AI-powered creative tools to users like indie game developers and creators. After launching, our explosive growth was a near existential crisis – the exorbitant data transfer costs from other providers were not sustainable for an early stage, high-growth startup in a data intensive space. Cloudflare’s R2 saved the day. The API compatibility meant switching over our apps was a breeze, with minimal engineering effort. The dashboard tool for migrating our existing data worked flawlessly. And the pricing is unbeatable, the best we found both on a per-GB and egress cost basis.” – Pete Werner, Head of AI, Leonardo.ai
- "Lexica's users are generating millions of images per month, letting them unleash their creativity and express themselves in new ways. Lexica.art wouldn't be possible without R2 and Workers. Using these products has given us a lot of control over the images we serve and helps us keep the website snappy and responsive. With the number of requests we serve, it would easily cost 100x more on Amazon." – Sharif Shameem, founder, Lexica.art
- "SiteGPT is working to make personalized chatbots accessible to every website. We use Cloudflare for everything – storage, cache, queues, and most importantly for training data and deploying the app on the edge, so I can ensure the product is reliable and fast. It's also been the most affordable option, with competitors costing more for a single day's worth of requests than Cloudflare costs in a month. The power of the developer platform and performance tools made it an easy choice to build with Cloudflare." – Bhanu Teja Pachipulusu, founder, SiteGPT.ai
To learn more, please check out the resources below:
- Blog: Cloudflare R2 and MosaicML enable training LLMs on any compute, anywhere in the world, with zero switching costs
- Product Page: R2 Storage
- See how much you can save with the R2 Calculator
About Cloudflare Cloudflare, Inc. (www.cloudflare.com / @cloudflare) is on a mission to help build a better Internet. Cloudflare’s suite of products protect and accelerate any Internet application online without adding hardware, installing software, or changing a line of code. Internet properties powered by Cloudflare have all web traffic routed through its intelligent global network, which gets smarter with every request. As a result, they see significant improvement in performance and a decrease in spam and other attacks. Cloudflare was awarded by Reuters Events for Global Responsible Business in 2020, named to Fast Company's Most Innovative Companies in 2021, and ranked among Newsweek's Top 100 Most Loved Workplaces in 2022.
Forward-Looking Statements This press release contains forward-looking statements within the meaning of Section 27A of the Securities Act of 1933, as amended, and Section 21E of the Securities Exchange Act of 1934, as amended, which statements involve substantial risks and uncertainties. In some cases, you can identify forward-looking statements because they contain words such as “may,” “will,” “should,” “expect,” “explore,” “plan,” “anticipate,” “could,” “intend,” “target,” “project,” “contemplate,” “believe,” “estimate,” “predict,” “potential,” or “continue,” or the negative of these words, or other similar terms or expressions that concern Cloudflare’s expectations, strategy, plans, or intentions. However, not all forward-looking statements contain these identifying words. Forward-looking statements expressed or implied in this press release include, but are not limited to, statements regarding the capabilities and effectiveness of R2 Storage and Cloudflare’s other products and technology, the benefits to Cloudflare’s customers from using R2 Storage and Cloudflare’s other products and technology, Cloudflare’s partnerships with MosaicML and CoreWeave and the potential resulting benefits to Cloudflare customers, the potential opportunity for Cloudflare to attract additional customers and to expand sales to existing customers through Cloudflare’s partnerships with MosaicML and CoreWeave, the timing of when R2 Storage or any of its related features will be generally available to all current and potential Cloudflare customers, Cloudflare’s technological development, future operations, growth, initiatives, or strategies, and comments made by Cloudflare’s CEO and others. Actual results could differ materially from those stated or implied in forward-looking statements due to a number of factors, including but not limited to, risks detailed in Cloudflare’s filings with the Securities and Exchange Commission (SEC), including Cloudflare’s Quarterly Report on Form 10-Q filed on April 27, 2023, as well as other filings that Cloudflare may make from time to time with the SEC.
The forward-looking statements made in this press release relate only to events as of the date on which the statements are made. Cloudflare undertakes no obligation to update any forward-looking statements made in this press release to reflect events or circumstances after the date of this press release or to reflect new information or the occurrence of unanticipated events, except as required by law. Cloudflare may not actually achieve the plans, intentions, or expectations disclosed in Cloudflare’s forward-looking statements, and you should not place undue reliance on Cloudflare’s forward-looking statements.
© 2023 Cloudflare, Inc. All rights reserved. Cloudflare, the Cloudflare logo, and other Cloudflare marks are trademarks and/or registered trademarks of Cloudflare, Inc. in the U.S. and other jurisdictions. All other marks and names referenced herein may be trademarks of their respective owners.