Drupal Association: Fallstudie

Drupal is an open source tool that powers millions of websites and applications by allowing users to upload and manage content. Over one million global users work on Drupal.org, which is funded and maintained by the Drupal Association. The Drupal Association is a non-profit organization based in Portland, Oregon that fosters and supports the Drupal software project, the community and its growth. Supported by both individual members and organizations, the Association uses its resources, network, and funds to educate people about Drupal and support the growth of the Drupal project.

Why Fastly

Drupal powers content management for 12.2% of the top 100,000 websites worldwide — including whitehouse.gov, Weather.com, Pinterest, NBCUniversal, Tesla, Pfizer, MLS, NBA, the GRAMMYs, the Emmys, and Harvard. The Drupal Association is the central and authoritative source for news, addons, development, and updates on all things Drupal. Like most Drupal-powered sites, the Drupal Association uses Varnish, the open source web accelerator, to cache and accelerate their sites and services.

Drupal.org hosts the Download (https://ftp.drupal.org) and Updates services that provide essential Drupal packages, themes, and modules to extend the look and feel of Drupal’s core features.

As a crucial part of the infrastructure for millions of sites, the Drupal Association looked for a CDN that would enable them to scale their infrastructure as Drupal grows, extend the robust features of their platform (including faster downloads, updates, and the latest news) to their community as a whole, and support unpredictable spikes without overloading their origins. The Drupal Association turned to Fastly to serve Drupal.org’s entire infrastructure, caching assets on both their Download and Updates services as well as Drupal.org. Because Fastly is based on Varnish, Drupal could easily extend their existing application logic to the network edge — closer to their global user base — creating faster experiences for their community. Fastly’s Origin Shield enables Drupal.org to scale without risk by absorbing traffic spikes and maintaining high-availability and fast, global cache-consistency to support instant updates and real-time releases.

Improving performance for Drupal.org

Fast, reliable page loads are important for Drupal users around the world — according to Kissmetrics, 47% of users expect a website to load in two seconds or less. This is especially critical with respect to Drupal.org, where their community goes to find the latest news and updates. Drupal migrated their core content platform at www.drupal.org as well as sites for the Drupal API, translations, and worldwide events (DrupalCons) to Fastly in less than two weeks, after which they saw a 33% decrease in page load time.

The power of Varnish & instant VCL changes

Fastly uses a highly customized version of Varnish, allowing the Drupal Association to write and deploy their own Custom Varnish Configuration Language (VCL). This gives them ultimate flexibility when caching and updating their content.

The fact that Fastly is built on Varnish made it easy for Drupal to push their content and existing configurations closer to their users — creating a faster experience than they could with Varnish alone. With Fastly’s Custom VCL, Drupal can extend their global reach while protecting their origins against spikes in traffic, improving experiences for users across the world.

Origin Shielding and scaling for global growth

Before Drupal.org moved to Fastly, they had massive amounts of traffic hitting their origins. Fastly’s Origin Shield protects against spikes in traffic and helps Drupal.org minimize bandwidth use on their high-demand services, such as Updates. If they make an update while 15,000 requests are coming in simultaneously, they can rest assured that their origins are protected.

Decreasing the load on their origins has allowed Drupal to save on operational costs, paving the way for global growth.

Instant updates and real-time releases

Speed of innovation is crucial: millions of modern, leading companies rely on Drupal every day, so it’s important that they’re able to make new releases available quickly and reliably. This is crucial from both a user experience and security standpoint— in the event of an important security update, Drupal.org needs to make it available to users immediately.

With their previous provider, updates to new projects, modules, and other Drupal-related content often took 45 minutes or more. Because Fastly enables Drupal.org to update content in 150 milliseconds, they can cache content for longer (thereby reducing requests to their origins), knowing they can update it instantly when necessary.

Streaming logs for real-time review

The Drupal Association has hooked up Fastly’s streaming logs to a centralized log server, enabling them to aggregate user data to keep track of vital information. In addition to streaming logs to their syslog endpoint, the Drupal Association sends a copy of their logs directly from Fastly to S3 buckets. They use these logs to generate project usage statistics on Drupal.org, and having multiple places to send logs helps them generate stats more reliably.

drupal.org
Industry: Open source
Location: Global
Customer since: 2014

Favorite features
Instant Purge™
Custom VCL
Origin Shield
Streaming logs

“Fastly helped us deal with some pretty challenging traffic levels. Speaking with them and learning about the [open source alliance program](https://www.fastly.com/about/open-source) sold us on working with an open source-friendly content distribution network that uses software we’re familiar with. Fastly understands the needs of an open source project.”
— Rudy Grigar, Infrastructure Manager

“Fastly is a perfect fit for an organization like the Drupal Association: it’s open source-friendly, built on Varnish, and offers a great distribution network with a great set of distributed POPs. Because we have a global community, we need to have a fast global reach, and services like Fastly make that doable.”
— Joshua Mitchell, CTO

“Drupal.org now loads about a second faster than it did before Fastly. On some pages, like the Drupal.org homepage, we went from 2.16 seconds to 1.42 seconds. Our cache hit also went up, from a 70% hit ratio to over 90%, which means that our origin servers were also performing much better considering the amount of traffic we handle. That’s a dramatic and impactful improvement for our users.”
— Joshua Mitchell, CTO

“A lot of features within the Custom VCL let us speed up page load times significantly. The caching we can do with Fastly is a lot more powerful than our previous (and very vanilla) provider.”
— Joshua Mitchell, CTO

“The ability to quickly test and deploy configuration changes has been a big improvement. If we need to make a critical change, our previous provider could take up to four hours to go live. With Fastly, the changes are live in a matter of seconds.”
— Rudy Grigar, Infrastructure Manager

“Origin Shield has been extremely helpful. Updates are our biggest use of bandwidth, and now we have a 99% hit ratio for our updates traffic, so that’s saved us a ton on infrastructure costs.”
— Joshua Mitchell, CTO

“Being able to push the majority of bandwidth off of our origin has freed up a lot of networking resources internally. It also helps with our bigger vision of extending Drupal around the world, offering a better experience for everyone.”
— Rudy Grigar, Infrastructure Manager

“The speed at which we push data out is critical to the user experience — not only in terms of security, but also for making downloads available more quickly, for everyone. Fastly gives us a faster rollout for releases — as soon as a release hits we can make it live for download. This is especially great from the security side; we can make a security release available to everyone within seconds of it being packaged.”
— Joshua Mitchell, CTO

“We didn’t have Instant Purge™ with our previous provider — we would often have to wait almost an hour for updates to go through. With Fastly, our cache expiration times are set really high — 365 days — but when an update comes through we can make it available immediately.”
— Rudy Grigar, Infrastructure Manager

“Fastly’s streaming logs have been extremely useful — we use them to aggregate project usage statistics on Drupal.org and to keep track of how many sites have a Drupal module or theme activated.”
— Rudy Grigar, Infrastructure Manager