4 awesome slides showing how page speed correlates to business metrics at Walmart.com

When one of the first slides in a presentation offers this level of candor, you know you’re in for a treat:

Walmart web performance optimization case study

File this presentation under “I wish I’d been there in person.” Cliff Crocker, Aaron Kulick, and Balaji Ram joined forces at February’s SF Web Performance Meetup to tell a RUM (real user monitoring) story through the lens of three job functions at Walmart.com: the performance data analyst, the developer, and the business analyst.

You can check out the full slide deck here (you need to be a Minus member to view it online, but anyone can download it), but I want to highlight my favourite slides.

First, some back story.

The problem: Folks at Walmart knew their pages were slow. As a for instance, initial measurement showed that an item page took about 24 seconds to load for the slowest 5% of users. Why? The usual culprits: too many page elements, slow third-party scripts, multiple hosts (25% of page content is served by partners, affiliates, and Marketplace), and various best practice no-nos.

The goal: Create and meet a performance SLA that would see Walmart’s 95th percentile traffic hit 20 seconds.

The approach: To get to that goal, they dedicated a scrum team to one sprint of performance optimization. At the start of the process, the team performed some baseline measurements in which they used their RUM data to look at the load times of key pages and look for patterns. Then the team would create targets for page performance and at the end of the sprint measure the impact of optimization on key metrics.

The following slides are a great use of historical RUM data to make a powerful case (embodied in compelling graphs) for investing in performance. Throughout this set, there’s a clear, consistent correlation  between load time and conversion.

Awesome slide #1: Overall, converted shoppers received pages that loaded 2X faster than non-converted shoppers.

This should be of interest to anyone who’s asked themselves how to set targets for their own performance.

Walmart web performance optimization case study

Awesome slide #2: The above trend persists, even on individual pages that experience greater load times.

An example is show here, in which a specific page loaded almost 2 seconds faster for buyers than it did for non-buyers. (There’s nothing I love more than seeing parallel lines on a graph like this.)

Walmart web performance optimization case study

Awesome slide #3: Non-buyers were served category pages that were 2-3 seconds slower than buyers.

I really appreciate the comprehensiveness of this set of slides. It’s a good proxy for measuring page flows, which is a much trickier task, due to the massive number of permutations involved. (Learn how you can do something similar using WebPagetest.)

Walmart web performance optimization case study

Awesome slide #4: Bounce rate strongly correlates to page speed.

No huge surprise here, but great to see this validated.

Walmart web performance optimization case study

Conclusions: Optimization resulted in improved conversions, revenue, and SEO

You may be happy to know that the Walmart team not only hit their SLA at the end of their optimization sprint, they actually overreached it by almost 3 seconds. They note the following benefits:

  • For every 1 second of improvement they experienced up to a 2% increase in conversions
  • For every 100 ms of improvement, they grew incremental revenue by up to 1%
  • SEO benefits for entry pages and reduce bounces

Do it yourself

Check out the original slide deck to learn how Walmart used RUM tools, first to baseline performance and its benefits, and then to measure the results of optimization.

If RUM isn’t an option for you, then read this post to learn how to identify and measure the performance of sample page flows using WebPagetest or HTTPwatch. And then watch this short video to learn how to use Google Analytics to perform a page speed/revenue analysis of the pages in your flows.

Before I sign off, I want to applaud the team at Walmart for providing this level of disclosure. Case studies like this are a massive boon for our industry. It’s always inspiring to see e-commerce giants joining the likes of Amazon and Shopzilla in their willingness to share data.

Related posts:

43 thoughts on “4 awesome slides showing how page speed correlates to business metrics at Walmart.com

  1. Wish you had been there in person as well Joshua! Thanks for the post. This was/is a lot of fun…

  2. Glad you like the post, guys. It’s a great presentation. We’ve circulated it around Strangeloop and we’ve all really enjoyed it.

    When the video is available, let me know and I’ll add the link.

  3. Pingback: The Performance Revolution Part I – Web Performance Optimization (WPO) « Sustainable Virtual Design

  4. Many thanks for that Joshua, we all know page load time is important but it’s great to see a major brand quantify the real effect it has.

  5. Pingback: Site Design as a Cloaking Device for Calls to Action : content ping

  6. Pingback: Community News: Web Performance Tips and More | New Relic blog

  7. Pingback: First look: Velocity 2012

  8. Pingback: How Walmart.com Correlates Web Performance to Business Performance | Rigor

  9. Pingback: The 27 best web performance links of Q1 2012

  10. Pingback: Four important web performance lessons for SMBs

  11. Pingback: Perfecting On-Page Optimization for Ecommerce Websites | Ezymagazines

  12. Pingback: Perfecting On-Page Optimization for Ecommerce Websites | Sphinx Web Design Experts

  13. Pingback: Perfecting On-Page Optimization for Ecommerce Websites | www.Anime-Island.org

  14. Pingback: Perfecting On-Page Optimization for Ecommerce Websites | latest techn

  15. Pingback: Perfecting On-Page Optimization for Ecommerce Websites – newcreationrecords.com

  16. Pingback: Perfecting On-Page Optimization for Ecommerce Websites

  17. Pingback: Perfecting On-Page Optimization for Ecommerce Websites | SCMG Enterprises, LLC.

  18. Pingback: Perfecting On-Page Optimization for Ecommerce Websites | Clixto7

  19. Pingback: Perfecting On-Page Optimization for Ecommerce Websites | Montachusett Internet Marketing

  20. Pingback: Perfecting On-Page Optimization for Ecommerce Websites | The Top 100 SEO Tips

  21. Pingback: Dicas de E-commerce Brasil melhorar as suas vendas

  22. Pingback: Perfecting On-Page Optimization for Ecommerce Websites | | Barrie MoranBarrie Moran

  23. Pingback: Diagonal Digital – Site speed and conversion - Diagonal Digital

  24. Pingback: On-Page Optimization for Ecommerce Websites. : Seochandra.me

  25. Pingback: 4 awesome slides showing how page speed correlates to business metrics at Walmart.com | mohammedalami

  26. Pingback: Perfecting On-Page Optimization for Ecommerce Websites | 蒙绍华博客

  27. Pingback: Coldwell Banker Previews Website Redesign | Bootstrap Software – Rants and Raves

  28. Pingback: Giovanni Fracasso: strategia e formazione per webmarketing, e-commerce e social media

  29. Pingback: UPDATED: 13 questions (and answers) about Google, site speed, and SEO

  30. Pingback: Big News: our new geo-distributed architecture speeds up A/B test loading times by 7x « I love split testing – Visual Website Optimizer Blog

  31. Pingback: WebPerfDays follow-up: 36 questions about web performance tools, measurement, and best practices

  32. Pingback: Evaluating eCommerce site with webpagetest.org - NathanBoyce.com

  33. Pingback: How Website Speed Affects Conversion Rates | GlobalDots Blog

  34. Pingback: Old Click » A Look at How Retailers Handled the Online Rush as Black Friday Sales Hit $1 Billion Mark

  35. Pingback: PINT Blog » 21 Steps to a Smarter Web Presence

  36. Pingback: Why Site Speed Optimisation Should Be Part of Your SEO Strategy | Web Development, Search Engine Optimization, Social Media Marketing Guru

  37. Pingback: Jussi Huotari’s Web » Online Business Requires Fast Page Load

  38. Pingback: Aaron Kulick (Walmart Labs): “RUM is trivial to implement but complicated to make actionable.” [PODCAST]

  39. Pingback: Carregamento de javascript: brincando com performance (parte 1) | Rafa Heringer

  40. My coder iis ttrying to convince me tto move to .net
    from PHP. I have always disliked the idwa because of the
    costs. But he’s tryiong none the less. I’ve been
    using Movable-type on several websites for about a year and am anxious about swktching to another platform.
    I have heared fantastic thinhgs about blogengine.net.
    Is there a way I can import all my wordpress content
    into it? Any help would be greatly appreciated!

    Also visit my web page :: best vaporizer for weed

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>