performance monitoring

Tim Morrow (Betfair): Why third-party content keeps him up at night [PODCAST]

Tim Morrow has rocked the performance community on at least three distinct occasions.

The first time was at Velocity 2009, when he shared a case study from Shopzilla, where he was senior architect, which presented findings that became a cornerstone of how I and many others talked about the business value of performance. They cut above-the-fold load times down to less than 2 seconds, and as a result saw revenue gains of 5-12%.

From where I sit, it’s pretty hard to top findings like this, but Tim managed to do it when he came back to Velocity a year later and offered an awesomely candid case study showing how Shopzilla took its eye off the ball, performance-wise. As developers were occupied with other projects, load times slowly deteriorated until pages were once again taking 5 or more seconds to load. Customers were quick to notice and complain, which spurred a renewed internal effort to make pages faster.

More recently, as head of sports delivery at Betfair, Tim brings his commitment to customer satisfaction to the creation of another industry first, which he helped launch in the summer of 2011: a customer-facing charter that addresses the issue of page speed and makes a clear pledge to users:

After reliability, we believe that speed is a key feature of our products. We also acknowledge that we have a long way to go but we are working on it. In simple terms we commit to ensure our site becomes faster. To be more specific, we aim for 99.9% of bets placed in less than a second and our aspirational website Service Level Agreement is as follows. Under peak loads, with performance measured at the 95th percentile, for typical user bandwidths and a 0% error rate, our users shall experience Visual Progress (header loaded) in less than 1 second, Time to Interact with useful content within 1.5 seconds and full page loads within 3 seconds.

Like so many of the people I meet in our community, Tim Morrow is a practical idealist when it comes to performance. He has an inspiring combination of aspirational, visionary thinking, and the savvy to back up thought with action. It was my great privilege to speak with him about topics ranging from third-party content to performance testing. I hope you enjoy listening.

Listen to the podcast: Tim Morrow

Related posts:

NEW PODCASTS: Mark Jennings (Lonely Planet) and Josh Fraser (Torbit)

Now that the buzz around last week’s announcement is starting to subside, time to play a bit of catch-up on the podcast front.

I’m very, very happy with how well-received the podcast has been so far — no doubt thanks to having a non-stop stream of rockstar guests, including folks like Pat Meenan, Eric Goldsmith, and Ilya Grigorik. The stream is still in full flow, and I’m really excited about the guests who are lined up in the coming weeks. If you have any suggestions or feedback, I’m all ears. Leave a comment, or email me at joshua(at) webperformancetoday(dot)com.

Now on to my latest guests…

I love getting a chance to talk with the people who work behind the scenes to keep well-used sites fast, so I was thrilled to chat with Mark Jennings, Technical Operations Manager at Lonely Planet Online. If you’ve ever used the Lonely Planet site, you know that it’s an incredibly useful resource. And if you’ve done a lot of travelling and tried to access the web in remote locations, you know that performance can be a huge pain. Mark’s job is making sure that it isn’t an issue for Lonely Planet’s audience, and he and his team do a pretty remarkable job. Getting there wasn’t always easy, though, and in our interview, he talks about the challenges of selling performance internally. He also talks about the massive growth in Lonely Planet’s mobile traffic, and what this means in terms of not just making pages faster, but keeping them fast for every visitor.

Listen to the podcast: Mark Jennings

My most recent guest is Josh Fraser, CEO of Torbit, a company that’s doing some cool things in the real user measurement space. (A few people thought I was crazy for interviewing Josh, since Torbit‘s solution overlaps the FEO space, making them something of a competitor — but as far as I’m concerned, it’s a big pond and there’s lots of room for everyone.) Josh and I are both serial start-up guys, so we had a really interesting chat about entrepreneurialism. We also talked about the evolution of performance metrics, from technical to business, and Josh made some predictions about what 2013 will hold for our industry.

Listen to the podcast: Josh Fraser

Related posts:

Eric Goldsmith (AOL): Why everyone has to think like a data scientist [PODCAST]

It was a great honour and a privilege to chat with AOL performance evangelist and operations architect Eric Goldsmith for this week’s podcast. If you’re newer to the performance scene, Eric’s name may not be familiar to you. That’s because in 2010 he got pulled off the web performance circuit sideways into the world of big data, and went from headlining at Velocity to headlining at Strata.

But web performance and big data are intersecting worlds, and make no mistake about it, Eric is still very much a big thinker — and doer — in the performance world. With real user measurement (RUM) poised to become a topic on every site owner’s lips, Eric shares some important insights about how to extract actionable metrics from your RUM data, and how to avoid falling into the trap of confusing correlation with causation.

While Eric is in the enviable position of having massive amounts of data to mine (in his own words: “I revel in the scale”), he points out that, for those mining smaller data sets, the fundamentals remain the same. He also mentions that preaching the importance of statistics is an uphill battle at any size of company, even AOL.

We covered a lot of ground in this podcast, from how to teach stats within a corporate culture to changes in the RUM world over the past seven years. Enjoy.

Listen to the podcast: Eric Goldsmith

Related posts:

Geoffrey Smalling (CTO, Wine.com): Why performance measurement is an art form, how mobile is a game changer, and where the cloud fits in [PODCAST]

It’s hard to believe it’s only been a month since launching the Web Performance Today podcast. I’ve spoken with some really smart folks so far, and I’m tremendously excited about the upcoming interviews we’ve lined up.

Till now, we’ve heard from some great minds in the performance solution space — guys like Cliff Crocker and Theo Schlossnagle. This week, we’re going to hear from someone who buys those solutions: Geoffrey Smalling, CTO of Wine.com. (Full disclosure: Wine.com is a Strangeloop customer.)

Despite being the number one online wine seller in the world, Geoffrey still considers Wine.com a small ecommerce site, but the insights he shares are relevant to owners and developers of ecommerce sites of all sizes.

While Wine.com may not be an Amazon, it does an inspiring job of taking a big-company approach to performance. The company had its “aha” moment back in 2009, when A/B testing revealed that fast stripped-down versions of pages vastly outperformed the gorgeous bells-and-whistles versions. Since then, they’ve been on a mission to make every single release of their site faster than before, with a goal of delivering every page in 3 seconds or less.

Geoffrey and his team aren’t afraid to adopt new technologies. (On top of Strangeloop, they’ve also been using New Relic for more than a year, and Geoffrey is a big fan of their product; you’ll learn why in the podcast.) He also has a lot of experience with turning down technology vendors, and in this interview he shares his major pet peeves about salespeople.

I enjoyed chatting with Geoffrey immensely, but I especially enjoyed talking about one of my pet topics — mobile. Wine.com has experimented with everything from m.dot sites to iPhone and iPad apps, and the company does a phenomenal job of tracking its successes and failures. Geoffrey was remarkably candid in sharing some of these successes and failures with me. He also shared some astute observations on current mobile usage and where he sees this platform going.

I hope you enjoy this podcast as much as I did. Thanks for listening. :)

Listen to the podcast: Geoffrey Smalling

Related posts:

This week on the Web Performance Today podcast: Cliff Crocker and Buddy Brewer

I feel extremely lucky in the calibre of guests who’ve been kind enough to chat with me on the Web Performance Today podcast. Last week, we kicked things off with Pat Meenan and Stephen Thair. This week, I’m talking to Cliff Crocker and Buddy Brewer.

Cliff Crocker is a great guy whom I’m happy to also call a friend. If you’re in the performance space, Cliff is a really interesting person to talk to because he’s sat on different sides of the fence, first as a solution vendor at Keynote, then as a customer at Walmart, and then again as a solution vendor — this time at SOASTA, where he’s currently VP Product. If you want to learn about the dynamics of the buying and selling process, he’s the person to talk to. And as you might also guess, he has a massive amount of insight into real user measurement and where that industry is heading. Which is a good segue into my other guest this week…

Buddy Brewer is one of the co-founders, along with Philip Tellis, of LogNormal, one of the most innovative RUM tools on the market — so innovative, in fact, that it was recently acquired by SOASTA. Everyone who’s ever worked with Buddy agrees he’s a rare combination — an awesome guy who also happens to be really sharp. A lot of technologists dream of taking their startup from bootstrap to successful acquisition, but Buddy and Philip actually made that dream come true — and in just over a year. When you listen to this podcast, you’ll get some great insight into how they made it happen.

I hope you enjoy this week’s interviews. If you have any feedback or suggestions for future podcasts, let me know.

Listen:

Related posts: