Ecommerce

From techs to execs: Putting performance in business terms

For those who asked, here’s the slide deck for my session at the recent Web Performance Summit:

These slides cover a lot of ground. Here’s a rough table of contents to help you drill into the material:

  • Terminology and concepts – slides 7-19
  • Performance automation case study – slides 20-91
  • Making a business case for performance – slides 92-112
  • How to be your company’s in-house performance evangelist – slides 113-121

I was honoured to be invited to speak among a roster of great speakers. Thanks again to Kyle Simpson and the folks at Environments for Humans for organizing the event, and to everyone who attended.

Related posts:

Case study: Faster pages lead to 6% revenue increase for Artbeads.com

There are a bunch of reasons why I’m really excited by the newest case study — for Artbeads.com — that we’ve added to our customer success stories:

  • While it’s a successful ecommerce site with a good-sized inventory (27,000-plus items), Artbeads isn’t a mega-giant. It’s what I call a “mortal company“, and it makes a great case for how smaller companies can justify automating their content optimization efforts.
  • As a Yahoo store, Artbeads presented some interesting new challenges for us. The site’s development and hosting platforms presented several potential optimization limitations, which are explained in the case study.
  • And my favourite aspect of this case study: Despite the fact that it’s a mid-sized site with hosting challenges, and despite the fact that its customers had no complaints about the site’s speed, the people at Artbeads still made it their mission to improve performance. As they told us, they had a hunch that performance optimization would pay off, and their hunch paid off. A/B testing revealed that the optimized site delivered a revenue increase of 6%.

Performance optimization for smaller ecommerce websites

You can read the case study here.

Related posts:

Are you focusing on first and repeat views? Then you may be ignoring 96% of your page traffic.

Question: What do you think these four waterfalls have in common? (Hint: Same browser. Same connection speed. Same location.)

Performance measurement - first, repeat, and flow views

Answer: They’re all the same page (the Lonely Planet home page, to be specific), but from four distinct perspectives: first view, repeat view, and two different flow views.

Why measuring first view and repeat view is not enough

When most of us run simple performance tests, we usually focus on two perspectives: the first view and the repeat view. Unfortunately, life is not this simple.

On non-landing pages (for most of you, that would be all pages but your home page), first view and repeat view only represent about 4% of the total views. There’s another view — the flow view — which represents approximately 96% of the traffic for most of your web pages.

And yet despite its incredible relevance, flow view gets almost zero attention.

For instance: Let’s look at a Lonely Planet product page

Imagine you go to the Lonely Planet website and want to buy the West Africa travel guide. Well, that page has a number of different waterfalls, depending on how you visit it:

1. First view

What is it?

This is the view of the page for someone who has never been to the Lonely Planet site before (or has cleared their cache since their last visit).

Performance measurement - web page test results

Likelihood your users will see this waterfall: Small (but still important)

Product pages are most likely only a first view page when they are linked directly from ads, searches, or other websites. It is very rare for product page to be typed directly into the browsers address bar. Looking at our analytics warehouse data, we see that product pages are viewed as first view pages only 3% of the time, on average. But still, these are important views because they are often targeted leads coming from search results and referral engines.

How to see first view in a waterfall

This is an easy one. Just go to WebPagetest, enter the URL, and click ‘Start test’. Look at the first view.

2. Repeat view

What is it?

This is the view of a page if a user goes only to the page, closes their browser, and then reopens the browser and goes only to that page again as the first page they hit on the site.

Peformance measurement - waterfall

Likelihood your users will see this waterfall: Almost never

Repeat views in the context of most test tools are a good proxy to see how well you are using cache headers, but users very rarely just go to one page on a site, close the browser, open it again and go back to that exact page.

How to see repeat view in a waterfall

This is another simple view to get. As with first view, go to WebPagetest, enter the URL, and click ‘Start test’. Look at the repeat view.

3. Flow view

What is it?

This is the view of the page when a customer has previously visited at least one other Lonely Planet page.

Likelihood your users will see this waterfall: Frequently

Product pages are often viewed as part of a flow by your users. Looking at our own customer analytics here at Strangeloop, I’d estimate that upwards of 96% of product page views are flow views.

How to see flow view in a waterfall: Two methods

Seeing a page in a flow is not as straightforward as first or repeat views. Obviously your users don’t all take the same flow, so you need to ensure that you test multiple permutations of pages based on the key flows through your site, which you see in your analytics tool.

Method #1: Using HTTPWatch
The easiest way to see the flow view of a page is to install HTTPWatch, start recording your browsing session, and click from the home page to the product page.

Method #2: Using WebPagetest
Another way to see the flow view is to use the script feature of WebPagetest. Click on ‘Advanced settings’ and then click on ‘Script’.

Customizing web page speed tests using scripts

Create a script by copying and pasting the example below and changing the URLs. (If your typical path has more or less steps, feel free to cut/copy to accommodate your needs. Remember that the URL below logData 1 will be captured as the waterfall for this page.)

logData 0
navigate http://www.lonelyplanet.com/us
logData 0
navigate http://www.lonelyplanet.com/destinations
logData 0
navigate http://www.lonelyplanet.com/africa
logData 0
navigate http://www.lonelyplanet.com/benin
logData 1
navigate http://shop.lonelyplanet.com/africa/west-africa-travel-guide-7

With hundreds of flows to choose from, how do you narrow down the most relevant ones?

Obviously you could have hundreds of permutations of flows. I was interested in tracking down just how many different waterfalls can be generated from one page.

Using our performance analytics database, I tracked down a specific product page and looked at all of the different flows. The specific page I identified had been viewed almost 25,000 times and had been viewed in 975 different combinations — far too many combinations to run individuals waterfalls on.

So instead of running hundreds of tests, I simply decided to group the pages into different templates, then look at the different flows.

For example:

Home page -> Destinations -> Africa -> Benin -> West Africa Travel Guide

Was translated to:

Home page -> Destinations -> Continent -> Country -> Book

I found that by using this method, I got down to a much more manageable set of 10 unique, relevant flows.

I then performed WebPagetests, using the script feature in WebPagetest that I described above. I found that looking at the first view, repeat view, and important flow view waterfalls really helped me see how the site was doing and how real users would view a page.

What this all serves to illustrate

Measuring performance is an art as much as it is a science. While there are a growing number of tools on the market, we need to be aware of what exactly it is we need to test and why. And we still have to be ready to perform some hacks to get the data we need.

Related posts:

 

Crazy Theory #9021-D: Can you boost conversions by loading keywords first?

These days I’ve been reading The Happiness Hypothesis by Jonathan Haidt and I’ve been writing about progressive enhancement. The two came together last night when I read this bit in my book:

After its long infatuation with information processing models and computer metaphors, psychologists began to realize that there are really two processing systems at work in the mind at all times: controlled processes and automatic processes. [...]

exposure to words related to the elderly makes people walk more slowly; words related to professors make people smarter at the game of Trivial Pursuit; and words related to soccer hooligans make people dumber. And these effects don’t even depend on your consciously reading the words; the same effects can occur when the words are presented subliminally, that is, flashed on a screen for just a few hundredths of a second, too fast for your conscious mind to register them. But some part of the mind does see the words, and it sets in motion behaviors that psychologists can measure.

According to John Bargh, the pioneer in this research, these experiments show that most mental processes happen automatically, without the need for conscious attention or control. Most automatic processes are completely unconscious, although some of them show a part of themselves to consciousness.

What’s interesting to me is that it doesn’t seem to take much to trigger these automatic processes. In a test to see how long we need to be exposed to certain words in order for these words to influence our actions, researchers found that subliminally exposing test subjects to images for just 13-26 milliseconds has a significant effect on behaviour.

(If you want to read the research first-hand, here’s the study. Neat stuff. I spent way too long reading it.)

I am not a crackpot.

Is all this just another name for subliminal advertising, which caused a big stir in the 1970s but was later debunked? Not quite.

While research points to the fact that imperceptible exposure to some words and images — especially negative ones — can affect our mood, there’s been no proof that this mood change actually affects our buying behaviour. Other research has found that you can motivate people to act by using subliminal messaging, but only if the message matches a real biological need or if the behaviour has a positive effect.

So what does this have to do with website performance?

Earlier this week, I wrote about how we can use progressive enhancement to make pages appear to load faster. As I said then, this technique treads into design and usability territory. It also treads into business territory, because these tweaks drive revenue.

What about using progressive rendering to load powerful key words first on a page? Assuming that your visitors are on your site because they have an existing need or problem they’re trying to solve, and your product or service is a legitimate solution for them, could loading these keywords first help boost your conversions? It may sound kind of crazy, but what if it’s one of those crazy ideas that work? Is it something you’d ever consider testing?

Again, this idea is where business, design, and web performance intersect. It isn’t about site speed, per se, but it is about reaching into our bag of performance tricks and seeing how we can apply them change how a site performs, and in the end to achieve business goals. Even if this particular technique isn’t something you want to investigate, are there other means and ends that you could be exploring for applying performance techniques? How wide have you set your sights?

As an aside, here’s an interesting fact I just looked up: It’s widely believed that subliminal advertising was made illegal in the US, but this isn’t the case. Subliminal ads are absolutely 100% legal in most countries, other than the UK and Australia. The US considered restricting subliminal advertising in the 1940s, but it never came to pass. However, the FCC, the independent body that regulates TV and radio in the US, has forbidden the use of subliminal advertising, though it’s never fined a broadcaster for its use.

Related posts:

Why CIOs need to care about web speed [VIDEO]

Like any normal self-respecting person, I hate watching myself in videos, but my marketing team is holding a gun* to my head, so here you go. Maggie Rulli interviewed me for the latest edition of CIO Insight. She asked some good questions: is the internet getting faster or slower? What’s the root cause of slow web pages? Why are internet users getting more and more impatient?

(Apologies in advance for my boring office wall. I forgot my blue screen, so they weren’t able to run the helicopter attack scene from Apocalypse Now in the background as I’d requested.)

*A water gun, but still.

Related posts: