By Chris Cardinal
On June 26th, 2008
Usability is an extraordinarily powerful characteristic of an application, tool or piece of equipment. (Or, for that matter, anything you “use” at all.) You can build an absolutely amazingly powerful product, but if no one can determine how to use the features you’ve built into it, you might as well not code them at all.
The Seattle PI has a great piece featuring an email that they unearthed from Bill Gates to some of the top engineers at Microsoft. Gates tried to download and install Windows Movie Maker 2 when it was first released in 2003. He documents the trials and tribulations he, a pretty-damn-experienced user, encountered as he tried to do what should’ve been a very simple task.
The full content of his email after the jump and what we do to make sure our applications are usable without driving the end-user absolutely insane.
—- Original Message —-
From: Bill Gates
Sent: Wednesday, January 15, 2003 10:05 AM
To: Jim Allchin
Cc: Chris Jones (WINDOWS); Bharat Shah (NT); Joe Peterson; Will Poole; Brian Valentine; Anoop Gupta (RESEARCH)
Subject: Windows Usability Systematic degradation flame
I am quite disappointed at how Windows Usability has been going backwards and the program management groups don’t drive usability issues.
Let me give you my experience from yesterday.
I decided to download (Moviemaker) and buy the Digital Plus pack … so I went to Microsoft.com. They have a download place so I went there.
The first 5 times I used the site it timed out while trying to bring up the download page. Then after an 8 second delay I got it to come up.
This site is so slow it is unusable.
It wasn’t in the top 5 so I expanded the other 45.
These 45 names are totally confusing. These names make stuff like: C:\Documents and Settings\billg\My Documents\My Pictures seem clear.
They are not filtered by the system … and so many of the things are strange.
I tried scoping to Media stuff. Still no moviemaker. I typed in movie. Nothing. I typed in movie maker. Nothing.
So I gave up and sent mail to Amir saying – where is this Moviemaker download? Does it exist?
So they told me that using the download page to download something was not something they anticipated.
They told me to go to the main page search button and type movie maker (not moviemaker!).
I tried that. The site was pathetically slow but after 6 seconds of waiting up it came.
I thought for sure now I would see a button to just go do the download.
In fact it is more like a puzzle that you get to solve. It told me to go to Windows Update and do a bunch of incantations.
This struck me as completely odd. Why should I have to go somewhere else and do a scan to download moviemaker?
So I went to Windows update. Windows Update decides I need to download a bunch of controls. (Not) just once but multiple times where I get to see weird dialog boxes.
Doesn’t Windows update know some key to talk to Windows?
Then I did the scan. This took quite some time and I was told it was critical for me to download 17megs of stuff.
This is after I was told we were doing delta patches to things but instead just to get 6 things that are labeled in the SCARIEST possible way I had to download 17meg.
So I did the download. That part was fast. Then it wanted to do an install. This took 6 minutes and the machine was so slow I couldn’t use it for anything else during this time.
What the heck is going on during those 6 minutes? That is crazy. This is after the download was finished.
Then it told me to reboot my machine. Why should I do that? I reboot every night — why should I reboot at that time?
So I did the reboot because it INSISTED on it. Of course that meant completely getting rid of all my Outlook state.
So I got back up and running and went to Windows Update again. I forgot why I was in Windows Update at all since all I wanted was to get Moviemaker.
So I went back to Microsoft.com and looked at the instructions. I have to click on a folder called WindowsXP. Why should I do that? Windows Update knows I am on Windows XP.
What does it mean to have to click on that folder? So I get a bunch of confusing stuff but sure enough one of them is Moviemaker.
So I do the download. The download is fast but the Install takes many minutes. Amazing how slow this thing is.
At some point I get told I need to go get Windows Media Series 9 to download.
So I decide I will go do that. This time I get dialogs saying things like “Open” or “Save”. No guidance in the instructions which to do. I have no clue which to do.
The download is fast and the install takes 7 minutes for this thing.
So now I think I am going to have Moviemaker. I go to my add/remove programs place to make sure it is there.
It is not there.
What is there? The following garbage is there. Microsoft Autoupdate Exclusive test package, Microsoft Autoupdate Reboot test package, Microsoft Autoupdate testpackage1. Microsoft AUtoupdate testpackage2, Microsoft Autoupdate Test package3.
Someone decided to trash the one part of Windows that was usable? The file system is no longer usable. The registry is not usable. This program listing was one sane place but now it is all crapped up.
But that is just the start of the crap. Later I have listed things like Windows XP Hotfix see Q329048 for more information. What is Q329048? Why are these series of patches listed here? Some of the patches just things like Q810655 instead of saying see Q329048 for more information.
What an absolute mess.
Moviemaker is just not there at all.
So I give up on Moviemaker and decide to download the Digital Plus Package.
I get told I need to go enter a bunch of information about myself.
I enter it all in and because it decides I have mistyped something I have to try again. Of course it has cleared out most of what I typed.
I try (typing) the right stuff in 5 times and it just keeps clearing things out for me to type them in again.
So after more than an hour of craziness and making my programs list garbage and being scared and seeing that Microsoft.com is a terrible website I haven’t run Moviemaker and I haven’t got the plus package.
The lack of attention to usability represented by these experiences blows my mind. I thought we had reached a low with Windows Network places or the messages I get when I try to use 802.11. (don’t you just love that root certificate message?)
When I really get to use the stuff I am sure I will have more feedback.
The issues come into focus from an engineering perspective pretty simply: Creating an interface that allows a user to disseminate through literally thousands of pieces of software or other content is a complete bitch. It’s not made at all easier when you have disparate engineering teams (Windows Update, Microsoft.com and MM2 are owned by completely different groups, naturally) working on the situation. If you read the thread of reply emails (available here, PDF, 5 pages), you can see that it’s a considerable issue to try to resolve and starting from scratch isn’t always an efficient option.
Apple is a perfect example of this. The iPod wasn’t the first hard drive-based portable music player. In fact, it continues to not be the most feature-packed portable music player. But it sells more units than anything before and since and has shifted into something resembling “Kleenex” or “Xerox” as a generic term for what used to be called an MP3 player. The reason? Exceedingly high usability and intuitiveness.
Almost anyone can pick up an iPod and figure it out in just a few seconds. They mated this with an easy-to-use and complete online catalog for loading your player with music and built a complete solution that essentially just works.
When we approach our web applications, usability is always first and foremost in our mind. Our applications are in use by the general public and so we have to build them to pass the Mom test, essentially. This is easier said than done, especially when you’re asking users to enter details found on a paper form.
User interaction testing is an important element that a lot of web developers seem to ignore or forget altogether. Put people in front of your application. Don’t give them any instructions other than to “use it.” See what happens. Pay attention to where their mouse goes and what they look at. Note down any question that they have about “why doesn’t this do this?” or “how do I make this happen?”
Work to keep things simple. Make use of tooltips, so that users can interact with elements to easily give them more information, but without cluttering the interface from an initial state. Think logically about which features your users will use the most; you should have a good idea what’s getting used the most. Determine if you need to promote lesser-used components and then build an interface that always has the most used features prominently displayed and as few clicks away as possible.
In a future post, I’m going to showcase some great user interfaces on the web and look at what makes them great and what you can do to improve your interfaces.