Usability research can be very costly. There are companies that specialize in doing it the right way, with high end audio/video equipment and multi-stream video editing and compositing integrated into the program. The deliverable is typically an incredibly insightful presentation with snippets of video that tell a compelling story all by themselves.
With startups, it is almost never the right decision to spend the big bucks and hire an agency to do this “right”. First hand learning is key and some research trumps no research. There are many options for you to crowdsource research, such as usertesting.com which is a terrific service - but it is a great idea to start with a face to face, high touch usability benchmark study for a few subjects to get all the low hanging fruit usability problems out of the way quickly.
It is ok to do this yourself, provided you put some structure around what you are doing to guard against common mistakes like confirmation bias and leading the witness.
As with all research projects, you should start with a research protocol that clearly states the questions you want to answer, provides a guideline for recruitment, and lists the props required for the session. Common props might include the means to take video footage, as well as a photo and video release form indicating that all footage is meant for internal use only. This is very important, because video footage allows you to go back and look at where the subject is struggling. It also helps you communicate your findings with the rest of the team. If you manage it correctly, most subjects forget the camera is running within 5 minutes- but you must get their consent so they know and are ok with being on camera.
Best practices usability benchmark studies suggest you keep the session inside one hour. Let’s say you are looking into the usability of a smart phone app or a web app. The session could look something like this:
This format is great at providing a sanity check for the out-of-box experience for any kind of product or service with a software and/or hardware component. Can the end user figure out how to set up a new account and get going without too much groaning and gnashing of teeth? Lots of times they can’t. It is amazing how much you can learn about the onboarding process for new customers by watching subjects struggle through the product setup process. It is very hard to keep quiet and not offer suggestions along the way… but the learnings are priceless.
As with all other kinds of research, it is healthy to invite the entire team to watch - particularly engineering team members. This is the best way to help them understand who they are designing for, and why certain feature enhancements are necessary to ensure an awesome user experience.
At some point you will be ready to go beyond the qualitative approach and get into quantitative research. Have a look at this article about when and how to go from qualitative to quantitative research, and how to make it work for you.
This post originally appeared on the ConceptSpring blog by Elaine Chen.
3 articles