Any monkey can do it
Guest blog from Leanna Comer, president of our research division.
I just returned from vacation. In my email inbox was a survey from one of the hotels where we stayed. I make my living conducting market research, so of course, I clicked on the link to participate. Early in the survey, I was asked if I used the wireless Internet in the room during my stay, and I clicked “no.” Why, then, was I later subjected to several more questions about the wireless Internet service in a series of questions about the amenities the hotel offered—how satisfied was I with the ease of logging on, how helpful was the staff in answering my questions, how satisfied was I with the speed, how much time did I spend on the Internet? Sure, I could click “not applicable,” which I did, but I shouldn’t have had the burden of doing so since I’d already said I did not use the Internet during my stay.
Also in my inbox was an article on intelligent survey design, in which the author noted, “The advent of user-friendly online survey tools in recent years has created the illusion that anybody can write a survey questionnaire. After all, how hard can it be?” Online survey companies, like Zoomerang and Survey Monkey, are certainly both user-friendly and cost-efficient tools in a market researcher’s arsenal. The key word here, however, is tools. Just as my holding a scalpel wouldn’t make me a surgeon, someone armed with Survey Monkey and a burning question does not a market researcher make. Over the years, a lot of damage has been done to the market research industry by sloppy research methods and horribly designed questionnaires. And online survey tools, although quite useful when used properly, have certainly served to exacerbate that problem when they’re not.
As someone who has devoted my career to market research, if I’m invited to participate in a survey, I typically oblige. However, I can’t tell you how many online surveys I’ve abandoned in recent years because it was so incredibly painful to participate. Poorly worded questions, branch logic that obviously didn’t work, extremely biased questions, response categories that weren’t mutually exclusive (or worse, didn’t include all possible options yet required an answer), surveys rife with typographical errors—I’ve seen it all. With each and every one of those survey experiences, I recognize and can appreciate why it’s getting harder and harder to persuade people to participate in the studies we conduct for our clients. No one wants to participate in a bad survey, and, trust me, there are lots of them out there.
One of our clients—a professional association with several thousand members—uses Preston-Osborne to conduct their comprehensive research studies. They supplement those studies, though, with quick online surveys they manage themselves when they need to poll their membership on a single issue or simple matter. But here’s the great part: They enlist our expertise in designing the survey questionnaire before they field it. If only more folks out there would seek the advice of a market research professional before launching their own online survey then perhaps painful survey experiences would become less commonplace…and that would benefit us all—researchers and participants alike.
(Stepping off my soapbox now.)


