Editor's note: Brett Watkins is president of L&E Research.

Qualitative research is a set of methodologies with the common goal of exploring and uncovering the hows and the whys of consumer behavior. Measuring the “how much” is left to quantitative research. This is a simplification but it works as a backdrop against which to highlight examples of change in qualitative research and the environment that supports that change.

Why do we have the categories of qualitative and quantitative? These have been easy monikers to talk about the concepts of “exploration” compared to “confirmation,” “depth of insight” compared to “breadth of insight,” the “immeasurable” contrasted to the “measurable.” But the lines between these categories are quickly blurring.

There are numerous reasons for this, but two of the main forces are business demands and the capabilities afforded by technology. Newton’s first law of motion applies here, as a research department at rest tends to stay at rest – unless that department is acted upon by certain forces. In this case, the forces are speed, cost and the need to respond to useful information.

When corporate researchers were asked about their pain points for this year’s Quirk’s Corporate Researcher Report, too many projects for the staff or budget topped the list as always or often a pain point (60 percent, 50 percent, respectively). When asked about challenges, corporate researchers noted the inability of insights to drive action and not being able to complete projects fast enough as always or often a challenge (50 percent, 42 percent, respectively). 1 2

When looking at the newer methods of research, corporate researchers view qualitative tools (as a whole) as more effective at providing actionable insights. “Online qualitative/focus groups” are viewed by 70 percent of corporate researchers as effective or very effective. Mobile-specific surveys are second (53 percent). But the next couple are also qualitative techniques: social media research (40 percent) and text analytics (52 percent). 3

Taking the premise that actionable insights are the No. 1 goal for corporate researchers and the No. 1 challenge, and that qualitative research (at least among the newer methods) generally does a better job of providing these insights, then it is likely that more energy will be directed here.

At the same time, there is a methodological drag to qualitative research, according to this survey. The top four drivers of methodological choice for a project are: representative sample (82 percent viewed as very or extremely important), proven methodology (69 percent), speed (58 percent) and response rate (52 percent). While qualitative has never been about representation per se, the scale in some tools is pushing that of quantitative. Some of the newer qualitative tools have a good way to go before they are as deemed worthy of a wide variety of use cases but that is changing rapidly. 4

Changing the nature

Technology is changing the nature of qualitative in several different ways:
Scale: We currently have some qualitative information at the scale of quantitative – and a growing ability to analyze that information. The easiest examples are both based in text analytics; customer service information and social media analytics are able to provide some structure to the vast amounts of unstructured data available in their respective data sources. While there are limitations – sample management, response bias, etc. – those only limit some applications. The variety of proven use cases continues to grow, expanding into consumer needs, brand management, operations and more.

Geography: The tools a respondent needs to participate in qualitative research now sit in the purse, pocket or on the kitchen table and thus geography is much less of an issue than it was before. Many of the corporate researchers who are using newer methods, such as online qualitative, mobile ethnography, etc., are doing so to take advantage of the access to consumers in the appropriate environment. Mobile, in particular, has the benefit of providing in-the-moment access in the way that was almost cost-prohibitive using other tools, particularly low-incidence or sensitive topics.

Cost: The “somewhat” lower cost of qualitative methods is also seen as a reason for switching. Several researchers mentioned the cost of online qualitative and communities as reasons for moving away from more traditional qualitative methods. This was generally expressed in terms of travel cost but occasionally as overall project cost. Though it was not mentioned, social media analytics can be very cost-effective depending on the type and frequency of projects.

Depth of insight: Deeper information is available through communities than through other traditional methods. This is a driver of choice for a few researchers who noted that the ongoing nature of a community allows a more longitudinal look at consumers and their product issues.

Speed: Speed is one of the top two corporate researcher challenges. While technology has improved speed-to-insight, in almost all the tools mentioned to this point it is hit-and-miss. Once a social media program or community is up and running, the speed-to-insight is generally improved over traditional methods. But according to one researcher, online qualitative groups are “not a lot faster.” However, the future holds a different story.

The future of qualitative research

Recent advancements signal the future of qualitative research. Text analytics improve month by month. Several companies have had different levels of success in identifying emotional context, purchase probabilities, consumer values and a number of other frameworks that build on our understanding of consumers and their relationship to our products. Other qualitative methodologies have automated processes for understanding the emotional connections consumers develop with products and brands through imagery, metaphors and other projective techniques. Crowdsourcing has been in use for several years but new applications and technologies are able to provide deep understanding of an issue in a cost-effective and timely manner – and at the scale of quantitative research. Artificial intelligence is making its way into marketing research. These tools have been around for a couple of years but have improved dramatically in the past year. Many of these tools measure delivery in hours or days instead of weeks or months.

In addition, we should start to see the synthesis of mobile sensors, shopping or purchase behavior and advertising effectiveness over the next year. This puts the depth of qualitative insights in context with behaviors – which is the holy grail of marketing research.

The future of qualitative research addresses the key pain points of today’s corporate researcher. The lower cost provided by technology and improved user interface will help make the most of constrained resources. Technology is also quickly and significantly improving the time to insights. Experience will prove the application to specific use cases. Scale will reduce the concern about sample representation. And, most importantly, the quality of insights provided by new qualitative methods has and will continue to improve. Many of the newer methods are combining the depth of qualitative with the breadth of quantitative – getting us to the how, the why AND the “how much.”