|
|
|
UNDERSTANDING OUR
RESEARCH METHODOLOGY
|
|
Experience |
Understanding the Design |
|
Parks Associates provides consulting as well as quantitative
and qualitative research and project design to help you make the
best product and business decisions while maximizing your
resources. We have more
than 15 years of experience examining residential technologies. Our market analyses combine primary consumer research with
industry knowledge, giving our clients a comprehensive demand- and
supply-side view of emerging markets.
Our research
covers the entire value chain and the multiple intersections where
computing touches entertainment, home control, security,
communications, and consumer avocations. |
What's the typical design for custom
research?
Why bother with
focus groups?
How
do you gather quantitative data?
What is a national
sample?
Why do you have to oversample
to provide results for a specific segment of the population?
Why not
sample even more households?
How can I ever know that the consumer research I receive will hold
up?
Developing a questionnaire doesn't seem that hard. What's the big
deal?
|
|
Q: What's the typical design for custom research? |
To
fulfill strategic research on emerging consumer areas, Parks
Associates typically recommends a combination of tacks:
- An Executive Summary of existing research compilation from
Parks Associates’ consumer and industry research.
- Qualitative research in the form of:
- focus groups; and/or
- one-on-one interviews.
- Quantitative Research with Appropriate Population Sets
Parks Associates seeks to provide its clients with the most
meaningful research at its disposal while also keeping an eye on
cost effectiveness. Thus, we typically propose compiling both our
own and available consumer and industry research as a precursor to
custom consumer research or as an adjunct to help manage costs.
^ top
|
|
Q: WHY BOTHER
WITH FOCUS GROUPS? |
|
A: To get in touch with real people. Parks Associates recommends hosting focus groups or one-on-one
research before fielding large national studies for a variety of
reasons. Focus groups cannot, of course, generalize to the total
population, but they have significant value, well beyond even
their dollar cost, when completed in a manner that optimizes their
research output potential. When competently completed, focus
groups provide:
- Target segments’ attitudes, general understanding, use of
language, and even objections towards the areas under
investigation.
- Moreover, focus groups allow mapping of the consumer
thinking process.
- Focus groups manage to allow both spontaneity and discussion
among participants as well as mapping development of the
underlying thinking structure about the topic under
investigation.
We consider focus groups as a near prerequisite
before developing quantitative studies on new ideas and new
products. After focus groups or one-on-ones are completed and
analyzed, the derived information has its own value and aids in
ensuring that national questionnaires are well-formed, using both
language and attitudes that guarantee meaningful results.
^ top |
|
Q: How do
you gather quantitative data? |
|
A: Telephone, Internet, and/or mail surveys tailored to
client's needs and information desired
Since statistical research is
expensive and has inherent time constraints, the best research is
streamlined, asking only what information is desired and useful in
language meaningful to the audience.
Defining specific population sets and surveying methodology are
dependent on the information desired and the client. Parks
Associates uses telephone, Internet, and mail surveys but prefers either online research or telephone-based surveying to
ensure good responses with statistical value.
Telephone surveys allow for validation (ability to listen in to
surveying at the rate of 10% - 15%), which helps us assure that
the approach remains constant. In addition, we can pre-test our
surveys quickly and then correct any misunderstood questions
should they occur. Mail can also be pretested, but it is slower.
^ top |
|
Q: WHAT IS A NATIONAL
SAMPLE? |
|
A: A survey of enough participants that the results are
considered representative of the U.S. population. A
national sample is a survey that has enough participants so the
results are considered representative of the U.S. population as a
whole and can be matched to the most recently available census
information about US households. Random digit dial is one method
helps surveyors meet the requirements for this representation. The
traditional sample size to provide adequate coverage of various U.S.
family characteristics is between 995 and 1006. The surveyors
determine the appropriate breakdown of households to ensure that
the results are representative across income, marital status, age,
and ethnicity. The sample number suggested provides a +/- 3%
statistical validity rate. To get a better rate than that, say +/-
2.5%, requires a substantial increase in survey numbers and is
typically deemed too expensive while providing only minimal
benefits.
^ top |
|
Q: WHY DO YOU
HAVE TO OVERSAMPLE? |
|
A: Sometimes a national sample isn't specific enough. Using
a national sample doesn't provide a survey volume robust enough to
determine valid differences in the specific population. Say, for
example, that we determine that 20% of US households have a
bilingual household member. In a sample of 1,000, we'll then have
200 bilingual households. Breaking down that population into
segments creates sets too small for validity. By oversampling, we
ensure that analysis further down the line has validity. For
example, if 30% of bilingual households have children between 10 -
18, our national sample only gives us 60 households to look at in
that category. Validity goes down at that point. By oversampling,
we'll have 120 households to measure. This provides us with higher
statistical validity.
^ top |
|
Q: WHY NOT
SAMPLE EVEN MORE HOUSEHOLDS? |
|
A: It's not worth it.
There
is always a cost/value trade-off. If money were no object, then
high-volume surveys would be considered more often. Since this
situation is not so, the balance lies between completing enough
surveys to provide valid data at a reasonable cost. Four hundred
surveys within a smaller segment (millions versus tens of
millions) typically provide a +/- validity of 4.5% to 5%. That is
good enough. The jump to 3% typically takes that sample back up to
1,000+. The cost per survey is determined by method, difficulty of
finding a sample population, and length of survey. Clearly,
finding neurosurgeons or bilingual households is a more expensive
endeavor than surveying US households in general. That is one
reason to use a national sample to determine exact demographics
and then pinpoint homes with a greater probability of matching
those demographic characteristics.
^ top |
|
Q: HOW CAN I
KNOW THE RESEARCH WILL HOLD UP? |
|
A: Parks Associates couples industry knowledge with a
savvy methodology that produces the data we need to provide expert
analysis. These three components create stable results. Conducting well-done research about existing or past facts is
difficult but clearly obtainable. Using the correct methodology
with clear questions and solid telephone surveys produces
high-quality results. Going beyond stating a "fact," that is, xx%
of people bought y-product, requires industry and distribution
knowledge for proper analysis.
Where the issue gets even murkier is about purchase intentions
and attitudes towards new product and service concepts not yet
diffused in the population. Here a knowledge of history and
patterns of consumer adoption for product types compared to stated
intentions are critical.
The need to marry industry knowledge with research methodology
savvy is essential and at the very core of Parks Associates'
beliefs. All too often, an industry company understands its
industry but completes flawed research because it has no expertise
in that arena. On the other hand, using skilled researchers with
no industry knowledge for analysis is equally dicey in terms of
results.
For example, looking at numbers and facts only in the
work-at-home, two-or-more telephone line population, the data
alone makes it appear that the percentage of work-at-homers
actually went down between 1994 and 1996. Furthermore, the FCC
data makes the number of dual-line households smaller than many
researchers, including Parks Associates, uncovered. What has
caused this disparity? The answer is that between 1994 and 1998,
the RBOCs abandoned policing the tariffs charged within the home.
Now, nearly all home lines are deemed residential and charged
residential tariffs, whether or not the second line is used for
business. In the early 90s, the BOCs screened for this so that it
could charge higher, more profitable rates for commercial lines
where possible. Competition and the desire for incremental revenue
changed this. If your researchers do not know their industries,
you couldn't get the background for proper analysis.
^ top |
|
Q:
WHAT'S THE BIG DEAL WITH THE QUESTIONNAIRE? |
|
A:
Developing an excellent questionnaire is so difficult that it's
almost the same art as excellent programming.
Making
questions uniformly understandable is time-consuming and requires
identifying all possible consumer misconceptions or
misinformation. What is high-speed access? How many people know
the speed of their modem? In addition, there is always more
information desired than time available. Efficiency of wording is
critical. For example, asking:
Do you have a PC at home? If yes, then…
Do you have more than one PC at home? If yes,
then… and so forth takes more time than:
How many PCs do you have in your home?
These nuances are important in every question. Consumer
research is inherently expensive, and it needs to be managed
efficiently.
^ top |
|
Q: YOU DIDN'T ANSWER MY QUESTION. WHO SHOULD I CONTACT? |
|
A: Contact any of us! Providing answers is what we do
best. Check out our CONTACT US
page for specific email addresses and our mailing address, call
972.490.1113, or email
sales@parksassociates.com
^ top
|
|
Subscribe to PARKS
POINTS | View
FAST FACTS
© 1998-2008 Parks Associates. All rights reserved |
CONTACT PARKS
1-800-PARKS11 or
972-490-1113
Design:
FigDesign |
Browse Parks Associates Industry Reports
|
|