Market Research » Practical sampling methods in research with examples

Practical sampling methods in research with examples

by

Sampling Methods in Research Guy 1

Find practical sampling methods in research and choose the best methodology for your next study

You might also like…

10 Business Uses for Conjoint Analysis

10 Business Uses for Conjoint Analysis

Conjoint Analysis, also called Discrete Choice Modeling is a research method and statistical technique used by researchers and marketers worldwide. It is a way to examine choices made by decision-makers based on various available features, pricing, and brands…

read more
The Guttman Scale: Definition and Basics

The Guttman Scale: Definition and Basics

Research within the social sciences is developed, carried out, and interpreted a little differently than, let’s say, medicine. Quantifying human attributes, opinions, and behavior to measure them and infer conclusions required a shift from conventional research methodologies…

read more
Customer Journey Mapping for Market Researchers

Customer Journey Mapping for Market Researchers

Today, every aspect of digital marketing and the all-embracing marketing umbrella is led by those on the other end of these interactions – the customers. Instead of asking how you can get the customer to do what the marketers intend, the question focuses on eliciting solutions for helping the customer achieve their goals while fulfilling yours…

read more

What practical sampling methods should be in every researcher’s toolkit?

 

When designing research that includes writing survey questions and considering sampling methods for online survey research, online focus groups, or other types of data collection methods…

which will likely prompt the following sampling methods related questions…

 

  • What types of sampling methods should you consider for your research?
  • What sampling methods are used for online surveys?
  • How does each technique affect the sampling process?
  • What confidence should you have in the results?
  • Can you draw statistical inferences from the data to project results?

 

 

What information is needed to choose the proper sampling method in research for my study?

 

Choosing a sampling method requires stating the problem you are solving first. Practically speaking, this requires identifying the target population and being clear on the hypothesis or rather null-hypothesis you are testing.

 

Begin with understanding who, what, why, where, when, and how questions. Answers to the following example queries can help you determine the target population to sample and identify a source or sample frame:

 

  • To whom should I market my product or service, and how will they respond?
  • What impact is my candidate’s message making on moving the needle?
  • How will my employees respond to a compensation change?
  • Which fundraising campaign will be most accepted, or where will dollars be most impactful.

 

These and many similar questions typically drive an organization’s desire to conduct market research, political research, or organizational research. You can be confident in designing the proper test and picking a sampling methodology to support your research goals…

 

If you plan to embark on such an effort, the next step is choosing a sample frame.

 

 

 

What is a sample frame and how does it help you collect a sample?

 

Collecting your sample implies you have a source or list of all the target population members from which to draw a sample and a method by which you will select the sample. A source can be any resource that contains the information required to contact every member of the target population. Examples may include…

 

  • A list of registered voters from the county,
  • A database of members of a national association,
  • Geographically defined exchange blocks for computer-generated RDD telephone sample.
  • A representative online panel of a country or other defined group

 

These are also referred to as your sample frame. It is important to note that a sample frame must include all eligible members of the target population. Each entry must be unique and have a unique identifier, and must have a method of contacting the member (preferably via the chosen data collection methodology).

 

 

Sample frame respondent contact methods and options

 

 

Data Collection Method Contact Method
Online Email Address
Mobile Mobile Phone Number
Telephone Landline RDD Block Sampling
Mail Survey Physical Mailing Address
Face-to-Face Intercept Mall or other locations where a target population will show up

 

 

Important questions to consider during sampling frame selection

 

What is the sample size?

How many responses do I need? (sample size). This depends on several factors, including your need for precision.

Is the sample qualified?

Do members selected in this sample frame match the qualifications for the study target population? (is this qualified list of members a sample representative of a total population)

Is the sample representative?

How do I ensure all qualified subjects are included in the selection process? (sampling bias).

How do you ensure subgroups are represented?

How how do I avoid excluding subgroup subjects from the sampling frame? (selection bias),  and properly use quotas to ensure all subgroup individuals are represented? (non-response bias).

How accurate are the results?

With what degree of precision (margin of error) can I forecast or state my conclusions? This sampling error is about the statistical accuracy of estimates from the target population,  confidence interval,  and sample size.

How accurate are the results?

With what degree of precision (margin of error) can I forecast or state my conclusions? This sampling error is about the statistical precision of estimates from the target population,  confidence interval,  and sample size.

 

 

What type of sampling methods are used in online research?

 

Using internet data collection methodology, sampling theory (basic methods) are not applied differently than when using other methodologies such as phone or mail surveys.

 

For decades into the internet research age, many research professionals still rely on offline data collection methods despite their high cost, non-response bias, and other inefficiencies. Yet, there are still legitimate use cases for these tools today.

 

With the popularity of online research, principally due to the speed, relatively lower costs, and access to targeted audiences, many research practitioners ask:

 

What kind of sampling method is an online survey?

 

The answer to this question highlights the main point of what this sampling article seeks to address, which is regardless of data collection medium: internet, phone, mail, door to door, or telepathy – it is the way you sample and not the data collection medium that is important.

 

All mediums have limitations and also strengths with regard to each sampling method for each given use case.

 

This is why if you are doing online qualitative interviews in:

  • China,
  • Cincinnati or,
  • Katmandu,

 

or quantitative online surveys with,

  • N=100 Alaskan crab fishers or,
  • Brand tracking with N=7000 13 to 39-year-old millennials every month,

 

any of the above-mentioned example project samples may be considered online research, and independently each of those may be different sampling methods. The panel provider you work with should address how they design and select sample frames for your specific research.

Use this Sample Size Calculator to Estimate Your Sample Size

 

  • Population total: Give the number of people that your survey results will be representing. This is not your sample size, but the entire population you are trying to represent. Examples would be The State of California (39.51 million) or Pacific Gas & Electric (PG&E) customers (16 million). Enter your target population total.
  • Margin of error:  The margin of error represents how precise your results will be. The margin of error represents the difference in proportion from the true proportion that is acceptable to the researcher. In the social sciences, five percent is an acceptable margin of error. You can change the margin of error depending on your precision needs. If you have no preference, choose five percent default. Sample size increases as the margin of error decreases.
  • Confidence level: Select the reliability level. In statistics, this a measure of the reliability of a result. A confidence level of 95 percent means there is a probability of at least 95 percent the result is within a given range. Increasing the confidence level will increase the sample size.

 

What types of sampling methods for research should you consider for your study design?

 

The principal methods used by market research experts are probability and non-probability sampling.

 

Within both of these categories are subgroups that define how to obtain your sample more clearly, each carrying its own advantages and disadvantages to the researcher seeking the data.

 

 

What are probability sampling methods, and how are they used?

 

In probability sampling, every individual in the entire population being considered has an equal chance of being randomly selected for the survey, interview, or questionnaire. The selection process is completely random, and therefore, the sample is likely to be closely representative of the whole population.

 

Probability sampling is best used in market research requiring quantitative results. Typically, probability sampling results involve a great deal of number crunching and statistical charts and graphs.

 

 

using sampling methods in research

 

 

Four probability sampling methods used in market research

 

 

Simple Random Sampling Method

 

There are generally two principal ways to make a random selection when building a sampling frame. When the sample size is smaller, one standard method is to use simple random sampling, which gives every individual in the target population an equal chance of being selected by generating a series of random numbers. When you have a larger population, deploy a systematic approach described below or use cluster or stratified methods.

 

 

Cluster Sampling

 

Cluster sampling involves two stages. In stage one, the market researcher selects a certain number of groups or clusters of people to question or interview. In stage two, a random sample within each cluster is selected for the actual study.

 

Cluster sampling works best when a random sampling method of an entire population is too expensive, impossible, or extremely complicated. This method is a less expensive and faster way to collect market research information. However, since it’s not a completely random sampling, you are more likely to generate a sampling error.

 

One example of good use for this research sampling method may involve collecting customer preferences for a large, national hotel chain. It would be difficult, expensive, and time-consuming to collect information about every customer visiting every location of a hotel chain. However, you can select a dozen locations around the country in stage one of a cluster sample and then randomly select guests at each of those 12 locations over the course of a month for your b2b research.

 

Perhaps you are collecting insights about new hotel services you’re thinking about adding. Customer preferences shared through such a cluster sample would probably be reasonably representative and usable for making such decisions. Precision is not extremely important in this case, and therefore, the cost and time savings would outweigh the need for conducting a completely randomized survey.

 

 

Stratified Sampling

 

Stratified sampling is where the overall population is divided into mutually exclusive groups before a random sample is selected. You might want to sub-divide your group by gender, race, income levels, or age. Each person can only belong to one stratum or group.

 

Businesses or organizations looking for a high level of precision or the ability to analyze information within the smaller subgroups and the overall population may want to invest in stratified sampling. Since a representative group will be selected from each stratum, the actual sample can be smaller, saving time and money.

 

Customer Experience and Brand Tracking Studies are most often stratified samples to ensure representation from all customer segments. However, they may be defined.

 

Depending on your population and research goals, you’ll want to decide if you will use a proportionate or disproportionate stratification. Proportionate stratification can increase your precision because the actual sampling fraction of people will be proportionate to your entire population, which may not be the case in a completely randomized sample.

 

Disproportionate stratification can help market researchers when there are significant variances among the strata. You may gain precision for a particular survey measure; however, this precision may not carry across other components of the research.

 

 

Systematic Sample

 

Systematic sampling is an easy version of probability sampling because researchers select every nth individual on a population list. As long as the population list does not contain any pre-organization, the resulting sampling should be representative. This method of sampling is simple, fast, and effective in most market research situations. All that is necessary is a list of the population, a starting point, and a sampling interval.

 

For example, if you want to collect data from a trade association with 10,000 members, you can select every 100th person (sampling interval) on a membership roster to create a survey group of 100. One example of a potential problem with systematic sampling would be a list that is organized before the sample is selected.

 

For instance, if you are questioning coaches and players of an adult sporting league about tournament locations, and the list is made up of team sub-lists that always place two coaches followed by 20 team members, you run the risk of either soliciting feedback from all coaches or no coaches depending on your interval selection.

 

 

 

Sampling methods infographic

 

 

 

 

What are non-probability sampling methods, and when are they used?

 

Non-probability sampling is, obviously, the opposite of probability sampling. Often referred to as purposive sampling collectively, the selection process within the various methods is not random, and therefore, subject to research to greater bias and more sampling errors. The results of non-probability sampling are often helpful before or after a market research project involving probability sampling. For instance, the ideas generated can be used to create a quantitative survey for a randomized sample of your population. A non-probability sample can help flesh out and clarify topics that come out of a randomized survey.

 

 

Three non-probability sampling methods used in market research

 

 

Convenience Sampling Method

 

Convenience sampling is a quick-and-easy way to select your research subjects. Because they are the ones most convenient for your particular research project, this factor means that it’s faster, easier, and cheaper to conduct your research. The major disadvantage is that (depending on the type of convenience sampling you are using) you can introduce significant bias or sampling errors using this method.

 

One common example of convenience sampling is in a university setting where graduate students use volunteer undergraduate students as experiments. In other cases, a researcher may select the people who happen to shop at a particular store on one day, mall shoppers, or the first dozen clients on a business’ customer list.

 

There are hybrids for convenience samples in online research where you draw random samples from a universe of participants with certain characteristics using behavioral data and other targeting methods. It’s a targeted convenience sample but still random. The question becomes low incidence categories; is it really better to screen through 10,000 people to get 100 people who qualify for a one percent incidence study? Most likely, it’s cost and time prohibitive if you consider all the pros and cons.

 

Quota Sampling

 

Categorized as a non-probability sampling technique, quota sampling enlists study participants until a relevant research category (or quota) has recruited enough respondents to reach holistic conclusions.

 

Unlike random sampling strategies where every member of a target population has an equal chance of being selected, quota sampling relies more on convenience sampling. This means that researchers use their own judgment regarding how many people they need to survey to acquire reasonable and authentic results.

 

Judgmental Sampling

 

Judgmental sampling is a technique where researchers use their own rationale to select a sample based on personal knowledge and expertise. This produces a bias in the sample, but purposive sampling research methods can be useful when studying particular groups within the population.

 

For example, if a researcher collects insights on patients suffering from a rare disease, it would make more sense to find those individuals directly. The advantage of judgmental sampling is that you question the exact type of person you’re seeking for your research project. The major disadvantage is that you will most likely introduce human error and researcher bias into the results. As a result, it would be unwise to make generalizations to a greater population based on the results of a judgmental sample study.

 

Sampling methods conclusions

 

Once you’ve determined your market research project’s goals and objectives, you can make a smarter decision about which type of sampling methodology to use. As you can see from this primer, you need to balance your requirements for precision against the cost and time requirements of each sampling method. If you’re seeking quantitative results, it’s best to use one probability sampling method or hybrids.

 

If you are looking to conduct qualitative data analysis, one of the non-probability sampling methods may deliver the sample you need at a much lower cost and time investment. Working with a market research expert will help you better match your research requirements to the research sampling method and give you the greatest return on your investment.

 

 

Follow OvationMR

 Jim Whaley is a business leader, market research expert, and writer. He posts frequently on The Standard Ovation and other industry blogs.

OvationMR is a global provider of first-party data for those seeking solutions that require information for informed business decisions.

OvationMR is a leader in delivering insights and reliable results across a variety of industry sectors around the globe consistently for market research professionals and management consultants.

Visit: https://www.ovationmr.com.

OvationMR sampling methods in research contact form logo

 

Need help with your project?

 

We are ready to get to work for you by providing:

N

Our latest Panel Book, ESOMAR28 response

N

An open dialogue about your requirements

N

A project estimate/proposal

info@ovationmr.com

+1.212.653.8750

39 Broadway, Suite 2010, New York, NY 10006 USA

M-F: 8am-5pm, S-S: Closed

OvationMR Logo for Contact OvationMR

           Visit Us:

 

           39 Broadway

               Suite 2010

New York, NY 10006

 

OvationMR Market Research

     Visit Us:

  • 39 Broadway
  • Suite 2010
  • New York, NY 10006