Tag: Questionnaire Tips - DataForce Survey Research Services

Five Ways to Avoid Survey Response Fatigue
Gallery
Five Ways to Avoid Survey Response Fatigue

Survey Mailing Services

Five Ways to Avoid Survey Response Fatigue

We are now in an age where sending feedback requests or surveys has never been so easy. Technology has made online surveys popular and has streamlined telephone and mail surveys to be convenient as well. Target audiences are being flooded by survey requests that survey fatigue is inevitably happening.

Survey fatigue occurs when people are discouraged in responding to surveys because they are overwhelmed with the number of questions on a survey or bombarded with numerous surveys. In fact, in 2012, a report was made by Pew Research, their telephone survey response rates have dropped from 36% in 1997 to a mere 9%. With these results, it is essential to understand how to reduce survey response fatigue to improve overall survey response rates. Below we’ve listed five ways to avoid survey response fatigue for the benefit of your data collection project.

1. Filter Questions

Create surveys that will provide you with the most relevant and needed information. Remove unnecessary questions and use responses on earlier questions to further filter the survey from items that are looking for similar answers (although the way of questioning is different). Avoid gathering as much data as you can on a survey, instead keep your questions focused on meeting your survey goals.

2. Time Your Survey

Fewer questions do not automatically mean a shorter time for respondents to answer the survey. The survey questions’ complexity is a significant factor, so make sure to test the survey and how long it takes to finish. Surveys that take too long can tire participants, which results in lower quality data, non-completion, or total abandonment.

Manage expectations by advising respondents on how long the survey will take before they begin.

3. Keep Your Respondents in Mind

Focus not just on your research goals but on the people who will be providing data. Think about how they will feel about the questions, survey layout, and response options. Make notes on challenges or roadblocks the respondents may encounter, as well as check for bias in questions and remove them. Balancing the demand from stakeholders for additional data while maintaining a level of empathy will ultimately give you better data.

4. Communicate the Value

A study by Vision Critical determined that people are more likely to do a survey when they feel their opinion matters. Accordingly, a majority of the respondents (87%) claim they took the survey because they believed it would contribute to making a difference in a company’s product or services. For example: Advising respondents that the survey will help the business create their new menu will motivate respondents to participate, especially regular customers. It would also be helpful if the request came from someone with authority, like the owner of the establishment, to emphasize the importance of the survey.

5. Show Appreciation

Value the time and effort of your respondents. Provide respondents with incentives such as cash, promotion, or gift card. Check out our post on 3 Survey Incentives to Explode Your Response Rate. Another way to show appreciation is by allowing them to find out the results of the survey. Post the results online and reveal how the survey results are improving the brand.

There you have it, Five Ways to Avoid Survey Response Fatigue for your respondents to have a more pleasant survey experience, and get you higher response rates and quality data.

For more information on survey research services, Mail Surveys and Data Collection in general, contact DataForce!

By Zoula Shalice|2020-06-22T20:41:30+00:00June 20th, 2020|Survey Mailing Services|0 Comments

What is a Likert Scale and How to Create One
Gallery
What is a Likert Scale and How to Create One

Survey Mailing Services, Survey Research Services, Uncategorized

What is a Likert Scale and How to Create One

Are you interested in finding out what you can use to measure questions that are neither agreed nor disagreed? A Likert scale can help you measure attitudes and opinions with a greater degree of nuance than simple binary questions, which offer only two answer options. Please read our blog post to learn what is a Likert scale and how to create one for your next survey.

1. What is a Likert scale?

The Likert scale is one of the most popular rating scales developed to measure one’s attitudes or opinions. Fixed choice response formats are used to determine how people feel about the topic, products, services, or experience. The scale deems that the strength/intensity of the experience is linear. These linear scales measure points of agreement/disagreement. People are given five to seven choices, or even nine balanced responses, that often come with a neutral point.

2. Common Likert Scale Question

A Likert scale does not have a fixed number of leveled items. Many researchers use five levels, but some also use 4, 7, 9, and even 10-leveled items. Since adding more levels produces diverse valuations, a 5 or 7 level scale is most often ideal for avoiding extreme options by obtaining just a bit of variation.

Below are some examples of Likert scale questions and answers:

a. Agreement

The employee training provided the knowledge I need to do my work efficiently.

Strongly Disagree
Disagree
Undecided
Agree
Strongly Agree

b. Satisfaction

How satisfied are you with our customer support?

Highly Dissatisfied
Dissatisfied
Neutral
Satisfied
Highly Satisfied

c. Frequency

How often do you visit our store?

Very Frequently
Frequently
Occasionally
Rarely
Never

3. When to Use Likert Scales

Likert scale is useful in measuring the general feeling or opinion of a particular topic, product, services or experience, and collecting additional data on the factors that contribute to those feelings or opinions. However, a Likert scale should only be used when the question items are related to each other and can be presented in a degree-scale form. Since respondents are not limited to a yes/no answer, a Likert scale allows researchers to obtain quantitative data that can be easily analyzed. Nevertheless, a Likert scale may be compromised because of “social desirability”. Social desirability is the bias exhibited by people to present themselves in a positive light in the community. For example, in taboo questions involving sex, illegal drugs, or racism, respondents may heighten “good behavior” or depress “bad” or undesirable behavior of their responses. One way to reduce social desirability bias is by allowing anonymity on self-administered surveys. A study by Paulhus (1984) found that when respondents have to put their name, address, and telephone number on the survey, results show more positive personality characteristics than an anonymous survey.

4. How to create a Likert Scale

Establish the footing of your survey questions and response scale by first deciding what you want to measure. It is best to use a Likert scale when several factors are influencing the way your respondents feel about something. For instance, you want to measure patient satisfaction. Many factors affect patient satisfaction, including affordability, general behavior of doctors, amenities, and administrative procedures. The respondents’ opinions, attitudes, feelings, or experience must be measurable in a scale form. Moreover, make sure that there are two well-defined extremes for the response.

For Example:

Recommendation

A Likert scale should have the same number of positive and negative responses.
Stay odd. Provide your respondents with a neutral option.
Use the appropriate description to label response. When you just use numbers, people may obscure which end is affirmative and which is undesirable.
Make sure your survey questions are specific
Use terms that your target audience understands
Avoid bias questions
Avoid long and complicated questions
Avoid double-barreled questions

Check out our post on How to Write Great Survey Questions

You’ve most likely encountered Likert scale questionnaires without even knowing it. Likert scale questions are valuable for assessing people’s opinions on a specific topic when undertaking in-depth research.

For more information on data collection techniques or any aspect of mail survey management, contact us today! We provide outstanding quantitative data collection services and paper scanning services!

Get more information on – survey research services incentive fulfillment services or survey mailing services

By Zoula Shalice|2020-05-28T12:55:47+00:00May 19th, 2020|Survey Mailing Services, Survey Research Services, Uncategorized|0 Comments

How to Pick the Right Respondents for Your Survey
Gallery
How to Pick the Right Respondents for Your Survey

Survey Research Services

How to Pick the Right Respondents for Your Survey

In our blog on “Choosing the right sample size”, we provided a formula to ensure your target population is represented accurately. Knowing that number early is important for determining your mail quantity and bidding out your project to vendors. However, it is only half the equation in survey sampling. The other half is making sure you pick the right people.

So how do you choose the participants?

1. Define Your Target Population

Before you can choose survey participants, you need to define the common binding characteristics or traits of the overall population. For example, “government employees” or “existing customers.” These are often combined with other characteristics: “government employees who use iPhones” or “existing customers who have utilized a particular service.” It is imperative to select the most appropriate target population to satisfy the objectives of the survey.

2. Identify Your List Source

Some survey samples are easier to generate than others. For example, if you are surveying your existing customers, you likely already have everything you need in your company database. But if your target is “Latina women 25-40 who shop online,” you may have some work to do. In this case, you may want to look for available public data or purchase a list from a sample provider. Once you determine the list you need, then you become better positioned to choose a sampling method and pick your respondents.

3. Choose a Sampling Method

There are many scientific ways to select a sample. They can be divided into two groups: probability and non-probability sampling. Probability sampling is any method that utilizes random selection like drawing straws or randomized computer selection. Everyone in a target group has an equal probability of being chosen. It is the preferred method of researchers because it accounts for bias and sampling error.

But sometimes probability sampling is not feasible, either due to time constraints or list accessibility. In that case, non-probability sampling is used. People must still meet common binding criteria, but they are chosen in such places as a mall or a busy neighborhood. Such samples are often useful but don’t account as easily for bias and sampling error.

Depending on the needs of your study, you will typically choose from one of the following common methods:

Random Sampling – The purest form of probability sampling. The most basic example of this technique would be the lottery method.
Stratified Sampling – Identifies a subset of the target population such as fathers, teachers, females, etc., and selects them at random.
Systematic Sampling– Uses every Nth name in a target list, where N is a variable of your choosing.
Convenience Sampling – A non-probability method used when only a few members of the target population are available.
Quota Sampling – Uses subset criteria like stratified, but doesn’t randomize their selection.
Purposive Sampling – A method that uses predefined criteria with a purpose in mind. For example, gauging the perceptions of Caucasian females between 30-40 years old on a new product but not randomize their selection.

Survey sampling is a critical part of data collection. Your survey provider can help you weigh these options for your survey to ensure you get the quality data you need. For more information on survey sampling or any aspect of mail survey management, contact us today!

By Damon Young|2020-03-30T19:45:29+00:00January 13th, 2020|Survey Research Services|0 Comments

How to Write Great Survey Questions
Gallery
How to Write Great Survey Questions

Survey Research Services

How to Write Great Survey Questions

When starting a survey project, most people look forward to the fun, creative part of writing the questions. However, it doesn’t take long to realize that writing great survey questions is not as easy as it looks. Questionnaire design is more science than art – requiring critical attention be paid to question and answer order, structure and phrasing to ensure you get the reliable, quality feedback you are looking for.

A simple question, such as “How much did you enjoy the program?” could wreak havoc in your results, because it is inherently biased towards a positive response. “How did you feel about the program?” would be a more effective approach. Other pitfalls include asking multi-part questions, having overlapping answer choices, or asking the more difficult questions too early.

But have no fear. Outlined below are the basic principles of questionnaire design, along with some helpful tips, that will have you writing great, effective survey questions in no time:

Before You can Start Writing Great Survey Questions

- Know your objectives. Write down the purpose of your survey scanning, what information you need, and how you plan to use the data.

Work backwards. Make a list of the specific answers you need first, and then use that to drive your questionnaire.

Basic Guidelines for Writing Great Survey Questions

- Keep questions focused. Make sure each question is designed for specific feedback. Avoid double-barrel questions like “How do you feel about our products and services?” as some respondents will focus on products and others on services. Instead, separate them into two questions.

- Put easier questions first. This will increase participation and establish trust. By getting comfortable with the survey research by answering a few less complex questions first, your participants will be more likely to answer the more complex or sensitive questions later.

- Organize by topic. Similar questions should be grouped together so the questionnaire flows naturally.

- Keep it short and simple. Questions should be short, focused, and easy to answer. This will ensure a higher response rate and limit survey fatigue.

- Be consistent. Use uniform rating scales, word choices and definitions throughout your survey. If you start with 1=low and 5=high, stick with that format.

- Be precise. Avoid generic answer choices like “sometimes” and “rarely”. Use actual numbers instead (e.g, “more than 3 times per week”).

- Be balanced. Provide an equal number of positive and negative response options.

- Be complete. Include all possible answers, and make sure there is no overlap between answer options.

Eliminate bias. Try to construct the questions as objectively as possible. Avoid leading questions like, “Can you see why this product was voted best in customer satisfaction?” Instead, ask how they would describe their satisfaction level.

Common Question Types

Survey questions fall into two categories: Structured (fixed response) where they choose from a provided list of answer options and Non-structured (open-ended) where they can fill in their own text or numeric answer. Both are extremely useful, depending on the type of feedback you need.

Following are the most commonly used question types:

Multiple Choice

These are questions with two or more answer options. These are useful for collecting structured responses.

Single Response Style (select one answer)

Example 1: Do you smoke? Y / N

Example 2: If yes, how many cigarettes do you smoke per day?

use multiple choice to write great survey questions

A common pitfall here is missing a possible response. Depending on your question, you may need to add a choice called “none”, or if you would like additional details, you could try an “other” option with space for a written response. You also want to make sure there is no overlap, such as using 10-20, 20-30, etc. in the previous example, which would clearly taint the results.

Multiple Response Style (you may select more than one answer)

Example 1: What is your race? (check all that apply)

Rating Scales

Rating scales ask respondents to rate how much they agree with a certain statement using a common scale (e.g, 1 to 5, where 1=low and 5=high). These are useful for gauging their opinions, attitudes and behaviors. When using rating scales, it is important to make sure you have a neutral option and a balanced, equal number of positive and negative responses. Scales most commonly use 5 or 7 options.

Example 1: The teacher was knowledgeable.

Example 2: How would you describe your experience navigating the instruction manual.

Common pitfalls here include being inconsistent with your scales (leading some respondents to answer incorrectly) and asking leading questions, such as, “We pride ourselves on our easy-to-use manuals. How easy was our manual to read?”

Ranking Scales

These ask respondents to rank a list of items in order (e.g, from favorite to least favorite, or most important to least important). It is recommended that you use these with caution. They are known to be reliable at determining first and last place, but not so much the fuzzy middle, as respondents often have to choose a pecking order for items that are essentially of equal value to them.

Example 1: Please rank the following customer service features in order of most to least important when contacting our agency by phone (1=most important, 5=least important)

Open-Ended Questions

These are questions with no provided answers options. Respondents answer by writing in their own text. These are great for eliciting responses about attitudes and opinions in a respondent’s own words, or having them provide a numeric answer without a suggested range. The downside is it requires extra time, can cause survey abandonment, and makes data collection and analysis more challenging.

Example: Name two ways we could have improved your customer experience today?

Questionnaire integrity is critical for getting quality data. By following these tips and guidelines, you will be well on your way to success.

For more information on question and survey design or any aspect of survey mail management, contact us today!

By Damon Young|2019-03-20T10:51:08+00:00December 6th, 2018|Survey Research Services|0 Comments

Choosing the Right Sample Size
Gallery
Choosing the Right Sample Size

Survey Research Services

Choosing the Right Sample Size

Choosing the right sample size is vital to accurate survey outcomes. With the right number of survey respondents, your target population will be represented with acceptable accuracy. Although it may seem like a simple undertaking, you must put a lot of thought into determining your survey’s most effective sample size.

In most cases, the larger your sample size, the more confident you can be that the responses you receive reflect the total target population. However, there is another side to that coin. Deciding on a larger sample size requires you to distribute more surveys, and that drives up the cost of your survey project.

It’s not as simple as randomly selecting a large sample size and assuming that will equate to successful response rates. The pitfall of using no forethought when selecting a sample size is that you may select a sample that is not statistically significant or will cause you to exceed your budget. To arrive at your optimum sample size, you must start by asking a few key questions.

1. How Large Is Your Target Population?

You can begin to understand your sample size needs by first determining the size of the total population of possible respondents. If you want to understand something more large-scale, such as how grocery shoppers are using mobile devices, you will need to use a larger sample size. That’s because there are millions of grocery shoppers who use mobile devices. On the other hand, if you want to assess a smaller, more specific group, such as the opinions of the faculty at a particular university, the population is limited to a few thousand or even a few hundred.

2. How Accurate Do You Need to Be in Choosing the Right Sample Size?

Because you are only using a small sample group out of a larger target population, you must now make some decisions about accuracy. Your accuracy will depend on choosing an acceptable margin of error and accepted confidence level.

Your margin of error measures how well the responses from your sample reflect the opinions of your entire target population. A commonly chosen margin of error is 5%. You must also keep in mind that lower margins of error require a larger sample size.

Your confidence level represents the degree to which your sample is an accurate sample of the population. If you decide your project requires a 95% confidence level, you are declaring that if you repeated your survey, you would get the same results 95% of the time. Higher confidence levels require a larger sample size.

3. What Is Your Expected Response Rate?

Arriving at an answer to the first two questions is relatively straightforward. First, determine the size of your target population. Then decide how accurate you want your survey results to be.

Now, on to the challenging part: estimating what your response rate will be. Estimating your response rate is often difficult; there are many factors that contribute to a respondent’s decision to complete and return your survey. The list of factors includes:

- Questionnaire length
- Question complexity
- Importance of the survey to the respondent
- Level of respondent interest in the survey
- Availability of incentives

Fortunately, you are in control of most of these factors. Depending on your target population and the decisions you make about how you will administer your survey, your response rate can range from 1% to 60%. Lower expected response rates require a larger sample size.

For more tips on Survey Design, check our blog post on How to Write Great Survey Questions.

Working with an Experienced Survey Administration Partner in Choosing the Right Sample Size

Your sample size has a direct impact on the validity and cost of your survey. Consequently, it’s crucial that you get that number right. Once you have determined the right sample size for your survey, there’s still more work to do. How will you distribute the surveys? How will you gather them and analyze the outcomes?

This is where your survey administration partner can add value to the process. When you work with an experienced vendor, they can consult with you about the nature of your survey research and suggest choices that will help you achieve your goals in an efficient and cost-effective manner.

Your partner can help you measure your target population and decide on an appropriate margin of error and confidence level. In addition—although no two survey projects are ever exactly alike—your partner can rely on their experience with working with a wide range of organizations and projects to help predict what your response rate might be.

When you are planning your next survey project—and trying to understand your optimal sample size—consider getting help from an experienced survey administration partner.

If you’d like more information on incentives, project consulting services, survey research services, incentive fulfillment or survey mailing services in general, contact us today!

By wpdataforce|2019-05-24T19:47:16+00:00March 6th, 2018|Survey Research Services|0 Comments