Podcast: Play in new window | Download
Every survey depends on who answers it. A well designed instrument with a weak response rate can produce data that looks precise and points in the wrong direction, because the people who responded differ from the people who did not. This guide covers what counts as a good response rate, why low rates put your conclusions at risk, and the practical steps that raise them. It draws on my podcast conversation with Sheila Robinson, Ed.D., a career educator, certified program evaluator, and survey design specialist. The full episode is below.
What counts as a good survey response rate
There is no universal target. The response rate you need depends on the population you are surveying, how you reach them, and what is at stake in the decision the data will inform. A program surveying its own active participants should expect a far higher rate than an organization emailing a community sample cold. Representativeness matters more than the raw percentage: whether the people who responded look like the population you need to describe. A 40 percent response rate that matches the population on key demographics can support stronger conclusions than a 70 percent rate drawn mostly from your most engaged participants.
Why low response rates put your data at risk
The core problem is nonresponse bias. People who answer surveys tend to differ from people who do not. They are often more engaged, more satisfied, or simply more available. When those differences relate to what the survey measures, the results tilt. A participant satisfaction survey answered mainly by your program’s most satisfied participants will overstate satisfaction no matter how carefully the questions were written. Low confidence in the data leads to biased findings and incorrect conclusions. On a grant-funded program, those conclusions feed reports that funders act on.
Check the demographic makeup of your respondents against the population you served. That is the fastest way to see whether nonresponse is distorting your data. When key groups are underrepresented, targeted follow-up with those groups does more for data quality than raising the overall rate.
Practical steps that raise response rates
Write the invitation message with care. The invitation is the single most influential piece of text in the whole effort. Tell respondents why the survey exists, how the results will be used, and why their answer matters. People respond when they understand the purpose.
Be transparent about length. State how long the survey takes, and be honest. Respondents commit more readily when they know the time cost up front. An understated estimate damages trust for every survey that follows.
Use reminders tactically. Reminders work, and they work best in small numbers with deliberate timing. The goal is to reach people at a better moment, not to pressure them with volume.
Choose incentives that fit the population. Incentives help when they are meaningful to the specific group you are surveying and not coercive. A generic reward that means nothing to your respondents wastes budget. Timing matters: an incentive offered up front can invoke reciprocity, while a promised incentive rewards completion.
Pay attention to who sends the survey. The sender’s name and relationship to the respondent affect whether the message is opened at all. A request from a known, trusted person outperforms a request from an unfamiliar office.
Build survey time into program activities. When you can set aside ten minutes at the end of a session for participants to complete the survey on the spot, completion becomes convenient instead of one more task. For program staff, this is often the tactic that raises completion the most.
Pilot the survey first. A pilot with a small sample surfaces confusing items, reveals the realistic completion time, and gives you an early read on the response rate you can expect, while there is still time to adjust.
Survey length and complexity
Length is inversely related to response rate. Every additional question costs responses, so each item needs a reason to be there. Start from the decisions the data will inform and cut anything that does not serve one. A shorter survey answered by a representative sample beats a comprehensive survey answered by a fraction of it. When you genuinely need more than a short survey can carry, consider splitting the content across time points or respondent groups rather than lengthening a single instrument.
Survey design choices interact with response quality in other ways too. For a look at how design thinking can shape the instrument itself, see my earlier conversation with Sheila on using design thinking in survey design. When response rates or missing baselines have already compromised a pre-post design, retrospective pretest surveys can recover a credible comparison.
Listen to the full conversation
Timeline
00:40 Why Sheila is interested in survey research
03:50 Why survey response rate is critical
05:15 The optimal response rate
07:37 Ensuring accurate demographic representation of the sample
09:30 How to improve response rate
12:01 The survey invitation message is critical
13:26 Transparency in the length of time to complete the survey is important
15:19 Survey reminders can be used tactically to improve the response rate
16:43 Incentives should be used carefully
20:46 Timing of incentives and the principle of reciprocity
23:08 Building survey completion time into program activities can increase response rate
26:17 Importance of piloting the survey prior to use
28:15 Who sends the survey is important
33:20 How to reach Sheila
Frequently Asked Questions About Survey Response Rates
What is a good survey response rate?
There is no single benchmark. The rate you need depends on the population, the survey mode, and the decision the data will inform. Representativeness matters more than the raw percentage. A moderate response rate that mirrors your population on key characteristics supports stronger conclusions than a high rate drawn from your most engaged participants. Compare respondent demographics against the full population to judge data quality.
How do you increase survey response rates?
Write an invitation that explains the survey’s purpose and how results will be used, state the completion time honestly, send a small number of well timed reminders, and choose incentives that are meaningful to the specific population. Building survey completion into program activities, so participants respond on the spot, is often the tactic that raises completion the most for program staff.
Do incentives improve survey response rates?
They can, when the incentive fits the population and is not coercive. An incentive offered up front can invoke reciprocity, while a promised reward encourages completion. A generic incentive that means little to your respondents wastes resources and can even depress participation. Test what motivates the group you are actually surveying.
How long should a survey be?
As short as the decision allows. Length is inversely related to response rate, so every question needs to inform a specific decision. State the completion time in the invitation and keep the estimate honest. When more content is genuinely needed, split it across time points or respondent groups instead of lengthening one instrument.
Why do response rates matter in program evaluation?
Because nonresponse bias distorts findings. Survey respondents often differ from nonrespondents in engagement and satisfaction. When those differences relate to what the survey measures, results tilt toward the people who answered. On grant-funded programs, biased survey data flows into reports that funders use when they make continuation and funding decisions.
Need help with your program’s surveys?
EvalNetwork provides program evaluation consulting to nonprofits, government agencies, and grant-funded organizations. That work includes survey design, data collection planning, and analysis that holds up in funder reports. If you are deciding whether to bring in outside help, our guide to choosing a program evaluator covers what to look for.


