Institute for Social Research, University of Michigan and 2Joint Program in Survey Methodology, University of Maryland
Dr Roger Tourangeau is a Research Professor at the Institute for Social Research, University of Michigan. He is also a Research Professor and the director of Joint Program in Survey Methodology at the University of Maryland.
Ting Yan, Frederick G. Conrad, Roger Tourangeau, Mick P. Couper; Should I Stay or Should I go: The Effects of Progress Feedback, Promised Task Duration, and Length of Questionnaire on Completing Web Surveys. Int J Public Opin Res 2011; 23 (2): 131-147. doi: 10.1093/ijpor/edq046
Many researchers include “progress indicators” in web questionnaires. The rationale is that if respondents know how much remains they will be more likely to complete the task. Previous research has shown that progress indicators often do not increase and sometimes even hurt completion rates, but in some circumstances they do help. Our hypothesis in the current experiment is that the effect of progress indicators depends on how long respondents believe the task will take and on how long it actually takes. We explore this by varying three factors in a web survey: (a) the task duration promised in the survey invitation; (b) the actual length of the questionnaire; and (c) whether or not a progress indicator is displayed. We found that the effect of progress indicators depend on respondents’ expectations and the degree to which they were realized; the presence of a progress indicator led to fewer breakoffs when respondents expected a short task based on the invitation and when the questionnaire was indeed short than when they expected the task to be longer. We discuss how all three factors work together in influencing respondents’ question-by-question decisions to continue the survey or to break off.