Postelection surveys regularly overestimate voter turnout by 10 points or more. This article provides the first comprehensive documentation of the turnout gap in three major ongoing surveys (the General Social Survey, Current Population Survey, and American National Election Studies), evaluates explanations for it, interprets its significance, and suggests means to continue evaluating and improving survey measurements of turnout. Accuracy was greater in face-to-face than telephone interviews, consistent with the notion that the former mode engages more respondent effort with less social desirability bias. Accuracy was greater when respondents were asked about the most recent election, consistent with the hypothesis that forgetting creates errors. Question wordings designed to minimize source confusion and social desirability bias improved accuracy. Rates of reported turnout were lower with proxy reports than with self-reports, which may suggest greater accuracy of proxy reports. People who do not vote are less likely to participate in surveys than voters are.
AbelsonRobert P.LoftusElizabeth F.GreenwaldAnthony G.. 1992. “Attempts to Improve Accuracy of Self-reports of Voting.” Pp. 138–53 in Questions about Questions, edited byTanurJudith M.. New York: Russell Sage Foundation.
2.
AndersonBarbara A.SilverBrian D.AbramsonPaul R.. 1988. “The Effects of Race of the Interviewer on Measures of Electoral Participation by Blacks in SRC National Election Studies.” Public Opinion Quarterly52:53–83.
3.
AnsolabehereStephenHershEitan. 2012. “Validation: What Big Data Reveal about Survey Misreporting and the Real Electorate.” Political Analysis20:437–59.
4.
BaumanKurt. 2012. “Consolidated Public Use CPS November 1980–2010 Data [data file].” U.S. Census Bureau, MD.
BelliRobert F.MooreSean E.HoewykJohn Van. 2006. “An Experimental Comparison of Question forms Used to Reduce Vote Overreporting.” Electoral Studies25:751–59.
7.
BelliRobert F.TraugottMichael W.YoungMargaretMcGonagleKatherine A.. 1999. “Reducing Vote Overreporting in Surveys: Social Desirability, Memory Failure, and Source Monitoring.” Public Opinion Quarterly63:90–108.
8.
BerentMatthew K.KrosnickJon A.LupiaArthur. 2011. “The Quality of Government Records and Over-estimation of Registration and Turnout in Surveys: Lessons from the 2008 Panel Study’s Registration and Turnout Validation Exercise.” ANES Technical Report Series, No. nes012554. Retrieved February 8, 2018 (http://electionstudies.org/resources/papers/nes012554.pdf).
9.
BerentMatthew K.KrosnickJon A.LupiaArthur. 2016. “Measuring Voter Registration and Turnout in Surveys: Do Official Government Records Yield More Accurate Estimates?” Public Opinion Quarterly80:597–621. doi: 10.1093/poq/nfw021.
10.
BernsteinRobertChadhaAnitaMontjoyRobert. 2001. “Overreporting Voting: Why It Happens and Why It Matters.” Public Opinion Quarterly65:22–44.
11.
BollingerChristopher R.HirschBarry T.. 2007. “How Well Are Earnings Measured in the Current Population Survey? Bias from Nonresponse and Proxy Respondents.” Paper presented at the North American Summer Meetings of the Econometric Society, June 21–24, Duke University, Durham, NC. Retrieved May 26, 2015 (http://www2.gsu.edu/∼ecobth/ES_Bollinger-Hirsch_Response_Bias_Apr07.pdf).
BurdenBarry C.2000. “Voter Turnout and the National Election Studies.” Political Analysis8:389–98.
14.
ClausenAage R.1968. “Response Validity: Vote Report.” Public Opinion Quarterly32:588–606.
15.
CobbCurtiss L.IIIKrosnickJon A.PearsonJeremy. 2011. “The Accuracy of Self-reports and Proxy Reports in Surveys.” Stanford University, CA. Unpublished manuscript.
16.
CobbSidneyThompsonDonovan J.RosenbaumJosephWarrenJoseph E.MerchantWilliam R.. 1956. “On the Measurement of Prevalence of Arthritis and Rheumatism from Interview Data.” Journal of Chronic Diseases3:134–39.
17.
CronbachLee J.1950. “Further Evidence on Response Sets and Test Design.” Educational and Psychological Measurement10:3–31.
18.
DeBellMatthewCowdenJonathan. 2010. Benchmark Report for the 2008 American National Election Studies Time Series and Panel Study. ANES Technical Report Series, no. nes012493. Ann Arbor, MI, and Palo Alto, CA: American National Election Studies. Retrieved from (http://electionstudies.org/resources/papers/nes012493.pdf).
19.
DuffBrianHanmerMichael J.ParkWon-HoWhiteIsmail K.. 2007. “Good Excuses: Understanding Who Votes with an Improved Turnout Question.” Public Opinion Quarterly71:67–90.
20.
FileThomCrisseySarah. 2010. Voting and Registration in the Election of November 2008. Current Population Reports, P20-562.U.S.Suitland, Maryland: Census Bureau.
21.
FlaniganWilliam H.ZingaleNancy H.. 1983. Political Behavior of the American Electorate. 5th ed. Boston, CA: Allyn & Bacon.
22.
GeraKatieYeagerDavidKrosnickJon A.DeBellMatthewMcDonaldMichael. 2010. “Overestimation of Voter Turnout in National Surveys.” Paper presented at the Annual Meeting of the American Political Science Association, Washington, DC.
23.
GranbergDonaldHolmbergSören. 1992. “The Hawthorne Effect in Election Studies: The Impact of Survey Participation on Voting.” British Journal of Political Science22:240–47.
24.
GreenwaldAnthony G.CarnotCatherine G.BeachRebeccaYoungBarbara. 1987. “Increasing Voting Behavior by Asking People If They Expect to Vote.” Journal of Applied Psychology72:315–18.
25.
GreenwaldAnthoony G.KlingerMark R.KampMark E. VandeKerrKatherine L.. 1988. “The Self-Prophecy Effect: Increasing Voter Turnout by Vanity-assisted Consciousness Raising.” University of Washington, Seattle, WA. Unpublished manuscript.
26.
GrovesRobert M.2006. “Nonresponse Rates and Nonresponse Bias in Household Surveys.” Public Opinion Quarterly70:646–75.
27.
GrovesRobert M.PeytchevaEmilia. 2008. “The Impact of Nonresponse Rates on Nonresponse Bias: A Meta-analysis.” Public Opinion Quarterly72:167–89.
28.
HanmerMichael J.BanksAntoine J.WhiteIsmail K.. 2014. “Experiments to Reduce the Over-reporting of Voting: A Pipeline to the Truth.” Political Analysis22:130–41.
29.
HightonBenjamin. 2005. “Self-reported versus Proxy-reported Voter Turnout in the Current Population Survey.” Public Opinion Quarterly69:113–23.
30.
HolbrookAllyson L.GreenMelanie C.KrosnickJon A.. 2003. “Telephone versus Face-to-face Interviewing of National Probability Samples with Long Questionnaires: Comparisons of Respondent Satisficing and Social Desirability Bias.” Public Opinion Quarterly67:79–125.
31.
HolbrookAllyson L.KrosnickJon A.. 2013. “A New Question Sequence to Measure Voter Turnout in Telephone Surveys: Results of an Experiment in the 2006 ANES Pilot Study.” Public Opinion Quarterly77:106–23.
32.
HurAramAchenChris. 2013. “Coding Voter Turnout Responses in the Current Population Survey.” Public Opinion Quarterly78:985–93.
33.
KatoshJohn P.TraugottMichael W.. 1981. “The Consequences of Validated and Self-reported Voting Measures.” Public Opinion Quarterly45:519–35.
34.
KrautRobert E.McConohayJohn B.. 1973. “How Being Interviewed Affects Voting: An Experiment.” Public Opinion Quarterly37:398–406.
35.
KrosnickJon A.PresserStanley. 2010. “Question and Questionnaire Design.” Pp. 263–314 in Handbook of Survey Research, edited byMarsdenPeterWrightJames. Bradford Emerald Group.
36.
MannChristopher B. 2005. “Unintentional Voter Mobilization: Does Participation in Preelection Surveys Increase Voter Turnout?” The ANNALS of the American Academy of Political and Social Science601:155–68.
37.
MartinezMichael D.2003. “Comment on “Voter Turnout and the National Election Studies.””Political Analysis11:187–92.
McDonaldMichael P.2003. “On the Overreport Bias of the National Election Study Turnout Rate.” Political Analysis11:180–86.
40.
OlsonKristenWittLindsey. 2011. “Are We Keeping the People Who Used to Stay? Changes in Correlates of Panel Survey Attrition over Time.” Social Science Research40:1037–50.
41.
ParryHugh J.CrossleyHelen M.. 1950. “Validity of Responses to Survey Questions.” Public Opinion Quarterly14:61–80.
42.
PeressMichael. 2010. “Correcting for Survey Nonresponse Using Variable Response Propensity.” Journal of the American Statistical Association105:1418–30.
43.
SigelmanLee. 1982. “The Nonvoting Voter in Voting Research.” American Journal of Political Science26:47–56.
44.
SilverBrian D.AndersonBarbara A.AbramsonPaul R.. 1986. “Who Overreports Voting?” American Political Science Review80:613–24.
SmithJennifer K.GerberAlan S.OrlichAnton. 2003. “Self-prophecy Effects and Voter Turnout: An Experimental Replication.” Political Psychology24:593–604.
47.
SpangenbergEric R.GreenwaldAnthony G.. 1999. “Social Influence by Requesting Self-prophecy.” Journal of Consumer Psychology8:61–89.
48.
StockeVolker. 2007. “Response Privacy and Elapsed Time Since Election Day as Determinants for Vote Overreporting.” International Journal of Public Opinion Research19:237–46.
49.
ThompsonDonovan J.TauberJoseph. 1957. “Household Survey, Individual Interview, and Clinical Examination to Determine Prevalence of Heart Disease.” American Journal of Public Health47:1131–140.
U.S. Census Bureau. 2008. Current Population Survey, November 2008, Voting and Registration Supplement File, Technical Documentation. Retrieved February 8, 2018 (http://www.census.gov/prod/techdoc/cps/cpsnov08.pdf).
52.
VoogtRobert J. J.KempenHetty Van. 2002. “Nonresponse Bias and Stimulus Effects in the Dutch National Election Study.” Quality & Quantity36:325–45.
53.
YalchRichard F.1976. “Pre-election Interview Effects on Voter Turnout.” Public Opinion Quarterly40:331–36.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
