How we made this
This story is based on our meta-analysis of 55 effects from 22 studies, published in Political Communication in 2021. The search ended in September 2019. The newer studies near the end are not part of the meta-analysis. We summarize them from their full papers. Some context comes from an op-ed we wrote for ZEIT ONLINE in 2021.
Each dot is one effect, placed at its point estimate. Turnout and vote choice are shown as odds ratios on a log scale. Issue knowledge is shown as partial correlations. The pooled estimates come from cross-classified random-effects models (effects nested in studies and elections), estimated by REML with the metafor package for R. We re-estimated every model shown here from the public replication materials. Where the re-run and the paper differ in the last digit, we show the paper's value.
The phone screen, the quiz, and the self-selection diagram are illustrations, not data.
Newer studies mentioned
- Frese, J., Hix, S., & Lachat, R. (2025). Quality not quantity: How a VAA affected voting behavior in three large-scale field experiments. British Journal of Political Science, 55, e176.
- Germann, M., Cioroianu, I., Mendez, F., & Djouvas, C. (2026). Do voting advice applications have durable causal effects? Evidence from concurrent survey and field experiments. European Journal of Political Research, 1–21.
- Velez, Y. R., Green, D. P., & Sevi, S. (2025). Chatbot voting advice applications inform but seldom sway young unaligned voters. Proceedings of the National Academy of Sciences, 122(50), e2515516122.
See all 55 effects in a table
One row per effect, as computed from the replication data: odds ratios for turnout and vote choice, partial correlations for issue knowledge, each with a 95% interval.
| Outcome | Study | Election | Design | Estimate [95% CI] |
|---|---|---|---|---|
| Turnout | Enyedi, 2016 | Hungary 2010 | Experiment | 1.34 [0.99, 1.82] |
| Turnout | Garzia & De Angelis, 2014 | Finland 2007 | Observational, no panel | 1.69 [1.25, 2.30] |
| Turnout | Garzia & De Angelis, 2014 | Finland 2011 | Observational, no panel | 1.27 [0.95, 1.70] |
| Turnout | Garzia & De Angelis, 2014 | Germany 2009 | Observational, no panel | 1.16 [0.82, 1.63] |
| Turnout | Garzia & De Angelis, 2014 | Netherlands 2003 | Observational, no panel | 1.92 [1.13, 3.25] |
| Turnout | Garzia & De Angelis, 2014 | Netherlands 2006 | Observational, no panel | 1.59 [1.18, 2.14] |
| Turnout | Garzia & De Angelis, 2014 | Netherlands 2010 | Observational, no panel | 1.81 [1.38, 2.37] |
| Turnout | Garzia & De Angelis, 2014 | Switzerland 2007 | Observational, no panel | 1.29 [1.14, 1.47] |
| Turnout | Garzia & De Angelis, 2014 | Switzerland 2011 | Observational, no panel | 1.38 [1.20, 1.58] |
| Turnout | Garzia et al., 2017 | Italy 2013 | Experiment | 1.71 [1.27, 2.30] |
| Turnout | Garzia et al., 2017 | EU 2009 | Observational, no panel | 3.03 [2.45, 3.76] |
| Turnout | Garzia et al., 2017 | Finland 2003 | Observational, no panel | 3.22 [1.75, 5.92] |
| Turnout | Garzia et al., 2017 | Germany 2013 | Observational, no panel | 2.94 [1.54, 5.62] |
| Turnout | Garzia et al., 2017 | Netherlands 2012 | Observational, no panel | 6.30 [3.71, 10.69] |
| Turnout | Gemenis & Rosema, 2014 | Netherlands 2006 | Observational, panel | 4.20 [2.58, 6.83] |
| Turnout | Gemenis, 2018 | Greece 5/2012 | Selection / matching | 2.75 [0.86, 8.73] |
| Turnout | Gemenis, 2018 | Greece 6/2012 | Selection / matching | 2.64 [0.75, 9.25] |
| Turnout | Gemenis, 2018 | Greece 1/2015 | Selection / matching | 1.09 [0.41, 2.92] |
| Turnout | Gemenis, 2018 | Greece 9/2015 | Selection / matching | 1.03 [0.44, 2.39] |
| Turnout | Germann & Gemenis, 2019 | Switzerland 2007 | Selection / matching | 1.82 [1.26, 2.64] |
| Turnout | Germann & Gemenis, 2019 | Switzerland 2011 | Selection / matching | 1.95 [1.37, 2.78] |
| Turnout | Germann & Gemenis, 2019 | Switzerland 2015 | Selection / matching | 1.90 [1.36, 2.65] |
| Turnout | Heinsohn et al., 2016 | Germany - EU 2014 | Observational, panel | 1.42 [1.19, 1.69] |
| Turnout | Mahéo, 2017 | Canada 2014 | Experiment | 1.49 [0.68, 3.27] |
| Turnout | Marschall & Schultze, 2012 | Germany 2009 | Observational, no panel | 1.82 [1.12, 2.97] |
| Turnout | Munzert et al., 2020 | Germany 2017 | Experiment | 0.96 [0.65, 1.42] |
| Turnout | Mykkänen & Moring, 2006 | Finland - EU 2004 | Observational, no panel | 1.89 [1.20, 2.96] |
| Turnout | Mykkänen & Moring, 2006 | Finland 2003 | Observational, no panel | 2.75 [1.74, 4.34] |
| Turnout | Ruusuvirta et al., 2009 | Netherlands 2006 | Observational, panel | 3.35 [2.20, 5.12] |
| Turnout | Vassil, 2012 | Estonia - EU 2009 | Experiment | 1.68 [1.05, 2.69] |
| Vote choice | Andreadis & Wall, 2014 | Finland 2003 | Observational, panel | 1.98 [1.26, 3.12] |
| Vote choice | Andreadis & Wall, 2014 | Finland 2007 | Observational, panel | 1.68 [1.09, 2.60] |
| Vote choice | Andreadis & Wall, 2014 | Finland 2011 | Observational, panel | 1.38 [0.90, 2.11] |
| Vote choice | Andreadis & Wall, 2014 | Germany 2009 | Observational, panel | 1.48 [1.01, 2.19] |
| Vote choice | Andreadis & Wall, 2014 | Netherlands 2003 | Observational, panel | 1.25 [0.94, 1.65] |
| Vote choice | Andreadis & Wall, 2014 | Netherlands 2006 | Observational, panel | 1.52 [1.21, 1.91] |
| Vote choice | Andreadis & Wall, 2014 | Netherlands 2010 | Observational, panel | 1.47 [1.16, 1.86] |
| Vote choice | Andreadis & Wall, 2014 | Switzerland 2007 | Observational, panel | 1.18 [0.81, 1.71] |
| Vote choice | Andreadis & Wall, 2014 | Switzerland 2011 | Observational, panel | 1.38 [1.00, 1.91] |
| Vote choice | Enyedi, 2016 | Hungary 2010 | Experiment | 1.05 [0.84, 1.32] |
| Vote choice | Klein Kranenburg, 2015 | Netherlands 2006 | Observational, panel | 1.33 [1.03, 1.72] |
| Vote choice | Klein Kranenburg, 2015 | Netherlands 2010 | Observational, panel | 1.50 [1.10, 2.05] |
| Vote choice | Klein Kranenburg, 2015 | Netherlands 2012 | Observational, panel | 1.59 [1.12, 2.27] |
| Vote choice | Klein Kranenburg, 2015 | Netherlands 2015 | Observational, panel | 1.62 [1.40, 1.87] |
| Vote choice | Kleinnijenhuis et al., 2019 | Netherlands 2010 | Observational, panel | 3.82 [1.38, 10.58] |
| Vote choice | Mahéo, 2016 | Canada 2014 | Experiment | 0.79 [0.44, 1.42] |
| Vote choice | Munzert et al., 2020 | Germany 2017 | Experiment | 1.22 [0.71, 2.11] |
| Vote choice | Pianzola, 2014a | Switzerland 2007 | Selection / matching | 2.05 [1.50, 2.81] |
| Vote choice | Pianzola, 2014b | Switzerland 2011 | Selection / matching | 1.93 [1.67, 2.22] |
| Vote choice | Pianzola et al., 2019 | Switzerland 2011 | Experiment | 0.76 [0.40, 1.42] |
| Vote choice | Vassil, 2012 | Estonia - EU 2009 | Experiment | 1.82 [0.83, 3.99] |
| Issue knowledge | Heinsohn et al., 2016 | Germany - EU 2014 | Observational, panel | 0.08 [0.03, 0.13] |
| Issue knowledge | Munzert et al., 2020 | Germany 2017 | Experiment | 0.13 [0.07, 0.19] |
| Issue knowledge | Schultze, 2014 | Germany 2009 | Observational, no panel | 0.19 [0.13, 0.24] |
| Issue knowledge | Van de Pol, 2016 | Netherlands 2014 | Selection / matching | −0.04 [−0.07, −0.01] |
The paper
Simon Munzert and Sebastian Ramirez-Ruiz (2021). “Meta-Analysis of the Effects of Voting Advice Applications.” Political Communication 38(6), 691–706. DOI: 10.1080/10584609.2020.1843572