How we made this
The German data come from five survey waves fielded by YouGov in 2017, linked to the browsing data of panel members who had agreed to passive tracking. Four waves included knowledge questions. We kept respondents whose survey sessions appear in the browsing data. To flag lookups, we searched the pages visited during each survey session for question-specific keywords, checked every hit by hand, and then screened all visits to the sites those checks turned up. All keywords and every validated lookup are listed in the paper’s online appendix.
There are limits. We can’t see devices that weren’t tracked, or offline sources such as asking someone in the room. We also have to assume that a search during the survey was a lookup, not someone checking an answer they had already given.
Newer study mentioned
- Graham, M. H. (2024). Detecting and deterring information search in online surveys. American Journal of Political Science, 68(4), 1315–1334. https://doi.org/10.1111/ajps.12786
See all 68 items in a table
Share of answers that respondents looked up, by item. German panel, waves 2 to 5, 2017.
| Item | Type | Wave | Answers | Looked up | Share (%) |
|---|---|---|---|---|---|
| Dobrindt calls for the end of diesel cars by 2030 | Recent events | 2 | 545 | 17 | 3.1 |
| Gauland sentenced for sedition | Recent events | 4 | 553 | 15 | 2.7 |
| Trump appoints a general as chief of staff | Recent events | 2 | 545 | 14 | 2.6 |
| Schulz calls for a universal basic income | Recent events | 2 | 545 | 13 | 2.4 |
| Morales referendum sparks mass protests | Recent events | 2 | 545 | 12 | 2.2 |
| UN Security Council toughens sanctions on North Korea | Recent events | 2 | 545 | 12 | 2.2 |
| US Senate abolishes Obamacare | Recent events | 2 | 545 | 11 | 2.0 |
| Knife attack in a Hamburg supermarket | Recent events | 2 | 545 | 11 | 2.0 |
| Carmakers commit to free diesel hardware updates | Recent events | 2 | 545 | 10 | 1.8 |
| Green MP Twesten leaves her group in Lower Saxony | Recent events | 2 | 545 | 9 | 1.7 |
| Unemployment falls below 4% in August | Recent events | 3 | 557 | 9 | 1.6 |
| Berlin votes against keeping Tegel Airport | Recent events | 5 | 519 | 7 | 1.3 |
| Greens rule out a Jamaica coalition | Recent events | 4 | 553 | 7 | 1.3 |
| Ryanair to take over Air Berlin | Recent events | 3 | 557 | 7 | 1.3 |
| Etihad bids for Air Berlin | Recent events | 4 | 553 | 6 | 1.1 |
| Merkel asks carmakers for free hardware updates | Recent events | 3 | 557 | 6 | 1.1 |
| Russia and China veto a North Korea resolution | Recent events | 4 | 553 | 5 | 0.9 |
| Parties want a five-year Bundestag term | Recent events | 4 | 553 | 5 | 0.9 |
| Schulz asks Merkel for another TV debate | Recent events | 4 | 553 | 5 | 0.9 |
| Volkswagen to end combustion cars by 2040 | Recent events | 4 | 553 | 5 | 0.9 |
| Weidel reportedly employed an asylum seeker off the books | Recent events | 4 | 553 | 5 | 0.9 |
| AfD deputy Arppe resigns | Recent events | 3 | 557 | 5 | 0.9 |
| Schulz presents an education reform | Recent events | 3 | 557 | 5 | 0.9 |
| FDP comes third in the federal election | Recent events | 5 | 519 | 4 | 0.8 |
| Russian hackers accessed voting software | Recent events | 5 | 519 | 4 | 0.8 |
| Gauland open to a coalition with the Union and FDP | Recent events | 5 | 519 | 4 | 0.8 |
| Bomb explodes on the London Underground | Recent events | 4 | 553 | 4 | 0.7 |
| Juncker calls for the euro in every EU country | Recent events | 4 | 553 | 4 | 0.7 |
| Hurricane floods southern Texas | Recent events | 3 | 557 | 4 | 0.7 |
| North Korea announces a hydrogen bomb test | Recent events | 3 | 557 | 4 | 0.7 |
| Merkel names the Greens as her preferred partner | Recent events | 3 | 557 | 4 | 0.7 |
| Bavaria reports a 30% drop in reported rapes | Recent events | 5 | 519 | 3 | 0.6 |
| Rohingya flee military violence in Myanmar | Recent events | 5 | 519 | 3 | 0.6 |
| Threatening letters sent to top politicians | Recent events | 5 | 519 | 3 | 0.6 |
| Alleged rape near a refugee shelter in Upper Bavaria | Recent events | 5 | 519 | 3 | 0.6 |
| Two Germans arrested in Turkey | Recent events | 3 | 557 | 3 | 0.5 |
| Earthquake in Mexico kills more than 200 | Recent events | 5 | 519 | 2 | 0.4 |
| Supermarkets pull eggs over fipronil | Recent events | 2 | 545 | 2 | 0.4 |
| EU to co-fund Hungary’s border fence | Recent events | 3 | 557 | 2 | 0.4 |
| Trump to rethink the Iran nuclear deal | Recent events | 5 | 519 | 1 | 0.2 |
| Who elects the chancellor? | Election rules | 2 | 545 | 67 | 12.3 |
| Who elects the chancellor? | Election rules | 5 | 519 | 40 | 7.7 |
| Which vote decides the parties’ strength? | Election rules | 2 | 545 | 19 | 3.5 |
| Which vote decides the parties’ strength? | Election rules | 5 | 519 | 7 | 1.3 |
| Top candidate(s): Greens | Candidate names | 4 | 553 | 56 | 10.1 |
| Top candidate(s): Left Party | Candidate names | 4 | 553 | 52 | 9.4 |
| Top candidate(s): AfD | Candidate names | 4 | 553 | 47 | 8.5 |
| Top candidate(s): FDP | Candidate names | 4 | 553 | 47 | 8.5 |
| Top candidate(s): SPD | Candidate names | 4 | 553 | 31 | 5.6 |
| Top candidate(s): CDU/CSU | Candidate names | 4 | 553 | 30 | 5.4 |
| Party of Heiko Maas (photo) | Politician photos | 2 | 545 | 18 | 3.3 |
| Party of Angela Merkel (photo) | Politician photos | 2 | 545 | 18 | 3.3 |
| Party of Peter Altmaier (photo) | Politician photos | 2 | 545 | 17 | 3.1 |
| Party of Katrin Göring-Eckardt (photo) | Politician photos | 2 | 545 | 17 | 3.1 |
| Party of Peter Altmaier (photo) | Politician photos | 5 | 519 | 16 | 3.1 |
| Party of Heiko Maas (photo) | Politician photos | 5 | 519 | 16 | 3.1 |
| Party of Alice Weidel (photo) | Politician photos | 2 | 545 | 16 | 2.9 |
| Party of Martin Schulz (photo) | Politician photos | 2 | 545 | 15 | 2.8 |
| Party of Dietmar Bartsch (photo) | Politician photos | 2 | 545 | 14 | 2.6 |
| Party of Anton Hofreiter (photo) | Politician photos | 2 | 545 | 14 | 2.6 |
| Party of Christian Lindner (photo) | Politician photos | 2 | 545 | 14 | 2.6 |
| Party of Dietmar Bartsch (photo) | Politician photos | 5 | 519 | 11 | 2.1 |
| Party of Katrin Göring-Eckardt (photo) | Politician photos | 5 | 519 | 11 | 2.1 |
| Party of Anton Hofreiter (photo) | Politician photos | 5 | 519 | 11 | 2.1 |
| Party of Christian Lindner (photo) | Politician photos | 5 | 519 | 11 | 2.1 |
| Party of Angela Merkel (photo) | Politician photos | 5 | 519 | 10 | 1.9 |
| Party of Martin Schulz (photo) | Politician photos | 5 | 519 | 10 | 1.9 |
| Party of Alice Weidel (photo) | Politician photos | 5 | 519 | 10 | 1.9 |
The paper
Simon Munzert, Sebastian Ramirez-Ruiz, Pablo Barberá, Andrew M. Guess, and JungHwan Yang (2024). “Who’s cheating on your survey? A detection approach with digital trace data.” Political Science Research and Methods 12(2), 390–398. DOI: 10.1017/psrm.2022.42