Identifying fake interviews in a cross-national panel study (SHARE) | Munich Center for the Economics of Aging - MEA
Home
Research
01.08.2016 - 31.12.2019 / SHARE - Infrastructure

Identifying fake interviews in a cross-national panel study (SHARE)

Interviewer fabrication (“fake interviews”) is a problem in all interviewer-conducted surveys and repeatedly come up in the Survey of Health, Ageing and Retirement in Europe (SHARE), as well. While there are many variations and different reasons for interviewers deviating from properly administering the survey, in this project we will only deal with the most extreme deviation, i.e. interviewers’ fabrication of entire interviews.

The main aim of this project is to implement a technical procedure to identify fakes in computer administered survey data. In contrast to previous work that often used only few variables to identify fake interviews, we implement a more complex approach that uses variables from different data sources to build up a comprehensive mechanism in order to identify fake interviews. We use several indicators from CAPI data (size of social networks, avoiding follow up questions, number of proxy interviews, rounding in physical tests, extreme answering, straight-lining, number of “other” answers, number of missings) as well as paradata (interview length, number of interviews per day, number of contact attempts, cooperation rates). We combine these indicators using a multivariate cluster analysis to distinguish two groups of interviewers: a falsifier group and an honest interviewer group.

During the sixth wave of the Survey of Health, Ageing and Retirement in Europe (SHARE) we discovered a very elaborate team of falsifiers who faked a fairly large part of the net sample. We use these known fakes as a kind of benchmark to check if our script is able to properly identify fake interviews. Thus, in comparison to most of the existing work so far, our study has the advantage to be based on a large data set including information on actual fakes.

Results show that we are able to identify most of the faked interviews, while at the same time we are able to keep the number of “false alarms” small. Although most of the time we cannot be perfectly sure if an interview has been faked or not, our results can be used to provide survey agencies with a much more informed sample for back checking suspicious interviewers and interviews during fieldwork of the current wave and future waves to come. By this, we hope that we can substantially improve the quality of our survey data.

Contact Person(s)
Bergmann-2

Dr. Michael Bergmann

Presentations and Contributions
20.02.2018
Dr. Michael Bergmann, Dr. Frederic Malter, Dr. Karin Schuller
Interviewerfälschungen in Panelstudien – Identifikation am Beispiel des Survey of Health, Aging and Retirement in Europe (SHARE)
20.07.2017
Dr. Frederic Malter
“Curbstoning”: case study of an elaborate interviewer falsification scheme and new procedures to prevent interviewer fabrication
16.03.2017
Dr. Michael Bergmann, Dr. Karin Schuller
Identifying fake interviews in a cross-national panel study (SHARE)
12.09.2003
Prof. Dr. h.c. Axel Börsch-Supan, Ph. D.
The German Pension System: How it was, How it will be
26.07.2018
Dr. Michael Bergmann, Dr. Frederic Malter, Dr. Karin Schuller
Identifying fake interviews in a panel study – The Survey of Health, Aging and Retirement in Europe (SHARE)
Publications

Bergmann, Michael; Schuller, Karin; Malter, Frederic (2019): "Preventing interview falsifications during fieldwork in the Survey of Health, Ageing and Retirement in Europe (SHARE)". In: Longitudinal and Life Course Studies, 10, 4, pp. 513-530.

Bergmann, Michael; Schuller, Karin (2019): "Improving the efficiency of data quality back checks: A new procedure to prevent curbstoning", In: Bergmann, Michael; Scherpenzeel, Annette; Börsch-Supan, Axel (eds.), SHARE Wave 7 Methodology: Panel innovations and life histories. Munich: Max Planck Institute for Social Law and Social Policy, Munich Center for the Economics of Aging (MEA), MEA, Max Planck Institute for Social Law and Social Policy, Munich, pp. 154-165.