Evaluating the response effort and data quality of established political solidarity measures: a pre-registered experimental test in an online survey of the German adult resident population in 2021

Research output: Contribution to journalArticleResearchpeer review

Authors

  • Achim Goerres
  • Jan Karem Höhne

Research Organisations

External Research Organisations

  • University of Duisburg-Essen
View graph of relations

Details

Original languageEnglish
Pages (from-to)5431-5447
Number of pages17
JournalQuality and Quantity
Volume57
Issue number6
Early online date23 Jan 2023
Publication statusPublished - Dec 2023

Abstract

This experimental study aims to check and improve the quality of 16 established survey measures of political solidarities and related concepts, such as redistribution and social trust. Political solidarities are defined as one’s willingness to share the costs that result from public redistribution that favours people other than oneself and thus constitute a subset of welfare state attitudes. The pre-registered study plan included suggestions for the development of improved rating scales, which we defined as five-point, end verbalized rating scales without non-substantive answer options. The overall results from an experimental online survey in Germany indicate differences in response effort in terms of response times but almost no differences in data quality in terms of criterion validity. Thus, the 16 survey measures show solid instrument validity as well as minor improvements in respondents’ response times. Indeed, the measures are (at least) in the online survey world of Germany of high-quality and warrant inclusion in future surveys with small efficiency gains still attainable.

Keywords

    Data quality, Online survey, Political solidarities, Rating scale design, Response behaviour

ASJC Scopus subject areas

Cite this

Evaluating the response effort and data quality of established political solidarity measures: a pre-registered experimental test in an online survey of the German adult resident population in 2021. / Goerres, Achim; Höhne, Jan Karem.
In: Quality and Quantity, Vol. 57, No. 6, 12.2023, p. 5431-5447.

Research output: Contribution to journalArticleResearchpeer review

Download
@article{637726ed0867431eab34e8bd0e9e2020,
title = "Evaluating the response effort and data quality of established political solidarity measures: a pre-registered experimental test in an online survey of the German adult resident population in 2021",
abstract = "This experimental study aims to check and improve the quality of 16 established survey measures of political solidarities and related concepts, such as redistribution and social trust. Political solidarities are defined as one{\textquoteright}s willingness to share the costs that result from public redistribution that favours people other than oneself and thus constitute a subset of welfare state attitudes. The pre-registered study plan included suggestions for the development of improved rating scales, which we defined as five-point, end verbalized rating scales without non-substantive answer options. The overall results from an experimental online survey in Germany indicate differences in response effort in terms of response times but almost no differences in data quality in terms of criterion validity. Thus, the 16 survey measures show solid instrument validity as well as minor improvements in respondents{\textquoteright} response times. Indeed, the measures are (at least) in the online survey world of Germany of high-quality and warrant inclusion in future surveys with small efficiency gains still attainable.",
keywords = "Data quality, Online survey, Political solidarities, Rating scale design, Response behaviour",
author = "Achim Goerres and H{\"o}hne, {Jan Karem}",
note = "Funding Information: We would like to thank Jakob Kemper (University of Duisburg-Essen) for his great assistance during the preparation of this study. We are also grateful to numerous members of the Working Group for Empirical Political Science (University Duisburg-Essen) for their great support during survey pre-testing. The respondents were reached by a sample-only commission to the survey company Forsa that drew a sample of their online access panel. Open Access funding enabled and organized by Projekt DEAL. We acknowledge financial support by the European Research Council (ERC; grant number: 864818) through the Consolidator Grant POLITSOLID (2021-25, https://bit.ly/politsolid ). ",
year = "2023",
month = dec,
doi = "10.1007/s11135-022-01594-4",
language = "English",
volume = "57",
pages = "5431--5447",
journal = "Quality and Quantity",
issn = "0033-5177",
publisher = "Springer Netherlands",
number = "6",

}

Download

TY - JOUR

T1 - Evaluating the response effort and data quality of established political solidarity measures

T2 - a pre-registered experimental test in an online survey of the German adult resident population in 2021

AU - Goerres, Achim

AU - Höhne, Jan Karem

N1 - Funding Information: We would like to thank Jakob Kemper (University of Duisburg-Essen) for his great assistance during the preparation of this study. We are also grateful to numerous members of the Working Group for Empirical Political Science (University Duisburg-Essen) for their great support during survey pre-testing. The respondents were reached by a sample-only commission to the survey company Forsa that drew a sample of their online access panel. Open Access funding enabled and organized by Projekt DEAL. We acknowledge financial support by the European Research Council (ERC; grant number: 864818) through the Consolidator Grant POLITSOLID (2021-25, https://bit.ly/politsolid ).

PY - 2023/12

Y1 - 2023/12

N2 - This experimental study aims to check and improve the quality of 16 established survey measures of political solidarities and related concepts, such as redistribution and social trust. Political solidarities are defined as one’s willingness to share the costs that result from public redistribution that favours people other than oneself and thus constitute a subset of welfare state attitudes. The pre-registered study plan included suggestions for the development of improved rating scales, which we defined as five-point, end verbalized rating scales without non-substantive answer options. The overall results from an experimental online survey in Germany indicate differences in response effort in terms of response times but almost no differences in data quality in terms of criterion validity. Thus, the 16 survey measures show solid instrument validity as well as minor improvements in respondents’ response times. Indeed, the measures are (at least) in the online survey world of Germany of high-quality and warrant inclusion in future surveys with small efficiency gains still attainable.

AB - This experimental study aims to check and improve the quality of 16 established survey measures of political solidarities and related concepts, such as redistribution and social trust. Political solidarities are defined as one’s willingness to share the costs that result from public redistribution that favours people other than oneself and thus constitute a subset of welfare state attitudes. The pre-registered study plan included suggestions for the development of improved rating scales, which we defined as five-point, end verbalized rating scales without non-substantive answer options. The overall results from an experimental online survey in Germany indicate differences in response effort in terms of response times but almost no differences in data quality in terms of criterion validity. Thus, the 16 survey measures show solid instrument validity as well as minor improvements in respondents’ response times. Indeed, the measures are (at least) in the online survey world of Germany of high-quality and warrant inclusion in future surveys with small efficiency gains still attainable.

KW - Data quality

KW - Online survey

KW - Political solidarities

KW - Rating scale design

KW - Response behaviour

UR - http://www.scopus.com/inward/record.url?scp=85146705662&partnerID=8YFLogxK

U2 - 10.1007/s11135-022-01594-4

DO - 10.1007/s11135-022-01594-4

M3 - Article

AN - SCOPUS:85146705662

VL - 57

SP - 5431

EP - 5447

JO - Quality and Quantity

JF - Quality and Quantity

SN - 0033-5177

IS - 6

ER -