Accurate measurement of compliance with COVID-19 guidance is important for public health policy and communications. Responses to surveys, however, are susceptible to psychological biases, including framing effects and social desirability. Our aim was to measure the effects of these biases on estimates of compliance with public health guidance (eg, hand-washing, social distancing). Design We conducted two online experiments (n=1800) and varied whether questions were framed positively or negatively (eg, € I always wash my hands...' vs € I don't always wash my hands...'). We also varied the degree to which anonymity was assured, via a € list' experiment. Results Reported compliance, despite being generally high, was reduced by negatively framing questions and increasing anonymity using a list experiment technique. Effect sizes were large: compliance estimates diminished by up to 17% points and 10% points, respectively. Conclusion Estimates of compliance with COVID-19 guidance vary substantially with how the question is asked. Standard tracking surveys tend to pose questions in ways that lead to higher estimates than alternative approaches. Experimental tests of these surveys offer public health officials greater insight into the range of likely compliance estimates to better inform policy and communications.

Timmons, S., Mcginnity, F., Belton, C., Barjaková, M., Lunn, P. (2021). It depends on how you ask: Measuring bias in population surveys of compliance with COVID-19 public health guidance. JOURNAL OF EPIDEMIOLOGY AND COMMUNITY HEALTH, 75(4), 387-389 [10.1136/jech-2020-215256].

It depends on how you ask: Measuring bias in population surveys of compliance with COVID-19 public health guidance

Barjaková, M;
2021

Abstract

Accurate measurement of compliance with COVID-19 guidance is important for public health policy and communications. Responses to surveys, however, are susceptible to psychological biases, including framing effects and social desirability. Our aim was to measure the effects of these biases on estimates of compliance with public health guidance (eg, hand-washing, social distancing). Design We conducted two online experiments (n=1800) and varied whether questions were framed positively or negatively (eg, € I always wash my hands...' vs € I don't always wash my hands...'). We also varied the degree to which anonymity was assured, via a € list' experiment. Results Reported compliance, despite being generally high, was reduced by negatively framing questions and increasing anonymity using a list experiment technique. Effect sizes were large: compliance estimates diminished by up to 17% points and 10% points, respectively. Conclusion Estimates of compliance with COVID-19 guidance vary substantially with how the question is asked. Standard tracking surveys tend to pose questions in ways that lead to higher estimates than alternative approaches. Experimental tests of these surveys offer public health officials greater insight into the range of likely compliance estimates to better inform policy and communications.
Si
Articolo in rivista - Articolo scientifico
Scientifica
Cognition; Health behaviour; Measurement; Psychology; Public health;
English
387
389
3
Timmons, S., Mcginnity, F., Belton, C., Barjaková, M., Lunn, P. (2021). It depends on how you ask: Measuring bias in population surveys of compliance with COVID-19 public health guidance. JOURNAL OF EPIDEMIOLOGY AND COMMUNITY HEALTH, 75(4), 387-389 [10.1136/jech-2020-215256].
Timmons, S; Mcginnity, F; Belton, C; Barjaková, M; Lunn, P
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/10281/391834
Citazioni
  • Scopus 14
  • ???jsp.display-item.citation.isi??? 12
Social impact