The effect of a Sequential Mixed-Mode Design on Panel Attrition: Evidence from an experiment of the Understanding Society Innovation Panel

This paper evaluates the effect of a wave of sequential mixed-mode design – with web as one of the mode of data collection – on panel attrition at the subsequent wave. I used data from the Innovation Panel (IP) of Understanding Society (UKHLS). At the fifth wave the sample was randomly allocated to two experimental groups: one assigned to a unimode face-to-face design and another to a mixed-mode design (web with a face-to-face follow up). I use logistic regression to model the effect of the experimental allocation on attrition at the 6th wave. I do not find evidence that a mixed mode design – with web as one of the modes of data collection – increases attrition. On the contrary, for the original sample non respondents at wave 4 a mixed-mode design reduce attrition. I speculate that some groups of sample members are both more likely to be non respondents and have a preference for web as a mode of data collection. No effect was found for the entire sample, for the original sample respondents and for the refreshment sample (added at the 4th wave). The finding that a mixed mode survey with web might decrease attrition for previous waves non respondents is particularly promising since this group is at higher risk of attrition. This study constitutes a novel contribution. In fact, the evidence on the effect of mixed-mode on panel attrition is scarce. This and other similar studies may contribute to the decisions on the mode of data collection for Understanding Society and other panel surveys. Further research is needed to assess whether this effect persists with future waves, or if this is eroded over time. Moreover, future research may compare costs and data quality in the two protocols. References: (please include 5 major references APA style): Jäckle, Annette, Peter Lynn and Jon Burton. Going Online with a Face-to-Face Hourshold Panel: Initial Results from an Experimental on the Understanding Society Innovation Panel, ISER Working Paper Series No. 2013- 03 Couper, Mick. 2012. Assessment of Innovations in Data Collection Technology for Understanding Society. Technical report, Economic and Social Research Council. de Leeuw, E. D. 2005. To Mix or not to Mix Data Collection Modes in Surveys. Journal of Official Statistics, 21(5):233-255. Lynn, Peter. 2013. Alternative Sequential Mixed-Mode designs: Effects on Attrition Rates, Attrition Bias, and Costs. Journal of Survey Statistics and Methodology 1: 183–205 Millar, Morgan M., and Don A. Dillman. 2011. Improving Response to Web and Mixed-mode Surveys Public Opinion Quarterly, 75(2): 249–269