We show how to handle the information which is acquired in a dynamic framework when there are multiple items in a survey collected on the same individuals at different time occasions. The response variables are commonly measured on an ordinal scale and the data may show a non-monotone missing pattern. The underlying phenomenon which is related to the interest of the survey may be modelled by a latent stochastic process. The latter having dependences according to a Markov structure is able to capture the heterogeneity of the response behaviour and to account for the measurement errors that naturally arise in the survey. The maximum likelihood estimation of the model parameters allows us to handle the missing data and to take advantage of the information provided by those individuals not showing complete responses. In a similar way, it is possible to consider a counterfactual framework in which the outcomes of interest are not directly observable even for the selected treatment. Such a flexible modelling approach is illustrated with two examples based on real data.

Pennoni, F. (2016). Modelling a multivariate hidden Markov process on survey data. In Proceedings of the 48th scientific meeting of the Italian Statistical Society (pp.1-10).

Modelling a multivariate hidden Markov process on survey data

PENNONI, FULVIA
2016

Abstract

We show how to handle the information which is acquired in a dynamic framework when there are multiple items in a survey collected on the same individuals at different time occasions. The response variables are commonly measured on an ordinal scale and the data may show a non-monotone missing pattern. The underlying phenomenon which is related to the interest of the survey may be modelled by a latent stochastic process. The latter having dependences according to a Markov structure is able to capture the heterogeneity of the response behaviour and to account for the measurement errors that naturally arise in the survey. The maximum likelihood estimation of the model parameters allows us to handle the missing data and to take advantage of the information provided by those individuals not showing complete responses. In a similar way, it is possible to consider a counterfactual framework in which the outcomes of interest are not directly observable even for the selected treatment. Such a flexible modelling approach is illustrated with two examples based on real data.
paper
Expectation-Maximization algorithm, latent variables, mitochondrial DNA haplogroup, observational studies, recursive algorithm, treatment effect
English
48th Scientific Meeting of the Italian Statistical Society
2016
Pratesi, M; Perna, C
Proceedings of the 48th scientific meeting of the Italian Statistical Society
9788861970618
6-giu-2012
2016
1
10
open
Pennoni, F. (2016). Modelling a multivariate hidden Markov process on survey data. In Proceedings of the 48th scientific meeting of the Italian Statistical Society (pp.1-10).
File in questo prodotto:
File Dimensione Formato  
Pennoni_may13.pdf

accesso aperto

Dimensione 98.27 kB
Formato Adobe PDF
98.27 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/116309
Citazioni
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
Social impact