In the context of longitudinal data, we show that a general class of hidden Markov (HM, [1]) models may be equivalent to a class of finite mixture (FM, [3]) models based on an augmented set of components and suitable constraints on the conditional response probabilities, given these components. We formulate a misspecification test for the latent structure of an HM model comparing maximum likelihood values of the two models for the same data, and when the number of possible latent state sequences is excessive, we propose a multiple version of this test including the Bonferroni correction. The procedure is simple since it is based on the output of the Expectation-Maximization estimation algorithm [2]. The properties of this testing procedure are evaluated through a simulation study. An empirical application illustrates it through data from the National Longitudinal Survey of Youth, in which we jointly consider wages and years of experience after labour force entry. We show that the proposed testing procedure may also be used as an alternative model selection criterion for the number of latent states of an HM model to those usually employed.
Bartolucci, F., Pandolfi, F., Pennoni, F. (2022). Mispecification tests for hidden Markov models based on a new class of finite mixture models. In IFCS 2022 Book of Abstracts 17th Conference of the International Federation of Classification Societies Classification and Data Science in the Digital Age (pp.271-271).
Mispecification tests for hidden Markov models based on a new class of finite mixture models
Pennoni F
2022
Abstract
In the context of longitudinal data, we show that a general class of hidden Markov (HM, [1]) models may be equivalent to a class of finite mixture (FM, [3]) models based on an augmented set of components and suitable constraints on the conditional response probabilities, given these components. We formulate a misspecification test for the latent structure of an HM model comparing maximum likelihood values of the two models for the same data, and when the number of possible latent state sequences is excessive, we propose a multiple version of this test including the Bonferroni correction. The procedure is simple since it is based on the output of the Expectation-Maximization estimation algorithm [2]. The properties of this testing procedure are evaluated through a simulation study. An empirical application illustrates it through data from the National Longitudinal Survey of Youth, in which we jointly consider wages and years of experience after labour force entry. We show that the proposed testing procedure may also be used as an alternative model selection criterion for the number of latent states of an HM model to those usually employed.File | Dimensione | Formato | |
---|---|---|---|
IFCS_2022_Pennoni1_1.pdf
accesso aperto
Descrizione: Slides
Tipologia di allegato:
Other attachments
Dimensione
428.63 kB
Formato
Adobe PDF
|
428.63 kB | Adobe PDF | Visualizza/Apri |
Abstract_Pennoni_IFCS22.pdf
accesso aperto
Descrizione: Abstract
Tipologia di allegato:
Publisher’s Version (Version of Record, VoR)
Dimensione
914.76 kB
Formato
Adobe PDF
|
914.76 kB | Adobe PDF | Visualizza/Apri |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.