The use of large datasets for targeted therapeutic interventions requires new ways to characterize the heterogeneity observed across subgroups of a specific population. In particular, models for partially exchangeable data are needed for inference on nested datasets, where the observations are assumed to be organized in different units and some sharing of information is required to learn distinctive features of the units. In this manuscript, we propose a nested common atoms model (CAM) that is particularly suited for the analysis of nested datasets where the distributions of the units are expected to differ only over a small fraction of the observations sampled from each unit. The proposed CAM allows a two-layered clustering at the distributional and observational level and is amenable to scalable posterior inference through the use of a computationally efficient nested slice sampler algorithm. We further discuss how to extend the proposed modeling framework to handle discrete measurements, and we conduct posterior inference on a real microbiome dataset from a diet swap study to investigate how the alterations in intestinal microbiota composition are associated with different eating habits. We further investigate the performance of our model in capturing true distributional structures in the population by means of a simulation study.

Denti, F., Camerlenghi, F., Guindani, M., Mira, A. (2023). A Common Atoms Model for the Bayesian Nonparametric Analysis of Nested Data. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 118(541), 405-416 [10.1080/01621459.2021.1933499].

A Common Atoms Model for the Bayesian Nonparametric Analysis of Nested Data

Denti, Francesco;Camerlenghi, Federico;
2023

Abstract

The use of large datasets for targeted therapeutic interventions requires new ways to characterize the heterogeneity observed across subgroups of a specific population. In particular, models for partially exchangeable data are needed for inference on nested datasets, where the observations are assumed to be organized in different units and some sharing of information is required to learn distinctive features of the units. In this manuscript, we propose a nested common atoms model (CAM) that is particularly suited for the analysis of nested datasets where the distributions of the units are expected to differ only over a small fraction of the observations sampled from each unit. The proposed CAM allows a two-layered clustering at the distributional and observational level and is amenable to scalable posterior inference through the use of a computationally efficient nested slice sampler algorithm. We further discuss how to extend the proposed modeling framework to handle discrete measurements, and we conduct posterior inference on a real microbiome dataset from a diet swap study to investigate how the alterations in intestinal microbiota composition are associated with different eating habits. We further investigate the performance of our model in capturing true distributional structures in the population by means of a simulation study.
Articolo in rivista - Articolo scientifico
Common atoms model; Microbiome abundance analysis; Nested dataset; Nested Dirichlet process; Partially exchangeable data;
English
14-lug-2021
2023
118
541
405
416
none
Denti, F., Camerlenghi, F., Guindani, M., Mira, A. (2023). A Common Atoms Model for the Bayesian Nonparametric Analysis of Nested Data. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 118(541), 405-416 [10.1080/01621459.2021.1933499].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/321426
Citazioni
  • Scopus 7
  • ???jsp.display-item.citation.isi??? 10
Social impact