When analyzing data in contingency tables it is frequent to deal with sparse data, particularly when the sample size is small relative to the number of cells. Most analyses of this kind are interpreted in an exploratory manner and even if tests are performed, little attention is paid to statistical power. This paper proposes a method we call redundant procedure, which is based on the union–intersection principle and increases test power by focusing on specific components of the hypothesis. This method is particularly helpful when the hypothesis to be tested can be expressed as the intersections of simpler models, such that at least some of them pertain to smaller table marginals. This situation leads to working on tables that are naturally denser. One advantage of this method is its direct application to (chain) graphical models. We illustrate the proposal through simulations and suggest strategies to increase the power of tests in sparse tables. Finally, we demonstrate an application to the EU-SILC dataset.

Nicolussi, F., Cazzaro, M., Rudas, T. (2023). Improving the power of hypothesis tests in sparse contingency tables. STATISTICAL PAPERS [10.1007/s00362-023-01473-6].

Improving the power of hypothesis tests in sparse contingency tables

Nicolussi F.
;
Cazzaro M.;
2023

Abstract

When analyzing data in contingency tables it is frequent to deal with sparse data, particularly when the sample size is small relative to the number of cells. Most analyses of this kind are interpreted in an exploratory manner and even if tests are performed, little attention is paid to statistical power. This paper proposes a method we call redundant procedure, which is based on the union–intersection principle and increases test power by focusing on specific components of the hypothesis. This method is particularly helpful when the hypothesis to be tested can be expressed as the intersections of simpler models, such that at least some of them pertain to smaller table marginals. This situation leads to working on tables that are naturally denser. One advantage of this method is its direct application to (chain) graphical models. We illustrate the proposal through simulations and suggest strategies to increase the power of tests in sparse tables. Finally, we demonstrate an application to the EU-SILC dataset.
Articolo in rivista - Articolo scientifico
Categorical variables; Graphical model; MC simulation; Redundant test; Union intersection principle;
English
3-ago-2023
2023
none
Nicolussi, F., Cazzaro, M., Rudas, T. (2023). Improving the power of hypothesis tests in sparse contingency tables. STATISTICAL PAPERS [10.1007/s00362-023-01473-6].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/450999
Citazioni
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
Social impact