When multiple hypotheses are tested, interest is often in ensuring that the proportion of false discoveries is small with high confidence. In this paper, confidence upper bounds for the false discovery proportion are constructed, which are simultaneous over all rejection cut-offs. In particular, this allows the user to select a set of hypotheses post hoc such that the false discovery proportion lies below some constant with high confidence. Our method uses permutations to account for the dependence structure in the data. So far only Meinshausen (2006) has developed an exact, permutation-based and computationally feasible method for obtaining simultaneous false discovery proportion bounds.We propose an exact method which uniformly improves that procedure. Further, we provide a generalization of the method that lets the user select the shape of the simultaneous confidence bounds; this gives the user more freedom in determining the power properties of the method. Interestingly, several existing permutation methods, such as significance analysis of microarrays and the maxT method of Westfall & Young (1993), are obtained as special cases.

Hemerik, J., Solari, A., Goeman, J. (2019). Permutation-based simultaneous confidence bounds for the false discovery proportion. BIOMETRIKA, 106(3), 635-649 [10.1093/biomet/asz021].

Permutation-based simultaneous confidence bounds for the false discovery proportion

Solari, A;
2019

Abstract

When multiple hypotheses are tested, interest is often in ensuring that the proportion of false discoveries is small with high confidence. In this paper, confidence upper bounds for the false discovery proportion are constructed, which are simultaneous over all rejection cut-offs. In particular, this allows the user to select a set of hypotheses post hoc such that the false discovery proportion lies below some constant with high confidence. Our method uses permutations to account for the dependence structure in the data. So far only Meinshausen (2006) has developed an exact, permutation-based and computationally feasible method for obtaining simultaneous false discovery proportion bounds.We propose an exact method which uniformly improves that procedure. Further, we provide a generalization of the method that lets the user select the shape of the simultaneous confidence bounds; this gives the user more freedom in determining the power properties of the method. Interestingly, several existing permutation methods, such as significance analysis of microarrays and the maxT method of Westfall & Young (1993), are obtained as special cases.
Articolo in rivista - Articolo scientifico
Confidence envelope; Exceedance control; False discovery rate; FDP; Multiple testing;
English
635
649
15
Hemerik, J., Solari, A., Goeman, J. (2019). Permutation-based simultaneous confidence bounds for the false discovery proportion. BIOMETRIKA, 106(3), 635-649 [10.1093/biomet/asz021].
File in questo prodotto:
File Dimensione Formato  
asz021.pdf

Solo gestori archivio

Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Dimensione 286.82 kB
Formato Adobe PDF
286.82 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/243051
Citazioni
  • Scopus 14
  • ???jsp.display-item.citation.isi??? ND
Social impact