Missing data recurrently affect datasets in almost every field of quantitative research. The subject is vast and complex and has originated a literature rich in very different approaches to the problem. Within an exploratory framework, distance-based methods such as nearest-neighbour imputation (NNI), or procedures involving multivariate data analysis (MVDA) techniques seem to treat the problem properly. In NNI, the metric and the number of donors can be chosen at will. MVDA-based procedures expressly account for variable associations. The new approach proposed here, called Forward Imputation, ideally meets these features. It is designed as a sequential procedure that imputes missing data in a step-by-step process involving subsets of units according to their “completeness rate”. Two methods within this context are developed for the imputation of quantitative data. One applies NNI with the Mahalanobis distance, the other combines NNI and principal component analysis. Statistical properties of the two methods are discussed, and their performance is assessed, also in comparison with alternative imputation methods. To this purpose, a simulation study in the presence of different data patterns along with an application to real data are carried out, and practical hints for users are also provided.

Solaro, N., Barbiero, A., Manzi, G., Ferrari, P. (2017). A sequential distance-based approach for imputing missing data: Forward Imputation. ADVANCES IN DATA ANALYSIS AND CLASSIFICATION, 11(2), 395-414 [10.1007/s11634-016-0243-0].

A sequential distance-based approach for imputing missing data: Forward Imputation

Solaro, N
Primo
;
2017

Abstract

Missing data recurrently affect datasets in almost every field of quantitative research. The subject is vast and complex and has originated a literature rich in very different approaches to the problem. Within an exploratory framework, distance-based methods such as nearest-neighbour imputation (NNI), or procedures involving multivariate data analysis (MVDA) techniques seem to treat the problem properly. In NNI, the metric and the number of donors can be chosen at will. MVDA-based procedures expressly account for variable associations. The new approach proposed here, called Forward Imputation, ideally meets these features. It is designed as a sequential procedure that imputes missing data in a step-by-step process involving subsets of units according to their “completeness rate”. Two methods within this context are developed for the imputation of quantitative data. One applies NNI with the Mahalanobis distance, the other combines NNI and principal component analysis. Statistical properties of the two methods are discussed, and their performance is assessed, also in comparison with alternative imputation methods. To this purpose, a simulation study in the presence of different data patterns along with an application to real data are carried out, and practical hints for users are also provided.
Articolo in rivista - Articolo scientifico
Iterative PCA; Mahalanobis distance; MCAR missing data; MissForest; Nearest-neighbour imputation; Skew data
English
2017
11
2
395
414
reserved
Solaro, N., Barbiero, A., Manzi, G., Ferrari, P. (2017). A sequential distance-based approach for imputing missing data: Forward Imputation. ADVANCES IN DATA ANALYSIS AND CLASSIFICATION, 11(2), 395-414 [10.1007/s11634-016-0243-0].
File in questo prodotto:
File Dimensione Formato  
188657.pdf

Solo gestori archivio

Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Dimensione 800.39 kB
Formato Adobe PDF
800.39 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/144612
Citazioni
  • Scopus 9
  • ???jsp.display-item.citation.isi??? 6
Social impact