Despite the rapid development in very recent years of Artificial Intelligence models to predict poverty risk, this problem still remains an unsolved open challenge, especially from a multidimensional perspective. One of the main challenges is related to the scarcity of labelled and high-quality data for training models coupled with the lack of a general reference model to build good predictors. This results in the proposal of a variety of approaches tailored to specific contexts. This paper presents our proposal to address multidimensional poverty prediction, starting from an unlabelled dataset. We focus on the case of a fragile population, the older adults; our approach is highly flexible and can be easily adapted to various scenarios. Firstly, starting from expert knowledge, we apply a stochastic method for estimating the probability of an individual being poor, and we use this probability to identify three levels of risk. Then, we train an XGBoost classification model and exploit its tree structure to define a ranking of feature relevance. This information is used to create a new set of aggregated features representative of different poverty dimensions. An explainable novel Naive Bayes model is then trained for predicting individuals' deprivation level in our particular domain. The capacity to identify which variables are predominantly associated with poverty among older adults offers valuable insights for policymakers and decision-makers to address poverty effectively.

Olearo, L., D'Adda, F., Messina, E., Cremaschi, M., Bandini, S., Gasparini, F. (2024). Facing multidimensional poverty in older adults: An artificial intelligence approach that reveals the variable relevance. INTELLIGENZA ARTIFICIALE, 18(1), 51-65 [10.3233/ia-240027].

Facing multidimensional poverty in older adults: An artificial intelligence approach that reveals the variable relevance

Olearo, Lorenzo;D'Adda, Fabio;Messina, Enza;Cremaschi, Marco;Bandini, Stefania;Gasparini, Francesca
2024

Abstract

Despite the rapid development in very recent years of Artificial Intelligence models to predict poverty risk, this problem still remains an unsolved open challenge, especially from a multidimensional perspective. One of the main challenges is related to the scarcity of labelled and high-quality data for training models coupled with the lack of a general reference model to build good predictors. This results in the proposal of a variety of approaches tailored to specific contexts. This paper presents our proposal to address multidimensional poverty prediction, starting from an unlabelled dataset. We focus on the case of a fragile population, the older adults; our approach is highly flexible and can be easily adapted to various scenarios. Firstly, starting from expert knowledge, we apply a stochastic method for estimating the probability of an individual being poor, and we use this probability to identify three levels of risk. Then, we train an XGBoost classification model and exploit its tree structure to define a ranking of feature relevance. This information is used to create a new set of aggregated features representative of different poverty dimensions. An explainable novel Naive Bayes model is then trained for predicting individuals' deprivation level in our particular domain. The capacity to identify which variables are predominantly associated with poverty among older adults offers valuable insights for policymakers and decision-makers to address poverty effectively.
Articolo in rivista - Articolo scientifico
feature ranking; Multidimensional poverty; naive bayes; older adults; poverty prediction; XGBoost;
English
31-lug-2024
2024
18
1
51
65
none
Olearo, L., D'Adda, F., Messina, E., Cremaschi, M., Bandini, S., Gasparini, F. (2024). Facing multidimensional poverty in older adults: An artificial intelligence approach that reveals the variable relevance. INTELLIGENZA ARTIFICIALE, 18(1), 51-65 [10.3233/ia-240027].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/522002
Citazioni
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
Social impact