We present a procedure for the optimal implementation of public policies that involve predicting an individual behavior or characteristic. By linking prediction errors of any given classification model to the resulting social welfare, we provide a simple measure to rank different models and select the optimal one. Such measure is defined as the difference between the social welfare of a given policy and that of an error-free policy, and it is related to the ROC curve employed in the Machine Learning literature. We extend the cost isometrics approach described in the literature by considering the case of heterogeneous costs of type I and II errors. We apply our approach to the prediction of inaccurate tax returns issued by Italian self-employed and sole proprietorships. We show that the approach can result in substantial increases in revenues, and that random forest models, beyond providing comparatively good predictions, yield important insights. In our case, they both provide empirical support for existing theories on tax evasion — highlighting, for instance, cross-sectoral heterogeneity — and extend our understanding of the phenomenon — such as the role of bunching.

Battiston, P., Gamba, S., Santoro, A. (2024). Machine learning and the optimization of prediction-based policies. TECHNOLOGICAL FORECASTING AND SOCIAL CHANGE, 199(February 2024) [10.1016/j.techfore.2023.123080].

Machine learning and the optimization of prediction-based policies

Battiston, Pietro
;
Santoro, Alessandro
2024

Abstract

We present a procedure for the optimal implementation of public policies that involve predicting an individual behavior or characteristic. By linking prediction errors of any given classification model to the resulting social welfare, we provide a simple measure to rank different models and select the optimal one. Such measure is defined as the difference between the social welfare of a given policy and that of an error-free policy, and it is related to the ROC curve employed in the Machine Learning literature. We extend the cost isometrics approach described in the literature by considering the case of heterogeneous costs of type I and II errors. We apply our approach to the prediction of inaccurate tax returns issued by Italian self-employed and sole proprietorships. We show that the approach can result in substantial increases in revenues, and that random forest models, beyond providing comparatively good predictions, yield important insights. In our case, they both provide empirical support for existing theories on tax evasion — highlighting, for instance, cross-sectoral heterogeneity — and extend our understanding of the phenomenon — such as the role of bunching.
Articolo in rivista - Articolo scientifico
Machine learning; Prediction; Public policy; ROC curve; Tax behavior;
English
14-dic-2023
2024
199
February 2024
123080
none
Battiston, P., Gamba, S., Santoro, A. (2024). Machine learning and the optimization of prediction-based policies. TECHNOLOGICAL FORECASTING AND SOCIAL CHANGE, 199(February 2024) [10.1016/j.techfore.2023.123080].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/453478
Citazioni
  • Scopus 4
  • ???jsp.display-item.citation.isi??? 4
Social impact