Searching for accurate machine and deep learning models is a computationally expensive and awfully energivorous process. A strategy which has been recently gaining importance to drastically reduce computational time and energy consumed is to exploit the availability of different information sources, with different computational costs and different “fidelity,” typically smaller portions of a large dataset. The multi-source optimization strategy fits into the scheme of Gaussian Process-based Bayesian Optimization. An Augmented Gaussian Process method exploiting multiple information sources (namely, AGP-MISO) is proposed. The Augmented Gaussian Process is trained using only “reliable” information among available sources. A novel acquisition function is defined according to the Augmented Gaussian Process. Computational results are reported related to the optimization of the hyperparameters of a Support Vector Machine (SVM) classifier using two sources: a large dataset—the most expensive one—and a smaller portion of it. A comparison with a traditional Bayesian Optimization approach to optimize the hyperparameters of the SVM classifier on the large dataset only is reported.

Candelieri, A., Perego, R., & Archetti, F. (2021). Green machine learning via augmented Gaussian processes and multi-information source optimization. SOFT COMPUTING, 25(19), 12591-12603 [10.1007/s00500-021-05684-7].

Green machine learning via augmented Gaussian processes and multi-information source optimization

Candelieri A.
;
Perego R.;Archetti F.
2021

Abstract

Searching for accurate machine and deep learning models is a computationally expensive and awfully energivorous process. A strategy which has been recently gaining importance to drastically reduce computational time and energy consumed is to exploit the availability of different information sources, with different computational costs and different “fidelity,” typically smaller portions of a large dataset. The multi-source optimization strategy fits into the scheme of Gaussian Process-based Bayesian Optimization. An Augmented Gaussian Process method exploiting multiple information sources (namely, AGP-MISO) is proposed. The Augmented Gaussian Process is trained using only “reliable” information among available sources. A novel acquisition function is defined according to the Augmented Gaussian Process. Computational results are reported related to the optimization of the hyperparameters of a Support Vector Machine (SVM) classifier using two sources: a large dataset—the most expensive one—and a smaller portion of it. A comparison with a traditional Bayesian Optimization approach to optimize the hyperparameters of the SVM classifier on the large dataset only is reported.
No
Articolo in rivista - Articolo scientifico
Scientifica
Bayesian optimization; Gaussian processes; Green AI; Green machine learning; Multi information source optimization;
English
12591
12603
13
Candelieri, A., Perego, R., & Archetti, F. (2021). Green machine learning via augmented Gaussian processes and multi-information source optimization. SOFT COMPUTING, 25(19), 12591-12603 [10.1007/s00500-021-05684-7].
Candelieri, A; Perego, R; Archetti, F
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/10281/327074
Citazioni
  • Scopus 3
  • ???jsp.display-item.citation.isi??? 2
Social impact