Autonomous driving is one of the most challenging problems of the last decades. The development in recent years is mainly due to the continuous expansion of Artificial Intelligence. Nowadays, most self-driving systems use Deep Learning techniques. In recent years, however, thanks to the successful learning demonstrations of Atari games and AlphaGo by Google DeepMind, new frameworks based on Deep Reinforcement Learning are being developed. The objective is to combine the advantages of image processing and feature extraction of convolutional networks, and the learning process through the interaction of one or multiple agents with their environment. This work aims to deepen and explore these new methodologies applied to autonomous driving cars. In particular, we developed a framework for controlling a car in a simulated environment. The agent learns to drive within a neighborhood with constant speed, variable light conditions, and avoiding collisions with external objects. The proposed techniques are based on Double Deep Q-learning and Dueling Double Deep Q-learning. We implemented two variants of the algorithms: one trained from random weights and one exploiting the concepts of Transfer Learning. After a simulation study, the Dueling Double Deep Q-learning with Transfer Learning has showed promising performance.

Riboni, A., Candelieri, A., Borrotti, M. (2022). Deep Autonomous Agents Comparison for Self-driving Cars. In Machine Learning, Optimization, and Data Science 7th International Conference, LOD 2021, Grasmere, UK, October 4–8, 2021, Revised Selected Papers, Part I (pp.201-213). Springer Science and Business Media Deutschland GmbH [10.1007/978-3-030-95467-3_16].

Deep Autonomous Agents Comparison for Self-driving Cars

Candelieri A.;Borrotti M.
2022

Abstract

Autonomous driving is one of the most challenging problems of the last decades. The development in recent years is mainly due to the continuous expansion of Artificial Intelligence. Nowadays, most self-driving systems use Deep Learning techniques. In recent years, however, thanks to the successful learning demonstrations of Atari games and AlphaGo by Google DeepMind, new frameworks based on Deep Reinforcement Learning are being developed. The objective is to combine the advantages of image processing and feature extraction of convolutional networks, and the learning process through the interaction of one or multiple agents with their environment. This work aims to deepen and explore these new methodologies applied to autonomous driving cars. In particular, we developed a framework for controlling a car in a simulated environment. The agent learns to drive within a neighborhood with constant speed, variable light conditions, and avoiding collisions with external objects. The proposed techniques are based on Double Deep Q-learning and Dueling Double Deep Q-learning. We implemented two variants of the algorithms: one trained from random weights and one exploiting the concepts of Transfer Learning. After a simulation study, the Dueling Double Deep Q-learning with Transfer Learning has showed promising performance.
No
paper
Autonomous driving; Deep Q-learning; Transfer learning;
English
7th International Conference on Machine Learning, Optimization, and Data Science, LOD 2021 - 4 October 2021 through 8 October 2021
9783030954666
Riboni, A., Candelieri, A., Borrotti, M. (2022). Deep Autonomous Agents Comparison for Self-driving Cars. In Machine Learning, Optimization, and Data Science 7th International Conference, LOD 2021, Grasmere, UK, October 4–8, 2021, Revised Selected Papers, Part I (pp.201-213). Springer Science and Business Media Deutschland GmbH [10.1007/978-3-030-95467-3_16].
Riboni, A; Candelieri, A; Borrotti, M
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/396695
Citazioni
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
Social impact