Digital raindrop removal is a branch of image restoration that aims at identifying adherent droplets on a glass surface and replacing them with plausible content. When successfully performed, raindrop removal was proven in the past to positively affect both the perceived appearance of the scene, and the performance of computer vision tasks such as semantic segmentation and object detection. In this paper, we design and implement a new encoder-decoder neural network for supervised raindrop removal. Our network, given a rainy input image, produces as output the Laplacian pyramid of a rain-free version of the input, making it possible to handle the variety of appearances of rain droplets by processing different frequency bands independently. To this end, we define and experimentally prove the effectiveness of a custom loss function that combines the errors of the different Laplacian frequency bands. We test our model for raindrop removal on a standard dataset, using multiple objective metrics to provide a detailed analysis of its performance. We confirm the superiority of our proposal in a comparison with other methods from the state of the art.

Zini, S., Buzzelli, M. (2022). Laplacian encoder-decoder network for raindrop removal. PATTERN RECOGNITION LETTERS, 158, 24-33 [10.1016/j.patrec.2022.04.016].

Laplacian encoder-decoder network for raindrop removal

Zini, Simone
;
Buzzelli, Marco
2022

Abstract

Digital raindrop removal is a branch of image restoration that aims at identifying adherent droplets on a glass surface and replacing them with plausible content. When successfully performed, raindrop removal was proven in the past to positively affect both the perceived appearance of the scene, and the performance of computer vision tasks such as semantic segmentation and object detection. In this paper, we design and implement a new encoder-decoder neural network for supervised raindrop removal. Our network, given a rainy input image, produces as output the Laplacian pyramid of a rain-free version of the input, making it possible to handle the variety of appearances of rain droplets by processing different frequency bands independently. To this end, we define and experimentally prove the effectiveness of a custom loss function that combines the errors of the different Laplacian frequency bands. We test our model for raindrop removal on a standard dataset, using multiple objective metrics to provide a detailed analysis of its performance. We confirm the superiority of our proposal in a comparison with other methods from the state of the art.
Articolo in rivista - Articolo scientifico
Image restoration; Rain removal; Raindrop removal;
English
14-apr-2022
2022
158
24
33
reserved
Zini, S., Buzzelli, M. (2022). Laplacian encoder-decoder network for raindrop removal. PATTERN RECOGNITION LETTERS, 158, 24-33 [10.1016/j.patrec.2022.04.016].
File in questo prodotto:
File Dimensione Formato  
Zini-2022-Pattern Recognit Lett-VoR.pdf

Solo gestori archivio

Descrizione: Short communication
Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Licenza: Tutti i diritti riservati
Dimensione 3.74 MB
Formato Adobe PDF
3.74 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/368137
Citazioni
  • Scopus 5
  • ???jsp.display-item.citation.isi??? 3
Social impact