A pipeline for the generation of synthetic dataset of spectral scenes, with corresponding sensor readings, is here proposed. The pipeline is composed of two main parts: Part 1: Image pixel reflectance assignment. Individual pixels from an input sRGB image dataset are replaced with appropriate reflectance spectra from a given non-image reflectance dataset. The resulting dataset of reflectance images is considered the starting point for simulated sensor acquisition. Part 2: Simulated sensor acquisition. Each spectral reflectance image in the dataset is illuminated with an illuminant spectra to produce a radiance image. The resulting dataset of radiance images is then synthetically read from the simulated sensors (camera and ambient multispectral sensor) of the Huawei P50 phone, using the corresponding sensors transmittance information. The capability of generating any large-scale, diverse, and annotated synthetic spectral datasets can facilitate the development of data-driven imaging algorithms, and foster reproducible research.

Buzzelli, M., Tchobanou, M., Schettini, R., Bianco, S. (2023). A General-purpose Pipeline for Realistic Synthetic Multispectral Image Dataset Generation. In 31st Color and Imaging Conference - Color Science and Engineering Systems, Technologies, and Applications, CIC 2023 (pp.155-160). Society for Imaging Science and Technology [10.2352/cic.2023.31.1.30].

A General-purpose Pipeline for Realistic Synthetic Multispectral Image Dataset Generation

Buzzelli, M
;
Schettini, R;Bianco, S
2023

Abstract

A pipeline for the generation of synthetic dataset of spectral scenes, with corresponding sensor readings, is here proposed. The pipeline is composed of two main parts: Part 1: Image pixel reflectance assignment. Individual pixels from an input sRGB image dataset are replaced with appropriate reflectance spectra from a given non-image reflectance dataset. The resulting dataset of reflectance images is considered the starting point for simulated sensor acquisition. Part 2: Simulated sensor acquisition. Each spectral reflectance image in the dataset is illuminated with an illuminant spectra to produce a radiance image. The resulting dataset of radiance images is then synthetically read from the simulated sensors (camera and ambient multispectral sensor) of the Huawei P50 phone, using the corresponding sensors transmittance information. The capability of generating any large-scale, diverse, and annotated synthetic spectral datasets can facilitate the development of data-driven imaging algorithms, and foster reproducible research.
poster + paper
Multispectral imaging, data generation, data synthesis
English
31st Color and Imaging Conference - Color Science and Engineering Systems, Technologies, and Applications, CIC 2023 - 13 November 2023 through 17 November 2023
2023
31st Color and Imaging Conference - Color Science and Engineering Systems, Technologies, and Applications, CIC 2023
2023
31
1
155
160
https://library.imaging.org/cic/articles/31/1/28
reserved
Buzzelli, M., Tchobanou, M., Schettini, R., Bianco, S. (2023). A General-purpose Pipeline for Realistic Synthetic Multispectral Image Dataset Generation. In 31st Color and Imaging Conference - Color Science and Engineering Systems, Technologies, and Applications, CIC 2023 (pp.155-160). Society for Imaging Science and Technology [10.2352/cic.2023.31.1.30].
File in questo prodotto:
File Dimensione Formato  
Buzzelli-2023-Color Imaging Conf-VoR.pdf

Solo gestori archivio

Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Licenza: Tutti i diritti riservati
Dimensione 775.78 kB
Formato Adobe PDF
775.78 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/469561
Citazioni
  • Scopus 2
  • ???jsp.display-item.citation.isi??? ND
Social impact