The automatic assessment of the aesthetic quality of a photo is a challenging and extensively studied problem. Most of the existing works focus on the aesthetic quality assessment of photos regardless of the depicted subject and mainly use features extracted from the entire image. It has been observed that the performance of generic content aesthetic assessment methods significantly decreases when it comes to images depicting faces. This paper introduces a method for evaluating the aesthetic quality of images with faces by encoding both the properties of the entire image and specific aspects of the face. Three different convolutional neural networks are exploited to encode information regarding perceptual quality, global image aesthetics, and facial attributes; then, a model is trained to combine these features to explicitly predict the aesthetics of images containing faces. Experimental results show that our approach outperforms existing methods for both binary, i.e., low/high, and continuous aesthetic score prediction on four different image databases in the state-of-the-art.

Celona, L., Schettini, R. (2021). A Genetic Algorithm to Combine Deep Features for the Aesthetic Assessment of Images Containing Faces. SENSORS, 21(4), 1-17 [10.3390/s21041307].

A Genetic Algorithm to Combine Deep Features for the Aesthetic Assessment of Images Containing Faces

Celona, Luigi
;
Schettini, Raimondo
2021

Abstract

The automatic assessment of the aesthetic quality of a photo is a challenging and extensively studied problem. Most of the existing works focus on the aesthetic quality assessment of photos regardless of the depicted subject and mainly use features extracted from the entire image. It has been observed that the performance of generic content aesthetic assessment methods significantly decreases when it comes to images depicting faces. This paper introduces a method for evaluating the aesthetic quality of images with faces by encoding both the properties of the entire image and specific aspects of the face. Three different convolutional neural networks are exploited to encode information regarding perceptual quality, global image aesthetics, and facial attributes; then, a model is trained to combine these features to explicitly predict the aesthetics of images containing faces. Experimental results show that our approach outperforms existing methods for both binary, i.e., low/high, and continuous aesthetic score prediction on four different image databases in the state-of-the-art.
Articolo in rivista - Articolo scientifico
Convolutional neural networks; Faces; Genetic algorithms; Image aesthetics;
English
12-feb-2021
2021
21
4
1
17
1307
none
Celona, L., Schettini, R. (2021). A Genetic Algorithm to Combine Deep Features for the Aesthetic Assessment of Images Containing Faces. SENSORS, 21(4), 1-17 [10.3390/s21041307].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/302431
Citazioni
  • Scopus 5
  • ???jsp.display-item.citation.isi??? 5
Social impact