The aesthetic quality of an image is defined as the measure or appreciation of the beauty of an image. Aesthetics is inherently a subjective property but there are certain factors that influence it such as, the semantic content of the image, the attributes describing the artistic aspect, the photographic setup used for the shot, etc. In this paper we propose a method for the automatic prediction of the aesthetics of an image that is based on the analysis of the semantic content, the artistic style and the composition of the image. The proposed network includes: a pre-trained network for semantic features extraction (the Backbone); a Multi Layer Perceptron (MLP) network that relies on the Backbone features for the prediction of image attributes (the AttributeNet); a self-adaptive Hypernetwork that exploits the attributes prior encoded into the embedding generated by the AttributeNet to predict the parameters of the target network dedicated to aesthetic estimation (the AestheticNet). Given an image, the proposed multi-network is able to predict: style and composition attributes, and aesthetic score distribution. Results on three benchmark datasets demonstrate the effectiveness of the proposed method, while the ablation study gives a better understanding of the proposed network.

Celona, L., Leonardi, M., Napoletano, P., Rozza, A. (2022). Composition and Style Attributes Guided Image Aesthetic Assessment. IEEE TRANSACTIONS ON IMAGE PROCESSING, 31, 5009-5024 [10.1109/TIP.2022.3191853].

Composition and Style Attributes Guided Image Aesthetic Assessment

Celona, Luigi
;
Leonardi, Marco;Napoletano, Paolo;
2022

Abstract

The aesthetic quality of an image is defined as the measure or appreciation of the beauty of an image. Aesthetics is inherently a subjective property but there are certain factors that influence it such as, the semantic content of the image, the attributes describing the artistic aspect, the photographic setup used for the shot, etc. In this paper we propose a method for the automatic prediction of the aesthetics of an image that is based on the analysis of the semantic content, the artistic style and the composition of the image. The proposed network includes: a pre-trained network for semantic features extraction (the Backbone); a Multi Layer Perceptron (MLP) network that relies on the Backbone features for the prediction of image attributes (the AttributeNet); a self-adaptive Hypernetwork that exploits the attributes prior encoded into the embedding generated by the AttributeNet to predict the parameters of the target network dedicated to aesthetic estimation (the AestheticNet). Given an image, the proposed multi-network is able to predict: style and composition attributes, and aesthetic score distribution. Results on three benchmark datasets demonstrate the effectiveness of the proposed method, while the ablation study gives a better understanding of the proposed network.
Articolo in rivista - Articolo scientifico
hypernetworks; Image aesthetic assessment; image composition; image style;
English
22-lug-2022
2022
31
5009
5024
none
Celona, L., Leonardi, M., Napoletano, P., Rozza, A. (2022). Composition and Style Attributes Guided Image Aesthetic Assessment. IEEE TRANSACTIONS ON IMAGE PROCESSING, 31, 5009-5024 [10.1109/TIP.2022.3191853].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/388639
Citazioni
  • Scopus 12
  • ???jsp.display-item.citation.isi??? 8
Social impact