We propose a novel deep multibranch and multitask neural network for artist, style, and genre painting categorization. The multibranch approach allows us to exploit at the same time the coarse layout of the painting and the fine-grained structures by using painting crops at different resolutions that are wisely extracted using a Spatial Transformer Network trained to identify the most discriminative subregions of paintings. The effectiveness of the proposed network is proved in experiments that are performed on a new dataset originally sourced from wikiart.org and hosted by Kaggle, and made suitable for artist, style and genre multitask learning. The dataset here proposed and made available for research is named MultitaskPainting100k, and is composed by 100K paintings, 1508 artists, 125 styles and 41 genres annotated by human experts. Among the different variants of the proposed network, the best method achieves accuracy levels of 56.5%, 57.2%, and 63.6% on the MultitaskPainting100k dataset for the tasks of artist, style and genre prediction respectively.

Bianco, S., Mazzini, D., Napoletano, P., Schettini, R. (2019). Multitask painting categorization by deep multibranch neural network. EXPERT SYSTEMS WITH APPLICATIONS, 135, 90-101 [10.1016/j.eswa.2019.05.036].

Multitask painting categorization by deep multibranch neural network

Bianco S;Mazzini D;Napoletano P;Schettini R
2019

Abstract

We propose a novel deep multibranch and multitask neural network for artist, style, and genre painting categorization. The multibranch approach allows us to exploit at the same time the coarse layout of the painting and the fine-grained structures by using painting crops at different resolutions that are wisely extracted using a Spatial Transformer Network trained to identify the most discriminative subregions of paintings. The effectiveness of the proposed network is proved in experiments that are performed on a new dataset originally sourced from wikiart.org and hosted by Kaggle, and made suitable for artist, style and genre multitask learning. The dataset here proposed and made available for research is named MultitaskPainting100k, and is composed by 100K paintings, 1508 artists, 125 styles and 41 genres annotated by human experts. Among the different variants of the proposed network, the best method achieves accuracy levels of 56.5%, 57.2%, and 63.6% on the MultitaskPainting100k dataset for the tasks of artist, style and genre prediction respectively.
Articolo in rivista - Articolo scientifico
Deep convolutional neural network; Multiresolution; Multitask; Painter recognition; Painting categorization; Painting style classification;
Deep Learning, Painting Categorization, Pattern Recognition
English
2019
135
90
101
reserved
Bianco, S., Mazzini, D., Napoletano, P., Schettini, R. (2019). Multitask painting categorization by deep multibranch neural network. EXPERT SYSTEMS WITH APPLICATIONS, 135, 90-101 [10.1016/j.eswa.2019.05.036].
File in questo prodotto:
File Dimensione Formato  
Multitask_painting_categorization_by_deep_multibranch_neural_network (2).pdf

Solo gestori archivio

Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Dimensione 4.96 MB
Formato Adobe PDF
4.96 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/231639
Citazioni
  • Scopus 30
  • ???jsp.display-item.citation.isi??? 21
Social impact