Smart mirrors are devices that can display any kind of information and can interact with the user using touch and voice commands. Different kinds of smart mirrors exist: general purpose, medical, fashion, and other task specific ones. General purpose smart mirrors are suitable for home environments but the exiting ones offer similar, limited functionalities. In this paper, we present a general-purpose smart mirror that integrates several functionalities, standard and advanced, to support users in their everyday life. Among the advanced functionalities are the capabilities of detecting a person’s emotions, the short- and long-term monitoring and analysis of the emotions, a double authentication protocol to preserve the privacy, and the integration of Alexa Skills to extend the applications of the smart mirrors. We exploit a deep learning technique to develop most of the smart functionalities. The effectiveness of the device is demonstrated by the performances of the implemented functionalities, and the evaluation in terms of its usability with real users.

Bianco, S., Celona, L., Ciocca, G., Marelli, D., Napoletano, P., Yu, S., et al. (2021). A Smart Mirror for Emotion Monitoring in Home Environments. SENSORS, 21(22) [10.3390/s21227453].

A Smart Mirror for Emotion Monitoring in Home Environments

Bianco, Simone;Celona, Luigi;Ciocca, Gianluigi;Marelli, Davide;Napoletano, Paolo
;
Schettini, Raimondo
2021

Abstract

Smart mirrors are devices that can display any kind of information and can interact with the user using touch and voice commands. Different kinds of smart mirrors exist: general purpose, medical, fashion, and other task specific ones. General purpose smart mirrors are suitable for home environments but the exiting ones offer similar, limited functionalities. In this paper, we present a general-purpose smart mirror that integrates several functionalities, standard and advanced, to support users in their everyday life. Among the advanced functionalities are the capabilities of detecting a person’s emotions, the short- and long-term monitoring and analysis of the emotions, a double authentication protocol to preserve the privacy, and the integration of Alexa Skills to extend the applications of the smart mirrors. We exploit a deep learning technique to develop most of the smart functionalities. The effectiveness of the device is demonstrated by the performances of the implemented functionalities, and the evaluation in terms of its usability with real users.
Articolo in rivista - Articolo scientifico
Affective computing; Amazon Alexa virtual assistant; Deep learning; Internet of things; Multimodal interaction; Positive technology; Raspberry Pi; Smart mirror;
English
9-nov-2021
2021
21
22
7453
open
Bianco, S., Celona, L., Ciocca, G., Marelli, D., Napoletano, P., Yu, S., et al. (2021). A Smart Mirror for Emotion Monitoring in Home Environments. SENSORS, 21(22) [10.3390/s21227453].
File in questo prodotto:
File Dimensione Formato  
10281-334737_VoR.pdf

accesso aperto

Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Licenza: Creative Commons
Dimensione 1.98 MB
Formato Adobe PDF
1.98 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/334737
Citazioni
  • Scopus 8
  • ???jsp.display-item.citation.isi??? 6
Social impact