Difficulty in emotion expression and recognition is typical of the personality trait known as alexithymia, which is often observed in persons with neurodevelopmental disorders (NDD). Past research has investigated various forms of conversational technology for people with NDD, but only a few studies have explored the use of conversational agents to reduce alexithymia. This paper presents Emoty, a speech-based conversational agent designed for people with NDD to train emotional communication skills. An original characteristic of this agent is that it exploits the emotional expression power of the voice. Emoty engages users in small conversations during which they are asked to repeat sentences and express specific emotions using the appropriate vocal tone. We ran an empirical study to evaluate the usability and effectiveness of our conversational agent. The study involved 19 Italian individuals with NDD and alexithymia aged from 29 to 45 (10 women and 9 men). They used Emoty in five individual sessions over two and a half months. The results showed that two subjects encountered problems using the system because they had difficulty verbalizing the sentences and were not understood by Emoty. The others performed the assigned tasks with the agent. Their capability to express emotions with the voice consistently improved, and other benefits were observed in other social and communication skills.

Catania, F., Garzotto, F. (2023). A conversational agent for emotion expression stimulation in persons with neurodevelopmental disorders. MULTIMEDIA TOOLS AND APPLICATIONS, 82(9), 12797-12828 [10.1007/s11042-022-14135-w].

A conversational agent for emotion expression stimulation in persons with neurodevelopmental disorders

Garzotto, F
2023

Abstract

Difficulty in emotion expression and recognition is typical of the personality trait known as alexithymia, which is often observed in persons with neurodevelopmental disorders (NDD). Past research has investigated various forms of conversational technology for people with NDD, but only a few studies have explored the use of conversational agents to reduce alexithymia. This paper presents Emoty, a speech-based conversational agent designed for people with NDD to train emotional communication skills. An original characteristic of this agent is that it exploits the emotional expression power of the voice. Emoty engages users in small conversations during which they are asked to repeat sentences and express specific emotions using the appropriate vocal tone. We ran an empirical study to evaluate the usability and effectiveness of our conversational agent. The study involved 19 Italian individuals with NDD and alexithymia aged from 29 to 45 (10 women and 9 men). They used Emoty in five individual sessions over two and a half months. The results showed that two subjects encountered problems using the system because they had difficulty verbalizing the sentences and were not understood by Emoty. The others performed the assigned tasks with the agent. Their capability to express emotions with the voice consistently improved, and other benefits were observed in other social and communication skills.
Articolo in rivista - Articolo scientifico
Alexithymia; Computer-assisted therapy; Conversational technology; Human-computer interaction; Neurodevelopmental disorder; Speech emotion recognition;
English
9-nov-2022
2023
82
9
12797
12828
reserved
Catania, F., Garzotto, F. (2023). A conversational agent for emotion expression stimulation in persons with neurodevelopmental disorders. MULTIMEDIA TOOLS AND APPLICATIONS, 82(9), 12797-12828 [10.1007/s11042-022-14135-w].
File in questo prodotto:
File Dimensione Formato  
Catania-Garzotto-2023-Multimedia Tools and Applications-VoR.pdf

Solo gestori archivio

Descrizione: This article is licensed under a Creative Commons Attribution 4.0 International License To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Licenza: Tutti i diritti riservati
Dimensione 1.84 MB
Formato Adobe PDF
1.84 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/524295
Citazioni
  • Scopus 1
  • ???jsp.display-item.citation.isi??? 1
Social impact