Conversational Interfaces for user assistance are becoming persuasive. Today, though, most chatbots are not integrated into the application in which they are placed, but only superimposed, with no communication between the conversational and the graphical interface. We propose Multi-modal Conversational Troubleshooting Kit (MCTK), a Python package to easily integrate a conversational agent for troubleshooting in web applications. MCTK is multi-modal: once the system recognizes the problem the user is encountering, the textual solution in the chat is coupled with visual hints in the GUI. On top of that, MCTK is easy to configure and offers separation of concerns: dialogue designers can work on the conversation without the necessity of modifying the code, and vice versa.

Abbo, G., Crovari, P., Pido', S., Pinoli, P., Garzotto, F. (2022). MCTK: a Multi-modal Conversational Troubleshooting Kit for supporting users in web applications. In AVI '22: Proceedings of the 2022 International Conference on Advanced Visual Interfaces (pp.1-3). Association for computing machinery [10.1145/3531073.3534480].

MCTK: a Multi-modal Conversational Troubleshooting Kit for supporting users in web applications

Garzotto F.
2022

Abstract

Conversational Interfaces for user assistance are becoming persuasive. Today, though, most chatbots are not integrated into the application in which they are placed, but only superimposed, with no communication between the conversational and the graphical interface. We propose Multi-modal Conversational Troubleshooting Kit (MCTK), a Python package to easily integrate a conversational agent for troubleshooting in web applications. MCTK is multi-modal: once the system recognizes the problem the user is encountering, the textual solution in the chat is coupled with visual hints in the GUI. On top of that, MCTK is easy to configure and offers separation of concerns: dialogue designers can work on the conversation without the necessity of modifying the code, and vice versa.
paper
Chatbots; Conversational agents; Conversational interface; Graphical interface; Multi-modal; Separation of concerns; User assistance; WEB application; Web applications
English
16th International Conference on Advanced Visual Interfaces, AVI 2022 - June 6 - 10, 2022
2022
AVI '22: Proceedings of the 2022 International Conference on Advanced Visual Interfaces
9781450397193
2022
1
3
55
reserved
Abbo, G., Crovari, P., Pido', S., Pinoli, P., Garzotto, F. (2022). MCTK: a Multi-modal Conversational Troubleshooting Kit for supporting users in web applications. In AVI '22: Proceedings of the 2022 International Conference on Advanced Visual Interfaces (pp.1-3). Association for computing machinery [10.1145/3531073.3534480].
File in questo prodotto:
File Dimensione Formato  
Abbo-2022-AVI-VoR.pdf

Solo gestori archivio

Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Licenza: Tutti i diritti riservati
Dimensione 542.43 kB
Formato Adobe PDF
542.43 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/524300
Citazioni
  • Scopus 1
  • ???jsp.display-item.citation.isi??? 0
Social impact