As a result of the widespread use of intelligent assistants, personalization in dialogue systems has become a hot topic in both research and industry. Typically, training such systems is computationally expensive, especially when using recent large language models. To address this challenge, we develop an approach to personalize dialogue systems using adapter layers and topic modelling. Our implementation enables the model to incorporate user-specific information, achieving promising results by training only a small fraction of parameters.

Braga, M., Raganato, A., Pasi, G. (2023). Personalization in BERT with Adapter Modules and Topic Modelling. In Proceedings of the 13th Italian Information Retrieval Workshop (IIR 2023) (pp.24-29). CEUR-WS.

Personalization in BERT with Adapter Modules and Topic Modelling

Braga M.
;
Raganato A.;Pasi G.
2023

Abstract

As a result of the widespread use of intelligent assistants, personalization in dialogue systems has become a hot topic in both research and industry. Typically, training such systems is computationally expensive, especially when using recent large language models. To address this challenge, we develop an approach to personalize dialogue systems using adapter layers and topic modelling. Our implementation enables the model to incorporate user-specific information, achieving promising results by training only a small fraction of parameters.
paper
Adapters; Personalization; Retrieval based chatbot; Topic Modelling;
English
13th Italian Information Retrieval Workshop, IIR 2023 - 8 June 2023through 9 June 2023
2023
Nardini, FM; Tonellotto, N; Faggioli, G; Ferrara, A
Proceedings of the 13th Italian Information Retrieval Workshop (IIR 2023)
2023
3448
24
29
https://ceur-ws.org/Vol-3448/
open
Braga, M., Raganato, A., Pasi, G. (2023). Personalization in BERT with Adapter Modules and Topic Modelling. In Proceedings of the 13th Italian Information Retrieval Workshop (IIR 2023) (pp.24-29). CEUR-WS.
File in questo prodotto:
File Dimensione Formato  
Braga-2023-CEUR Workshop Proceedings-VoR.pdf

accesso aperto

Descrizione: CC BY 4.0 This volume and its papers are published under the Creative Commons License Attribution 4.0 International (CC BY 4.0).
Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Licenza: Creative Commons
Dimensione 986.63 kB
Formato Adobe PDF
986.63 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/454534
Citazioni
  • Scopus 3
  • ???jsp.display-item.citation.isi??? ND
Social impact