The purpose of advanced Brain–Computer Interfaces (BCIs) is to connect the human brain with an external device without using the muscular system. To do this, they must effectively process mental activity and infer information on the users’ intentions and directives. This work proposes a novel and explainable BCI system capable of recognizing P300 deflection in single-trial EEGs with higher accuracy compared to the literature gold standard. Moreover, the proposed deep-learning approach allows us to go beyond the mere P300 detection, which is, to our best knowledge, the current state of the art. Indeed, we first identify the P300-related signal in the single-trial EEG signal, and then, we further discriminate the ERPs associated to the detected P300 between visual and auditory stimuli-related. To do this, we employ a CNN–LSTM neural network, which manages a 3D data representation of the acquired EEG signals. The performance of the approach is tested on experiments carried out on 22 subjects, revealing a 82.4% F1-score in P300 identification and 82.4% discriminating between visual and auditory stimuli. The employed algorithmic procedure also reports the most relevant each EEG channels in determining the predictions, adding interpretability to the proposed AI-based tools. These results pave the way for more sophisticated BCIs, capable of extending the set of available actions for the patients. The project was pre-approved by the Research Assessment Committee of the Department of Psychology (CRIP) for minimal risk projects, under the aegis of the Ethical Committee of University of Milano-Bicocca, on May 27th, 2019, protocol number RM-2019-193.

Leoni, J., Strada, S., Tanelli, M., Brusa, A., Proverbio, A. (2022). Single-trial stimuli classification from detected P300 for augmented Brain-Computer Interface: A deep learning approach. MACHINE LEARNING WITH APPLICATIONS, 9(15 September) [10.1016/j.mlwa.2022.100393].

Single-trial stimuli classification from detected P300 for augmented Brain-Computer Interface: A deep learning approach

Proverbio, Alice Mado
Ultimo
Membro del Collaboration Group
2022

Abstract

The purpose of advanced Brain–Computer Interfaces (BCIs) is to connect the human brain with an external device without using the muscular system. To do this, they must effectively process mental activity and infer information on the users’ intentions and directives. This work proposes a novel and explainable BCI system capable of recognizing P300 deflection in single-trial EEGs with higher accuracy compared to the literature gold standard. Moreover, the proposed deep-learning approach allows us to go beyond the mere P300 detection, which is, to our best knowledge, the current state of the art. Indeed, we first identify the P300-related signal in the single-trial EEG signal, and then, we further discriminate the ERPs associated to the detected P300 between visual and auditory stimuli-related. To do this, we employ a CNN–LSTM neural network, which manages a 3D data representation of the acquired EEG signals. The performance of the approach is tested on experiments carried out on 22 subjects, revealing a 82.4% F1-score in P300 identification and 82.4% discriminating between visual and auditory stimuli. The employed algorithmic procedure also reports the most relevant each EEG channels in determining the predictions, adding interpretability to the proposed AI-based tools. These results pave the way for more sophisticated BCIs, capable of extending the set of available actions for the patients. The project was pre-approved by the Research Assessment Committee of the Department of Psychology (CRIP) for minimal risk projects, under the aegis of the Ethical Committee of University of Milano-Bicocca, on May 27th, 2019, protocol number RM-2019-193.
Articolo in rivista - Articolo scientifico
BCI; P300; Deep Learning; AI
English
Leoni, J., Strada, S., Tanelli, M., Brusa, A., Proverbio, A. (2022). Single-trial stimuli classification from detected P300 for augmented Brain-Computer Interface: A deep learning approach. MACHINE LEARNING WITH APPLICATIONS, 9(15 September) [10.1016/j.mlwa.2022.100393].
Leoni, J; Strada, S; Tanelli, M; Brusa, A; Proverbio, A
File in questo prodotto:
File Dimensione Formato  
MachineLearn2022.pdf

accesso aperto

Tipologia di allegato: Submitted Version (Pre-print)
Dimensione 838.73 kB
Formato Adobe PDF
838.73 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/389900
Citazioni
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
Social impact