What are wereallydecoding? Unveiling biases in EEG-based decoding of the spatial focus of auditory attention
© 2024 IOP Publishing Ltd..
Objective.Spatial auditory attention decoding (Sp-AAD) refers to the task of identifying the direction of the speaker to which a person is attending in a multi-talker setting, based on the listener's neural recordings, e.g. electroencephalography (EEG). The goal of this study is to thoroughly investigate potential biases when training such Sp-AAD decoders on EEG data, particularly eye-gaze biases and latent trial-dependent confounds, which may result in Sp-AAD models that decode eye-gaze or trial-specific fingerprints rather than spatial auditory attention.Approach.We designed a two-speaker audiovisual Sp-AAD protocol in which the spatial auditory and visual attention were enforced to be either congruent or incongruent, and we recorded EEG data from sixteen participants undergoing several trials recorded at distinct timepoints. We trained a simple linear model for Sp-AAD based on common spatial patterns filters in combination with either linear discriminant analysis (LDA) or k-means clustering, and evaluated them both across- and within-trial.Main results.We found that even a simple linear Sp-AAD model is susceptible to overfitting to confounding signal patterns such as eye-gaze and trial fingerprints (e.g. due to feature shifts across trials), resulting in artificially high decoding accuracies. Furthermore, we found that changes in the EEG signal statistics across trials deteriorate the trial generalization of the classifier, even when the latter is retrained on the test trial with an unsupervised algorithm.Significance.Collectively, our findings confirm that there exist subtle biases and confounds that can strongly interfere with the decoding of spatial auditory attention from EEG. It is expected that more complicated non-linear models based on deep neural networks, which are often used for Sp-AAD, are even more vulnerable to such biases. Future work should perform experiments and model evaluations that avoid and/or control for such biases in Sp-AAD tasks.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2024 |
|---|---|
| Erschienen: |
2024 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:21 |
|---|---|
| Enthalten in: |
Journal of neural engineering - 21(2024), 1 vom: 06. Feb. |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Rotaru, Iustina [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Audiovisual stimulation |
|---|
| Anmerkungen: |
Date Completed 07.02.2024 Date Revised 09.04.2024 published: Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1088/1741-2552/ad2214 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM367567059 |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM367567059 | ||
| 003 | DE-627 | ||
| 005 | 20240409232352.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 240125s2024 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1088/1741-2552/ad2214 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1370.xml |
| 035 | |a (DE-627)NLM367567059 | ||
| 035 | |a (NLM)38266281 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Rotaru, Iustina |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a What are wereallydecoding? Unveiling biases in EEG-based decoding of the spatial focus of auditory attention |
| 264 | 1 | |c 2024 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 07.02.2024 | ||
| 500 | |a Date Revised 09.04.2024 | ||
| 500 | |a published: Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a © 2024 IOP Publishing Ltd. | ||
| 520 | |a Objective.Spatial auditory attention decoding (Sp-AAD) refers to the task of identifying the direction of the speaker to which a person is attending in a multi-talker setting, based on the listener's neural recordings, e.g. electroencephalography (EEG). The goal of this study is to thoroughly investigate potential biases when training such Sp-AAD decoders on EEG data, particularly eye-gaze biases and latent trial-dependent confounds, which may result in Sp-AAD models that decode eye-gaze or trial-specific fingerprints rather than spatial auditory attention.Approach.We designed a two-speaker audiovisual Sp-AAD protocol in which the spatial auditory and visual attention were enforced to be either congruent or incongruent, and we recorded EEG data from sixteen participants undergoing several trials recorded at distinct timepoints. We trained a simple linear model for Sp-AAD based on common spatial patterns filters in combination with either linear discriminant analysis (LDA) or k-means clustering, and evaluated them both across- and within-trial.Main results.We found that even a simple linear Sp-AAD model is susceptible to overfitting to confounding signal patterns such as eye-gaze and trial fingerprints (e.g. due to feature shifts across trials), resulting in artificially high decoding accuracies. Furthermore, we found that changes in the EEG signal statistics across trials deteriorate the trial generalization of the classifier, even when the latter is retrained on the test trial with an unsupervised algorithm.Significance.Collectively, our findings confirm that there exist subtle biases and confounds that can strongly interfere with the decoding of spatial auditory attention from EEG. It is expected that more complicated non-linear models based on deep neural networks, which are often used for Sp-AAD, are even more vulnerable to such biases. Future work should perform experiments and model evaluations that avoid and/or control for such biases in Sp-AAD tasks | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Research Support, Non-U.S. Gov't | |
| 650 | 4 | |a audiovisual stimulation | |
| 650 | 4 | |a eye-gaze biases | |
| 650 | 4 | |a feature drifts | |
| 650 | 4 | |a spatial auditory attention decoding (Sp-AAD) | |
| 700 | 1 | |a Geirnaert, Simon |e verfasserin |4 aut | |
| 700 | 1 | |a Heintz, Nicolas |e verfasserin |4 aut | |
| 700 | 1 | |a Van de Ryck, Iris |e verfasserin |4 aut | |
| 700 | 1 | |a Bertrand, Alexander |e verfasserin |4 aut | |
| 700 | 1 | |a Francart, Tom |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Journal of neural engineering |d 2004 |g 21(2024), 1 vom: 06. Feb. |w (DE-627)NLM155213075 |x 1741-2552 |7 nnns |
| 773 | 1 | 8 | |g volume:21 |g year:2024 |g number:1 |g day:06 |g month:02 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1088/1741-2552/ad2214 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 21 |j 2024 |e 1 |b 06 |c 02 | ||