Task sub-type states decoding via group deep bidirectional recurrent neural network
Copyright © 2024. Published by Elsevier B.V..
Decoding brain states under different cognitive tasks from functional magnetic resonance imaging (fMRI) data has attracted great attention in the neuroimaging filed. However, the well-known temporal dependency in fMRI sequences has not been fully exploited in existing studies, due to the limited temporal-modeling capacity of the backbone machine learning algorithms and rigid training sample organization strategies upon which the brain decoding methods are built. To address these limitations, we propose a novel method for fine-grain brain state decoding, namely, group deep bidirectional recurrent neural network (Group-DBRNN) model. We first propose a training sample organization strategy that consists of a group-task sample generation module and a multiple-scale random fragment strategy (MRFS) module to collect training samples that contain rich task-relevant brain activity contrast (i.e., the comparison of neural activity patterns between different tasks) and maintain the temporal dependency. We then develop a novel decoding model by replacing the unidirectional RNNs that are widely used in existing brain state decoding studies with bidirectional stacked RNNs to better capture the temporal dependency, and by introducing a multi-task interaction layer (MTIL) module to effectively model the task-relevant brain activity contrast. Our experimental results on the Human Connectome Project task fMRI dataset (7 tasks consisting of 23 task sub-type states) show that the proposed model achieves an average decoding accuracy of 94.7% over the 23 fine-grain sub-type states. Meanwhile, our extensive interpretations of the intermediate features learned in the proposed model via visualizations and quantitative assessments of their discriminability and inter-subject alignment evidence that the proposed model can effectively capture the temporal dependency and task-relevant contrast.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2024 |
|---|---|
| Erschienen: |
2024 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:94 |
|---|---|
| Enthalten in: |
Medical image analysis - 94(2024) vom: 15. Apr., Seite 103136 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Zhao, Shijie [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Bidirectional stacked RNNs |
|---|
| Anmerkungen: |
Date Completed 16.04.2024 Date Revised 16.04.2024 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1016/j.media.2024.103136 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM369795768 |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM369795768 | ||
| 003 | DE-627 | ||
| 005 | 20240416232719.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 240316s2024 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.media.2024.103136 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1377.xml |
| 035 | |a (DE-627)NLM369795768 | ||
| 035 | |a (NLM)38489895 | ||
| 035 | |a (PII)S1361-8415(24)00061-6 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Zhao, Shijie |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Task sub-type states decoding via group deep bidirectional recurrent neural network |
| 264 | 1 | |c 2024 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 16.04.2024 | ||
| 500 | |a Date Revised 16.04.2024 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Copyright © 2024. Published by Elsevier B.V. | ||
| 520 | |a Decoding brain states under different cognitive tasks from functional magnetic resonance imaging (fMRI) data has attracted great attention in the neuroimaging filed. However, the well-known temporal dependency in fMRI sequences has not been fully exploited in existing studies, due to the limited temporal-modeling capacity of the backbone machine learning algorithms and rigid training sample organization strategies upon which the brain decoding methods are built. To address these limitations, we propose a novel method for fine-grain brain state decoding, namely, group deep bidirectional recurrent neural network (Group-DBRNN) model. We first propose a training sample organization strategy that consists of a group-task sample generation module and a multiple-scale random fragment strategy (MRFS) module to collect training samples that contain rich task-relevant brain activity contrast (i.e., the comparison of neural activity patterns between different tasks) and maintain the temporal dependency. We then develop a novel decoding model by replacing the unidirectional RNNs that are widely used in existing brain state decoding studies with bidirectional stacked RNNs to better capture the temporal dependency, and by introducing a multi-task interaction layer (MTIL) module to effectively model the task-relevant brain activity contrast. Our experimental results on the Human Connectome Project task fMRI dataset (7 tasks consisting of 23 task sub-type states) show that the proposed model achieves an average decoding accuracy of 94.7% over the 23 fine-grain sub-type states. Meanwhile, our extensive interpretations of the intermediate features learned in the proposed model via visualizations and quantitative assessments of their discriminability and inter-subject alignment evidence that the proposed model can effectively capture the temporal dependency and task-relevant contrast | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Bidirectional stacked RNNs | |
| 650 | 4 | |a Brain stage decoding | |
| 650 | 4 | |a Functional magnetic resonance imaging | |
| 650 | 4 | |a Task-relevant brain activity contrast | |
| 650 | 4 | |a Temporal dependency | |
| 700 | 1 | |a Fang, Long |e verfasserin |4 aut | |
| 700 | 1 | |a Yang, Yang |e verfasserin |4 aut | |
| 700 | 1 | |a Tang, Guochang |e verfasserin |4 aut | |
| 700 | 1 | |a Luo, Guoxin |e verfasserin |4 aut | |
| 700 | 1 | |a Han, Junwei |e verfasserin |4 aut | |
| 700 | 1 | |a Liu, Tianming |e verfasserin |4 aut | |
| 700 | 1 | |a Hu, Xintao |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Medical image analysis |d 1996 |g 94(2024) vom: 15. Apr., Seite 103136 |w (DE-627)NLM096527188 |x 1361-8423 |7 nnns |
| 773 | 1 | 8 | |g volume:94 |g year:2024 |g day:15 |g month:04 |g pages:103136 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1016/j.media.2024.103136 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 94 |j 2024 |b 15 |c 04 |h 103136 | ||