Multimodal deep learning-based diagnostic model for BPPV
© 2024. The Author(s)..
BACKGROUND: Benign paroxysmal positional vertigo (BPPV) is a prevalent form of vertigo that necessitates a skilled physician to diagnose by observing the nystagmus and vertigo resulting from specific changes in the patient's position. In this study, we aim to explore the integration of eye movement video and position information for BPPV diagnosis and apply artificial intelligence (AI) methods to improve the accuracy of BPPV diagnosis.
METHODS: We collected eye movement video and diagnostic data from 518 patients with BPPV who visited the hospital for examination from January to March 2021 and developed a BPPV dataset. Based on the characteristics of the dataset, we propose a multimodal deep learning diagnostic model, which combines a video understanding model, self-encoder, and cross-attention mechanism structure.
RESULT: Our validation test on the test set showed that the average accuracy of the model reached 81.7%, demonstrating the effectiveness of the proposed multimodal deep learning method for BPPV diagnosis. Furthermore, our study highlights the significance of combining head position information and eye movement information in BPPV diagnosis. We also found that postural and eye movement information plays a critical role in the diagnosis of BPPV, as demonstrated by exploring the necessity of postural information for the diagnostic model and the contribution of cross-attention mechanisms to the fusion of postural and oculomotor information. Our results underscore the potential of AI-based methods for improving the accuracy of BPPV diagnosis and the importance of considering both postural and oculomotor information in BPPV diagnosis.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2024 |
|---|---|
| Erschienen: |
2024 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:24 |
|---|---|
| Enthalten in: |
BMC medical informatics and decision making - 24(2024), 1 vom: 21. März, Seite 82 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Lu, Hang [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
BPPV |
|---|
| Anmerkungen: |
Date Completed 25.03.2024 Date Revised 25.03.2024 published: Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1186/s12911-024-02438-x |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM37004729X |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM37004729X | ||
| 003 | DE-627 | ||
| 005 | 20240325235436.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 240323s2024 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1186/s12911-024-02438-x |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1347.xml |
| 035 | |a (DE-627)NLM37004729X | ||
| 035 | |a (NLM)38515156 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Lu, Hang |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Multimodal deep learning-based diagnostic model for BPPV |
| 264 | 1 | |c 2024 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 25.03.2024 | ||
| 500 | |a Date Revised 25.03.2024 | ||
| 500 | |a published: Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a © 2024. The Author(s). | ||
| 520 | |a BACKGROUND: Benign paroxysmal positional vertigo (BPPV) is a prevalent form of vertigo that necessitates a skilled physician to diagnose by observing the nystagmus and vertigo resulting from specific changes in the patient's position. In this study, we aim to explore the integration of eye movement video and position information for BPPV diagnosis and apply artificial intelligence (AI) methods to improve the accuracy of BPPV diagnosis | ||
| 520 | |a METHODS: We collected eye movement video and diagnostic data from 518 patients with BPPV who visited the hospital for examination from January to March 2021 and developed a BPPV dataset. Based on the characteristics of the dataset, we propose a multimodal deep learning diagnostic model, which combines a video understanding model, self-encoder, and cross-attention mechanism structure | ||
| 520 | |a RESULT: Our validation test on the test set showed that the average accuracy of the model reached 81.7%, demonstrating the effectiveness of the proposed multimodal deep learning method for BPPV diagnosis. Furthermore, our study highlights the significance of combining head position information and eye movement information in BPPV diagnosis. We also found that postural and eye movement information plays a critical role in the diagnosis of BPPV, as demonstrated by exploring the necessity of postural information for the diagnostic model and the contribution of cross-attention mechanisms to the fusion of postural and oculomotor information. Our results underscore the potential of AI-based methods for improving the accuracy of BPPV diagnosis and the importance of considering both postural and oculomotor information in BPPV diagnosis | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a BPPV | |
| 650 | 4 | |a Deep learning | |
| 650 | 4 | |a Feature fusion | |
| 650 | 4 | |a Multimodal | |
| 650 | 4 | |a Vertigo | |
| 700 | 1 | |a Mao, Yuxing |e verfasserin |4 aut | |
| 700 | 1 | |a Li, Jinsen |e verfasserin |4 aut | |
| 700 | 1 | |a Zhu, Lin |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t BMC medical informatics and decision making |d 2001 |g 24(2024), 1 vom: 21. März, Seite 82 |w (DE-627)NLM112392881 |x 1472-6947 |7 nnns |
| 773 | 1 | 8 | |g volume:24 |g year:2024 |g number:1 |g day:21 |g month:03 |g pages:82 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1186/s12911-024-02438-x |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 24 |j 2024 |e 1 |b 21 |c 03 |h 82 | ||