A generative adaptive convolutional neural network with attention mechanism for driver fatigue detection with class-imbalanced and insufficient data
Copyright © 2024 Elsevier B.V. All rights reserved..
Over the past few years, fatigue driving has emerged as one of the main causes of traffic accidents, necessitating the development of driver fatigue detection systems. However, many existing methods involves tedious manual parameter tunings, a process that is both time-consuming and results in task-specific models. On the other hand, most of the researches on fatigue recognition are based on class-balanced and sufficient data, and effectively "mine" meaningful information from class-imbalanced and insufficient data for fatigue recognition is still a challenge. In this paper, we proposed two novel models, the attention-based residual adaptive multiscale fully convolutional network-long short term memory network (ARMFCN-LSTM), and the Generative ARMFCN-LSTM (GARMFCN-LSTM) aiming to address this issue. ARMFCN-LSTM excels at automatically extracting multiscale representations through adaptive multiscale temporal convolutions, while capturing temporal dependency features through LSTM. GARMFCN-LSTM integrates Wasserstein GAN with gradient penalty (WGAN-GP) into ARMFCN-LSTM to improve driver fatigue detection performance by alleviating data scarcity and addressing class imbalances. Experimental results show that ARMFCN-LSTM achieves the highest classification accuracy of 95.84% in driver fatigue detection on the class-balanced EEG dataset (binary classification), and GARMFCN-LSTM attained an improved classification accuracy of 84.70% on the class-imbalanced EOG dataset (triple classification), surpassing the competing methods. Therefore, the proposed models are promising for further implementations in online driver fatigue detection systems.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2024 |
|---|---|
| Erschienen: |
2024 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:464 |
|---|---|
| Enthalten in: |
Behavioural brain research - 464(2024) vom: 27. März, Seite 114898 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
He, Le [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Brain–computer interface (BCI) |
|---|
| Anmerkungen: |
Date Completed 18.03.2024 Date Revised 18.03.2024 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1016/j.bbr.2024.114898 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM368727238 |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM368727238 | ||
| 003 | DE-627 | ||
| 005 | 20240318234420.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 240222s2024 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.bbr.2024.114898 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1334.xml |
| 035 | |a (DE-627)NLM368727238 | ||
| 035 | |a (NLM)38382711 | ||
| 035 | |a (PII)S0166-4328(24)00054-8 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a He, Le |e verfasserin |4 aut | |
| 245 | 1 | 2 | |a A generative adaptive convolutional neural network with attention mechanism for driver fatigue detection with class-imbalanced and insufficient data |
| 264 | 1 | |c 2024 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 18.03.2024 | ||
| 500 | |a Date Revised 18.03.2024 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Copyright © 2024 Elsevier B.V. All rights reserved. | ||
| 520 | |a Over the past few years, fatigue driving has emerged as one of the main causes of traffic accidents, necessitating the development of driver fatigue detection systems. However, many existing methods involves tedious manual parameter tunings, a process that is both time-consuming and results in task-specific models. On the other hand, most of the researches on fatigue recognition are based on class-balanced and sufficient data, and effectively "mine" meaningful information from class-imbalanced and insufficient data for fatigue recognition is still a challenge. In this paper, we proposed two novel models, the attention-based residual adaptive multiscale fully convolutional network-long short term memory network (ARMFCN-LSTM), and the Generative ARMFCN-LSTM (GARMFCN-LSTM) aiming to address this issue. ARMFCN-LSTM excels at automatically extracting multiscale representations through adaptive multiscale temporal convolutions, while capturing temporal dependency features through LSTM. GARMFCN-LSTM integrates Wasserstein GAN with gradient penalty (WGAN-GP) into ARMFCN-LSTM to improve driver fatigue detection performance by alleviating data scarcity and addressing class imbalances. Experimental results show that ARMFCN-LSTM achieves the highest classification accuracy of 95.84% in driver fatigue detection on the class-balanced EEG dataset (binary classification), and GARMFCN-LSTM attained an improved classification accuracy of 84.70% on the class-imbalanced EOG dataset (triple classification), surpassing the competing methods. Therefore, the proposed models are promising for further implementations in online driver fatigue detection systems | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Brain–computer interface (BCI) | |
| 650 | 4 | |a Deep learning (DL) | |
| 650 | 4 | |a Driver fatigue detection | |
| 650 | 4 | |a Electroencephalogram (EEG) | |
| 650 | 4 | |a Electrooculogram (EOG) | |
| 650 | 4 | |a Generative adversarial network (GAN) | |
| 700 | 1 | |a Zhang, Li |e verfasserin |4 aut | |
| 700 | 1 | |a Sun, Qiang |e verfasserin |4 aut | |
| 700 | 1 | |a Lin, XiangTian |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Behavioural brain research |d 1993 |g 464(2024) vom: 27. März, Seite 114898 |w (DE-627)NLM012632252 |x 1872-7549 |7 nnns |
| 773 | 1 | 8 | |g volume:464 |g year:2024 |g day:27 |g month:03 |g pages:114898 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1016/j.bbr.2024.114898 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 464 |j 2024 |b 27 |c 03 |h 114898 | ||