Automated accurate emotion recognition system using rhythm-specific deep convolutional neural network technique with multi-channel EEG signals
Copyright © 2021 Elsevier Ltd. All rights reserved..
Emotion is interpreted as a psycho-physiological process, and it is associated with personality, behavior, motivation, and character of a person. The objective of affective computing is to recognize different types of emotions for human-computer interaction (HCI) applications. The spatiotemporal brain electrical activity is measured using multi-channel electroencephalogram (EEG) signals. Automated emotion recognition using multi-channel EEG signals is an exciting research topic in cognitive neuroscience and affective computing. This paper proposes the rhythm-specific multi-channel convolutional neural network (CNN) based approach for automated emotion recognition using multi-channel EEG signals. The delta (δ), theta (θ), alpha (α), beta (β), and gamma (γ) rhythms of EEG signal for each channel are evaluated using band-pass filters. The EEG rhythms from the selected channels coupled with deep CNN are used for emotion classification tasks such as low-valence (LV) vs. high valence (HV), low-arousal (LA) vs. high-arousal (HA), and low-dominance (LD) vs. high dominance (HD) respectively. The deep CNN architecture considered in the proposed work has eight convolutions, three average pooling, four batch-normalization, three spatial drop-outs, two drop-outs, one global average pooling and, three dense layers. We have validated our developed model using three publicly available databases: DEAP, DREAMER, and DASPS. The results reveal that the proposed multivariate deep CNN approach coupled with β-rhythm has obtained the accuracy values of 98.91%, 98.45%, and 98.69% for LV vs. HV, LA vs. HA, and LD vs. HD emotion classification strategies, respectively using DEAP database with 10-fold cross-validation (CV) scheme. Similarly, the accuracy values of 98.56%, 98.82%, and 98.99% are obtained for LV vs. HV, LA vs. HA, and LD vs. HD classification schemes, respectively, using deep CNN and θ-rhythm. The proposed multi-channel rhythm-specific deep CNN classification model has obtained the average accuracy value of 57.14% using α-rhythm and trial-specific CV using DASPS database. Moreover, for 8-quadrant based emotion classification strategy, the deep CNN based classifier has obtained an overall accuracy value of 24.37% using γ-rhythms of multi-channel EEG signals. Our developed deep CNN model can be used for real-time automated emotion recognition applications.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2021 |
|---|---|
| Erschienen: |
2021 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:134 |
|---|---|
| Enthalten in: |
Computers in biology and medicine - 134(2021) vom: 20. Juli, Seite 104428 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Maheshwari, Daksh [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Channel selection |
|---|
| Anmerkungen: |
Date Completed 26.07.2021 Date Revised 26.07.2021 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1016/j.compbiomed.2021.104428 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM325361312 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM325361312 | ||
| 003 | DE-627 | ||
| 005 | 20231225192257.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231225s2021 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.compbiomed.2021.104428 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1084.xml |
| 035 | |a (DE-627)NLM325361312 | ||
| 035 | |a (NLM)33984749 | ||
| 035 | |a (PII)S0010-4825(21)00222-5 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Maheshwari, Daksh |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Automated accurate emotion recognition system using rhythm-specific deep convolutional neural network technique with multi-channel EEG signals |
| 264 | 1 | |c 2021 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 26.07.2021 | ||
| 500 | |a Date Revised 26.07.2021 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Copyright © 2021 Elsevier Ltd. All rights reserved. | ||
| 520 | |a Emotion is interpreted as a psycho-physiological process, and it is associated with personality, behavior, motivation, and character of a person. The objective of affective computing is to recognize different types of emotions for human-computer interaction (HCI) applications. The spatiotemporal brain electrical activity is measured using multi-channel electroencephalogram (EEG) signals. Automated emotion recognition using multi-channel EEG signals is an exciting research topic in cognitive neuroscience and affective computing. This paper proposes the rhythm-specific multi-channel convolutional neural network (CNN) based approach for automated emotion recognition using multi-channel EEG signals. The delta (δ), theta (θ), alpha (α), beta (β), and gamma (γ) rhythms of EEG signal for each channel are evaluated using band-pass filters. The EEG rhythms from the selected channels coupled with deep CNN are used for emotion classification tasks such as low-valence (LV) vs. high valence (HV), low-arousal (LA) vs. high-arousal (HA), and low-dominance (LD) vs. high dominance (HD) respectively. The deep CNN architecture considered in the proposed work has eight convolutions, three average pooling, four batch-normalization, three spatial drop-outs, two drop-outs, one global average pooling and, three dense layers. We have validated our developed model using three publicly available databases: DEAP, DREAMER, and DASPS. The results reveal that the proposed multivariate deep CNN approach coupled with β-rhythm has obtained the accuracy values of 98.91%, 98.45%, and 98.69% for LV vs. HV, LA vs. HA, and LD vs. HD emotion classification strategies, respectively using DEAP database with 10-fold cross-validation (CV) scheme. Similarly, the accuracy values of 98.56%, 98.82%, and 98.99% are obtained for LV vs. HV, LA vs. HA, and LD vs. HD classification schemes, respectively, using deep CNN and θ-rhythm. The proposed multi-channel rhythm-specific deep CNN classification model has obtained the average accuracy value of 57.14% using α-rhythm and trial-specific CV using DASPS database. Moreover, for 8-quadrant based emotion classification strategy, the deep CNN based classifier has obtained an overall accuracy value of 24.37% using γ-rhythms of multi-channel EEG signals. Our developed deep CNN model can be used for real-time automated emotion recognition applications | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Research Support, Non-U.S. Gov't | |
| 650 | 4 | |a Channel selection | |
| 650 | 4 | |a Classification | |
| 650 | 4 | |a Deep CNN | |
| 650 | 4 | |a Emotion recognition | |
| 650 | 4 | |a Multi-channel EEG | |
| 650 | 4 | |a Rhythms | |
| 700 | 1 | |a Ghosh, S K |e verfasserin |4 aut | |
| 700 | 1 | |a Tripathy, R K |e verfasserin |4 aut | |
| 700 | 1 | |a Sharma, Manish |e verfasserin |4 aut | |
| 700 | 1 | |a Acharya, U Rajendra |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Computers in biology and medicine |d 1970 |g 134(2021) vom: 20. Juli, Seite 104428 |w (DE-627)NLM000382272 |x 1879-0534 |7 nnns |
| 773 | 1 | 8 | |g volume:134 |g year:2021 |g day:20 |g month:07 |g pages:104428 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1016/j.compbiomed.2021.104428 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 134 |j 2021 |b 20 |c 07 |h 104428 | ||