A Unified Deep Model for Joint Facial Expression Recognition, Face Synthesis, and Face Alignment
Facial expression recognition, face synthesis, and face alignment are three coherently related tasks and can be solved in a joint framework. To achieve this goal, in this paper, we propose a novel end-to-end deep learning model by exploiting the expression code, geometry code and generated data jointly for simultaneous pose-invariant facial expression recognition, face image synthesis, and face alignment. The proposed deep model enjoys several merits. First, to the best of our knowledge, this is the first work to address these three tasks jointly in a unified deep model to complement and enhance each other. Second, the proposed model can effectively disentangle the global and local identity representation from different expression and geometry codes. As a result, it can automatically generate facial images with different expressions under arbitrary geometry codes. Third, these three tasks can further boost their performance for each other via our model. Extensive experimental results on three standard benchmarks demonstrate that the proposed deep model performs favorably against state-of-the-art methods on the three tasks.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2020 |
|---|---|
| Erschienen: |
2020 |
| Enthalten in: |
Zur Gesamtaufnahme - year:2020 |
|---|---|
| Enthalten in: |
IEEE transactions on image processing : a publication of the IEEE Signal Processing Society - (2020) vom: 08. Mai |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Zhang, Feifei [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
|---|
| Anmerkungen: |
Date Revised 27.02.2024 published: Print-Electronic Citation Status Publisher |
|---|
| doi: |
10.1109/TIP.2020.2991549 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM309791898 |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM309791898 | ||
| 003 | DE-627 | ||
| 005 | 20240229162852.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231225s2020 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1109/TIP.2020.2991549 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1308.xml |
| 035 | |a (DE-627)NLM309791898 | ||
| 035 | |a (NLM)32396088 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Zhang, Feifei |e verfasserin |4 aut | |
| 245 | 1 | 2 | |a A Unified Deep Model for Joint Facial Expression Recognition, Face Synthesis, and Face Alignment |
| 264 | 1 | |c 2020 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Revised 27.02.2024 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status Publisher | ||
| 520 | |a Facial expression recognition, face synthesis, and face alignment are three coherently related tasks and can be solved in a joint framework. To achieve this goal, in this paper, we propose a novel end-to-end deep learning model by exploiting the expression code, geometry code and generated data jointly for simultaneous pose-invariant facial expression recognition, face image synthesis, and face alignment. The proposed deep model enjoys several merits. First, to the best of our knowledge, this is the first work to address these three tasks jointly in a unified deep model to complement and enhance each other. Second, the proposed model can effectively disentangle the global and local identity representation from different expression and geometry codes. As a result, it can automatically generate facial images with different expressions under arbitrary geometry codes. Third, these three tasks can further boost their performance for each other via our model. Extensive experimental results on three standard benchmarks demonstrate that the proposed deep model performs favorably against state-of-the-art methods on the three tasks | ||
| 650 | 4 | |a Journal Article | |
| 700 | 1 | |a Zhang, Tianzhu |e verfasserin |4 aut | |
| 700 | 1 | |a Mao, Qirong |e verfasserin |4 aut | |
| 700 | 1 | |a Xu, Changsheng |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t IEEE transactions on image processing : a publication of the IEEE Signal Processing Society |d 1992 |g (2020) vom: 08. Mai |w (DE-627)NLM09821456X |x 1941-0042 |7 nnns |
| 773 | 1 | 8 | |g year:2020 |g day:08 |g month:05 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1109/TIP.2020.2991549 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |j 2020 |b 08 |c 05 | ||