Microwave Speech Recognizer Empowered by a Programmable Metasurface
© 2024 The Authors. Advanced Science published by Wiley-VCH GmbH..
Speech recognition becomes increasingly important in the modern society, especially for human-machine interactions, but its deployment is still severely thwarted by the struggle of machines to recognize voiced commands in challenging real-life settings: oftentimes, ambient noise drowns the acoustic sound signals, and walls, face masks or other obstacles hide the mouth motion from optical sensors. To address these formidable challenges, an experimental prototype of a microwave speech recognizer empowered by programmable metasurface is presented here that can remotely recognize human voice commands and speaker identities even in noisy environments and if the speaker's mouth is hidden behind a wall or face mask. The programmable metasurface is the pivotal hardware ingredient of the system because its large aperture and huge number of degrees of freedom allows the system to perform a complex sequence of sensing tasks, orchestrated by artificial-intelligence tools. Relying solely on microwave data, the system avoids visual privacy infringements. The developed microwave speech recognizer can enable privacy-respecting voice-commanded human-machine interactions is experimentally demonstrated in many important but to-date inaccessible application scenarios. The presented strategy will unlock new possibilities and have expectations for future smart homes, ambient-assisted health monitoring, as well as intelligent surveillance and security.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2024 |
|---|---|
| Erschienen: |
2024 |
| Enthalten in: |
Zur Gesamtaufnahme - year:2024 |
|---|---|
| Enthalten in: |
Advanced science (Weinheim, Baden-Wurttemberg, Germany) - (2024) vom: 21. Feb., Seite e2309826 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Zhang, Hongrui [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Artificial intelligence (AI) |
|---|
| Anmerkungen: |
Date Revised 21.02.2024 published: Print-Electronic Citation Status Publisher |
|---|
| doi: |
10.1002/advs.202309826 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM368705757 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM368705757 | ||
| 003 | DE-627 | ||
| 005 | 20240222092501.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 240222s2024 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1002/advs.202309826 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1301.xml |
| 035 | |a (DE-627)NLM368705757 | ||
| 035 | |a (NLM)38380552 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Zhang, Hongrui |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Microwave Speech Recognizer Empowered by a Programmable Metasurface |
| 264 | 1 | |c 2024 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Revised 21.02.2024 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status Publisher | ||
| 520 | |a © 2024 The Authors. Advanced Science published by Wiley-VCH GmbH. | ||
| 520 | |a Speech recognition becomes increasingly important in the modern society, especially for human-machine interactions, but its deployment is still severely thwarted by the struggle of machines to recognize voiced commands in challenging real-life settings: oftentimes, ambient noise drowns the acoustic sound signals, and walls, face masks or other obstacles hide the mouth motion from optical sensors. To address these formidable challenges, an experimental prototype of a microwave speech recognizer empowered by programmable metasurface is presented here that can remotely recognize human voice commands and speaker identities even in noisy environments and if the speaker's mouth is hidden behind a wall or face mask. The programmable metasurface is the pivotal hardware ingredient of the system because its large aperture and huge number of degrees of freedom allows the system to perform a complex sequence of sensing tasks, orchestrated by artificial-intelligence tools. Relying solely on microwave data, the system avoids visual privacy infringements. The developed microwave speech recognizer can enable privacy-respecting voice-commanded human-machine interactions is experimentally demonstrated in many important but to-date inaccessible application scenarios. The presented strategy will unlock new possibilities and have expectations for future smart homes, ambient-assisted health monitoring, as well as intelligent surveillance and security | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a artificial intelligence (AI) | |
| 650 | 4 | |a human-machine interactions | |
| 650 | 4 | |a microwave sensing | |
| 650 | 4 | |a programmable metasurface | |
| 650 | 4 | |a speech recognition | |
| 700 | 1 | |a Ruan, Hengxin |e verfasserin |4 aut | |
| 700 | 1 | |a Zhao, Hanting |e verfasserin |4 aut | |
| 700 | 1 | |a Wang, Zhuo |e verfasserin |4 aut | |
| 700 | 1 | |a Hu, Shengguo |e verfasserin |4 aut | |
| 700 | 1 | |a Cui, Tie Jun |e verfasserin |4 aut | |
| 700 | 1 | |a Del Hougne, Philipp |e verfasserin |4 aut | |
| 700 | 1 | |a Li, Lianlin |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Advanced science (Weinheim, Baden-Wurttemberg, Germany) |d 2014 |g (2024) vom: 21. Feb., Seite e2309826 |w (DE-627)NLM252851455 |x 2198-3844 |7 nnns |
| 773 | 1 | 8 | |g year:2024 |g day:21 |g month:02 |g pages:e2309826 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1002/advs.202309826 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |j 2024 |b 21 |c 02 |h e2309826 | ||