Data-Driven Classification of Human Movements in Virtual Reality-Based Serious Games : Preclinical Rehabilitation Study in Citizen Science
©Roni Barak Ventura, Kora Stewart Hughes, Oded Nov, Preeti Raghavan, Manuel Ruiz Marín, Maurizio Porfiri. Originally published in JMIR Serious Games (https://games.jmir.org), 10.02.2022..
BACKGROUND: Sustained engagement is essential for the success of telerehabilitation programs. However, patients' lack of motivation and adherence could undermine these goals. To overcome this challenge, physical exercises have often been gamified. Building on the advantages of serious games, we propose a citizen science-based approach in which patients perform scientific tasks by using interactive interfaces and help advance scientific causes of their choice. This approach capitalizes on human intellect and benevolence while promoting learning. To further enhance engagement, we propose performing citizen science activities in immersive media, such as virtual reality (VR).
OBJECTIVE: This study aims to present a novel methodology to facilitate the remote identification and classification of human movements for the automatic assessment of motor performance in telerehabilitation. The data-driven approach is presented in the context of a citizen science software dedicated to bimanual training in VR. Specifically, users interact with the interface and make contributions to an environmental citizen science project while moving both arms in concert.
METHODS: In all, 9 healthy individuals interacted with the citizen science software by using a commercial VR gaming device. The software included a calibration phase to evaluate the users' range of motion along the 3 anatomical planes of motion and to adapt the sensitivity of the software's response to their movements. During calibration, the time series of the users' movements were recorded by the sensors embedded in the device. We performed principal component analysis to identify salient features of movements and then applied a bagged trees ensemble classifier to classify the movements.
RESULTS: The classification achieved high performance, reaching 99.9% accuracy. Among the movements, elbow flexion was the most accurately classified movement (99.2%), and horizontal shoulder abduction to the right side of the body was the most misclassified movement (98.8%).
CONCLUSIONS: Coordinated bimanual movements in VR can be classified with high accuracy. Our findings lay the foundation for the development of motion analysis algorithms in VR-mediated telerehabilitation.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2022 |
|---|---|
| Erschienen: |
2022 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:10 |
|---|---|
| Enthalten in: |
JMIR serious games - 10(2022), 1 vom: 10. Feb., Seite e27597 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Barak Ventura, Roni [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Journal Article |
|---|
| Anmerkungen: |
Date Revised 11.03.2022 published: Electronic Citation Status PubMed-not-MEDLINE |
|---|
| doi: |
10.2196/27597 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM336748655 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM336748655 | ||
| 003 | DE-627 | ||
| 005 | 20231225232839.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231225s2022 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.2196/27597 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1122.xml |
| 035 | |a (DE-627)NLM336748655 | ||
| 035 | |a (NLM)35142629 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Barak Ventura, Roni |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Data-Driven Classification of Human Movements in Virtual Reality-Based Serious Games |b Preclinical Rehabilitation Study in Citizen Science |
| 264 | 1 | |c 2022 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Revised 11.03.2022 | ||
| 500 | |a published: Electronic | ||
| 500 | |a Citation Status PubMed-not-MEDLINE | ||
| 520 | |a ©Roni Barak Ventura, Kora Stewart Hughes, Oded Nov, Preeti Raghavan, Manuel Ruiz Marín, Maurizio Porfiri. Originally published in JMIR Serious Games (https://games.jmir.org), 10.02.2022. | ||
| 520 | |a BACKGROUND: Sustained engagement is essential for the success of telerehabilitation programs. However, patients' lack of motivation and adherence could undermine these goals. To overcome this challenge, physical exercises have often been gamified. Building on the advantages of serious games, we propose a citizen science-based approach in which patients perform scientific tasks by using interactive interfaces and help advance scientific causes of their choice. This approach capitalizes on human intellect and benevolence while promoting learning. To further enhance engagement, we propose performing citizen science activities in immersive media, such as virtual reality (VR) | ||
| 520 | |a OBJECTIVE: This study aims to present a novel methodology to facilitate the remote identification and classification of human movements for the automatic assessment of motor performance in telerehabilitation. The data-driven approach is presented in the context of a citizen science software dedicated to bimanual training in VR. Specifically, users interact with the interface and make contributions to an environmental citizen science project while moving both arms in concert | ||
| 520 | |a METHODS: In all, 9 healthy individuals interacted with the citizen science software by using a commercial VR gaming device. The software included a calibration phase to evaluate the users' range of motion along the 3 anatomical planes of motion and to adapt the sensitivity of the software's response to their movements. During calibration, the time series of the users' movements were recorded by the sensors embedded in the device. We performed principal component analysis to identify salient features of movements and then applied a bagged trees ensemble classifier to classify the movements | ||
| 520 | |a RESULTS: The classification achieved high performance, reaching 99.9% accuracy. Among the movements, elbow flexion was the most accurately classified movement (99.2%), and horizontal shoulder abduction to the right side of the body was the most misclassified movement (98.8%) | ||
| 520 | |a CONCLUSIONS: Coordinated bimanual movements in VR can be classified with high accuracy. Our findings lay the foundation for the development of motion analysis algorithms in VR-mediated telerehabilitation | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a motion analysis | |
| 650 | 4 | |a principal component analysis | |
| 650 | 4 | |a telerehabilitation | |
| 650 | 4 | |a virtual reality | |
| 700 | 1 | |a Stewart Hughes, Kora |e verfasserin |4 aut | |
| 700 | 1 | |a Nov, Oded |e verfasserin |4 aut | |
| 700 | 1 | |a Raghavan, Preeti |e verfasserin |4 aut | |
| 700 | 1 | |a Ruiz Marín, Manuel |e verfasserin |4 aut | |
| 700 | 1 | |a Porfiri, Maurizio |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t JMIR serious games |d 2013 |g 10(2022), 1 vom: 10. Feb., Seite e27597 |w (DE-627)NLM245300899 |x 2291-9279 |7 nnns |
| 773 | 1 | 8 | |g volume:10 |g year:2022 |g number:1 |g day:10 |g month:02 |g pages:e27597 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.2196/27597 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 10 |j 2022 |e 1 |b 10 |c 02 |h e27597 | ||