Development of an Intraoperative Pipeline for Holographic Mixed Reality Visualization During Spinal Fusion Surgery
Objective. Holographic mixed reality (HMR) allows for the superimposition of computer-generated virtual objects onto the operator's view of the world. Innovative solutions can be developed to enable the use of this technology during surgery. The authors developed and iteratively optimized a pipeline to construct, visualize, and register intraoperative holographic models of patient landmarks during spinal fusion surgery. Methods. The study was carried out in two phases. In phase 1, the custom intraoperative pipeline to generate patient-specific holographic models was developed over 7 patients. In phase 2, registration accuracy was optimized iteratively for 6 patients in a real-time operative setting. Results. In phase 1, an intraoperative pipeline was successfully employed to generate and deploy patient-specific holographic models. In phase 2, the registration error with the native hand-gesture registration was 20.2 ± 10.8 mm (n = 7 test points). Custom controller-based registration significantly reduced the mean registration error to 4.18 ± 2.83 mm (n = 24 test points, P < .01). Accuracy improved over time (B = -.69, P < .0001) with the final patient achieving a registration error of 2.30 ± .58 mm. Across both phases, the average model generation time was 18.0 ± 6.1 minutes (n = 6) for isolated spinal hardware and 33.8 ± 8.6 minutes (n = 6) for spinal anatomy. Conclusions. A custom pipeline is described for the generation of intraoperative 3D holographic models during spine surgery. Registration accuracy dramatically improved with iterative optimization of the pipeline and technique. While significant improvements and advancements need to be made to enable clinical utility, HMR demonstrates significant potential as the next frontier of intraoperative visualization.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2021 |
|---|---|
| Erschienen: |
2021 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:28 |
|---|---|
| Enthalten in: |
Surgical innovation - 28(2021), 4 vom: 05. Aug., Seite 427-437 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Buch, Vivek P [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
3D visualization |
|---|
| Anmerkungen: |
Date Completed 15.10.2021 Date Revised 15.10.2021 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1177/1553350620984339 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM31946069X |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM31946069X | ||
| 003 | DE-627 | ||
| 005 | 20231225171506.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231225s2021 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1177/1553350620984339 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1064.xml |
| 035 | |a (DE-627)NLM31946069X | ||
| 035 | |a (NLM)33382008 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Buch, Vivek P |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Development of an Intraoperative Pipeline for Holographic Mixed Reality Visualization During Spinal Fusion Surgery |
| 264 | 1 | |c 2021 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 15.10.2021 | ||
| 500 | |a Date Revised 15.10.2021 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Objective. Holographic mixed reality (HMR) allows for the superimposition of computer-generated virtual objects onto the operator's view of the world. Innovative solutions can be developed to enable the use of this technology during surgery. The authors developed and iteratively optimized a pipeline to construct, visualize, and register intraoperative holographic models of patient landmarks during spinal fusion surgery. Methods. The study was carried out in two phases. In phase 1, the custom intraoperative pipeline to generate patient-specific holographic models was developed over 7 patients. In phase 2, registration accuracy was optimized iteratively for 6 patients in a real-time operative setting. Results. In phase 1, an intraoperative pipeline was successfully employed to generate and deploy patient-specific holographic models. In phase 2, the registration error with the native hand-gesture registration was 20.2 ± 10.8 mm (n = 7 test points). Custom controller-based registration significantly reduced the mean registration error to 4.18 ± 2.83 mm (n = 24 test points, P < .01). Accuracy improved over time (B = -.69, P < .0001) with the final patient achieving a registration error of 2.30 ± .58 mm. Across both phases, the average model generation time was 18.0 ± 6.1 minutes (n = 6) for isolated spinal hardware and 33.8 ± 8.6 minutes (n = 6) for spinal anatomy. Conclusions. A custom pipeline is described for the generation of intraoperative 3D holographic models during spine surgery. Registration accuracy dramatically improved with iterative optimization of the pipeline and technique. While significant improvements and advancements need to be made to enable clinical utility, HMR demonstrates significant potential as the next frontier of intraoperative visualization | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a 3D visualization | |
| 650 | 4 | |a HoloLens™ | |
| 650 | 4 | |a augmented reality | |
| 650 | 4 | |a holographic mixed reality | |
| 650 | 4 | |a spine surgery | |
| 700 | 1 | |a Mensah-Brown, Kobina G |e verfasserin |4 aut | |
| 700 | 1 | |a Germi, James W |e verfasserin |4 aut | |
| 700 | 1 | |a Park, Brian J |e verfasserin |4 aut | |
| 700 | 1 | |a Madsen, Peter J |e verfasserin |4 aut | |
| 700 | 1 | |a Borja, Austin J |e verfasserin |4 aut | |
| 700 | 1 | |a Haldar, Debanjan |e verfasserin |4 aut | |
| 700 | 1 | |a Basenfelder, Patricia |e verfasserin |4 aut | |
| 700 | 1 | |a Yoon, Jang W |e verfasserin |4 aut | |
| 700 | 1 | |a Schuster, James M |e verfasserin |4 aut | |
| 700 | 1 | |a Chen, Han-Chiao I |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Surgical innovation |d 2004 |g 28(2021), 4 vom: 05. Aug., Seite 427-437 |w (DE-627)NLM154108928 |x 1553-3514 |7 nnns |
| 773 | 1 | 8 | |g volume:28 |g year:2021 |g number:4 |g day:05 |g month:08 |g pages:427-437 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1177/1553350620984339 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 28 |j 2021 |e 4 |b 05 |c 08 |h 427-437 | ||