Innovative integration of augmented reality and optical surface imaging : A coarse-to-precise system for radiotherapy positioning
© 2023 American Association of Physicists in Medicine..
BACKGROUND: Traditional methods of radiotherapy positioning have shortcomings such as fragile skin-markers, additional doses, and lack of information integration. Emerging technologies may provide alternatives for the relevant clinical practice.
PURPOSE: To propose a noninvasive radiotherapy positioning system integrating augmented reality (AR) and optical surface, and to evaluate its feasibility in clinical workflow.
METHODS: AR and structured light-based surface were integrated to implement the coarse-to-precise positioning through two coherent steps, the AR-based coarse guidance and the optical surface-based precise verification. To implement quality assurance, recognition of face and pattern was used for patient authentication, case association, and accessory validation in AR scenes. The holographic images reconstructed from simulation computed tomography (CT) images, guided the initial posture correction by virtual-real alignment. The point clouds of body surface were fused, with the calibration and pose estimation of structured light cameras, and segmented according to the preset regions of interest (ROIs). The global-to-local registration for cross-source point clouds was achieved to calculate couch shifts in six degrees-of-freedom (DoF), which were ultimately transmitted to AR scenes. The evaluation based on phantom and human-body (4 volunteers) included, (i) quality assurance workflow, (ii) errors of both steps and correlation analysis, (iii) receiver operating characteristic (ROC), (iv) distance characteristics of accuracy, and (v) clinical positioning efficiency.
RESULTS: The maximum errors in phantom evaluation were 3.4 ± 2.5 mm in Vrt and 1.4 ± 1.0° in Pitch for the coarse guidance step, while 1.6 ± 0.9 mm in Vrt and 0.6 ± 0.4° in Pitch for the precise verification step. The Pearson correlation coefficients between precise verification and cone beam CT (CBCT) results were distributed in the interval [0.81, 0.85]. In ROC analysis, the areas under the curve (AUC) were 0.87 and 0.89 for translation and rotation, respectively. In human body-based evaluation, the errors of thorax and abdomen (T&A) were significantly greater than those of head and neck (H&N) in Vrt (2.6 ± 1.1 vs. 1.7 ± 0.8, p < 0.01), Lng (2.3 ± 1.1 vs. 1.4 ± 0.9, p < 0.01), and Rtn (0.8 ± 0.4 vs. 0.6 ± 0.3, p = 0.01) while relatively similar in Lat (1.8 ± 0.9 vs. 1.7 ± 0.8, p = 0.07). The translation displacement range, after coarse guidance step, required for high accuracy of the optical surface component of the integrated system was 0-42 mm, and the average positioning duration of the integrated system was significantly less than that of conventional workflow (355.7 ± 21.7 vs. 387.7 ± 26.6 s, p < 0.01).
CONCLUSIONS: The combination of AR and optical surface has utility and feasibility for patient positioning, in terms of both safety and accuracy.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2023 |
|---|---|
| Erschienen: |
2023 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:50 |
|---|---|
| Enthalten in: |
Medical physics - 50(2023), 7 vom: 15. Juli, Seite 4505-4520 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Zhang, Gongsen [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Augmented reality |
|---|
| Anmerkungen: |
Date Completed 11.07.2023 Date Revised 18.07.2023 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1002/mp.16417 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM355644533 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM355644533 | ||
| 003 | DE-627 | ||
| 005 | 20231226064759.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231226s2023 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1002/mp.16417 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1185.xml |
| 035 | |a (DE-627)NLM355644533 | ||
| 035 | |a (NLM)37060328 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Zhang, Gongsen |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Innovative integration of augmented reality and optical surface imaging |b A coarse-to-precise system for radiotherapy positioning |
| 264 | 1 | |c 2023 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 11.07.2023 | ||
| 500 | |a Date Revised 18.07.2023 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a © 2023 American Association of Physicists in Medicine. | ||
| 520 | |a BACKGROUND: Traditional methods of radiotherapy positioning have shortcomings such as fragile skin-markers, additional doses, and lack of information integration. Emerging technologies may provide alternatives for the relevant clinical practice | ||
| 520 | |a PURPOSE: To propose a noninvasive radiotherapy positioning system integrating augmented reality (AR) and optical surface, and to evaluate its feasibility in clinical workflow | ||
| 520 | |a METHODS: AR and structured light-based surface were integrated to implement the coarse-to-precise positioning through two coherent steps, the AR-based coarse guidance and the optical surface-based precise verification. To implement quality assurance, recognition of face and pattern was used for patient authentication, case association, and accessory validation in AR scenes. The holographic images reconstructed from simulation computed tomography (CT) images, guided the initial posture correction by virtual-real alignment. The point clouds of body surface were fused, with the calibration and pose estimation of structured light cameras, and segmented according to the preset regions of interest (ROIs). The global-to-local registration for cross-source point clouds was achieved to calculate couch shifts in six degrees-of-freedom (DoF), which were ultimately transmitted to AR scenes. The evaluation based on phantom and human-body (4 volunteers) included, (i) quality assurance workflow, (ii) errors of both steps and correlation analysis, (iii) receiver operating characteristic (ROC), (iv) distance characteristics of accuracy, and (v) clinical positioning efficiency | ||
| 520 | |a RESULTS: The maximum errors in phantom evaluation were 3.4 ± 2.5 mm in Vrt and 1.4 ± 1.0° in Pitch for the coarse guidance step, while 1.6 ± 0.9 mm in Vrt and 0.6 ± 0.4° in Pitch for the precise verification step. The Pearson correlation coefficients between precise verification and cone beam CT (CBCT) results were distributed in the interval [0.81, 0.85]. In ROC analysis, the areas under the curve (AUC) were 0.87 and 0.89 for translation and rotation, respectively. In human body-based evaluation, the errors of thorax and abdomen (T&A) were significantly greater than those of head and neck (H&N) in Vrt (2.6 ± 1.1 vs. 1.7 ± 0.8, p < 0.01), Lng (2.3 ± 1.1 vs. 1.4 ± 0.9, p < 0.01), and Rtn (0.8 ± 0.4 vs. 0.6 ± 0.3, p = 0.01) while relatively similar in Lat (1.8 ± 0.9 vs. 1.7 ± 0.8, p = 0.07). The translation displacement range, after coarse guidance step, required for high accuracy of the optical surface component of the integrated system was 0-42 mm, and the average positioning duration of the integrated system was significantly less than that of conventional workflow (355.7 ± 21.7 vs. 387.7 ± 26.6 s, p < 0.01) | ||
| 520 | |a CONCLUSIONS: The combination of AR and optical surface has utility and feasibility for patient positioning, in terms of both safety and accuracy | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a augmented reality | |
| 650 | 4 | |a noninvasive | |
| 650 | 4 | |a optical surface imaging | |
| 650 | 4 | |a radiotherapy positioning | |
| 650 | 4 | |a structured light | |
| 700 | 1 | |a Jiang, Zejun |e verfasserin |4 aut | |
| 700 | 1 | |a Zhu, Jian |e verfasserin |4 aut | |
| 700 | 1 | |a Dai, Tianyuan |e verfasserin |4 aut | |
| 700 | 1 | |a He, Xiaolong |e verfasserin |4 aut | |
| 700 | 1 | |a Liu, Xinchao |e verfasserin |4 aut | |
| 700 | 1 | |a Chang, Yankui |e verfasserin |4 aut | |
| 700 | 1 | |a Wang, Linlin |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Medical physics |d 1974 |g 50(2023), 7 vom: 15. Juli, Seite 4505-4520 |w (DE-627)NLM000294748 |x 2473-4209 |7 nnns |
| 773 | 1 | 8 | |g volume:50 |g year:2023 |g number:7 |g day:15 |g month:07 |g pages:4505-4520 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1002/mp.16417 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 50 |j 2023 |e 7 |b 15 |c 07 |h 4505-4520 | ||