Deep-learning-based segmentation of the vocal tract and articulators in real-time magnetic resonance images of speech
Copyright © 2020. Published by Elsevier B.V..
BACKGROUND AND OBJECTIVE: Magnetic resonance (MR) imaging is increasingly used in studies of speech as it enables non-invasive visualisation of the vocal tract and articulators, thus providing information about their shape, size, motion and position. Extraction of this information for quantitative analysis is achieved using segmentation. Methods have been developed to segment the vocal tract, however, none of these also fully segment any articulators. The objective of this work was to develop a method to fully segment multiple groups of articulators as well as the vocal tract in two-dimensional MR images of speech, thus overcoming the limitations of existing methods.
METHODS: Five speech MR image sets (392 MR images in total), each of a different healthy adult volunteer, were used in this work. A fully convolutional network with an architecture similar to the original U-Net was developed to segment the following six regions in the image sets: the head, soft palate, jaw, tongue, vocal tract and tooth space. A five-fold cross-validation was performed to investigate the segmentation accuracy and generalisability of the network. The segmentation accuracy was assessed using standard overlap-based metrics (Dice coefficient and general Hausdorff distance) and a novel clinically relevant metric based on velopharyngeal closure.
RESULTS: The segmentations created by the method had a median Dice coefficient of 0.92 and a median general Hausdorff distance of 5mm. The method segmented the head most accurately (median Dice coefficient of 0.99), and the soft palate and tooth space least accurately (median Dice coefficients of 0.92 and 0.93 respectively). The segmentations created by the method correctly showed 90% (27 out of 30) of the velopharyngeal closures in the MR image sets.
CONCLUSIONS: An automatic method to fully segment multiple groups of articulators as well as the vocal tract in two-dimensional MR images of speech was successfully developed. The method is intended for use in clinical and non-clinical speech studies which involve quantitative analysis of the shape, size, motion and position of the vocal tract and articulators. In addition, a novel clinically relevant metric for assessing the accuracy of vocal tract and articulator segmentation methods was developed.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2021 |
|---|---|
| Erschienen: |
2021 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:198 |
|---|---|
| Enthalten in: |
Computer methods and programs in biomedicine - 198(2021) vom: 18. Jan., Seite 105814 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Ruthven, Matthieu [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Articulators |
|---|
| Anmerkungen: |
Date Completed 14.05.2021 Date Revised 31.03.2024 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1016/j.cmpb.2020.105814 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM31765117X |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM31765117X | ||
| 003 | DE-627 | ||
| 005 | 20240331232241.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231225s2021 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.cmpb.2020.105814 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1358.xml |
| 035 | |a (DE-627)NLM31765117X | ||
| 035 | |a (NLM)33197740 | ||
| 035 | |a (PII)S0169-2607(20)31647-3 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Ruthven, Matthieu |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Deep-learning-based segmentation of the vocal tract and articulators in real-time magnetic resonance images of speech |
| 264 | 1 | |c 2021 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 14.05.2021 | ||
| 500 | |a Date Revised 31.03.2024 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Copyright © 2020. Published by Elsevier B.V. | ||
| 520 | |a BACKGROUND AND OBJECTIVE: Magnetic resonance (MR) imaging is increasingly used in studies of speech as it enables non-invasive visualisation of the vocal tract and articulators, thus providing information about their shape, size, motion and position. Extraction of this information for quantitative analysis is achieved using segmentation. Methods have been developed to segment the vocal tract, however, none of these also fully segment any articulators. The objective of this work was to develop a method to fully segment multiple groups of articulators as well as the vocal tract in two-dimensional MR images of speech, thus overcoming the limitations of existing methods | ||
| 520 | |a METHODS: Five speech MR image sets (392 MR images in total), each of a different healthy adult volunteer, were used in this work. A fully convolutional network with an architecture similar to the original U-Net was developed to segment the following six regions in the image sets: the head, soft palate, jaw, tongue, vocal tract and tooth space. A five-fold cross-validation was performed to investigate the segmentation accuracy and generalisability of the network. The segmentation accuracy was assessed using standard overlap-based metrics (Dice coefficient and general Hausdorff distance) and a novel clinically relevant metric based on velopharyngeal closure | ||
| 520 | |a RESULTS: The segmentations created by the method had a median Dice coefficient of 0.92 and a median general Hausdorff distance of 5mm. The method segmented the head most accurately (median Dice coefficient of 0.99), and the soft palate and tooth space least accurately (median Dice coefficients of 0.92 and 0.93 respectively). The segmentations created by the method correctly showed 90% (27 out of 30) of the velopharyngeal closures in the MR image sets | ||
| 520 | |a CONCLUSIONS: An automatic method to fully segment multiple groups of articulators as well as the vocal tract in two-dimensional MR images of speech was successfully developed. The method is intended for use in clinical and non-clinical speech studies which involve quantitative analysis of the shape, size, motion and position of the vocal tract and articulators. In addition, a novel clinically relevant metric for assessing the accuracy of vocal tract and articulator segmentation methods was developed | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Articulators | |
| 650 | 4 | |a Convolutional neural networks | |
| 650 | 4 | |a Dynamic magnetic resonance imaging | |
| 650 | 4 | |a Segmentation | |
| 650 | 4 | |a Speech | |
| 650 | 4 | |a Vocal tract | |
| 700 | 1 | |a Miquel, Marc E |e verfasserin |4 aut | |
| 700 | 1 | |a King, Andrew P |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Computer methods and programs in biomedicine |d 1993 |g 198(2021) vom: 18. Jan., Seite 105814 |w (DE-627)NLM012836133 |x 1872-7565 |7 nnns |
| 773 | 1 | 8 | |g volume:198 |g year:2021 |g day:18 |g month:01 |g pages:105814 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1016/j.cmpb.2020.105814 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 198 |j 2021 |b 18 |c 01 |h 105814 | ||