Applications of Digital Microscopy and Densely Connected Convolutional Neural Networks for Automated Quantification of Babesia-Infected Erythrocytes
© American Association for Clinical Chemistry 2021. All rights reserved. For permissions, please email: journals.permissionsoup.com..
BACKGROUND: Clinical babesiosis is diagnosed, and parasite burden is determined, by microscopic inspection of a thick or thin Giemsa-stained peripheral blood smear. However, quantitative analysis by manual microscopy is subject to error. As such, methods for the automated measurement of percent parasitemia in digital microscopic images of peripheral blood smears could improve clinical accuracy, relative to the predicate method.
METHODS: Individual erythrocyte images were manually labeled as "parasite" or "normal" and were used to train a model for binary image classification. The best model was then used to calculate percent parasitemia from a clinical validation dataset, and values were compared to a clinical reference value. Lastly, model interpretability was examined using an integrated gradient to identify pixels most likely to influence classification decisions.
RESULTS: The precision and recall of the model during development testing were 0.92 and 1.00, respectively. In clinical validation, the model returned increasing positive signal with increasing mean reference value. However, there were 2 highly erroneous false positive values returned by the model. Further, the model incorrectly assessed 3 cases well above the clinical threshold of 10%. The integrated gradient suggested potential sources of false positives including rouleaux formations, cell boundaries, and precipitate as deterministic factors in negative erythrocyte images.
CONCLUSIONS: While the model demonstrated highly accurate single cell classification and correctly assessed most slides, several false positives were highly incorrect. This project highlights the need for integrated testing of machine learning-based models, even when models in the development phase perform well.
Medienart: |
E-Artikel |
---|
Erscheinungsjahr: |
2021 |
---|---|
Erschienen: |
2021 |
Enthalten in: |
Zur Gesamtaufnahme - volume:68 |
---|---|
Enthalten in: |
Clinical chemistry - 68(2021), 1 vom: 30. Dez., Seite 218-229 |
Sprache: |
Englisch |
---|
Beteiligte Personen: |
Durant, Thomas J S [VerfasserIn] |
---|
Links: |
---|
Themen: |
Babesia |
---|
Anmerkungen: |
Date Completed 13.04.2022 Date Revised 13.04.2022 published: Print Citation Status MEDLINE |
---|
doi: |
10.1093/clinchem/hvab237 |
---|
funding: |
|
---|---|
Förderinstitution / Projekttitel: |
|
PPN (Katalog-ID): |
NLM335049060 |
---|
LEADER | 01000naa a22002652 4500 | ||
---|---|---|---|
001 | NLM335049060 | ||
003 | DE-627 | ||
005 | 20231225225002.0 | ||
007 | cr uuu---uuuuu | ||
008 | 231225s2021 xx |||||o 00| ||eng c | ||
024 | 7 | |a 10.1093/clinchem/hvab237 |2 doi | |
028 | 5 | 2 | |a pubmed24n1116.xml |
035 | |a (DE-627)NLM335049060 | ||
035 | |a (NLM)34969114 | ||
040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
041 | |a eng | ||
100 | 1 | |a Durant, Thomas J S |e verfasserin |4 aut | |
245 | 1 | 0 | |a Applications of Digital Microscopy and Densely Connected Convolutional Neural Networks for Automated Quantification of Babesia-Infected Erythrocytes |
264 | 1 | |c 2021 | |
336 | |a Text |b txt |2 rdacontent | ||
337 | |a ƒaComputermedien |b c |2 rdamedia | ||
338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
500 | |a Date Completed 13.04.2022 | ||
500 | |a Date Revised 13.04.2022 | ||
500 | |a published: Print | ||
500 | |a Citation Status MEDLINE | ||
520 | |a © American Association for Clinical Chemistry 2021. All rights reserved. For permissions, please email: journals.permissionsoup.com. | ||
520 | |a BACKGROUND: Clinical babesiosis is diagnosed, and parasite burden is determined, by microscopic inspection of a thick or thin Giemsa-stained peripheral blood smear. However, quantitative analysis by manual microscopy is subject to error. As such, methods for the automated measurement of percent parasitemia in digital microscopic images of peripheral blood smears could improve clinical accuracy, relative to the predicate method | ||
520 | |a METHODS: Individual erythrocyte images were manually labeled as "parasite" or "normal" and were used to train a model for binary image classification. The best model was then used to calculate percent parasitemia from a clinical validation dataset, and values were compared to a clinical reference value. Lastly, model interpretability was examined using an integrated gradient to identify pixels most likely to influence classification decisions | ||
520 | |a RESULTS: The precision and recall of the model during development testing were 0.92 and 1.00, respectively. In clinical validation, the model returned increasing positive signal with increasing mean reference value. However, there were 2 highly erroneous false positive values returned by the model. Further, the model incorrectly assessed 3 cases well above the clinical threshold of 10%. The integrated gradient suggested potential sources of false positives including rouleaux formations, cell boundaries, and precipitate as deterministic factors in negative erythrocyte images | ||
520 | |a CONCLUSIONS: While the model demonstrated highly accurate single cell classification and correctly assessed most slides, several false positives were highly incorrect. This project highlights the need for integrated testing of machine learning-based models, even when models in the development phase perform well | ||
650 | 4 | |a Journal Article | |
650 | 4 | |a Research Support, Non-U.S. Gov't | |
650 | 4 | |a babesia | |
650 | 4 | |a convolutional neural networks | |
650 | 4 | |a erythrocyte | |
650 | 4 | |a image analysis | |
650 | 4 | |a machine learning | |
650 | 4 | |a peripheral blood smear | |
700 | 1 | |a Dudgeon, Sarah N |e verfasserin |4 aut | |
700 | 1 | |a McPadden, Jacob |e verfasserin |4 aut | |
700 | 1 | |a Simpson, Anisia |e verfasserin |4 aut | |
700 | 1 | |a Price, Nathan |e verfasserin |4 aut | |
700 | 1 | |a Schulz, Wade L |e verfasserin |4 aut | |
700 | 1 | |a Torres, Richard |e verfasserin |4 aut | |
700 | 1 | |a Olson, Eben M |e verfasserin |4 aut | |
773 | 0 | 8 | |i Enthalten in |t Clinical chemistry |d 1955 |g 68(2021), 1 vom: 30. Dez., Seite 218-229 |w (DE-627)NLM000002003 |x 1530-8561 |7 nnns |
773 | 1 | 8 | |g volume:68 |g year:2021 |g number:1 |g day:30 |g month:12 |g pages:218-229 |
856 | 4 | 0 | |u http://dx.doi.org/10.1093/clinchem/hvab237 |3 Volltext |
912 | |a GBV_USEFLAG_A | ||
912 | |a GBV_NLM | ||
951 | |a AR | ||
952 | |d 68 |j 2021 |e 1 |b 30 |c 12 |h 218-229 |