Image-Based Differentiation of Bacterial and Fungal Keratitis Using Deep Convolutional Neural Networks
© 2022 by the American Academy of Ophthalmology..
Purpose: Develop computer vision models for image-based differentiation of bacterial and fungal corneal ulcers and compare their performance against human experts.
Design: Cross-sectional comparison of diagnostic performance.
Participants: Patients with acute, culture-proven bacterial or fungal keratitis from 4 centers in South India.
Methods: Five convolutional neural networks (CNNs) were trained using images from handheld cameras collected from patients with culture-proven corneal ulcers in South India recruited as part of clinical trials conducted between 2006 and 2015. Their performance was evaluated on 2 hold-out test sets (1 single center and 1 multicenter) from South India. Twelve local expert cornea specialists performed remote interpretation of the images in the multicenter test set to enable direct comparison against CNN performance.
Main Outcome Measures: Area under the receiver operating characteristic curve (AUC) individually and for each group collectively (i.e., CNN ensemble and human ensemble).
Results: The best-performing CNN architecture was MobileNet, which attained an AUC of 0.86 on the single-center test set (other CNNs range, 0.68-0.84) and 0.83 on the multicenter test set (other CNNs range, 0.75-0.83). Expert human AUCs on the multicenter test set ranged from 0.42 to 0.79. The CNN ensemble achieved a statistically significantly higher AUC (0.84) than the human ensemble (0.76; P < 0.01). CNNs showed relatively higher accuracy for fungal (81%) versus bacterial (75%) ulcers, whereas humans showed relatively higher accuracy for bacterial (88%) versus fungal (56%) ulcers. An ensemble of the best-performing CNN and best-performing human achieved the highest AUC of 0.87, although this was not statistically significantly higher than the best CNN (0.83; P = 0.17) or best human (0.79; P = 0.09).
Conclusions: Computer vision models achieved superhuman performance in identifying the underlying infectious cause of corneal ulcers compared with cornea specialists. The best-performing model, MobileNet, attained an AUC of 0.83 to 0.86 without any additional clinical or historical information. These findings suggest the potential for future implementation of these models to enable earlier directed antimicrobial therapy in the management of infectious keratitis, which may improve visual outcomes. Additional studies are ongoing to incorporate clinical history and expert opinion into predictive models.
Medienart: |
E-Artikel |
---|
Erscheinungsjahr: |
2022 |
---|---|
Erschienen: |
2022 |
Enthalten in: |
Zur Gesamtaufnahme - volume:2 |
---|---|
Enthalten in: |
Ophthalmology science - 2(2022), 2 vom: 22. Juni, Seite 100119 |
Sprache: |
Englisch |
---|
Beteiligte Personen: |
Redd, Travis K [VerfasserIn] |
---|
Links: |
---|
Anmerkungen: |
Date Revised 21.03.2024 published: Electronic-eCollection Citation Status PubMed-not-MEDLINE |
---|
doi: |
10.1016/j.xops.2022.100119 |
---|
funding: |
|
---|---|
Förderinstitution / Projekttitel: |
|
PPN (Katalog-ID): |
NLM347646662 |
---|
LEADER | 01000caa a22002652 4500 | ||
---|---|---|---|
001 | NLM347646662 | ||
003 | DE-627 | ||
005 | 20240321235051.0 | ||
007 | cr uuu---uuuuu | ||
008 | 231226s2022 xx |||||o 00| ||eng c | ||
024 | 7 | |a 10.1016/j.xops.2022.100119 |2 doi | |
028 | 5 | 2 | |a pubmed24n1338.xml |
035 | |a (DE-627)NLM347646662 | ||
035 | |a (NLM)36249698 | ||
040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
041 | |a eng | ||
100 | 1 | |a Redd, Travis K |e verfasserin |4 aut | |
245 | 1 | 0 | |a Image-Based Differentiation of Bacterial and Fungal Keratitis Using Deep Convolutional Neural Networks |
264 | 1 | |c 2022 | |
336 | |a Text |b txt |2 rdacontent | ||
337 | |a ƒaComputermedien |b c |2 rdamedia | ||
338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
500 | |a Date Revised 21.03.2024 | ||
500 | |a published: Electronic-eCollection | ||
500 | |a Citation Status PubMed-not-MEDLINE | ||
520 | |a © 2022 by the American Academy of Ophthalmology. | ||
520 | |a Purpose: Develop computer vision models for image-based differentiation of bacterial and fungal corneal ulcers and compare their performance against human experts | ||
520 | |a Design: Cross-sectional comparison of diagnostic performance | ||
520 | |a Participants: Patients with acute, culture-proven bacterial or fungal keratitis from 4 centers in South India | ||
520 | |a Methods: Five convolutional neural networks (CNNs) were trained using images from handheld cameras collected from patients with culture-proven corneal ulcers in South India recruited as part of clinical trials conducted between 2006 and 2015. Their performance was evaluated on 2 hold-out test sets (1 single center and 1 multicenter) from South India. Twelve local expert cornea specialists performed remote interpretation of the images in the multicenter test set to enable direct comparison against CNN performance | ||
520 | |a Main Outcome Measures: Area under the receiver operating characteristic curve (AUC) individually and for each group collectively (i.e., CNN ensemble and human ensemble) | ||
520 | |a Results: The best-performing CNN architecture was MobileNet, which attained an AUC of 0.86 on the single-center test set (other CNNs range, 0.68-0.84) and 0.83 on the multicenter test set (other CNNs range, 0.75-0.83). Expert human AUCs on the multicenter test set ranged from 0.42 to 0.79. The CNN ensemble achieved a statistically significantly higher AUC (0.84) than the human ensemble (0.76; P < 0.01). CNNs showed relatively higher accuracy for fungal (81%) versus bacterial (75%) ulcers, whereas humans showed relatively higher accuracy for bacterial (88%) versus fungal (56%) ulcers. An ensemble of the best-performing CNN and best-performing human achieved the highest AUC of 0.87, although this was not statistically significantly higher than the best CNN (0.83; P = 0.17) or best human (0.79; P = 0.09) | ||
520 | |a Conclusions: Computer vision models achieved superhuman performance in identifying the underlying infectious cause of corneal ulcers compared with cornea specialists. The best-performing model, MobileNet, attained an AUC of 0.83 to 0.86 without any additional clinical or historical information. These findings suggest the potential for future implementation of these models to enable earlier directed antimicrobial therapy in the management of infectious keratitis, which may improve visual outcomes. Additional studies are ongoing to incorporate clinical history and expert opinion into predictive models | ||
650 | 4 | |a Journal Article | |
650 | 4 | |a AUC, area under the receiver operating characteristic curve | |
650 | 4 | |a Artificial intelligence | |
650 | 4 | |a Bacterial keratitis | |
650 | 4 | |a CI, confidence interval | |
650 | 4 | |a CNN, convolutional neural network | |
650 | 4 | |a Computer vision | |
650 | 4 | |a Convolutional neural networks | |
650 | 4 | |a Corneal ulcer | |
650 | 4 | |a Deep learning | |
650 | 4 | |a Fungal keratitis | |
650 | 4 | |a Infectious keratitis | |
650 | 4 | |a MUTT, Mycotic Ulcer Treatment Trials | |
650 | 4 | |a SCUT, Steroids for Corneal Ulcers Trial | |
700 | 1 | |a Prajna, N Venkatesh |e verfasserin |4 aut | |
700 | 1 | |a Srinivasan, Muthiah |e verfasserin |4 aut | |
700 | 1 | |a Lalitha, Prajna |e verfasserin |4 aut | |
700 | 1 | |a Krishnan, Tiru |e verfasserin |4 aut | |
700 | 1 | |a Rajaraman, Revathi |e verfasserin |4 aut | |
700 | 1 | |a Venugopal, Anitha |e verfasserin |4 aut | |
700 | 1 | |a Acharya, Nisha |e verfasserin |4 aut | |
700 | 1 | |a Seitzman, Gerami D |e verfasserin |4 aut | |
700 | 1 | |a Lietman, Thomas M |e verfasserin |4 aut | |
700 | 1 | |a Keenan, Jeremy D |e verfasserin |4 aut | |
700 | 1 | |a Campbell, J Peter |e verfasserin |4 aut | |
700 | 1 | |a Song, Xubo |e verfasserin |4 aut | |
773 | 0 | 8 | |i Enthalten in |t Ophthalmology science |d 2021 |g 2(2022), 2 vom: 22. Juni, Seite 100119 |w (DE-627)NLM329259180 |x 2666-9145 |7 nnns |
773 | 1 | 8 | |g volume:2 |g year:2022 |g number:2 |g day:22 |g month:06 |g pages:100119 |
856 | 4 | 0 | |u http://dx.doi.org/10.1016/j.xops.2022.100119 |3 Volltext |
912 | |a GBV_USEFLAG_A | ||
912 | |a GBV_NLM | ||
951 | |a AR | ||
952 | |d 2 |j 2022 |e 2 |b 22 |c 06 |h 100119 |