Assessing the Impact of Image Quality on Deep Learning Classification of Infectious Keratitis
© 2023 by the American Academy of Ophthalmology..
Objective: To investigate the impact of corneal photograph quality on convolutional neural network (CNN) predictions.
Design: A CNN trained to classify bacterial and fungal keratitis was evaluated using photographs of ulcers labeled according to 5 corneal image quality parameters: eccentric gaze direction, abnormal eyelid position, over/under-exposure, inadequate focus, and malpositioned light reflection.
Participants: All eligible subjects with culture and stain-proven bacterial and/or fungal ulcers presenting to Aravind Eye Hospital in Madurai, India, between January 1, 2021 and December 31, 2021.
Methods: Convolutional neural network classification performance was compared for each quality parameter, and gradient class activation heatmaps were generated to visualize regions of highest influence on CNN predictions.
Main Outcome Measures: Area under the receiver operating characteristic and precision recall curves were calculated to quantify model performance. Bootstrapped confidence intervals were used for statistical comparisons. Logistic loss was calculated to measure individual prediction accuracy.
Results: Individual presence of either light reflection or eyelids obscuring the corneal surface was associated with significantly higher CNN performance. No other quality parameter significantly influenced CNN performance. Qualitative review of gradient class activation heatmaps generally revealed the infiltrate as having the highest diagnostic relevance.
Conclusions: The CNN demonstrated expert-level performance regardless of image quality. Future studies may investigate use of smartphone cameras and image sets with greater variance in image quality to further explore the influence of these parameters on model performance.
Financial Disclosures: Proprietary or commercial disclosure may be found after the references.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2023 |
|---|---|
| Erschienen: |
2023 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:3 |
|---|---|
| Enthalten in: |
Ophthalmology science - 3(2023), 4 vom: 22. Dez., Seite 100331 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Hanif, Adam [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Artificial intelligence |
|---|
| Anmerkungen: |
Date Revised 21.03.2024 published: Electronic-eCollection Citation Status PubMed-not-MEDLINE |
|---|
| doi: |
10.1016/j.xops.2023.100331 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM364122927 |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM364122927 | ||
| 003 | DE-627 | ||
| 005 | 20240321235554.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231226s2023 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.xops.2023.100331 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1338.xml |
| 035 | |a (DE-627)NLM364122927 | ||
| 035 | |a (NLM)37920421 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Hanif, Adam |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Assessing the Impact of Image Quality on Deep Learning Classification of Infectious Keratitis |
| 264 | 1 | |c 2023 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Revised 21.03.2024 | ||
| 500 | |a published: Electronic-eCollection | ||
| 500 | |a Citation Status PubMed-not-MEDLINE | ||
| 520 | |a © 2023 by the American Academy of Ophthalmology. | ||
| 520 | |a Objective: To investigate the impact of corneal photograph quality on convolutional neural network (CNN) predictions | ||
| 520 | |a Design: A CNN trained to classify bacterial and fungal keratitis was evaluated using photographs of ulcers labeled according to 5 corneal image quality parameters: eccentric gaze direction, abnormal eyelid position, over/under-exposure, inadequate focus, and malpositioned light reflection | ||
| 520 | |a Participants: All eligible subjects with culture and stain-proven bacterial and/or fungal ulcers presenting to Aravind Eye Hospital in Madurai, India, between January 1, 2021 and December 31, 2021 | ||
| 520 | |a Methods: Convolutional neural network classification performance was compared for each quality parameter, and gradient class activation heatmaps were generated to visualize regions of highest influence on CNN predictions | ||
| 520 | |a Main Outcome Measures: Area under the receiver operating characteristic and precision recall curves were calculated to quantify model performance. Bootstrapped confidence intervals were used for statistical comparisons. Logistic loss was calculated to measure individual prediction accuracy | ||
| 520 | |a Results: Individual presence of either light reflection or eyelids obscuring the corneal surface was associated with significantly higher CNN performance. No other quality parameter significantly influenced CNN performance. Qualitative review of gradient class activation heatmaps generally revealed the infiltrate as having the highest diagnostic relevance | ||
| 520 | |a Conclusions: The CNN demonstrated expert-level performance regardless of image quality. Future studies may investigate use of smartphone cameras and image sets with greater variance in image quality to further explore the influence of these parameters on model performance | ||
| 520 | |a Financial Disclosures: Proprietary or commercial disclosure may be found after the references | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Artificial intelligence | |
| 650 | 4 | |a Deep learning | |
| 650 | 4 | |a External photograph | |
| 650 | 4 | |a Image quality | |
| 650 | 4 | |a Infectious keratitis | |
| 700 | 1 | |a Prajna, N Venkatesh |e verfasserin |4 aut | |
| 700 | 1 | |a Lalitha, Prajna |e verfasserin |4 aut | |
| 700 | 1 | |a NaPier, Erin |e verfasserin |4 aut | |
| 700 | 1 | |a Parker, Maria |e verfasserin |4 aut | |
| 700 | 1 | |a Steinkamp, Peter |e verfasserin |4 aut | |
| 700 | 1 | |a Keenan, Jeremy D |e verfasserin |4 aut | |
| 700 | 1 | |a Campbell, J Peter |e verfasserin |4 aut | |
| 700 | 1 | |a Song, Xubo |e verfasserin |4 aut | |
| 700 | 1 | |a Redd, Travis K |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Ophthalmology science |d 2021 |g 3(2023), 4 vom: 22. Dez., Seite 100331 |w (DE-627)NLM329259180 |x 2666-9145 |7 nnns |
| 773 | 1 | 8 | |g volume:3 |g year:2023 |g number:4 |g day:22 |g month:12 |g pages:100331 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1016/j.xops.2023.100331 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 3 |j 2023 |e 4 |b 22 |c 12 |h 100331 | ||