Evaluation of a deep learning system for the joint automated detection of diabetic retinopathy and age-related macular degeneration
© 2019 The Authors. Acta Ophthalmologica published by John Wiley & Sons Ltd on behalf of Acta Ophthalmologica Scandinavica Foundation..
PURPOSE: To validate the performance of a commercially available, CE-certified deep learning (DL) system, RetCAD v.1.3.0 (Thirona, Nijmegen, The Netherlands), for the joint automatic detection of diabetic retinopathy (DR) and age-related macular degeneration (AMD) in colour fundus (CF) images on a dataset with mixed presence of eye diseases.
METHODS: Evaluation of joint detection of referable DR and AMD was performed on a DR-AMD dataset with 600 images acquired during routine clinical practice, containing referable and non-referable cases of both diseases. Each image was graded for DR and AMD by an experienced ophthalmologist to establish the reference standard (RS), and by four independent observers for comparison with human performance. Validation was furtherly assessed on Messidor (1200 images) for individual identification of referable DR, and the Age-Related Eye Disease Study (AREDS) dataset (133 821 images) for referable AMD, against the corresponding RS.
RESULTS: Regarding joint validation on the DR-AMD dataset, the system achieved an area under the ROC curve (AUC) of 95.1% for detection of referable DR (SE = 90.1%, SP = 90.6%). For referable AMD, the AUC was 94.9% (SE = 91.8%, SP = 87.5%). Average human performance for DR was SE = 61.5% and SP = 97.8%; for AMD, SE = 76.5% and SP = 96.1%. Regarding detection of referable DR in Messidor, AUC was 97.5% (SE = 92.0%, SP = 92.1%); for referable AMD in AREDS, AUC was 92.7% (SE = 85.8%, SP = 86.0%).
CONCLUSION: The validated system performs comparably to human experts at simultaneous detection of DR and AMD. This shows that DL systems can facilitate access to joint screening of eye diseases and become a quick and reliable support for ophthalmological experts.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2020 |
|---|---|
| Erschienen: |
2020 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:98 |
|---|---|
| Enthalten in: |
Acta ophthalmologica - 98(2020), 4 vom: 02. Juni, Seite 368-377 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
González-Gonzalo, Cristina [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Age-related macular degeneration |
|---|
| Anmerkungen: |
Date Completed 31.03.2021 Date Revised 13.01.2023 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1111/aos.14306 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM303761830 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM303761830 | ||
| 003 | DE-627 | ||
| 005 | 20231225113521.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231225s2020 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1111/aos.14306 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1012.xml |
| 035 | |a (DE-627)NLM303761830 | ||
| 035 | |a (NLM)31773912 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a González-Gonzalo, Cristina |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Evaluation of a deep learning system for the joint automated detection of diabetic retinopathy and age-related macular degeneration |
| 264 | 1 | |c 2020 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 31.03.2021 | ||
| 500 | |a Date Revised 13.01.2023 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a © 2019 The Authors. Acta Ophthalmologica published by John Wiley & Sons Ltd on behalf of Acta Ophthalmologica Scandinavica Foundation. | ||
| 520 | |a PURPOSE: To validate the performance of a commercially available, CE-certified deep learning (DL) system, RetCAD v.1.3.0 (Thirona, Nijmegen, The Netherlands), for the joint automatic detection of diabetic retinopathy (DR) and age-related macular degeneration (AMD) in colour fundus (CF) images on a dataset with mixed presence of eye diseases | ||
| 520 | |a METHODS: Evaluation of joint detection of referable DR and AMD was performed on a DR-AMD dataset with 600 images acquired during routine clinical practice, containing referable and non-referable cases of both diseases. Each image was graded for DR and AMD by an experienced ophthalmologist to establish the reference standard (RS), and by four independent observers for comparison with human performance. Validation was furtherly assessed on Messidor (1200 images) for individual identification of referable DR, and the Age-Related Eye Disease Study (AREDS) dataset (133 821 images) for referable AMD, against the corresponding RS | ||
| 520 | |a RESULTS: Regarding joint validation on the DR-AMD dataset, the system achieved an area under the ROC curve (AUC) of 95.1% for detection of referable DR (SE = 90.1%, SP = 90.6%). For referable AMD, the AUC was 94.9% (SE = 91.8%, SP = 87.5%). Average human performance for DR was SE = 61.5% and SP = 97.8%; for AMD, SE = 76.5% and SP = 96.1%. Regarding detection of referable DR in Messidor, AUC was 97.5% (SE = 92.0%, SP = 92.1%); for referable AMD in AREDS, AUC was 92.7% (SE = 85.8%, SP = 86.0%) | ||
| 520 | |a CONCLUSION: The validated system performs comparably to human experts at simultaneous detection of DR and AMD. This shows that DL systems can facilitate access to joint screening of eye diseases and become a quick and reliable support for ophthalmological experts | ||
| 650 | 4 | |a Evaluation Study | |
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a age-related macular degeneration | |
| 650 | 4 | |a automated detection | |
| 650 | 4 | |a deep learning | |
| 650 | 4 | |a diabetic retinopathy | |
| 650 | 4 | |a observer study | |
| 650 | 4 | |a validation | |
| 700 | 1 | |a Sánchez-Gutiérrez, Verónica |e verfasserin |4 aut | |
| 700 | 1 | |a Hernández-Martínez, Paula |e verfasserin |4 aut | |
| 700 | 1 | |a Contreras, Inés |e verfasserin |4 aut | |
| 700 | 1 | |a Lechanteur, Yara T |e verfasserin |4 aut | |
| 700 | 1 | |a Domanian, Artin |e verfasserin |4 aut | |
| 700 | 1 | |a van Ginneken, Bram |e verfasserin |4 aut | |
| 700 | 1 | |a Sánchez, Clara I |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Acta ophthalmologica |d 2008 |g 98(2020), 4 vom: 02. Juni, Seite 368-377 |w (DE-627)NLM171266315 |x 1755-3768 |7 nnns |
| 773 | 1 | 8 | |g volume:98 |g year:2020 |g number:4 |g day:02 |g month:06 |g pages:368-377 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1111/aos.14306 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 98 |j 2020 |e 4 |b 02 |c 06 |h 368-377 | ||