Towards a robust and compact deep learning system for primary detection of early Barrett's neoplasia : Initial image-based results of training on a multi-center retrospectively collected data set
© 2023 The Authors. United European Gastroenterology Journal published by Wiley Periodicals LLC on behalf of United European Gastroenterology..
INTRODUCTION: Endoscopic detection of early neoplasia in Barrett's esophagus is difficult. Computer Aided Detection (CADe) systems may assist in neoplasia detection. The aim of this study was to report the first steps in the development of a CADe system for Barrett's neoplasia and to evaluate its performance when compared with endoscopists.
METHODS: This CADe system was developed by a consortium, consisting of the Amsterdam University Medical Center, Eindhoven University of Technology, and 15 international hospitals. After pretraining, the system was trained and validated using 1.713 neoplastic (564 patients) and 2.707 non-dysplastic Barrett's esophagus (NDBE; 665 patients) images. Neoplastic lesions were delineated by 14 experts. The performance of the CADe system was tested on three independent test sets. Test set 1 (50 neoplastic and 150 NDBE images) contained subtle neoplastic lesions representing challenging cases and was benchmarked by 52 general endoscopists. Test set 2 (50 neoplastic and 50 NDBE images) contained a heterogeneous case-mix of neoplastic lesions, representing distribution in clinical practice. Test set 3 (50 neoplastic and 150 NDBE images) contained prospectively collected imagery. The main outcome was correct classification of the images in terms of sensitivity.
RESULTS: The sensitivity of the CADe system on test set 1 was 84%. For general endoscopists, sensitivity was 63%, corresponding to a neoplasia miss-rate of one-third of neoplastic lesions and a potential relative increase in neoplasia detection of 33% for CADe-assisted detection. The sensitivity of the CADe system on test sets 2 and 3 was 100% and 88%, respectively. The specificity of the CADe system varied for the three test sets between 64% and 66%.
CONCLUSION: This study describes the first steps towards the establishment of an unprecedented data infrastructure for using machine learning to improve the endoscopic detection of Barrett's neoplasia. The CADe system detected neoplasia reliably and outperformed a large group of endoscopists in terms of sensitivity.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2023 |
|---|---|
| Erschienen: |
2023 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:11 |
|---|---|
| Enthalten in: |
United European gastroenterology journal - 11(2023), 4 vom: 24. Mai, Seite 324-336 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Fockens, Kiki N [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Artificial intelligence |
|---|
| Anmerkungen: |
Date Completed 09.05.2023 Date Revised 25.06.2023 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1002/ueg2.12363 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM355993961 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM355993961 | ||
| 003 | DE-627 | ||
| 005 | 20231226065523.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231226s2023 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1002/ueg2.12363 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1186.xml |
| 035 | |a (DE-627)NLM355993961 | ||
| 035 | |a (NLM)37095718 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Fockens, Kiki N |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Towards a robust and compact deep learning system for primary detection of early Barrett's neoplasia |b Initial image-based results of training on a multi-center retrospectively collected data set |
| 264 | 1 | |c 2023 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 09.05.2023 | ||
| 500 | |a Date Revised 25.06.2023 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a © 2023 The Authors. United European Gastroenterology Journal published by Wiley Periodicals LLC on behalf of United European Gastroenterology. | ||
| 520 | |a INTRODUCTION: Endoscopic detection of early neoplasia in Barrett's esophagus is difficult. Computer Aided Detection (CADe) systems may assist in neoplasia detection. The aim of this study was to report the first steps in the development of a CADe system for Barrett's neoplasia and to evaluate its performance when compared with endoscopists | ||
| 520 | |a METHODS: This CADe system was developed by a consortium, consisting of the Amsterdam University Medical Center, Eindhoven University of Technology, and 15 international hospitals. After pretraining, the system was trained and validated using 1.713 neoplastic (564 patients) and 2.707 non-dysplastic Barrett's esophagus (NDBE; 665 patients) images. Neoplastic lesions were delineated by 14 experts. The performance of the CADe system was tested on three independent test sets. Test set 1 (50 neoplastic and 150 NDBE images) contained subtle neoplastic lesions representing challenging cases and was benchmarked by 52 general endoscopists. Test set 2 (50 neoplastic and 50 NDBE images) contained a heterogeneous case-mix of neoplastic lesions, representing distribution in clinical practice. Test set 3 (50 neoplastic and 150 NDBE images) contained prospectively collected imagery. The main outcome was correct classification of the images in terms of sensitivity | ||
| 520 | |a RESULTS: The sensitivity of the CADe system on test set 1 was 84%. For general endoscopists, sensitivity was 63%, corresponding to a neoplasia miss-rate of one-third of neoplastic lesions and a potential relative increase in neoplasia detection of 33% for CADe-assisted detection. The sensitivity of the CADe system on test sets 2 and 3 was 100% and 88%, respectively. The specificity of the CADe system varied for the three test sets between 64% and 66% | ||
| 520 | |a CONCLUSION: This study describes the first steps towards the establishment of an unprecedented data infrastructure for using machine learning to improve the endoscopic detection of Barrett's neoplasia. The CADe system detected neoplasia reliably and outperformed a large group of endoscopists in terms of sensitivity | ||
| 650 | 4 | |a Multicenter Study | |
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Research Support, Non-U.S. Gov't | |
| 650 | 4 | |a Barrett's esophagus | |
| 650 | 4 | |a Barrett's neoplasia | |
| 650 | 4 | |a artificial intelligence | |
| 650 | 4 | |a computer aided detection | |
| 650 | 4 | |a endoscopy | |
| 650 | 4 | |a machine learning | |
| 700 | 1 | |a Jukema, Jelmer B |e verfasserin |4 aut | |
| 700 | 1 | |a Boers, Tim |e verfasserin |4 aut | |
| 700 | 1 | |a Jong, Martijn R |e verfasserin |4 aut | |
| 700 | 1 | |a van der Putten, Joost A |e verfasserin |4 aut | |
| 700 | 1 | |a Pouw, Roos E |e verfasserin |4 aut | |
| 700 | 1 | |a Weusten, Bas L A M |e verfasserin |4 aut | |
| 700 | 1 | |a Alvarez Herrero, Lorenza |e verfasserin |4 aut | |
| 700 | 1 | |a Houben, Martin H M G |e verfasserin |4 aut | |
| 700 | 1 | |a Nagengast, Wouter B |e verfasserin |4 aut | |
| 700 | 1 | |a Westerhof, Jessie |e verfasserin |4 aut | |
| 700 | 1 | |a Alkhalaf, Alaa |e verfasserin |4 aut | |
| 700 | 1 | |a Mallant, Rosalie |e verfasserin |4 aut | |
| 700 | 1 | |a Ragunath, Krish |e verfasserin |4 aut | |
| 700 | 1 | |a Seewald, Stefan |e verfasserin |4 aut | |
| 700 | 1 | |a Elbe, Peter |e verfasserin |4 aut | |
| 700 | 1 | |a Barret, Maximilien |e verfasserin |4 aut | |
| 700 | 1 | |a Ortiz Fernández-Sordo, Jacobo |e verfasserin |4 aut | |
| 700 | 1 | |a Pech, Oliver |e verfasserin |4 aut | |
| 700 | 1 | |a Beyna, Torsten |e verfasserin |4 aut | |
| 700 | 1 | |a van der Sommen, Fons |e verfasserin |4 aut | |
| 700 | 1 | |a de With, Peter H |e verfasserin |4 aut | |
| 700 | 1 | |a de Groof, A Jeroen |e verfasserin |4 aut | |
| 700 | 1 | |a Bergman, Jacques J |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t United European gastroenterology journal |d 2013 |g 11(2023), 4 vom: 24. Mai, Seite 324-336 |w (DE-627)NLM237284804 |x 2050-6414 |7 nnns |
| 773 | 1 | 8 | |g volume:11 |g year:2023 |g number:4 |g day:24 |g month:05 |g pages:324-336 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1002/ueg2.12363 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 11 |j 2023 |e 4 |b 24 |c 05 |h 324-336 | ||