Variability in human and automatic segmentation of melanocytic lesions
In a double blind evaluation of 60 digital dermatoscopic images by 4 "junior", 4 "senior" and 4 "expert" dermatologists (dermatoscopy training respectively less than 1 year, between 1 and 5 years, and more than 5 years), a significant inter-operator variability was observed in melanocytic lesion border identification (with a disagreement of the order of 10 - 20% of the area of the lesions). Expert dermatologists showed greater agreement among themselves than with senior and junior dermatologists, and a slight tendency towards "tighter" segmentations. The human inter-operator variability was then used to evaluate the segmentation accuracy of 4 algorithms, representative of the 3 fundamental state-of-the-art automated segmentation techniques and of a fourth, novel, technique. Our evaluation methodology addresses a number of crucial difficulties encountered in previous studies and may be of independent interest. 3 of the 4 algorithms showed considerably less agreement with expert dermatologists than even senior and junior dermatologists did (with a disagreement of the order of 30% of the area of the lesions); the remaining algorithm, however, showed agreement with expert dermatologists comparable to that of other expert dermatologists.
Medienart: |
E-Artikel |
---|
Erscheinungsjahr: |
2009 |
---|---|
Erschienen: |
2009 |
Enthalten in: |
Zur Gesamtaufnahme - volume:2009 |
---|---|
Enthalten in: |
Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference - 2009(2009) vom: 15., Seite 5789-92 |
Sprache: |
Englisch |
---|
Beteiligte Personen: |
Silletti, A [VerfasserIn] |
---|
Links: |
---|
Themen: |
---|
Anmerkungen: |
Date Completed 02.04.2010 Date Revised 28.09.2020 published: Print Citation Status MEDLINE |
---|
doi: |
10.1109/IEMBS.2009.5332543 |
---|
funding: |
|
---|---|
Förderinstitution / Projekttitel: |
|
PPN (Katalog-ID): |
NLM193299224 |
---|
LEADER | 01000naa a22002652 4500 | ||
---|---|---|---|
001 | NLM193299224 | ||
003 | DE-627 | ||
005 | 20231223194530.0 | ||
007 | cr uuu---uuuuu | ||
008 | 231223s2009 xx |||||o 00| ||eng c | ||
024 | 7 | |a 10.1109/IEMBS.2009.5332543 |2 doi | |
028 | 5 | 2 | |a pubmed24n0644.xml |
035 | |a (DE-627)NLM193299224 | ||
035 | |a (NLM)19963660 | ||
040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
041 | |a eng | ||
100 | 1 | |a Silletti, A |e verfasserin |4 aut | |
245 | 1 | 0 | |a Variability in human and automatic segmentation of melanocytic lesions |
264 | 1 | |c 2009 | |
336 | |a Text |b txt |2 rdacontent | ||
337 | |a ƒaComputermedien |b c |2 rdamedia | ||
338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
500 | |a Date Completed 02.04.2010 | ||
500 | |a Date Revised 28.09.2020 | ||
500 | |a published: Print | ||
500 | |a Citation Status MEDLINE | ||
520 | |a In a double blind evaluation of 60 digital dermatoscopic images by 4 "junior", 4 "senior" and 4 "expert" dermatologists (dermatoscopy training respectively less than 1 year, between 1 and 5 years, and more than 5 years), a significant inter-operator variability was observed in melanocytic lesion border identification (with a disagreement of the order of 10 - 20% of the area of the lesions). Expert dermatologists showed greater agreement among themselves than with senior and junior dermatologists, and a slight tendency towards "tighter" segmentations. The human inter-operator variability was then used to evaluate the segmentation accuracy of 4 algorithms, representative of the 3 fundamental state-of-the-art automated segmentation techniques and of a fourth, novel, technique. Our evaluation methodology addresses a number of crucial difficulties encountered in previous studies and may be of independent interest. 3 of the 4 algorithms showed considerably less agreement with expert dermatologists than even senior and junior dermatologists did (with a disagreement of the order of 30% of the area of the lesions); the remaining algorithm, however, showed agreement with expert dermatologists comparable to that of other expert dermatologists | ||
650 | 4 | |a Evaluation Study | |
650 | 4 | |a Journal Article | |
700 | 1 | |a Peserico, E |e verfasserin |4 aut | |
700 | 1 | |a Mantovan, A |e verfasserin |4 aut | |
700 | 1 | |a Zattra, E |e verfasserin |4 aut | |
700 | 1 | |a Peserico, A |e verfasserin |4 aut | |
700 | 1 | |a Belloni Fortina, A |e verfasserin |4 aut | |
773 | 0 | 8 | |i Enthalten in |t Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference |d 2007 |g 2009(2009) vom: 15., Seite 5789-92 |w (DE-627)NLM175007292 |x 2694-0604 |7 nnns |
773 | 1 | 8 | |g volume:2009 |g year:2009 |g day:15 |g pages:5789-92 |
856 | 4 | 0 | |u http://dx.doi.org/10.1109/IEMBS.2009.5332543 |3 Volltext |
912 | |a GBV_USEFLAG_A | ||
912 | |a GBV_NLM | ||
951 | |a AR | ||
952 | |d 2009 |j 2009 |b 15 |h 5789-92 |