Active Deep Learning with Fisher Information for Patch-wise Semantic Segmentation
Deep learning with convolutional neural networks (CNN) has achieved unprecedented success in segmentation, however it requires large training data, which is expensive to obtain. Active Learning (AL) frameworks can facilitate major improvements in CNN performance with intelligent selection of minimal data to be labeled. This paper proposes a novel diversified AL based on Fisher information (FI) for the first time for CNNs, where gradient computations from backpropagation are used for efficient computation of FI on the large CNN parameter space. We evaluated the proposed method in the context of newborn and adolescent brain extraction problem under two scenarios: (1) semi-automatic segmentation of a particular subject from a different age group or with a pathology not available in the original training data, where starting from an inaccurate pre-trained model, we iteratively label small number of voxels queried by AL until the model generates accurate segmentation for that subject, and (2) using AL to build a universal model generalizable to all images in a given data set. In both scenarios, FI-based AL improved performance after labeling a small percentage (less than 0.05%) of voxels. The results showed that FI-based AL significantly outperformed random sampling, and achieved accuracy higher than entropy-based querying in transfer learning, where the model learns to extract brains of newborn subjects given an initial model trained on adolescents.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2018 |
|---|---|
| Erschienen: |
2018 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:11045 |
|---|---|
| Enthalten in: |
Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support : 4th International Workshop, DLMIA 2018, and 8th International Workshop, ML-CDS 2018, held in conjunction with MICCAI 2018, Granada, Spain, S - 11045(2018) vom: 14. Sept., Seite 83-91 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Sourati, Jamshid [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
|---|
| Anmerkungen: |
Date Revised 01.10.2020 published: Print-Electronic Citation Status PubMed-not-MEDLINE |
|---|
| doi: |
10.1007/978-3-030-00889-5_10 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM290825733 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM290825733 | ||
| 003 | DE-627 | ||
| 005 | 20231225065545.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231225s2018 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1007/978-3-030-00889-5_10 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n0969.xml |
| 035 | |a (DE-627)NLM290825733 | ||
| 035 | |a (NLM)30450490 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Sourati, Jamshid |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Active Deep Learning with Fisher Information for Patch-wise Semantic Segmentation |
| 264 | 1 | |c 2018 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Revised 01.10.2020 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status PubMed-not-MEDLINE | ||
| 520 | |a Deep learning with convolutional neural networks (CNN) has achieved unprecedented success in segmentation, however it requires large training data, which is expensive to obtain. Active Learning (AL) frameworks can facilitate major improvements in CNN performance with intelligent selection of minimal data to be labeled. This paper proposes a novel diversified AL based on Fisher information (FI) for the first time for CNNs, where gradient computations from backpropagation are used for efficient computation of FI on the large CNN parameter space. We evaluated the proposed method in the context of newborn and adolescent brain extraction problem under two scenarios: (1) semi-automatic segmentation of a particular subject from a different age group or with a pathology not available in the original training data, where starting from an inaccurate pre-trained model, we iteratively label small number of voxels queried by AL until the model generates accurate segmentation for that subject, and (2) using AL to build a universal model generalizable to all images in a given data set. In both scenarios, FI-based AL improved performance after labeling a small percentage (less than 0.05%) of voxels. The results showed that FI-based AL significantly outperformed random sampling, and achieved accuracy higher than entropy-based querying in transfer learning, where the model learns to extract brains of newborn subjects given an initial model trained on adolescents | ||
| 650 | 4 | |a Journal Article | |
| 700 | 1 | |a Gholipour, Ali |e verfasserin |4 aut | |
| 700 | 1 | |a Dy, Jennifer G |e verfasserin |4 aut | |
| 700 | 1 | |a Kurugol, Sila |e verfasserin |4 aut | |
| 700 | 1 | |a Warfield, Simon K |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support : 4th International Workshop, DLMIA 2018, and 8th International Workshop, ML-CDS 2018, held in conjunction with MICCAI 2018, Granada, Spain, S |d 2018 |g 11045(2018) vom: 14. Sept., Seite 83-91 |w (DE-627)NLM290825725 |7 nnns |
| 773 | 1 | 8 | |g volume:11045 |g year:2018 |g day:14 |g month:09 |g pages:83-91 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1007/978-3-030-00889-5_10 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 11045 |j 2018 |b 14 |c 09 |h 83-91 | ||