Learning what and where to segment : A new perspective on medical image few-shot segmentation
Copyright © 2023 The Author(s). Published by Elsevier B.V. All rights reserved..
Traditional medical image segmentation methods based on deep learning require experts to provide extensive manual delineations for model training. Few-shot learning aims to reduce the dependence on the scale of training data but usually shows poor generalizability to the new target. The trained model tends to favor the training classes rather than being absolutely class-agnostic. In this work, we propose a novel two-branch segmentation network based on unique medical prior knowledge to alleviate the above problem. Specifically, we explicitly introduce a spatial branch to provide the spatial information of the target. In addition, we build a segmentation branch based on the classical encoder-decoder structure in supervised learning and integrate prototype similarity and spatial information as prior knowledge. To achieve effective information integration, we propose an attention-based fusion module (AF) that enables the content interaction of decoder features and prior knowledge. Experiments on an echocardiography dataset and an abdominal MRI dataset show that the proposed model achieves substantial improvements over state-of-the-art methods. Moreover, some results are comparable to those of the fully supervised model. The source code is available at github.com/warmestwind/RAPNet.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2023 |
|---|---|
| Erschienen: |
2023 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:87 |
|---|---|
| Enthalten in: |
Medical image analysis - 87(2023) vom: 15. Juli, Seite 102834 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Feng, Yong [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Echocardiography |
|---|
| Anmerkungen: |
Date Completed 06.06.2023 Date Revised 08.06.2023 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1016/j.media.2023.102834 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM357100360 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM357100360 | ||
| 003 | DE-627 | ||
| 005 | 20231226071849.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231226s2023 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.media.2023.102834 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1190.xml |
| 035 | |a (DE-627)NLM357100360 | ||
| 035 | |a (NLM)37207524 | ||
| 035 | |a (PII)S1361-8415(23)00094-4 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Feng, Yong |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Learning what and where to segment |b A new perspective on medical image few-shot segmentation |
| 264 | 1 | |c 2023 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 06.06.2023 | ||
| 500 | |a Date Revised 08.06.2023 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Copyright © 2023 The Author(s). Published by Elsevier B.V. All rights reserved. | ||
| 520 | |a Traditional medical image segmentation methods based on deep learning require experts to provide extensive manual delineations for model training. Few-shot learning aims to reduce the dependence on the scale of training data but usually shows poor generalizability to the new target. The trained model tends to favor the training classes rather than being absolutely class-agnostic. In this work, we propose a novel two-branch segmentation network based on unique medical prior knowledge to alleviate the above problem. Specifically, we explicitly introduce a spatial branch to provide the spatial information of the target. In addition, we build a segmentation branch based on the classical encoder-decoder structure in supervised learning and integrate prototype similarity and spatial information as prior knowledge. To achieve effective information integration, we propose an attention-based fusion module (AF) that enables the content interaction of decoder features and prior knowledge. Experiments on an echocardiography dataset and an abdominal MRI dataset show that the proposed model achieves substantial improvements over state-of-the-art methods. Moreover, some results are comparable to those of the fully supervised model. The source code is available at github.com/warmestwind/RAPNet | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Research Support, Non-U.S. Gov't | |
| 650 | 4 | |a Echocardiography | |
| 650 | 4 | |a Few-shot segmentation | |
| 650 | 4 | |a Medical prior knowledge | |
| 650 | 4 | |a Organ segmentation | |
| 700 | 1 | |a Wang, Yonghuai |e verfasserin |4 aut | |
| 700 | 1 | |a Li, Honghe |e verfasserin |4 aut | |
| 700 | 1 | |a Qu, Mingjun |e verfasserin |4 aut | |
| 700 | 1 | |a Yang, Jinzhu |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Medical image analysis |d 1996 |g 87(2023) vom: 15. Juli, Seite 102834 |w (DE-627)NLM096527188 |x 1361-8423 |7 nnns |
| 773 | 1 | 8 | |g volume:87 |g year:2023 |g day:15 |g month:07 |g pages:102834 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1016/j.media.2023.102834 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 87 |j 2023 |b 15 |c 07 |h 102834 | ||