STIRUnet : SwinTransformer and inverted residual convolution embedding in unet for Sea-Land segmentation
Copyright © 2024 Elsevier Ltd. All rights reserved..
Extraction of coastline from optical remote sensing images is of paramount importance for coastal zone management, erosion monitoring, and intelligent ocean construction. However, nearshore marine environment complexity presents a challenge when capturing small-scale and detailed information regarding coastlines. Furthermore, the presence of numerous tidal flats, suspended sediments, and coastal biological communities exacerbates the reduction in segmentation accuracy, which is particularly noticeable in medium-high-resolution remote sensing image segmentation tasks. Most previous related studies, based primarily on convolutional neural networks (CNNs) or traditional feature extraction methods, faced challenges in detailed pixel-level refinement and lacked comprehensive understanding of the studied images. Therefore, we proposed a new U-shaped deep learning model (STIRUnet) that combines the excellent global modeling ability of SwinTransformer with an improved CNN using an inverted residual module. The proposed method has the capability of global supervised feature learning and layer-by-layer feature extraction, and we conducted sea-land segmentation experiments using GF-HNCD and BSD remote sensing image datasets to validate the performance of the proposed model. The results indicate the following: 1) suspended sediments and coastal biological communities are major contributors to coastline blurring, and 2) the recovery of minute features (e.g., narrow watercourses and microscale artificial structures) effectively enhances edge details and leads to more realistic segmentation outcomes. The findings of this study are highly important in relation of accurate extraction of sea-land information in complex marine environments, and they offer novel insights regarding mixed-pixel identification.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2024 |
|---|---|
| Erschienen: |
2024 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:357 |
|---|---|
| Enthalten in: |
Journal of environmental management - 357(2024) vom: 21. Apr., Seite 120773 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Tong, Qixiang [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Inverted residual convolution |
|---|
| Anmerkungen: |
Date Completed 15.04.2024 Date Revised 15.04.2024 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1016/j.jenvman.2024.120773 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM370453662 |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM370453662 | ||
| 003 | DE-627 | ||
| 005 | 20240415233622.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 240401s2024 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.jenvman.2024.120773 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1376.xml |
| 035 | |a (DE-627)NLM370453662 | ||
| 035 | |a (NLM)38555845 | ||
| 035 | |a (PII)S0301-4797(24)00759-X | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Tong, Qixiang |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a STIRUnet |b SwinTransformer and inverted residual convolution embedding in unet for Sea-Land segmentation |
| 264 | 1 | |c 2024 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 15.04.2024 | ||
| 500 | |a Date Revised 15.04.2024 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Copyright © 2024 Elsevier Ltd. All rights reserved. | ||
| 520 | |a Extraction of coastline from optical remote sensing images is of paramount importance for coastal zone management, erosion monitoring, and intelligent ocean construction. However, nearshore marine environment complexity presents a challenge when capturing small-scale and detailed information regarding coastlines. Furthermore, the presence of numerous tidal flats, suspended sediments, and coastal biological communities exacerbates the reduction in segmentation accuracy, which is particularly noticeable in medium-high-resolution remote sensing image segmentation tasks. Most previous related studies, based primarily on convolutional neural networks (CNNs) or traditional feature extraction methods, faced challenges in detailed pixel-level refinement and lacked comprehensive understanding of the studied images. Therefore, we proposed a new U-shaped deep learning model (STIRUnet) that combines the excellent global modeling ability of SwinTransformer with an improved CNN using an inverted residual module. The proposed method has the capability of global supervised feature learning and layer-by-layer feature extraction, and we conducted sea-land segmentation experiments using GF-HNCD and BSD remote sensing image datasets to validate the performance of the proposed model. The results indicate the following: 1) suspended sediments and coastal biological communities are major contributors to coastline blurring, and 2) the recovery of minute features (e.g., narrow watercourses and microscale artificial structures) effectively enhances edge details and leads to more realistic segmentation outcomes. The findings of this study are highly important in relation of accurate extraction of sea-land information in complex marine environments, and they offer novel insights regarding mixed-pixel identification | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Inverted residual convolution | |
| 650 | 4 | |a Remote sensing | |
| 650 | 4 | |a Sea–land segmentation | |
| 650 | 4 | |a SwinTransformer | |
| 650 | 4 | |a Unet | |
| 700 | 1 | |a Wu, Jiawei |e verfasserin |4 aut | |
| 700 | 1 | |a Zhu, Zhipeng |e verfasserin |4 aut | |
| 700 | 1 | |a Zhang, Min |e verfasserin |4 aut | |
| 700 | 1 | |a Xing, Haihua |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Journal of environmental management |d 2001 |g 357(2024) vom: 21. Apr., Seite 120773 |w (DE-627)NLM112866786 |x 1095-8630 |7 nnns |
| 773 | 1 | 8 | |g volume:357 |g year:2024 |g day:21 |g month:04 |g pages:120773 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1016/j.jenvman.2024.120773 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 357 |j 2024 |b 21 |c 04 |h 120773 | ||