Passive Non-Line-of-Sight Imaging Using Optimal Transport
Passive non-line-of-sight (NLOS) imaging has drawn great attention in recent years. However, all existing methods are in common limited to simple hidden scenes, low-quality reconstruction, and small-scale datasets. In this paper, we propose NLOS-OT, a novel passive NLOS imaging framework based on manifold embedding and optimal transport, to reconstruct high-quality complicated hidden scenes. NLOS-OT converts the high-dimensional reconstruction task to a low-dimensional manifold mapping through optimal transport, alleviating the ill-posedness in passive NLOS imaging. Besides, we create the first large-scale passive NLOS imaging dataset, NLOS-Passive, which includes 50 groups and more than 3,200,000 images. NLOS-Passive collects target images with different distributions and their corresponding observed projections under various conditions, which can be used to evaluate the performance of passive NLOS imaging algorithms. It is shown that the proposed NLOS-OT framework achieves much better performance than the state-of-the-art methods on NLOS-Passive. We believe that the NLOS-OT framework together with the NLOS-Passive dataset is a big step and can inspire many ideas towards the development of learning-based passive NLOS imaging. Codes and dataset are publicly available (https://github.com/ruixv/NLOS-OT).
Medienart: |
E-Artikel |
---|
Erscheinungsjahr: |
2022 |
---|---|
Erschienen: |
2022 |
Enthalten in: |
Zur Gesamtaufnahme - volume:31 |
---|---|
Enthalten in: |
IEEE transactions on image processing : a publication of the IEEE Signal Processing Society - 31(2022) vom: 22., Seite 110-124 |
Sprache: |
Englisch |
---|
Beteiligte Personen: |
Geng, Ruixu [VerfasserIn] |
---|
Links: |
---|
Themen: |
---|
Anmerkungen: |
Date Revised 01.12.2021 published: Print-Electronic Citation Status PubMed-not-MEDLINE |
---|
doi: |
10.1109/TIP.2021.3128312 |
---|
funding: |
|
---|---|
Förderinstitution / Projekttitel: |
|
PPN (Katalog-ID): |
NLM333451457 |
---|
LEADER | 01000naa a22002652 4500 | ||
---|---|---|---|
001 | NLM333451457 | ||
003 | DE-627 | ||
005 | 20231225221701.0 | ||
007 | cr uuu---uuuuu | ||
008 | 231225s2022 xx |||||o 00| ||eng c | ||
024 | 7 | |a 10.1109/TIP.2021.3128312 |2 doi | |
028 | 5 | 2 | |a pubmed24n1111.xml |
035 | |a (DE-627)NLM333451457 | ||
035 | |a (NLM)34807823 | ||
040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
041 | |a eng | ||
100 | 1 | |a Geng, Ruixu |e verfasserin |4 aut | |
245 | 1 | 0 | |a Passive Non-Line-of-Sight Imaging Using Optimal Transport |
264 | 1 | |c 2022 | |
336 | |a Text |b txt |2 rdacontent | ||
337 | |a ƒaComputermedien |b c |2 rdamedia | ||
338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
500 | |a Date Revised 01.12.2021 | ||
500 | |a published: Print-Electronic | ||
500 | |a Citation Status PubMed-not-MEDLINE | ||
520 | |a Passive non-line-of-sight (NLOS) imaging has drawn great attention in recent years. However, all existing methods are in common limited to simple hidden scenes, low-quality reconstruction, and small-scale datasets. In this paper, we propose NLOS-OT, a novel passive NLOS imaging framework based on manifold embedding and optimal transport, to reconstruct high-quality complicated hidden scenes. NLOS-OT converts the high-dimensional reconstruction task to a low-dimensional manifold mapping through optimal transport, alleviating the ill-posedness in passive NLOS imaging. Besides, we create the first large-scale passive NLOS imaging dataset, NLOS-Passive, which includes 50 groups and more than 3,200,000 images. NLOS-Passive collects target images with different distributions and their corresponding observed projections under various conditions, which can be used to evaluate the performance of passive NLOS imaging algorithms. It is shown that the proposed NLOS-OT framework achieves much better performance than the state-of-the-art methods on NLOS-Passive. We believe that the NLOS-OT framework together with the NLOS-Passive dataset is a big step and can inspire many ideas towards the development of learning-based passive NLOS imaging. Codes and dataset are publicly available (https://github.com/ruixv/NLOS-OT) | ||
650 | 4 | |a Journal Article | |
700 | 1 | |a Hu, Yang |e verfasserin |4 aut | |
700 | 1 | |a Lu, Zhi |e verfasserin |4 aut | |
700 | 1 | |a Yu, Cong |e verfasserin |4 aut | |
700 | 1 | |a Li, Houqiang |e verfasserin |4 aut | |
700 | 1 | |a Zhang, Hengyu |e verfasserin |4 aut | |
700 | 1 | |a Chen, Yan |e verfasserin |4 aut | |
773 | 0 | 8 | |i Enthalten in |t IEEE transactions on image processing : a publication of the IEEE Signal Processing Society |d 1992 |g 31(2022) vom: 22., Seite 110-124 |w (DE-627)NLM09821456X |x 1941-0042 |7 nnns |
773 | 1 | 8 | |g volume:31 |g year:2022 |g day:22 |g pages:110-124 |
856 | 4 | 0 | |u http://dx.doi.org/10.1109/TIP.2021.3128312 |3 Volltext |
912 | |a GBV_USEFLAG_A | ||
912 | |a GBV_NLM | ||
951 | |a AR | ||
952 | |d 31 |j 2022 |b 22 |h 110-124 |