A Review of Depth and Normal Fusion Algorithms

Geometric surface information such as depth maps and surface normals can be acquired by various methods such as stereo light fields, shape from shading and photometric stereo techniques. We compare several algorithms which deal with the combination of depth with surface normal information in order to reconstruct a refined depth map. The reasons for performance differences are examined from the perspective of alternative formulations of surface normals for depth reconstruction. We review and analyze methods in a systematic way. Based on our findings, we introduce a new generalized fusion method, which is formulated as a least squares problem and outperforms previous methods in the depth error domain by introducing a novel normal weighting that performs closer to the geodesic distance measure. Furthermore, a novel method is introduced based on Total Generalized Variation (TGV) which further outperforms previous approaches in terms of the geodesic normal distance error and maintains comparable quality in the depth error domain.

Medienart:

E-Artikel

Erscheinungsjahr:

2018

Erschienen:

2018

Enthalten in:

Zur Gesamtaufnahme - volume:18

Enthalten in:

Sensors (Basel, Switzerland) - 18(2018), 2 vom: 01. Feb.

Sprache:

Englisch

Beteiligte Personen:

Antensteiner, Doris [VerfasserIn]
Štolc, Svorad [VerfasserIn]
Pock, Thomas [VerfasserIn]

Links:

Volltext

Themen:

Computational imaging
Depth reconstruction
Journal Article
Least squares
Optimization
Primal-dual algorithm
Surface normals
Total Generalized Variation

Anmerkungen:

Date Completed 22.02.2018

Date Revised 13.11.2018

published: Electronic

Citation Status PubMed-not-MEDLINE

doi:

10.3390/s18020431

funding:

Förderinstitution / Projekttitel:

PPN (Katalog-ID):

NLM280498721