TY - GEN
T1 - Disambiguating Monocular Depth Estimation with a Single Transient
AU - Nishimura, Mark
AU - Lindell, David B.
AU - Metzler, Christopher A.
AU - Wetzstein, Gordon
N1 - KAUST Repository Item: Exported on 2022-07-01
Acknowledgements: D.L. was supported by a Stanford Graduate Fellowship. C.M. was supported by an ORISE Intelligence Community Postdoctoral Fellowship. G.W. was supported by an NSF CAREER Award (IIS 1553333), a Sloan Fellowship, by the KAUST Office of Sponsored Research through the Visual Computing Center CCF grant, and a PECASE by the ARL.
This publication acknowledges KAUST support, but has no KAUST affiliated authors.
PY - 2020/11/12
Y1 - 2020/11/12
N2 - Monocular depth estimation algorithms successfully predict the relative depth order of objects in a scene. However, because of the fundamental scale ambiguity associated with monocular images, these algorithms fail at correctly predicting true metric depth. In this work, we demonstrate how a depth histogram of the scene, which can be readily captured using a single-pixel time-resolved detector, can be fused with the output of existing monocular depth estimation algorithms to resolve the depth ambiguity problem. We validate this novel sensor fusion technique experimentally and in extensive simulation. We show that it significantly improves the performance of several state-of-the-art monocular depth estimation algorithms.
AB - Monocular depth estimation algorithms successfully predict the relative depth order of objects in a scene. However, because of the fundamental scale ambiguity associated with monocular images, these algorithms fail at correctly predicting true metric depth. In this work, we demonstrate how a depth histogram of the scene, which can be readily captured using a single-pixel time-resolved detector, can be fused with the output of existing monocular depth estimation algorithms to resolve the depth ambiguity problem. We validate this novel sensor fusion technique experimentally and in extensive simulation. We show that it significantly improves the performance of several state-of-the-art monocular depth estimation algorithms.
UR - http://hdl.handle.net/10754/679537
UR - https://link.springer.com/10.1007/978-3-030-58589-1_9
UR - http://www.scopus.com/inward/record.url?scp=85097375767&partnerID=8YFLogxK
U2 - 10.1007/978-3-030-58589-1_9
DO - 10.1007/978-3-030-58589-1_9
M3 - Conference contribution
SN - 9783030585884
SP - 139
EP - 155
BT - Computer Vision – ECCV 2020
PB - Springer International Publishing
ER -