Aberration-Aware Depth-From-Focus

Xinge Yang, Qiang Fu, Mohamed Elhoseiny, Wolfgang Heidrich

Research output: Contribution to journalArticlepeer-review


Computer vision methods for depth estimation usually use simple camera models with idealized optics. For modern machine learning approaches, this creates an issue when attempting to train deep networks with simulated data, especially for focus-sensitive tasks like Depth-from-Focus. In this work, we investigate the domain gap caused by off-axis aberrations that will affect the decision of the best-focused frame in a focal stack. We then explore bridging this domain gap through aberration-aware training (AAT). Our approach involves a lightweight network that models lens aberrations at different positions and focus distances, which is then integrated into the conventional network training pipeline. We evaluate the generality of network models on both synthetic and real-world data. The experimental results demonstrate that the proposed AAT scheme can improve depth estimation accuracy without fine-tuning the model for different datasets.
Original languageEnglish (US)
Pages (from-to)1-11
Number of pages11
JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
StatePublished - Aug 4 2023


Dive into the research topics of 'Aberration-Aware Depth-From-Focus'. Together they form a unique fingerprint.

Cite this