News

• May, 2023: Paper, datasets and code available (see Downloads).
• May, 2023: Paper accepted to ACM Transactions on Graphics (SIGGRAPH 2023)
• May, 2023: Web launched

Downloads

• Paper (Authors' version)
• Experiment data
• Code (camera models used in the paper)
• Code (simulation of captured data)

Abstract

Non-line-of-sight (NLOS) imaging methods are capable of reconstructing complex scenes that are not visible to an observer using indirect illumination. However, they assume only third-bounce illumination, so they are currently limited to single-corner configurations, and present limited visibility when imaging surfaces at certain orientations. To reason about and tackle these limitations, we make the key observation that planar diffuse surfaces behave specularly at wavelengths used in the computational wave-based NLOS imaging domain. We call such surfaces virtual mirrors. We leverage this observation to expand the capabilities of NLOS imaging using illumination beyond the third bounce, addressing two problems: imaging single-corner objects at limited visibility angles, and imaging objects hidden behind two corners. To image objects at limited visibility angles, we first analyze the reflections of the known illuminated point on surfaces of the scene as an estimator of the position and orientation of objects with limited visibility. We then image those limited visibility objects by computationally building secondary apertures at other surfaces that observe the target object from a direct visibility perspective. Beyond single-corner NLOS imaging, we exploit the specular behavior of virtual mirrors to image objects hidden behind a second corner by imaging the space behind such virtual mirrors, where the mirror image of objects hidden around two corners is formed. No specular surfaces were involved in the making of this paper.

Bibtex

Related Work

• 2022: Non-Line-of-Sight Transient Rendering
@article{royo2022non, title = {Non-line-of-sight transient rendering}, author = {Royo, Diego and Garc{\'\i}a, Jorge and Mu{\~n}oz, Adolfo and Jarabo, Adrian}, journal = {Computers \& Graphics}, volume = {107}, pages = {84--92}, year = {2022}, publisher = {Elsevier} }
• 2021: Virtual Light Transport Matrices for Non-Line-Of-Sight Imaging
@inproceedings{marco2021NLOSvLTM, author = {Marco, Julio and Jarabo, Adrian and Nam, Ji Hyun and Liu, Xiaochun and Cosculluela, Miguel Angel and Velten, Andreas and Gutierrez, Diego}, title = {Virtual Light Transport Matrices for Non-Line-of-Sight Imaging}, booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)}, month = {October}, year = {2021}, pages = {2440-2449} }
• 2019: Non-Line-of-Sight Imaging using Phasor Field Virtual Wave Optics
@article{liu2019non, title = {Non-line-of-sight imaging using phasor-field virtual wave optics}, author = {Liu, Xiaochun and Guill{\'e}n, Ib{\'o}n and La Manna, Marco and Nam, Ji Hyun and Reza, Syed Azer and Le, Toan Huu and Jarabo, Adrian and Gutierrez, Diego and Velten, Andreas}, journal = {Nature}, volume = {572}, number = {7771}, pages = {620--623}, year = {2019}, publisher = {Nature Publishing Group} }

Acknowledgements

We want to thank the anonymous reviewers for their time and insightful comments, and the members of the Graphics and Imaging Lab for their help with the manuscript. Our work was funded by the European Union's European Defense Fund Program through the ENLIGHTEN project under grant agreement No. 101103242, by the Gobierno de Aragón (Departamento de Ciencia, Universidad y Sociedad del Conocimiento) through project BLINDSIGHT (ref. LMP30_21), by MCIN/AEI/10.13039/501100011033 through Project PID2019-105004GB-I00, by the Air Force Office for Scientific Research (FA9550-21-1-0341), and by the National Science Foundation (1846884). Additionally, Diego Royo was supported by a Gobierno de Aragón predoctoral grant.