P-NLOS: A Prompt-Based Method for Robust NLOS Imaging
Loading...
Date
2024
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
The field of non-line-of-sight (NLOS) imaging is experiencing rapid advancement, offering the potential to reveal hidden scenes that are otherwise obscured from direct view. Despite this promise, NLOS systems face obstacles in managing a variety of sampling noise, as well as spatial and temporal variations, which limit their practical deployment. This paper introduces a novel strategy to overcome these challenges. It employs prompts to encode latent information, which is then leveraged to dynamically guide the NLOS reconstruction network. The proposed method, P-NLOS, consists of two branches: a reconstruction branch that handles the restoration of sampled information, and a prompting branch that captures the original information. The prompting branch supplies reliable content to the reconstruction branch, thereby enhancing the guidance of the reconstruction process and enhancing the quality of the recovered images. Overall, P-NLOS demonstrates robustness in real-world applications by effectively handling a wide range of corruption types in NLOS reconstruction tasks, including varying noise levels, diverse blur kernels, and temporal resolution variations.
Description
CCS Concepts: Computing methodologies → Computational photography
@inproceedings{10.2312:pg.20241303,
booktitle = {Pacific Graphics Conference Papers and Posters},
editor = {Chen, Renjie and Ritschel, Tobias and Whiting, Emily},
title = {{P-NLOS: A Prompt-Based Method for Robust NLOS Imaging}},
author = {Su, Xiongfei and Zhu, Tianyi and Liu, Lina and Zhang, Yuanlong},
year = {2024},
publisher = {The Eurographics Association},
ISBN = {978-3-03868-250-9},
DOI = {10.2312/pg.20241303}
}