Real-Time Neural Denoising for Volume Rendering Using Dual-Input Feature Fusion Network
Loading...
Date
2025
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association and John Wiley & Sons Ltd.
Abstract
Direct volume rendering (DVR) is a widely used technique in the visualization of volumetric data. As an important DVR technique, volumetric path tracing (VPT) simulates light transport to produce realistic rendering results, which provides enhanced perception and understanding for users, especially in the field of medical imaging. VPT, based on the Monte Carlo (MC) method, typically requires a large number of samples to generate noise-free results. However, in real-time applications, only a limited number of samples per pixel is allowed and significant noise can be created. This paper introduces a novel neural denoising approach that utilizes a new feature fusion method for VPT. Our method uses a feature decomposition technique that separates radiance into components according to noise levels. Our new decomposition technique mitigates biases found in contemporary decoupling denoising algorithms and shows better utilization of samples. A lightweight dual-input network is designed to correlate these components with noise-free ground truth. Additionally, for denoising sequences of video frames, we develop a learning-based temporal method that calculates temporal weight maps, blending reprojected results of previous frames with spatially denoised current frames. Comparative results demonstrate that our network performs faster inference than existing methods and can produce denoised output of higher quality in real time.
Description
@article{10.1111:cgf.70276,
journal = {Computer Graphics Forum},
title = {{Real-Time Neural Denoising for Volume Rendering Using Dual-Input Feature Fusion Network}},
author = {Xu, Chunxiao and Xu, Xinran and Zhang, Jiatian and Liu, Yufei and Cao, Yiheng and Zhao, Lingxiao},
year = {2025},
publisher = {The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {10.1111/cgf.70276}
}