Dense 3D Gaussian Splatting Initialization for Sparse Image Data
Loading...
Date
2024
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
This paper presents advancements in novel-view synthesis with 3D Gaussian Splatting (3DGS) using a dense and accurate SfM point cloud initialization approach. We address the challenge of achieving photorealistic renderings from sparse image data, where basic 3DGS training may result in suboptimal convergence, thus leading to visual artifacts. The proposed method enhances precision and density of initially reconstructed point clouds by refining 3D positions and extrapolating additional points, even for difficult image regions, e.g. with repeating patterns and suboptimal visual coverage. Our contributions focus on improving ''Dense Feature Matching for Structure-from-Motion'' (DFM4SfM) based on a homographic decomposition of the image space to support 3DGS training: First, a grid-based feature detection method is introduced for DFM4SfM to ensure a welldistributed 3D Gaussian initialization uniformly over all depth planes. Second, the SfM feature matching is complemented by a geometric plausibility check, priming the homography estimation and thereby improving the initial placement of 3D Gaussians. Experimental results on the NeRF-LLFF dataset demonstrate that this approach achieves superior qualitative and quantitative results, even for fewer views, and the potential for a significantly accelerated 3DGS training with faster convergence.
Description
CCS Concepts: Computing methodologies → Reconstruction; Point-based models; Rendering
@inproceedings{10.2312:egp.20241038,
booktitle = {Eurographics 2024 - Posters},
editor = {Liu, Lingjie and Averkiou, Melinos},
title = {{Dense 3D Gaussian Splatting Initialization for Sparse Image Data}},
author = {Seibt, Simon and Chang, Thomas Vincent Siu-Lung and von Rymon Lipinski, Bartosz and Latoschik, Marc Erich},
year = {2024},
publisher = {The Eurographics Association},
ISSN = {1017-4656},
ISBN = {978-3-03868-239-4},
DOI = {10.2312/egp.20241038}
}