SemanticSplatStylization: Semantic scene stylization based on 3D Gaussian splatting and class-based style transfer
No Thumbnail Available
Date
2024
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
We propose a novel approach for 3D Semantic Style Transfer in 3D Gaussian Splatting (3DGS) that applies style transfer to specific segments of a 3D scene using 2D style images. Our method leverages a finetuning of 3D Gaussian splats and fast 2D class-based style transfer to achieve targeted stylization with superior fidelity and multi-view consistency compared to existing state-of-the- art methods. By incorporating a semantic understanding, our approach ensures precise, context-aware stylization, aligning the visual characteristics of segments with their intended style. The application of 3D Semantic Style Transfer in cultural heritage preservation and restoration holds significant potential. By accurately capturing and transferring styles onto specific segments of cultural heritage objects, our approach demonstrates the potential of providing more accurate and visually appealing stylization results that preserve the integrity and historical significance of cultural heritage artifacts.
Description
CCS Concepts: Computing methodologies → Rasterization; Artificial intelligence; Image manipulation
@inproceedings{10.2312:gch.20241256,
booktitle = {Eurographics Workshop on Graphics and Cultural Heritage},
editor = {Corsini, Massimiliano and Ferdani, Daniele and Kuijper, Arjan and Kutlu, Hasan},
title = {{SemanticSplatStylization: Semantic scene stylization based on 3D Gaussian splatting and class-based style transfer}},
author = {Sinha, Saptarshi Neil and Graf, Holger and Weinmann, Michael},
year = {2024},
publisher = {The Eurographics Association},
ISSN = {2312-6124},
ISBN = {978-3-03868-248-6},
DOI = {10.2312/gch.20241256}
}