Application of 3D Gaussian Splatting for Cinematic Anatomy on Consumer Class Devices

Simple item page
dc.contributor.authorNiedermayr, Simonen_US
dc.contributor.authorNeuhauser, Christophen_US
dc.contributor.authorPetkov, Kaloianen_US
dc.contributor.authorEngel, Klausen_US
dc.contributor.authorWestermann, Rüdigeren_US
dc.contributor.editorLinsen, Larsen_US
dc.contributor.editorThies, Justusen_US
dc.date.accessioned2024-09-09T05:26:37Z
dc.date.available2024-09-09T05:26:37Z
dc.date.issued2024
dc.description.abstractInteractive photorealistic rendering of 3D anatomy is used in medical education to explain the structure of the human body. It is currently restricted to frontal teaching scenarios, where even with a powerful GPU and high-speed access to a large storage device where the data set is hosted, interactive demonstrations can hardly be achieved. We present the use of novel view synthesis via compressed 3D Gaussian Splatting (3DGS) to overcome this restriction, and to even enable students to perform cinematic anatomy on lightweight and mobile devices. Our proposed pipeline first finds a set of camera poses that captures all potentially seen structures in the data. High-quality images are then generated with path tracing and converted into a compact 3DGS representation, consuming < 70 MB even for data sets of multiple GBs. This allows for real-time photorealistic novel view synthesis that recovers structures up to the voxel resolution and is almost indistinguishable from the path-traced images.en_US
dc.description.sectionheadersRendering
dc.description.seriesinformationVision, Modeling, and Visualization
dc.identifier.doi10.2312/vmv.20241195
dc.identifier.isbn978-3-03868-247-9
dc.identifier.pages10 pages
dc.identifier.urihttps://doi.org/10.2312/vmv.20241195
dc.identifier.urihttps://diglib.eg.org/handle/10.2312/vmv20241195
dc.publisherThe Eurographics Associationen_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectCCS Concepts: Computing methodologies->Computer graphics; Rendering
dc.subjectComputing methodologies
dc.subjectComputer graphics
dc.subjectRendering
dc.titleApplication of 3D Gaussian Splatting for Cinematic Anatomy on Consumer Class Devicesen_US
Files
Original bundle
Now showing 1 - 4 of 4
Thumbnail Image
Name:
vmv20241195.pdf
Size:
3.75 MB
Format:
Adobe Portable Document Format
Download
Thumbnail Image
Name:
paper1009_2.pdf
Size:
8.33 MB
Format:
Adobe Portable Document Format
Download
No Thumbnail Available
Name:
paper1009_3.mp4
Size:
39.58 MB
Format:
Video MP4
Download
No Thumbnail Available
Name:
paper1009_4.mp4
Size:
161.93 MB
Format:
Video MP4
Download
Collections
VMV2024