View-Dependent Deformation Fields for 2D Editing of 3D Models

dc.contributor.authorMqirmi, Martin Elen_US
dc.contributor.authorAigerman, Noamen_US
dc.contributor.editorCatalano, Chiara Evaen_US
dc.contributor.editorParakkat, Amal Deven_US
dc.date.accessioned2025-05-09T09:43:14Z
dc.date.available2025-05-09T09:43:14Z
dc.date.issued2025
dc.description.abstractWe propose a method for authoring non-realistic 3D objects (represented as either 3D Gaussian Splats or meshes), that comply with 2D edits from specific viewpoints. Namely, given a 3D object, a user chooses different viewpoints and interactively deforms the object in the 2D image plane of each view. The method then produces a ''deformation field'' - an interpolation between those 2D deformations in a smooth manner as the viewpoint changes. Our core observation is that the 2D deformations do not need to be tied to an underlying object, nor share the same deformation space. We use this observation to devise a method for authoring view-dependent deformations, holding several technical contributions: first, a novel way to compositionality-blend between the 2D deformations after lifting them to 3D - this enables the user to ''stack'' the deformations similarly to layers in an editing software, each deformation operating on the results of the previous; second, a novel method to apply the 3D deformation to 3D Gaussian Splats; third, an approach to author the 2D deformations, by deforming a 2D mesh encapsulating a rendered image of the object. We show the versatility and efficacy of our method by adding cartoonish effects to objects, providing means to modify human characters, fitting 3D models to given 2D sketches and caricatures, resolving occlusions, and recreating classic non-realistic paintings as 3D models.en_US
dc.description.sectionheadersUser Guided Creative Modeling
dc.description.seriesinformationACM/EG Expressive Symposium - WICED: Eurographics Workshop on Intelligent Cinematography and Editing
dc.identifier.doi10.2312/exw.20251056
dc.identifier.isbn978-3-03868-271-4
dc.identifier.pages14 pages
dc.identifier.urihttps://doi.org/10.2312/exw.20251056
dc.identifier.urihttps://diglib.eg.org/handle/10.2312/exw20251056
dc.publisherThe Eurographics Associationen_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectCCS Concepts: Computing methodologies → Shape modeling
dc.subjectComputing methodologies → Shape modeling
dc.titleView-Dependent Deformation Fields for 2D Editing of 3D Modelsen_US
Files
Original bundle
Now showing 1 - 2 of 2
Loading...
Thumbnail Image
Name:
exw20251056.pdf
Size:
41.18 MB
Format:
Adobe Portable Document Format
No Thumbnail Available
Name:
paper1007_mm.mp4
Size:
146.72 MB
Format:
Video MP4