PhyDeformer: High-Quality Non-Rigid Garment Registration with Physics-Awareness

dc.contributor.authorYu, Boyangen_US
dc.contributor.authorCordier, Fredericen_US
dc.contributor.authorSeo, Hyewonen_US
dc.contributor.editorGuerrero, Paulen_US
dc.contributor.editorPratikakis, Ioannisen_US
dc.contributor.editorVeltkamp, Remcoen_US
dc.date.accessioned2025-08-29T08:12:22Z
dc.date.available2025-08-29T08:12:22Z
dc.date.issued2025
dc.description.abstractAccurately registering 3D garment meshes to real-world image data is a fundamental yet challenging task in computer vision and graphics, with applications in virtual try-on systems, digital fashion, performance capture, and virtual content creation. This problem involves recovering detailed, non-rigid garment geometry from partial, noisy, and often ambiguous visual cues extracted from 2D or reconstructed 3D data. A key challenge lies in aligning garment templates with target shapes while preserving realistic fabric behavior and accommodating variations in body shape, garment fit, and pose. We present PhyDeformer, a new deformation method for high-quality garment mesh registration. It operates in two phases: In the first phase, a garment grading is performed to achieve a coarse 3D alignment between the mesh template and the target mesh, accounting for proportional scaling and fit (e.g. length, size). In the second phase, the graded mesh is refined to capture fine-grained geometric details of the 3D target through a localized optimization process, leveraging a Jacobian-based deformation framework. Both quantitative and qualitative evaluations on synthetic and real garment data demonstrate the effectiveness and robustness of our method in achieving accurate and visually plausible registrations. The code and base meshes generated and evaluated in this paper are available at https://github.com/MLMS-CG/PhyDeformer.en_US
dc.description.sectionheadersShort Papers
dc.description.seriesinformationEurographics Workshop on 3D Object Retrieval
dc.identifier.doi10.2312/3dor.20251200
dc.identifier.isbn978-3-03868-280-6
dc.identifier.issn1997-0471
dc.identifier.pages7 pages
dc.identifier.urihttps://doi.org/10.2312/3dor.20251200
dc.identifier.urihttps://diglib.eg.org/handle/10.2312/3dor20251200
dc.publisherThe Eurographics Associationen_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.titlePhyDeformer: High-Quality Non-Rigid Garment Registration with Physics-Awarenessen_US
Files
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
3dor20251200.pdf
Size:
2.23 MB
Format:
Adobe Portable Document Format