Neural Fields in Visual Computing and Beyond

Simple item page
dc.contributor.authorXie, Yihengen_US
dc.contributor.authorTakikawa, Towakien_US
dc.contributor.authorSaito, Shunsukeen_US
dc.contributor.authorLitany, Oren_US
dc.contributor.authorYan, Shiqinen_US
dc.contributor.authorKhan, Numairen_US
dc.contributor.authorTombari, Federicoen_US
dc.contributor.authorTompkin, Jamesen_US
dc.contributor.authorSitzmann, Vincenten_US
dc.contributor.authorSridhar, Srinathen_US
dc.contributor.editorMeneveaux, Danielen_US
dc.contributor.editorPatanè, Giuseppeen_US
dc.date.accessioned2022-04-22T07:00:32Z
dc.date.available2022-04-22T07:00:32Z
dc.date.issued2022
dc.description.abstractRecent advances in machine learning have led to increased interest in solving visual computing problems using methods that employ coordinate-based neural networks. These methods, which we call neural fields, parameterize physical properties of scenes or objects across space and time. They have seen widespread success in problems such as 3D shape and image synthesis, animation of human bodies, 3D reconstruction, and pose estimation. Rapid progress has led to numerous papers, but a consolidation of the discovered knowledge has not yet emerged. We provide context, mathematical grounding, and a review of over 250 papers in the literature on neural fields. In Part I, we focus on neural field techniques by identifying common components of neural field methods, including different conditioning, representation, forward map, architecture, and manipulation methods. In Part II, we focus on applications of neural fields to different problems in visual computing, and beyond (e.g., robotics, audio). Our review shows the breadth of topics already covered in visual computing, both historically and in current incarnations, and highlights the improved quality, flexibility, and capability brought by neural field methods. Finally, we present a companion website that acts as a living database that can be continually updated by the community.en_US
dc.description.documenttypestar
dc.description.number2
dc.description.sectionheadersState of the Art Reports
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume41
dc.identifier.doi10.1111/cgf.14505
dc.identifier.issn1467-8659
dc.identifier.pages641-676
dc.identifier.pages36 pages
dc.identifier.urihttps://doi.org/10.1111/cgf.14505
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf14505
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectCCS Concepts: Computing methodologies --> Machine Learning; Artificial Intelligence
dc.subjectComputing methodologies
dc.subjectMachine Learning
dc.subjectArtificial Intelligence
dc.titleNeural Fields in Visual Computing and Beyonden_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
v41i2pp641-676.pdf
Size:
15.31 MB
Format:
Adobe Portable Document Format
Download
Collections
EG 2022 - STARs (CGF 41-2)