Generative Adversarial Shaders for Real-Time Realism Enhancement

dc.contributor.authorSalmi, Arturoen_US
dc.contributor.authorCséfalvay, Szabolcsen_US
dc.contributor.authorImber, Jamesen_US
dc.contributor.editorBikker, Jaccoen_US
dc.contributor.editorGribble, Christiaanen_US
dc.date.accessioned2023-06-25T09:04:15Z
dc.date.available2023-06-25T09:04:15Z
dc.date.issued2023
dc.description.abstractApplication of realism enhancement methods, particularly in real-time and resource-constrained settings, has been frustrated by the expense of existing methods. These achieve high quality results only at the cost of long runtimes and high bandwidth, memory, and power requirements. We present an efficient alternative: a high-performance, generative shader-based approach that adapts machine learning techniques to real-time applications, even in resource-constrained settings such as embedded and mobile GPUs. The proposed learnable shader pipeline comprises differentiable functions that can be trained in an end-toend manner using an adversarial objective, allowing for faithful reproduction of the appearance of a target image set without manual tuning. The shader pipeline is optimized for highly efficient execution on the target device, providing temporally stable, faster-than-real time results with quality competitive with many neural network-based methods.en_US
dc.description.number8
dc.description.sectionheadersDeep Learning for Graphics
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume42
dc.identifier.doi10.1111/cgf.14870
dc.identifier.issn1467-8659
dc.identifier.pages8 pages
dc.identifier.urihttps://doi.org/10.1111/cgf.14870
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf14870
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectCCS Concepts: Computing methodologies -> Computer graphics; Machine learning; Image processing; Rendering; Graphics processors
dc.subjectComputing methodologies
dc.subjectComputer graphics
dc.subjectMachine learning
dc.subjectImage processing
dc.subjectRendering
dc.subjectGraphics processors
dc.titleGenerative Adversarial Shaders for Real-Time Realism Enhancementen_US
Files
Original bundle
Now showing 1 - 2 of 2
Loading...
Thumbnail Image
Name:
v42i8_05_14870.pdf
Size:
80.86 MB
Format:
Adobe Portable Document Format
No Thumbnail Available
Name:
mm1032.mp4
Size:
574.85 MB
Format:
Unknown data format