Render2MPEG: A Perception-based Framework Towards Integrating Rendering and Video Compression

Simple item page
dc.contributor.authorHerzog, Roberten_US
dc.contributor.authorKinuwaki, Shinichien_US
dc.contributor.authorMyszkowski, Karolen_US
dc.contributor.authorSeidel, Hans-Peteren_US
dc.date.accessioned2015-02-21T16:18:26Z
dc.date.available2015-02-21T16:18:26Z
dc.date.issued2008en_US
dc.description.abstractCurrently 3D animation rendering and video compression are completely independent processes even if rendered frames are streamed on-the-fly within a client-server platform. In such scenario, which may involve time-varying transmission bandwidths and different display characteristics at the client side, dynamic adjustment of the rendering quality to such requirements can lead to a better use of server resources. In this work, we present a framework where the renderer and MPEG codec are coupled through a straightforward interface that provides precise motion vectors from the rendering side to the codec and perceptual error thresholds for each pixel in the opposite direction. The perceptual error thresholds take into account bandwidth-dependent quantization errors resulting from the lossy com-pression as well as image content-dependent luminance and spatial contrast masking. The availability of the discrete cosine transform (DCT) coefficients at the codec side enables to use advanced models of the human visual system (HVS) in the perceptual error threshold derivation without incurring any significant cost. Those error thresholds are then used to control the rendering quality and make it well aligned with the compressed stream quality. In our prototype system we use the lightcuts technique developed by Walter et al., which we enhance to handle dynamic image sequences, and an MPEG-2 implementation. Our results clearly demonstrate many advantages of coupling the rendering with video compression in terms of faster rendering. Furthermore, temporally coherent rendering leads to a reduction of temporal artifacts.en_US
dc.description.number2en_US
dc.description.seriesinformationComputer Graphics Forumen_US
dc.description.volume27en_US
dc.identifier.doi10.1111/j.1467-8659.2008.01115.xen_US
dc.identifier.issn1467-8659en_US
dc.identifier.pages183-192en_US
dc.identifier.urihttps://doi.org/10.1111/j.1467-8659.2008.01115.xen_US
dc.publisherThe Eurographics Association and Blackwell Publishing Ltden_US
dc.titleRender2MPEG: A Perception-based Framework Towards Integrating Rendering and Video Compressionen_US
Files
Collections
27-Issue 2
Full Papers 2008 - CGF 27-Issue 2