Selecting Texture Resolution Using a Task-specific Visibility Metric

dc.contributor.authorWolski, Krzysztofen_US
dc.contributor.authorGiunchi, Danieleen_US
dc.contributor.authorKinuwaki, Shinichien_US
dc.contributor.authorDidyk, Piotren_US
dc.contributor.authorMyszkowski, Karolen_US
dc.contributor.authorSteed, Anthonyen_US
dc.contributor.authorMantiuk, Rafal K.en_US
dc.contributor.editorLee, Jehee and Theobalt, Christian and Wetzstein, Gordonen_US
dc.date.accessioned2019-10-14T05:10:11Z
dc.date.available2019-10-14T05:10:11Z
dc.date.issued2019
dc.description.abstractIn real-time rendering, the appearance of scenes is greatly affected by the quality and resolution of the textures used for image synthesis. At the same time, the size of textures determines the performance and the memory requirements of rendering. As a result, finding the optimal texture resolution is critical, but also a non-trivial task since the visibility of texture imperfections depends on underlying geometry, illumination, interactions between several texture maps, and viewing positions. Ideally, we would like to automate the task with a visibility metric, which could predict the optimal texture resolution. To maximize the performance of such a metric, it should be trained on a given task. This, however, requires sufficient user data which is often difficult to obtain. To address this problem, we develop a procedure for training an image visibility metric for a specific task while reducing the effort required to collect new data. The procedure involves generating a large dataset using an existing visibility metric followed by refining that dataset with the help of an efficient perceptual experiment. Then, such a refined dataset is used to retune the metric. This way, we augment sparse perceptual data to a large number of per-pixel annotated visibility maps which serve as the training data for application-specific visibility metrics. While our approach is general and can be potentially applied for different image distortions, we demonstrate an application in a game-engine where we optimize the resolution of various textures, such as albedo and normal maps.en_US
dc.description.number7
dc.description.sectionheadersSurface and Texture
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume38
dc.identifier.doi10.1111/cgf.13871
dc.identifier.issn1467-8659
dc.identifier.pages685-696
dc.identifier.urihttps://doi.org/10.1111/cgf.13871
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf13871
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectComputing methodologies
dc.subjectPerception
dc.subjectImage manipulation
dc.subjectImage processing
dc.titleSelecting Texture Resolution Using a Task-specific Visibility Metricen_US
Files
Collections