37-Issue 2

Permanent URI for this collection

https://diglib.eg.org/handle/10.2312/2632120

Browse

Now showing 1 - 20 of 45

Approximate Program Smoothing Using Mean-Variance Statistics, with Application to Procedural Shader Bandlimiting
(The Eurographics Association and John Wiley & Sons Ltd., 2018) Yang, Yuting; Barnes, Connelly; Gutierrez, Diego and Sheffer, Alla
We introduce a general method to approximate the convolution of a program with a Gaussian kernel. This results in the program being smoothed. Our compiler framework models intermediate values in the program as random variables, by using mean and variance statistics. We decompose the input program into atomic parts and relate the statistics of the different parts of the smoothed program. We give several approximate smoothing rules that can be used for the parts of the program. These include an improved variant of Dorn et al. [DBLW15], a novel adaptive Gaussian approximation, Monte Carlo sampling, and compactly supported kernels. Our adaptive Gaussian approximation handles multivariate Gaussian distributed inputs, gives exact results for a larger class of programs than previous work, and is accurate to the second order in the standard deviation of the kernel for programs with certain analytic properties. Because each expression in the program can have multiple approximation choices, we use a genetic search to automatically select the best approximations. We apply this framework to the problem of automatically bandlimiting procedural shader programs. We evaluate our method on a variety of geometries and complex shaders, including shaders with parallax mapping, animation, and spatially varying statistics. The resulting smoothed shader programs outperform previous approaches both numerically and aesthetically.
Aura Mesh: Motion Retargeting to Preserve the Spatial Relationships between Skinned Characters
(The Eurographics Association and John Wiley & Sons Ltd., 2018) Jin, Taeil; Kim, Meekyoung; Lee, Sung-Hee; Gutierrez, Diego and Sheffer, Alla
Applying motion-capture data to multi-person interaction between virtual characters is challenging because one needs to preserve the interaction semantics while also satisfying the general requirements of motion retargeting, such as preventing penetration and preserving naturalness. An efficient means of representing interaction semantics is by defining the spatial relationships between the body parts of characters. However, existing methods consider only the character skeleton and thus are not suitable for capturing skin-level spatial relationships. This paper proposes a novel method for retargeting interaction motions with respect to character skins. Specifically, we introduce the aura mesh, which is a volumetric mesh that surrounds a character's skin. The spatial relationships between two characters are computed from the overlap of the skin mesh of one character and the aura mesh of the other, and then the interaction motion retargeting is achieved by preserving the spatial relationships as much as possible while satisfying other constraints. We show the effectiveness of our method through a number of experiments.
Controllable Dendritic Crystal Simulation Using Orientation Field
(The Eurographics Association and John Wiley & Sons Ltd., 2018) Ren, Bo; Huang, Jiahui; Lin, Ming C.; Hu, Shi-Min; Gutierrez, Diego and Sheffer, Alla
Real world dendritic growths show charming structures by their exquisite balance between the symmetry and randomness in the crystal formation. Other than the variety in the natural crystals, richer visual appearance of crystals can benefit from artificially controlling of the crystal growth on its growing directions and shapes. In this paper, by introducing one extra dimension of freedom, i.e. the orientation field, into the simulation, we propose an efficient algorithm for dendritic crystal simulation that is able to reproduce arbitrary symmetry patterns with different levels of asymmetry breaking effect on general grids or meshes, including spreading on curved surfaces and growth in 3D. Flexible artistic control is also enabled in a unified manner by exploiting and guiding the orientation field in the visual simulation. We show the effectiveness of our approach by various demonstrations of simulation results.
Deep Joint Design of Color Filter Arrays and Demosaicing
(The Eurographics Association and John Wiley & Sons Ltd., 2018) Henz, Bernardo; Gastal, Eduardo S. L.; Oliveira, Manuel M.; Gutierrez, Diego and Sheffer, Alla
We present a convolutional neural network architecture for performing joint design of color filter array (CFA) patterns and demosaicing. Our generic model allows the training of CFAs of arbitrary sizes, optimizing each color filter over the entire RGB color space. The patterns and algorithms produced by our method provide high-quality color reconstructions. We demonstrate the effectiveness of our approach by showing that its results achieve higher PSNR than the ones obtained with state-of-the-art techniques on all standard demosaicing datasets, both for noise-free and noisy scenarios. Our method can also be used to obtain demosaicing strategies for pre-defined CFAs, such as the Bayer pattern, for which our results also surpass even the demosaicing algorithms specifically designed for such a pattern.
Efficient BVH-based Collision Detection Scheme with Ordering and Restructuring
(The Eurographics Association and John Wiley & Sons Ltd., 2018) Wang, Xinlei; Tang, Min; Manocha, Dinesh; Tong, Ruofeng; Gutierrez, Diego and Sheffer, Alla
Bounding volume hierarchy (BVH) has been widely adopted as the acceleration structure in broad-phase collision detection. Previous state-of-the-art BVH-based collision detection approaches exploited the spatio-temporal coherence of simulations by maintaining a bounding volume test tree (BVTT) front. A major drawback of these algorithms is that large deformations in the scenes decrease culling efficiency and slow down collision queries. Moreover, for front-based methods, the inefficient caching on GPU caused by the arbitrary layout of BVH and BVTT front nodes becomes a critical performance issue. We present a fast and robust BVH-based collision detection scheme on GPU that addresses the above problems by ordering and restructuring BVHs and BVTT fronts. Our techniques are based on the use of histogram sort and an auxiliary structure BVTT front log, through which we analyze the dynamic status of BVTT front and BVH quality. Our approach efficiently handles inter- and intra-object collisions and performs especially well in simulations where there is considerable spatio-temporal coherence. The benchmark results demonstrate that our approach is significantly faster than the previous BVH-based method, and also outperforms other state-of-the-art spatial subdivision schemes in terms of speed.
EUROGRAPHICS 2018: CGF 37-2 Frontmatter
(The Eurographics Association and John Wiley & Sons Ltd., 2018) Gutierrez, Diego; Sheffer, Alla; Gutierrez, Diego; Sheffer, Alla
-
Example-based Authoring of Procedural Modeling Programs with Structural and Continuous Variability
(The Eurographics Association and John Wiley & Sons Ltd., 2018) Ritchie, Daniel; Jobalia, Sarah; Thomas, Anna; Gutierrez, Diego and Sheffer, Alla
Procedural models are a powerful tool for quickly creating a variety of computer graphics content. However, authoring them is challenging, requiring both programming and artistic expertise. In this paper, we present a method for learning procedural models from a small number of example objects. We focus on the modular design setting, where objects are constructed from a common library of parts. Our procedural representation is a probabilistic program that models both the discrete, hierarchical structure of the examples as well as the continuous variability in their spatial arrangements of parts. We develop an algorithm for learning such programs from examples, using combinatorial search over program structures and variational inference to estimate continuous program parameters. We evaluate our method by demonstrating its ability to learn programs from examples of ornamental designs, spaceships, space stations, and castles. Experiments suggest that our learned programs can reliably generate a variety of new objects that are perceptually indistinguishable from hand-crafted examples.
ExpandNet: A Deep Convolutional Neural Network for High Dynamic Range Expansion from Low Dynamic Range Content
(The Eurographics Association and John Wiley & Sons Ltd., 2018) Marnerides, Demetris; Bashford-Rogers, Thomas; Hatchett, Jon; Debattista, Kurt; Gutierrez, Diego and Sheffer, Alla
High dynamic range (HDR) imaging provides the capability of handling real world lighting as opposed to the traditional low dynamic range (LDR) which struggles to accurately represent images with higher dynamic range. However, most imaging content is still available only in LDR. This paper presents a method for generating HDR content from LDR content based on deep Convolutional Neural Networks (CNNs) termed ExpandNet. ExpandNet accepts LDR images as input and generates images with an expanded range in an end-to-end fashion. The model attempts to reconstruct missing information that was lost from the original signal due to quantization, clipping, tone mapping or gamma correction. The added information is reconstructed from learned features, as the network is trained in a supervised fashion using a dataset of HDR images. The approach is fully automatic and data driven; it does not require any heuristics or human expertise. ExpandNet uses a multiscale architecture which avoids the use of upsampling layers to improve image quality. The method performs well compared to expansion/inverse tone mapping operators quantitatively on multiple metrics, even for badly exposed inputs.
Extended Narrow Band FLIP for Liquid Simulations
(The Eurographics Association and John Wiley & Sons Ltd., 2018) Sato, Takahiro; Wojtan, Chris; Thuerey, Nils; Igarashi, Takeo; Ando, Ryoichi; Gutierrez, Diego and Sheffer, Alla
The Fluid Implicit Particle method (FLIP) reduces numerical dissipation by combining particles with grids. To improve performance, the subsequent narrow band FLIP method (NB-FLIP) uses a FLIP-based fluid simulation only near the liquid surface and a traditional grid-based fluid simulation away from the surface. This spatially-limited FLIP simulation significantly reduces the number of particles and alleviates a computational bottleneck. In this paper, we extend the NB-FLIP idea even further, by allowing a simulation to transition between a FLIP-like fluid simulation and a grid-based simulation in arbitrary locations, not just near the surface. This approach leads to even more savings in memory and computation, because we can concentrate the particles only in areas where they are needed. More importantly, this new method allows us to seamlessly transition to smooth implicit surface geometry wherever the particle-based simulation is unnecessary. Consequently, our method leads to a practical algorithm for avoiding the noisy surface artifacts associated with particle-based liquid simulations, while simultaneously maintaining the benefits of a FLIP simulation in regions of dynamic motion.
Fast Catmull-Rom Spline Interpolation for High-Quality Texture Sampling
(The Eurographics Association and John Wiley & Sons Ltd., 2018) Csébfalvi, Balázs; Gutierrez, Diego and Sheffer, Alla
It is well known that cubic texture filtering can be efficiently implemented on the GPU by using a method published by Sigg and Hadwiger [SH05], which simplifies the evaluation to a linear combination of linear texture fetches. However, their method cannot be directly applied if the filter kernel takes also negative values like the popular Catmull-Rom spline, for example. In this paper, we propose a modified algorithm that is able to handle also the negative weights. Therefore, using our method, the Catmull-Rom spline interpolation can also be evaluated in one, two, and three dimensions by taking two, four, and eight linear texture fetches, respectively.
Fast Fluid Simulations with Sparse Volumes on the GPU
(The Eurographics Association and John Wiley & Sons Ltd., 2018) Wu, Kui; Truong, Nghia; Yuksel, Cem; Hoetzlein, Rama; Gutierrez, Diego and Sheffer, Alla
We introduce efficient, large scale fluid simulation on GPU hardware using the fluid-implicit particle (FLIP) method over a sparse hierarchy of grids represented in NVIDIA R GVDB Voxels. Our approach handles tens of millions of particles within a virtually unbounded simulation domain. We describe novel techniques for parallel sparse grid hierarchy construction and fast incremental updates on the GPU for moving particles. In addition, our FLIP technique introduces sparse, work efficient parallel data gathering from particle to voxel, and a matrix-free GPU-based conjugate gradient solver optimized for sparse grids. Our results show that our method can achieve up to an order of magnitude faster simulations on the GPU as compared to FLIP simulations running on the CPU.
Fast Penetration Volume for Rigid Bodies
(The Eurographics Association and John Wiley & Sons Ltd., 2018) Nirel, Dan; Lischinski, Dani; Gutierrez, Diego and Sheffer, Alla
Handling collisions among a large number of bodies can be a performance bottleneck in video games and many other real-time applications. We present a new framework for detecting and resolving collisions using the penetration volume as an interpenetration measure. Given two non-convex polyhedral bodies, a new sampling paradigm locates their near-contact configurations in advance, and stores associated contact information in a compact database. At runtime, we retrieve a given configuration's nearest neighbors. By taking advantage of the penetration volume's continuity, cheap geometric methods can use the neighbors to estimate contact information as well as a translational gradient. This results in an extremely fast, geometry-independent, and trivially parallelizable computation, which constitutes the first global volume-based collision resolution. When processing multiple collisions simultaneously on a 4-core processor, the average running cost is as low as 5 μs. Furthermore, no additional proximity or contact-regions queries are required. These results are orders of magnitude faster than previous penetration volume approaches.
Feature Curve Co-Completion in Noisy Data
(The Eurographics Association and John Wiley & Sons Ltd., 2018) Gehre, Anne; Lim, Isaak; Kobbelt, Leif; Gutierrez, Diego and Sheffer, Alla
Feature curves on 3D shapes provide important hints about significant parts of the geometry and reveal their underlying structure. However, when we process real world data, automatically detected feature curves are affected by measurement uncertainty, missing data, and sampling resolution, leading to noisy, fragmented, and incomplete feature curve networks. These artifacts make further processing unreliable. In this paper we analyze the global co-occurrence information in noisy feature curve networks to fill in missing data and suppress weakly supported feature curves. For this we propose an unsupervised approach to find meaningful structure within the incomplete data by detecting multiple occurrences of feature curve configurations (cooccurrence analysis). We cluster and merge these into feature curve templates, which we leverage to identify strongly supported feature curve segments as well as to complete missing data in the feature curve network. In the presence of significant noise, previous approaches had to resort to user input, while our method performs fully automatic feature curve co-completion. Finding feature reoccurrences however, is challenging since naïve feature curve comparison fails in this setting due to fragmentation and partial overlaps of curve segments. To tackle this problem we propose a robust method for partial curve matching. This provides us with the means to apply symmetry detection methods to identify co-occurring configurations. Finally, Bayesian model selection enables us to detect and group re-occurrences that describe the data well and with low redundancy.
Flexible Live-Wire: Image Segmentation with Floating Anchors
(The Eurographics Association and John Wiley & Sons Ltd., 2018) Summa, Brian; Faraj, Noura; Licorish, Cody; Pascucci, Valerio; Gutierrez, Diego and Sheffer, Alla
We introduce Flexible Live-Wire, a generalization of the Live-Wire interactive segmentation technique with floating anchors. In our approach, the user input for Live-Wire is no longer limited to the setting of pixel-level anchor nodes, but can use more general anchor sets. These sets can be of any dimension, size, or connectedness. The generality of the approach allows the design of a number of user interactions while providing the same functionality as the traditional Live-Wire. In particular, we experiment with this new flexibility by designing four novel Live-Wire interactions based on specific primitives: paint, pinch, probable, and pick anchors. These interactions are only a subset of the possibilities enabled by our generalization. Moreover, we discuss the computational aspects of this approach and provide practical solutions to alleviate any additional overhead. Finally, we illustrate our approach and new interactions through several example segmentations.
From Faces to Outdoor Light Probes
(The Eurographics Association and John Wiley & Sons Ltd., 2018) Calian, Dan A.; Lalonde, Jean-François; Gotardo, Paulo; Simon, Tomas; Matthews, Iain; Mitchell, Kenny; Gutierrez, Diego and Sheffer, Alla
Image-based lighting has allowed the creation of photo-realistic computer-generated content. However, it requires the accurate capture of the illumination conditions, a task neither easy nor intuitive, especially to the average digital photography enthusiast. This paper presents an approach to directly estimate an HDR light probe from a single LDR photograph, shot outdoors with a consumer camera, without specialized calibration targets or equipment. Our insight is to use a person's face as an outdoor light probe. To estimate HDR light probes from LDR faces we use an inverse rendering approach which employs data-driven priors to guide the estimation of realistic, HDR lighting. We build compact, realistic representations of outdoor lighting both parametrically and in a data-driven way, by training a deep convolutional autoencoder on a large dataset of HDR sky environment maps. Our approach can recover high-frequency, extremely high dynamic range lighting environments. For quantitative evaluation of lighting estimation accuracy and relighting accuracy, we also contribute a new database of face photographs with corresponding HDR light probes. We show that relighting objects with HDR light probes estimated by our method yields realistic results in a wide variety of settings.
GazeDirector: Fully Articulated Eye Gaze Redirection in Video
(The Eurographics Association and John Wiley & Sons Ltd., 2018) Wood, Erroll; Baltrušaitis, Tadas; Morency, Louis-Philippe; Robinson, Peter; Bulling, Andreas; Gutierrez, Diego and Sheffer, Alla
We present GazeDirector, a new approach for eye gaze redirection that uses model-fitting. Our method first tracks the eyes by fitting a multi-part eye region model to video frames using analysis-by-synthesis, thereby recovering eye region shape, texture, pose, and gaze simultaneously. It then redirects gaze by 1) warping the eyelids from the original image using a model-derived flow field, and 2) rendering and compositing synthesized 3D eyeballs onto the output image in a photorealistic manner. GazeDirector allows us to change where people are looking without person-specific training data, and with full articulation, i.e. we can precisely specify new gaze directions in 3D. Quantitatively, we evaluate both model-fitting and gaze synthesis, with experiments for gaze estimation and redirection on the Columbia gaze dataset. Qualitatively, we compare GazeDirector against recent work on gaze redirection, showing better results especially for large redirection angles. Finally, we demonstrate gaze redirection on YouTube videos by introducing new 3D gaze targets and by manipulating visual behavior.
Hair Modeling and Simulation by Style
(The Eurographics Association and John Wiley & Sons Ltd., 2018) Jung, Seunghwan; Lee, Sung-Hee; Gutierrez, Diego and Sheffer, Alla
As the deformation behaviors of hair strands vary greatly depending on the hairstyle, the computational cost and accuracy of hair movement simulations can be significantly improved by applying simulation methods specific to a certain style. This paper makes two contributions with regard to the simulation of various hair styles. First, we propose a novel method to reconstruct simulatable hair strands from hair meshes created by artists. Manually created hair meshes consist of numerous mesh patches, and the strand reconstruction process is challenged by the absence of connectivity information among the patches for the same strand and the omission of hidden parts of strands due to the manual creation process. To this end, we develop a two-stage spectral clustering method for estimating the degree of connectivity among patches and a strand-growing method that preserves hairstyles. Next, we develop a hairstyle classification method for style-specific simulations. In particular, we propose a set of features for efficient classifications and show that classifiers trained with the proposed features have higher accuracy than those trained with naive features. Our method applies efficient simulation methods according to the hairstyle without specific user input, and thus is favorable for real-time simulation.
Improved Functional Mappings via Product Preservation
(The Eurographics Association and John Wiley & Sons Ltd., 2018) Nogneng, Dorian; Melzi, Simone; Rodolà, Emanuele; Castellani, Umberto; Bronstein, Michael; Ovsjanikov, Maks; Gutierrez, Diego and Sheffer, Alla
In this paper, we consider the problem of information transfer across shapes and propose an extension to the widely used functional map representation. Our main observation is that in addition to the vector space structure of the functional spaces, which has been heavily exploited in the functional map framework, the functional algebra (i.e., the ability to take pointwise products of functions) can significantly extend the power of this framework. Equipped with this observation, we show how to improve one of the key applications of functional maps, namely transferring real-valued functions without conversion to point-to-point correspondences. We demonstrate through extensive experiments that by decomposing a given function into a linear combination consisting not only of basis functions but also of their pointwise products, both the representation power and the quality of the function transfer can be improved significantly. Our modification, while computationally simple, allows us to achieve higher transfer accuracy while keeping the size of the basis and the functional map fixed. We also analyze the computational complexity of optimally representing functions through linear combinations of products in a given basis and prove NP-completeness in some general cases. Finally, we argue that the use of function products can have a wide-reaching effect in extending the power of functional maps in a variety of applications, in particular by enabling the transfer of highfrequency functions without changing the representation size or complexity.
Interactive Generation of Time-evolving, Snow-Covered Landscapes with Avalanches
(The Eurographics Association and John Wiley & Sons Ltd., 2018) Cordonnier, Guillaume; Ecormier, Pierre; Galin, Eric; Gain, James; Benes, Bedrich; Cani, Marie-Paule; Gutierrez, Diego and Sheffer, Alla
We introduce a novel method for interactive generation of visually consistent, snow-covered landscapes and provide control of their dynamic evolution over time. Our main contribution is the real-time phenomenological simulation of avalanches and other user-guided events, such as tracks left by Nordic skiing, which can be applied to interactively sculpt the landscape. The terrain is modeled as a height field with additional layers for stable, compacted, unstable, and powdery snow, which behave in combination as a semi-viscous fluid. We incorporate the impact of several phenomena, including sunlight, temperature, prevailing wind direction, and skiing activities. The snow evolution includes snow-melt and snow-drift, which a ect stability of the snow mass and the probability of avalanches. A user can shape landscapes and their evolution either with a variety of interactive brushes, or by prescribing events along a winter season time-line. Our optimized GPU-implementation allows interactive updates of snow type and depth across a large (10 10km) terrain, including real-time avalanches, making this suitable for visual assets in computer games. We evaluate our method through perceptual comparison against exiting methods and real snow-depth data.
MIQP-based Layout Design for Building Interiors
(The Eurographics Association and John Wiley & Sons Ltd., 2018) Wu, Wenming; Fan, Lubin; Liu, Ligang; Wonka, Peter; Gutierrez, Diego and Sheffer, Alla
We propose a hierarchical framework for the generation of building interiors. Our solution is based on a mixed integer quadratic programming (MIQP) formulation. We parametrize a layout by polygons that are further decomposed into small rectangles. We identify important high-level constraints, such as room size, room position, room adjacency, and the outline of the building, and formulate them in a way that is compatible with MIQP and the problem parametrization. We also propose a hierarchical framework to improve the scalability of the approach. We demonstrate that our algorithm can be used for residential building layouts and can be scaled up to large layouts such as office buildings, shopping malls, and supermarkets. We show that our method is faster by multiple orders of magnitude than previous methods.

Browse

Browsing 37-Issue 2 by Title

Results Per Page

Sort Options