43 results
Search Results
Now showing 1 - 10 of 43
Item Semantic Reconstruction: Reconstruction of Semantically Segmented 3D Meshes via Volumetric Semantic Fusion(The Eurographics Association and John Wiley & Sons Ltd., 2018) Jeon, Junho; Jung, Jinwoong; Kim, Jungeon; Lee, Seungyong; Fu, Hongbo and Ghosh, Abhijeet and Kopf, JohannesSemantic segmentation partitions a given image or 3D model of a scene into semantically meaning parts and assigns predetermined labels to the parts. With well-established datasets, deep networks have been successfully used for semantic segmentation of RGB and RGB-D images. On the other hand, due to the lack of annotated large-scale 3D datasets, semantic segmentation for 3D scenes has not yet been much addressed with deep learning. In this paper, we present a novel framework for generating semantically segmented triangular meshes of reconstructed 3D indoor scenes using volumetric semantic fusion in the reconstruction process. Our method integrates the results of CNN-based 2D semantic segmentation that is applied to the RGB-D stream used for dense surface reconstruction. To reduce the artifacts from noise and uncertainty of single-view semantic segmentation, we introduce adaptive integration for the volumetric semantic fusion and CRF-based semantic label regularization. With these methods, our framework can easily generate a high-quality triangular mesh of the reconstructed 3D scene with dense (i.e., per-vertex) semantic labels. Extensive experiments demonstrate that our semantic segmentation results of 3D scenes achieves the state-of-the-art performance compared to the previous voxel-based and point cloud-based methods.Item A Practical Approach to Physically-Based Reproduction of Diffusive Cosmetics(The Eurographics Association and John Wiley & Sons Ltd., 2018) Kim, Goanghun; Ko, Hyeong-Seok; Fu, Hongbo and Ghosh, Abhijeet and Kopf, JohannesIn this paper, we introduce so-called the bSX method as a new way to utilize the Kubelka-Munk (K-M) model. Assuming the material is completely diffusive, the K-M model gives the reflectance and transmittance of the material from the observation of the material applied on a backing, where the observation includes the thickness of the material application. By rearranging the original K-M equation, we propose that the reflectance and transmittance can be calculated without knowing the thickness. This is a practically useful contribution. Based on the above finding, we develop the bSX method which can (1) capture the material specific parameters from the two photos - taken before and after the material application, and (2) reproduce its effect on a novel backing. We experimented the proposed method in various cases related to virtual cosmetic try-on, which include (1) capture from a single color backing, (2) capture from human skin backing, (3) reproduction of varying thickness effect, (4) reproduction of multi-layer cosmetic application effect, (5) applying the proposed method to makeup transfer. Compared to previous image-based makeup transfer methods, the bSX method reproduces the feel of the cosmetics more accurately.Item Subdivision Schemes With Optimal Bounded Curvature Near Extraordinary Vertices(The Eurographics Association and John Wiley & Sons Ltd., 2018) Ma, Yue; Ma, Weiyin; Fu, Hongbo and Ghosh, Abhijeet and Kopf, JohannesWe present a novel method to construct subdivision stencils near extraordinary vertices with limit surfaces having optimal bounded curvature at extraordinary positions. With the proposed method, subdivision stencils for newly inserted and updated vertices near extraordinary vertices are first constructed to ensure subdivision with G1 continuity and bounded curvature at extraordinary positions. The remaining degrees of freedom of the constructed subdivision stencils are further used to optimize the eigenbasis functions corresponding to the subsubdominant eigenvalues of the subdivision with respect to G2 continuity constraints. We demonstrate the method by replacing subdivision stencils near extraordinary vertices for Catmull-Clark subdivision and compare the results with the original Catmull-Clark subdivision and previous tuning schemes known with small curvature variation near extraordinary positions. The results show that the proposed method produces subdivision schemes with better or comparable curvature behavior around extraordinary vertices with comparatively simple subdivision stencils.Item Fast Global Illumination with Discrete Stochastic Microfacets Using a Filterable Model(The Eurographics Association and John Wiley & Sons Ltd., 2018) Wang, Beibei; Wang, Lu; Holzschuch, Nicolas; Fu, Hongbo and Ghosh, Abhijeet and Kopf, JohannesMany real-life materials have a sparkling appearance, whether by design or by nature. Examples include metallic paints, sparkling varnish but also snow. These sparkles correspond to small, isolated, shiny particles reflecting light in a specific direction, on the surface or embedded inside the material. The particles responsible for these sparkles are usually small and discontinuous. These characteristics make it diffcult to integrate them effciently in a standard rendering pipeline, especially for indirect illumination. Existing approaches use a 4-dimensional hierarchy, searching for light-reflecting particles simultaneously in space and direction. The approach is accurate, but still expensive. In this paper, we show that this 4-dimensional search can be approximated using separate 2-dimensional steps. This approximation allows fast integration of glint contributions for large footprints, reducing the extra cost associated with glints be an order of magnitude.Item Ellipsoid Packing Structures on Freeform Surfaces(The Eurographics Association and John Wiley & Sons Ltd., 2018) Xu, Qun-Ce; Deng, Bailin; Yang, Yong-Liang; Fu, Hongbo and Ghosh, Abhijeet and Kopf, JohannesDesigners always get good inspirations from fascinating geometric structures gifted by the nature. In the recent years, various computational design tools have been proposed to help generate cell packing structures on freeform surfaces, which consist of a packing of simple primitives, such as polygons, spheres, etc. In this work, we aim at computationally generating novel ellipsoid packing structures on freeform surfaces. We formulate the problem as a generalization of sphere packing structures in the sense that anisotropic ellipsoids are used instead of isotropic spheres to pack a given surface. This is done by defining an anisotropic metric based on local surface anisotropy encoded by principal curvatures and the corresponding directions. We propose an optimization framework that can optimize the shapes of individual ellipsoids and the spatial relation between neighboring ellipsoids to form a quality packing structure. A tailored anisotropic remeshing method is also employed to better initialize the optimization and ensure the quality of the result. Our framework is extensively evaluated by optimizing ellipsoid packing and generating appealing geometric structures on a variety of freeform surfaces.Item Skeletex: Skeleton-texture Co-representation for Topology-driven Real-time Interchange and Manipulation of Surface Regions(The Eurographics Association and John Wiley & Sons Ltd., 2018) Madaras, Martin; Riecický, Adam; Mesároš, Michal; Stuchlík, Martin; Piovarči, Michal; Fu, Hongbo and Ghosh, Abhijeet and Kopf, JohannesMesh processing algorithms depend on quick access to the local neighborhood, which requires costly memory queries. Moreover, even having access to the local neighborhood is not enough to efficiently perform many geometry processing algorithms in an automatic or semi-automatic way. As humans, we often imagine mesh editing at the level of topological information, e.g., altering surface features, adding limbs, etc., which is not supported by current data structures. These limitations come from the widely used mesh representations because the needed information is not implicitly defined by the structure. We propose a novel model representation called Skeletex. Each 3D model is decomposed into two elements: a skeletal structure that encodes the model topology and a vector displacement map to capture fine details of the geometry. Such a co-representation contains the topology information, as well as the information about the local vertex neighborhood at each texel. Additionally, our data structure facilitates an automatic skeleton-based cross-parameterization. This allows us to implement the mesh manipulation tasks in parallel, using a unified streamlined pipeline that directly maps to the GPU. We demonstrate the capabilities of our data structure by implementing surface region transfer and mesh morphing of 3D models.Item Parallel Multigrid for Nonlinear Cloth Simulation(The Eurographics Association and John Wiley & Sons Ltd., 2018) Wang, Zhendong; Wu, Longhua; Fratarcangeli, Marco; Tang, Min; Wang, Huamin; Fu, Hongbo and Ghosh, Abhijeet and Kopf, JohannesAccurate high-resolution simulation of cloth is a highly desired computational tool in graphics applications. As singleresolution simulation starts to reach the limit of computational power, we believe the future of cloth simulation is in multi-resolution simulation. In this paper, we explore nonlinearity, adaptive smoothing, and parallelization under a full multigrid (FMG) framework. The foundation of this research is a novel nonlinear FMG method for unstructured meshes. To introduce nonlinearity into FMG, we propose to formulate the smoothing process at each resolution level as the computation of a search direction for the original high-resolution nonlinear optimization problem. We prove that our nonlinear FMG is guaranteed to converge under various conditions and we investigate the improvements to its performance. We present an adaptive smoother which is used to reduce the computational cost in the regions with low residuals already. Compared to normal iterative solvers, our nonlinear FMG method provides faster convergence and better performance for both Newton's method and Projective Dynamics. Our experiment shows our method is efficient, accurate, stable against large time steps, and friendly with GPU parallelization. The performance of the method has a good scalability to the mesh resolution, and the method has good potential to be combined with multi-resolution collision handling for real-time simulation in the future.Item Sit & Relax: Interactive Design of Body-Supporting Surfaces(The Eurographics Association and John Wiley & Sons Ltd., 2018) Leimer, Kurt; Birsak, Michael; Rist, Florian; Musialski, Przemyslaw; Fu, Hongbo and Ghosh, Abhijeet and Kopf, JohannesWe propose a novel method for interactive design of well-fitting body-supporting surfaces that is driven by the pressure distribution on the body's surface. Our main contribution is an interactive modeling system that utilizes captured body poses and computes an importance field that is proportional to the pressure distribution on the body for a given pose. This distribution indicates where the body should be supported in order to easily hold a particular pose, which is one of the measures of comfortable sitting. Using our approximation, we propose the entire workflow for interactive design of C2 smooth surfaces which serve as seats, or generally, as body supporting furniture for comfortable sitting. Finally, we also provide a design tool for RHINOCEROS/GRASSHOPPER that allows for interactive creation of single designs or entire multi-person sitting scenarios. We also test the tool with design students and present several results. Our method aims at interactive design in order to help designers to create appropriate surfaces digitally without additional empirical design passes.Item Non-Local Low-Rank Normal Filtering for Mesh Denoising(The Eurographics Association and John Wiley & Sons Ltd., 2018) Li, Xianzhi; Zhu, Lei; Fu, Chi-Wing; Heng, Pheng-Ann; Fu, Hongbo and Ghosh, Abhijeet and Kopf, JohannesThis paper presents a non-local low-rank normal filtering method for mesh denoising. By exploring the geometric similarity between local surface patches on 3D meshes in the form of normal fields, we devise a low-rank recovery model that filters normal vectors by means of patch groups. In summary, our method has the following key contributions. First, we present the guided normal patch covariance descriptor to analyze the similarity between patches. Second, we pack normal vectors on similar patches into the normal-field patch-group (NPG) matrix for rank analysis. Third, we formulate mesh denoising as a low-rank matrix recovery problem based on the prior that the rank of the NPG matrix is high for raw meshes with noise, but can be significantly reduced for denoised meshes, whose normal vectors across similar patches should be more strongly correlated. Furthermore, we devise an objective function based on an improved truncated 'gamma' norm, and derive an optimization procedure using the alternative direction method of multipliers and iteratively re-weighted least squares techniques.We conducted several experiments to evaluate our method using various 3D models, and compared our results against several state-of-the-art methods. Experimental results show that our method consistently outperforms other methods and better preserves the fine details.Item Biorthogonal Wavelet Surface Reconstruction Using Partial Integrations(The Eurographics Association and John Wiley & Sons Ltd., 2018) Ren, Xiaohua; Lyu, Luan; He, Xiaowei; Cao, Wei; Yang, Zhixin; Sheng, Bin; Zhang, Yanci; Wu, Enhua; Fu, Hongbo and Ghosh, Abhijeet and Kopf, JohannesWe introduce a new biorthogonal wavelet approach to creating a water-tight surface defined by an implicit function, from a finite set of oriented points. Our approach aims at addressing problems with previous wavelet methods which are not resilient to missing or nonuniformly sampled data. To address the problems, our approach has two key elements. First, by applying a three-dimensional partial integration, we derive a new integral formula to compute the wavelet coefficients without requiring the implicit function to be an indicator function. It can be shown that the previously used formula is a special case of our formula when the integrated function is an indicator function. Second, a simple yet general method is proposed to construct smooth wavelets with small support. With our method, a family of wavelets can be constructed with the same support size as previously used wavelets while having one more degree of continuity. Experiments show that our approach can robustly produce results comparable to those produced by the Fourier and Poisson methods, regardless of the input data being noisy, missing or nonuniform. Moreover, our approach does not need to compute global integrals or solve large linear systems.