VMV: Vision, Modeling, and Visualization

Permanent URI for this community

https://diglib.eg.org/handle/10.2312/1013

Browse

Now showing 1 - 20 of 381

3D Curve-Skeleton Extraction Algorithm Using a Pseudo-Normal Vector Field
(The Eurographics Association, 2010) Pantuwong, Natapon; Sugimoto, Masanori; Reinhard Koch and Andreas Kolb and Christof Rezk-Salama
A curve skeleton is a line representation of a 3D object. It is useful in many applications, such as animation, shape matching or scientific analysis. The method described in this paper extracts a curve skeleton from the vector field which is created inside the 3D object. The topology of the vector field is analyzed to obtain the curve skeleton. In contrast with previous methods, the vector field is calculated using a pseudo-normal vector. Furthermore, by using the proposed skeleton-growing method, the vector field topology need not be computed for every voxel. Therefore, the proposed approach requires significantly less computation compared with previous vector field-based approaches, while still capturing all important parts of 3D object. The proposed method is very useful for any applications, especially real-time applications such as quick animation production and prototyping of graphical systems.
3D Face Reconstruction with Silhouette Constraints
(The Eurographics Association, 2016) Hu, Qiyang; Zwicker, Matthias; Favaro, Paolo; Matthias Hullin and Marc Stamminger and Tino Weinkauf
In this paper we introduce silhouette constraints to improve the quality of unconstrained 3D face reconstruction. Previously, state of the art unconstrained 3D face reconstruction techniques relied solely on photometric consistency and matching sparse facial landmarks. We show that constraining the silhouettes of the 3D reconstruction to match silhouettes in the input images can further improve reconstruction quality. Our technique automatically detects silhouettes and iteratively matches silhouette points computed from the current 3D reconstruction with silhouettes in the input images. We demonstrate that our results improve on the previous state of the art in unconstrained 3D face reconstruction and that our additional constraints can easily be included in the iterative reconstruction at little additional cost.
3D Real-Time Hydraulic Erosion Simulation using Multi-Layered Heightmaps
(The Eurographics Association, 2024) Nilles, Alexander Maximilian; Günther, Lars; Wagner, Tobias; Müller, Stefan; Linsen, Lars; Thies, Justus
We present a novel method for real-time 3D hydraulic erosion simulation of large-scale terrain. Existing hydraulic erosion methods based on heightmaps and the virtual pipes method are extended to multi-layered heightmaps that can represent more complex 3D features. Our new method for horizontal erosion is able to create overhangs, arches and to some extent caves by allowing water to erode horizontally adjacent bedrock, eventually splitting a column into two new columns. Additionally, we developed an iterative method for bedrock support check that efficiently prevents floating terrain and unrealistic overhangs by propagating bedrock connectivity while incorporating the weight of each column. We implement our method in CUDA, using only features that are also available in standard compute shaders. On a RTX 3070, the resulting method runs at approximately 6ms and 23ms per simulation step for resolutions of 20482 and 40962, respectively.
3D Shape Cropping
(The Eurographics Association, 2013) Franco, Jean-Sebastien; Petit, Benjamin; Boyer, Edmond; Michael Bronstein and Jean Favre and Kai Hormann
We introduce shape cropping as the segmentation of a bounding geometry of an object as observed by sensors with different modalities. Segmenting a bounding volume is a preliminary step in many multi-view vision applications that consider or require the recovery of 3D information, in particular in multi-camera environments. Recent vision systems used to acquire such information often combine sensors of different types, usually color and depth sensors. Given depth and color images we present an efficient geometric algorithm to compute a polyhedral bounding surface that delimits the region in space where the object lies. The resulting cropped geometry eliminates unwanted space regions and enables the initialization of further processes including surface refinements. Our approach exploits the fact that such a region can be defined as the intersection of 3D regions identified as non empty in color or depth images. To this purpose, we propose a novel polyhedron combination algorithm that overcomes computational and robustness issues exhibited by traditional intersection tools in our context. We show the correction and effectiveness of the approach on various combination of inputs.
3D Shape Matching based on Geodesic Distance Distributions
(The Eurographics Association, 2012) Martinek, Michael; Ferstl, Matthias; Grosso, Roberto; Michael Goesele and Thorsten Grosch and Holger Theisel and Klaus Toennies and Bernhard Preim
In this work, we present a signature for 3D shapes which is based on the distribution of geodesic distances. Our shape descriptor is invariant with respect to rotation and scaling as well as articulations of the object. It consists of shape histograms which reflect the geodesic distance distribution of randomly chosen pairs of surface points as well as the distribution of geodesic eccentricity and centricity. We show, that a combination of these shape histograms provides good discriminative power to find similar objects in 3D databases even if they are differently articulated. In order to improve the efficiency of the feature extraction, we employ a fast voxelization method and compute the geodesic distances on a boundary voxel representation of the objects.
Accurate Face Reconstruction through Anisotropic Fitting and Eye Correction
(The Eurographics Association, 2015) Achenbach, Jascha; Zell, Eduard; Botsch, Mario; David Bommes and Tobias Ritschel and Thomas Schultz
Fitting a facial template model to 3D-scanner data is a powerful technique for generating face avatars, in particular in the presence of noisy and incomplete measurements. Consequently, there are many approaches for the underlying non-rigid registration task, and these are typically composed from very similar algorithmic building blocks. By providing a thorough analysis of the different design choices, we derive a face matching technique tailored to high quality reconstructions from high resolution scanner data. We then extend this approach in two ways: An anisotropic bending model allows us to more accurately reconstruct facial details. A simultaneous constrained fitting of eyes and eye lids improves the reconstruction of the eye region considerably.
Adaptive Grids for Neural Scene Representation
(The Eurographics Association, 2024) Pajoum, Barbod; Fox, Gereon; Elgharib, Mohamed; Habermann, Marc; Theobalt, Christian; Linsen, Lars; Thies, Justus
We introduce a novel versatile approach to enhance the quality of grid-based neural scene representations. Grid-based scene representations model a scene by storing density and color features at discrete 3D points, which offers faster training and rendering than purely implicit methods such as NeRF. However, they require high-resolution grids to achieve high-quality outputs, leading to a significant increase in memory usage. Common standard grids with uniform voxel sizes do not account for the varying complexity of different regions within a scene. This is particularly evident when a highly detailed region or object is present, while the rest of the scene is less significant or simply empty. To address this we introduce a novel approach based on frequency domain transformations for finding the key regions in the scene and then utilize a 2-level hierarchy of grids to allocate more resources to more detailed regions. We also created a more efficient version of this concept, that adapts to a compact grid representation, namely TensoRF, which also works for very few training samples.
Adaptive Image-space Stereo View Synthesis
(The Eurographics Association, 2010) Didyk, Piotr; Ritschel, Tobias; Eisemann, Elmar; Myszkowski, Karol; Seidel, Hans-Peter; Reinhard Koch and Andreas Kolb and Christof Rezk-Salama
Stereo vision is becoming increasingly popular in feature films, visualization and interactive applications such as computer games. However, computation costs are doubled when rendering an individual image for each eye. In this work, we propose to only render a single image, together with a depth buffer and use image-based techniques to generate two individual images for the left and right eye. The resulting method computes a high-quality stereo pair for roughly half the cost of the traditional methods. We achieve this result via an adaptive-grid warping that also involves information from previous frames to avoid artifacts.
Adaptive Level-of-Precision for GPU-Rendering
(The Eurographics Association, 2011) Meyer, Quirin; Sussner, Gerd; Greiner, Günter; Stamminger, Marc; Peter Eisert and Joachim Hornegger and Konrad Polthier
Video memory is a valuable resource that has grown much slower than the rendering power of GPUs over the last years. Today, video memory is often the limiting factor in interactive high-quality rendering applications. The most often used solution to reduce memory consumption is to apply level-of-detail (LOD) methods: only a simplified version of the mesh with less vertices and triangles is kept in memory. In this paper we examine a simple orthogonal compression approach that is mostly neglected: adapting the level-of-precision (LOP) of vertex data. The main idea is to quantize vertex positions according to the current view distance, and adapt precision by adding or removing single bit planes. We provide an analysis of the resulting image error, and show that visual artifacts can be avoided by simply constraining the quantization for critical vertices. Our approach allows both random access on vertex data as well as quickly switching between LOP. In experiments we found that our approach compresses vertex positions by about 70percent on average without loss in rendering performance or image quality.
Adaptive Sampling for Geometry-aware Reconstruction Filters
(The Eurographics Association, 2011) Bauszat, Pablo; Eisemann, Martin; Magnor, Marcus; Peter Eisert and Joachim Hornegger and Konrad Polthier
We present an adaptive sampling scheme for Monte-Carlo-based renderers with the aim to support geometryaware filtering techniques for interactive computation of global illumination. While sophisticated filtering techniques for homogeneous areas can already produce high-quality results with as few as one sample per pixel, these approaches lack the ability to filter sufficiently in the vicinity of complex geometric structures. The result are visible artifacts in the final rendering result. Our sampling scheme distributes the samples for the indirect illumination in the image plane according to the necessity of a geometry-aware filtering. We show how to implement our scheme efficiently on current graphics hardware and how to combine it with a sophisticated filtering in order to achieve high-quality interactive frame rates for global illumination simulations. The resulting computational overhead is only in the range of a few milliseconds, making our approach suitable for real-time implementations.
Adaptive Surface Visualization of Vessels with Embedded Blood Flow Based on the Suggestive Contour Measure
(The Eurographics Association, 2013) Lawonn, Kai; Gasteiger, Rocco; Preim, Bernhard; Michael Bronstein and Jean Favre and Kai Hormann
The investigation of hemodynamic information for the assessment of cardiovascular diseases (CVD) has increased in recent years. Improved flow measuring modalities and computational fluid dynamics (CFD) simulations are suitable to provide domain experts with reliable blood flow information. For a visual exploration of the flow information domain experts are used to investigate the flow information combined with its enclosed vessel anatomy. Since the flow is spatially embedded in the surrounding vessel surface, occlusion problems have to be resolved that include a meaningful visual reduction of the vessel surface but still provide important anatomical features. We accomplish this by applying an adaptive surface visualization inspired by the suggestive contour measure. Our approach combines several visualization techniques to improve the perception of surface shape and depth. Thereby, we ensure appropriate visibility of the embedded flow information, which can be depicted with established or advanced flow visualization techniques. We apply our approach to cerebral aneurysms and aortas with simulated and measured blood flow. In an informal user feedback with nine domain experts, we confirm the advantages of our approach compared with existent methods, e.g., semi-transparent surface rendering.
Adaptive Treelet Meshes for Efficient Streak-Surface Visualization on the GPU
(The Eurographics Association, 2012) Fuchs, Raphael; Schindler, Benjamin; Carnecky, Robert; Waser, Jürgen; Yang, Yun; Peikert, Ronny; Michael Goesele and Thorsten Grosch and Holger Theisel and Klaus Toennies and Bernhard Preim
We describe a novel adaptive mesh representation for streak-surfaces. The surface is represented as a mesh of small trees of initial depth zero (treelets). This mesh representation allows for efficient integration, refinement, coarsening and appending of surface patches utilizing the computational capacities of modern GPUs. Integration, refinement, and rendering are strictly separated into effectively parallelizable substeps of the streak-surface integration algorithm. We also describe a sampler framework which unifies the handling of different vector field representations.
AFiT - Atrial Fibrillation Ablation Planning Tool
(The Eurographics Association, 2011) Brost, Alexander B.; Bourier, Felix; Kleinoeder, Andreas; Raab, Jens; Koch, Martin; Stamminger, Marc; Hornegger, Joachim; Strobel, Norbert; Kurzidim, Klaus; Peter Eisert and Joachim Hornegger and Konrad Polthier
The planning of cryo-balloon ablations for treatment of atrial fibrillation is a crucial task for a physician as he has to determine which size of the balloon catheter is required for isolation at each pulmonary vein. Today, the diameter of the pulmonary vein's ostium is measured in a pre-operative data set to determine which type of catheter is most appropriate. We present a novel tool that visualizes a cryo-balloon catheter model within a 3-D model representing a segmented left atrium. Using this approach, physicians are able to better assess the catheter fit. So far, measurement of the pulmonary vein diameters have been performed by evaluation of 2-D slices taken from pre-operative data sets. The first feedback obtained by physicians was very encouraging as this tool offers better insights for balloon catheter ablation procedures.
Alignment and Reassembly of Broken Specimens for Creep Ductility Measurements
(The Eurographics Association, 2022) Knauthe, Volker; Kraus, Maurice; Buelow, Max von; Wirth, Tristan; Rak, Arne; Merth, Laurenz; Erbe, Alexander; Kontermann, Christian; Guthe, Stefan; Kuijper, Arjan; Fellner, Dieter W.; Bender, Jan; Botsch, Mario; Keim, Daniel A.
Designing new types of heat-resistant steel components is an important and active research field in material science. It requires detailed knowledge of the inherent steel properties, especially concerning their creep ductility. Highly precise automatic stateof- the-art approaches for such measurements are very expensive and often times invasive. The alternative requires manual work from specialists and is time consuming and unrobust. In this paper, we present a novel approach that uses a photometric scanning system for capturing the geometry of steel specimens, making further measurement extractions possible. In our proposed system, we apply calibration for pan angles that occur during capturing and a robust reassembly for matching two broken specimen pieces to extract the specimen's geometry. We compare our results against µCT scans and found that it deviates by 0.057mm on average distributed over the whole specimen for a small amount of 36 captured images. Additionally, comparisons to manually measured values indicate that our system leads to more robust measurements.
Analysis of Structural Dependencies for the Automatic Visual Inspection of Wire Ropes
(The Eurographics Association, 2010) Haase, Daniel; Wacker, Esther-Sabrina; Schukat-Talamazzini, Ernst Günter; Denzler, Joachim; Reinhard Koch and Andreas Kolb and Christof Rezk-Salama
Automatic visual inspection is an arising field of research. Especially in security relevant applications, an automation of the inspection process would be a great benefit. For wire ropes, a first step is the acquisition of the curved surface with several cameras located all around the rope. Because most of the visible defects in such a rope are very inconspicuous, an automatic defect detection is a very challenging problem. As in general there is a lack of defective training data, most of the presented ideas for automatic rope inspection are embedded in a one-class classification framework. However, none of these methods makes use of the context information which results from the fact that all camera views image the same rope. In contrast to an individual analysis of each camera view, this work proposes the simultaneous analysis of all available camera views with the help of a vector autoregressive model. Moreover, various dependency analysis methods are used to give consideration to the regular rope structure and to deal with the high dimensionality of the problem. These dependencies are then used as constraints for the vector autoregressive model, which results in a sparse but powerful detection system. The proposed method is evaluated by using real wire rope data and the conducted experiments show that our approach clearly outperforms all previously presented methods.
Analysis of Vortex Merge Graphs
(The Eurographics Association, 2012) Kasten, Jens; Zoufahl, Andre; Hege, Hans-Christian; Hotz, Ingrid; Michael Goesele and Thorsten Grosch and Holger Theisel and Klaus Toennies and Bernhard Preim
We propose an analysis framework to investigate different flow quantities such as vorticity, λ<sub>2</sub> or the acceleration magnitude along vortex merge graphs and within their regions of influence. The explicit extraction of vortex merge graphs enables the application of statistical tools to investigate the vortex core lines themselves. The analysis tool provides common plots as scatter plots and parallel coordinates to explore the correlation of different quantities. An abstract representation of the vortex merge graph highlights birth, death and merges of vortices. Interactive picking of substructures supports a closer insepection of single vortices and their evolution. A further step integrates the regions of influence into the statistical analysis. Minima, maxima, median, mean and other percentiles of the measures along the vortex merge graph and its regions are visualized. The usability of the framework is demonstrated using a simulated flow data set of a mixing layer and a jet.
Appearance Bending: A Perceptual Editing Paradigm for Data-Driven Material Models
(The Eurographics Association, 2017) Mylo, Marlon; Giesel, Martin; Zaidi, Qasim; Hullin, Matthias; Klein, Reinhard; Matthias Hullin and Reinhard Klein and Thomas Schultz and Angela Yao
Data-driven representations of material appearance play an important role in a wide range of applications. Unlike with analytical models, however, the intuitive and efficient editing of tabulated reflectance data is still an open problem. In this work, we introduce appearance bending, a set of image-based manipulation operators, such as thicken, inflate, and roughen, that implement recent insights from perceptual studies. In particular, we exploit a link between certain perceived visual properties of a material, and specific bands in its spectrum of spatial frequencies or octaves of a wavelet decomposition. The result is an editing interface that produces plausible results at interactive rates, even for drastic manipulations. We present the effectiveness of our method on a database of bidirectional texture functions (BTFs) for a variety of material samples.
Application of 3D Gaussian Splatting for Cinematic Anatomy on Consumer Class Devices
(The Eurographics Association, 2024) Niedermayr, Simon; Neuhauser, Christoph; Petkov, Kaloian; Engel, Klaus; Westermann, Rüdiger; Linsen, Lars; Thies, Justus
Interactive photorealistic rendering of 3D anatomy is used in medical education to explain the structure of the human body. It is currently restricted to frontal teaching scenarios, where even with a powerful GPU and high-speed access to a large storage device where the data set is hosted, interactive demonstrations can hardly be achieved. We present the use of novel view synthesis via compressed 3D Gaussian Splatting (3DGS) to overcome this restriction, and to even enable students to perform cinematic anatomy on lightweight and mobile devices. Our proposed pipeline first finds a set of camera poses that captures all potentially seen structures in the data. High-quality images are then generated with path tracing and converted into a compact 3DGS representation, consuming < 70 MB even for data sets of multiple GBs. This allows for real-time photorealistic novel view synthesis that recovers structures up to the voxel resolution and is almost indistinguishable from the path-traced images.
Application of Tensor Approximation to Multiscale Volume Feature Representations
(The Eurographics Association, 2010) Suter, Susanne K.; Zollikofer, Christoph P. E.; Pajarola, Renato; Reinhard Koch and Andreas Kolb and Christof Rezk-Salama
Advanced 3D microstructural analysis in natural sciences and engineering depends ever more on modern data acquisition and imaging technologies such as micro-computed or synchrotron tomography and interactive visualization. The acquired volume data sets are not only of high-resolution but in particular exhibit complex spatial structures at different levels of scale (e.g. variable spatial expression of multiscale periodic growth structures in tooth enamel). Such highly structured volume data sets represent a tough challenge to be analyzed and explored by means of interactive visualization due to the amount of raw volume data to be processed and filtered for the desired features. As an approach to address this bottleneck by multiscale feature preserving data reduction, we propose higher-order tensor approximations (TAs). We demonstrate the power of TA to represent, and highlight the structural features in volume data. We visually and quantitatively show that TA yields high data reduction and that TA preserves volume features at multiple scales.
Art-directable Stroke-based Rendering on Mobile Devices
(The Eurographics Association, 2023) Wagner, Ronja; Schulz, Sebastian; Reimann, Max; Semmo, Amir; Döllner, Jürgen; Trapp, Matthias; Guthe, Michael; Grosch, Thorsten
This paper introduces an art-directable stroke-based rendering technique for transforming photos into painterly renditions on mobile devices. Unlike previous approaches that rely on time-consuming iterative computations and explicit brush-stroke geometry, our method offers a interactive image-based implementation tailored to the capabilities of modern mobile devices. The technique places curved brush strokes in multiple passes, leveraging a texture bombing algorithm. To maintain and highlight essential details for stylization, we incorporate additional information such as image salience, depth, and facial landmarks as parameters. Our technique enables a user to control and manipulate using a wide range of parameters and masks during editing to adjust and refine the stylized image. The result is an interactive painterly stylization tool that supports high-resolution input images, providing users with an immersive and engaging artistic experience on their mobile devices.

Browse

Browsing VMV: Vision, Modeling, and Visualization by Title

Results Per Page

Sort Options