Decoration
max planck institut
informatik
mpii logo Minerva of the Max Planck Society
 


Shape Reconstruction and Data Modeling

There is a multitude of representations for geometry data, the choice and and construction of an appropriate mathematical model is crucial for further processing of the data. Our research lead to new techniques for the reconstruction and modeling of surface and volume data.

Surfaces are commonly represented as polygonal meshes. Given huge scattered data from digitization, e.g., from a 3D-scan, it is not straightforward to construct a consistent, high-quality mesh due to the presence of measurement noise and variation of sampling density, i.e., oversampling and missing data. Our new approaches to related problem focus on sparse meshing of noisy data (Section 0.1.1), statistical learning methods (Section 0.1.2) and implicit surface fitting (0.1.3) for shape reconstruction. In addition we address subdivision techniques (Section 0.1.4) as a efficient model for smooth data in surface design and animation.

Volume data arise in many applications like medical imaging, seismic applications, and numeric simulations. We developed and investigated new kinds of trivariate splines as efficient models of such data (Section 0.1.5).


Sparse Meshing of Noisy Scattered Data

Investigators: Oliver Schall and Alexander Belyaev

Surface reconstruction is a field of intensive research in computer graphics. Hence, a large variety of efficient surface reconstruction techniques has been proposed including Delaunay-based and volumetric methods being of particular interest. However, in practice, most surface reconstruction techniques are still limited to handle clean data.

In [SBS05], we propose a clustering method for sparse surface reconstruction from dense noisy surface scattered data. The approach is inspired by the kernel density estimation method (Parzen-window estimation method). The approach computes a global uncertainty function modeling the contribution of each noisy point sample to the smooth surface which is supposed to be reconstructed. To find a sparse set of approximation centers of the smooth surface, minima of the uncertainty function are extracted using a gradient descent like technique. Once the approximation centers are determined their applications are versatile. The approximated smooth surface can be rendered using different visualization techniques like for instance surface splatting or accurately reconstructed using different established meshing techniques (see Figure 0.1).

Figure 0.1: Noisy point cloud of the Armadillo model (2.4M points). Smooth and accurate reconstruction from a sparse set of approximation centers (240K points). A zoom of the left foot is illustrated.
Image arma_noise Image arma_rec Image arma_noise_zoom Image arma_rec_zoom


Statistical Learning Applications in Surface Reconstruction

Investigators: Ioannis Ivrissimtzis and Waqar Saleem

With the recent progress in data acquisition systems the typical mesh size in a computer graphics application grows exponentially. This leads to a shift towards statistical methods in mesh processing because such methods can better cope with the computational time and memory restrictions imposed by large data sets. Moreover, as the size (and sometimes the noise) of the data increases, the average amount of information carried by a mesh primitive drops, making the statistical methods a more appropriate choice than their geometry based counterparts.

In collaboration with Won-Ki Jeong from the University of Utah and Seungyong Lee and Yunjin Lee from POSTECH, Korea, we study the use of Self-Organizing Maps in surface reconstruction. In [JIS03] we study a self-organizing mesh which develops using normal rather than spatial information, producing this way curvature adaptive reconstructions. In [IJS03] we improve an algorithm we proposed earlier, solving in particular the problem of changes in the mesh topology. In [Sal04] instead of the usual signal counters we use a relative evaluation of the activity of each vertex, improving the efficiency of the algorithm. In [ILL+04] we show that using an ensemble of self-organizing meshes rather than a single one, that is, averaging many different reconstruction of the same input data, improves the robustness. In [IOSS05] we study the applicability of clustering techniques in surface reconstruction.

In [IJL+05] we notice that even though self-organizing meshes have very limited ability to correct topological mistakes occurring at he early stages of their growth, nevertheless, such false topological features tend to shrink later in the process and become geometric details. We proposed a geometry forgetting component, in the form of coarse voxelization followed by remeshing, which periodically erase all the geometric detail. We showed that forgetting geometric detail is a very robust way to learn topology, see Fig. 0.2.

Figure 0.2: All the learned geometric detail is periodically erased until the correct topology is captured.
Image ijlls_bier1 Image ijlls_bier1_vox Image ijlls_bier2 Image ijlls_bier2_vox
Image ijlls_bier3 Image ijlls_bier3_vox Image ijlls_bier4_500k


Implicit Surface Fitting

Investigators: Yutaka Ohtake and Alexander Belyaev

There are many applications that rely on building accurate digital models of real-world objects. Modern 3D digitizing techniques can yield millions of 3D point locations on the object that is being digitized. Once these points have been collected, it is a non-trivial task to build a surface representation that is faithful to the collected data.

In a series of papers [OBS04b,OBS04a,OBA+03,OBS03], we use radial basis function (RBF) and partition of unity (PU) approximations to develop surface reconstruction methods allowing for fast and accurate reconstruction of scattered data sets by implicit surfaces. The proposed methods are fast, capable of reconstructing sharp features, and robust in the presence of holes and abrupt variations in the sampling density. We also demonstrate that such RBF, PU, and RBF+PU composite implicit surface representations of digital shapes are often more accurate, easier to handle, and better adapted for various geometric modeling tasks then the traditional mesh-based representation.


Subdivision Surfaces

Investigators: Ioannis Ivrissimtzis and Rhaleb Zayer

Subdivision surfaces are becoming the favored standard of the entertainment industry for surface representation. This is due to their simplicity, their ability to capture complex topology, and their hybrid representation both as a sequence of meshes of increasing size and as a smooth limit surface.

In collaboration with Malcolm Sabin from Numerical Geometry Ltd and Neil Dodgson from the University of Cambridge we studied several theoretical aspects of subdivision. In [ISD04] we studied the support of subdivision, that is, the area of the surface affected by the change in position of a single vertex of the initial mesh. Our results explain why for a binary scheme the support is usually a polygon which can be easily computed. We also show that if the scheme is not binary, then, in many cases the support will be fractal. In particular, we show that the support of the 3-scheme is a fractal and on its boundary we can identify sets like the classic ternary Cantor set. In [IDS04a] we presented a classification of the various subdivision schemes based on lattice transformations. In [IDS04b] we proposed a 5-subdivision scheme for quadrilateral meshes.

In [IS04,IZS04,IZS05] we work on the spectral analysis of subdivision surfaces. We notice that even though spectral analysis is the main tool for studying subdivision surfaces, nevertheless, the literature focuses on the analysis of the subdivision matrix rather than the analysis of mesh neighborhoods. In [IS04] we study eigen-decompositions of polygonal neighborhoods of the control mesh. Fig. 0.3 shows an eigen-basis for planar pentagons and hexagons, while we work with similar 3D decompositions. We show that such eigen-decompositions determine many of the properties of the subdivision surface. In particular, they determine when the surface has a singularity and if there is no singularity they determine the normal of the limit surface. In [IZS04,IZS05] we show that these decompositions can be extended to larger neighborhoods around a control vertex. This extension makes possible the study of schemes with larger support like the Catmull-Clark scheme.

Figure 0.3: The eigen-pentagons (top) and the eigen-hexagons (bottom).
basis_pentagons.png


basis_hexagons.png


Trivariate Splines

Investigator: Christian Rössl

Splines are a valuable tool for approximating and modeling data well-known in Computer Aided Geometric Design. We focussed our research on the modeling and visualization of volumetric data using new trivariate splines, i.e., piecewise polynomials in three variables that are defined w.r.t. certain uniform tetrahedral partitions of the volumetric domain.

We studied the dimension of C¹-splines on these partitions in [HNR+04], which provides the theoretic foundation for the subsequent work and which indicates that the construction of such spline spaces is much more complex than in the bivariate setting.

In [RZNS03,RZNS04a] we propose a new approach to reconstruct non-discrete models from gridded volume samples, e.g., data stemming from a CT or MRI sensor. As a model, we use quadratic trivariate super splines which fulfill appropriate smoothness conditions using polynomial pieces of the lowest possible total degree two. This enables efficient and exact ray intersections with an isosurface for ray-casting. Our approach enables efficient reconstruction of the data using only repeated averaging. We studied the smoothness and approximation properties of the quasi-interpolating quadratic super splines in [NRZS05]. Here, we observe as a non-standard phenomenon that the derivatives of our splines yield optimal approximation order for smooth data, while the theoretical error of the values is nearly optimal due to the carefully chosen averaging rules. The optimal approximation properties of the derivatives allow to simply sample the necessary gradients directly from the polynomial pieces of the splines for efficient high-quality visualization of isosurfaces (see Fig. 0.4 (a)).

Figure 0.4: (a) Visualization of a medical data set capturing an aneurysm. The images compare isosurfaces of a trilinear, i.e., piecewise cubic, reconstruction (left) and our new quadratic super spline model (right), which allows efficient computation of exact ray-intersections and local evaluation of gradients for shading. (b) Approximation of general data with a cubic spline. The spline was constructed from 128K random samples of a trivariate test function. The images show different isosurfaces of the spline. The color coded error visualizes the good approximation properties.
Image roessl-aneurism-close-l Image roessl-aneurism-close-q Image roessl-coons
(a) (b)

In [RZNS04b] we address the approximation of general data, i.e., the data is distributed over arbitrarily shaped volumes. We base our approach on cubic trivariate splines, which are determined from the discrete data as a result of a two-step method, where local discrete least squares polynomial approximations of varying degrees are extended by using natural conditions, i.e., the continuity and smoothness properties which determine the underlying spline space. The main advantages of this approach with linear algorithmic complexity are as follows: no tetrahedral partition of the volume data is needed, only small linear systems have to be solved, the local variation and distribution of the data is automatically adapted, noisy data are automatically smoothed. Our numerical examples with huge data sets for synthetic data as well as some real-world data confirm the efficiency of the methods, show the high quality of the spline approximation and illustrate that the rendered isosurfaces inherit a visual smooth appearance from the volume approximating splines (see Fig. 0.4 (b)).


Bibliography

HNR+04
Thomas Hangelbroek, Günther Nürnberger, Christian Rössl, Hans-Peter Seidel, and Frank Zeilfelder.
Dimension of c1-splines on type-6 tetrahedral partitions.
Journal of Approximation Theory, 131(2):157-184, 2004.

IDS04a
Ioannis Ivrissimtzis, Neil Dodgson, and Malcolm Sabin.
A generative classification of mesh refinement rules with lattice transformations.
Computer Aided Geometric Design, 21(1):99-109, 2004.

IDS04b
Ioannis Ivrissimtzis, Neil Dodgson, and Malcolm Sabin.
sqrt(5)-subdivision.
In Neil A. Dodgson, Michael S. Floater, and Malcom A. Sabin, editors, Advances in Multiresolution for Geometric Modelling, Mathematics and Visualization, pages 285-299. Springer, Berlin, Germany, 2004.

IJL+05
Ioannis Ivrissimtzis, Won-Ki Jeong, Seungyong Lee, Yunjin Lee, and Hans-Peter Seidel.
Surface reconstruction with neural meshes.
In 6th International Conference on Mathematical Methods for Curves and Surfaces, Tromso, Norway, 2005. Nashboro Press.
to appear.

IJS03
Ioannis Ivrissimtzis, Won-Ki Jeong, and Hans-Peter Seidel.
Neural meshes: Statistical learning methods in surface reconstruction.
Technical Report MPI-I-2003-4-007, Max-Planck-Institut für Informatik, Saarbrücken, April 2003.

ILL+04
Ioannis Ivrissimtzis, Yunjin Lee, Seungyong Lee, Won-Ki Jeong, and Hans-Peter Seidel.
Neural mesh ensembles.
In Yiannis Aloimonos and Gabriel Taubin, editors, 2nd International Symposium on 3D Data Processing, Visualization, and Transmission, 3DPVT 2004, pages 308-315, Thessaloniki, Greece, 2004. IEEE.

IOSS05
Francesco Isgro, Francesca Odone, Waqar Saleem, and Oliver Schall.
Clustering for surface reconstruction.
In Bianca Falcidieno and Nadia Magnenat-Thalmann, editors, 1st International Workshop on Semantic Virtual Environments, Villars, Switzerland, 2005. AIM@SHAPE, not yet known.

IS04
Ioannis Ivrissimtzis and Hans-Peter Seidel.
Evolutions of polygons in the study of subdivision surfaces.
Computing, 72(1-2):93-103, 2004.

ISD04
Ioannis Ivrissimtzis, Malcolm Sabin, and Neil Dodgson.
On the support of recursive subdivision.
ACM Transactions on Graphics, 23(4):1043-1060, 2004.

IZS04
Ioannis Ivrissimtzis, Rhaleb Zayer, and Hans-Peter Seidel.
Polygonal decomposition of the 1-ring neighborhood of the catmull-clark scheme.
In Franca Giannini and Alexander Pasko, editors, Shape Modeling International 2004 (SMI 2004) : proceedings, pages 101-109, Genoa, Italy, June 2004. IEEE.

IZS05
Ioannis Ivrissimtzis, Rhaleb Zayer, and Hans-Peter Seidel.
Polygonal decompositions of quadrilateral subdivision meshes.
Computer Graphics & Geometry, to appear, 2005.

JIS03
Won-Ki Jeong, Ioannis Ivrissimtzis, and Hans-Peter Seidel.
Neural meshes: Statistical learning based on normals.
In Jon Rokne, Reinhard Klein, and Wenping Wang, editors, 11th Pacific Conference on Computer Graphics and Applications (PG-03), pages 404-408, Canmore, Alberta, Canada, October 2003. IEEE.

NRZS05
Günther Nürnberger, Christian Rössl, Frank Zeilfelder, and Hans-Peter Seidel.
Quasi-interpolation by quadratic piecewise polynomials in three variables.
Computer Aided Geometric Design, 2005.
to appear.

OBA+03
Yutaka Ohtake, Alexander Belyaev, Marc Alexa, Greg Turk, and Hans-Peter Seidel.
Multi-level partition of unity implicits.
ACM Transactions on Graphics, 22(3):463-470, July 2003.
(Proc. ACM SIGGRAPH '03).

OBS03
Yutaka Ohtake, Alexander Belyaev, and Hans-Peter Seidel.
A multi-scale approach to 3d scattered data interpolation with compactly supported basis functions.
In Myung-Soo Kim, editor, Shape Modeling International 2003 (SMI 2003), pages 153-161, Seoul, Korea, May 2003. IEEE.

OBS04a
Yutaka Ohtake, Alexander Belyaev, and Hans-Peter Seidel.
3d scattered data approximation with adaptive compactly supported radial basis functions.
In Proceedings of the International Conference on Shape Modeling and Applications, pages 31-39, Genova, Italy, June 2004. IEEE.

OBS04b
Yutaka Ohtake, Alexander Belyaev, and Hans-Peter Seidel.
Multi-scale and adaptive cs-rbfs for shape reconstruction from cloud of points.
In N. Dodgson, M. S. Floater, and M. Sabin, editors, Advances in Multiresolution for Geometric Modelling, pages 143-154. Springer, Berlin, 2004.

RZNS03
Christian Rössl, Frank Zeilfelder, Günther Nürnberger, and Hans-Peter Seidel.
Visualization of volume data with quadratic super splines.
In Greg Turk, Jarke van Wijk, and Robert Moorhead, editors, IEEE Visualization 2003 (VIS-03), pages 393-400, Seattle, USA, October 2003. IEEE.

RZNS04a
Christian Rössl, Frank Zeilfelder, Günther Nürnberger, and Hans-Peter Seidel.
Reconstruction of volume data with quadratic super splines.
IEEE Transactions on Visualization and Computer Graphics, 10(4):397-409, 2004.

RZNS04b
Christian Rössl, Frank Zeilfelder, Günther Nürnberger, and Hans-Peter Seidel.
Spline approximation of general volumetric data.
In Gershon Elber, Nick Patrikalakis, and Pere Brunet, editors, Proceedings of the 9th ACM Symposium on Solid Modeling and Applications (SM 2004), pages 71-82, Genova, Italy, 2004. Eurographics.

Sal04
Waqar Saleem.
A flexible framework for learning-based surface reconstruction.
Masters thesis, Universität des Saarlandes, December 2004.

SBS05
Oliver Schall, Alexander Belyaev, and Hans-Peter Seidel.
Sparse meshing of uncertain and noisy surface scattered data.
Research Report MPI-I-2005-4-002, Max-Planck-Institut für Informatik, Stuhlsatzenhausweg 85, 66123 Saarbrücken, Germany, February 2005.