Decoration
max planck institut
informatik
mpii logo Minerva of the Max Planck Society
 

General Appearance Acquisition

The research in our group covers the areas of computational photography, image-based modeling and rendering, 3D scanning and volume reconstruction with the goal to develop acquisition systems and algorithms for digitizing and reproducing the appearance of real-world objects, ranging from small figurines, entire streets, to planetary nebulae.  

Scope of Research

One central problem in computer graphics is the synthesis of realistic images that are indistinguishable from real photographs. The basic theory behind rendering such images has been known for a while and has been turned into a broad range of rendering algorithms ranging from slow but physically accurate frameworks to hardware-accelerated, real-time applications that make a lot of simplifications. One fundamental building block to these algorithms is the simulation of the interaction between incident illumination and the reflective properties of the scene. The limiting factor in photo-realistic image synthesis today is not the rendering per se but rather the input data passed to the algorithms. The realism of the outcome depends largely on the quality of the scene and material description. Accurate input is required for geometry, illumination and reflective properties. An efficient way to obtain realistic models is through measurement of scene attributes from real-world objects by inverse rendering. The attributes are estimated from real photographs by inverting the rendering process.

  • 3D Geometry Reconstruction

    Traditional structured light 3D scanning systems are designed to capture the geometry for bright diffuse surfaces of moderate complexity. Shiny or translucent materials, e.g. metals or marble, or objects with high depth complexity typically corrupt the estimated 3D geometry producing noise or even wholes in the reconstructed surface. By designing novel capturing systems, specialized illumination patterns, and appropriate reconstruction algorithms we are able to capture the precise 3D geometry even of uncooperative static as well as dynamic objects.

  • Appearance Measurement

    The research group further focuses on developing photographic techniques for measuring the scene's reflection properties. A so-called reflectance field captures the light transport within a scene such that all local and global illumination effects, highlights, shadows, interreflections, or caustics, are recorded and can be re-rendered under arbitrary illumination. The envisioned techniques should be general enough to cope with arbitrary materials, with scenes with high depth complexity such as trees, and should allow capturing in arbitrary environments, i.e. outside a measurement laboratory.

  • Computational Photography

    A third thread of research of this group is computational photography with the goal to develop optical systems augmented by computational procedures; by jointly designing the capturing apparatus, i.e., the optical layout of active or passive devices such as cameras, projectors, beam-splitters, etc., together with the capturing algorithm and appropriate post-processing. Such combined systems are used to increase image quality, e.g., by removing image noise or camera shake, to emphasize or extract scene features such as edges or silhouettes by optical means, or to reconstruct volumetric 3D structures from images. We plan to devise computational photography techniques for advanced optical microscopy, large scale scene acquisition, and even astronomical imaging.

People

Head of Group

Researchers

Students

  • Michael Heinz
  • Tomasz Jurkiewicz
  • Young-Jun Ko
  • Henning Peters
  • Alexander Reuter
  • Andreas Steinel

Collaborators

Former Group Members

Funding

Featured Projects

Towards Passive 6D Reflectance Field Displays
Martin Fuchs, Ramesh Raskar, Hans-Peter Seidel, Hendrik P. A. Lensch
In: Proceedings of SIGGRAPH 2008.
Fluorescent Immersion Range Scanning
Matthias B. Hullin, Martin Fuchs, Ivo Ihrke, Hans-Peter Seidel, Hendrik P. A. Lensch
In: Proceedings of SIGGRAPH 2008.
Combining Confocal Imaging and Descattering
Christian Fuchs, Michael Heinz, Marc Levoy, Hans-Peter Seidel, Hendrik P. A. Lensch
In: Proceedings of EGSR 2008.
Demosaicing by Smoothing along 1D Features
Boris Ajdin, Matthias B. Hullin, Christian Fuchs, Hans-Peter Seidel, Hendrik P. A. Lensch
In: Proceedings of CVPR 2008.
Modulated Phase-Shifting for 3D Scanning
Tongbo Chen, Hans-Peter Seidel, Hendrik P. A. Lensch
In: Proceedings of CVPR 2008.
Background Estimation from Non-Time Sequence Images
Miguel Granados, Hans-Peter Seidel, Hendrik P. A. Lensch
In: Proceedings of Graphics Interface 2008.

 

Polarization and Phase-shifting for 3D Scanning of Translucent Objects
Tongbo Chen, Christian Fuchs, Hendrik P. A. Lensch, Hans-Peter Seidel
In: Proceedings of CVPR 2007.
Superresolution Reflectance Fields: Synthesizing images for intermediate light directions
Martin Fuchs, Hendrik P. A. Lensch, Volker Blanz, Hans-Peter Seidel
In: Proceedings of EUROGRAPHICS 2007.
Density Estimation for Dynamic Volumes
Christian Fuchs, Michael Goesele, Holger Theisel, Hans-Peter Seidel
In: Computers and Graphics, 31(2), 2007.
Reconstruction of Reflection and Planetary Nebulae
Andrei Linţu, Lars Hoffmann, Sascha El-Abed, Ting-Hui Lee, Marcus Magnor, Hendrik P. A. Lensch, Hans-Peter Seidel
Mesostructure from Specularity
Tongbo Chen, Michael Goesele, Hans-Peter Seidel
In: Proceedings of CVPR 2006.
Automatic Multiperspective Images
Augusto Román, Hendrik P. A. Lensch
In: Proceedings of EGSR 2006.
Symmetric Photography: Exploiting Data-Sparseness in Reflectance Fields
Gaurav Garg, Eino-Ville Talvala, Marc Levoy, Hendrik P. A. Lensch
In: Proceedings of EGSR 2006.
DISCO - Acquisition of Translucent Objects
Michael Goesele, Hendrik P. A. Lensch, Christian Fuchs, Jochen Lang, Hans-Peter Seidel
In: Proceedings of SIGGRAPH 2004.

Publications