max planck institut
mpii logoMinerva of the Max Planck Society

Computational Photography

Sommersemester 2010

A cutaway view showing some of the optical and electronic components in a Canon 5D Mark II - one of the most capable prosumer digital cameras (image from Canon USA). By inserting a microlens array into a conventional handheld camera, one can create a plenoptic camera, which can record a light field in a single snapshot. The photographs produced by a plenoptic camera can be refocused after they are captured, and the viewpoint can be moved. Click above for an example of digital refocusing. Combining multiple images from different viewpoints under different lighting conditions allows for re-rendering and re-lighting a human face. Dual photography lets us read a hidden playing card from its reflection in the page of a book. The card's face is shown at lower-right.

Summer term, 2010, Wed 14:00 c.t. - 16:00 (6CP)
Raum 001 (Building E1.7, Cluster of Excellence MMCI)
Dr. Ivo Ihrke
Matthias Hullin



Although the digital photography industry is expanding rapidly, most digital cameras still look and feel like film cameras, and they offer roughly the same set of features and controls. However, as sensors and in-camera processing systems improve, these cameras are beginning to offer capabilities that film cameras never had. Among these are the ability to refocus photographs after they are taken (see the example above), or to combine views taken with different camera settings, aim, or placement. Equally exciting are new technologies for creating efficient, controllable illumination. Future "flashbulbs" may be pulsed LEDs or video projectors, with the ability to selectively illuminate objects, recolor the scene, or extract shape information. These developments force us to relax our notion of what constitutes "a photograph." They also blur the distinction between photography and scene modeling. These changes will lead to new photographic techniques, new scientific tools, and possibly new art forms.

In this course, we will survey the converging technologies of digital photography, computational imaging, and image-based rendering, and we will explore the new imaging modalities that they enable. Here is a tentative schedule of lectures.

Course requirements

This is an advanced course for students with background in computer graphics or computer vision. The content is reflecting our conviction that successful researchers in this area must understand both the algorithms and the underlying technologies. The lectures may be accompanied by readings from textbooks or the research literature. These readings will be handed out in class or placed on the course web site. Students are expected to:

  1. read the assigned papers, attend the lectures, and participate in class discussions
  2. prepare a project work in a small group.

An individual oral exam will conclude the course.

Course material

New: Student project websites

Vera Bazhenova, Stoyan Furnadzhiev: HDR Video Camera
Ebad Pirmoradian, Reza Bahmanyar: Time-of-Flight/Stereo Fusion
Beata Turoňová: Dark Flash Photography
Markus Osthof, Oliver Barth: Focal Stack Photography
[in preparation] Christopher Haccius, Hanjo Viets: Spectral/IR Imaging
Alexander Reuter: Aperture Light Fields

Related Material

© 2010 Ivo Ihrke / Matthias Hullin
August 29, 2010 03:26:25 PM