Decoration
max planck institut
informatik
mpii logo Minerva of the Max Planck Society
 

Free-Viewpoint Video of Human Actors


Christian Theobalt, Joel Carranza, Marcus Magnor, Hans-Peter Seidel.

In our free-viewpoint video system, a scene with an actor is recorded with up to 8 video cameras from different viewing positions. Using a generic body model, the system estimates the motion parameters of the person from the video footage. During initialization, the body model is automatically adapted to the shape of the recorded actor. The motion parameters are estimated via hierarchical optimization using an energy function computed in graphics hardware that is based on silhouette images. This way, motion parameter estimation is possible without the use of optical markers. From the video frames, realistic time-dependent surface textures for the body model are computed. Real-time rendering of the 3D video on off-the-shelf PCs is possible. During rendering, the viewer can interactively choose his viewpoint onto the reconstructed 3D video sequence.


Back to AG4 Gallery