Free-Viewpoint Video of Human Actors
Christian Theobalt,
Joel Carranza, Marcus Magnor, Hans-Peter Seidel.
In our free-viewpoint video system, a scene with an actor is recorded with up
to 8 video cameras from different viewing positions. Using a generic body model,
the system estimates the motion parameters of the person from the video footage.
During initialization, the body model is automatically adapted to the shape
of the recorded actor. The motion parameters are estimated via hierarchical optimization
using an energy function computed in graphics hardware that is based on silhouette images.
This way, motion parameter estimation is possible without the
use of optical markers. From the video frames, realistic time-dependent
surface textures for the body model are computed.
Real-time rendering of the 3D video on off-the-shelf PCs is possible.
During rendering, the viewer can interactively choose his viewpoint onto
the reconstructed 3D video sequence.
Back to AG4 Gallery