A Shaped Temporal Filter Camera

Martin Fuchs1,2, Tongbo Chen3, Oliver Wang4, Ramesh Raskar5, Hans-Peter Seidel1, and Hendrik P. A. Lensch6

1 MPI Informatik      2 now at Princeton University      3 USC ICT     
4 UC Santa Cruz      5 MIT Media Lab      6 Ulm University     

temporal sampling processing pipeline

Abstract

Digital movie cameras only perform a discrete sampling of real-world imagery. While spatial sampling effects are well studied in the literature, there has not been as much work in regards to temporal sampling. As cameras get faster and faster, the need for conventional frame-rate video that matches the abilities of human perception remains. In this article, we introduce a system with controlled temporal sampling behavior. It transforms a high fps input stream into a conventional speed output video in real-time.

We investigate the effect of different temporal sampling kernels and demonstrate that extended, overlapping kernels can mitigate aliasing artifacts. Furthermore, NPR effects, such as enhanced motion blur, can be achieved. By applying Fourier transforms in the temporal domain, we can also obtain novel tools for analyzing and visualizing time dependent effects.

We demonstrate the effect of different sampling kernels in creating enhanced movies and stills of fast motion.

Article Preprint

A shaped temporal filter camera [.pdf, 300 dpi, 3.8 MB]
Martin Fuchs, Tongbo Chen, Oliver Wang, Ramesh Raskar, Hans-Peter Seidel, and Hendrik P. A. Lensch

Accepted for publication at VMV 2009.
A full resolution .pdf file [20 MB] is also available.

Video

A shaped temporal filter camera [.mov, 640 x 360, 60 Hz, 48 MB]