Computer Graphics
TU Braunschweig

Correspondence and Depth-Image Based Rendering: a Hybrid Approach for Free-Viewpoint Video


Correspondence and Depth-Image Based Rendering: a Hybrid Approach for Free-Viewpoint Video

We present a novel approach to free-viewpoint video. Our main contribution is the formulation of a hybrid approach between image morphing and depth-image based rendering. When rendering the scene from novel viewpoints, we use both dense pixel correspondences between image pairs as well as an underlying, view-dependent geometrical model. Our novel reconstruction scheme iteratively refines geometric and correspondence information. By combining the strengths of both depth and correspondence estimation, our approach enables free-viewpoint video also for challenging scenes as well as for recordings that may violate typical constraints in multiview reconstruction. For example, our method is robust against inaccurate camera calibration, asynchronous capture, and imprecise depth reconstruction. Rendering results for different scenes and applications demonstrate the versatility and robustness of our approach.


Author(s):Christian Lipski, Felix Klose, Marcus Magnor
Published:June 2014
Type:Article
Journal:IEEE Trans. Circuits and Systems for Video Technology (T-CSVT) Vol. 24
Project(s): Multi-Image Correspondences  Virtual Video Camera  Reality CG 


@article{Lipski2014CDI,
  title = {Correspondence and Depth-Image Based Rendering: a Hybrid Approach for Free-Viewpoint Video},
  author = {Lipski, Christian and Klose, Felix and Magnor, Marcus},
  journal = {{IEEE} Trans. Circuits and Systems for Video Technology (T-{CSVT})},
  volume = {24},
  number = {6},
  pages = {942--951},
  month = {Jun},
  year = {2014}
}

Authors