Optimizing Apparent Display Resolution Enhancement for Arbitrary Videos (Michael Stengel, Martin Eisemann, Stephan Wenger, Benjamin Hell, Marcus Magnor)

Optimizing Apparent Display Resolution Enhancement for Arbitrary Videos

Authors: Michael Stengel, Martin Eisemann, Stephan Wenger, Benjamin Hell, Marcus Magnor

Abstract

Display resolution is frequently exceeded by available image resolution. Recently, apparent display resolution enhancement techniques (ADRE) have demonstrated how characteristics of the human visual system can be exploited to provide super-resolution on high refresh rate displays. In this paper we address the problem of generalizing the apparent display resolution enhancement technique to conventional videos of arbitrary content.We propose an optimization-based approach to continuously translate the video frames in such a way that the added motion enables apparent resolution enhancement for the salient image region. The optimization takes the optimal velocity, smoothness and similarity into account to compute an appropriate trajectory. Additionally, we provide an intuitive user interface which allows to guide the algorithm interactively and preserve important compositions within the video. We present a user study evaluating apparent rendering quality and demonstrate versatility of our method on a variety of general test scenes.

Publication Info

IEEE Transactions on Image Processing (TIP), vol. 22, no. 9, pp. 3604-3613, September 2013.
doi: 10.1109/TIP.2013.2265885
Part of project "Reality CG".
[pdf] [bib]