Texture Replacement of Garments in Monocular Video Sequences

In this paper we present a video processing algorithm for texture replacement of moving garments. We use a colorcoded pattern which encodes texture coordinates within a local neighborhood in order to determine the geometric deformation of the texture. A time-coherent texture interpolation is obtained by the use of 3D radial basis functions. Shading maps are determined with a surface reconstruction technique and applied to new textures which replace the color pattern in the video sequence. Our method enables editing and even completely exchanging fabric pattern designs of garments worn by actors as a video post-processing step.