Computer Graphics
TU Braunschweig

PEFS: A Validated Dataset for Perceptual Experiments on Face Swap Portrait Videos


PEFS: A Validated Dataset for Perceptual Experiments on Face Swap Portrait Videos

Videos obtained by current face swapping techniques can contain artifacts potentially detectable, yet unobtrusive to human observers. However, the perceptual differences between real and altered videos, as well as properties leading humans to classify a video as manipulated, are still unclear. Thus, to support the research on perceived realism and conveyed emotions in face swap videos, this paper introduces a high-resolution dataset providing the community with the necessary sophisticated stimuli.

Our recording process has been specifically designed to focus on human perception research and entails three scenarios (text-reading, emotion-triggering, and free-speech). We assess the perceived realness of our dataset through a series of experiments. The results indicate that our stimuli are overall convincing, even for long video sequences. Further-more, we partially annotate the dataset with noticeable facial distortions and artifacts reported by participants.

About PEFS

The videos and other information in this database are only available for scientific use. Any commercial use or other re-distribution is strictly forbidden.

Researchers can apply for full free access on a case-by-case (i.e., person-by-person and study-by-study) basis by contacting us.

Presentation Video CASA 2020

 


Author(s):Leslie Wöhler, Jann-Ole Henningson, Susana Castillo, Marcus Magnor
Published:November 2020
Type:Article in conference proceedings
Book:Proc. International Conference on Computer Animation and Social Agents (CASA) (Springer, Cham)
ISBN:978-3-030-63425-4
DOI:10.1007/978-3-030-63426-1_13
Presented at:International Conference on Computer Animation and Social Agents (CASA) 2020
Project(s): Perception of Video Manipulation   Immersive Digital Reality 

BibTex PDF 



@inproceedings{wohler2020pefs,
  title = {{PEFS}: A Validated Dataset for Perceptual Experiments on Face Swap Portrait Videos},
  author = {W{\"o}hler, Leslie and Henningson, Jann-Ole and Castillo, Susana  and Magnor, Marcus},
  booktitle = {Proc. International Conference on Computer Animation and Social Agents ({CASA})},
  organization = {Springer},
  isbn = {978-3-030-63425-4},
  doi = {10.1007/978-3-030-63426-1\_13},
  editor = {Tian F. et al.},
  volume = {1300},
  pages = {120--127},
  month = {Nov},
  year = {2020}
}

Authors