PEFS: A Validated Dataset for Perceptual Experiments on Face Swap Portrait Videos

Videos obtained by current face swapping techniques can contain artifacts potentially detectable, yet unobtrusive to human observers. However, the perceptual differences between real and altered videos, as well as properties leading humans to classify a video as manipulated, are still unclear. Thus, to support the research on perceived realism and conveyed emotions in face swap videos, this paper introduces a high-resolution dataset providing the community with the necessary sophisticated stimuli.
Our recording process has been specifically designed to focus on human perception research and entails three scenarios (text-reading, emotion-triggering, and free-speech). We assess the perceived realness of our dataset through a series of experiments. The results indicate that our stimuli are overall convincing, even for long video sequences. Further-more, we partially annotate the dataset with noticeable facial distortions and artifacts reported by participants.
About PEFS
The videos and other information in this database are only available for scientific use. Any commercial use or other re-distribution is strictly forbidden.
Researchers can apply for full free access on a case-by-case (i.e., person-by-person and study-by-study) basis by contacting us.
Presentation Video CASA 2020
Author(s): | Leslie Wöhler, Jann-Ole Henningson, Susana Castillo, Marcus Magnor |
---|---|
Published: | November 2020 |
Type: | Article in conference proceedings |
Book: | Proc. International Conference on Computer Animation and Social Agents (CASA) (Springer, Cham) |
ISBN: | 978-3-030-63425-4 |
DOI: | 10.1007/978-3-030-63426-1_13 |
Presented at: | International Conference on Computer Animation and Social Agents (CASA) 2020 |
Project(s): | Perception of Video Manipulation Immersive Digital Reality |
@inproceedings{wohler2020pefs, title = {{PEFS}: A Validated Dataset for Perceptual Experiments on Face Swap Portrait Videos}, author = {W{\"o}hler, Leslie and Henningson, Jann-Ole and Castillo, Susana and Magnor, Marcus}, booktitle = {Proc. International Conference on Computer Animation and Social Agents ({CASA})}, organization = {Springer}, isbn = {978-3-030-63425-4}, doi = {10.1007/978-3-030-63426-1\_13}, editor = {Tian F. et al.}, volume = {1300}, pages = {120--127}, month = {Nov}, year = {2020} }
Authors
Leslie Wöhler
Fmr. Senior ResearcherJann-Ole Henningson
Fmr. Research AssistantSusana Castillo
Senior ResearcherMarcus Magnor
Director, Chair