We present a simple, yet general method to detect fake videos displaying human subjects, generated via Deep Learning techniques. The method relies on gauging the complexity of heart rate dynamics as derived from the facial video streams through remote photoplethysmography (rPPG). Features analyzed have a clear semantics as to such physiological behaviour. The approach is thus explainable both in terms of the underlying context model and the entailed computational steps. Most important, when compared to more complex state-of-the-art detection methods, results so far achieved give evidence of its capability to cope with datasets produced by different deep fake models.
Boccignone, G., Bursic, S., Cuculo, V., D’Amelio, A., Grossi, G., Lanzarotti, R., et al. (2022). DeepFakes Have No Heart: A Simple rPPG-Based Method to Reveal Fake Videos. In Image Analysis and Processing – ICIAP 2022 21st International Conference, Lecce, Italy, May 23–27, 2022, Proceedings, Part II (pp.186-195). Springer [10.1007/978-3-031-06430-2_16].
DeepFakes Have No Heart: A Simple rPPG-Based Method to Reveal Fake Videos
Patania, S
2022
Abstract
We present a simple, yet general method to detect fake videos displaying human subjects, generated via Deep Learning techniques. The method relies on gauging the complexity of heart rate dynamics as derived from the facial video streams through remote photoplethysmography (rPPG). Features analyzed have a clear semantics as to such physiological behaviour. The approach is thus explainable both in terms of the underlying context model and the entailed computational steps. Most important, when compared to more complex state-of-the-art detection methods, results so far achieved give evidence of its capability to cope with datasets produced by different deep fake models.| File | Dimensione | Formato | |
|---|---|---|---|
|
Boccignone-2022-ICIAP 2022-VoR.pdf
Solo gestori archivio
Tipologia di allegato:
Publisher’s Version (Version of Record, VoR)
Licenza:
Tutti i diritti riservati
Dimensione
681.68 kB
Formato
Adobe PDF
|
681.68 kB | Adobe PDF | Visualizza/Apri Richiedi una copia |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.


