We present a simple, yet general method to detect fake videos displaying human subjects, generated via Deep Learning techniques. The method relies on gauging the complexity of heart rate dynamics as derived from the facial video streams through remote photoplethysmography (rPPG). Features analyzed have a clear semantics as to such physiological behaviour. The approach is thus explainable both in terms of the underlying context model and the entailed computational steps. Most important, when compared to more complex state-of-the-art detection methods, results so far achieved give evidence of its capability to cope with datasets produced by different deep fake models.

Boccignone, G., Bursic, S., Cuculo, V., D’Amelio, A., Grossi, G., Lanzarotti, R., et al. (2022). DeepFakes Have No Heart: A Simple rPPG-Based Method to Reveal Fake Videos. In Image Analysis and Processing – ICIAP 2022 21st International Conference, Lecce, Italy, May 23–27, 2022, Proceedings, Part II (pp.186-195). Springer [10.1007/978-3-031-06430-2_16].

DeepFakes Have No Heart: A Simple rPPG-Based Method to Reveal Fake Videos

Patania, S
2022

Abstract

We present a simple, yet general method to detect fake videos displaying human subjects, generated via Deep Learning techniques. The method relies on gauging the complexity of heart rate dynamics as derived from the facial video streams through remote photoplethysmography (rPPG). Features analyzed have a clear semantics as to such physiological behaviour. The approach is thus explainable both in terms of the underlying context model and the entailed computational steps. Most important, when compared to more complex state-of-the-art detection methods, results so far achieved give evidence of its capability to cope with datasets produced by different deep fake models.
paper
Biological signals; DeepFake detection; Image forensics; rPPG;
English
Image Analysis and Processing – ICIAP 2022 21st International Conference - May 23–27, 2022
2022
Sclaroff, S; Distante, C; Leo, M; Farinella, GM; Tombari, F
Image Analysis and Processing – ICIAP 2022 21st International Conference, Lecce, Italy, May 23–27, 2022, Proceedings, Part II
9783031064296
2022
13232 LNCS
186
195
reserved
Boccignone, G., Bursic, S., Cuculo, V., D’Amelio, A., Grossi, G., Lanzarotti, R., et al. (2022). DeepFakes Have No Heart: A Simple rPPG-Based Method to Reveal Fake Videos. In Image Analysis and Processing – ICIAP 2022 21st International Conference, Lecce, Italy, May 23–27, 2022, Proceedings, Part II (pp.186-195). Springer [10.1007/978-3-031-06430-2_16].
File in questo prodotto:
File Dimensione Formato  
Boccignone-2022-ICIAP 2022-VoR.pdf

Solo gestori archivio

Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Licenza: Tutti i diritti riservati
Dimensione 681.68 kB
Formato Adobe PDF
681.68 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/553733
Citazioni
  • Scopus 17
  • ???jsp.display-item.citation.isi??? 11
Social impact