A YOLOV3-Based Method for Detecting Deepfake Manipulated Facial Images

Abstract

With the advancement of technology and the development of applications that make it easier to transfer images, sounds and videos to the virtual environment, it has become much easier to access people's personal information, videos and images. Deepfake technology produces fakes of authentic images or sounds using deep learning and artificial intelligence techniques. Today, in addition to being used in the entertainment and film industries, it is also used in situations such as creating fake news and discrediting people. Different studies have been conducted in the literature to detect deepfake images and videos to prevent these situations. In this study, a comprehensive literature review was conducted. Real and fake images were collected and labelled from different datasets or videos, and a dataset was created by applying the necessary pre-processing steps. With the created dataset, training was carried out with YOLOv3 technology, which calculates class probabilities differently from traditional methods using Convolutional Neural Networks (CNN) and handles all operations in a single regression problem, which can make fast and high-accurate detection, and the modelling process is explained. With the tests performed in the study, the model that can detect fake images produced with deepfake technology with 95% accuracy was obtained.