Evaluating the effectiveness of rationale-augmented convolutional neural networks for deepfake detection

dc.authoridAhmed, Saadaldeen Rashid/0000-0003-2259-7437
dc.contributor.authorAhmed, Saadaldeen Rashid
dc.contributor.authorSonuc, Emrullah
dc.date.accessioned2024-09-29T15:51:04Z
dc.date.available2024-09-29T15:51:04Z
dc.date.issued2023
dc.departmentKarabük Üniversitesien_US
dc.description.abstractDeepfake image detection has emerged as an important area of research due to its wide-ranging implications for various security systems. In particular, in the field of deep learning, the task of detecting fake images has traditionally been challenging due to its complicated and abstract nature, especially in the field of computer vision where accurate analysis and understanding of facial landmarks play a crucial role. This study introduces a rational-augmented convolutional neural network (RACNN) for deepfake image detection. The RACNN combines a convolutional neural network (CNN) with a reasoning generator, which generates binary masks to highlight the crucial regions that contribute to the CNN's decision-making process. To improve the accuracy and efficiency of the reasoning generator, a reinforcement learning technique is used to train it to generate accurate and compact masks. Through extensive experiments conducted on a large dataset of deepfake images, the effectiveness of the RACNN method is demonstrated, achieving an impressive accuracy rate of 94.87% on an open-source dataset, namely FaceForensics++. The comparative analysis shows the superiority of the RACNN model over existing approaches, especially in terms of accuracy. This robustly demonstrates the effectiveness of the RACNN in accurately distinguishing between real and fake images. The AUC of 95.69% on the dataset serves as a strong indication of the effectiveness of our proposed method in accurately detecting fake facial images generated by various deepfake techniques. Our model proves to be a promising way to advance the field of deepfake image detection, providing potential improvements to the capabilities of such systems.en_US
dc.description.sponsorshipThe authors did not receive any specific grant from funding agencies in the public, commercial, or non-profit sectors.en_US
dc.description.sponsorshipThe authors did not receive any specific grant from funding agencies in the public, commercial, or non-profit sectors.en_US
dc.identifier.doi10.1007/s00500-023-09245-y
dc.identifier.issn1432-7643
dc.identifier.issn1433-7479
dc.identifier.scopus2-s2.0-85173780464en_US
dc.identifier.scopusqualityQ2en_US
dc.identifier.urihttps://doi.org/10.1007/s00500-023-09245-y
dc.identifier.urihttps://hdl.handle.net/20.500.14619/3879
dc.identifier.wosWOS:001081833700002en_US
dc.identifier.wosqualityQ2en_US
dc.indekslendigikaynakWeb of Scienceen_US
dc.indekslendigikaynakScopusen_US
dc.language.isoenen_US
dc.publisherSpringeren_US
dc.relation.ispartofSoft Computingen_US
dc.relation.publicationcategoryMakale - Uluslararası Hakemli Dergi - Kurum Öğretim Elemanıen_US
dc.rightsinfo:eu-repo/semantics/closedAccessen_US
dc.subjectDeepfakeen_US
dc.subjectConvolutional neural networken_US
dc.subjectRationale-augmented CNNen_US
dc.subjectForgery detectionen_US
dc.titleEvaluating the effectiveness of rationale-augmented convolutional neural networks for deepfake detectionen_US
dc.typeArticleen_US

Dosyalar