Blockchain-Enabled Machine Learning Framework for Multi-Modal Deepfake Detection: A Sustainable Approach to Digital Media Authentication

Abstract

With unparalleled threats to the integrity of digital information, democratic practices, and public confidence in media, deepfake technology comprises a new class of harm. Deep generative models can be used to generate realistic looking (and sounding) fake human faces and voices, which is great news for bad actors who seek to spread misinformation, commit crimes and ruin journalism. CyberLink Fights Deepfakes with New AI Model That Uses Neural Network Traditional methods used to identify deepfakes have depended on centralised AI systems that can’t be trusted at face value and there is little or no way of proving a piece of content’s authenticity. In this work, we have presented a solution that involves multi-modal deepfake detection and has utilized learning-based forgery detection framework to be deployed on blockchain for evidence tamper resistance. The proposed framework employs a hybrid CNN-RNN architecture that computes facial, audio and metadata feature in parallel to detect unseen deepfakes with accuracy of 94.2%, compared to the single-modal baselines (CNN only: 81.3%, and audio only: 67.4%). Novelty: Blockchain timestamping with cryptographically secured certificates of authenticity for third-party verification while protected proprietary detection logic is not revealed. At the computational efficiency and bandwidth threshold required for edge deployment, video processing at 30 FPS and only 2.1 MBs makes this applicable on any average mobile device. It holds for 12k synthetic videos (celebrities, politicians, newscasters) and diverse deepfake generation methods (FaceSwap, DeepFaceLab, StyleGAN). Societal impact: framework mitigates $1.2T annual disinformation damage and champions digital rights through decentralized verification. Via mashable.com Framework addresses the convergence of deepfake detection, blockchain authentication and the case for sustainable cybersecurity: As a global community grapples with synthetic media in ways we’ve never seen before, support online safety experts to respond.