Unmasking the Deepfake Infocalypse: Debunking Manufactured Misinformation with a Prototype Model in the AI Era “Seeing and hearing, no longer believing.”
DOI:
https://doi.org/10.58966/JCM2023243Keywords:
Deepfakes, Fake news, Media literacy, AI, Machine learning, Deep learningAbstract
Machine learning and artificial intelligence in Journalism are aid and not a replacement or challenge to a journalist’s ability. Artificial intelligence-backed fake news characterized by misinformation and disinformation is the new emerging threat in our broken information ecosystem. Deepfakes erode trust in visual evidence, making it increasingly challenging to discern real from fake. Deepfakes are an increasing cause for concern since they can be used to propagate false information, fabricate news, or deceive people. While Artificial intelligence is used to create deepfakes, the same technology is also used to detect them. Digital Media literacy, along with technological deepfake detection tools, is an effective solution to the menace of deepfake. The paper reviews the creation and detection of deepfakes using machine learning and deep learning models. It also discusses the implications of cognitive biases and social identity theories in deepfake creation and strategies for establishing a trustworthy information ecosystem. The researchers have developed a prototype deepfake detection model, which can lay a foundation to expose deepfake videos. The prototype model correctly identified 35 out of 50 deepfake videos, achieving 70% accuracy. The researcher considers 65% and above as “fake” and 65% and below as “real”. 15 videos were incorrectly classified as real, potentially due to model limitations and the quality of the deepfakes. These deepfakes were highly convincing and flawless. Deepfakes have a high potential to damage reputations and are often obscene or vulgar. There is no specific law for deepfakes, but general laws require offensive/fake content to be taken down. Deepfakes are often used to spread misinformation or harm someone’s reputation. They are designed to harass, intimidate, or spread fear. A significant majority of deepfake videos are pornographic and target female celebrities
References
Abdullah-All-Tanvir, Mahir, E. M., Akhter, S. and Huq, M. R., Detecting fake news using machine learning and deep learning algorithms. 7th International Conference on Smart Computing & Communications (ICSCC)., 2019, https://doi.org/10.1109/icscc.2019.8843612
Ahmed, Choi, Praveen, Myung, Donepudi, Ayman, A., Aljarbouh. and Ayub, A. A., Detecting fake news using Machine Learning: A Systematic Literature Review. Psychology and Education Journal., 2021, 58(1), 1932–1939. https://doi.org/10.17762/pae.v58i1.1046
Ahmed, H., Traore, I. and Saad, S., Detection of online fake news using N-gram analysis and Machine Learning Techniques. Lecture Notes in Computer Science., 2017, 127–138. https://doi.org/10.1007/978-3-319-69155-8_9
De Lima, O., Franklin, S., Basu, S., Karwoski, B. and George, A., Deepfake detection using spatiotemporal convolutional networks. arXiv.org., 2020, https://arxiv.org/abs/2006.14749
Della Vedova, M. L., Tacchini, E., Moret, S., Ballarin, G., DiPierro, M. and de Alfaro, L., Automatic online fake news detection combining content and social signals. 22nd Conference of Open Innovations Association (FRUCT)., 2018. https://doi.org/10.23919/fruct.2018.8468301
Dewey, C., Analysis facebook has repeatedly trended fake news since firing its human editors. The Washington Post., 2021, https://www.washingtonpost.com/news/the-intersect/wp/2016/10/12/facebook-has-repeatedly-trended-fake-news-since-firing-its-human-editors/
Durall, R., Keuper, M, Pfreundt, F.-J. and Keuper., Unmasking deepfakes with Simple features. arXiv.org., 2020, https://arxiv.org/abs/1911.00686
Fagni, T., Falchi, F., Gambini, M., Martella, A. and Tesconi, M., Tweepfake: About detecting deepfake tweets. PLOS ONE., 2021, 16(5). https://doi.org/10.1371/journal.pone.0251415
Hao, K., Deepfake porn is ruining women’s lives. Now the law may finally ban it. MIT Technology Review., 2021, https://www.technologyreview.com/2021/02/12/1018222/deepfake-revenge-porn-coming-ban/
Hao, K., A horrifying new AI app swaps women into porn videos with a click. MIT Technology Review., 2022, https://www.technologyreview.com/2021/09/13/1035449/ai-deepfake-app-face-swaps-women-into-porn/
Huang, Y., Juefei-Xu, F., Wang, R., Guo, Q., Ma, L., Xie, X., Li, J., Miao, W., Liu. and Pu, G., Fakepolisher: Making deepfakes more detection-evasive by shallow reconstruction. Proceedings of the 28th ACM International Conference on Multimedia., 2020, https://doi.org/10.1145/3394171.3413732
Kaur, S., Kumar, P. and Kumaraguru, P., Automating fake news detection system using multi-level voting model. Soft Computing., 2019, 24(12), 9049–9069. https://doi.org/10.1007/s00500-019-04436-y
Kesarwani, A., Chauhan, S. S. and Nair, A. R.,Fake news detection on social media using k-nearest neighbor classifier. International Conference on Advances in Computing and Communication Engineering (ICACCE)., 2020, https://doi.org/10.1109/icacce49060.2020.9154997
Kurasinski, L. and Mihailescu, R.-C., Towards machine learning explainability in text classification for fake news detection. 2020 19th IEEE International Conference on Machine Learning and Applications (ICMLA)., 2020, https://doi.org/10.1109/icmla51294.2020.00127
Langguth, J., Pogorelov, K., Brenner, S., Filkuková, P. and Schroeder, D. T., Don’t trust your eyes: Image manipulation in the age of deepfakes. Frontiers in Communication., 2021, 6. https://doi.org/10.3389/fcomm.2021.632317
Maddocks, S., ‘A deepfake porn plot intended to Silence me’: Exploring Continuities between pornographic and ‘political’ deep fakes. Porn Studies., 2020, 7(4), 415–423. https://doi.org/10.1080/23268743.2020.1757499
Nguyen, T. T., Pham, Q.-V. and Nguyen, C. M., Deep learning for deepfakes creation and detection: A survey. Computer Vision and Image Understanding., 2022, 223, 103525. https://doi.org/10.1016/j.cviu.2022.103525
Ni, B., Guo, Z., Li, J. and Jiang, M., Improving generalizability of fake news detection methods using propensity score matching., 2020, arXiv.org. https://arxiv.org/abs/2002.00838
Pratiwi, I. Y., Asmara, R. A. and Rahutomo, F., Study of hoax news detection using naïve Bayes classifier in Indonesian language. 2017 11th International Conference on Information & Communication Technology and System (ICTS)., 2017, https://doi.org/10.1109/icts.2017.8265649
Rastogi, S., Mishra, A. K. and Gaur, L., Detection of deepfakes using local features and Convolutional Neural Network. DeepFakes, 2022, 73–89. https://doi.org/10.1201/9781003231493-6
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J. and Niessner, M., FaceForensics++: Learning to detect manipulated facial images. 2019 IEEE/CVF International Conference on Computer Vision (ICCV)., 2019, https://doi.org/10.1109/iccv.2019.00009
Shin, S. Y. and Lee, J., The effect of deepfake video on news credibility and corrective influence of cost-based knowledge about deepfakes. Digital Journalism., 2022, 10(3), 412–432. https://doi.org/10.1080/21670811.2022.2026797
Shu, K., Sliva, A., Wang, S., Tang, J. and Liu, H., Fake news detection on social media: A Data Mining Perspective., 2017, arXiv.org. https://arxiv.org/abs/1708.01967
Siwei Lyu., Detecting “deepfake” videos in the blink of an Eye. The Conversation., 2022, https://theconversation.com/detecting-deepfake-videos-in-the-blink-of-an-eye-101072
Tan, K. L., Poo Lee, C. and Lim, K. M., FN-net: A deep convolutional neural network for fake news detection. 2021 9th International Conference on Information and Communication Technology (ICoICT)., 2021, https://doi.org/10.1109/icoict52021.2021.9527500
Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Morales, A. and Ortega-Garcia, J., Deepfakes and beyond: A survey of face manipulation and fake detection. Information Fusion., 2022, 64, 131–148. https://doi.org/10.1016/j.inffus.2020.06.014
Wang, W. Y., “Liar, Liar Pants On fire”: A new benchmark dataset for fake news detection. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics., 2017, 2, https://doi.org/10.18653/v1/p17-2067
Whittaker, L., Letheren, K. and Mulcahy, R., The rise of Deepfakes: A conceptual framework and research agenda for marketing. Australasian Marketing Journal., 2021, 29(3), 204–214. https://doi.org/10.1177/1839334921999479
Zhou, X., Wang, Y. and Wu, P., Detecting deepfake videos via frame serialization learning. IEEE 3rd International Conference of Safe Production and Informatization (IICSPI)., 2020, https://doi.org/10.1109/iicspi51290.2020.9332419
Zubiaga, A., Aker, A., Bontcheva, K., Liakata, M. and Procter, R., Detection and resolution of rumours in social media. ACM Computing Surveys., 2018, 51(2), 1–36. https://doi.org/10.1145/3161603
Vatreš, A., ‘Deepfake Phenomenon: An advanced form of fake news and its implications on reliable journalism’, Društvene i humanističke studije (Online)., 2022, 6(3(16)), pp. 561–576. doi:10.51558/2490-3647.2021.6.3.561.
Cover, R., Haw, A. and Thompson, J.D., ‘The visual in an era of hyperreality and disinformation: The deepfake video’, Fake News in Digital Cultures: Technology, Populism and Digital Misinformation., 2022, pp. 63–76. doi:10.1108/978-1-80117-876-120221005.
Kaliyar, R.K., Goswami, A. and Narang, P., ‘Deepfake: Improving fake news detection using tensor decomposition-based deep neural network’, The Journal of Supercomputing., 2020, 77(2), pp. 1015–1037. doi:10.1007/s11227-020-03294-y.
Giansiracusa, N., ‘Deepfake Deception’, How Algorithms Create and Prevent Fake News., 2021, pp. 41–66. doi:10.1007/978-1-4842-7155-1_3.
Lyu, S., ‘Fighting AI-synthesized fake media’, Proceedings of the 1st Workshop on Synthetic Multimedia - Audiovisual Deepfake Generation and Detection., 2021, doi:10.1145/3476099.3482881.
Hwang, Y., Ryu, J.Y. and Jeong, S.-H., ‘Effects of disinformation using deepfake: The protective effect of Media Literacy Education’, Cyberpsychology, Behavior, and Social Networking., 2021, 24(3), pp. 188–193. doi:10.1089/cyber.2020.0174.
Han, B. et al., ‘Fighting fake news: Two stream network for Deepfake detection via learnable SRM’, IEEE Transactions on Biometrics, Behavior, and Identity Science., 2021, 3(3), pp. 320–331. doi:10.1109/tbiom.2021.3065735.
Jawad, Z.A. and Obaid, A.J., ‘An overview of rumor and fake news detection approaches’, Advances in Multimedia and Interactive Technologies., 2023, pp. 12–31. doi:10.4018/978-1-6684-6060-3.ch002.
Gaur, L., Ratta, M. and Gaur, A., ‘Future of deepfakes and Ectypes’, DeepFakes., 2022, pp. 135–145. doi:10.1201/9781003231493-11.
Mishra, S., Shukla, P.K. and Agrawal, R., ‘Deepfakes, media, and societal impacts’, DeepFakes., 2022, pp. 115–120. doi:10.1201/9781003231493-9.
Radoli, L. and Langmia, K.,‘Of deepfakes, misinformation, and disinformation’, Black Communication in the Age of Disinformation., 2023, pp. 1–13. doi:10.1007/978-3-031-27696-5_1.
