Enhancing Cold Cases Forensic Identification with DCGAN-based Personal Image Reconstruction
DOI:
https://doi.org/10.21123/bsj.2024.10896Keywords:
DCGAN, Deep Learning, Forensic Image Reconstructing, pix2pix Translation, Sketch-to-ImageAbstract
With the improvement of artificial intelligence and deep learning techniques, especially deep convolutional generative adversarial network (DCGAN), there has been a significant development in personal identity and generating images through facial reconstruction systems. This study focuses on proposing a model of personal image reconstruction from forensic sketches using DCGAN. The model comprises two networks: a generator to convert sketch images into real images and a feature network to determine the similarity of the generated images to real ones. Forensic sketches provided by relevant authorities are used as inputs to the proposed model. These sketches include details and information on the perpetrators or missing persons obtained from witnesses or the missing person parents. Prominent facial features extracted from the reconstructed images aid in the process of personal image reconstruction. The proposed model shows good results, achieving up to 99% accuracy in the generated images. The error ratio is reported to be as low as 0.92% based on the evaluation using the CUHKFaces dataset. This study presents a new approach to reconstructing human face images from forensic sketches using DCGAN.
Received 08/02/2024
Revised 21/05/2024
Accepted 23/05/2024
Published Online First 20/09/2024
References
Epskamp-Dudink C, Winter JM. Benefits of scenario reconstruction in cold case investigations. J Crim Psychol 2020; 10(2): 65–78. https://doi.org/10.1108/JCP-09-2019-0035
Toolin K, van Langeraad A, Hoi V, Scott A, Gabbert F. Psychological contributions to cold case investigations: A systematic review. Forensic Sci Int 2022; 5. https://doi.org/10.1016/j.fsisyn.2022.100294
Radford A, Metz L, Chintala S. Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks. arXiv:1511.06434. 2015. https://doi.org/10.48550/arXiv.1511.06434
Arnob NMK, Rahman NN, Mahmud S, et al. Facial Image Generation from Bangla Textual Description using DCGAN and Bangla FastText. Int J Adv Comput Sci Appl. 2023; 14(6): 2023. https://doi.org/10.14569/IJACSA.2023.01406134
Liu B, Lv J, Fan X, Luo J, Zou T. Application of an Improved DCGAN for Image Generation. Mob Inf Syst. 2022; 2022(1), 9005552 . https://doi.org/10.1155/2022/9005552
Wu Q, Chen Y, Meng J. Dcgan-based data augmentation for tomato leaf disease identification. IEEE Access. 2020; 8: 98716-98728. https://doi.org/10.1109/ACCESS.2020.2997001
Li Zecheng, Wan Qianduoer. Generating Anime Characters and Experimental Analysis Based on DCGAN Model. In: Proceedings - 2021 2nd International Conference on Intelligent Computing and Human-Computer Interaction, ICHCI 2021 Institute of Electrical and Electronics Engineers Inc.; 2021; pp. 27–31. https://doi.org/10.1109/ICHCI54629.2021.00013
Yin X, Hou B, Huang Y, Li C, Fan Z, Liu J. Image Enhancement Method Based on Improved DCGAN for Limit Sample. In: Proceedings - 2022 14th International Conference on Measuring Technology and Mechatronics Automation, ICMTMA 2022 Institute of Electrical and Electronics Engineers Inc.; 2022; 376–379. https://doi.org/10.1109/ICMTMA54903.2022.00078
Jadli A, Hain M, Chergui A, Jaize A. DCGAN-Based Data Augmentation for Document Classification. In: 2020 IEEE 2nd International Conference on Electronics, Control, Optimization and Computer Science, ICECOCS 2020 Institute of Electrical and Electronics Engineers Inc.; 2020. https://doi.org/10.1109/ICECOCS50124.2020.9314379
Liu W, Gu Y, Zhang K. Face Generation Using DCGAN for Low Computing Resources. In: Proceedings - 2021 2nd International Conference on Big Data and Artificial Intelligence and Software Engineering, ICBASE 2021 Institute of Electrical and Electronics Engineers Inc.; 2021; 377–382. https://doi.org/10.1109/ICBASE53849.2021.00076
Koç Canan, Özyurt Fatih. An examination of synthetic images produced with DCGAN according to the size of data and epoch. FUJECE 2023; 2(1): 32–37. https://doi.org/10.5505/fujece.2023.69885
Ammar S, Bouwmans T, Neji M. Face Identification Using Data Augmentation Based on the Combination of DCGANs and Basic Manipulations. Information (Switzerland) 2022; 13(8). 370. https://doi.org/10.3390/info13080370
Heusel M, Ramsauer H, Unterthiner T, Nessler B, Hochreiter S. GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium. arXiv:1706.08500. 2017; 30. https://doi.org/10.18034/ajase. v8i1.9
Gao H, Zhang Y, Lv W, Yin J, Qasim T, Wang D. A Deep Convolutional Generative Adversarial Networks-Based Method for Defect Detection in Small Sample Industrial Parts Images. Appl Sci. 2022; 12(13): 6569. https://doi.org/10.3390/app12136569
Choi JY, Lee B. Ensemble of Deep Convolutional Neural Networks with Gabor Face Representations for Face Recognition. IEEE Trans Image Process. 2020; 29: 3270–3281. https://doi.org/10.1109/TIP.2019.2958404
Wu Y, He K. Group Normalization. arXiv:1803.08494. 2018; 742 - 755. https://doi.org/10.48550/arXiv.1803.08494
Mullery S, Whelan PF. Batch Normalization in the final layer of generative networks. arXiv:1805.07389 2018.
Kumar Yadav N, Kumar Singh S, Ram Dubey S. TVA-GAN: Attention Guided Generative Adversarial Network for Thermal to Visible image transformations. Neural Comput Appl. 2023; 35: 19729–19749. https://doi.org/10.36227/techrxiv.14393243.v1
Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde Farley D, Ozair S et al. Generative adversarial networks. Commun ACM 2020; 63(11): 139–144. https://doi.org/10.1145/3422622
Creswell A, White T, Dumoulin V, et al. Generative Adversarial Networks: An Overview. IEEE Signal Process. Mag. 2018; 35(1): 53–65. https://doi.org/10.1109/MSP.2017.2765202
Downloads
Issue
Section
License
Copyright (c) 2024 Hasan Sabah K. AL-Muttairi, Sefer Kurnaz, Abbas Fadhil Aljuboori
This work is licensed under a Creative Commons Attribution 4.0 International License.