Enhancing Cold Cases Forensic Identification with DCGAN-based Personal Image Reconstruction

Authors

  • Hasan Sabah K. AL-Muttairi Department of Electrical and Computer Engineering, Altinbas University, Istanbul, Turkey. https://orcid.org/0009-0006-8671-008X
  • Sefer Kurnaz Department of Electrical and Computer Engineering, Altinbas University, Istanbul, Turkey.
  • Abbas Fadhil Aljuboori College of Engineering and Information Technology, AlShaab University, Baghdad, Iraq.

DOI:

https://doi.org/10.21123/bsj.2024.10896

Keywords:

DCGAN, Deep Learning, Forensic Image Reconstructing, pix2pix Translation, Sketch-to-Image

Abstract

With the improvement of artificial intelligence and deep learning techniques, especially deep convolutional generative adversarial network (DCGAN), there has been a significant development in personal identity and generating images through facial reconstruction systems. This study focuses on proposing a model of personal image reconstruction from forensic sketches using DCGAN. The model comprises two networks: a generator to convert sketch images into real images and a feature network to determine the similarity of the generated images to real ones. Forensic sketches provided by relevant authorities are used as inputs to the proposed model. These sketches include details and information on the perpetrators or missing persons obtained from witnesses or the missing person parents. Prominent facial features extracted from the reconstructed images aid in the process of personal image reconstruction. The proposed model shows good results, achieving up to 99% accuracy in the generated images. The error ratio is reported to be as low as 0.92% based on the evaluation using the CUHKFaces dataset. This study presents a new approach to reconstructing human face images from forensic sketches using DCGAN.

References

Epskamp-Dudink C, Winter JM. Benefits of scenario reconstruction in cold case investigations. J Crim Psychol 2020; 10(2): 65–78. https://doi.org/10.1108/JCP-09-2019-0035

Toolin K, van Langeraad A, Hoi V, Scott A, Gabbert F. Psychological contributions to cold case investigations: A systematic review. Forensic Sci Int 2022; 5. https://doi.org/10.1016/j.fsisyn.2022.100294

Radford A, Metz L, Chintala S. Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks. arXiv:1511.06434. 2015. https://doi.org/10.48550/arXiv.1511.06434

Arnob NMK, Rahman NN, Mahmud S, et al. Facial Image Generation from Bangla Textual Description using DCGAN and Bangla FastText. Int J Adv Comput Sci Appl. 2023; 14(6): 2023. https://doi.org/10.14569/IJACSA.2023.01406134

Liu B, Lv J, Fan X, Luo J, Zou T. Application of an Improved DCGAN for Image Generation. Mob Inf Syst. 2022; 2022(1), 9005552 . https://doi.org/10.1155/2022/9005552

Wu Q, Chen Y, Meng J. Dcgan-based data augmentation for tomato leaf disease identification. IEEE Access. 2020; 8: 98716-98728. https://doi.org/10.1109/ACCESS.2020.2997001

Li Zecheng, Wan Qianduoer. Generating Anime Characters and Experimental Analysis Based on DCGAN Model. In: Proceedings - 2021 2nd International Conference on Intelligent Computing and Human-Computer Interaction, ICHCI 2021 Institute of Electrical and Electronics Engineers Inc.; 2021; pp. 27–31. https://doi.org/10.1109/ICHCI54629.2021.00013

Yin X, Hou B, Huang Y, Li C, Fan Z, Liu J. Image Enhancement Method Based on Improved DCGAN for Limit Sample. In: Proceedings - 2022 14th International Conference on Measuring Technology and Mechatronics Automation, ICMTMA 2022 Institute of Electrical and Electronics Engineers Inc.; 2022; 376–379. https://doi.org/10.1109/ICMTMA54903.2022.00078

Jadli A, Hain M, Chergui A, Jaize A. DCGAN-Based Data Augmentation for Document Classification. In: 2020 IEEE 2nd International Conference on Electronics, Control, Optimization and Computer Science, ICECOCS 2020 Institute of Electrical and Electronics Engineers Inc.; 2020. https://doi.org/10.1109/ICECOCS50124.2020.9314379

Liu W, Gu Y, Zhang K. Face Generation Using DCGAN for Low Computing Resources. In: Proceedings - 2021 2nd International Conference on Big Data and Artificial Intelligence and Software Engineering, ICBASE 2021 Institute of Electrical and Electronics Engineers Inc.; 2021; 377–382. https://doi.org/10.1109/ICBASE53849.2021.00076

Koç Canan, Özyurt Fatih. An examination of synthetic images produced with DCGAN according to the size of data and epoch. FUJECE 2023; 2(1): 32–37. https://doi.org/10.5505/fujece.2023.69885

Ammar S, Bouwmans T, Neji M. Face Identification Using Data Augmentation Based on the Combination of DCGANs and Basic Manipulations. Information (Switzerland) 2022; 13(8). 370. https://doi.org/10.3390/info13080370

Heusel M, Ramsauer H, Unterthiner T, Nessler B, Hochreiter S. GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium. arXiv:1706.08500. 2017; 30. https://doi.org/10.18034/ajase. v8i1.9

Gao H, Zhang Y, Lv W, Yin J, Qasim T, Wang D. A Deep Convolutional Generative Adversarial Networks-Based Method for Defect Detection in Small Sample Industrial Parts Images. Appl Sci. 2022; 12(13): 6569. https://doi.org/10.3390/app12136569

Choi JY, Lee B. Ensemble of Deep Convolutional Neural Networks with Gabor Face Representations for Face Recognition. IEEE Trans Image Process. 2020; 29: 3270–3281. https://doi.org/10.1109/TIP.2019.2958404

Wu Y, He K. Group Normalization. arXiv:1803.08494. 2018; 742 - 755. https://doi.org/10.48550/arXiv.1803.08494

Mullery S, Whelan PF. Batch Normalization in the final layer of generative networks. arXiv:1805.07389 2018.

Kumar Yadav N, Kumar Singh S, Ram Dubey S. TVA-GAN: Attention Guided Generative Adversarial Network for Thermal to Visible image transformations. Neural Comput Appl. 2023; 35: 19729–19749. https://doi.org/10.36227/techrxiv.14393243.v1

Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde Farley D, Ozair S et al. Generative adversarial networks. Commun ACM 2020; 63(11): 139–144. https://doi.org/10.1145/3422622

Creswell A, White T, Dumoulin V, et al. Generative Adversarial Networks: An Overview. IEEE Signal Process. Mag. 2018; 35(1): 53–65. https://doi.org/10.1109/MSP.2017.2765202

Downloads

Issue

Section

article

How to Cite

1.
Enhancing Cold Cases Forensic Identification with DCGAN-based Personal Image Reconstruction. Baghdad Sci.J [Internet]. [cited 2024 Sep. 27];22(4). Available from: https://bsj.uobaghdad.edu.iq/index.php/BSJ/article/view/10896