CNN Model for Analyzing Masked Facial RGB Images Using Cloud Computing

Authors

  • Alyaa J. Jalil, Essam El-Seidy, Sameh S. Daoud, Naglaa M. Reda

Keywords:

Cloud computing, Convolution neural networks, Eye color, Gender classification, Masked faces, Skin color

Abstract

The world invasion of dangerous virus diseases such as Covid 19, in the last few years, force people to wear masks as precaution. Although this prudence reduces the risk of infection and viruses’ spread, it adds difficulty to distinguishing or identifying a person. This paper proposes a method to analyze images of masked persons for classifying their gender, in addition to identifying the colors of their skin and their eyes. We apply residual learning using the convolutional neural network (CNN) based on the visible part of the face. Cloud computing resources have been used as a convenient environment of substantial computing ability. Also, new database of RGB face images was created for testing. Experiments have been operated on the constructed database beside other datasets of facial images after cropping. The proposed model gives 96% gender classification accuracy and 100% skin/eye color identification.

Downloads

Download data is not yet available.

Author Biography

Alyaa J. Jalil, Essam El-Seidy, Sameh S. Daoud, Naglaa M. Reda

Alyaa J. Jalil1, Essam El-Seidy 2, Sameh. S. Daoud3, Naglaa M. Reda4

1Department of Computer Science, Faculty of Computer Science and Information Technology, Basrah University, Basrah, Iraq.

ORCID ID: 0000-0003-1203-9765

2Department of Mathematics, Faculty of Science, Ain Shams University, Cairo, Egypt.

ORCID ID: 0000-0001-6869-7121

3Department of Mathematics, Faculty of Science, Ain Shams University, Cairo, Egypt.

ORCID ID: 0000-0002-0937-8849

4Department of Mathematics, Faculty of Science, Ain Shams University, Cairo, Egypt.

ORCID ID: 0000-0001-6205-9217

1 alyaa.jalil@uobasrah.edu.iq  (ORCID: 0000-0003-1203-9765)

2 essamelseidy@sci.asu.edu.eg (ORCID: 0000-0001-6869-7121)

* Corresponding Author Email: author@email.com

References

H. N. Vu, M. H. Nguyen, and C. Pham, “Masked face recognition with convolutional neural networks and local binary patterns,” Applied Intelligence 52: 5497–5512, 2022, doi: 10.1007/s10489-021-02728-1.

R. Min, A. Hadid, and J. L. Dugelay, “Improving the recognition of faces occluded by facial accessories,” IEEE International Confonference on Automatic Face and Gesture Recogniton (FG) 2011:442–447, 2011, doi: 10.1109/FG.2011.5771439.

V. K. Choudhary, "Cloud Computing and its Applications: A Review," International Journal of Emerging Trends & Technology in Computer Science 5(4):20-27, 2018.

R. Singh, A. Agarwal, M. Singh, S. Nagpal, and M. Vatsa, “On the Robustness of Face Recognition Algorithms Against Attacks and Bias,” AAAI 2020: 13583-13589, doi: 10.1609/aaai.v34i09.7085.

X. Zhang, S. Javed, A. Obeid, J. Dias and N. Werghi, "Gender Recognition on RGB-D Image," IEEE International Conference on Image Processing: 1836-1840, 2020, doi: 10.1109/ICIP40778.2020.9191068.

F. Hafizhelmi and K. Zaman, “Gender classification using custom convolutional neural networks architecture,” IJECE 10(6): 5758–5771, 2020, doi: 10.11591/ijece.v10i6.

F. Abbas, M. Yasmin, M. Fayyaz, M. A. Elaziz, S. Lu, and AAA. El-latif, “Gender Classification Using Proposed CNN-Based Model and Ant Colony Optimization,” Mathematics 9(19):2499, doi:10.3390/math919249.

A. J. Jalil, N. M. Reda, "Infrared Thermal Image Gender Classifier Based on the Deep ResNet Model‏," Advances in Human-Computer Interaction, New York 2022, 2022.

C. Gurel and A. Erden, “Design of a Face Recognition System,” The 15th International Conference on machine design and production, UMTIK:1-12, 2012.

S. Khan, M. H. Javed, E. Ahmed, S. A. A. Shah, and S. U. Ali, “Facial Recognition using Convolutional Neural Networks and Implementation on Smart Glasses,” International Conference on Information Science and Communication Technology:1-6, 2019, doi: 10.1109/CISCT.2019.8777442.

M. K. Hasan, M. S. Ahsan, Abdullah-Al-Mamun, S. H. Newaz SHS, and G. M. Lee, "Human Face Detection Techniques: A Comprehensive Review and Future Research Directions,". Electronics 10(19):2354, 2021, doi: 10.3390/electronics10192354.

A. R. Syafeeza, M. Khalil-Hani, S. S. Liew, and R. Bakhteri, “Convolutional Neural Network for Face Recognition with Pose and Illumination Variation,” International Journal of Engineering and Technology 6(1):44–57, 2014.

L. Song, Di. Gong, Z. Li, C. Liu, and W. Liu, “Occlusion robust face recognition based on mask learning with pairwise differential siamese network,” 2019 IEEE International Conference on Computer Vision 2019:773–782, 2019, doi: 10.1109/ICCV.2019.00086.

H. Deng, Z. Feng, G. Qian, X. Lv, H. Li, and G. Li, “MFCosface: a masked-face recognition algorithm based on large margin cosine loss,” Applied Sciences 11(16):7310, 2021, doi: 10.3390/app11167310.

A. Gupta, Dr. R. Tiwari, “Face Detection Using Modified Viola Jones Algorithm,” International Journal of Recent Research in Mathematics Computer Science and Information Technology 1(2):59–66, 2015.

J. Kaur, A. Sharma, “Performance Analysis of Face Detection by using Viola-Jones algorithm,” International Journal of Computational Intelligence Research 13(5):707–717, 2017.

N. T. Deshpande, Dr. S. Ravishankar, “Face Detection and Recognition using Viola-Jones algorithm and Fusion of PCA and ANN,” Advances in Computational Sciences and Technology 10(5):1173–1189, 2017.

M. K. Sri, P. N. Divya, J. Vyshnavi, and B. Tejaswini, “Detection Of Drowsy Eyes Using Viola Jones Face,” International Journal of Current Engineering and Scientific Research 5(4):375-380, 2018.

K. He, X. Zhang, S. Ren and J. Sun, "Deep Residual Learning for Image Recognition," 2016 IEEE Conference on Computer Vision and Pattern Recognition 2016:770-778, doi: 10.1109/CVPR.2016.90.

R. U. Khan, Xiaosong Zhang, R. Kumar, and E. O. Aboagye, “Evaluating the Performance of ResNet Model Based on Image Recognition,” 2018 International Conference on Computing and Artificial Intelligence 2018:86–90, doi: 10.1145/3194452.3194461.

T. Tuncer, F. Ertam, S. Dogan, and E. Aydemir, “Ensemble residual network‑based gender and activity recognition method with signals,” Journal of Supercomputing 76(3):2119–2138, 2020, doi: 10.1007/s11227-020-03205-1.

S. Kolkur, D. Kalbande, P. Shimpi, C. Bapat, and J. Jatakia, “Human Skin Detection Using RGB, HSV and YCbCr Color Models,” ArXiv abs/1708.02694, 2017.

C. Yadufashije and R. Samuel, “Genetic and environmental factors in skin color determination,” African Journal of Biological Sciences 1(2):51-54, 2019, doi: 10.33472/AFJBS.1.2.2019.51-54.

A. Dantcheva, S. Antipolis, N. Erdogmus, J. Dugelay, and S. Antipolis, “On the Reliability of Eye Color Classification as a Soft Biometrics Trait,” 2011 IEEE Workshop on Applications of Computer Vision (WACV):227-231, 2011.

J. A. Nasiri, S. Khanchi and H. R. Pourreza, "Eye Detection Algorithm on Facial Color Images," 2008 Second Asia International Conference on Modelling & Simulation (AMS):344-349, 2008, doi: 10.1109/AMS.2008.55.

F. Li, M. Andreeto, M Ranzato, and P. Perona, Caltech 101 (1.0) [Data set]. CaltechDATA, 2022, doi: 10.22002/D1.20086

https://www.kaggle.com/datasets/jessicali9530/celeba-dataset

Downloads

Published

17.02.2023

How to Cite

Alyaa J. Jalil, Essam El-Seidy, Sameh S. Daoud, Naglaa M. Reda. (2023). CNN Model for Analyzing Masked Facial RGB Images Using Cloud Computing. International Journal of Intelligent Systems and Applications in Engineering, 11(2), 648–654. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/2783

Issue

Section

Research Article