VisioFace: An Android App Utilizing Deep Learning for Facial Recognition to Aid the Visually Impaired

Authors

  • Chandrashekhar Uppin Department of Computer Science, Baze University, Abuja, Nigeria
  • Gilbert Gorge Department of Computer Science, Baze Univerity, Abuja, Nigeria

Keywords:

facial recognition, visual impairment, Android application, Deep learning, Convolutional Neural Networks (CNNs)

Abstract

Over the years, assistive technologies aimed at helping individuals with visual impairments have undergone significant advancements. These advancements encompass various tools such as screen-reading software, magnification programs, and daisy book readers, offering a wide range of devices to support visually impaired individuals in their daily activities. Despite the proven usefulness of these devices, their widespread adoption has been hindered by certain limitations, including high costs, societal stigma associated with public usage, and a lack of sustained support. However, in the present era, smartphones have become an integral part of our modern lives, featuring advanced camera technology and an array of mobile applications. The continuous enhancements in computer vision and machine learning, particularly on mobile devices, have created an ideal platform for the development of a mobile application solution. Although there are existing similar solutions, they also possess certain drawbacks. Introducing Vision Assist, a mobile application that offers an intuitive user experience by leveraging AI-Driven face recognition. With Vision Assist, users can effortlessly scan their surroundings and receive verbal feedback about the person present by simply tapping anywhere on the screen. This innovative solution capitalizes on the power of AI-Driven and smartphone technology, enabling visually impaired individuals to navigate their environment with ease and confidence.

Downloads

Download data is not yet available.

References

Salihbašić, T. O.-2019 42nd International, and undefined 2019, “Development of android application for gender, age and face recognition using opencv,” ieeexplore.ieee.org, Accessed: Jun. 26, 2023. [Online].

G. Dave, X. Chao, K. S.-D. of Electrical, and undefined 2010, “Face recognition in mobile phones,” researchgate.net, Accessed: Jun. 26, 2023. [Online].

L. Rai, Z. Wang, A. Rodrigo, Z. Deng, and H. Liu, “Software development framework for real-time face detection and recognition in mobile devices,” 2020, doi: 10.3991/ijim.v14i04.12077.

“Real time face recognition with Android + TensorFlow Lite | by esteban uri | Medium.” (accessed Jun. 26, 2023).

Vaishak, S. Hoysala, V. H. Pavankumar, and Mohana, “Currency and Fake Currency Detection using Machine Learning and Image Processing - An Application for Blind People using Android Studio,” International Conference on Automation, Computing and Renewable Systems, ICACRS 2022 - Proceedings, pp. 274–277, 2022, doi: 10.1109/ICACRS55517.2022.10029296.

A. E. Hassanien, M. F. Tolba, and A. T. Azar, “Advanced Machine Learning Technologies and Applications: Second International Conference, AMLTA 2014 Cairo, Egypt, November 28-30, 2014 Proceedings,” Communications in Computer and Information Science, vol. 488, 2014, doi: 10.1007/978-3-319-13461-1.

R. R. A. Bourne et al., “Causes of blindness and vision impairment in 2020 and trends over 30 years, and prevalence of avoidable blindness in relation to VISION 2020: The Right to Sight: An analysis for the Global Burden of Disease Study,” Lancet Glob Health, vol. 9, no. 2, pp. e144–e160, Feb. 2021, doi: 10.1016/S2214-109X(20)30489-7.

A. M. Mulloy, C. Gevarter, M. Hopkins, K. S. Sutherland, and S. T. Ramdoss, “Assistive Technology for Students with Visual Impairments and Blindness,” pp. 113–156, 2014, doi: 10.1007/978-1-4899-8029-8_5.

M. Satrio, A. Putrada, M. A.-P. of Sixth, and undefined 2022, “Evaluation of face detection and recognition methods in smart mirror implementation,” Springer, Accessed: Jun. 26, 2023. [Online].

M. Du, “Mobile payment recognition technology based on face detection algorithm,” Concurr Comput, vol. 30, no. 22, Nov. 2018, doi: 10.1002/CPE.4655.

L. Hakobyan, J. Lumsden, D. O’Sullivan, H. B.-S. of ophthalmology, and undefined 2013, “Mobile assistive technologies for the visually impaired,” Elsevier, doi: 10.1016/j.survophthal.2012.10.004.

S. Szpiro, S. Hashash, Y. Zhao, and S. Azenkot, “How people with low vision access computing devices: Understanding challenges and opportunities,” ASSETS 2016 - Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 171–180, Oct. 2016, doi: 10.1145/2982142.2982168.

T. S. Huang, “Computer vision: Evolution and promise,” 1996, Accessed: Jun. 29, 2023. [Online].

L. Louis and D. A. Patel, “A History and Explanation of Major Neural Network Developments,” 2019, Accessed: Jun. 29, 2023. [Online].

“Signal Processing for Computer Vision - Gösta H. Granlund, Hans Knutsson - Google Books.” (accessed Jun. 29, 2023).

R. Szeliski, “Image processing,” pp. 87–180, 2011, doi: 10.1007/978-1-84882-935-0_3.

M. Ghantous, M. Nahas, M. Ghamloush, and M. Rida, “ISee: An android application for the assistance of the visually impaired,” Communications in Computer and Information Science, vol. 488, pp. 26–35, 2014, doi: 10.1007/978-3-319-13461-1_4.

M. B. Satrio, A. G. Putrada, and M. Abdurohman, “Evaluation of Face Detection and Recognition Methods in Smart Mirror Implementation,” Lecture Notes in Networks and Systems, vol. 236, pp. 449–457, 2022, doi: 10.1007/978-981-16-2380-6_39.

R. David et al., “TensorFlow Lite Micro: Embedded Machine Learning for TinyML Systems,” Proceedings of Machine Learning and Systems, vol. 3, pp. 800–811, Mar. 2021.

L. Dunai, M. Chillarón Pérez, G. Peris-Fajarnés, M. Chillaron, G. P. Fajarnes, and I. L. Lengua, “Face detection and recognition application for Android,” ieeexplore.ieee.org, doi: 10.1109/IECON.2015.7392581.

Perez-Siguas, R. ., Matta-Solis, H. ., Matta-Solis, E. ., Matta-Perez, H. ., Cruzata-Martinez, A. ., & Meneses-Claudio, B. . (2023). Management of an Automatic System to Generate Reports on the Attendance Control of Teachers in a Educational Center. International Journal on Recent and Innovation Trends in Computing and Communication, 11(2), 20–26. https://doi.org/10.17762/ijritcc.v11i2.6106

Ahammad, D. S. K. H. (2022). Microarray Cancer Classification with Stacked Classifier in Machine Learning Integrated Grid L1-Regulated Feature Selection. Machine Learning Applications in Engineering Education and Management, 2(1), 01–10. Retrieved from http://yashikajournals.com/index.php/mlaeem/article/view/18

Downloads

Published

21.09.2023

How to Cite

Uppin, C. ., & Gorge, G. . (2023). VisioFace: An Android App Utilizing Deep Learning for Facial Recognition to Aid the Visually Impaired. International Journal of Intelligent Systems and Applications in Engineering, 11(4), 903–910. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/3625

Issue

Section

Research Article