Machine Learning Model for Optical Character Recognition-Based Food Allergen Detection with Recommendation System for Alternative Food


  • Rugved Borade, Arishi Gupta, Anupriya Kathpalia, Tanish Jain, Priti Chakurkar


OCR, Regular Expressions, Recommendation, Database, Food packages, Allergies, Cosine Similarity


In today’s diverse and fast-paced food industry, ensuring consumer safety and meeting specific dietary needs is of paramount importance. Food allergen detection and recommendation systems have emerged as crucial tools to address these concerns. This project aims to create an innovative OCR based solution for automating the identification of allergenic ingredients on food packaging labels. By combining Optical Character Recognition (OCR) technology with a comprehensive allergen database, the system will provide real-time allergen information to consumers. Moreover, it will recommend suitable food alternatives for individuals with specific dietary restrictions, enhancing their shopping experience and reducing the risk of allergen-related incidents. The allergen knowledge base is implemented using several machine learning algorithms and will be updated constantly. This holistic approach not only promotes food safety but also empowers consumers to make informed choices, fostering a healthier and more inclusive food environment.


Download data is not yet available.


Fiocchi A, Fierro V. Food Allergy [Internet]. World Allergy Organization. 2017 [cited 2024 Jan 9]. Avail-able from:

Kattan J. The Prevalence and Natural History of Food Allergy. Current Allergy and Asthma Reports. 2016 Jun 22;16(7).

Lieberman JA, Gupta R, Knibb RC, Haselkorn T, Tilles S, Mack DP, et al. The Global Burden of Illness of Peanut Allergy: A Comprehensive Literature Re-view. Allergy. 2020 Nov 20;76(5).

Li J, Ogorodova LM, Mahesh PA, Wang MH, Fedo-rova OS, Leung TF, et al. Comparative Study of Food Allergies in Children from China, India, and Russia: The EuroPrevall-INCO Surveys. The Journal of Aller-gy and Clinical Immunology: In Practice [Internet]. 2019 Dec; Available from:

Fiocchi A, Risso D, DunnGalvin A, González Díaz SN, Monaci L, Fierro V, et al. Food labeling issues for se-vere food allergic patients. World Allergy Organization Journal. 2021 Oct;14(10):100598.

Lu Y, Shi Z, Liu Q. Smartphone-based biosensors for portable food evaluation. Current Opinion in Food Science. 2019 Aug; 28:74–81.

Joshi K. Study of Tesseract OCR. GLS KALP – Jour-nal of Multidisciplinary Studies [Internet]. 2021 Mar 28 [cited 2024 Jan 9];1(2):41–51. Available from:

Hegghammer T. OCR with Tesseract, Amazon Tex-tract, and Google Document AI: a benchmarking ex-periment. Journal of Computational Social Science. 2021 Nov 22;

B. Rohini, Divya Madhuri Pavuluri, LS Naresh Kumar, V Soorya, J Aravinth. A Framework to Identify Aller-gen and Nutrient Content in Fruits and Packaged Food using Deep Learning and OCR. 2021 Mar 19;

Kamis P, Ok Keun Shin. OCR-Based Safety Check System of Packaged Food for Food Inconvenience Patients. Dijiteolkeontencheuhakoenonmunji. 2020 Jun 30;21(6):1025–32.

Wikipedia contributors. Regular expression [Internet]. Wikipedia. Wikipedia, The Free Encyclopedia; 2024 [cited 2024 Jan 9]. Available from:

Lahitani AR, Permanasari AE, Setiawan NA. Cosine similarity to determine similarity measure: Study case in online essay assessment [Internet]. IEEE Xplore. 2016 [cited 2021 Jun 2]. p. 1–6. Available from:

Shah, Priyanshi Sanghvi, Shikhar. Video Recom-mender System. 2020

F. De Sousa Ribeiro et al., "An End-to-End Deep Neu-ral Architecture for Optical Character Verification and Recognition in Retail Food Packaging," 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece, 2018, pp. 2376-2380, doi: 10.1109/ICIP.2018.8451555.

Chen, Y., Subburathinam, A., Chen, C.H. and Zaki, M.J., 2021, March. Personalized food recommenda-tion as constrained question answering over a large-scale food knowledge graph. In Proceedings of the 14th ACM International Conference on Web Search and Data Mining (pp. 544-552).




How to Cite

Rugved Borade,. (2024). Machine Learning Model for Optical Character Recognition-Based Food Allergen Detection with Recommendation System for Alternative Food. International Journal of Intelligent Systems and Applications in Engineering, 12(21s), 1869–1875. Retrieved from



Research Article