Fusion of Colour, Texture, and Shape Features with Supervised Learning Model for Content Based Image Retrieval

Authors

  • Shilpa Marathe School of Interdisciplinary Studies and Resarch DY Patil International University, Akurdi Pune-411044, Maharashtra
  • Sirshendu Arosh Department of Electrical Engineering Asansol Engineering College (AEC) Asansol-713305, West Bengal

Keywords:

Content-based Image Retrieval, Cartoon texture, F-Score, Accuracy, Neighbourhood Component Analysis, Support Vector Machine.

Abstract

To overcome a challenge in the field of imaging, Content-based Image Retrieval (CBIR) is used to find digital images in large datasets. When distinct functionalities are employed separately, the majority of present imaging systems provide less accuracy. Shape, texture, and colour are examples of low-level characteristics that are used to store various sets of models in the database. Based on the query images, related categories of images are then fetched. This paper proposes the hybrid approach of different shape, texture (cartoon feature) and colour feature. Further fuse features will be selected by neighbourhood Component Analysis (NCA) for machine learning i.e. SVM training. Validation of simulation results is achieved by using several databases. Experiments have shown that the accuracy of a NCA selected features in Corel dataset is up to 96%. The simulation results show strong performance based on recall, precision, accuracy, and F-score.

Downloads

Download data is not yet available.

References

Wan, Ji, Dayong Wang, Steven Chu Hong Hoi, Pengcheng Wu, Jianke Zhu, Yongdong Zhang, and Jintao Li. "Deep learning for content-based image retrieval: A comprehensive study." In Proceedings of the 22nd ACM international conference on Multimedia, pp. 157-166. 2014.

Lande, Milind V., Praveen Bhanodiya, and Pritesh Jain. "An effective content-based image retrieval using color, texture and shape feature." In Intelligent Computing, Networking, and Informatics, pp. 1163-1170. Springer, New Delhi, 2014.

Agarwal, Swati, Anil Kumar Verma, and Preetvanti Singh. "Content based image retrieval using discrete wavelet transform and edge histogram descriptor." In 2013 International Conference on Information Systems and Computer Networks, pp. 19-23. IEEE, 2013.

Tunga, Satish, D. Jayadevappa, and C. Gururaj. "A comparative study of content based image retrieval trends and approaches." International Journal of Image Processing (IJIP) 9, no. 3 (2015): 127-155.

Nazir, A., Ashraf, R., Hamdani, T. and Ali, N., 2018, March. Content based image retrieval system by using HSV color histogram, discrete wavelet transform and edge histogram descriptor. In 2018 international conference on computing, mathematics and engineering technologies (iCoMET) (pp. 1-6). IEEE.

Wang, X.Y., Liang, L.L., Li, Y.W. and Yang, H.Y., 2017. Image retrieval based on exponent moments descriptor and localized angular phase histogram. Multimedia Tools and Applications, 76(6), pp.7633-7659.

Liu, Guang-Hai, and Jing-Yu Yang. "Content-based image retrieval using color difference histogram." Pattern recognition 46, no. 1 (2017): 188-198.

Lasmar, Nour-Eddine, and Yannick Berthoumieu. "Gaussian copula multivariate modeling for texture image retrieval using wavelet transforms." IEEE Transactions on Image Processing 23, no. 5 (2018): 2246-2261.

Wang, Xinjian, Guangchun Luo, and Ke Qin. "A composite descriptor for shape image retrieval." In 2018 International Conference on Automation, Mechanical Control and Computational Engineering. Atlantis Press, 2018.

Wang, Xiang-Yang, Bei-Bei Zhang, and Hong-Ying Yang. "Content-based image retrieval by integrating color and texture features." Multimedia tools and applications 68, no. 3 (2019): 545-569.

Basu, S., Karki, M., Ganguly, S., DiBiano, R., Mukhopadhyay, S., Gayaka, S., Kannan, R. and Nemani, R., 2017. Learning sparse feature representations using probabilistic quadtrees and deep belief nets. Neural Processing Letters, 45(3), pp.855-867.

Chandrasekhar, Vijay, Jie Lin, Qianli Liao, Olivier Morere, Antoine Veillard, Lingyu Duan, and Tomaso Poggio. "Compression of deep neural networks for image instance retrieval." In 2017 Data Compression Conference (DCC), pp. 300-309. IEEE, 2017.

Yu, Wei, Kuiyuan Yang, Hongxun Yao, Xiaoshuai Sun, and Pengfei Xu. "Exploiting the complementary strengths of multi-layer CNN features for image retrieval." Neurocomputing 237 (2017): 235-241.

Tzelepi, Maria, and Anastasios Tefas. "Deep convolutional learning for content based image retrieval." Neurocomputing 275 (2018): 2467-2478.

Sugamya, Katta, Suresh Pabboju, and A. Vinaya Babu. "A CBIR classification using support vector machines." In 2016 International Conference on Advances in Human Machine Interaction (HMI), pp. 1-6. IEEE, 2016.

Sarwar, Amna, Zahid Mehmood, Tanzila Saba, Khurram Ashfaq Qazi, Ahmed Adnan, and Habibullah Jamal. "A novel method for content-based image retrieval to improve the effectiveness of the bag-of-words model using a support vector machine." Journal of Information Science 45, no. 1 (2019): 117-135.

Wang, Xiang-Yang, Hong-Ying Yang, and Dong-Ming Li. "A new content-based image retrieval technique using color and texture information." Computers & Electrical Engineering 39, no. 3 (2013): 746-761.

Manoharan, S., and S. Sathappan. "A novel approach for content based image retrieval using hybrid filter techniques." In 2013 8th International Conference on Computer Science & Education, pp. 518-524. IEEE, 2013.

Chen, Heng, Zhicheng Zhao, Anni Cai, and Xiaohui Xie. "An effective relevance feedback algorithm for image retrieval." In 2010 2nd IEEE International Conference on Network Infrastructure and Digital Content, pp. 251-255. IEEE, 2010.

Yalavarthi, A., Veeraswamy, K. and Sheela, K.A., 2017, July. Content based image retrieval using enhanced Gabor wavelet transform. In 2017 International Conference on Computer, Communications and Electronics (Comptelix) (pp. 339-343). IEEE.

Latif, A., Rasheed, A., Sajid, U., Ahmed, J., Ali, N., Ratyal, N.I., Zafar, B., Dar, S.H., Sajid, M. and Khalil, T., 2019. Content-based image retrieval and feature extraction: a comprehensive review. Mathematical Problems in Engineering, 2019.

Mahajan, R. ., Patil, P. R. ., Potgantwar, A. ., & Bhaladhare, P. R. . (2023). Novel Load Balancing Optimization Algorithm to Improve Quality-of-Service in Cloud Environment. International Journal on Recent and Innovation Trends in Computing and Communication, 11(2), 57–64. https://doi.org/10.17762/ijritcc.v11i2.6110

Ashraf, R., Ahmed, M., Jabbar, S., Khalid, S., Ahmad, A., Din, S. and Jeon, G., 2018. Content based image retrieval by using color descriptor and discrete wavelet transform. Journal of medical systems, 42(3), pp.1-12.

Bhunia, A.K., Bhattacharyya, A., Banerjee, P., Roy, P.P. and Murala, S., 2020. A novel feature descriptor for image retrieval by combining modified color histogram and diagonally symmetric co-occurrence texture pattern. Pattern Analysis and Applications, 23(2), pp.703-723.

Mistry, Y., Ingole, D.T. and Ingole, M.D., 2018. Content based image retrieval using hybrid features and various distance metric. Journal of Electrical Systems and Information Technology, 5(3), pp.874-888.

Ahmed, K.T., Ummesafi, S. and Iqbal, A., 2019. Content based image retrieval using image features information fusion. Information Fusion, 51, pp.76-99.

Cai, J., Luo, J., Wang, S. and Yang, S., 2018. Feature selection in machine learning: A new perspective. Neurocomputing, 300, pp.70-79.

Yang, W., Wang, K. and Zuo, W., 2012. Neighborhood component feature selection for high-dimensional data. J. Comput., 7(1), pp.161-168.

Griffin, Gregory, Alex Holub, and Pietro Perona. "Caltech-256 object category dataset." (2007).

Wang, J.Z., Li, J. and Wiederhold, G., 2001. SIMPLIcity: Semantics-sensitive integrated matching for image libraries. IEEE Transactions on pattern analysis and machine intelligence, 23(9), pp.947-963.

Pise, D. P. . (2021). Bot Net Detection for Social Media Using Segmentation with Classification Using Deep Learning Architecture. Research Journal of Computer Systems and Engineering, 2(1), 11:15. Retrieved from https://technicaljournals.org/RJCSE/index.php/journal/article/view/13

Patil, Priyadarshini, and Bhagya Sunag. "Analysis of image retrieval techniques based on content." In 2015 IEEE International Advance Computing Conference (IACC), pp. 958-962. IEEE, 2015.

Gali, Raghupathi, M. L. Dewal, and R. S. Anand. "Genetic algorithm for content based image retrieval." In 2012 fourth international conference on computational intelligence, Communication Systems and Networks, pp. 243-247. IEEE, 2012.

Vikhar, Pradnya, and Pravin Karde. "Improved CBIR system using edge histogram descriptor (EHD) and support vector machine (SVM)." In 2016 International Conference on ICT in Business Industry & Government (ICTBIG), pp. 1-5. IEEE, 2016.

Ansari, Mohd Aquib, Manish Dixit, Diksha Kurchaniya, and Punit Kumar Johari. "An Effective Approach to an Image Retrieval using SVM Classifier." database 1 (2017): 2.

Schematic of a query in a CBIR System

Downloads

Published

01.07.2023

How to Cite

Marathe, S. ., & Arosh, S. . (2023). Fusion of Colour, Texture, and Shape Features with Supervised Learning Model for Content Based Image Retrieval. International Journal of Intelligent Systems and Applications in Engineering, 11(7s), 406–423. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/2965