Self-Supervised Learning (SSL): Enhancing Few-Shot Image Classification with Limited Labeled Data Exploration

Authors

  • K. Nirmaladevi Assistant Professor, Department of Computer Science and Engineering, Panimalar Engineering College, Chennai
  • K. Revathi Research Scholar & Assistant Professor, Department of Information Technology, SNS College of Engineering, Coimbatore
  • K.B. Kishore Mohan Professor & Head, Department of Bio Medical Engineering, Sri Shanmugha College of Engineering and Technology - [SSCET], Sankari, Salem
  • J. Jayapradha Department of Computing Technologies, SRM Institute of Science and Technology, Kattankulathur, Tamil Nadu 603203, India
  • T. Senthil Kumar Department of Computing Technologies, SRM Institute of Science and Technology, Kattankulathur, Tamil Nadu 603203, India

Keywords:

Self-supervised learning, Few-shot image classification, Labeled data scarcity, feature extraction, contrastive learning

Abstract

This research investigates the application of self-supervised learning techniques to enhance few-shot image classification in scenarios with limited labeled data. Traditional supervised learning approaches often struggle in settings where annotated examples are scarce. The study focuses on developing strategies to augment the effectiveness of few-shot image classification models when confronted with a shortage of labeled training samples. The proposed approach involves employing self-supervised learning (SSL) methods to uncover latent patterns and representations within the unlabeled data, allowing the model to generalize more effectively to new classes with minimal labeled instances. Various self-supervised learning strategies, including contrastive learning and temporal consistency, are examined to enhance feature extraction and classification performance. Through experimentation on CIFAR-100 datasets, it is demonstrated that the self-supervised learning framework significantly improves few-shot image classification accuracy compared to traditional supervised approaches. Furthermore, the implications of the findings for real-world applications, where acquiring labeled data is resource-intensive or impractical, are discussed. This research contributes valuable insights into the synergy between self-supervised learning and few-shot image classification, offering a promising avenue for addressing data scarcity challenges in image recognition tasks.

Downloads

Download data is not yet available.

References

Islam, A. R. (2022). Machine learning in computer vision. In Applications of Machine Learning and Artificial Intelligence in Education (pp. 48-72). IGI Global.

Odu, A., Steve, M., & Adedokun, D. (2023). Leveraging Contrastive Learning with Auxiliary Generators for Improved Few-Shot Learning in Remote Sensing Applications.

Li, Z., Guo, H., Chen, Y., Liu, C., Du, Q., & Fang, Z. (2023). Few-shot hyperspectral image classification with self-supervised learning. IEEE Transactions on Geoscience and Remote Sensing.

Lim, J. Y., Lim, K. M., Lee, C. P., & Tan, Y. X. (2023). SCL: Self-supervised contrastive learning for few-shot image classification. Neural Networks, 165, 19-30.

Ericsson, L., Gouk, H., Loy, C. C., & Hospedales, T. M. (2022). Self-supervised representation learning: Introduction, advances, and challenges. IEEE Signal Processing Magazine, 39(3), 42-62.

Chaudhari, A., Bhatt, C., Krishna, A., & Travieso-González, C. M. (2023). Facial emotion recognition with inter-modality-attention-transformer-based self-supervised learning. Electronics, 12(2), 288.

Albelwi, S. (2022). Survey on self-supervised learning: auxiliary pretext tasks and contrastive learning methods in imaging. Entropy, 24(4), 551.

Tao, C., Wang, H., Zhu, X., Dong, J., Song, S., Huang, G., & Dai, J. (2022). Exploring the equivalence of siamese self-supervised learning via a unified gradient framework. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 14431-14440).

Han, H., Huang, Y., & Wang, Z. (2023). Collaborative Self-Supervised Transductive Few-Shot Learning for Remote Sensing Scene Classification. Electronics, 12(18), 3846.

Snell, J., Swersky, K., & Zemel, R. (2017). Prototypical networks for few-shot learning. Advances in neural information processing systems, 30.

Sung, F., Yang, Y., Zhang, L., Xiang, T., Torr, P. H., & Hospedales, T. M. (2018). Learning to compare: Relation network for few-shot learning. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1199-1208).

Chen, W. Y., Liu, Y. C., Kira, Z., Wang, Y. C. F., & Huang, J. B. (2019). A closer look at few-shot classification. arXiv preprint arXiv:1904.04232.

Medina, C., Devos, A., & Grossglauser, M. (2020). Self-supervised prototypical transfer learning for few-shot classification. arXiv preprint arXiv:2006.11325.

Li, P., Zhao, G., & Xu, X. (2022). Coarse-to-fine few-shot classification with deep metric learning. Information Sciences, 610, 592-604.

Downloads

Published

07.02.2024

How to Cite

Nirmaladevi, K. ., Revathi, K. ., Kishore Mohan, K. ., Jayapradha, J. ., & Kumar, T. S. . (2024). Self-Supervised Learning (SSL): Enhancing Few-Shot Image Classification with Limited Labeled Data Exploration. International Journal of Intelligent Systems and Applications in Engineering, 12(15s), 437 –. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/4767

Issue

Vol. 12 No. 15s (2024)

Section

Research Article

License

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.

IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.