Enhancing Aspect Term Extraction from Customer Reviews with Sparse Gated Recurrent Units (SGRUs) in the Context of BERT and NER
Keywords:
Aspect Term Extraction, Customer Reviews, aspect-based sentiment analysis (ABSA), Sparse Gated Recurrent Units (SGRUs), Named Entity Recognition (NER), Aspect Term Extraction (ATE), Aspect Polarity Classification (APC)Abstract
A product evaluation system is a potent instrument that analyzes many online product reviews and recommends suitable products to consumers. A large amount of unlabeled data can be found on social networking sites. Fine-grained data annotation, on the other hand, is both costly and time-consuming. Aspect-based sentiment analysis (ABSA) aims to identify aspect terms in online reviews and predict their polarity. Sentiment analysis is a difficult and complex operation. Common subtasks include Aspect Term Extraction (ATE) and Aspect Polarity Classification (APC). When these two subtasks are trained independently, the relationship between ATE and APC should be addressed. Extracting aspect phrases from customer evaluations is crucial for sentiment analysis and opinion mining. This work proposes a novel technique for improving aspect phrase extraction in the context of BERT (Bidirectional Encoder Representations from Transformers) and Named Entity Recognition (NER) by leveraging Sparse Gated Recurrent Units (SGRUs). In order to address the challenges of aspect word extraction, we provide a synergistic combination of cutting-edge methods such as Sparse GRUs, BERT, and NER. Sparse GRUs benefit from efficient computing and improved generalization by including sparsity requirements in the GRU architecture. This novel approach seeks to gather local and contextual information to improve the precision and relevance of derived aspect phrases. Our experimental results on a benchmark data set demonstrate the effectiveness of the proposed technique. By combining Sparse GRUs with BERT and NER, we can significantly improve the accuracy of aspect term extraction over earlier methods. The tests' results suggest that Sparse GRUs can increase the identification of aspect phrases inside customer reviews, resulting in more accurate sentiment analysis and a better understanding of customer ratings.
Downloads
References
Zhao, G., Luo, Y., Chen, Q., & Qian, X. (2023). Aspect-based sentiment analysis via multitask learning for online reviews. Knowledge-Based Systems, 264, 110326.
Venugopalan, M., & Gupta, D. (2022). A reinforced active learning approach for optimal sampling in aspect term extraction for sentiment analysis. Expert Systems with Applications, 209, 118228.
Venugopalan, M., & Gupta, D. (2022). An enhanced guided LDA model augmented with BERT based semantic strength for aspect term extraction in sentiment analysis. Knowledge-based systems, 246, 108668.
Y. Song, J. Wang, T. Jiang, Z. Liu, Y. Rao, Attentional encoder network for targeted sentiment classification, arXiv preprint arXiv:1902.09314 (2019). https://arxiv.org/abs/1902.09314.
B. Zeng, H. Yang, R. Xu, W. Zhou, X. Han, Lcf: A local context focus mechanism for aspect-based sentiment classification, Applied Sciences 9 (16) (2019) 3389, https://doi.org/10.3390/app9163389.
W. Xue, T. Li, Aspect based sentiment analysis with gated convolutional networks, in: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (vol. 1: Long Papers), Association for Computational Linguistics, Melbourne, Australia, 2018, pp. 2514–2523. doi:10.18653/v1/P18- 1234. https://www.aclweb.org/anthology/P18-1234.
Yang, H., Zeng, B., Yang, J., Song, Y., & Xu, R. (2021). A multi-task learning model for chinese-oriented aspect polarity classification and aspect term extraction. Neurocomputing, 419, 344-356.
Mukherjee, A., and B. Liu. 2012. Aspect extraction through semi-supervised modelling. In Proceedings of the 50 Annual Meeting of the Association for Computational Linguistics July, 2012 (Association for Computational Linguistics) Jeju Island, Korea, 339–348.
Xue, W. 2017. MTNA: A neural multi-task model for aspect category classification and aspect term extraction on restaurant reviews. Proceedings of the The 8th International Joint Conference on Natural Language Processing, Taipei, Taiwan, 151–156.
Senarath, Y., N. Jihan, and S. Ranathunga. 2019. A hybrid approach for aspect extraction from customer reviews International Journal on Advances in ICT for Emerging Regions (ICTer) . 12 (September):1–8.
Hu M, Peng Y, Huang Z et al (2019) Open-domain targeted sentiment analysis via span-based extraction and classification. In: Proceedings of the 57th annual meeting of the association for computational linguistics, pp 537–546
Liu, Z., Sun, Q., Yang, Z., Jiang, K., & Yan, J. (2020, December). Fined-grained aspect extraction from online reviews for decision support. In 2020 IEEE 19th International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) (pp. 1536-1541). IEEE.
Liu, N., & Shen, B. (2023). Aspect term extraction via information-augmented neural network. Complex & Intelligent Systems, 9(1), 537-563.
A. Zhou.Li, L., and Y. Liu. 2018. Hierarchical attention-based position-aware network for aspect-level sentiment analysis. Conference of Computational Natural Language Learning (CoNLL), Brussels, Belgium, Association for Computational Linguistics, 181–189.
Hou, X., Huang, J., Wang, G., Qi, P., He, X. 2019. Selective attention-based graph convolutional networks for aspect-level sentiment classification Proceedings of the Fifteenth Workshop on Graph-Based Methods for Natural Language Processing (TextGraphs-15) June,2021 (Association for Computational Linguistics) 83–93 Mexico City, Mexico.
Chen, J. 2019. Graph convolutional networks with structural attention model for aspect-based sentiment analysis. 2019 International Joint Conference on Neural Networks (IJCNN). Budapest, Hungaray: IEEE, July, 1–7.
Al-Ghuribi, S. M., Noah, S. A. M., & Tiun, S. (2020). Unsupervised semantic approach of aspect-based sentiment analysis for large-scale user reviews. IEEE Access, 8, 218592-218613.
Luo Z, Huang S, Zhu KQ. Knowledge empowered prominent aspect extraction from product reviews. Inform Process Manag. 2019; 56(3): 408-423.
Wang, R., Liu, C., Zhao, R., Yang, Z., Zhang, P., & Wu, D. (2022). Post-processing method with aspect term error correction for enhancing aspect term extraction. Applied Intelligence, 52(14), 15751-15763.
Luo, Huaishao, Tianrui Li, Bing Liu, Bin Wang, and Herwig Unger. "Improving aspect term extraction with bidirectional dependency tree representation." IEEE/ACM Transactions on Audio, Speech, and Language Processing 27, no. 7 (2019): 1201-1212.
Michelle, P., Ruskanda, F. Z., & Purwarianti, A. (2020, September). Development of domain-specific lexicon for aspect-based sentiment analysis. In 2020 7th International Conference on Advance Informatics: Concepts, Theory and Applications (ICAICTA) (pp. 1-6). IEEE.
Abdelminaam DS, Neggaz N, Gomaa IAE, Ismail FH, Elsawy AA. ArabicDialects: an efficient framework for Arabic dialects opinion mining on twitter using optimized deep. Neural Netw. 2021; 9: 97079-97099.
Sharbatian, K., & Moattar, M. H. (2023). Deep aspect extraction and classification for opinion mining in e‐commerce applications using convolutional neural network feature extraction followed by long short term memory attention model. Applied AI Letters, e86.
Dutta, R., Das, N., Majumder, M., & Jana, B. (2023). Aspect based sentiment analysis using multi‐criteria decision‐making and deep learning under COVID‐19 pandemic in India. CAAI Transactions on Intelligence Technology, 8(1), 219-234.
Chouikhi, Hasna, Mohammed Alsuhaibani, and Fethi Jarray. "BERT-Based Joint Model for Aspect Term Extraction and Aspect Polarity Detection in Arabic Text." Electronics 12, no. 3 (2023): 515.
Ali, Noaman M., Abdullah Alshahrani, Ahmed M. Alghamdi, and Boris Novikov. "Extracting Prominent Aspects of Online Customer Reviews: A Data-Driven Approach to Big Data Analytics." Electronics 11, no. 13 (2022): 2042.
X. Feng, Y. Zeng, Neural collaborative embedding from reviews for recommendation, IEEE Access 7 (2019) 103263–103274.
Venugopalan, Manju, and Deepa Gupta. "A reinforced active learning approach for optimal sampling in aspect term extraction for sentiment analysis." Expert Systems with Applications 209 (2022): 118228.
N. Shrestha, F. Nasoz, Deep learning sentiment analysis of Amazon.Com Reviews and Ratings, Int. J. Soft Comput. Artif. Intel. Appl. 8 (No. 1) (2019), 01–15.
Sridevi M, Murugeswari, Bheema Lingaiah, "Deep Learning Approaches for Cyberbullying Detection and Classification on Social Media", Computational Intelligence and Neuroscience, vol. 2022, 2022. https://doi.org/10.1155/2022/2163458
S. Yu, J. Su, D. Luo, Improving BERT-based text classification with auxiliary sentence and domain knowledge, IEEE Access 7 (2019) 176600–176612.
Sridevi M, Saravanan Chandrasekaran, Murugeswari, Bheema Lingaiah, "Deep Learning Approaches for Cyberbullying Detection and Classification on Social Media", Computational Intelligence and Neuroscience, vol. 2022, 2022. https://doi.org/10.1155/2022/2163458
Li, J., Sun, A., Han, J., & Li, C. (2020). A survey on deep learning for named entity recognition. IEEE Transactions on Knowledge and Data Engineering, 34(1), 50-70.
Trisna, Komang Wahyu, and Huang Jin Jie. "Deep learning approach for aspect-based sentiment classification: a comparative review." Applied Artificial Intelligence 36, no. 1 (2022): 2014186.
Abbas Mardani, Sudhanshu Maurya & N. Arulkumar (2023) Eagle Strategy Arithmetic Optimisation Algorithm with Optimal Deep Convolutional Forest Based FinTech Application for Hyper-automation, Enterprise Information Systems, DOI: 10.1080/17517575.2023.2188123
Gangathimmappa, M, Subramani, N, Sambath, V, Ramanujam, RAM, Sammeta, M. Deep learning enabled cross-lingual search with metaheuristic web-based query optimization model for multi-document summarization. Concurrency Computation Practice Experience. 2022;e7476. doi:10.1002/cpe.7476
Xu H, Liu B, Shu L et al (2018) Double embeddings and CNN based sequence labeling for aspect extraction. In: Proceedings of the 56th annual meeting of the association for computational linguistics (volume 2: short papers), pp 592–598
M. Zhao, J. Yang, J. Zhang, S. Wang, Aggregated graph convolutional networks for aspect-based sentiment classification, Inform. Sci. 600 (2022) 73–93.
F. Fan, Y. Feng, D. Zhao, Multi-grained attention network for aspect-level sentiment classification, in, in: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, 2018, pp. 3433–3442, https://doi.org/10.18653/v1/D18-1380
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.
