Augmented Deep Learning Model for Social Network Sentiment Analysis

Authors

Keywords:

Deep learning, CNN, LSTM, RCNN, Sentiment analysis, social media analysis

Abstract

Users of social media communicate their views, wants, socialise, and share their opinions as the number of users grows. Resources of high quality are required for social media sentiment analysis, but there aren't many of them available for languages other than English, especially Arabic. Both the amount of the corpus and the calibre of the annotations in the Arabic resources that are readily available are lacking. In this study, we offer a Facebook-sourced Arabic sentiment analysis corpus with 60K comments that have been manually marked as a gold standard and classified as positive and negative. In order to annotate the corpus, we used self-training and remote supervision techniques. in this paper we propose a deep learning approach that allows companies and organizations to evaluate users' opinions on the quality of their services, by analysing their opinions on Facebook. We display three deep Learning models Convolutional Neural (CNN), Recurrent Convolutional (RCNN), Long Term Memory (LSTM) for Arabic sentiment analysis with the assistance of word embedding. The model accuracy was measured, and we got average accuracy of 82.1 % which was better than both CNN and RCNN. Also, applying increasing that data to the body increments LSTM accuracy by 8.7 %.

Downloads

Download data is not yet available.

References

A. &. S. K. Farghaly, " Arabic natural language processing: Challenges and solutions.," ACM Transactions on Asian Language Information Processing (TALIP),, vol. 8, pp. 1-22., (2009)..

S. B. M. E. A. F. C. L. &. E. M. A. E. Boukil, " Arabic text classification using deep learning technics.," International Journal of Grid and Distributed Computing, , vol. 11, pp. 103-114., (2018)..

G. L. Z. V. D. M. L. &. W. K. Q. Huang, "Densely connected convolutional networks.," in In Proceedings of the IEEE conference on computer vision and pattern recognition, (2017)..

K. M. E. H. M. &. S. K. Alomari, "Arabic tweets sentimental analysis using machine learning.," in In International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, Cham., (2017, June)..

J. B. &. E. A. Salamah, "Microblogging opinion mining approach for kuwaiti dialect.," in In The International Conference on Computing Technology and Information Management (ICCTIM) ., (2014, January)..

Ranadev, M. B. ., V. R. . Sheelavant, and R. L. . Chakrasali. “Predetermination of Performance Parameters of 3-Phase Induction Motor Using Numerical Technique Tools”. International Journal on Recent and Innovation Trends in Computing and Communication, vol. 10, no. 6, June 2022, pp. 63-69, doi:10.17762/ijritcc.v10i6.5628.

H. K. &. A. A. M. Aldayel, "Arabic tweets sentiment analysis–a hybrid scheme.," Journal of Information Science, , Vols. 42,, pp. 782-797., (2016). .

R. &. W. J. Collobert, "A unified architecture for natural language processing: Deep neural networks with multitask learning.," in In Proceedings of the 25th international conference on Machine learning, (2008, July)..

T. Fawcett, "An introduction to ROC analysis.," Pattern recognition letters, , Vols. 27,, pp. 861-874., (2006). .

R. D. J. D. T. &. M. J. Girshick, " Rich feature hierarchies for accurate object detection and semantic segmentation.," in In Proceedings of the IEEE conference on computer vision and pattern recognition , (2014)..

R. D. J. D. T. &. M. J. Girshick, " Rich feature hierarchies for accurate object detection and semantic segmentation.," in In Proceedings of the IEEE conference on computer vision and pattern recognition , (2014)..

N. A. Libre. (2021). A Discussion Platform for Enhancing Students Interaction in the Online Education. Journal of Online Engineering Education, 12(2), 07–12. Retrieved from http://onlineengineeringeducation.com/index.php/joee/article/view/49

S. B. M. E. A. F. C. L. &. E. M. A. E. Boukil, " Arabic text classification using deep learning technics.," International Journal of Grid and Distributed Computing, , Vols. 11,, pp. 103-114., (2018)..

W. Z. L. S. Y. G. K. &. C. E. Li, "User reviews: Sentiment analysis using lexicon integrated two-channel CNN–LSTM family models.," Applied Soft Computing,, Vols. 94 ,, p. 106435., (2020)..

A. K. S. &. B. H. Onan, " LDA-based Topic Modelling in Text Sentiment Classification: An Empirical Analysis.," Int. J. Comput. Linguistics Appl., , Vols. 7,, pp. 101-119., (2016)..

R. G. M. R. M. &. R. S. O. Rossi, Benchmarking text collections for classification and clustering tasks., (2013)..

A. K. S. &. B. H. Onan, "Ensemble of keyword extraction methods and classifiers in text classification.," Expert Systems with Applications,, Vols. 57,, pp. 232-247., (2016). .

A. Onan, "Hybrid supervised clustering based ensemble scheme for text classification.," Kybernetes., (2017). .

M. A. C.-P. R. S.-Z. M. D. P. &. V.-G. R. Paredes-Valverde, "Sentiment analysis in Spanish for improvement of products and services: A deep learning approach.," Scientific Programming,, vol. 2017., (2017)..

X. S. Y. A. B. C. C. &. W. K. Chen, "Adversarial deep averaging networks for cross-lingual sentiment classification.," Transactions of the Association for Computational Linguistics, , Vols. 6, , pp. 557-570., (2018). .

Chaudhary, D. S. . (2022). Analysis of Concept of Big Data Process, Strategies, Adoption and Implementation. International Journal on Future Revolution in Computer Science &Amp; Communication Engineering, 8(1), 05–08. https://doi.org/10.17762/ijfrcsce.v8i1.2065

M. M. V. B.-G. J. &. D. I. H. Iyyer, "Deep unordered composition rivals syntactic methods for text classification.," in In Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing, (2015, July)..

M. S. Y. E. A. &. K. L. Attia, "Multilingual multi-class sentiment classification using convolutional neural networks.," in In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), (2018, May). .

A. Onan, "An ensemble scheme based on language function analysis and feature engineering for text genre classification.," Journal of Information Science,, Vols. 44, , pp. 28-47., (2018). .

R. P. A. W. J. C. J. M. C. D. N. A. Y. &. P. C. Socher, "Recursive deep models for semantic compositionality over a sentiment treebank.," in In Proceedings of the 2013 conference on empirical methods in natural language processing, (2013, October). .

L. &. E. A. Lulu, "Automatic Arabic dialect classification using deep learning models.," Procedia computer science, , Vols. 142,, pp. 262-269., (2018). .

M. T. M. &. E.-M. N. Heikal, "Sentiment analysis of Arabic tweets using deep learning.," Procedia Computer Science,, Vols. 142, , pp. 114-122., (2018). .

K. S. M. K. C. S. &. D. S. Abu Kwaik, " Shami: A corpus of levantine arabic dialects.," in In Proceedings of the eleventh international conference on language resources and evaluation (LREC 2018)., (2018)..

S. E. M. &. H. H. Hamed, "A Review of Sentiment Analysis Techniques.," International Journal of Computer Applications, , Vols. 975,, p. 8887..

Y. &. W. B. Zhang, "A sensitivity analysis of (and practitioners' guide to) convolutional neural networks for sentence classification.," arXiv preprint arXiv:1510.03820., (2015). .

A. B. V. &. Y. B. B. Onan, " The use of data mining for strategic management: a case study on mining association rules in student information system.," Croatian Journal of Education: Hrvatski časopis za odgoj i obrazovanje,, Vols. 18, , pp. 41-70., (2016)..

R. E.-K. G. M. R. A. R. H. H. S. K. B. &. E.-H. W. Baly, " Comparative evaluation of sentiment analysis methods across Arabic dialects.," Procedia Computer Science, , Vols. 117,, pp. 266-273., (2017)..

Andrie Dazlee, N. M. A., Abdul Khalil, S., Abdul-Rahman, S., & Mutalib, S. (2022). Object Detection for Autonomous Vehicles with Sensor-based Technology Using YOLO. International Journal of Intelligent Systems and Applications in Engineering, 10(1), 129–134. https://doi.org/10.18201/ijisae.2022.276

A. M. P. V. E. M. &. I. R. Alayba, "A combined CNN and LSTM model for arabic sentiment analysis.," in In International cross-domain conference for machine learning and knowledge extraction ., (2018, August). .

G. L. Z. V. D. M. L. &. W. K. Q. Huang, "Densely connected convolutional networks.," in In Proceedings of the IEEE conference on computer vision and pattern recognition , (2017). .

A. E. M. A. Z. J. &. X. S. Dahou, " Arabic sentiment classification using convolutional neural network and differential evolution algorithm.," Computational intelligence and neuroscience,, vol. 2019., (2019)..

L. W. S. &. L. B. Zhang, " Deep learning for sentiment analysis: A survey.," Wiley Interdisciplinary Reviews:Data Mining and Knowledge Discovery, , Vols. 8, , p. e1253., (2018). .

S. X. L. L. K. &. Z. J. Lai, " Recurrent convolutional neural networks for text classification.," In Twenty-ninth AAAI conference on artificial intelligence., (2015, February)..

A. S. M. S. F. &. A. M. S. I. Alshuaibi, "Internet misuse at work in Jordan: Challenges and implications.," (2015). .

T. C. K. C. G. &. D. J. Mikolov, "Efficient estimation of word representations in vector space.," arXiv preprint arXiv:1301.3781., (2013). .

A. B. E. K. &. E.-B. S. R. Soliman, "Aravec: A set of arabic word embedding models for use in arabic nlp.," Procedia Computer Science, , Vols. 117, , pp. 256-265., (2017). .

J. &. M. C. Han, " The influence of the sigmoid function parameters on the speed of backpropagation learning.," in In International workshop on artificial neural networks ., (1995, June)..

S. Kobayashi, "Contextual augmentation: Data augmentation by words with paradigmatic relations.," arXiv preprint arXiv:1805.06201., (2018). .

M. &. S.-P. A. Jungiewicz, "Towards textual data augmentation for neural networks: synonyms and maximum loss.," Computer Science, , vol. 20., (2019). .

Generalarchitecture of the proposed models

Downloads

Published

16.12.2022

How to Cite

Hamed, S. ., Ezzat, M. ., & Hefny, H. . (2022). Augmented Deep Learning Model for Social Network Sentiment Analysis. International Journal of Intelligent Systems and Applications in Engineering, 10(4), 246–255. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/2223

Issue

Section

Research Article