Quantifying the Effectiveness of Student Organization Activities using Natural Language Processing
Keywords:
Hugging Face, Machine Learning, Natural Language Processing (NLP), Sentiment Analysis, Student Affairs.Abstract
Student extracurricular activities play an important role in enriching the students' educational experiences. With the increasing popularity of Machine Learning and Natural Language Processing, it becomes a logical step that incorporating ML-NLP in improving extracurricular activities is a potential focus of study in Artificial Intelligence (AI). This research study aims to develop a machine learning workflow that will quantify the effectiveness of student-organized activities based on student emotional responses using sentiment analysis. The study uses the Bidirectional Encoder Representations from Transformers (BERT) Large Language Model (LLM) called via the pysentimiento toolkit, as a Transformer pipeline in Hugging Face. A sample data set from Organization C, a Recognized Student Organization (RSO) of a higher educational institute in the Philippines, College X, was used to develop the workflow. The workflow consisted of data preprocessing, key feature selection, LLM feature processing, and score aggregation, resulting in an Event Score for each data set. The results show that the BERT LLM can also be used effectively in analyzing sentiment beyond product reviews and post comments. For the student affairs offices of educational institutions, this study can provide a practical example of how NLP can be applied to real-world scenarios, showcasing the potential impact of data-driven decision making.
Downloads
References
J. Serrano-Guerrero, J. A. Olivas, F. P. Romero, and E. Herrera-Viedma, “Sentiment analysis: A review and comparative analysis of web services,” Information Sciences, vol. 311, pp. 18–38, Aug. 2015, doi: 10.1016/j.ins.2015.03.040. [Online]. Available: http://dx.doi.org/10.1016/j.ins.2015.03.040
M. R. Ghasemi, H. Karimi Moonaghi, and A. Heydari, “Student-related factors affecting academic engage-ment: A qualitative study exploring the experiences of Iranian undergraduate nursing students,” Electronic Physician, vol. 10, no. 7, pp. 7078–7085, Jul. 2018, doi: 10.19082/7078. [Online]. Available: http://dx.doi.org/10.19082/7078
Iram, “Sentiment Analysis of Student’s Facebook Posts,” Communications in Computer and Infor-mation Science, pp. 86–97, 2019, doi: 10.1007/978-981-13-6052-7_8. [Online]. Available: http://dx.doi.org/10.1007/978-981-13-6052-7_8
S. Sirajudeen, B. Duraisamy, Haleema, and V. Ajan-tha Devi, “Correction to: Sentiment Analysis to Assess Students’ Perception on the Adoption of Online Learning During Pre-COVID-19 Pandemic Period,” In-telligent Computing and Innovation on Data Science, pp. C1–C1, 2022, doi: 10.1007/978-981-16-3153-5_61. [Online]. Available: http://dx.doi.org/10.1007/978-981-16-3153-5_61
M. Atif, “An Enhanced Framework for Sentiment Analysis of Students’ Surveys: Arab Open University Business Program Courses Case Study,” Business and Economics Journal, vol. 09, no. 01, 2018, doi: 10.4172/2151-6219.1000337. [Online]. Available: http://dx.doi.org/10.4172/2151-6219.1000337
F. Gkontzis, C. V. Karachristos, C. T. Panagio-takopoulos, E. C. Stavropoulos, and V. S. Verykios, “Sentiment Analysis to Track Emotion and Polarity in Student Fora,” Proceedings of the 21st Pan-Hellenic Conference on Informatics, Sep. 2017, doi: 10.1145/3139367.3139389. [Online]. Available: http://dx.doi.org/10.1145/3139367.3139389
Y. Ma, “A Study of Ethical Issues in Natural Lan-guage Processing with Artificial Intelligence,” Journal of Computer Science and Technology Studies, vol. 5, no. 1, pp. 52–56, Mar. 2023, doi: 10.32996/jcsts.2023.5.1.7. [Online]. Available: http://dx.doi.org/10.32996/jcsts.2023.5.1.7
A. Q. Aqlan, B. Manjula, and R. Lakshman Naik, “A Study of Sentiment Analysis: Concepts, Techniques, and Challenges,” Proceedings of International Con-ference on Computational Intelligence and Data En-gineering, pp. 147–162, 2019, doi: 10.1007/978-981-13-6459-4_16. [Online]. Available: http://dx.doi.org/10.1007/978-981-13-6459-4_16
M. V. Santos, F. Morgado-Dias, and T. C. Silva, “Oil Sector and Sentiment Analysis—A Review,” Energies, vol. 16, no. 12, p. 4824, Jun. 2023, doi: 10.3390/en16124824. [Online]. Available: http://dx.doi.org/10.3390/en16124824
Almudena and G.-Olalla. "Extracurricular activities in higher education and the promotion of reflective learning for sustainability Ana, “Extracurricular activi-ties in higher education and the promotion of reflec-tive learning for sustainability,” 2019 [Online]. Avail-able: https://www.mdpi.com/2071-1050/11/17/4521
Crystal, D. M. Susan, C. Jonathan, and Thapa. "In-volvement in extracurricular activities: I. differences in perceptions of school climate Amrit, “The Educa-tional and Developmental Psychologist 33 no,” 2016 [Online]. Available: https://www.cambridge.org/core/journals/educational-and-developmental-psychologist/article/involvement-in-extracurricular-activities-identifying-differences-in-perceptions-of-school-cli-mate/A794A7DC2C9200AFBDBAE320E6FEA0C1
Martinez, C. Coker, S. D. McMahon, J. Cohen, and A. Thapa, “Involvement in Extracurricular Activities: Identifying Differences in Perceptions of School Cli-mate,” The Educational and Developmental Psy-chologist, vol. 33, no. 1, pp. 70–84, Jul. 2016, doi: 10.1017/edp.2016.7.
[“Student leadership at the university,” Academia, [Online]. Available: https://www.academia.edu/download/89737647/ciadmin_2C_Journal_manager_2C_93-359-1-CE.pdf_filename_UTF-8ciadmin_2C_Journal_manager_2C_93-359-1-CE.pdf
J. E. Hill, “THE DEVELOPMENT AND APPLICATION OF A METHOD FOR EVALUATING DEFINED PHASESOF STUDENT ACTIVITIES PROGRAMS IN INSTITUTIONS OF HIGHER EDUCATION” [Online]. Available: https://search.proquest.com/openview/d729b71ebc60a1a89cb478560f0edd51/1?pq-origsite=gscholar&cbl=18750&diss=y
M. Grahame. "Barriers to adjustment: N. of interna-tional students within a semi-urban campus commu-nity Kamini, “Journal of instructional Psychology 34 no,” 2007 [Online]. Available: https://www.redorbit.com/news/education/907480/barri-ers_to_adjustment_needs_of_international_students_within_a_semiurban/index.html/
P. John, B. D. Peter, and G. Oblinger. "Academic ana-lytics: A. new tool for a new era Diana, “EDUCAUSE review 42 no,” 2007 [Online]. Available: https://er.educause.edu/articles/2007/7/academic-analytics-a-new-tool-for-a-new-era
R. A. "Student affairs assessment: M. the effective-ness of assessment plans designed to shrink the aca-demic equity gap Mead, “PhD diss” [Online]. Availa-ble: https://search.proquest.com/openview/8ea37a5856be7115dc8688d1a1bc9a70/1?pq-origsite=gscholar&cbl=18750&diss=y
K. Torana, M. Anushka, K. Anupam, and R. Vinay, “Envisioning Tomorrow: AI Powered Career Counsel-ing” [Online]. Available: https://ieeexplore.ieee.org/abstract/document/10426016/
William, B. Wendy, and Hellmundt. "Just another student survey?:-Point-of-contact survey feedback enhances the student experience and lets researchers gather data Suzi, “Just another student survey?:-Point-of-contact survey feedback enhances the stu-dent experience and lets researchers gather data,” 2017 [Online]. Available: https://search.informit.org/doi/abs/10.3316/INFORMIT.772130139728485
Weitong, L. Xue, Z. Wanli, and Y. Minghao, “A survey of sentiment analysis in social media,” 2019 [Online]. Available: https://link.springer.com/article/10.1007/s10115-018-1236-4
K. Mohammed and B.-H. Abderrahim, “A compre-hensive survey on sentiment analysis Approaches challenges and trends,” 2021 [Online]. Available: https://www.sciencedirect.com/science/article/pii/S095070512100397X
S. Prof, “Sentiment analysis of twitter data: a survey of techniques,” 2016 [Online]. Available: https://arxiv.org/abs/1601.06971
Nhan, N. M.-G. María, and D. la Prieta. "Sentiment analysis based on deep learning: A. comparative study Fernando, “Sentiment analysis based on deep learning: A comparative study,” 2020 [Online]. Avail-able: https://www.mdpi.com/2079-9292/9/3/483
K. Vishwakarma. "Sentiment analysis using deep learning architectures: a review Dinesh, “Sentiment analysis using deep learning architectures: a review,” 2020 [Online]. Available: https://link.springer.com/article/10.1007/s10462-019-09794-5
Company and Meta, “The Facebook Company Is Now Meta,” Meta, Nov. 07, 2022. [Online]. Availa-ble: https://about.fb.com/news/2021/10/facebook-company-is-now-meta/. [Accessed: May 25, 2024]
S. Shah, “Why is Twitter now called X? The big re-branding explained,” Evening Standard, Aug. 22, 2023. [Online]. Available: https://www.standard.co.uk/news/tech/x-twitter-logo-rebrand-why-elon-musk-b1096363.html. [Accessed: May 25, 2024]
M. Swamynathan, “Mastering machine learning with python in six steps A practical implementation guide to predictive data analytics using python” [Online]. Available: https://link.springer.com/content/pdf/10.1007/978-1-4842-2866-1.pdf
H. Sajjad and G. Sayeed, “Lexiconbased sentiment analysis of teachers evaluation,” 2016 [Online]. Available: https://www.hindawi.com/journals/acisc/2016/2385429/abs/
“Data Privacy in DTI | Department of Trade and In-dustry ...,” Department of Trade and Industry Philip-pines, Aug. 08, 2023. [Online]. Available: https://www.dti.gov.ph/good-governance-program/data-privacy-dti/. [Accessed: May 25, 2024]
L. Catherine and D. M. Johanna, “Polarity and inten-sity: the two aspects of sentiment analysis,” 2018 [Online]. Available: https://arxiv.org/abs/1807.01466
J. M. Pérez et al., “pysentimiento: A Python Toolkit for Opinion Mining and Social NLP tasks,” arXiv.org, Jun. 2021, doi: 10.48550/arXiv.2106.09462. [Online]. Available: https://arxiv.org/abs/2106.09462
V. De, van C. Andreas, B. Arianna, C. Tommaso, van N. Gertjan, and N. Malvina, “Bertje A dutch bert model,” 2019 [Online]. Available: https://arxiv.org/abs/1912.09582
S. U. Md, M. K. Md, B. S. Talha, S. Mejdl, A. Sultan, and F. Mridha. "A multimodal approach to cross-lingual sentiment analysis with ensemble of trans-former and L. M., “Scientific Reports 14 no,” 2024 [Online]. Available: https://www.nature.com/articles/s41598-024-60210-7
J. Luna, “8 Top Open-Source LLMs for 2024 and Their Uses,” DataCamp, Nov. 2023. [Online]. Availa-ble: https://www.datacamp.com/blog/top-open-source-llms. [Accessed: Jun. 02, 2024]
J. M. Pérez, “finiteautomata/bertweet-base-sentiment-analysis · Hugging Face,” Hugging Face, May 25, 2021. [Online]. Available: https://huggingface.co/finiteautomata/bertweet-base-sentiment-analysis. [Accessed: Jun. 02, 2024]
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.
