A Proposed Hybrid CNN-RNN Architecture for Student Performance Prediction
Keywords:
Convolutional Neural Network, Recurrent neural network, CNN-RNN, Hybrid Deep Learning, Education, Student Performance PredictionAbstract
Education is one of the important factors for the development of a country, thus, an early prediction system to predict the student performance is needed. With such system, education institutes would have a strong capacity to detect slow learners and investigate the major variables impacting their academic performance and preventing students from dropping out of school owing to poor marks or failing the exam. There are several studies that uses traditional machine learning to predict student performance, however, hybrid deep learning in predicting student performance has never been reported. Whereas machine learning requires feature selection, deep learning models may conduct automatic feature selection in the training model. However, it may suffer from the curse of dimensionality as it collects more and more features from student data. This paper proposes a hybrid deep learning model with combination of Convolutional Neural Network (CNN) and Recurrent neural network (RNN), i.e. CNN-RNN, where CNN captures the local dominant features and reduce the curse of dimensionality and RNN obtains the semantic correlation between features. The results of the experiments indicate that the hybrid CNN-RNN prediction model performs better than deep learning model by 3.16%, where the accuracy increased from 73.07% in ANN to 79.23% in hybrid CNN-RNN.
Downloads
References
J. Sultana, M. Usha, and M. A. H. Farquad, “Student’s performance prediction using deep learning and data mining methods,” Int. J. Recent Technol. Eng., vol. 8, no. 1, pp. 1018–1021, 2019.
R. Hasan, S. Palaniappan, S. Mahmood, A. Abbas, K. U. Sarker, and M. U. Sattar, “Predicting student performance in higher educational institutions using video learning analytics and data mining techniques,” Appl. Sci., vol. 10, no. 11, 2020.
Kadhim, R. R., and M. Y. Kamil. “Evaluation of Machine Learning Models for Breast Cancer Diagnosis Via Histogram of Oriented Gradients Method and Histopathology Images”. International Journal on Recent and Innovation Trends in Computing and Communication, vol. 10, no. 4, Apr. 2022, pp. 36-42, doi:10.17762/ijritcc.v10i4.5532.
R. Hasan, S. Palaniappan, S. Mahmood, K. U. Sarker, and A. Abbas, “Modelling and predicting student’s academic performance using classification data mining techniques,” Int. J. Bus. Inf. Syst., vol. 34, no. 3, pp. 403–422, 2020.
R. Hasan, S. Palaniappan, A. R. A. Raziff, S. Mahmood, and K. U. Sarker, “Student Academic Performance Prediction by using Decision Tree Algorithm,” in 2018 4th International Conference on Computer and Information Sciences: Revolutionising Digital Landscape for Sustainable Smart Society, 2018.
B. Oancea, R. Dragoescu, and S. Ciucu, “Predicting students’ results in higher education using a neural network Predicting students’ results in higher education using a neural network,” Appl. Inf. Commun. Technol., no. 72041, 2013.
L. M. Abu Zohair, “Prediction of Student’s performance by modelling small dataset size,” Int. J. Educ. Technol. High. Educ., vol. 16, no. 1, pp. 1–18, Aug. 2019.
Y. Bengio and Y. Lecun, “Scaling Learning Algorithms Towards AI,” Large-Scale Kernel Mach., vol. 1, pp. 1–41, 2017.
P. Cortez and A. M. G. Silva, “Using data mining to predict secondary school student performance,” Comput. Sci., 2008.
S. Natek and M. Zwilling, “Student data mining solution-knowledge management system related to higher education institutions,” Expert Syst. Appl., vol. 41, no. 14, pp. 6400–6407, Oct. 2014.
A. A. Saa, M. Al-Emran, and K. Shaalan, “Mining Student Information System Records to Predict Students’ Academic Performance,” in Advances in Intelligent Systems and Computing, 2020, vol. 921, pp. 229–239.
N. Tomasevic, N. Gvozdenovic, and S. Vranes, “An overview and comparison of supervised data mining techniques for student exam performance prediction,” Comput. Educ., vol. 143, p. 103676, Jan. 2020.
Chaudhary, D. S. . (2022). Analysis of Concept of Big Data Process, Strategies, Adoption and Implementation. International Journal on Future Revolution in Computer Science &Amp; Communication Engineering, 8(1), 05–08. https://doi.org/10.17762/ijfrcsce.v8i1.2065
D. Kabakchieva, “Predicting student performance by using data mining methods for classification,” Cybern. Inf. Technol., vol. 13, no. 1, pp. 61–72, 2013.
B. Minaei-Bidgoli, D. A. Kashy, G. Kortemeyer, and W. F. Punch, “Predicting student performance: An application of data mining methods with an educational web-based system,” in 33rd Annual Frontiers in Education, 2003, vol. 1, p. T2A13-T2A18.
E. Osmanbegovic and M. Suljic, “Data Mining Approach for Predicting Student Performance,” J. Econ. Bus., vol. 10, no. 1, pp. 3–12, 2012.
A. Namoun and A. Alshanqiti, “Predicting student performance using data mining and learning analytics techniques: A systematic literature review,” Appl. Sci., vol. 11, no. 1, pp. 1–28, Jan. 2021.
P. Cortez and A. M. G. Silva, “Using data mining to predict secondary school student performance,” EUROSIS-ETI, 2008.
A. M. Shahiri, W. Husain, and N. A. Rashid, “A Review on Predicting Student’s Performance Using Data Mining Techniques,” in Procedia Computer Science, 2015, vol. 72, pp. 414–422.
A. Daud, M. D. Lytras, N. R. Aljohani, F. Abbas, R. A. Abbasi, and J. S. Alowibdi, “Predicting student performance using advanced learning analytics,” in 26th International World Wide Web Conference 2017, WWW 2017 Companion, 2017, pp. 415–421.
H. Hamsa, S. Indiradevi, and J. J. Kizhakkethottam, “Student Academic Performance Prediction Model Using Decision Tree and Fuzzy Genetic Algorithm,” Procedia Technol., vol. 25, pp. 326–332, Jan. 2016.
W. F. W. Yaacob, S. A. M. Nasir, W. F. W. Yaacob, and N. M. Sobri, “Supervised data mining approach for predicting student performance,” Indones. J. Electr. Eng. Comput. Sci., vol. 16, no. 3, pp. 1584–1592, 2019.
R. Baker and K. Yacef, “The State of Educational Data Mining in 2009: A Review and Future Visions,” J. Educ. Data Min., vol. 1, no. 1, pp. 3–17, Oct. 2009.
A. Kumar, R. Pandi Selvam, and K. Sathesh Kumar, “Review on prediction algorithms in educational data mining,” Int. J. Pure Appl. Math., vol. 118, no. Special Issue 8, pp. 531–537, 2018.
C. Romero and S. Ventura, “Educational data mining: A survey from 1995 to 2005,” Expert Syst. Appl., vol. 33, no. 1, pp. 135–146, Jul. 2007.
Q. Liu et al., “Fuzzy cognitive diagnosis for modelling examinee performance,” ACM Trans. Intell. Syst. Technol., vol. 9, no. 4, Jan. 2018.
H. A. Mengash, “Using data mining techniques to predict student performance to support decision making in university admission systems,” IEEE Access, vol. 8, pp. 55462–55470, 2020.
Y. Li, J. Gou, and Z. Fan, “Educational data mining for students’ performance based on fuzzy C-means clustering,” J. Eng., vol. 11, pp. 8245–8250, 2019.
J. T. Heaton, Programming Neural Networks with Encog3 in Java, 1st ed. Heaton Research, 2011.
A. Ethem, Introduction to Machine Learning. The MIT Press, 2014.
N. K. Rotich, J. Backman, L. Linnanen, and P. Daniil, “Wind resource assessment and forecast planning with neural networks,” J. Sustain. Dev. Energy, Water Environ. Syst., vol. 2, no. 2, pp. 174–190, Jun. 2014.
Kiran, M. S., & Yunusova, P. (2022). Tree-Seed Programming for Modelling of Turkey Electricity Energy Demand. International Journal of Intelligent Systems and Applications in Engineering, 10(1), 142–152. https://doi.org/10.18201/ijisae.2022.278
J. Sola and J. Sevilla, “Importance of input data normalization for the application of neural networks to complex industrial problems,” IEEE Trans. Nucl. Sci., vol. 44, no. 3 PART 3, pp. 1464–1468, 1997.
O. Abdelrahman and P. Keikhosrokiani, “Assembly Line Anomaly Detection and Root Cause Analysis Using Machine Learning,” IEEE Access, vol. 8, pp. 189661–189672, 2020.
A. Sharma, A. Ram, and A. Bansal, “Feature Extraction Mining for Student Performance Analysis,” in Proceedings of ICETIT 2019, 2020, vol. 605, pp. 785–797.
J. Zhu, H. Chen, and W. Ye, “A Hybrid CNN-LSTM Network for the Classification of Human Activities Based on Micro-Doppler Radar,” IEEE Access, vol. 8, pp. 24713–24720, 2020.
D. P. Kingma and B. Jimmy, “Adam: A Method for Stochastic Optimization,” in 3rd International Conference for Learning Representations, 2015.
N. A. Libre. (2021). A Discussion Platform for Enhancing Students Interaction in the Online Education. Journal of Online Engineering Education, 12(2), 07–12. Retrieved from http://onlineengineeringeducation.com/index.php/joee/article/view/49
A. Khan and S. K. Ghosh, “Student performance analysis and prediction in classroom learning: A review of educational data mining studies,” Educ. Inf. Technol., vol. 26, no. 1, pp. 205–240, 2021.
N. Venkat, “The Curse of Dimensionality: Inside Out,” ServerProcessor, 2018. [Online].
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.
