Predicting Knee Osteoarthritis Progression: A Multimodal Approach Integrating Unadorned Radiographs and Medical Data for Enhanced Machine Learning


  • Jihane Ben Slimane


Knee Osteoarthritis Progression, Multimodal, CNN, MOST, GBM


Knee osteoarthritis (OA) is a debilitating degenerative joint disease affecting millions worldwide, presenting significant challenges in patient management and healthcare resource allocation. Accurate prediction of disease progression is essential for personalized treatment strategies and timely interventions. In this study, we propose a novel multimodal approach for predicting knee OA progression, integrating clinical, imaging, and biomarker data. Leveraging advanced machine learning techniques, including deep learning and ensemble models, we demonstrate the efficacy of our approach in accurately forecasting disease progression trajectories. Our findings underscore the potential of multimodal data fusion in improving predictive modeling for knee OA progression, offering new insights for clinical decision-making and personalized patient care. Our approach achieved an average AUC of 0.810 (0.790–0.820) and AP of 0.700 (0.680–0.720) in predicting knee OA progression, outperforming existing methods and highlighting its clinical utility.


Download data is not yet available.


B. Guan, F. Liu, A. H. Mizaian, S. Demehri, A. Samsonov, A. Guermazi and R. Kijowski, "Deep learning approach to predict pain progression in knee osteoarthritis," Skeletal radiology, p. 1–11, 2022.

A. Kirchmeyer and J. Deng, "Convolutional networks with oriented 1d kernels," in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023.

L. Liu, J. Chang, P. Zhang, Q. Ma, H. Zhang, T. Sun and H. Qiao, "A joint multi-modal learning method for early-stage knee osteoarthritis disease classification," Heliyon, vol. 9, 2023.

W. Wu, K. Hu, W. Yue, W. Li, M. Simic, C. Li, W. Xiang and Z. Wang, "Self-Supervised Multimodal Fusion Network for Knee Osteoarthritis Severity Grading," in 2023 International Conference on Digital Image Computing: Techniques and Applications (DICTA), 2023.

Z. Liu, T. D. Nguyen, T. H. Nguyen, A. Ene and H. Nguyen, "High probability convergence of stochastic gradient methods," in International Conference on Machine Learning, 2023.

Y. Arjevani, Y. Carmon, J. C. Duchi, D. J. Foster, N. Srebro and B. Woodworth, "Lower bounds for non-convex stochastic optimization," Mathematical Programming, vol. 199, p. 165–214, 2023.

I. Salehin and D.-K. Kang, "A review on dropout regularization approaches for deep neural networks within the scholarly domain," Electronics, vol. 12, p. 3106, 2023.

R. Balestriero, L. Bottou and Y. LeCun, "The effects of regularization and data augmentation are class dependent," Advances in Neural Information Processing Systems, vol. 35, p. 37878–37891, 2022.

M. Gupta and R. Y. Zhang, "A Noise Resilient Transformation for Streaming Algorithms," arXiv preprint arXiv:2307.07087, 2023.

H. Zhang, C. Wu, Z. Zhang, Y. Zhu, H. Lin, Z. Zhang, Y. Sun, T. He, J. Mueller, R. Manmatha and others, "Resnest: Split-attention networks," in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022.

J. H. Cueva, D. Castillo, H. Espinós-Morató, D. Durán, P. Dı́az and V. Lakshminarayanan, "Detection and classification of knee osteoarthritis," Diagnostics, vol. 12, p. 2362, 2022.

B. Babenko, I. Traynis, C. Chen, P. Singh, A. Uddin, J. Cuadros, L. P. Daskivich, A. Y. Maa, R. Kim, E. Y.-C. Kang and others, "A deep learning model for novel systemic biomarkers in photographs of the external eye: a retrospective study," The Lancet Digital Health, vol. 5, p. e257–e264, 2023.

D. P. Woodruff and T. Yasuda, "High-dimensional geometric streaming in polynomial space," in 2022 IEEE 63rd Annual Symposium on Foundations of Computer Science (FOCS), 2022.

H. Shi, M. Xie and S. Huang, "Robust AUC maximization for classification with pairwise confidence comparisons," Frontiers of Computer Science, vol. 18, p. 184317, 2024.

P. Gao, Q. Xu, P. Wen, H. Shao, Y. He and Q. Huang, "Towards Decision-Friendly AUC: Learning Multi-Classifier with AUCμ," in Proceedings of the AAAI Conference on Artificial Intelligence, 2023.

H. Zhu, S. Liu, W. Xu, J. Dai and M. Benbouzid, "Linearithmic and unbiased implementation of DeLong’s algorithm for comparing the areas under correlated ROC curves," Expert Systems with Applications, vol. 246, p. 123194, 2024.




How to Cite

Slimane, J. B. . (2024). Predicting Knee Osteoarthritis Progression: A Multimodal Approach Integrating Unadorned Radiographs and Medical Data for Enhanced Machine Learning. International Journal of Intelligent Systems and Applications in Engineering, 12(21s), 2127–2137. Retrieved from



Research Article

Most read articles by the same author(s)