Automated Feature Engineering in Machine Learning: Challenges and Innovations

Authors

  • Vinoth Manamala Sudhakar

Keywords:

Automated Feature Engineering, Machine Learning, Leveraging AI, Creation, Improving Efficiency, Model Performance, Reducing Human Bias, AutoML Tools, Deep Learning.

Abstract

This research explores the emerging field of automated feature engineering in machine learning and stresses how machine learning and AI algorithms can potentially revolutionize predictive modeling. Automation will ease feature generation, transformation, and selection, making it more efficient, boosting model performance, and reducing human bias. Feature engineering has traditionally been time-consuming and skill-based. The research examines several AI-based approaches, i.e., AutoML tools, feature extraction using deep learning, and feature selection using reinforcement learning. It also addresses problems like overfitting, scalability, and the complexity of preprocessing data. The presentation of case studies and applications focuses on the rising importance of machine learning automation. Innovations for future developments and trends in automatic feature engineering are also presented in the conclusion of the paper as informative perspectives to practitioners and researchers.

Downloads

Download data is not yet available.

References

A. Truong, A. Walters, J. Goodsitt, K. Hines, C. B. Bruss, and R. Farivar, “Towards automated machine learning: Evaluation and comparison of AutoML approaches and tools,” in Proc. IEEE 31st Int. Conf. Tools with Artificial Intelligence (ICTAI), Nov. 2019, pp. 1471-1479.

C. Janiesch, P. Zschech, and K. Heinrich, “Machine learning and deep learning,” Electronic Markets, vol. 31, no. 3, pp. 685-695, 2021.

F. Hutter, L. Kotthoff, and J. Vanschoren, Automated Machine Learning: Methods, Systems, Challenges, Springer Nature, 2019, p. 219.

F. Wang, L. P. Casalino, and D. Khullar, “Deep learning in medicine—promise, progress, and challenges,” JAMA Internal Medicine, vol. 179, no. 3, pp. 293-294, 2019.

H. Shimizu and K. I. Nakayama, “Artificial intelligence in oncology,” Cancer Science, vol. 111, no. 5, pp. 1452-1460, 2020.

H. Shokoohi, M. A. LeSaux, Y. H. Roohani, A. Liteplo, C. Huang, and M. Blaivas, “Enhanced point-of-care ultrasound applications by integrating automated feature-learning systems using deep learning,” Journal of Ultrasound in Medicine, vol. 38, no. 7, pp. 1887-1897, 2019.

M. H. Saleem, J. Potgieter, and K. M. Arif, “Automation in agriculture by machine and deep learning techniques: A review of recent developments,” Precision Agriculture, vol. 22, no. 6, pp. 2053-2091, 2021.

M. Usama, J. Qadir, A. Raza, H. Arif, K. L. A. Yau, Y. Elkhatib, et al., “Unsupervised machine learning for networking: Techniques, applications and research challenges,” IEEE Access, vol. 7, pp. 65579-65615, 2019.

R. Elshawi, M. Maher, and S. Sakr, “Automated machine learning: State-of-the-art and open challenges,” arXiv preprint arXiv:1906.02287, 2019.

S. Ji, S. Pan, X. Li, E. Cambria, G. Long, and Z. Huang, “Suicidal ideation detection: A review of machine learning methods and applications,” IEEE Trans. Computational Social Systems, vol. 8, no. 1, pp. 214-226, 2020.

S. S. Parimi, “Automated risk assessment in SAP financial modules through machine learning,” SSRN, no. 4934897, 2019.

T. Wang, C. Lu, G. Shen, and F. Hong, “Sleep apnea detection from a single-lead ECG signal with automatic feature-extraction through a modified LeNet-5 convolutional neural network,” PeerJ, vol. 7, p. e7731, 2019.

X. Li, F. Dong, S. Zhang, and W. Guo, “A survey on deep learning techniques in wireless signal recognition,” Wireless Communications and Mobile Computing, vol. 2019, p. 5629572, 2019.

Y. Liu, O. C. Esan, Z. Pan, and L. An, “Machine learning for advanced energy materials,” Energy and AI, vol. 3, p. 100049, 2021.

Z. Chen, P. Zhao, C. Li, F. Li, D. Xiang, Y. Z. Chen, et al., “iLearnPlus: A comprehensive and automated machine-learning platform for nucleic acid and protein sequence analysis, prediction and visualization,” Nucleic Acids Research, vol. 49, no. 10, p. e60, 2021.

Downloads

Published

05.10.2024

How to Cite

Vinoth Manamala Sudhakar. (2024). Automated Feature Engineering in Machine Learning: Challenges and Innovations. International Journal of Intelligent Systems and Applications in Engineering, 12(23s), 2123–2129. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/7273

Issue

Section

Research Article