Intersection of AI and Cybersecurity: A Data-Driven Approach to Proactive Risk Management in ETL Processes

Authors

  • Shiva Kumar Vuppala

Keywords:

Artificial Intelligence, cybersecurity, ETL processes, anomaly detection, autoencoder, Convolutional Neural Network, Gated Recurrent Unit

Abstract

The growing complexity of Extract, Transform, Load (ETL) processes and their crucial role in modern data pipelines make them susceptible to various cybersecurity risks, including unauthorized access, data tampering, and service disruption. These threats can have far-reaching consequences, affecting business operations, regulatory compliance, and strategic decision-making. Traditional security approaches, relying on static rule-based systems, struggle to address the dynamic nature and scale of ETL workflows, necessitating the integration of more adaptive and intelligent methods. A data-driven approach utilizing Artificial Intelligence (AI) offers a promising solution by leveraging machine learning and deep learning techniques to continuously analyze system logs, performance metrics, and historical incidents for abnormal activity. This paper proposes a hybrid approach combining autoencoders for feature extraction and Convolutional Neural Network-Gated Recurrent Unit (CNN-GRU) models for anomaly detection, aiming to proactively identify security risks within ETL systems. Autoencoders are employed to reduce data dimensionality while capturing critical features, while the CNN-GRU model enhances the detection of both local and temporal anomalies. The proposed method is evaluated through performance metrics, showing a high detection rate and minimal false positives compared to traditional rule-based methods. The results demonstrate the potential of AI-driven security frameworks to provide real-time, intelligent monitoring and adaptive risk management, thus improving ETL pipeline resilience and security. This research highlights the importance of incorporating AI into cybersecurity strategies for dynamic, data-intensive environments, ensuring that security measures evolve alongside emerging threats.

Downloads

Download data is not yet available.

References

S. Mokhtari, A. Abbaspour, K. K. Yen, and A. Sargolzaei, “A Machine Learning Approach for Anomaly Detection in Industrial Control Systems Based on Measurement Data,” Electronics, vol. 10, no. 4, p. 407, Feb. 2021, doi: 10.3390/electronics10040407.

S. S. Aljameel et al., “An Anomaly Detection Model for Oil and Gas Pipelines Using Machine Learning,” Computation, vol. 10, no. 8, p. 138, Aug. 2022, doi: 10.3390/computation10080138.

S. Akcay, D. Ameln, A. Vaidya, B. Lakshmanan, N. Ahuja, and U. Genc, “Anomalib: A Deep Learning Library for Anomaly Detection,” in 2022

IEEE International Conference on Image Processing (ICIP), Bordeaux, France: IEEE, Oct. 2022, pp. 1706–1710. doi: 10.1109/ICIP46576.2022.9897283.

K. Al Jallad, M. Aljnidi, and M. S. Desouki, “Anomaly detection optimization using big data and deep learning to reduce false-positive,” J Big Data, vol. 7, no. 1, p. 68, Dec. 2020, doi: 10.1186/s40537-020-00346-1.

S. T. Ikram et al., “Anomaly Detection Using XGBoost Ensemble of Deep Neural Network Models,” Cybernetics and Information Technologies, vol. 21, no. 3, pp. 175–188, Sep. 2021, doi: 10.2478/cait-2021-0037.

H. Son, Y. Jang, S.-E. Kim, D. Kim, and J.-W. Park, “Deep Learning-Based Anomaly Detection to Classify Inaccurate Data and Damaged Condition of a Cable-Stayed Bridge,” IEEE Access, vol. 9, pp. 124549–124559, Jan. 2021, doi: 10.1109/ACCESS.2021.3100419.

H. Matsuo et al., “Diagnostic accuracy of deep-learning with anomaly detection for a small amount of imbalanced data: discriminating malignant parotid tumors in MRI,” Sci Rep, vol. 10, no. 1, p. 19388, Nov. 2020, doi: 10.1038/s41598-020-76389-4.

H. W. Oleiwi, D. N. Mhawi, and H. Al-Raweshidy, “MLTs-ADCNs: Machine Learning Techniques for Anomaly Detection in Communication Networks,” IEEE Access, vol. 10, pp. 91006–91017, Aug. 2022, doi: 10.1109/ACCESS.2022.3201869.

W. Marfo, D. K. Tosh, and S. V. Moore, “Network Anomaly Detection Using Federated Learning,” in MILCOM 2022 - 2022 IEEE Military Communications Conference (MILCOM), Rockville, MD, USA: IEEE, Nov. 2022, pp. 484–489. doi: 10.1109/MILCOM55135.2022.10017793.

M. Qasim and E. Verdu, “Video anomaly detection system using deep convolutional and recurrent models,” Results in Engineering, vol. 18, p. 101026, Jun. 2023, doi: 10.1016/j.rineng.2023.101026.

O. Hamza, A. Collins, A. Eweje, and G. O. Babatunde, “Advancing Data Migration and Virtualization Techniques: ETL-Driven Strategies for Oracle BI and Salesforce Integration in Agile Environments,” IJMRGE, vol. 5, no. 1, pp. 1100–1118, Jan. 2024, doi: 10.54660/.IJMRGE.2024.5.1.1100-1118.

S. Hiremath et al., “A New Approach to Data Analysis Using Machine Learning for Cybersecurity,” BDCC, vol. 7, no. 4, p. 176, Nov. 2023, doi: 10.3390/bdcc7040176.

Saswata Dey, Writuraj Sarma, and Sundar Tiwari, “Deep learning applications for real-time cybersecurity threat analysis in distributed cloud systems,” World J. Adv. Res. Rev., vol. 17, no. 3, pp. 1044–1058, Mar. 2023, doi: 10.30574/wjarr.2023.17.3.0288.

N. Joshi, “Optimizing Real-Time ETL Pipelines Using Machine Learning Techniques,” Dec. 2024, SSRN. doi: 10.2139/ssrn.5054767.

M. F. Ansari, R. Sandilya, M. Javed, and D. Doermann, “ETLNet: An Efficient TCN-BiLSTM Network for Road Anomaly Detection Using Smartphone Sensors,” Dec 2024, arXiv. doi: 10.48550/ARXIV.2412.04990.

D. Seenivasan, “AI Driven Enhancement of ETL Workflows for Scalable and Efficient Cloud Data Engineering,” int. jour. eng. com. sci, vol. 13, no. 06, pp. 26837–26848, Jun. 2024, doi: 10.18535/ijecs.v13i06.4824.

R. Kumaran, “ETL Techniques for Structured and Unstructured Data,” SSRN Journal, Jan. 2024, doi: 10.2139/ssrn.5143370.

P. Cichonski, T. Millar, T. Grance, and K. Scarfone, “Computer Security Incident Handling Guide : Recommendations of the National Institute of Standards and Technology,” National Institute of Standards and Technology, NIST SP 800-61r2, Aug. 2023. doi: 10.6028/NIST.SP.800-61r2.

M. K. Hooshmand and D. Hosahalli, “Network anomaly detection using deep learning techniques,” CAAI Trans on Intel Tech, vol. 7, no. 2, pp. 228–243, Jun. 2022, doi: 10.1049/cit2.12078.

M. Said Elsayed, N.-A. Le-Khac, S. Dev, and A. D. Jurcut, “Network Anomaly Detection Using LSTM Based Autoencoder,” in Proceedings of the 16th ACM Symposium on QoS and Security for Wireless and Mobile Networks, Alicante Spain: ACM, Nov. 2020, pp. 37–45. doi: 10.1145/3416013.3426457.

Downloads

Published

19.04.2025

How to Cite

Shiva Kumar Vuppala. (2025). Intersection of AI and Cybersecurity: A Data-Driven Approach to Proactive Risk Management in ETL Processes. International Journal of Intelligent Systems and Applications in Engineering, 13(1), 191–204. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/7567

Issue

Vol. 13 No. 1 (2025)

Section

Research Article

License

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.

IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.