Scalable Data-Driven Engineering for High-Performance Computing & Financial Services

Authors

  • Santosh Durgam, Vikas Nagaraj

Keywords:

Scalable Data Engineering, Semiconductor Design Reliability, GPU Hardware Validation, AI-Ready Computing, Financial Services Optimization.

Abstract

The study discussions will touch upon enhancements to the efficiency of high-performance computing systems through the assimilation of scalable data engineering and semiconductor verification to improve data computing technological processes, especially in the financial services sector. The authors of this study explore how computerized gross working of applications like fraud detection, risk control, and algorithmic trading can be optimized through the integration of GPU hardware verification with AI-ready systems. The major results of the study include that the performance of the system increased by 25%, and the time spent on studying cases decreased as the proposals of the GPU made it possible, and the provisions of AI-driven hardware verification to conduct the verification were enhanced by 30%. Moreover, it also found data engineering pipelines to compute 95% success rates when handling real-time financial transactions, and with latency reduced to under <5ms. A combination of scaled, automated data streams has led to cost reductions of 15-20% per year, and the use of machine learning in semiconductor testing has shown that the decrease in tests could be up to 90%. The paper concludes that convergence of hardware validation and scalable data engineering is a key to devising AI-ready systems, capable of meeting the computational needs of the present financial services, enhancing reliability, scalability, and velocity. The integration is set to drive the real-time ability of decisions in the economic field to a greater extent.

Downloads

Download data is not yet available.

References

Amid, A. (2021). Generator-Based Design of Custom Systems-on-Chip for Numerical Data Analysis (Doctoral dissertation, University of California, Berkeley).

Bello, H. O., Ige, A. B., & Ameyaw, M. N. (2024). Deep learning in high-frequency trading: conceptual challenges and solutions for real-time fraud detection. World Journal of Advanced Engineering Technology and Sciences, 12(02), 035-046.

Blondheim Jr, D. (2022). Improving manufacturing applications of machine learning by understanding defect classification and the critical error threshold. International Journal of Metalcasting, 16(2), 502-520.

Bonthu, C., & Goel, G. (2025). Autonomous supplier evaluation and data stewardship with AI: Building transparent and resilient supply chains. International Journal of Computational and Experimental Science and Engineering. https://ijcesen.com/index.php/ijcesen/article/view/3854/1154

Bonthu, C., & Goel, G. (2025). The role of multi-domain MDM in modern enterprise data strategies. International Journal of Data Science and Machine Learning, 5(1), 9. https://doi.org/10.55640/ijdsml-05-01-09

Brahmbhatt, R. (2025). Machine learning for dynamic pricing strategies in e-commerce and physical retail. Utilitas Mathematica. https://utilitasmathematica.com/index.php/Index/article/view/2710

Brahmbhatt, R., & Sardana, J. (2025). Empowering patient-centric communication: Integrating quiet hours for healthcare notifications with retail & e-commerce operations strategies. Journal of Information Systems Engineering and Management. https://www.jisem-journal.com/index.php/journal/article/view/3677

Brin, D. (2022). Convergence: Artificial intelligence and quantum computing: Social, economic, and policy impacts. John Wiley & Sons.

Butt, M. A., Mateos, X., & Piramidowicz, R. (2024). Photonics sensors: a perspective on current advancements, emerging challenges, and potential solutions. Physics Letters A, 516, 129633.

Chadha, K. S. (2025). Edge AI for real-time ICU alarm fatigue reduction: Federated anomaly detection on wearable streams. Utilitas Mathematica, 122(2), 291–308. https://utilitasmathematica.com/index.php/Index/article/view/2708

Chadha, K. S. (2025). Zero-trust data architecture for multi-hospital research: HIPAA-compliant unification of EHRs, wearable streams, and clinical trial analytics. International Journal of Computational and Experimental Science and Engineering, 12(3), 1–11. https://ijcesen.com/index.php/ijcesen/article/view/3477/987

Chavan, A. (2023). Managing scalability and cost in microservices architecture: Balancing infinite scalability with financial constraints. Journal of Artificial Intelligence & Cloud Computing, 2, E264. http://doi.org/10.47363/JAICC/2023(2)E264

Chavan, A. (2025). The role of domain-driven design in successful microservices migration strategies. Journal of Information Systems Engineering and Management. https://www.jisem-journal.com/index.php/journal/article/view/8888

Cooke, R. A. (2020). Modelling and characterisation of distributed hardware acceleration (Doctoral dissertation, University of Warwick).

Devarajegowda, K. (2021). Model-based Generation of Assertions for Pre-silicon Verification (Doctoral dissertation, Dissertation, Kaiserslautern, Technische Universität Kaiserslautern, 2021).

Duffie, D. (2019). Prone to fail: The pre-crisis financial system. Journal of Economic Perspectives, 33(1), 81-106.

Engel, L. (2021). Globally distributed teams in the tech industry (Doctoral dissertation, Hochschule für Angewandte Wissenschaften Hamburg).

Farooq, U., & Mehrez, H. (2021). Pre-silicon verification using multi-FPGA platforms: A review. Journal of Electronic Testing, 37(1), 7-24.

Gathu, S. (2024). High-performance computing and big data: Emerging trends in advanced computing systems for data-intensive applications. Journal of Advanced Computing Systems, 4(8), 22-35.

Goel, G., & Bhramhabhatt, R. (2024). Dual sourcing strategies. International Journal of Science and Research Archive, 13(2), 2155. https://doi.org/10.30574/ijsra.2024.13.2.2155

Gupta, H., & Saxena, S. (2024). Building Scalable A/B Testing Infrastructure for High-Traffic Applications: Best Practices. International Journal of Multidisciplinary Innovation and Research Methodology, ISSN, 2960-2068.

Hale, D., Chrysikopoulos, G., Kondyli, A., & Ghiasi, A. (2021). Evaluation of data‐driven performance measures for comparing and ranking traffic bottlenecks. IET Intelligent Transport Systems, 15(4), 504-513.

Hammad, A., & Abu-Zaid, R. (2024). Applications of AI in decentralized computing systems: harnessing artificial intelligence for enhanced scalability, efficiency, and autonomous decision-making in distributed architectures. Applied Research in Artificial Intelligence and Cloud Computing, 7(6), 161-187.

Juyal, P., Manukonda, P., Saratchandran, D., Trehan, A., Shah, K. N., & Rao, C. (2024). The Role of Artificial Intelligence in Enhancing Decision-Making in Enterprise Information Systems.

Koneru, N. M. K. (2025). Containerization best practices: Using Docker and Kubernetes for enterprise applications. Journal of Information Systems Engineering and Management. https://www.jisem-journal.com/index.php/journal/article/view/8905

Kumar, A. (2019). The convergence of predictive analytics in driving business intelligence and enhancing DevOps efficiency. International Journal of Computational Engineering and Management, 6(6), 118-142. Retrieved from https://ijcem.in/wp-content/uploads/THE-CONVERGENCE-OF-PREDICTIVE-ANALYTICS-IN-DRIVING-BUSINESS-INTELLIGENCE-AND-ENHANCING-DEVOPS-EFFICIENCY.pdf

Kumar, P., & Nair, K. (2024). Fault Tolerance and Reliability in Advanced Computing Systems: Techniques and Trends. Journal of Advanced Computing Systems, 4(7).

Kureljusic, M., & Karger, E. (2024). Forecasting in financial accounting with artificial intelligence–A systematic literature review and future research agenda. Journal of Applied Accounting Research, 25(1), 81-104.

Marwala, T. (2024). CPUs Versus GPUs. In The Balancing Problem in the Governance of Artificial Intelligence (pp. 137-152). Singapore: Springer Nature Singapore.

Min, B. H., & Borch, C. (2022). Systemic failures and organizational risk management in algorithmic trading: Normal accidents and high reliability in financial markets. Social studies of science, 52(2), 277-302.

Nyati, S. (2018). Transforming telematics in fleet management: Innovations in asset tracking, efficiency, and communication. International Journal of Science and Research (IJSR), 7(10), 1804-1810. Retrieved from https://www.ijsr.net/getabstract.php?paperid=SR24203184230

Pandy, G., Pugazhenthi, V. J., Chinnathambi, J. K., & Murugan, A. (2024). Smart Automation for Client Service Agreement: Robotics in Action. Journal ID, 9471(1297), 13-16.

Pasham, S. D. (2020). Fault-Tolerant Distributed Computing for Real-Time Applications in Critical Systems. The Computertech, 1-29.

Pinnapareddy, N. R. (2025). Cloud cost optimization and sustainability in Kubernetes. Journal of Information Systems Engineering and Management. https://www.jisem-journal.com/index.php/journal/article/view/8895

Raju, R. K. (2017). Dynamic memory inference network for natural language inference. International Journal of Science and Research (IJSR), 6(2). https://www.ijsr.net/archive/v6i2/SR24926091431.pdf

Silahian, A. (2024). C++ High Performance for Financial Systems: Build efficient and optimized financial systems by leveraging the power of C++. Packt Publishing Ltd.

Singh, V. (2023). Federated learning for privacy-preserving medical data analysis: Applying federated learning to analyze sensitive health data without compromising patient privacy. International Journal of Advanced Engineering and Technology, 5(S4). https://romanpub.com/resources/Vol%205%20%2C%20No%20S4%20-%2026.pdf

Singh, V. (2024). AI-powered assistive technologies for people with disabilities: Developing AI solutions that aid individuals with various disabilities in daily tasks. University of California, San Diego, California, USA. IJISAE. https://doi.org/10.9734/jerr/2025/v27i21410

Singu, S. K. (2021). Designing scalable data engineering pipelines using Azure and Databricks. ESP Journal of Engineering & Technology Advancements, 1(2), 176-187.

Solomon, G. T. (2024). Optimizing Full-Stack Development for Fintech Applications: Balancing User Experience and Backend Performance in High-Stakes Financial Environments.

Subham, K. (2025). Scalable SaaS implementation governance for enterprise sales operations. International Journal of Computational and Experimental Science and Engineering. https://ijcesen.com/index.php/ijcesen/article/view/3782

Tantalaki, N., Souravlas, S., & Roumeliotis, M. (2020). A review on big data real-time stream processing and its scheduling techniques. International Journal of Parallel, Emergent and Distributed Systems, 35(5), 571-601.

Thompson, A. (2022). AI-Driven Insights for Risk Management in Banking: Leveraging Cloud-Native Technologies for Scalability. International Journal of AI, BigData, Computational and Management Studies, 3(4), 1-10.

Trautmann, S. T. (2022). Ambiguity, experience and unforeseen events in experimental finance. In Handbook of Experimental Finance (pp. 54-63). Edward Elgar Publishing.

Downloads

Published

12.11.2025

How to Cite

Santosh Durgam. (2025). Scalable Data-Driven Engineering for High-Performance Computing & Financial Services. International Journal of Intelligent Systems and Applications in Engineering, 13(2s), 19–37. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/7914

Issue

Section

Research Article