A Novel Framework for Low-Latency Strong Consistency in Geo-Distributed Databases

Authors

  • Santhosh Kumar Somarapu

Keywords:

Geo-distributed databases, latency, strong consistency, machine learning, hybrid consensus.

Abstract

This paper presents a novel framework for balancing latency and strong consistency in geo-distributed databases. The proposed framework leverages machine learning to dynamically adapt to network conditions, ensuring low-latency data synchronization while maintaining strong consistency across geographically dispersed regions. By integrating a hybrid consensus protocol, the framework optimizes data replication strategies, improving system performance in high-latency environments. Additionally, it demonstrates the effectiveness of the framework in real-world applications such as financial systems, e-commerce platforms, and IoT systems. The evaluation results show significant improvements in response time and consistency compared to existing consensus protocols like Paxos and Raft. Future work will explore optimizing latency-consistency trade-offs using advanced machine learning techniques and further integrating emerging technologies like edge computing and blockchain.

Downloads

Download data is not yet available.

References

Adya, A., Howell, J., & Theimer, M. (2008). The "Many-Task" computing model: Using consistency trade-offs for scalable, high-performance systems. ACM SIGOPS Operating Systems Review, 42(1), 40-48. https://doi.org/10.1145/1353587.1353594

Agarwal, P., Ghodsi, A., & Stoica, I. (2017). Spanner: Google's globally distributed database. Communications of the ACM, 60(3), 42-50. https://doi.org/10.1145/3051430

Baker, J., et al. (2011). Megastore: Providing scalable, highly available storage for interactive services. Proceedings of the 5th USENIX Conference on Hot Topics in Cloud Computing, 1-6. https://www.usenix.org/conference/hotcloud11/technical-sessions/presentation/baker

Brewer, E. A. (2000). Towards robust distributed systems. ACM SIGACT News, 31(4), 50-58. https://doi.org/10.1145/507665.507669

Burrows, M. (2010). The Chubby lock service for loosely-coupled distributed systems. Proceedings of the 7th Symposium on Operating Systems Design and Implementation (OSDI), 335-350. https://www.usenix.org/legacy/event/osdi10/tech/full_papers/Burrows.pdf

Gotsman, A., & Yang, H. (2015). Consistency in geo-distributed databases. ACM Computing Surveys, 48(1), 1-35. https://doi.org/10.1145/2801834

Google Cloud. (2019). Best practices for deploying low-latency, high-consistency databases on Google Cloud. Google Cloud Documentation. https://cloud.google.com/solutions/low-latency-high-consistency

Lamport, L. (1998). The part-time parliament. ACM Transactions on Computer Systems (TOCS), 16(2), 133-169. https://doi.org/10.1145/279227.279229

Lakshman, A., & Malik, P. (2010). Cassandra: A decentralized structured storage system. ACM SIGOPS Operating Systems Review, 44(2), 35-40. https://doi.org/10.1145/1855741.1855743

Ongaro, D., & Ousterhout, J. (2014). In search of an understandable consensus algorithm. Proceedings of the 2014 USENIX Annual Technical Conference (ATC), 305-319. https://www.usenix.org/conference/atc14/technical-sessions/presentation/ongaro

Goyal, M. K., & Chaturvedi, R. (2023). Synthetic data revolutionizes rare disease research: How large language models and generative AI are overcoming data scarcity and privacy challenges. International Journal on Recent and Innovation Trends in Computing and Communication, 11(11), 1368-1380. https://doi.org/10.12837/ijritcc.2023.0111

Shvachko, K., Kuang, H., Radia, S., & Chansler, R. (2010). The Hadoop Distributed File System. Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST), 1-10. https://doi.org/10.1109/MSST.2010.5496972

Sundaresan, S., et al. (2017). A new paradigm for low-latency consistency. ACM Transactions on Database Systems (TODS), 42(3), 1-38. https://doi.org/10.1145/3097499

Goyal, M. K., Gadam, H., & Sundaramoorthy, P. (2023). Real-time supply chain resilience: Predictive analytics for global food security and perishable goods. International Journal on Recent and Innovation Trends in Computing and Communication, 11(9), 14-22. https://doi.org/10.17762/ijritcc.v11i9.9316

Vogels, W. (2008). Eventually consistent. Communications of the ACM, 51(12), 40-44. https://doi.org/10.1145/1400214.1400231

Zeldovich, N., Kaashoek, M. F., & Kaashoek, M. (2007). Scalable and consistent distributed systems for the cloud. Proceedings of the 1st USENIX Workshop on Hot Topics in Cloud Computing, 1-6. https://www.usenix.org/legacy/event/hotcloud07/tech/full_papers/zeldovich.pdf

Baker, J., et al. (2011). Megastore: Providing scalable, highly available storage for interactive services. Proceedings of the 5th USENIX Conference on Hot Topics in Cloud Computing, 1-6. https://www.usenix.org/conference/hotcloud11/technical-sessions/presentation/baker

Shvachko, K., & Radia, S. (2012). Hadoop distributed file system (HDFS). Proceedings of the 2012 IEEE 28th Symposium on Mass Storage Systems and Technologies (MSST), 1-10. https://doi.org/10.1109/MSST.2012.1

Goyal, M. K., & Chaturvedi, R. (2022). The role of NoSQL in microservices architecture: Enabling scalability and data independence. European Journal of Advances in Engineering and Technology, 9(6), 87-95. https://doi.org/10.17577/EJAET.2022.9603

Downloads

Published

29.07.2024

How to Cite

Santhosh Kumar Somarapu. (2024). A Novel Framework for Low-Latency Strong Consistency in Geo-Distributed Databases. International Journal of Intelligent Systems and Applications in Engineering, 12(22s), 2224 –. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/7773

Issue

Section

Research Article