Tackling the Challenges of Distributed Data Management in Cloud Computing - A Review of Approaches and Solutions
Keywords:
Data Management, Storage, cloud computing, challenges, consistencyAbstract
Cloud computing is a contemporary endeavour to provide computing resources, such as hardware or software, as a service across a network. Cloud computing is a current IT trend that involves shifting computation and data storage from desktop and portable PCs to enormous data centre's that can store massive amounts of information, measured in peta-bytes. Cloud Computing encompasses multiple facets, including availability, scalability, virtualization, interoperability, quality of service, and the delivery types of the cloud, which are private, public, and hybrid. Cloud databases are mostly utilized for data-intensive applications, such as data warehousing, data mining, and business intelligence. A cloud database is necessary to efficiently accelerate the process of reducing the burdens associated with routing configuration. This article conducts a thorough analysis of challenges in cloud computing data management, focusing on dimensions such as consistency, scalability, security, interoperability, migration, and latency. Scholarly investigations address distributed databases, consensus algorithms, encryption, access control, auditing, and the development of harmonious ecosystems for diverse cloud environments. Emphasis is placed on automated migration tools, best practices, and methodologies for smooth transitions, as well as innovative solutions for minimizing latency in real-time applications. The overarching goal is to advance data confidentiality, integrity, system security, and long-term advancements in cloud computing.
Downloads
References
Vankudre, A. "Data Management in Cloud Computing" Adarsh Institute Of Technology.
Vela, F. "Cloud Computing Management" Masaryk University Faculty of Informatics, 2013, pp. 12-13.
Mohammad, S., Breß, S., Schallehn, E. "Cloud Data Management: A Short Overview and Comparison of Current Approaches."
"Data Management Solutions in the Cloud: Accessing, Sharing, and Processing Data on Google Cloud Platform (GCP)."
S. R. M. Zeebaree, H. Shukur, L. Haji, and R. Zebari, “Characteristics and Analysis of Hadoop Distributed Systems,” Technol. Reports Kansai Univ., vol. 62, no. 4, pp. 1555–1564, 2020.
Wang, C., Wang, Q., Ren, K., Lou, W. "Privacy-preserving public auditing for data storage security in cloud computing," IEEE INFOCOM, 2010, pp. 1-9.
P. Y. Abdullah, S. R. M. Zeebaree, K. Jacksi, and R. R. Zeabri, “an Hrm System for Small and Medium Enterprises (Sme)S Based on Cloud Computing Technology,” Int. J. Res. -GRANTHAALAYAH, vol. 8, no. 8, pp. 56–64, 2020, doi: 10.29121/granthaalayah.v8.i8.2020.926
Kaufman, L. M. "Data Security in the World of Cloud Computing," IEEE Security & Privacy Magazine, 2009.
Security Guidance for Critical Areas of Focus in Cloud Computing," Cloud Security Alliance, 2010.
P. Abdullah, H. Shukur, K. Jacksi, P. Y. Abdullah, S. R. M. Zeebaree, and H. M. Shukur, “HRM System using Cloud Computing for Small and Medium Enterprises (SMEs) Head of IT Department View project Client-Server and Video Broadcasting View project HRM System using Cloud Computing for Small and Medium Enterprises (SMEs),” Tkru, vol. 62, no. May, 2020, [Online]. Available: https://www.researchgate.net/publication/341883552.
[Gartner Report](http://www.gartner.com/DisplayDocument?id=685308).
S. R. M. Zeebaree, R. R. Zebari, K. Jacksi, and D. A. Hasan, “Security Approaches For Integrated Enterprise Systems Performance: A Review,” 2019, [Online]. Available: https://api.semanticscholar.org/CorpusID:219780910.
Chang, F., et al. "Bigtable: A Distributed Storage System for Structured Data," OSDI, 2006, pp. 205–218.
Cooper, B.F., et al. "PNUTS: Yahoo!’s Hosted Data Serving Platform," VLDB Endowment, 2008, pp. 1277–1288.
S. R. M. Zeebaree, A. B. Sallow, B. K. Hussan, and S. M. Ali, “Design and Simulation of High-Speed Parallel/Sequential Simplified DES Code Breaking Based on FPGA,” in 2019 International Conference on Advanced Science and Engineering (ICOASE), 2019, pp. 76–81, doi: 10.1109/ICOASE.2019.8723792.
DeCandia, G., et al. "Dynamo: Amazon’s Highly Available Key-Value Store," SOSP, 2007, pp. 205–220.
Lindsay, B.G., et al. "Computation and Communication in R*: A Distributed Database Manager," ACM Trans. Comput. Syst., 1984, pp. 24–38.
S. R. M. Zeebaree, “DES encryption and decryption algorithm implementation based on FPGA,” Indones. J. Electr. Eng. Comput. Sci., vol. 18, no. 2, pp. 774–781, 2020, doi: 10.11591/ijeecs.v18.i2.pp774-781.
Rothnie Jr., J.B., et al. "Introduction to a System for Distributed Databases (SDD1)," ACM Trans. Database Syst., 1980, pp. 1–17.
Bernstein, P.A., Hadzilacos, V., Goodman, N. "Concurrency Control and Recovery in Database Systems," Addison Wesley, 1987.
H. Malallah et al., “A Comprehensive Study of Kernel (Issues and Concepts) in Different Operating Systems,” Asian J. Res. Comput. Sci., vol. 8, no. 3, pp. 16–31, 2021, doi: 10.9734/ajrcos/2021/v8i330201.
Weikum, G., Vossen, G. "Transactional Information Systems: Theory, Algorithms, and the Practice of Concurrency Control and Recovery," Morgan Kaufmann, 2001.
H. Shukur, S. Zeebaree, R. Zebari, O. Ahmed, L. Haji, and D. Abdulqader, “Cache Coherence Protocols in Distributed Systems,” J. Appl. Sci. Technol. Trends, vol. 1, no. 3, pp. 92–97, 2020, doi: 10.38094/jastt1329.
Harsh, P., Dudouet, F., Cascella, R. G., Jegou, Y., Morin, C. "Using Open Standards for Interoperability Issues, Solutions, and Challenges facing Cloud Computing," Inria Rennes - Bretagne Atlantique.
Schubert, L., et al. "The Future of Cloud Computing: Opportunities for European Cloud Computing Beyond," European Commission, 2010.
S. R. Zeebaree et al., “Multicomputer Multicore System Influence on Maximum Multi-Processes Execution Time,” TEST Eng. Manag., vol. 83, no. 03, pp. 14921–14931, 2020.
Petcu, D. "Portability and Interoperability between Clouds: Challenges and Case Study, Towards a Service-Based Internet," Lecture Notes in Computer Science, 2011, vol. 6994, pp. 62-74.
Rashidi, B., Sharifi, M., Jafari, T. "A Survey on Interoperability in the Cloud Computing Environments," International Journal of Modern Education and Computer Science, 2013, pp. 17-23.
Z. N. Rashid, S. R. M. Zeebaree, M. A. M. Sadeeq, R. R. Zebari, H. M. Shukur, and A. Alkhayyat, “Cloud-based Parallel Computing System Via Single-Client Multi-Hash Single-Server Multi-Thread,” in 2021 International Conference on Advance of Sustainable Engineering and its Application (ICASEA), 2021, pp. 59–64, doi: 10.1109/ICASEA53739.2021.9733077.
Lewis, G. A. "The Role of Standards in Cloud Computing Interoperability," October 2012.
Rao, R., Prakash, P. "Improving Security for Data Migration in Cloud Computing using Randomized Encryption Technique," 2013.
Z. N. Rashid, S. R. M. Zeebaree, R. R. Zebari, S. H. Ahmed, H. M. Shukur, and A. Alkhayyat, “Distributed and Parallel Computing System Using Single-Client Multi-Hash Multi-Server Multi-Thread,” in 2021 1st Babylon International Conference on Information Technology and Science (BICITS), 2021, pp. 222–227, doi: 10.1109/BICITS51482.2021.9509872.
Amin, R., Vadlamudi, S., Rahaman, M. M. "Opportunities and Challenges of Data Migration in Cloud."
Cranford, N. "Five Challenges of Cloud Migration," RCR Wireless News, 2017.
L. M. Haji, S. R. M. Zeebaree, O. M. Ahmed, M. A. M. Sadeeq, H. M. Shukur, and A. Alkhavvat, “Performance Monitoring for Processes and Threads Execution-Controlling,” in 2021 International Conference on Communication & Information Technology (ICICT), 2021, pp. 161–166, doi: 10.1109/ICICT52195.2021.9568445.
Cardoso, A., Moreira, F., Simões, P. "A Survey of Cloud Computing Migration Issues and Frameworks."
M. A. M．Sadeeq and S. R. M. Zeebaree, “Design and implementation of an energy management system based on distributed IoT,” Comput. Electr. Eng., vol. 109, p. 108775, 2023, doi: https://doi.org/10.1016/j.compeleceng.2023.108775.
"Pros and Cons of Cloud Data Migration," Flatworld Solutions, [Online] Available: [link](https://www.flatworldsolutions.com/datamanagement/articles/pros-cons-cloud-data-migration.php).
Uggirala, A. "Five Cloud Migration Strategies for Applications," Imperva Blog, 2018.
Furfaro, A., Garro, A., Tundis, A. "Towards Security as a Service (SecaaS): On the Modeling of Security Services for Cloud Computing," 2014 Int. Carnahan Conf. Secur. Technol. ICCST.
M. A. M. Sadeeq and S. R. M. Zeebaree, “DPU-ALDOSKI dataset of Monitoring and Controlling distributed far distances energy consumed system based on Internet of Things,” Data Br., vol. 49, p. 109455, 2023, doi: https://doi.org/10.1016/j.dib.2023.109455.
Abdou Hussein, A. "Data Migration Need, Strategy, Challenges, Methodology, Categories, Risks, Uses with Cloud Computing, and Improvements in Its Using with Cloud Using Suggested Proposed Model (DMig 1)," Journal of Information Security, 2021.
Kushwah, V. S., Saxena, A. "A Security Approach for Data Migration in Cloud Computing," 2013.
Moore, A. W. "Characterizing the Impact of Network Latency on Cloud-Based Applications' Performance," 2017.
L. M. Haji, S. R. M. Zeebaree, Z. S. Ageed, O. M. Ahmed, M. A. M. Sadeeq, and H. M. Shukur, “Performance Monitoring and Controlling of Multicore Shared-Memory Parallel Processing Systems,” in 2022 3rd Information Technology To Enhance e-learning and Other Application (IT-ELA), 2022, pp. 44–48, doi: 10.1109/IT-ELA57378.2022.10107953.
Bali, M. S., Khurana, S. "Effect of Latency on Network and End User Domains in Cloud Computing," Dec 2013.
Aburukbaa, R. O., AliKarrara, M., Landolsia, T., El-Fakih, K. "Scheduling Internet of Things Requests to Minimize Latency in Hybrid Fog-Cloud Computing."
Y. S. Jghef, S. R. M. Zeebaree, Z. S. Ageed, and H. M. Shukur, “Performance Measurement of Distributed Systems via Single-Host Parallel Requesting using (Single, Multi and Pool) Threads,” in 2022 3rd Information Technology To Enhance e-learning and Other Application (IT-ELA), 2022, pp. 38–43, doi: 10.1109/IT-ELA57378.2022.10107923.
Bali, M. S., Khurana, S. "Effect of Latency on Network and End User Domains in Cloud Computing."
Z. S. Ageed and S. R. M. Zeebaree, “Distributed Systems Meet Cloud Computing: A Review of Convergence and Integration,” Int. J. Intell. Syst. Appl. Eng., vol. 12, no. 11s, pp. 469–490, 2024, [Online]. Available: https://ijisae.org/index.php/IJISAE/article/view/4468.
Kamal, J.M.M. and Murshed, M., 2014. Distributed database management systems: architectural design choices for the cloud. Cloud Computing: Challenges, Limitations and R&D Solutions, pp.23-50.
S. R. M. Zeebaree , et al., “Single-threading Based Distributed-multiprocessor-machines Affecting by Distributed-parallel-computing Technology,” J. Duhok Univ., vol. 26, no. 2, pp. 416–426, 2023, doi: 10.26682/csjuod.2023.26.2.39.
Huth, A., Cebula, J. "The Basics of Cloud Computing."
Turab, N. M., Talebn, A. A., Masadeh, S. R. "Cloud Computing Challenges and Solutions."
Mell, P., Grance, T. "The NIST Definition of Cloud Computing, National Institute of Standards and Technology," 2009.
Ghanam, Y., Ferreira, J., Maurer, F. "Emerging Issues & Challenges in Cloud Computing—A Hybrid Approach."
Hassan, A. "Cloud Computing: Literature Review," 2022, [Online] Available: [link](https://mars.gmu.edu/bitstream/handle/1920/11608/hassan_cloud.pdf?sequence=1).
"Architecture of Cloud Computing," GeeksforGeeks, 2022, [Online] Available: [link](https://www.geeksforgeeks.org/architecture-of-cloud-computing/amp/).
Chandran, A. and Shyamala, C.K., 2017, January. Data management issues in cloud integrated computing: A big picture. In 2017 4th International Conference on Advanced Computing and Communication Systems (ICACCS) (pp. 1-8). IEEE.
Horey, J., Begoli, E., Gunasekaran, R., Lim, S.H. and Nutaro, J., 2012. Big data platforms as a service: challenges and approach. In 4th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud 12).
Forell, T., Milojicic, D. and Talwar, V., 2011, May. Cloud management: Challenges and opportunities. In 2011 IEEE international symposium on parallel and distributed processing workshops and Phd forum (pp. 881-889). IEEE.
el-Khameesy, N. and Rahman, H.A., 2012. A proposed model for enhancing data storage security in cloud computing systems. Journal of Emerging Trends in Computing and Information Sciences, 3(6), pp.970-974.
Ooi, B.C., 2009, October. Cloud data management systems: Opportunities and challenges. In 2009 Fifth International Conference on Semantics, Knowledge and Grid (pp. 2-2). IEEE.
Sakr, S., Liu, A., Batista, D.M. and Alomari, M., 2011. A survey of large scale data management approaches in cloud environments. IEEE communications surveys & tutorials, 13(3), pp.311-336.
Zhang, Q. and Boutaba, R., 2014, May. Dynamic workload management in heterogeneous cloud computing environments. In 2014 IEEE Network Operations and Management Symposium (NOMS) (pp. 1-7). IEEE.
Tärneberg, W., Papadopoulos, A.V., Mehta, A., Tordsson, J. and Kihl, M., 2017, May. Distributed approach to the holistic resource management of a mobile cloud network. In 2017 IEEE 1st International Conference on Fog and Edge Computing (ICFEC) (pp. 51-60). IEEE.
Lehner, W., Sattler, K.U. and Sattler, K.U., 2013. Web-scale data management for the cloud (Vol. 5). Berlin: Springer.
George, S. and Edwin, E.B., 2017, December. A review on data replication strategy in cloud computing. In 2017 IEEE International Conference on Computational Intelligence and Computing Research (ICCIC) (pp. 1-4). IEEE.
Chhabra, S. and Singh, A.K., 2022. A comprehensive vision on cloud computing environment: Emerging challenges and future research directions. arXiv preprint arXiv:2207.07955.
Sen, P., Saha, P. and Khatua, S., 2015, February. A distributed approach towards trusted cloud computing platform. In 2015 Applications and Innovations in Mobile Computing (AIMoC) (pp. 146-151). IEEE.
Sundareswaran, S., Squicciarini, A. and Lin, D., 2012. Ensuring distributed accountability for data sharing in the cloud. IEEE transactions on dependable and secure computing, 9(4), pp.556-568.
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.
