Generative Adversarial Network to Evaluate the Ceramic Art Design through Virtual Reality with Augmented Reality

Authors

  • Shouzheng Huang Universiti Utara Malaysia, changloon, 06010, Malaysia and Jingdezhen Ceramic University, Jingdezhen, Jiangxi, 333000, China
  • Adzrool Idzwan Bin Ismail Universiti Utara Malaysia, changloon, 06010, Malaysia

Keywords:

Ceramic Art, Deep Learning, Generative Adversarial Networks, Reinforcement Learning, Augmented Reality (AR), Virtual reality (VR)

Abstract

A ceramic art exhibition is a curated display of ceramic artworks, sculptures, pottery, and other ceramic creations. These exhibitions provide a platform for ceramic artists to showcase their work and allow art enthusiasts, collectors, and the public to appreciate the beauty and diversity of ceramic art.  Ceramic art exhibitions have embarked on a dynamic transformation by harnessing the power of augmented reality (AR) and virtual reality (VR) technology. This paper proposed an architecture of the GAN-RL (Generative Adversarial Networks with Reinforcement Learning) process. the fusion of AR and VR technologies with augmented flow networks generated by the GAN-RL process. The GAN-RL framework introduces adaptability and interactivity to the visitor's journey, shaping their experience based on preferences and real-time feedback. With the proposed GAN-RL the ceramic art designs are evaluated and trained in the network for the analysis. Finally, the GAN-designed features are applied in the deep learning model for the classification process. The results demonstrated that the deep learning model with the GAN-RL achieves an accuracy of 0.99 which is significantly higher compared with the conventional techniques.

Downloads

Download data is not yet available.

References

Ming, Y., Me, R. C., Chen, J. K., & Rahmat, R. W. O. (2023). A Systematic Review on Virtual Reality Technology for Ancient Ceramic Restoration. Applied Sciences, 13(15), 8991.

Fengyi, L., & Liu, S. (2022). 3D Garment Design Model Based on Convolution Neural Network and Virtual Reality. Computational Intelligence and Neuroscience, 2022.

Buratti, G., Conte, S., & Rossi, M. (2021). Artificial Intelligency, Big Data and Cultural Heritage. In REPRESENTATION CHALLENGES. Augmented Reality and Artificial Intelligence in Cultural Heritage and Innovative Design Domain (pp. 29-34). Franco Angeli.

Salimbeni, G., Fol Leymarie, F., & Latham, W. (2022). A machine learning Application based on giorgio morandi Still-life paintings to Assist Artists in the Choice of 3d Compositions. Leonardo, 55(1), 57-61.

Farook, T. H., Ahmed, S., Jamayet, N. B., Rashid, F., Barman, A., Sidhu, P., ... & Daood, U. (2023). Computer-aided design and 3-dimensional artificial/convolutional neural network for digital partial dental crown synthesis and validation. Scientific Reports, 13(1), 1561.

Nagao, K., Kumon, K., & Hattori, K. (2021). Impact sound generation for audiovisual interaction with real-world movable objects in building-scale virtual reality. Applied Sciences, 11(16), 7546.

Lin, W., & Li, C. (2023). Review of Studies on Emotion Recognition and Judgment Based on Physiological Signals. Applied Sciences, 13(4), 2573.

Li¹, R., & Zhang, B. (2022). The Use of Edge Cloud Computing Technology in Innovative Design of Historical Cultural and Creative Products in the Context of Augmented Reality.

Li, D., & Alkathir, E. S. (2021). Implementation of Computer-Based Vision Technology to Consider Visual Form of Ceramic Mural Art. Mathematical Problems in Engineering, 2021, 1-15.

Dashti, S. (2022). Sound shape modelling, interaction and prototyping for virtual pottery (Doctoral dissertation, Cardiff Metropolitan University).

Srinivasan, R., & Uchino, K. (2021, March). Biases in generative art: A causal look from the lens of art history. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (pp. 41-51).

Wu, K., Fu, X. M., Chen, R., & Liu, L. (2022). Survey on computational 3D visual optical art design. Visual Computing for Industry, Biomedicine, and Art, 5(1), 1-31.

Núñez Jareño, S. J., van Helden, D. P., Mirkes, E. M., Tyukin, I. Y., & Allison, P. M. (2021). Learning from scarce information: using synthetic data to classify Roman fine ware pottery. Entropy, 23(9), 1140.

KRUPSKYY, I., ZYKUN, N., OVCHYNNIKOVA, A., GOREVALOV, S., & MITCHUK, O. (2021). DETERMINANTS AND MODERN GENRES OF AUDIO-VISUAL ART. Journal of the Balkan Tribological Association, 27(4).

Bonny, T., Al Nassan, W., Obaideen, K., Al Mallahi, M. N., Mohammad, Y., & El-damanhoury, H. M. (2023). Contemporary Role and Applications of Artificial Intelligence in Dentistry. F1000Research, 12, 1179.

Cho, H. W., Shin, S. J., Seo, G. J., Kim, D. B., & Lee, D. H. (2022). Real-time anomaly detection using convolutional neural network in wire arc additive manufacturing: molybdenum material. Journal of Materials Processing Technology, 302, 117495.

Bertacchini, F., Bilotta, E., De Pietro, M., Demarco, F., Pantano, P., & Scuro, C. (2022). Modeling and recognition of emotions in manufacturing. International Journal on Interactive Design and Manufacturing (IJIDeM), 16(4), 1357-1370.

Sero, D., Garachon, I., Hermens, E., Liere, R. V., & Batenburg, K. J. (2021). The study of three-dimensional fingerprint recognition in cultural heritage: Trends and challenges. Journal on Computing and Cultural Heritage (JOCCH), 14(4), 1-20.

Franchi, V., & Ntagiou, E. (2021, November). Augmentation of a virtual reality environment using generative adversarial networks. In 2021 IEEE international conference on artificial intelligence and virtual reality (AIVR) (pp. 219-223). IEEE.

Toshpulatov, M., Lee, W., & Lee, S. (2021). Generative adversarial networks and their application to 3D face generation: A survey. Image and vision computing, 108, 104119.

Maldonado-Romo, J., Maldonado-Romo, A., & Aldape-Pérez, M. (2022). Path Generator with Unpaired Samples Employing Generative Adversarial Networks. Sensors, 22(23), 9411.

Šoberl, D. (2023). Mixed Reality and Deep Learning: Augmenting Visual Information Using Generative Adversarial Networks. In Augmented Reality and Artificial Intelligence: The Fusion of Advanced Technologies (pp. 3-29). Cham: Springer Nature Switzerland.

Khan, M. F. F., Devulapally, A., Advani, S., & Narayanan, V. (2022, October). Robust Multimodal Depth Estimation using Transformer based Generative Adversarial Networks. In Proceedings of the 30th ACM International Conference on Multimedia (pp. 3559-3568).

Roy, D., Mukherjee, D., & Chanda, B. (2021, January). An Unsupervised Approach towards Varying Human Skin Tone Using Generative Adversarial Networks. In 2020 25th International Conference on Pattern Recognition (ICPR) (pp. 10681-10688). IEEE.

Lim, S., Shin, M., & Paik, J. (2022). Point cloud generation using deep adversarial local features for augmented and mixed reality contents. IEEE Transactions on Consumer Electronics, 68(1), 69-76.

Xia, Y., Zheng, W., Wang, Y., Yu, H., Dong, J., & Wang, F. Y. (2021). Local and global perception generative adversarial network for facial expression synthesis. IEEE Transactions on Circuits and Systems for Video Technology, 32(3), 1443-1452.

Kumar, T. S. (2021). Study of retail applications with virtual and augmented reality technologies. Journal of Innovative Image Processing, 3(2), 144-156.

Hatori, K., & Takemura, K. (2023). Conditional Generative Adversarial Network-Based Tactile Stimulus Generation for Ultrasonic Tactile Display. IEEE Access.

Khan, M. F. F., Troncoso Aldas, N. D., Kumar, A., Advani, S., & Narayanan, V. (2021, October). Sparse to dense depth completion using a generative adversarial network with intelligent sampling strategies. In Proceedings of the 29th ACM International Conference on Multimedia (pp. 5528-5536).

Nakhaee, A., & Paydar, A. (2023, March). DeepRadiation: An intelligent augmented reality platform for predicting urban energy performance just through 360 panoramic streetscape images utilizing various deep learning models. In Building Simulation (Vol. 16, No. 3, pp. 499-510). Beijing: Tsinghua University Press.

Wang, X., Jiang, H., Liu, Y., & Yang, Q. (2023). Data-augmented patch variational autoencoding generative adversarial networks for rolling bearing fault diagnosis. Measurement Science and Technology, 34(5), 055102.

Anitha, C., & Kumar, R. M. S. (2022). GEVE: A generative adversarial network for extremely dark image/video enhancement. Pattern Recognition Letters, 155, 159-164.

Pektas, M., & Ugur, A. (2022). Realistic Hair Synthesis with Generative Adversarial Networks. arXiv preprint arXiv:2209.12875.

Yoon, D., Kong, H. J., Kim, B. S., Cho, W. S., Lee, J. C., Cho, M., ... & Kim, S. (2022). Colonoscopic image synthesis with generative adversarial network for enhanced detection of sessile serrated lesions using convolutional neural network. Scientific reports, 12(1), 261.

Hughes, R. T., Zhu, L., & Bednarz, T. (2021). Generative adversarial networks–enabled human–artificial intelligence collaborative applications for creative and design industries: A systematic review of current approaches and trends. Frontiers in artificial intelligence, 4, 604234.

Downloads

Published

30.11.2023

How to Cite

Huang, S. ., & Ismail, A. I. B. . (2023). Generative Adversarial Network to Evaluate the Ceramic Art Design through Virtual Reality with Augmented Reality. International Journal of Intelligent Systems and Applications in Engineering, 12(6s), 508–520. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/3992

Issue

Section

Research Article