The Power of Visual Storytelling: A Deep Learning Framework for Educational Influence

Authors

  • K. Dinesh Kumar Mechatronics and Information Technology, Institute of Technology of Cambodia, Phnom Penh, Cambodia
  • Sarot Srang Mechatronics and Information Technology, Institute of Technology of Cambodia, Phnom Penh, Cambodia.
  • Dona Valy Department of Information and Communication Engineering, Institute of Technology of Cambodia, Phnom Penh, Cambodia

Keywords:

GANs, Nodes, Relation, Graph Embedding, Visual Storytelling, Blooms Taxonomy

Abstract

This research focuses on enhancing students' memory retention and visualization skills in education through visual storytelling, a powerful pedagogical approach known for improving learning outcomes across various domains. Our visual storytelling method involves generating images from text using Generative Adversarial Networks (GANs) along with the Graph Embedding technique, contributing to comprehension, memory, sequencing, and engagement. A primary survey revealed that a significant portion of teachers (70.3%) in India and Cambodia incorporate visual storytelling in half of their total class time. However, the process is perceived as time-consuming, prompting educators' expectations for a unified model capable of generating complete reading comprehension along with images. In our post-experiment test, involving 8th-grade students, the study compared the Experimental Group, experiencing visual storytelling, with the Control Group using traditional methods. Assessments through Fill-in-the-Blanks, Multiple Choice Questions (MCQs), and story continuation demonstrated the Experimental Group's improved recall, application, and critical thinking skills. Remarkably, 92% of the Experimental Group actively engaged in continuing the story, signifying a substantial increase compared to the Control Group. Post-research surveys show a strong willingness of educators (96.3%) to integrate visual storytelling into classrooms, with 63% expressing a desire to incorporate our research findings into teaching methods, particularly in reading comprehension with image sequences. These findings underscore the positive impact of visual storytelling, advocating for its widespread adoption and further exploration in educational practices.

Downloads

Download data is not yet available.

References

Maila D. H. Rahiem “Storytelling in early childhood education: Time to go digital”, International Journal of Child Care and Education Policy, ICEP 15, 4 (2021). https://doi.org/10.1186/s40723-021-00081-x.

Smeda, N., Dakich, E. & Sharda, N. “The effectiveness of digital storytelling in the classrooms: a comprehensive study”. Smart Learn. Environ. 1, 6 (2014). https://doi.org/10.1186/s40561-014-0006-3

Sinead McGee,” The role of storytelling in early literacy development at Northbridge”, The role of storytelling in early literacy development at Northbridge (nordangliaeducation.com), 26 April, 2021.

The power of visual storytelling in content design (uxdesigninstitute.com)

Vinnie Wong, “What is visual Storytelling? How to engage and Inspire Audience”, Aug 31, 2023, What Is Visual Storytelling? How to Engage and Inspire Audiences (piktochart.com).

Jamal Raiyn, “The Role of Visual Learning in Improving Students’ High-Order Thinking Skills”, Journal of Education and Practice, www.iiste.org ISSN 2222-1735 (Paper) ISSN 2222-288X , (Online) Vol.7, No.24, 2016.

What is reading comprehension and why is it important? (oxfordowl.co.uk)

Halverson, R., & Shapiro, R. B. (2012). Technologies for education and technologies for learners: How information technologies are (and should be) changing schools. (WCER Working Paper no. 2012-6).

Llama 2 - Meta AI

K. Dinesh Kumar, Dr. Sarot Srang, Dr. Dona Valy, “Visual Storytelling: A Generative Adversarial Networks (GANs) and Graph Embedding Framework”, International Journal on Recent and Innovation Trends in Computing and Communication, 30-September-2023.

Christine Persaud, “Bloom’s Taxonomy: The Ultimate Guide”, HIGHER ED TRENDS, How to Implement Bloom's Taxonomy in Your Course | Top Hat,

Downloads

Published

24.03.2024

How to Cite

Kumar, K. D. ., Srang , S. ., & Valy , D. . (2024). The Power of Visual Storytelling: A Deep Learning Framework for Educational Influence. International Journal of Intelligent Systems and Applications in Engineering, 12(18s), 800–806. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/5168

Issue

Section

Research Article