Vize: A Voice-Based Interface for Data Visualization and Summarisation with Recommendation System

Authors

  • Anil Vasoya Thakur College of Engineering and Technology, Mumbai, India.
  • Kamal Shah Thakur College of Engineering and Technology, Mumbai, India.
  • Neha Gadiya Dwarkadas J. Sanghvi College of Engineering, Mumbai, India
  • Palka Dhirawani Dwarkadas J. Sanghvi College of Engineering, Mumbai, India.
  • Pratik Kanani Dwarkadas J. Sanghvi College of Engineering, Mumbai, India.
  • Vedant Gandhi Dwarkadas J. Sanghvi College of Engineering, Mumbai, India.

Keywords:

Data Visualization, Voice user interface, Summarization, Accessibility, Speech Recognition, Recommendation System

Abstract

Data comprises information that may be used to improve business performance and keep a competitive edge. Extraction of knowledge and insights depends on data analytics and visualization technologies. The popularity of voice technology has skyrocketed recently. Users may communicate with technology using only their voices, which leverages speech recognition technology. A Voice User Interface (VUI) is intended to simulate dialogues that result in device-user interaction and facilitate users' ability to complete activities or perform information searches without requiring their hands or eyes. Thus, users can interact freely with their data, verify, and query it, and pursue their own lines of inquiry in a way that is both flexible and unfettered. Through a survey conducted, it was deduced that having a VUI could be a solution to streamline processes and give users an easier method to access data visualization tools. This research work aims to build a web-based tool that would enable data exploration and visualization through speech recognition. This equips users of all skill levels as well as those with sight impairments to easily upload their data and create visualizations with the use of straightforward voice commands. By simply instructing the software to do so, users may also request a summary of their data and customize the charts they create as they see fit. A Data Visualization Recommendation System (DVRS) was introduced that automatically created a dashboard that showcases the charts that can help users to understand their database quicker. It makes use of a simple feedforward neural network that provides insights into the underlying factors driving the predictions, resulting in charts with a high probability value. The charts with the highest probability values are chosen to be presented on the dashboard.

Downloads

Download data is not yet available.

References

Diamond, M. and Mattia, A. (2017) Data Visualization: An exploratory study into the software tools used by businesses., Journal of Instructional Pedagogies. Academic and Business Research Institute. 147 Medjool Trail, Ponte Vedra, FL 32081. Tel: 904-435-4330; e-mail: editorial.staff@aabri.com; Web site: http://www.aabri.com. Available at: https://eric.ed.gov/?id=EJ1151731 (Accessed: February 28, 2023).

Kaidi, Z. (no date) Data Visualization - University of Illinois Chicago. Available at: https://www.cs.uic.edu/~kzhao/Papers/00_course_Data_visualization.pdf (Accessed: February 28, 2023).

Kendall, Linus & Chaudhuri, Bidisha & Bhalla, Apoorva. (2020). Understanding Technology as Situated Practice: Everyday use of Voice User Interfaces Among Diverse Groups of Users in Urban India. Information Systems Frontiers. 22. 585-605. 10.1007/s10796-020-10015-6.

Shakila Cherise S Joyner, Amalia Riegelhuth, Kathleen Garrity, Yea-Seul Kim, and Nam Wook Kim. 2022.Visualization Accessibility in the Wild: Challenges Faced by Visualization Designers. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22). Association for Computing Machinery, New York, NY, USA, Article 83, 1–19. https://doi.org/10.1145/3491102.3517630.

Ather Sharif, Sanjana Shivani Chintalapati, Jacob O. Wobbrock, and Katharina Reinecke. 2021. Understanding Screen-Reader Users’ Experiences with Online Data Visualizations. In Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '21). Association for Computing Machinery, New York, NY, USA, Article 14, 1–16. https://doi.org/10.1145/3441852.3471202.

Profunda Analytics + dundas bi (no date) Premium Reporting & Data Analytics - Dundas Data Visualization. Available at: https://www.dundas.com/resources/customer-stories/embedded/profunda-analytics-dundas-bi (Accessed: October 5, 2022).

FlowSense (no date) VisFlow. Available at: https://visflow.org/flowsense/ (Accessed: October 5, 2022).

Zierau, N., Hildebrand, C., Bergner, A. et al. Voice bots on the frontline: Voice-based interfaces enhance flowlike consumer experiences & boost service outcomes. J. of the Acad. Mark. Sci. (2022). https://doi.org/10.1007/s11747-022-00868-5.

C. Murad, C. Munteanu, B. R. Cowan and L. Clark, "Revolution or Evolution? Speech Interaction and HCI Design Guidelines," in IEEE Pervasive Computing, vol. 18, no. 2, pp. 33-45, 1 April-June 2019, doi:10.1109/MPRV.2019.2906991.

H. Guo, S. R. Gomez, C. Ziemkiewicz and D. H. Laidlaw, "A Case Study Using Visualization Interaction Logs and Insight Metrics to Understand How Analysts Arrive at Insights," in IEEE Transactions on Visualization and Computer Graphics, vol. 22, no. 1, pp. 51-60, 31 Jan. 2016, doi:10.1109/TVCG.2015.2467613.

L. Shen et al., "Towards Natural Language Interfaces for Data Visualization: A Survey," in IEEE Transactions on Visualization and Computer Graphics, doi: 10.1109/TVCG.2022.3148007.

Srinivasan, Arjun; Stasko, John; Keefe, Daniel F.; Tory, Melanie (2020). How to Ask What to Say?: Strategies for Evaluating Natural Language Interfaces for Data Visualization. IEEE Computer Graphics and Applications, 40(4), 96–103. doi:10.1109/MCG.2020.2986902.

K. Padmanandam, S. P. V. D. S. Bheri, L. Vegesna and K. Sruthi, "A Speech Recognized Dynamic Word Cloud Visualization for Text Summarization," 2021 6th International Conference on Inventive Computation Technologies (ICICT), 2021, pp. 609-613, doi: 10.1109/ICICT50816.2021.9358693.

Marriott, Kim, Bongshin Lee, Matthew Butler, Ed Cutrell, Kirsten Ellis, Cagatay Goncu, Marti Hearst, Kathleen McCoy, and Danielle Albers Szafir. "Inclusive data visualization for people with disabilities: a call to action." Interactions 28, no. 3 (2021): 47-51.

Ather Sharif, Sanjana Shivani Chintalapati, Jacob O. Wobbrock, and Katharina Reinecke. 2021. Understanding Screen-Reader Users’ Experiences with Online Data Visualizations. In Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '21). Association for Computing Machinery, New York, NY, USA, Article 14, 1–16. https://doi.org/10.1145/3441852.3471202

Sharif, A., Wang, O.H., Muongchan, A.T., Reinecke, K. and Wobbrock, J.O., 2022, April. VoxLens: Making Online Data Visualizations Accessible with an Interactive JavaScript Plug-In. In CHI Conference on Human Factors in Computing Systems (pp. 1-19).

Kevin Hu, Michiel A. Bakker, Stephen Li, Tim Kraska, and Cesar Hidalgo. 2019. VizML: A Machine Learning Approach to Visualization Recommendation. In Proceedings of CHI Conference on Human Factors in Computing Systems (CHI '19), May 4–9, 2019, Glasgow, Scotland UK. ACM, New York, NY, USA 21 Pages.

5-Point Likert Scale. In: Preedy, V.R., Watson, R.R. (eds) Handbook of Disease Burdens and Quality of Life Measures. Springer, New York, NY (2010). https://doi.org/10.1007/978-0-387-78665-0_6363.

Vartak M, Rahman S, Madden S, Parameswaran A, Polyzotis N. SeeDB: Efficient Data-Driven Visualization Recommendations to Support Visual Analytics. Proceedings VLDB Endowment. 2015 Sep;8(13):2182-2193. PMID: 26779379; PMCID: PMC4714568.

V. Dibia and Ç. Demiralp, "Data2Vis: Automatic Generation of Data Visualizations Using Sequence-to-Sequence Recurrent Neural Networks," in IEEE Computer Graphics and Applications, vol. 39, no. 5, pp. 33-46, 1 Sept.-Oct. 2019, doi: 10.1109/MCG.2019.2924636.

Anupong, W., Yi-Chia, L., Jagdish, M., Kumar, R., Selvam, P.D., Saravanakumar, R., Dhabliya, D. Hybrid distributed energy sources providing climate security to the agriculture environment and enhancing the yield (2022) Sustainable Energy Technologies and Assessments, 52, art. no. 102142

Aoudni, Y., Donald, C., Farouk, A., Sahay, K.B., Babu, D.V., Tripathi, V., Dhabliya, D. Cloud security based attack detection using transductive learning integrated with Hidden Markov Model (2022) Pattern Recognition Letters, 157, pp. 16-26.

Downloads

Published

05.12.2023

How to Cite

Vasoya, A. ., Shah, K. ., Gadiya, N. ., Dhirawani, P. ., Kanani, P. ., & Gandhi, V. . (2023). Vize: A Voice-Based Interface for Data Visualization and Summarisation with Recommendation System. International Journal of Intelligent Systems and Applications in Engineering, 12(7s), 201–216. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/4063

Issue

Vol. 12 No. 7s (2024)

Section

Research Article

License

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.

IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.

Most read articles by the same author(s)