A Study on Text Entry in XR: Case of Korean

Authors

  • Su Young Kim, So Hyeon Ryu, Yoon Sang Kim

Keywords:

augmented reality, bare-hand interaction, extended reality, virtual keyboard

Abstract

In recent years, extended reality (XR) devices have been developed into see-through HMD (Head Mounted Display) with bare-hand interaction. Previous studies on inputting text based on bare-hands in XR were mainly conducted using virtual keyboards, but most of them focused on inputting alphabetic characters, so there is still insufficient research on inputting Korean characters. In addition, virtual keyboards in previous studies were mainly augmented in mid-air, thus various augmented positions were not considered. Therefore, this paper presents a study on augmented positions for inputting Korean text in the XR environment. For this purpose, we developed an experimental environment for three augmented positions (mid-air, physical planar surface, and inner surface of the palm) based on the international standard Korean keyboard layout and analyzed its effects on text entry through an experiment. From the analysis results, it was confirmed that the virtual keyboard performed the best overall when augmented in mid-air.

Downloads

Download data is not yet available.

References

Milgram, P., Takemura, H., Utsumi, A., & Kishino, F. (1995). Augmented reality: A class of displays on the reality-virtuality continuum. Telemanipulator and telespresence technologies, 2351, 282-292. DOI: 10.1117/12.197321

Milgram, P., & Colquhoun, H. (1999). A taxonomy of real and virtual world display integration. Mixed reality: Merging real and virtual worlds, 1-26. DOI: 10.1007/978-3-642-87512-0_1

Card, S. K. (Ed.). (1983/2018). The psychology of human-computer interaction. Crc Press.

Xu, W., Liang, H. N., He, A., & Wang, Z. (2019). Pointing and selection methods for text entry in augmented reality head mounted displays. 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 279-288. DOI: 10.1109/ISMAR.2019.00026

Dudley, J. J., Benko, H., Wigdor, D., & Kristensson, P. O. (2019). Performance envelopes of virtual keyboard text input strategies in virtual reality. 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 289-300. DOI: 10.1109/ISMAR.2019.00027

Kern, F., Niebling, F., & Latoschik, M. E. (2023). Text Input for Non-Stationary XR Workspaces: Investigating Tap and Word-Gesture Keyboards in Virtual and Augmented Reality. IEEE Transactions on Visualization and Computer Graphics, 29(5), 2658-2669. DOI: 10.1109/TVCG.2023.3247098

Lee, T. H., & Lee, H. J. (2018). A new virtual keyboard with finger gesture recognition for AR/VR devices. Human-Computer Interaction. Interaction Technologies: 20th International Conference, 56-67. DOI: 10.1007/978-3-319-91250-9_5

Brasier, E., Chapuis, O., Ferey, N., Vezien, J., & Appert, C. (2020). Arpads: Mid-air indirect input for augmented reality. 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 332-343. DOI: 10.1109/ISMAR50242.2020.00060

Song, Z., Dudley, J. J., & Kristensson, P. O. (2022). Efficient Special Character Entry on a Virtual Keyboard by Hand Gesture-Based Mode Switching. 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 864-871. DOI: 10.1109/ISMAR55827.2022.00105

Speicher, M., Feit, A. M., Ziegler, P., & Krüger, A. (2018). Selection-based text entry in virtual reality. Proceedings of the 2018 CHI conference on human factors in computing systems, 1-13. DOI: 10.1145/3173574.3174221

Chen, S., Wang, J., Guerra, S., Mittal, N., & Prakkamakul, S. (2019). Exploring word-gesture text entry techniques in virtual reality. Extended Abstracts of the 2019 CHI conference on human factors in computing systems, 1-6. DOI: 10.1145/3290607.3312762

Boletsis, C., & Kongsvik, S. (2019). Controller-based text-input techniques for virtual reality: An empirical comparison. International Journal of Virtual Reality (IJVR), 19(3), 1-15. DOI: 10.20870/IJVR.2019.19.3.2917

Lee, T. H., & Lee, H. J. (2018). Ambidextrous virtual keyboard design with finger gesture recognition. 2018 IEEE International Symposium on Circuits and Systems (ISCAS), 1-4. DOI: 10.1109/ISCAS.2018.8351485

Dudley, J. J., Vertanen, K., & Kristensson, P. O. (2018). Fast and precise touch-based text entry for head-mounted augmented reality with variable occlusion. ACM Transactions on Computer-Human Interaction (TOCHI), 25(6), 1-40. DOI: 10.1145/3232163

Kim, B. J., Kwon, K. C., Yang, Y. M., & Kim, N. (2018). Keyboard for Virtual Reality Head Mounted Display using Electro-oculogram. The Journal of the Korea Contents Association, 18(1), 1-9. DOI: 10.5392/JKCA.2018.18.01.001

Yu, H., Park, T., Joh, M., & Lee, S. (2023). Vision based Virtual Touch Keyboard: Focused on Unconstrained Usability. Proceedings of HCI KOREA 2023, 750-755. [Online]. Available: https://www.dbpia.co.kr/Journal/articleDetail?nodeId=NODE11229744

Dube, T. J., & Arif, A. S. (2020). Impact of key shape and dimension on text entry in virtual reality. Extended abstracts of the 2020 CHI conference on human factors in computing systems, 1-10. DOI: 10.1145/3334480.3382882

Lu, X., Yu, D., Liang, H. N., & Goncalves, J. (2021). itext: Hands-free text entry on an imaginary keyboard for augmented reality systems. The 34th Annual ACM Symposium on User Interface Software and Technology, 815-825. DOI: 10.1145/3472749.3474788

Kim, Y., Sung, M., & Kim, D. (2015). A Virtual Keyboard Interface for Head-Mounted Display. Proceedings of 2023 Korea Computer Congress (KCC), 1410-1412. [Online]. Available: https://www.dbpia.co.kr/Journal/articleDetail?nodeId=NODE06394424

MacKenzie, I. S., & Soukoreff, R. W. (2003). Phrase sets for evaluating text entry techniques. CHI'03 extended abstracts on Human factors in computing systems,754-755. DOI: 10.1145/765891.765971

Choi, Y., & Kim, Y. S. (2022). An Adaptive UI Based on User-Satisfaction Prediction in Mixed Reality. Applied Sciences, 12(9), 4559. DOI: 10.3390/app12094559

Downloads

Published

26.03.2024

How to Cite

So Hyeon Ryu, Yoon Sang Kim, S. Y. K. . (2024). A Study on Text Entry in XR: Case of Korean. International Journal of Intelligent Systems and Applications in Engineering, 12(3), 1779–1785. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/5587

Issue

Vol. 12 No. 3 (2024)

Section

Research Article

License

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.

IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.