A Critical Study of Pragmatic Ambiguity Detection in Natural Language Requirements

Authors

  • Reena S. Satpute, Avinash Agrawal

Keywords:

Natural Language Processing, Ambiguity, Pragmatic Ambiguity

Abstract

An approach for pragmatic ambiguity detection in natural language requirements is presented in this paper. Pragmatic ambiguities are determined by the requirements' context, which includes the reader's background knowledge. Readers with different backgrounds may interpret requirements differently. To determine whether a requirement is ambiguous or not, various pragmatic interpretations are compared. In this paper, we will discuss the significance of pragmatic ambiguity detection in NLRs, applications of NLP, ambiguities in NLP, and pragmatic ambiguities, as well as review various techniques used for identifying and resolving ambiguities in natural language requirements. Our objective is to motivate further research in this field by providing a thorough understanding of the difficulties and opportunities related to pragmatic ambiguity detection in NLRs. The tool might be enhanced in the future to support more file types, like PDF. There is ongoing research in the area of pragmatic ambiguity detection, and new approaches and procedures are constantly being developed. It is likely that improvements in pragmatic ambiguity detection and resolution will come as a result of developments in artificial intelligence, machine learning, and natural language processing in the future. Additionally, the growing accessibility of expansive, varied datasets will make it possible to train more reliable and accurate models. Pragmatic ambiguity detection is likely to become a more crucial tool as the field develops in fields like automated language translation, dialogue systems, and natural language understanding.

Downloads

Download data is not yet available.

Author Biography

Reena S. Satpute, Avinash Agrawal

Ms. Reena S. Satpute, Dr. Avinash Agrawal

Assistant Professor Datta Meghe Institute of Higher Education & Research, Sawangi (M)

Email – reenasatpute2017@gmail.com

Associate Professor & Dean Shri Ramdeobaba College of Engineering and Management, Nagpur

Email – agrawalaj@rknec.edu

References

Ferrari, G. Lipari, S. Gnesi and G. O. Spagnolo, "Pragmatic ambiguity detection in natural language requirements," 2014 IEEE 1st International Workshop on Artificial Intelligence for Requirements Engineering (AIRE), Karlskrona, Sweden, 2014, pp. 1-8, doi: 10.1109/AIRE.2014.6894849.

Mishra, S., & Sharma, A. (2019). On the use of word embeddings for identifying domain specific ambiguities in requirements. Paper presented at the 2019 IEEE 27th International Requirements Engineering Conference Workshops (REW).

M. Q. Riaz, W. H. Butt and S. Rehman, "Automatic Detection of Ambiguous Software Requirements: An Insight," 2019 5th International Conference on Information Management (ICIM), Cambridge, UK, 2019, pp. 1-6, doi: 10.1109/INFOMAN.2019.8714682.

Sabriye, A. O. J. a., & Zainon, W. M. N. W. (2017). A framework for detecting ambiguity in software requirement specification. Paper presented at the 2017 8th International Conference on Information Technology (ICIT).

Ali, S. W., Ahmed, Q. A., & Shafi, I. (2018). Process to enhance the quality of software requirement specification document. Paper presented at the 2018 International Conference on Engineering and Emerging Technologies (ICEET).

D. Kokane, S. D. Babar and P. N. Mahalle, "Word Sense Disambiguation for Large Documents Using Neural Network Model," 2021 12th International Conference on Computing Communication and Networking Technologies (ICCCNT), Kharagpur, India, 2021, pp. 1-5, doi: 10.1109/ICCCNT51525.2021.9580101.

Riaz, M. Q., Butt, W. H., & Rehman, S. (2019). Automatic detection of ambiguous software requirements: An insight. Paper presented at the 2019 5th International Conference on Information Management (ICIM).

Nazir, F., Butt, W.H., Anwar, M.W., Khan Khattak, M.A. (2017). The Applications of Natural Language Processing (NLP) for Software Requirement Engineering - A Systematic Literature Review. In: Kim, K., Joukov, N. (eds) Information Science and Applications 2017. ICISA 2017. Lecture Notes in Electrical Engineering, vol 424. Springer, Singapore. https://doi.org/10.1007/978-981-10-4154-9_56

Mathews, S.M. (2019). Explainable Artificial Intelligence Applications in NLP, Biomedical, and Malware Classification: A Literature Review. In: Arai, K., Bhatia, R., Kapoor, S. (eds) Intelligent Computing. CompCom 2019. Advances in Intelligent Systems and Computing, vol 998. Springer, Cham. https://doi.org/10.1007/978-3-030-22868-2_90

Shankar, V., Parsana, S. An overview and empirical comparison of natural language processing (NLP) models and an introduction to and empirical application of autoencoder models in marketing. J. of the Acad. Mark. Sci. 50, 1324–1350 (2022). https://doi.org/10.1007/s11747-022-00840-3

Yue Kang, Zhao Cai, Chee-Wee Tan, Qian Huang & Hefu Liu (2020) Natural language processing (NLP) in management research: A literature review, Journal of Management Analytics, 7:2, 139-172, DOI: 10.1080/23270012.2020.1756939

Dhar, A., Mukherjee, H., Dash, N.S. et al. Text categorization: past and present. Artif Intell Rev 54, 3007–3054 (2021). https://doi.org/10.1007/s10462-020-09919-1

P. Garg and N. Girdhar, "A Systematic Review on Spam Filtering Techniques based on Natural Language Processing Framework," 2021 11th International Conference on Cloud Computing, Data Science & Engineering (Confluence), Noida, India, 2021, pp. 30-35, doi: 10.1109/Confluence51648.2021.9377042.

S. Alves, J. Costa and J. Bernardino, "Information Extraction Applications for Clinical Trials: A Survey," 2019 14th Iberian Conference on Information Systems and Technologies (CISTI), Coimbra, Portugal, 2019, pp. 1-6, doi: 10.23919/CISTI.2019.8760639.

Abualigah, L., Bashabsheh, M.Q., Alabool, H., Shehab, M. (2020). Text Summarization: A Brief Review. In: Abd Elaziz, M., Al-qaness, M., Ewees, A., Dahou, A. (eds) Recent Advances in NLP: The Case of Arabic Language. Studies in Computational Intelligence, vol 874. Springer, Cham. https://doi.org/10.1007/978-3-030-34614-0_1

Ni, J., Young, T., Pandelea, V. et al. Recent advances in deep learning based dialogue systems: a systematic survey. Artif Intell Rev (2022). https://doi.org/10.1007/s10462-022-10248-8

Zhou, G. Yang, Z. Shi and S. Ma, "Natural Language Processing for Smart Healthcare," in IEEE Reviews in Biomedical Engineering, 2022, doi: 10.1109/RBME.2022.3210270.

M. Bano, "Addressing the challenges of requirements ambiguity: A review of empirical literature," 2015 IEEE Fifth International Workshop on Empirical Requirements Engineering (EmpiRE), Ottawa, ON, Canada, 2015, pp. 21-24, doi: 10.1109/EmpiRE.2015.7431303.

Chowdhary, K.R. (2020). Natural Language Processing. In: Fundamentals of Artificial Intelligence. Springer, New Delhi. https://doi.org/10.1007/978-81-322-3972-7_19

R. Sahoo, B. R. Das and B. Kishore Mishra, "Analysis and Implementation of Odia Part of Speech Tagger in recent IoT based devices through Chatbot: A review," 2020 International Conference on Computer Science, Engineering and Applications (ICCSEA), Gunupur, India, 2020, pp. 1-4, doi: 10.1109/ICCSEA49143.2020.9132940.

Das Dawn, D., Shaikh, S.H. & Pal, R.K. A comprehensive review of Bengali word sense disambiguation. Artif Intell Rev 53, 4183–4213 (2020). https://doi.org/10.1007/s10462-019-09790-9

Harish, B.S., Rangan, R.K. A comprehensive survey on Indian regional language processing. SN Appl. Sci. 2, 1204 (2020). https://doi.org/10.1007/s42452-020-2983-x

T. Kato and K. Tsuda, “A Method of Ambiguity Detection in Requirement Specifications by Using a Knowledge Dictionary,” Procedia Comput. Sci., vol. 207, pp. 1482–1489, 2022, doi: https://doi.org/10.1016/j.procs.2022.09.205.

Manam, VK Chaithanya, Joseph Divyan Thomas, and Alexander J. Quinn. "TaskLint: Automated Detection of Ambiguities in Task Instructions." Proceedings of the AAAI Conference on Human Computation and Crowdsourcing. Vol. 10. No. 1. 2022.

S. Ezzini, S. Abualhaija, C. Arora and M. Sabetzadeh, "Automated Handling of Anaphoric Ambiguity in Requirements: A Multi-solution Study," 2022 IEEE/ACM 44th International Conference on Software Engineering (ICSE), Pittsburgh, PA, USA, 2022, pp. 187-199, doi: 10.1145/3510003.3510157.

Roopa, H. R., and S. Panneer Arockiaraj. "The Role of Artificial Neural Network in Word Sense Disambiguation (WSD)—A Survey." Rising Threats in Expert Applications and Solutions. Springer, Singapore, 2022. 221-227.

Kaddoura, Sanaa, and Rowanda D. Ahmed. "A comprehensive review on Arabic word sense disambiguation for natural language processing applications." Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery (2022): e1447.

Saxena, Shefali, et al. "Improved unsupervised statistical machine translation via unsupervised word sense disambiguation for a low-resource and Indic languages." IETE Journal of Research (2022): 1-11.

Yadav, Apurwa, Aarshil Patel, and Manan Shah. "A comprehensive review on resolving ambiguities in natural language processing." AI Open 2 (2021): 85-92.

S. Ezzini, S. Abualhaija, C. Arora, M. Sabetzadeh and L. C. Briand, "Using Domain-Specific Corpora for Improved Handling of Ambiguity in Requirements," 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE), Madrid, ES, 2021, pp. 1485-1497, doi: 10.1109/ICSE43902.2021.00133.

M. Osama, A. Zaki-Ismail, M. Abdelrazek, J. Grundy and A. Ibrahim, "Score-Based Automatic Detection and Resolution of Syntactic Ambiguity in Natural Language Requirements," 2020 IEEE International Conference on Software Maintenance and Evolution (ICSME), Adelaide, SA, Australia, 2020, pp. 651-661, doi: 10.1109/ICSME46990.2020.00067.

Mishra, Siba, and Arpit Sharma. "On the use of word embeddings for identifying domain specific ambiguities in requirements." 2019 IEEE 27th International Requirements Engineering Conference Workshops (REW). IEEE, 2019.

Ferrari, Alessio, et al. "Detecting requirements defects with NLP patterns: an industrial experience in the railway domain." Empirical Software Engineering 23.6 (2018): 3684-3733.

(Walton D. (1996) A Pragmatic Synthesis. In: Fallacies Arising from Ambiguity. Applied Logic Series, vol 1. Springer, Dordrecht).

R. Sonbol, G. Rebdawi and N. Ghneim, "The Use of NLP-Based Text Representation Techniques to Support Requirement Engineering Tasks: A Systematic Mapping Review," in IEEE Access, vol. 10, pp. 62811-62830, 2022, doi: 10.1109/ACCESS.2022.3182372.

Khurana, D., Koli, A., Khatter, K. et al. Natural language processing: state of the art, current trends and challenges. Multimed Tools Appl 82, 3713–3744 (2023). https://doi.org/10.1007/s11042-022-13428-4

Apurwa Yadav, Aarshil Patel, Manan Shah, A comprehensive review on resolving ambiguities in natural language processing, AI Open, Volume 2, 2021, Pages 85-92, ISSN 2666-6510, https://doi.org/10.1016/j.aiopen.2021.05.001.

T. P. Nagarhalli, V. Vaze and N. K. Rana, "Impact of Machine Learning in Natural Language Processing: A Review," 2021 Third International Conference on Intelligent Communication Technologies and Virtual Mobile Networks (ICICV), Tirunelveli, India, 2021, pp. 1529-1534, doi: 10.1109/ICICV50876.2021.9388380.

Oo, K.H. (2023). Comparing Accuracy Between SVM, Random Forest, K-NN Text Classifier Algorithms for Detecting Syntactic Ambiguity in Software Requirements. In: Al-Emran, M., Al-Sharafi, M.A., Shaalan, K. (eds) International Conference on Information Systems and Intelligent Applications. ICISIA 2022. Lecture Notes in Networks and Systems, vol 550. Springer, Cham. https://doi.org/10.1007/978-3-031-16865-9_4

Moharil and A. Sharma, "Identification of Intra-Domain Ambiguity using Transformer-based Machine Learning," 2022 IEEE/ACM 1st International Workshop on Natural Language-Based Software Engineering (NLBSE), Pittsburgh, PA, USA, 2022, pp. 51-58, doi: 10.1145/3528588.3528651.

M. Osama, A. Zaki-Ismail, M. Abdelrazek, J. Grundy and A. Ibrahim, "Score-Based Automatic Detection and Resolution of Syntactic Ambiguity in Natural Language Requirements," 2020 IEEE International Conference on Software Maintenance and Evolution (ICSME), Adelaide, SA, Australia, 2020, pp. 651-661, doi: 10.1109/ICSME46990.2020.00067.

Khalid Abdikarim Mohamed, Jamilah Din, & Salmi Baharom. (2022). A Tool to Detect Pragmatic Ambiguity with Possible Interpretations Suggestion in Software Requirement Specifications. International Journal of Synergy in Engineering and Technology, 3(2), 52-60. Retrieved from https://tatiuc.edu.my/ijset/index.php/ijset/article/view/141

Fabiano Dalpiaz, Ivor van der Schalk, Sjaak Brinkkemper, Fatma Başak Aydemir, Garm Lucassen, Detecting terminological ambiguity in user stories: Tool and experimentation, Information and Software Technology, Volume 110, 2019, Pages 3-16, ISSN 0950-5849, https://doi.org/10.1016/j.infsof.2018.12.007.

S. Mishra and A. Sharma, "On the Use of Word Embeddings for Identifying Domain Specific Ambiguities in Requirements," 2019 IEEE 27th International Requirements Engineering Conference Workshops (REW), Jeju, Korea (South), 2019, pp. 234-240, doi: 10.1109/REW.2019.00048.

S. Assem and S. Alansary, "Sentiment Analysis From Subjectivity to (Im)Politeness Detection: Hate Speech From a Socio-Pragmatic Perspective," 2022 20th International Conference on Language Engineering (ESOLEC), Cairo, Egypt, 2022, pp. 19-23, doi: 10.1109/ESOLEC54569.2022.10009298.

Application of NLP

Downloads

Published

04.02.2023

How to Cite

Reena S. Satpute, Avinash Agrawal. (2023). A Critical Study of Pragmatic Ambiguity Detection in Natural Language Requirements. International Journal of Intelligent Systems and Applications in Engineering, 11(3s), 249–259. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/2681

Issue

Section

Research Article