A Proposed Framework for Human-like Language Processing of ChatGPT in Academic Writing

Authors

  • Mohammad Mahyoob Languages and Translation Department, Taibah university https://orcid.org/0000-0002-6664-1017
  • Jeehaan Algaraady Department of English, Faculty of Education, Taiz University, Yemen https://orcid.org/0000-0003-3901-4648
  • Abdulaziz Alblwi Computer Science Department, Applied College, Taibah University, KSA

DOI:

https://doi.org/10.3991/ijet.v18i14.41725

Keywords:

Natural and artificial language processing, academic writing, OpenAI, emerging technologies, ChatGPT, LLMs

Abstract


The study proposed a framework for analyzing and measuring the ChatGPT capabilities as a generic language model. This study aims to examine the capabilities of the emerging technological Artificial Intelligence tool (ChatGPT) in generating effective academic writing. The proposed framework consists of six principles (Relatedness, Adequacy, Limitation, Authenticity, Cognition, and Redundancy) related to Artificial Language Processing which would explore the accuracy and proficiency of this algorithm-generated writing. The researchers used ChatGPT to obtain some academic texts and paragraphs in different genres as responses to some textbased academic queries. A critical analysis of the content of these academic texts was conducted based on the proposed framework principles. The results show that despite ChatGPT’s exceptional capabilities, its serious defects are evident, as many issues in academic writing are raised. The major issues include information repetition, nonfactual inferences, illogical reasoning, fake references, hallucination, and lack of pragmatic interpretation. The proposed framework would be a valuable guideline for researchers and practitioners interested in analyzing and evaluating recently emerging machine languages of AI language models.

Author Biography

Mohammad Mahyoob, Languages and Translation Department, Taibah university

Mohammad Mahyoob is an Associate Professor of Computational linguistics in the Department of Languages & Translation Department, at Taibah University, Madina, Saudi Arabia. He holds his Ph. D in Computational Linguistics. His research interests include Computational linguistics, Online learning, digital media studies, Theoretical and Applied Linguistics, and English Language Education.

ORCID: https://orcid.org/0000-0002-6664-1017.

Cover iJET – Vol 18, No 14, 2023

Downloads

Published

2023-07-31

How to Cite

Mahyoob, M., Algaraady, J. ., & Alblwi, A. (2023). A Proposed Framework for Human-like Language Processing of ChatGPT in Academic Writing . International Journal of Emerging Technologies in Learning (iJET), 18(14), pp. 282–293. https://doi.org/10.3991/ijet.v18i14.41725

Issue

Vol. 18 No. 14 (2023)

Section

Papers

License

Copyright (c) 2023 Mohammad Mahyoob, Jeehaan Algaraady, Abdulaziz Alblwi

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

The submitting author warrants that the submission is original and that she/he is the author of the submission together with the named co-authors; to the extend the submission incorporates text passages, figures, data or other material from the work of others, the submitting author has obtained any necessary permission.
Articles in this journal are published under the Creative Commons Attribution Licence (CC-BY What does this mean?). This is to get more legal certainty about what readers can do with published articles, and thus a wider dissemination and archiving, which in turn makes publishing with this journal more valuable for you, the authors.
By submitting an article the author grants to this journal the non-exclusive right to publish it. The author retains the copyright and the publishing rights for his article without any restrictions.