Analyzing the role of ChatGPT as a writing assistant at higher education level: A systematic review of the literature

Muhammad Imran; Norah Almusharraf

doi:10.30935/cedtech/13605

Muhammad Imran ¹ ² ^* , Norah Almusharraf ³

More Detail

CONT ED TECHNOLOGY, Volume 15, Issue 4, Article No: ep464

https://doi.org/10.30935/cedtech/13605

Submitted: 19 June 2023, Published Online: 22 August 2023

OPEN ACCESS 23271 Views 19200 Downloads

Download Full Text (PDF)

Abstract

This study examines the role of ChatGPT as a writing assistant in academia through a systematic literature review of the 30 most relevant articles. Since its release in November 2022, ChatGPT has become the most debated topic among scholars and is also being used by many users from different fields. Many articles, reviews, blogs, and opinion essays have been published in which the potential role of ChatGPT as a writing assistant is discussed. For this systematic review, 550 articles published six months after ChatGPT’s release (December 2022 to May 2023) were collected based on specific keywords, and the final 30 most relevant articles were finalized through PRISMA flowchart. The analyzed literature identifies different opinions and scenarios associated with using ChatGPT as a writing assistant and how to interact with it. Findings show that artificial intelligence (AI) in education is a part of the ongoing development process, and its latest chatbot, ChatGPT is a part of it. Therefore, the education process, particularly academic writing, has both opportunities and challenges in adopting ChatGPT as a writing assistant. The need is to understand its role as an aid and facilitator for both the learners and instructors, as chatbots are relatively beneficial devices to facilitate, create ease and support the academic process. However, academia should revisit and update students’ and teachers’ training, policies, and assessment ways in writing courses for academic integrity and originality, like plagiarism issues, AI-generated assignments, online/home-based exams, and auto-correction challenges.

Keywords: AI in education, chatbots, ChatGPT as writing assistant, scientific writing, academic integrity

References

Afzaal, M., Imran, M., Du, X., & Almusharraf, N. (2022). Automated and human interaction in written discourse: A contrastive parallel corpus-based investigation of meta discourse features in machine-human translations. SAGE Open, 12(4), 1-18. https://doi.org/21582440221142210
Alattar, A. A., & McDowell, M. M. (2023). The rise of AI coauthors: Navigating the future of scientific writing with ChatGPT. Journal of Neurosurgery, 1, 1-2. https://doi.org/10.3171/2023.3.JNS23254
Altmäe, S., Sola-Leyva, A., & Salumets, A. (2023). Artificial intelligence in scientific writing: A friend or a foe? Reproductive BioMedicine Online. https://doi.org/10.1016/j.rbmo.2023.06.011
Ariyaratne, S., Iyengar, K. P., Nischal, N., Chitti Babu, N., & Botchu, R. (2023). A comparison of ChatGPT-generated articles with human-written articles. Skeletal Radiology. https://doi.org/10.1007/s00256-023-04340-5
Barrot, J. S. (2023). Using ChatGPT for second language writing: Pitfalls and potentials. Assessing Writing, 57, 100745. https://doi.org/10.1016/j.asw.2023.100745
Biswas, S. (2023). ChatGPT and the future of medical writing. Radiology, 307(2), e223312. https://doi.org/10.1148/radiol.223312
Cingillioglu, I. (2023). Detecting AI-generated essays: The ChatGPT challenge. The International Journal of Information and Learning Technology, 40(3), 259-268. https://doi.org/10.1108/IJILT-03-2023-0043
Cooper, G. (2023). Examining science education in ChatGPT: An exploratory study of generative artificial intelligence. Journal of Science Education and Technology. https://doi.org/10.1007/s10956-023-10039-y
Cotton, D. R., Cotton, P. A., & Shipway, J. R. (2023). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International. https://doi.org/10.1080/14703297.2023.2190148
da Silva, J. A. T. (2023). Is ChatGPT a valid author? Nurse Education in Practice, 68, 103600. https://doi.org/10.1016/j.nepr.2023.103600
Dergaa, I., Chamari, K., Zmijewski, P., & Saad, H. B. (2023). From human writing to artificial intelligence generated text: Examining the prospects and potential threats of ChatGPT in academic writing. Biology of Sport, 40(2), 615-622. https://doi.org/10.5114/biolsport.2023.125623
Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., Albanna, H., Albashrawi, M. A., Al-Busaidi, A. S., Balakrishan, J., Barlette, Y., Basu, S., Bose, I., Brooks, L., Buhalis, D., ... Wright, R. (2023). “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, 71, 102642. https://doi.org/10.1016/j.ijinfomgt.2023.102642
Firat, M. (2023). What ChatGPT means for universities: Perceptions of scholars and students. Journal of Applied Learning and Teaching, 6(1). https://doi.org/10.37074/jalt.2023.6.1.22
Gao, C. A., Howard, F. M., Markov, N. S., Dyer, E. C., Ramesh, S., Luo, Y., & Pearson, A. T. (2023). Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers. NPJ Digital Medicine, 6(1), 75. https://doi.org/10.1038/s41746-023-00819-6
Ge, J., & Lai, J. C. (2023). Artificial intelligence-based text generators in hepatology: ChatGPT is just the beginning. Hepatology Communications, 7(4). https://doi.org/10.1097/HC9.0000000000000097
Geher, G. (2023). ChatGPT, artificial intelligence, and the future of writing. Psychology Today. https://www.psychologytoday.com/us/blog/darwins-subterranean-world/202301/chatgpt-artificial-intelligence-and-the-future-of-writing
Greller, W., & Drachsler, H. (2012). Translating learning into numbers: A generic framework for learning analytics. Journal of Educational Technology & Society, 15(3), 42-57.
Holmes, W., Persson, J., Chounta, I. A., Wasson, B., & Dimitrova, V. (2022). Artificial intelligence and education: A critical view through the lens of human rights, democracy and the rule of law. Council of Europe. https://rm.coe.int/artificial-intelligence-and-education-a-critical-view-through-the-lens/1680a886bd
Homolak, J. (2023). Opportunities and risks of ChatGPT in medicine, science, and academic publishing: A modern Promethean dilemma. Croatian Medical Journal, 64(1), 1. https://doi.org/10.3325/cmj.2023.64.1
Huang, J., & Tan, M. (2023). The role of ChatGPT in scientific communication: Writing better scientific review articles. American Journal of Cancer Research, 13(4), 1148.
Imran, M., & Almusharraf, N. (2023). Review of teaching innovation in university education: Case studies and main practices. The Social Science Journal. https://doi.org/10.1080/03623319.2023.2201973
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., … & Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. EdArXiv. https://doi.org/10.35542/osf.io/5er8f
Kirmani, A. R. (2022). Artificial intelligence enabled science poetry. ACS Energy Letters, 8, 574-576. https://doi.org/10.1021/acsenergylett.2c02758
Kohnke, L., Moorhouse, B. L., & Zou, D. (2023). ChatGPT for language teaching and learning. RELC Journal, 00336882231162868. https://doi.org/10.1177/00336882231162868
Kung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., & Tseng, V. (2023). Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLoS Digital Health, 2(2). https://doi.org/10.1371/journal.pdig.0000198
Lametti, D. (2022). AI could be great for college essays. slate.com. https://slate.com/technology/2022/12/chatgpt-college-essay-plagiarism.html
Liberati, A., Clark, J., D’Amico, R., Grimshaw, J., Moja, L., Napoli, M., Pham, B., & Tovey, D. (2014). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Revista Espanola de Nutricion Humana y Dietetica [Spanish Journal of Human Nutrition and Dietetics], 18(3), 172-181.
Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410. https://doi.org/10.3390/educsci13040410
Lund, B. D. (2023). A brief review of ChatGPT: Its value and the underlying GPT technology. https://www.researchgate.net/publication/366809571_A_Brief_Review_of_ChatGPT_Its_Value_and_the_Underlying_GPT_Technology
Lund, B. D., & Wang, T. (2023). Chatting about ChatGPT: How may AI and GPT impact academia and libraries? Library Hi Tech News. https://doi.org/10.2139/ssrn.4333415
Lund, B. D., Wang, T., Mannuru, N. R., Nie, B., Shimray, S., & Wang, Z. (2023). ChatGPT and a new academic reality: Artificial Intelligence‐written research papers and the ethics of the large language models in scholarly publishing. Journal of the Association for Information Science and Technology, 74(5), 570-581. https://doi.org/10.1002/asi.24750
Manohar, N., & Prasad, S. S. (2023). Use of ChatGPT in academic publishing: A rare case of seronegative systemic lupus erythematosus in a patient with HIV infection. Cureus, 15(2). https://doi.org/10.7759/cureus.34616
McMurtrie, B. (2022). AI and the future of undergraduate writing. The Chronicles of Higher Education. https://www.chronicle.com/article/ai-and-the-future-of-undergraduate-writing?cid=gen_sign_in
O’Connor, S., & ChatGPT.(2023). Open artificial intelligence platforms in nursing education: Tools for academic progress or abuse. Nurse Education In Practice, 66. https://doi.org/10.1016/j.nepr.2022.103537
Rahimi, F., & Abadi, A. T. B. (2023). ChatGPT and publication ethics. Archives of Medical Research, 54(3), 272-274. https://doi.org/10.1016/j.arcmed.2023.03.004
Ramalingam, S., Yunus, M. M., & Hashim, H. (2022). Blended learning strategies for sustainable English as a second language education: A systematic review. Sustainability, 14(13), 8051. https://doi.org/10.3390/su14138051
Rasul, T., Nair, S., Kalendra, D., Robin, M., de Oliveira Santini, F., Ladeira, W. J., Sun, M., Day, I., Rather, R. A., & Heathcote, L. (2023). The role of ChatGPT in higher education: Benefits, challenges, and future research directions. Journal of Applied Learning and Teaching, 6(1). https://doi.org/10.37074/jalt.2023.6.1.29
Ray, P. P. (2023). ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet of Things and Cyber-Physical Systems, 3, 121-154. https://doi.org/10.1016/j.iotcps.2023.04.003
Roumeliotis, K. I., & Tselikas, N. D. (2023). ChatGPT and open-AI models: A preliminary review. Future Internet, 15(6), 192. https://doi.org/10.3390/fi15060192
Sallam, M. (2023). ChatGPT utility in healthcare education, research, and practice: Systematic review on the promising perspectives and valid concerns. Healthcare, 11(6), 887. https://doi.org/10.3390/healthcare11060887
Salvagno, M., Taccone, F. S., & Gerli, A. G. (2023). Can artificial intelligence help for scientific writing? Critical Care, 27(1), 1-5. https://doi.org/10.1186/s13054-023-04380-2
Stacey, S. (2022). Cheating on your college essay with ChatGPT. Business Insider. https://www.businessinsider.com/professors-say-chatgpt-wont-kill-college-essays-make-education-fairer-2022-12
Steenbergen-Hu, S., & Cooper, H. (2014). A meta-analysis of the effectiveness of intelligent tutoring systems on college students’ academic learning. Journal of Educational Psychology, 106(2), 331. https://doi.org/10.1037/a0034752
Stock, L. (2023). ChatGPT is changing education, AI experts say–but how? DW.com-science-global issues. https://www.dw.com/en/chatgpt-is-changing-education-ai-experts-say-but-how/a-64454752
Stokel-Walker C. (2022). AI bot ChatGPT writes smart essays–should professors worry? Nature. https://doi.org/10.1038/d41586-022-04397-7
Suaverdez, J. B., & Suaverdez, U. V. (2023). Chatbots impact on academic writing. Global Journal of Business and Integral Security.
Taecharungroj, V. (2023). What can ChatGPT do? Analyzing early reactions to the innovative AI chatbot on Twitter. Big Data and Cognitive Computing, 7(1), 35. https://doi.org/10.3390/bdcc7010035
Thorp, H. H. (2023). ChatGPT is fun, but not an author. Science, 379(6630), 313-313. https://doi.org/10.1126/science.adg7879
Transformer, C. G. P. T., & Zhavoronkov, A. (2022). Rapamycin in the context of Pascal’s Wager: Generative pre-trained transformer perspective. Oncoscience, 9, 82. https://doi.org/10.18632/oncoscience.571
Uegaki, W. (2022). The informativeness/complexity trade-off in the domain of Boolean connectives. Linguistic Inquiry, 1-23. https://doi.org/10.1162/ling_a_00461
Van Dis, E. A., Bollen, J., Zuidema, W., van Rooij, R., & Bockting, C. L. (2023). ChatGPT: Five priorities for research. Nature, 614(7947), 224-226. https://doi.org/10.1038/d41586-023-00288-7
Verhoeven, F., Wendling, D., & Prati, C. (2023). ChatGPT: When artificial intelligence replaces the rheumatologist in medical writing. Annals of the Rheumatic Diseases, 82(8), 1015-1017. https://doi.org/10.1136/ard-2023-223936
Wen, J., & Wang, W. (2023). The future of ChatGPT in academic research and publishing: A commentary for clinical and translational medicine. Clinical and Translational Medicine, 13(3). https://doi.org/10.1002/ctm2.1207
Williams, T. (2023). Turnitin announces AI detector with ‘97 per cent accuracy. timeshighereducation.com. https://www.timeshighereducation.com/news/turnitin-announces-ai-detector-97-cent-accuracy
Yan, D. (2023). Impact of ChatGPT on learners in a L2 writing practicum: An exploratory investigation. Education and Information Technologies. https://doi.org/10.1007/s10639-023-11742-4
Yeadon, W., Inyang, O. O., Mizouri, A., Peach, A., & Testrow, C. P. (2023). The death of the short-form physics essay in the coming AI revolution. Physics Education, 58(3). https://doi.org/10.1088/1361-6552/acc5cf
Zheng, H., & Zhan, H. (2023). ChatGPT in scientific writing: A cautionary tale. The American Journal of Medicine, 136(8), 725-726.e6. https://doi.org/10.1016/j.amjmed.2023.02.011
Zimmerman, A. (2023). A ghostwriter for the masses: ChatGPT and the future of writing. Annals of Surgical Oncology, 30, 3170-3173. https://doi.org/10.1245/s10434-023-13436-0

Citation

Imran, M., & Almusharraf, N. (2023). Analyzing the role of ChatGPT as a writing assistant at higher education level: A systematic review of the literature. Contemporary Educational Technology, 15(4), ep464. https://doi.org/10.30935/cedtech/13605

Imran, M., and Almusharraf, N. (2023). Analyzing the role of ChatGPT as a writing assistant at higher education level: A systematic review of the literature. Contemporary Educational Technology, 15(4), ep464. https://doi.org/10.30935/cedtech/13605

Imran M, Almusharraf N. Analyzing the role of ChatGPT as a writing assistant at higher education level: A systematic review of the literature. CONT ED TECHNOLOGY. 2023;15(4), ep464. https://doi.org/10.30935/cedtech/13605

Imran, Muhammad, and Norah Almusharraf. "Analyzing the role of ChatGPT as a writing assistant at higher education level: A systematic review of the literature". Contemporary Educational Technology 2023 15 no. 4 (2023): ep464. https://doi.org/10.30935/cedtech/13605

Imran, Muhammad et al. "Analyzing the role of ChatGPT as a writing assistant at higher education level: A systematic review of the literature". Contemporary Educational Technology, vol. 15, no. 4, 2023, ep464. https://doi.org/10.30935/cedtech/13605

Imran M, Almusharraf N. Analyzing the role of ChatGPT as a writing assistant at higher education level: A systematic review of the literature. CONT ED TECHNOLOGY. 2023;15(4):ep464. https://doi.org/10.30935/cedtech/13605