Research Article
Reginald Gerald Govender
CONT ED TECHNOLOGY, Volume 16, Issue 2, Article No: ep509
ABSTRACT
A new era of artificial intelligence (AI) has begun, which can radically alter how humans interact with and profit from technology. The confluence of chat interfaces with large language models lets humans write a natural language inquiry and receive a natural language response from a machine. This experimental design study tests the capabilities of three popular AI chatbot services referred to as my AI students: Microsoft Bing, Google Bard, and OpenAI ChatGPT on completeness and accuracy. A Likert scale was used to rate completeness and accuracy, respectively, a three-point and five-point. Descriptive statistics and non-parametric tests were used to compare marks and scale ratings. The results show that AI chatbots were awarded a score of 80.0% overall. However, they struggled with answering questions from the higher Bloom’s taxonomic levels. The median completeness was 3.00 with a mean of 2.75 and the median accuracy was 5.00 with a mean of 4.48 across all Bloom’s taxonomy questions (n=128). Overall, the completeness of the solution was rated mostly incomplete due to limited response (76.2%), while accuracy was rated mostly correct (83.3%). In some cases, generative text was found to be verbose and disembodied, lacking perspective and coherency. Microsoft Bing ranked first among the three AI text generative tools in providing correct answers (92.0%). The Kruskal-Wallis test revealed a significant difference in completeness (asymp. sig.=0.037, p<0.05) and accuracy (asymp. sig.=0.006, p<0.05) among the three AI chatbots. A series of Mann and Whitney tests were carried out showing no significance between AI chatbots for completeness (all p-values>0.015 and 0<r<0.2), while a significant difference was found for accuracy between Google Bard and Microsoft Bing (asymp. sig.=0.002, p<0.05, r=0.3 medium effect). The findings suggest that while AI chatbots can generate comprehensive and correct responses, they may have limits when dealing with more complicated cognitive tasks.
Keywords: artificial intelligence, chatbots, generative text, completeness, accuracy
Research Article
Stavros Papakonstantinidis, Piotr Kwiatek, Filomachi Spathopoulou
CONT ED TECHNOLOGY, Volume 16, Issue 2, Article No: ep495
ABSTRACT
This research investigates the perspectives of using artificial intelligence writing software (AIWS) in professional contexts, focusing on academic and non-academic writers. These two groups, while standing to gain increased productivity through the adoption of AIWS, also express concerns regarding the widespread implementation of this technology. Notably, artificial intelligence (AI) writing tech’s impact on content creation has been profound, with its swift grammatically accurate content generation. This adoption, however, remains controversial. The study employs a quantitative approach, combining technology acceptance model and new computer game attitude scale. This approach allows us to discern implications of using AI-powered writing tools while accounting for possible differences in different domains of use. Through a survey of 219 participants, spanning academia and business, the study explores attitudes and willingness to use AIWS. Findings yield insights into non-academic writers’ readiness and implications of AIWS adoption. Business, non-academic professionals view AIWS as a tool for efficiency and content quality, while writers in academic contexts express concerns about biases, manipulation, and job displacement. The study contributes to AIWS understanding, benefiting developers, educational institutions, and content creators, and elucidates differing attitudes and age dynamics between academics and professionals. The research underscores the multifaceted influence of AIWS, providing a foundation for future exploration in this emerging domain, as well as practical applications for industries and educational institutions.
Keywords: artificial intelligence, chatbots, ChatGPT, education, educational technologies
Research Article
Mohammed Muneerali Thottoli, Badria Hamed Alruqaishi, Arockiasamy Soosaimanickam
CONT ED TECHNOLOGY, Volume 16, Issue 1, Article No: ep485
ABSTRACT
Purpose: Chatbots and artificial intelligence (AI) have the potential to alleviate some of the challenges faced by humans. Faculties frequently swamped with teaching and research may find it difficult to act in a parental role for students by offering them individualized advice. Hence, the primary purpose of this study is to review the literature on chatbots and AI in light of their role in auto-advising systems. The authors aimed to gain insights into the most pertinent topics and concerns related to robo academic advisor and identify any gaps in the literature that could serve as potential avenues for further research.
Design/methodology/approach: The research employs a systematic literature review and bibliometric techniques to find 67 primary papers that have been published between 1984 and 2023. Using the Scopus database, the researchers built a summary of the literature on chatbots and AI in academic advice.
Findings: Chatbot applications can be a promising approach to address the challenges of balancing personalized student advising with automation. More empirical research is required, especially on chatbots and other AI-based advising systems, to understand their effectiveness and how they can be integrated into educational settings.
Research limitations/implications: This research’s sample size may restrict its findings’ generalizability. Furthermore, the study’s focus on chatbots may overlook the potential benefits of other AI technologies in enhancing robo academic advising systems. Future research could explore the impact of robo academic advisors in diverse societal backgrounds to gain a more comprehensive understanding of their implications.
Practical implications: Higher educational institutions (HEIs) should establish a robo academic advising system that serves various stakeholders. The system’s chatbots and AI features must be user-friendly, considering the customers’ familiarity with robots.
Originality/value: This study contributes to a better understanding of HEIs’ perceptions of the adoption of chatbots and AI in academic advising by providing insightful information about the main forces behind robo academic advising, illuminating the most frequently studied uses of chatbots and AI in academic advising.
Keywords: Artificial intelligence, chatbots, robo, academic advisor, human interaction
Review Article
Muhammad Imran, Norah Almusharraf
CONT ED TECHNOLOGY, Volume 15, Issue 4, Article No: ep464
ABSTRACT
This study examines the role of ChatGPT as a writing assistant in academia through a systematic literature review of the 30 most relevant articles. Since its release in November 2022, ChatGPT has become the most debated topic among scholars and is also being used by many users from different fields. Many articles, reviews, blogs, and opinion essays have been published in which the potential role of ChatGPT as a writing assistant is discussed. For this systematic review, 550 articles published six months after ChatGPT’s release (December 2022 to May 2023) were collected based on specific keywords, and the final 30 most relevant articles were finalized through PRISMA flowchart. The analyzed literature identifies different opinions and scenarios associated with using ChatGPT as a writing assistant and how to interact with it. Findings show that artificial intelligence (AI) in education is a part of the ongoing development process, and its latest chatbot, ChatGPT is a part of it. Therefore, the education process, particularly academic writing, has both opportunities and challenges in adopting ChatGPT as a writing assistant. The need is to understand its role as an aid and facilitator for both the learners and instructors, as chatbots are relatively beneficial devices to facilitate, create ease and support the academic process. However, academia should revisit and update students’ and teachers’ training, policies, and assessment ways in writing courses for academic integrity and originality, like plagiarism issues, AI-generated assignments, online/home-based exams, and auto-correction challenges.
Keywords: AI in education, chatbots, ChatGPT as writing assistant, scientific writing, academic integrity
Review Article
Tufan Adiguzel, Mehmet Haldun Kaya, Fatih Kürşat Cansu
CONT ED TECHNOLOGY, Volume 15, Issue 3, Article No: ep429
ABSTRACT
Artificial intelligence (AI) introduces new tools to the educational environment with the potential to transform conventional teaching and learning processes. This study offers a comprehensive overview of AI technologies, their potential applications in education, and the difficulties involved. Chatbots and related algorithms that can simulate human interactions and generate human-like text based on input from natural language are discussed. In addition to the advantages of cutting-edge chatbots like ChatGPT, their use in education raises important ethical and practical challenges. The authors aim to provide insightful information on how AI may be successfully incorporated into the educational setting to benefit teachers and students, while promoting responsible and ethical use.
Keywords: artificial intelligence, education, chatbots, ChatGPT, personalized learning