An investigation of the efficacy of a ChatGPT-powered chatbot

Abstract

[EN] One of the newest tools for language learning is AI-powered chatbots which allow students to engage in interactive conversations with a chatbot. English Central is a digital language learning platform that allows students to watch videos, study vocabulary, and produce spoken language through short interactive videos. In addition to these three core components, English Central has recently added a chatbot powered by ChatGPT. This paper shares the results of a pilot study that analysed data from Japanese university students who engaged in interactions with this chatbot. The authors introduce quantitative data showing the quantity and quality of the interactions and discuss the strategies they implemented to encourage longer interactions. A student feedback survey was conducted and the results of this are also shared. The results suggested that although many students reported benefits to using a chatbot, the strategies implemented did not lead to significantly longer interactions, and that many students felt frustrated when the chatbot did not understand their utterances.