Interdisciplinary Research in English Language Communication

Interdisciplinary Research in English Language Communication

A Systematic Review of Generative AI in CALL Published Research in Scholarly Journals

Document Type : Review Article

Authors
Department of English for Sciences, Center for Preparatory Studies, Sultan Qaboos University, Muscat, Sultanate of Oman
Abstract
This study aimed to systematically examine attitudes toward GenAI and its applications in CALL research published in top-tier CALL journals. Forty papers met the inclusion/exclusion criteria and were classified as attitudinal, empirical, and combined. Using a principled approach to coding and thematizing the data based on the research questions of the current study, major themes and trends were identified. Findings indicate an overall positive attitude to GenAI integration into CALL research, while negative voices were also detected concerning the biased nature of GenAI in relation to certain stereotypes and access inequalities. Regarding empirical research, it turned out that most were conducted in formal settings and were most effective in the writing skill, followed by speaking skills, revealing a serious gap in connection to the other language skills and subskills. The study also discusses research-related implications and then concludes with suggestions for further examination of GenAI in view of the observed limitations.
Keywords
Subjects

Aldosari, M. S. (2024). Another world with artificial intelligence in speaking classes: To delve into the influences on willingness to communicate, personal best goals, and academic enjoyment. Computer Assisted Language Learning Electronic Journal (CALL-EJ), 25(4), 439-463,
Alm, A., & Watanabe, Y. (2023). Integrating ChatGPT in language education: A Freirean perspective. Iranian Journal of Language Teaching Research, 11(3 (Special Issue)), 19-30. https://doi.org/10.30466/ijltr.2023.121404
An, X., Chai, C. S., Li, Y., Zhou, Y., & Yang, B. (2023). Modeling students’ perceptions of artificial intelligence assisted language learning. Computer Assisted Language Learning, 1–22. https://doi.org/10.1080/09588221.2023.2246519
Aryadoust, V., Zakaria, A., & Jia, Y. (2024). Investigating the affordances of OpenAI's large language model in developing listening assessments. Computers and Education: Artificial Intelligence, 6, 100204. https://doi.org/10.1016/j.caeai.2024.100204
Boulton, A. & Choubsaz, Y. (2025). Computer-assisted language learning. In N. Hilary & P. Milin (Ed.), International Encyclopedia of Language and Linguistics (3rd Ed.). Elsevier. https://doi.org/10.1016/B978-0-323-95504-1.00361-6
Chen, A., Jia, J., Li, Y., & Fu, L. (2025). Investigating the effect of role-pay activity with GenAI agent on EFL students’ speaking performance. Journal of Educational Computing Research, 63(1), 99-125. https://doi.org/10.1177/07356331241299058
Choubsaz, Y., Jalilifar, A., & Boulton, A. (2024). A longitudinal analysis of highly cited papers in four CALL journals. ReCALL, 36(1), 40–57. https://doi.org/10.1017/S0958344023000137
Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2023). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 61(2), 228–239. https://doi.org/10.1080/14703297.2023.2190148
Creely, E., Barnes, M., Tour, E., Henderson, M., Waterhouse, P., Pena, M.A. & Patel, S.V. (2025). Exploring attitudes to generative AI in education for English as an additional language (EAL) adult learners. ReCALL First View, 1–17. https://doi.org/10.1017/S0958344024000314
Crompton, H., Edmett, A., Ichaporia, N., & Burke, D. (2024). AI and English language teaching: Affordances and challenges. British Journal of Educational Technology, 55(6), 2503-2529. https://doi.org/10.1111/bjet.13460
Fathi, J., & Rahimi, M. (2024). Utilising artificial intelligence-enhanced writing mediation to develop academic writing skills in EFL learners: a qualitative study. Computer Assisted Language Learning, 1–40. https://doi.org/10.1080/09588221.2024.2374772
Fazal, N., Tahir, M. S., Chaudhary, M., & Abbasi, M. (2024). Effectiveness of AI integration into computer-assisted language learning (CALL) on student writing skills based on gender. Pakistan Journal of Humanities and Social Sciences, 12(1), 224–230. https://doi.org/10.52131/pjhss.2024.v12i1.1974
Gillespie, J. (2020). CALL research: Where are we now? ReCALL, 32(2), 127–144. https://doi.org/10.1017/S0958344020000051
Guan, L., Li, S., & Gu, M. M. (2024). AI in informal digital English learning: A meta-analysis of its effectiveness on proficiency, motivation, and self-regulation. Computers and Education: Artificial Intelligence, 7, 100323. https://doi.org/10.1016/j.caeai.2024.100323
Hınız, G. (2024). A year of generative AI in English language teaching and learning: A case study. Journal of Research on Technology in Education. Advance online publication. https://doi.org/10.1080/15391523.2024.2404132
Hubbard, P. & Colpaert, J. (2019). Toward transdisciplinarity in computer-assisted language learning. CALICO Journal, 36(2): 81–99. https://doi.org/10.1558/cj.37499
Hwang, W.-Y., Nurtantyana, R., Purba, S. W. D., Hariyanti, U., Indrihapsari, Y., & Surjono, H. D. (2023). AI and recognition technologies to facilitate English as foreign language writing for supporting personalization and contextualization in authentic contexts. Journal of Educational Computing Research, 61(5), 1008–1035. https://doi.rg/10.1177/07356331221137253
Karataş, F., Abedi, F. Y., Ozek Gunyel, F., Karadeniz, D., & Kuzgun, Y. (2024). Incorporating AI in foreign language education: An investigation into ChatGPT’s effect on foreign language learners. Education and Information Technologies, 29, 19343–19366. https://doi.org/10.1007/s10639-024-12574-6
Kim, H., Yang, H., Shin, D., & Lee, J. H. (2022). Design principles and architecture of a second language learning chatbot. Language Learning & Technology, 26(1), 1–18. http://hdl.handle.net/10125/73463
Klimova, B., Pikhart, M., Polakova, P., Cerna, M., Yayilgan, S. Y., & Shaikh, S. (2023). A systematic review on the use of emerging technologies in teaching English as an applied language at the university level. Systems, 11(1), 42. https://doi.org/10.3390/systems11010042
Klimova, B., Pikhart, M., & Al-Obaydi, L. H. (2024). Exploring the potential of ChatGPT for foreign language education at the university level. Frontiers in Psychology, 15, 1269319. https://doi.org/10.3389/fpsyg.2024.1269319
Kohnke, L. (2024). Exploring EAP students' perceptions of GenAI and traditional grammar-checking tools for language learning. Computers and Education: Artificial Intelligence, 7, 100279. https://doi.org/10.1016/j.caeai.2024.100279
Kostka, I., & Toncelli, R. (2023). Exploring applications of ChatGPT to English language teaching: Opportunities, challenges, and recommendations. TESL-Ej, 27(3), n3.
Kumar, K. & Thakur, G. S. M. (2012). Advanced applications of neural networks and arti/cial intelligence: A review. International Journal of Information Technology and Computer Science, 4(6), pp. 57-68.
Lai, W. Y. W., & Lee, J. S. (2024). A systematic review of conversational AI tools in ELT: Publication trends, tools, research methods, learning outcomes, and antecedents. Computers and Education: Artificial Intelligence, 100291. https://doi.org/10.1016/j.caeai.2024.100291
Law, L. (2024). Application of generative artificial intelligence (GenAI) in language teaching and learning: A scoping literature review. Computers and Education Open, 6. https://doi.org/10.1016/J.CAEO.2024.100174
Lei, L. & Liu, D. (2019) The research trends and contributions of System’s publications over the past four decades (1973–2017): A bibliometric analysis. System, 80, 1–13. https://doi.org/10.1016/j.system.2018.10.003
Liang, J.-C., Hwang, G.-J., Chen, M.-R. A., & Darmawansah, D. (2023). Roles and research foci of artificial intelligence in language education: An integrated bibliographic analysis and systematic review approach. Interactive Learning Environments, 31(7), 4270–4296. https://doi.org/10.1080/10494820.2021.1958348
Li, B., Lowell, V., Chaoran Wang, C., & Li, X. (2024).  A systematic review of the first year of publications on ChatGPT and language education: Examining research on ChatGPT’s use in language learning and teaching. Computers and Education: Artificial Intelligence, 7, 100266. https://doi.org/10.1016/j.caeai.2024.100266
Liu, C.-C., Liao, M.-G., Chang, C.-H., & Lin, H.-M. (2022). An analysis of children’ interaction with an AI chatbot and its impact on their interest in reading. Computers & Education, 189, Article 104576. https://doi.org/10.1016/j.Compedu.2022.104576 
Liu, G. L., Darvin, R., & Ma, C. (2024). Exploring AI-mediated informal digital learning of English (AI-IDLE): a mixed-method investigation of Chinese EFL learners’ AI adoption and experiences. Computer Assisted Language Learning, 1–29. https://doi.org/10.1080/09588221.2024.2310288
Lodge, J. M., Thompson, K., & Corrin, L. (2023). Mapping out a research agenda for generative artificial intelligence in tertiary education. Australasian Journal of Educational Technology, 39(1), 1-8.
Luo, J. (2024). A critical review of GenAI policies in higher education assessment: A call to reconsider the “originality” of students’ work. Assessment & Evaluation in Higher Education, 49(5), 651-664.
Mi, Y., Rong, M., & Chen, X. (2025). Exploring the affordances and challenges of GenAI feedback in L2 writing instruction: A comparative analysis with peer feedback. ECNU Review of Education, 20965311241310883. https://doi.org/10.1177/20965311241310883
Mohsen, M. A., Althebi, S., Alsagour, R., Alsalem, A., Almudawi, A., & Alshahrani, A. (2024). Forty-two years of computer-assisted language learning research: A scientometric study of hotspot research and trending issues. ReCALL, 36(2), 230–249. https://doi.org/10.1017/S0958344023000253
Nikolic, S., Wentworth, I., Sheridan, L., Moss, S., Duursma, E., Jones, R. A., ... & Middleton, R. (2024). A systematic literature review of attitudes, intentions and behaviours of teaching academics pertaining to AI and generative AI (GenAI) in higher education: An analysis of GenAI adoption using the UTAUT framework. Australasian Journal of Educational Technology, 40(6), 56-75.
Onwuegbuzie, A. J., Frels, R. K., & Hwang, E. (2016). Mapping Saldana’s coding methods onto the literature review process. Journal of Educational Issues, 2(1), 130–150. https://doi.org/10.5296/jei.v2i1.8931
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S. ... & Moher, D. (2021). The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. International Journal of Surgery, 88, Article 105906. https://doi.org/10.1136/bmj.n71
Prather, J., Leinonen, J., Kiesler, N., Gorson Benario, J., Lau, S., MacNeil, S., ... & Zingaro, D. (2025). Beyond the hype: A comprehensive review of current trends in generative AI research, teaching practices, and tools. 2024 Working Group Reports on Innovation and Technology in Computer Science Education, 300-338. https://doi.org/10.1145/3689187.3709614
Premkumar, P. P., Yatigammana, M. R. K. N., & Kannangara, S. (2024). Impact of generative AI on critical thinking skills in undergraduates: A systematic review. Journal of Desk Research Review and Analysis, 2(1).
Qu, K., & Wu, X. (2024). ChatGPT as a CALL tool in language education: A study of hedonic motivation adoption models in English learning environments. Education and Information Technologies, 1-33. https://doi.org/10.1007/s10639-024-12598-y
Robson, R., Pham, B., Hwee, J., Thomas, S., Rios, P., Page, M., & Tricco, A. (2019). Few studies exist examining methods for selecting studies, abstracting data, and appraising quality in a systematic review. Journal of Clinical Epidemiology, 106, 121–135. https://doi.org/10.1016/j.jclinepi.2018.10.003
Rudolph, J., Tan, S., & Tan, S. (20 23). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Teaching & Learning, 6(1), 342-362. https://doi.org/10.37074/jalt.2023.6.1.9
Shi, H., & Aryadoust, V. (2024). A systematic review of AI-based automated written feedback research. ReCALL 36(2), 187–209. https://doi.org/10.1017/S0958344023000265
Shi, H., Chai, C. S., Zhou, S., & Aubrey, S. (2025). Comparing the effects of ChatGPT and automated writing evaluation on students’ writing and ideal L2 writing self. Computer Assisted Language Learning, 1–28. https://doi.org/10.1080/09588221.2025.2454541
Shin, D., & Lee, J. H. (2023). Can ChatGPT make reading comprehension testing items on par with human experts? Language Learning & Technology, 27(3), 27–40. https://hdl.handle.net/10125/73530
Smith, J. A., & Patel, R. (2024). Navigating the challenges of AI in education: Fostering critical thinking in the age of ChatGPT. Academy of Management Learning & Education, 23(2), 189-205. https://doi.org/10.5465/amle.2024.0338
Tafazoli, D. (2024). Exploring the potential of generative AI in democratizing English language education. Computers and Education: Artificial Intelligence, 7, 100275. https://doi.org/10.1016/j.caeai.2024.100275
Tillmanns, T., Salomão Filho, A., Rudra, S., Weber, P., Dawitz, J., Wiersma, E., ... & Reynolds, S. (2025). Mapping tomorrow’s teaching and learning spaces: A systematic review on GenAI in higher education. Trends in Higher Education, 4(1), 2. https://doi.org/10.3390/higheredu4010002
Tolstykh, O. M., & Oshchepkova, T. (2024). Beyond ChatGPT: roles that artificial intelligence tools can play in an English language classroom. Discover Artificial Intelligence, 4(1), 60. https://doi.org/10.1007/s44163-024-00158-9
Vaccino-Salvadore, S. (2023). Exploring the ethical dimensions of using ChatGPT in language learning and beyond. Languages, 8(3), 191. https://doi.org/10.3390/languages8030191
Vartiainen, H., & Tedre, M. (2023). Using artificial intelligence in craft education: Crafting with text-to image generative models. Digital Creativity, 34(1), 1–21. https://doi.org/10.1080/14626268.2023.2174557
Wang, S., Wang, F., Zhu, Z., Wang, J., Tran, T., & Du, Z. (2024). Artificial intelligence in education: A systematic literature review. Expert Systems with Applications, 252, 124167. https://doi.org/10.1016/j.eswa.2024.124167
Zamanpour, A., & Etemadzadeh, H. (2024). The Effects of Artificial Intelligence Driven Corpus (AIDC) On ESP Learners' Learning and Retention of Lexical Bundles, Academic Emotions, And Engagement for Learning: A Case of Financial Engineering Students. Computer Assisted Language Learning Electronic Journal (CALL-EJ), 25(4), 51-68.
Zare, J., Al-Issa, A. & Ranjbaran Madiseh, F. (2025). Interacting with ChatGPT in essay writing: A study of L2 learners’ task motivation. ReCALL FirstView, 1–18. https://doi.org/10.1017/S0958344025000035
Zhai, C., & Wibowo, S. (2023). A systematic review on artificial intelligence dialogue systems for enhancing English as foreign language students’ interactional competence in the university. Computers and Education: Artificial Intelligence, 4, Article 100134. https://doi.org/10.1016/j.caeai.2023.100134
Zhu, M., & Wang, C. (2025). A systematic review of artificial intelligence in language education: Current status and future implications. Language Learning & Technology, 29(1), 1-29. https://hdl.handle.net/10125/73606
Ziqi, C., Xinhua, Z., Qi, L., & Wei, W. (2024). L2 students’ barriers in engaging with form and content-focused AI-generated feedback in revising their compositions. Computer Assisted Language Learning, 1–21. https://doi.org/10.1080/09588221.2024.2422478