Students’ Gains in English as a Second or Foreign Language through Game-Based Learning: A Meta-Analysis

Abstract views: 68 , PDF downloads: 38
Keywords: game-based learning, language domains, English language learning, meta-analysis, students’ achievement

Abstract

Various digitally aided applications have prompted ESL/EFL teachers to adopt them in their classrooms for games and experiments; hence, the concept of play in pedagogical settings has grown and become more modern, modifying the structures of Game-based Learning (GBL). This study, therefore, aims to analyze the effectiveness of GBL through meta-analysis. Following the set of inclusion and exclusion criteria, 16 studies in East Asia, Middle East Asia, and South America conducted from 2018 to 2023 have qualified for this study with 14 studies on tertiary level (n=822); 1 on secondary (n=56); and 1 on primary (n=46). Studies were obtained from Google Scholar, OpenAlex, Scopus, and Crossref. Further, the researchers used Harzing’s Publish or Perish software to exhaust the search process. Sample size, mean, and standard deviation were analyzed using the Jamovi software version 2.4 to determine the effect sizes (Hedge's g) and the results of moderator analysis, forest plot, funnel plot, and Classic Fail-Safe N test. Findings have shown that GBL, as an approach to teaching English, had a significant and positive effect (ES=1.19) on students' achievement in different language domains. Educational levels and the type of game-based learning employed as moderators were also proven to be factors that may affect learning outcomes. Hence, more studies testing the subgroups mentioned above should be conducted to facilitate more comprehensive comparative educational research in the future.

Downloads

Download data is not yet available.

Author Biographies

Jason S. Barrun, Language Education Department, Sorsogon State University, Magsaysay St., Sorsogon City, 4700

JASON S. BARRUN is the Senior Education Program Specialist for Planning and Research of the Schools Division Office of Masbate City. He is a student in the Doctor of Philosophy in Language Education (PhD L.E.) program at Sorsogon State University, Sorsogon City, Philippines—his interests in research range from English teaching pedagogies to bilingualism/multilingualism and language.

Sherill A. Gilbas, Language Education Department, Sorsogon State University, Magsaysay St., Sorsogon City, 4700

SHERIL A. GILBAS is the Head of the Admission Services Unit and the Program Chair of the Doctor of Philosophy Language Education Department at the Graduate School of Sorsogon State University, Sorsogon City, Philippines. She is the ninth-best researcher in the institution based on the Alper-Doger (AD) Scientific Index 2024. Her research interests include Humanities, Literature, and Language and Cultural Studies.

References

Ahmed, A. A. A., Ampry, E. S., Komariah, A., Hassan, I., Thahir, I., Ali, M. H., . . . Zafarani, P. (2022). Investigating The Effect of Using Game-Based Learning on EFL Learners’ Motivation And Anxiety. Education Research International, 2022, 1–9. https://doi.org/10.1155/2022/6503139

Ahmed, A. A. A., Sayed, B. T., Wekke, I. S., Widodo, M., Rostikawati, D., Ali, M. H., . . . Azizian, M. (2022). An Empirical Study on the Effects of Using Kahoot as a Game-Based Learning Tool on EFL Learners’ Vocabulary Recall And Retention. Education Research International, 2022, 1–10. https://doi.org/10.1155/2022/9739147

Alhebshi, A. A., & Gamlo, N. (2022). The Effects of Mobile Game-Based Learning on Saudi EFL Foundation Year Students’ Vocabulary Acquisition. Arab World English Journal, 13(1), 408–425. https://doi.org/10.24093/awej/vol13no1.27

Altiok, S., Yukselturk, E., & Baser, Z. (2018). Using Game-Based Learning with Kinect Technology in Foreign Language Education Course. Educational Technology & Society, 21(3), 159–173. https://doi.org/10.5072/zenodo.41162

Annetta, L. A., Minogue, J., Holmes, S. Y., & Cheng, M. (2009). Investigating the Impact of Video Games on High School Students’ Engagement and Learning About Genetics. Computers & Education, 53(1), 74–85. https://doi.org/10.1016/j.compedu.2008.12.020

Blair, E., & Blair, J. (2015). Applied Survey Sampling. London: Sage.

Borenstein, M., Hedges, L. V., Higgins, J. P., & Rothstein, H. R. (2010). A Basic Introduction to Fixed-effect and Random-effects Models for Meta-Analysis. Research Synthesis Methods, 1(2), 97–111. https://doi.org/10.1002/jrsm.12

Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2011b). Introduction to Meta-Analysis. John Wiley & Sons.

Boyle, E. A., Hainey, T., Connolly, T. M., Gray, G., Earp, J., Ott, M., . . . Pereira, J. (2015). An Update to the Systematic Literature Review of Empirical Evidence of the Impacts and Outcomes of Computer Games and Serious Games. Computers & Education, 94, 178–192. https://doi.org/10.1016/j.compedu.2015.11.003

Bryant, T. (2006). Using World of Warcraft and Other MMORPGs to Foster a Targeted, Social, and Cooperative Approach Toward Language Learning. Computers & Education. Retrieved from https://scholar.dickinson.edu/cgi/viewcontent.cgi?article=1781&context=faculty_publications

Cabrera-Solano, P. (2022). Game-Based Learning in Higher Education: The Pedagogical Effect of Genially Games in English as a Foreign Language Instruction. International Journal of Educational Methodology, 8(4), 719–729. https://doi.org/10.12973/ijem.8.4.719

Chen, C., & Yeh, H. (2019). Effects of Integrating a Questioning Strategy with Game-Based Learning on Students’ Language Learning Performances in Flipped Classrooms. Technology Pedagogy and Education, 28(3), 347–361. https://doi.org/10.1080/1475939x.2019.1618901

Chen, C., & Chung, C. (2007). Personalized Mobile English Vocabulary Learning System Based on Item Response Theory and Learning Memory Cycle. Computers & Education, 51(2), 624–645. https://doi.org/10.1016/j.compedu.2007.06.011

Chen, S., Hung, C., Chang, Y., Lin, Y., & Lai, Y. (2018). A Study on Integrating Augmented Reality Technology and Game-Based Learning Model to Improve Motivation and Effectiveness of Learning English Vocabulary. Technology Pedagogy and Education, 24–27. https://doi.org/10.1109/ic3.2018.00015

Chou, M. (2012). Assessing English Vocabulary and Enhancing Young English as a Foreign Language (EFL) Learners’ Motivation Through Games, Songs, and Stories. Education 3-13, 42(3), 284–297. https://doi.org/10.1080/03004279.2012.680899

Connolly, T. M., Boyle, E. A., MacArthur, E., Hainey, T., & Boyle, J. M. (2012). A Systematic Literature Review of Empirical Evidence on Computer Games and Serious Games. Computers & Education, 59(2), 661–686. https://doi.org/10.1016/j.compedu.2012.03.004

Schmidt, S. R., & Bohannon, J. N. (1988). In Defense of the Flashbulb-Memory Hypothesis: A Comment on McCloskey, Wible, and Cohen (1988). Journal of Experimental Psychology General, 117(3), 332–335. https://doi.org/10.1037/0096-3445.117.3.332

Cooper, H., Hedges, L. V., & Valentine, J. C. (2019). The Handbook of Research Synthesis and Meta-Analysis. https://doi.org/10.7758/9781610448864

Erhel, S., & Jamet, E. (2013). Digital Game-Based Learning: Impact of Instructions and Feedback on Motivation and Learning Effectiveness. Computers & Education, 67, 156–167. https://doi.org/10.1016/j.compedu.2013.02.019

Freiermuth, M. R. (2002). Connecting with Computer Science Students by Building Bridges. Simulation & Gaming, 33(3), 299–315. https://doi.org/10.1177/104687810203300305

Funa, A. A., & Prudente, M. S. (2021). Effectiveness of Problem-Based Learning on Secondary Students’ Achievement in Science: A Meta-Analysis. International Journal of Instruction, 14(4), 69–84. https://doi.org/10.29333/iji.2021.1445a

Gaydos, M. (2015). Seriously Considering Design in Educational Games. Educational Researcher, 44(9), 478–483. https://doi.org/10.3102/0013189x15621307

Girard, C., Ecalle, J., & Magnan, A. (2012). Serious Games as New Educational Tools: How Effective Are They? A Meta-Analysis of Recent Studies. Journal of Computer Assisted Learning, 29(3), 207–219. https://doi.org/10.1111/j.1365-2729.2012.00489.x

Glen, S. (2016). Hedges’ g: Definition, Formula. Statistics_How_To.com: Elementary Statistics for the rest of us. http://www.statisticshowto.com/hedges-g/

Harbord, R. M., Harris, R. J., & Sterne, J. A. C. (2009). Updated Tests for Small-Study Effects in Meta-Analyses. The Stata Journal: Promoting Communications on Statistics and Stata, 9(2), 197–210. https://doi.org/10.1177/1536867x0900900202

Hartt, M., Hosseini, H., & Mostafapour, M. (2020). Game On: Exploring the Effectiveness of Game-Based Learning. Planning Practice and Research, 35(5), 589–604. https://doi.org/10.1080/02697459.2020.1778859

Harzing, A. W. (2007). Publish or Perish Software. Available from https://harzing.com/resources/publish-or-perish

Freeman, P. R., Hedges, L. V., & Olkin, I. (1986). Statistical Methods for Meta-Analysis. Biometrics, 42(2), 454. https://doi.org/10.2307/2531069

Hsu, T. (2019). Effects of Gender and Different Augmented Reality Learning Systems on English Vocabulary Learning of Elementary School Students. Universal Access in the Information Society, 18(2), 315–325. https://doi.org/10.1007/s10209-017-0593-1

Hwang, G., Wu, P., & Chen, C. (2012). An Online Game Approach for Improving Students’ Learning Performance in Web-Based Problem-Solving Activities. Computers & Education, 59(4), 1246–1256. https://doi.org/10.1016/j.compedu.2012.05.009

Hung, H. (2018). Gamifying the Flipped Classroom Using Game-Based Learning Materials. ELT Journal, 72(3), 296–308. https://doi.org/10.1093/elt/ccx055

Janhavi, K., & Anwaya, N. (2017). Comparison of Different Methods of Detecting Publication Bias. PhUSE 2017. https://www.lexjansen.com/phuse/2017/as/AS04.pdf

Kao, C. (2020). The Effect of a Digital Game-Based Learning Task on the Acquisition of the English Article System. System, 95, 102373. https://doi.org/10.1016/j.system.2020.102373

Kennedy, K. J., & Lee, J. C.-K. (Eds.). (2018). Routledge International Handbook of Schools and Schooling in Asia (1st edition). Abingdon, Oxon; New York, NY: Routledge.

Knowles, M. S., Holton, E. F., & Swanson, R. A. (1998). The Adult Learner: The Definitive Classic in Adult Education and Human Resource Development. New York: Butterworth-Heinemann

Krashen, S. D. (1992). The Input Hypothesis: Issues and Implications. New Jersey: Laredo Publishing. Retrieved from https://ci.nii.ac.jp/ncid/BA35128831

Lindeman, E. C. (2013). The Meaning of Adult Education. Windham Press. Retrieved from http://ci.nii.ac.jp/ncid/BA12227685

Page, M. J., Moher, D., & McKenzie, J. E. (2021). Introduction to PRISMA 2020 and Implications for Research Synthesis Methodologists. Research Synthesis Methods, 13(2), 156–163. https://doi.org/10.1002/jrsm.1535

Peterson, M. (2006). Learner Interaction Management in an Avatar and Chat-Based Virtual World. Computer Assisted Language Learning, 19(1), 79–103. https://doi.org/10.1080/09588220600804087

Peterson, M. (2010). Massively Multiplayer Online Role-Playing Games as Arenas for Second Language Learning. Computer Assisted Language Learning, 23(5), 429–439. https://doi.org/10.1080/09588221.2010.520673

Peterson, M. (2012). Learner Interaction in a Massively Multiplayer Online Role-Playing Game (MMORPG): A Sociocultural Discourse Analysis. ReCALL, 24(3), 361–380. https://doi.org/10.1017/s0958344012000195

Plass, J. L., Homer, B. D., & Kinzer, C. K. (2015). Foundations of GBL. Educational Psychologist, 50(4), 258–283.

Plonsky, L., & Oswald, F. L. (2014). How Big is “Big”? Interpreting Effect Sizes in L2 Research. Language Learning, 64(4), 878–912. https://doi.org/10.1111/lang.12079

Poitras, M., Péléja, L., Lavertu, G., Langlois, A., Boulerice, K., Berthelot, P., & Vincent-Lamarre, P. (2020). A Replication of Waugh and Norman (1965) Primary Memory Study. The Quantitative Methods for Psychology, 16(2), r1–r7. https://doi.org/10.20982/tqmp.16.2.r001

Reinhardt, J. S., & Thorne, S. (2016). Metaphors for digital games and language learning. In F. Farr & L. Murray (Eds.), Routledge Handbook of Language Learning and Technology, 415–430. https://doi.org/10.4324/9781315657899.ch30

Rosenthal, R. (1979). The "File Drawer Problem" and Tolerance for Null Results, Psychological Bulletin, Vol. 86, No. 3, 838-641.

Routledge International Handbook of Schools and Schooling in Asia. (2018b). Routledge eBooks. https://doi.org/10.4324/9781315694382

Serrano, K. (2019). The Effect of Digital Game-Based Learning on Student Learning: Literature Review. Graduate Research Papers, 943. https://scholarworks.uni.edu/grp/943

Svensson, P. (2009). Virtual Worlds as Arenas for Language Learning. In U. Felix (Ed.), Language Learning Online: Towards Best Practice, 123–142. Retrieved from http://www.diva-portal.org/smash/record.jsf?pid=diva2:446390

The Jamovi Project. (2023). Jamovi (Version 2.4) [Computer software]. Retrieved from https://www.jamovi.org

Vásquez, S., Peñafiel, M., Cevallos, A., Zaldumbide, J., & Vásquez, D. (2017). Impact of Game-Based Learning on Students In Higher Education. EDULEARN Proceedings, 1, 4356–4363. https://doi.org/10.21125/edulearn.2017.1942

Wang, A. I., Øfsdahl, T., & Mørch-Storstein, O. K. (2007). Lecture Quiz: A Mobile Game Concept for Lectures. International Conference on Software Engineering, 305–310.

Wang, Z., Li, H., & Liu, F. (2014b). The Design of Mobile Learning English Word Memory Management Software Function Module. in The Design of Mobile Learning English Word Memory Management Software Function Module, 49–53. https://doi.org/10.1109/eitt.2014.16

Wiburg, K., Chamberlin, B., Trujillo, K. M., Parra, J. L., & Stanford, T. (2018). Transforming Mathematics Teaching Through Games and Inquiry. In K-12 STEM Education: Breakthroughs in Research and Practice (pp. 279–304). IGI Global Scientific Publishing. https://doi.org/10.4018/978-1-5225-3832-5.ch014

Woo, J. (2014). Digital Game-Based Learning Supports Student Motivation, Cognitive Success, and Performance Outcomes. Educational Technology & Society, 17(3), 291–307. Retrieved from http://ifets.info/journals/17_3/22.pdf

Wu, T. (2018). Improving The Effectiveness of English Vocabulary Review by Integrating ARCS with Mobile Game-Based Learning. Journal of Computer Assisted Learning, 34(3), 315–323. https://doi.org/10.1111/jcal.12244

Published
2025-01-22
How to Cite
Barrun, J. S., & Gilbas, S. A. (2025). Students’ Gains in English as a Second or Foreign Language through Game-Based Learning: A Meta-Analysis. OKARA: Jurnal Bahasa Dan Sastra, 18(2), 244-265. https://doi.org/10.19105/ojbs.v18i2.15127