Unboxing ‘Computer Assisted Language Assessment’: Recent Trends and Measurement Tools

Areeba Shabbir & Manish Kumar

 

Abstract

Since 2020, there has been a consistent rise in research aimed at finding better alternatives to traditional methods of language learning assessment. In order to introduce technology into the assessment process, several theories were reviewed and put into practice to make ‘Computer Assisted Language Assessment’ (CALA) both feasible and standardized. The idea behind CALA is to use computers to gauge learners’ language skills. However, the challenges associated with the effectiveness of CALA remain unresolved. This paper examines the trends in CALA for basic language learning skills - listening, speaking, reading, and writing (LSRW) and presents the measurement tools in the language learning and teaching pedagogy. Additionally, this paper incorporates quantitative methodology to analyze learners’ perceptions of the success of CALA into their classrooms. The findings suggest that issues relating to reliability, and authentication need to be addressed. Furthermore, there is an increasing demand for contextualized assessment tools in the language learning classrooms.

Keywords: Computer-Assisted Language Assessment (CALA), Computer-Assisted Language Learning (CALL), Second Language Learning (SLL), English as a Second Language (ESL), Recent Assessment Trends, Measurement Tools

 

Works Cited

  • Aschbacher, Pamela R. “Performance Assessment: State Activity, Interest, and Concerns.” Applied Measurement in Education, vol. 4, no. 4, Dec. 2009, pp. 275–88. Taylor & Francis Online, https://doi.org/10.1207/ s15324818ame0404_2. Accessed 25 Jan. 2023.
  • Barrett, Helen. Electronic Teaching Portfolios: Multimedia Skills + Portfolio Development = Powerful Professional Development. ERIC, 2000, pp. 1111–16, eric.ed.gov/?id=ED444514. Accessed 25 Jan. 2023.
  • Brookhart, Susan M. “Assessment Theory for College Classrooms.” New Directions for Teaching and Learning, vol. 2004, no. 100, Mar. 2005, pp. 5–14. Wiley Online Library, onlinelibrary.wiley.com/doi/10.1002/tl.165. Accessed 26 Jan. 2023.
  • Burkhardt, Hugh, and Daniel Pead. “Computer-Based Assessment: A Platform for Better Tests?” Whither Assessment?, edited by C. Richardson, 2002, pp. 133–48, www.mathshell.com/papers/pdf/hb_dp_2002_whither.pdf. Accessed 31 Jan. 2023.
  • Burns, Matthew K., et al. “The Effects of Technology-Enhanced Formative Evaluation on Student Performance on State Accountability Math Tests.” Psychology in the Schools, vol. 47, no. 6, May 2010, pp. 582–91. APA PsycInfo, https://doi.org/10.1002/pits.20492. Accessed 21 Jan. 2023
  • Carey, Greg. “Alternative Strategies for Evaluating Student Learning.” Teaching Theology and Religion, edited by Michelle V. Achacoso and Marilla D. Svinicki, vol. 9, no. 3, July 2006, pp. 198–99. Wiley Online Library, https://doi.org/10.1111/j.1467-9647.2006.00283_11.x. Accessed 22 Dec. 2023.
  • Chapelle, Carol A., and Dan Douglas. Assessing Language through Computer Technology. Cambridge UP, 2006. Cambridge Core, www.cambridge.org/core/books/assessing-language-through-computertechnology/ 435EC370842E3370BB248B5B1F4D42E6#fndtn-information. Accessed 16 Jan. 2023.
  • Cumming, Alister. Review of Building a Validity Argument for the Test of English as a Foreign LanguageTM, edited by C. A. Chapelle, et al. Language Testing, vol. 27, no. 2, Apr. 2010, pp. 286–88, https://doi.org/ 10.1177/02655322100270020902. Accessed 5 Jan. 2023.
  • Di Mauro, María Florencia, and Melina Furman.” Impact of an Inquiry Unit on Grade 4 Students’ Science Learning.” International Journal of Science Education, vol. 38, no. 14, Sept. 2016, pp. 2239–58. Taylor & Francis Online, https://doi.org/10.1080/09500693.2016.1234085. Accessed 12 Jan. 2023.
  • Galaczi, Evelina D. “FACE-TO-FACE and COMPUTER-BASED ASSESSMENT of SPEAKING: CHALLENGES and OPPORTUNITIES.” Computer-Based Assessment (CBA) of Foreign Language Speaking Skills, edited by Luísa Araújo, 2010, pp. 29–51. European Union, www.researchgate.net/publication/ 260118084_Computer-based_Assessment_CBA_of_Foreign_Lang uage_Speaking_Skills. Accessed 29 Jan. 2023.
  • Luoma, Sari. Assessing Speaking. 2004. Cambridge UP, 2010, pp. 113– 38, www.cambridge.org/core/books/assessing-speaking/B51 FA996816705DE4121FBB17B973846#fndtn-contents. Accessed 21 Dec. 2022.
  • McGuire, Lesley. “Assessment Using New Technology.” Innovations in Education and Teaching International, vol. 42, no. 3, Aug. 2005, pp. 265–76. Taylor & Francis Online, https://doi.org/10.1080/ 01587910500168025. Accessed 28 Nov. 2022.
  • Messer, David, and Gilly Nash.”An Evaluation of the Effectiveness of a Computer-Assisted Reading Intervention.” Journal of Research in Reading, vol. 41, no. 1, Feb. 2017, pp. 140–58. Wiley Online Library, https://doi.org/10.1111/1467-9817.12107. Accessed 20 Feb. 2023.
  • Wagner, Elvis. “The Effect of the Use of Video Texts on ESL Listening Test-Taker Performance.” Language Testing, vol. 27, no. 4, Mar. 2010, pp. 493–513. SAGE Journals, https://doi.org/10.1177/0265532209355668. Accessed 29 Mar. 2023.

How to cite

Shabbir, Areeba, and Manish Kumar. “Unboxing ‘Computer Assisted Language Assessment’: Recent Trends and Measurement Tools.” Akshara, vol. 15, May 2023, pp. 109-21, https://www.waoar.org/volume-15-may-2023/unboxing-computer-assisted-language-assessment-recent-trends-and-measurement-tools/.


ISSUE

Volume 15, May 2023


Section

Articles


  Download Full Article