A BERT-Based Automatic Scoring Model of Korean Language Learners' Essay


Jung Hee Lee, Ji Su Park, Jin Gon Shon, Journal of Information Processing Systems Vol. 18, No. 2, pp. 282-291, Apr. 2022  

10.3745/JIPS.04.0239
Keywords: Automatic Writing Scoring, Bidirectional Encoder Representations from Transformers, Korean as a Foreign Language, Natural Language Processing
Fulltext:

Abstract

This research applies a pre-trained bidirectional encoder representations from transformers (BERT) handwriting recognition model to predict foreign Korean-language learners’ writing scores. A corpus of 586 answers to midterm and final exams written by foreign learners at the Intermediate 1 level was acquired and used for pre-training, resulting in consistent performance, even with small datasets. The test data were pre-processed and fine-tuned, and the results were calculated in the form of a score prediction. The difference between the prediction and actual score was then calculated. An accuracy of 95.8% was demonstrated, indicating that the prediction results were strong overall; hence, the tool is suitable for the automatic scoring of Korean written test answers, including grammatical errors, written by foreigners. These results are particularly meaningful in that the data included written language text produced by foreign learners, not native speakers.


Statistics
Show / Hide Statistics

Statistics (Cumulative Counts from November 1st, 2017)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.




Cite this article
[APA Style]
Jung Hee Lee, Ji Su Park, & Jin Gon Shon (2022). A BERT-Based Automatic Scoring Model of Korean Language Learners' Essay. Journal of Information Processing Systems, 18(2), 282-291. DOI: 10.3745/JIPS.04.0239.

[IEEE Style]
J. H. Lee, J. S. Park and J. G. Shon, "A BERT-Based Automatic Scoring Model of Korean Language Learners' Essay," Journal of Information Processing Systems, vol. 18, no. 2, pp. 282-291, 2022. DOI: 10.3745/JIPS.04.0239.

[ACM Style]
Jung Hee Lee, Ji Su Park, and Jin Gon Shon. 2022. A BERT-Based Automatic Scoring Model of Korean Language Learners' Essay. Journal of Information Processing Systems, 18, 2, (2022), 282-291. DOI: 10.3745/JIPS.04.0239.