logo logo International Journal of Educational Methodology

IJEM is a leading, peer-reviewed, open access, research journal that provides an online forum for studies in education, by and for scholars and practitioners, worldwide.

Subscribe to

Receive Email Alerts

for special events, calls for papers, and professional development opportunities.

Subscribe

Publisher (HQ)

RHAPSODE
Eurasian Society of Educational Research
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, HA4 7AE, UK
RHAPSODE
Headquarters
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, HA4 7AE, UK
Research Article

Preliminary Indicators of EFL Essay Writing for Teachers’ Feedback Using Automatic Text Analysis

Rong Phoophuangpairoj , Piyarat Pipattarasakul

During the pandemic of Coronavirus disease 2019 (COVID-19), English as a foreign language (EFL) students have to study and submit their assignments an.

D

During the pandemic of Coronavirus disease 2019 (COVID-19), English as a foreign language (EFL) students have to study and submit their assignments and quizzes through online systems using electronic files instead of hardcopies. This has created an opportunity for teachers to use computer tools to conduct preliminary assessment of the students’ writing performance and then give advice to them timely. Hence, this paper proposed some indicators which were essay readability scored by Flesch Reading Ease (FRE), length of essays, errors in writing and a method to assist the teachers in providing writing feedback to the students. The results showed a large difference in FRE, the number of words, sentences, paragraphs and errors. The K-means clustering findings were applied to classify groups of students based on writing proficiency indicators. The findings also revealed that the number of words and sentences in the essays indicated some deficiencies. The concept of paragraph should be reinforced while some specific errors such as misspelling, grammatical and typographical errors found need to be eliminated. This study showcased that the computer tools should be integrated to process the students’ essays so that the teachers can pinpoint the problems and make suggestions to their students in appropriate time. Lastly, the results can be served as the guidelines for the teachers to develop and adjust teaching materials pertinent to writing to enhance the writing performance of EFL learners.

Keywords: Clustering, EFL, essay writing feedback, readability, writing errors.

cloud_download PDF
Cite
Article Metrics
Views
356
Download
974
Citations
Crossref
4

Scopus
3

References

Alavi, S. (2021). The implementation of writing through technology-mediated English course to enhance Thai university students writing skills. Rangsit Journal of Educational Studies, 8(2), 50-65. https://doi.org/10.14456/rjes.2021.11

Alvira, R. (2016). The impact of oral and written feedback on EFL writers with the use of screencasts. PROFILE Issues in Teachers’ Professional Development, 18(2), 79-92. https://doi.org/10.1080/14703297.2018.1431143

Anh, D. T. N. (2019). EFL student’s writing skills: Challenges and remedies. IOSR Journal of Research & Method in Education, 9(6), 74-84. https://doi.org/10.9790/7388-0906017484

Bastola, M. N., & Hu, G. (2021). Supervisory feedback across disciplines: does it meet students' expectations? Assessment & Evaluation in Higher Education, 46(3), 407-423. https://doi.org/10.1080/02602938.2020.1780562

Cahyono, B. Y., Mukminatien, N., & Amrina, R. (2016). Indonesian students’ writing proficiency and their ability in using complex sentences. International Journal on Studies in English Language and Literature, 4(9), 22-32. https://doi.org/10.20431/2347-3134.0409004

Choi, J. S., & Crossley, S. A. (2020). ARTE: Automatic Readability Tool for English - NLP tools for the social sciences. https://www.linguisticanalysistools.org/arte.html

Crossley, S. (2020). Linguistic features in writing quality and development: An overview. Journal of Writing Research11(3), 415-443. https://doi.org/10.17239/jowr-2020.11.03.01

Crossley, S. A., Kyle, K., & McNamara, D. S. (2015). The tool for the automatic analysis of text cohesion (TAACO): Automatic assessment of local, global, and text cohesion. Behavior Research Methods 48(4), 227-1237. https://doi.org/10.3758/s13428-015-0651-7

Flinton, D. M., Singh, M. K., & Haria, K. (2018). Readability of internet based patient information for radiotherapy patients. Journal of Radiotherapy in Practice, 17(2), 142-150. https://doi.org/10.1017/S1460396917000620

Hartshorn, K. (2008). The effects of manageable corrective feedback on ESL writing accuracy [Doctoral dissertation]. Brigham Young University, Provo, USA.

Ho, W. Y. J., & Tai, K. W. H. (2021). Translanguaging in digital learning: the making of translanguaging spaces in online English teaching videos. International Journal of Bilingual Education and Bilingualism, 1-22. https://doi.org/10.1080/13670050.2021.2001427

Huisman, B., Saab, N., Broek, P. V. D., & Driel, J. V. (2019). The impact of formative peer feedback on higher education students’ academic writing: A meta-analysis. Assessment & Evaluation in Higher Education44(6), 863-880. https://doi.org/10.1080/02602938.2018.1545896

Kamberi, L. (2013). The significance of teacher feedback in EFL writing for tertiary level foreign language learners. Procedia - Social and Behavioral Sciences, 70, 1686-1690. https://doi.org/10.1016/j.sbspro.2013.01.241

Kampookaew, P. (2020). An analysis of grammatical errors made by Thai EFL university students in an EAP writing class: Issues and recommendations. rEFLections, 27(2), 246-273. https://bit.ly/347ZNG7

Khumphee, S., & Yodkamlue, B. (2017). Grammatical errors in English essays written by Thai EFL undergraduate students. Journal of Education Mahasarakham University, 11(4), 139-154. http://edu.msu.ac.th/journal/home/journal_file/388.pdf

Kim, V. (2018). Technology-enhanced feedback on student writing in the English-medium instruction classroom. English Teaching, 73(4), 29-53. https://doi.org/10.15858/engtea.73.4.201812.29

Kongkaew, S., & Cedar, P. (2018). An analysis of errors in online English writing made by Thai EFL authors. International Journal of Applied Linguistics & English Literature, 7(6), 86-96. https://doi.org/10.7575/aiac.ijalel.v.7n.6p.86

Kuptanaroaj, N. (2019). An analysis of grammatical errors in English essays written by the undergraduate students at Rangsit University, Proceedings of RSU International Research Conference (pp. 1267-1275). Rangsit University, Pathum Thani, Thailand. https://doi.org/10.14458/RSU.res.2019.24

Lim, C. T., Bong, C. H., Wong, W. S., & Lee, N. K. (2021). A comprehensive review of automated essay scoring (AES) research and development. Pertanika Journal of Science & Technology, 29(3), 1875-1899.

Lv, X., Ren, R., & Xie, Y. (2021). The effects of online feedback on ESL/EFL writing: A meta-analysis. The Asia-Pacific Education Researcher30, 643-653. https://doi.org/10.1007/s40299-021-00594-6

Macedo, M. G. M., Figueiredo, E. M. N., Soares, F. M. B., Siqueira, H., Maciel, A. M. A., Gokhale, A., & Bastos-Filho, C. J. A. (2018). Clustering students based on grammatical errors for on-line education. Journal of the Brazilian Society on Computational Intelligence, 16(1), 26-40. https://doi.org/10.21528/LNLM-vol16-no1-art2

Noroozi, O., & Hatami, J. (2019). The effects of online peer feedback and epistemic beliefs on students’ argumentation-based learning. Innovations in Education and Teaching International56(5), 548-557. https://doi.org/10.1080/14703297.2018.1431143

Pham, T. N., Lin, M., Trinh, V. Q., & Bui, L. T. P. (2020). Electronic peer feedback, EFL academic writing and reflective thinking: Evidence from a Confucian context. Sage Open, 10(1) https://doi.org/10.1177/2158244020914554

Pranay, J., & MacDermid, J. C. (2017). Assessing reading levels of health information: uses and limitations of flesch formula. Education for Health, 30(1), 84-88. https://doi.org/10.4103/1357-6283.210517

Rapanta, C., Botturi, L., Goodyear, P., Guàrdia, L., & Koole, M. (2020). Online university teaching during and after the Covid-19 crisis: refocusing teacher presence and learning activity. Postdigital Science and Education, 2, 923-945. https://doi.org/10.1007/s42438-020-00155-y

Rattanadilok Na Phuket, P. (2015). Understanding EFL students’ errors in writing. Journal of Education and Practice, 6(32) 99-106.

Rodsawang, S. S. (2017). Writing problems of EFL learners in higher education: A case Study of the Far Eastern University. FEU Academic Review, 11(1), 268-284. https://bit.ly/3rqt5ZD

Sepasdar, M., & Kafipour, R. (2019). The immediate and delayed effects of explicit and implicit corrective feedback types on EFL learners’ phonological errors. Pertanika Journal of Social Science and Humanities, 27(3), 1493-1506.

Shovon, H. I. M., & Haque, M. (2012). An approach of improving student’s academic performance by using K-means clustering algorithm and decision tree. International Journal of Advanced Computer Science and Applications, 3(8), 146-149. https://arxiv.org/pdf/1211.6340

Suvarnamani, S. (2017). A study of grammatical and lexical errors in descriptive writing of first year arts students at Silpakorn University. Silpakorn University Journal of Social Sciences, Humanities, and Arts, 17(2), 239-264. https://bit.ly/3GogFpn

Turkben, T. (2019). Readability characteristics of texts in middle school Turkish textbooks. Educational Policy Analysis and Strategic Research, 14(3), 80-105. https://doi.org/10.29329/epasr.2019.208.5

Waelateh, B., Boonsuk, Y., Ambele, E. A., & Jeharsae, F. (2019). An analysis of the written errors of Thai EFL students’ essay writing in English. Songklanakarin Journal of Social Sciences and Humanities, 25(3), 55-82. https://bit.ly/3AEUV7c

Wali, O., & Madani, A. Q. (2020). The importance of paragraph writing: An introduction. International Journal of Latest Research in Humanities and Social Science, 3(7), 44-50.

Watcharapunyawong, S., & Usaha, S. (2013). Thai EFL students’ writing errors in different text types: The interference of the first language. English Language Teaching, 6(1), 67-78. https://doi.org/10.5539/elt.v6n1p67

Wright, J., Ahn, Y. -H., & Lee, K. (2018). Investigating language learning strategies in English conversation using non-hierarchical cluster analysis. English Teaching, 73(1), 183-200. https://doi.org/10.15858/engtea.73.1.201803.183

Yang, Y. F. (2016). Transforming and constructing academic knowledge through online peer feedback in summary writing. Computer Assisted Language Learning29(4), 683-702. https://doi.org/10.1080/09588221.2015.1016440

Yulianto, Y. (2019). An analysis on readability level of English reading texts for Eighth grade students. J-SHMIC: Journal of English for Academic, 6(1), 81-91. https://bit.ly/3AEKZL7

Zamanian, M., & Heydari, P. (2012). Readability of texts: State of the art. Theory and Practice in Language Studies, 2(1), 43-53. https://doi.org/10.4304/tpls.2.1.43-53

Zhang, T., Chen, X., Hu, J., & Ketwan, P. (2021). EFL students' preferences for written corrective feedback: do error types, language proficiency, and foreign language enjoyment matter? Frontiers.in Psychology12, 1-12. https://doi.org/10.3389/fpsyg.2021.660564

...