logo logo International Journal of Educational Methodology

IJEM is a leading, peer-reviewed, open access, research journal that provides an online forum for studies in education, by and for scholars and practitioners, worldwide.

Subscribe to

Receive Email Alerts

for special events, calls for papers, and professional development opportunities.

Subscribe

Publisher (HQ)

RHAPSODE
Eurasian Society of Educational Research
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, HA4 7AE, UK
RHAPSODE
Headquarters
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, HA4 7AE, UK
Research Article

Developing Competency Evaluation of Pre-service Science Teachers in Industrial Revolution 4.0: Revealing Pedagogic and Professional Competencies

Endang Susantini , Badrun Kartowagiran , Syukrul Hamdi , Samsul Hadi , Amat Jaedun , I Gede Astra Wesnawa , Dadang Sunendar , Lukman Abdul Rauf Laliyo

This study aimed to develop an instrument to assess science teacher candidates’ professional and pedagogical competence in the Industrial revolu.

T

This study aimed to develop an instrument to assess science teacher candidates’ professional and pedagogical competence in the Industrial revolution 4.0. The instrument consisted of 30 questions and was used in the main study, which was analyzed using the Rasch model to unravel the reliability and empirical validity. The questions were developed based on a predetermined grid including the skills and literacy aspects used in the industrial revolution 4.0. The 30 revised questions were then tested on 60 students of Science Education at two State universities in Indonesia who were in their third year of study times. The Rasch model was employed to test its reliability and empirical validity that included Wright map analysis, item difficulty level, distractor analysis, and item suitability with the Rasch model. The results showed that the reliability value of the professional aspect was .95 and classified as an excellent category. Moreover, the pedagogic aspect obtained .93 and was classified as a very good category. Only one question was the most difficult and did not fit the Rasch model, while the others already fitted. This reliable and valid instrument is suggested to be useful in assessing pre-service science teachers’ competence.

Keywords: Industrial revolution, Rasch model, teacher competence, test development.

cloud_download PDF
Cite
Article Metrics
Views
495
Download
1028
Citations
Crossref
2

Scopus
1

References

Abdullah, Q. A., Humaidi, N., & Shahrom, M. (2020). Industry revolution 4.0: The readiness of graduates of higher education institutions for fulfilling job demands. Romanian Journal of Information Technology and Automatic Control30(2), 15-26. https://doi.org/10.31004/edukatif.v3i5.1055

Akimova, L., Akimov, O., Mihus, I., Koval, Y., & Dmitrenko, V. (2020). Improvement of the methodological approach to assessing the impact of public governance on ensuring the economic security of the state. Financial and Credit Activity: Problems of Theory and Practice4(35), 180-190. https://doi.org/10.18371/fcaptp.v4i35.221969

Alda, R., Boholano, H., & Dayagbil, F. (2020). Teacher education institutions in the Philippines towards education 4.0. International Journal of Learning, Teaching and Educational Research19(8), 137-154. https://doi.org/10.26803/ijlter.19.8.8

Amalia, A. N., & Widayati, A. (2012). Analisis butir soal tes kendali mutu kelas XII SMA mata pelajaran ekonomi akuntansi di Kota Yogyakarta tahun 2012 [Analysis of quality control test items for class XII SMA economics accounting subject in Yogyakarta City in 2012]. Jurnal Pendidikan Akuntansi Indonesia, 10(1), 1-26. https://doi.org/10.21831/jpai.v10i1.919

Applegate, G. M., Sutherland, K. A., Becker, K. A., & Luo, X. (2019). The effect of option homogeneity in multiple-choice items. Applied Psychological Measurement43(2), 113-124. https://doi.org/10.1177/0146621618770803

Arifin, Z. (2009). Evaluasi pembelajaran [Learning evaluatio]. Remaja Rosdakarya.

Bakar, N. S. A., Maat, S. M., & Rosli, R. (2020). Mathematics teacher's self-efficacy of technology integration and technological pedagogical content knowledge. Journal on Mathematics Education11(2), 259-276. http://doi.org/10.22342/jme.11.2.10818.259-276.

Ellitan, L. (2020). Competing in the era of industrial revolution 4.0 and society 5.0. Jurnal Maksipreneur: Manajemen, Koperasi, dan Entrepreneurship10(1), 1-12. https://doi.org/10.30588/jmp.v10i1.657

Fraenkel, J. R., Wallen, N. E., & Hyun, H. H. (2012). How to design and evaluate research in education. McGraw-Hill.

Gierl, M. J., Bulut, O., Guo, Q., & Zhang, X. (2017). Developing, analyzing, and using distractors for multiple-choice tests in education: A comprehensive review. Review of Educational Research, 87(6), 1082–1116. https://doi.org/10.3102/0034654317726529

Gleason, N. W. (2018). Higher education in the era of the fourth industrial revolution. Springer Nature. https://doi.org/10.1007/978-981-13-0194-0

Haladyna, T. M., Rodriguez, M. C., & Stevens, C. (2019). Are multiple-choice items too fat? Applied Measurement in Education32(4), 350-364. https://doi.org/10.1080/08957347.2019.1660348

Indira, E. W. M., Hermanto, A., & Pramono, S. E. (2020, June). Improvement of teacher competence in the industrial revolution era 4.0. In S. Xiao (Eds.), Proceedings of the International Conference on Science and Education and Technology (ISET 2019) (pp. 350-352). Atlantis Press. https://doi.org/10.2991/assehr.k.200620.068

Juhji, J., & Nuangchalerm, P. (2020). Interaction between scientific attitudes and science process skills toward technological pedagogical content knowledge. Journal for the Education of Gifted Young Scientists8(1), 1-16. https://doi.org/10.17478/jegys.2020.XX

Kopotun, I. M., Durdynets, M. Y., Teremtsova, N. V., Markina, L. L., & Prisnyakova, L. M. (2020). The use of smart technologies in the professional training of students of the Law Departments for the development of their critical thinking. International Journal of Learning, Teaching and Educational Research19(3), 174-187. https://doi.org/10.26803/ijlter.19.3.10

Macaro, E., Akincioglu, M., & Han, S. (2020). English medium instruction in higher education: Teacher perspectives on professional development and certification. International Journal of Applied Linguistics30(1), 144-157. https://doi.org/10.1111/ijal.12272

Maryanti, N., Rohana, R., & Kristiawan, M. (2020). The principal’s strategy in preparing students ready to face the industrial revolution 4.0. International Journal of Educational Review2(1), 54-69. https://bit.ly/3L0rnV7  

Muryadi, A. D. (2017). Model evaluasi program dalam penelitian evaluasi [Program evaluation model in evaluation research]. Jurnal Ilmiah Penjas3(1). https://bit.ly/39HG02E

Nuryanti, S., Masykuri, M., & Susilowati, E. (2018). Analisis Iteman dan model Rasch pada pengembangan instrumen kemampuan berpikir kritis peserta didik sekolah menengah kejuruan [Iteman's analysis and Rasch's model on the development of critical thinking skills of vocational high school students]. Jurnal Inovasi Pendidikan IPA4(2), 224-233. https://doi.org/10.21831/jipi.v4i2.21442

Pallant, J. (2020). SPSS survival manual: A step by step guide to data analysis using IBM SPSS. Routledge. https://doi.org/10.4324/9781003117452

Philbeck, T. D. (2017). Can we build a resilient employment market for an uncertain future? In LaGrandeur, K., Hughes, J. Surviving the Machine Age (pp. 83-106). Palgrave Macmillan. https://doi.org/10.1007/978-3-319-51165-8_6

Rahiem, M. D. (2020). The emergency remote learning experience of university students in Indonesia amidst the COVID-19 crisis. International Journal of Learning, Teaching and Educational Research19(6), 1-26. https://doi.org/10.26803/ijlter.19.6.1

Türkoguz, S. (2020). Investigation of three-tier diagnostic and multiple choice tests on chemistry concepts with response change behaviour. International Education Studies13(9), 10-22. https://doi.org/10.5539/ies.v13n9p10

Wahyuni, D. (2018). Peningkatan kompetensi guru menuju era revolusi industri 4.0 [Improving teacher competence towards the industrial revolution era 4.0]. Kajian Singkat Terhadap Isu Aktual dan Strategis Puslit Badan Keahlian DPR RI, X (24), 13-18. https://bit.ly/3FyrZAk

Wartoni, W., & Benyamin, P. I. (2020). Strategi pengembangan tes objektif (pilihan ganda) [Objective test development strategy (multiple choice)]. Diegesis: Jurnal Teologi5(1), 33-53. https://doi.org/10.46933/DGS.vol5i1%25p

World Economic Forum. (2016, January 1). The future of jobs. https://bit.ly/3FBIyvl

Xu, M., David, J. M., & Kim, S. H. (2018). The fourth industrial revolution: Opportunities and challenges. International Journal of Financial Research9(2), 90-95. https://doi.org/10.5430/ijfr.v9n2p90

Yurdakul, I. K. (2011). An evaluative case study on professional competency of preservice information technology teachers. Turkish Online Journal of Educational Technology, 10(3), 33-53. https://bit.ly/39TIYkS

...