Factor Structure and Dimensionality of an Instrument designed to Measure the Metacognitive Orientation of Thai Science Classroom Learning Environments
The purpose of this study was to establish the factor structure and dimensionality of the Metacognitive Orientation Learning Environment Scale –.
- Pub. date: November 15, 2022
- Pages: 805-818
- 347 Downloads
- 744 Views
- 2 Citations
The purpose of this study was to establish the factor structure and dimensionality of the Metacognitive Orientation Learning Environment Scale – Science (MOLES-S) in the Thai context. The metacognitive orientation of a science classroom learning environment is defined as the extent to which psychosocial conditions that are known to enhance students’ metacognition are evident in a specific science classroom. This study builds on earlier work in the research areas of science education, metacognition, and learning environments. A sample of 5418 Thai science students in grades 10 to 12, from 40 schools across Thailand, completed the MOLES-S that had been translated into Thai. Exploratory factor analysis was undertaken and Rasch analysis was used to calibrate the scale and explore its dimensionality. The results suggest that the MOLES-S(T), where (T) represents Thailand, has the same factor structure as the original MOLES-S, is reliable, and can be used with confidence in research into metacognition in Thai high school science classrooms.
Keywords: Classroom learning environments, metacognition, science education.
References
Behr, D., & Shishido, K. (2016). The translation of measurement instruments for cross-cultural-surveys. In W. Wolf, T. Joye, T. W. Smith & Y.-C. Fu. (Eds.), The sage handbook of survey methodology (pp. 269-287). Sage Publications. https://doi.org/10.4135/9781473957893
Bode, R. K., & Wright, B. D. (1999). Rasch measurement in higher education. In J. C. Smart & W. G. Tierney (Eds.), Higher education: Handbook of theory and research (Vol. 14, pp. 287–316). Springer. https://doi.org/10.1007/978-94-011-3955-7_7
Brislin, R. W. (1980). Translation and content analysis of oral and written material. In H. Triandis & J. Berry (Eds.), Handbook of cross-cultural psychology: Methodology (Vol. 2, pp. 389-444.) Allyn & Bacon.
Chantharanuwong, W., Buaraphan, K., Thomas, G. P., Ruangsuwan, C., Booncerd, K., Anankaphan, S., & Sumida, M. (2016). Supporting science learning through the ‘Enhancing Students’ Thinking Skills and Teachers’ Thinking Research Project.’ In C. Yuenyong, P. Pongsophan, D. Treagust, G. P Thomas, F.-Y. Yang, M. B. Barquilla, C. Dahsah, C. Faikhamta, P. C. Taylor, M. Sumida, L. Halim, & K. C. D. Tan (Eds.), Proceedings of the 4th International Conference for Science Educators and Teachers: ISET 2016 (pp. 305-313). Khon Kaen University.
Chantharanuwong, W., Thathong, K., Yuenyong, C., Buaraphan, K., & Thomas, G. P. (2014). The current situation of students’ metacognition of the high school science classrooms in Thailand. In L. Dvořák & V. Koudelková (Eds.), Proceedings of the 2013 International Conference on Physics Education (pp. 153-159). MATFYZPRESS. https://repository.bbg.ac.id/handle/374
Chantharanuwong, W., Thatthong, K., Yuenyong, C., & Thomas, G. P. (2011). Exploring student metacognition in science, technology, society, and environment issues in a Thai Context. In J. Kim, J. Park, H.-A. Seo, J.-A. Lee, & J. Kim (Eds.), Lighting the World with Science: Proceedings of the 2011 Conference of the East-Asian Association for Science Education (pp. 146). Chosun University.
Chantharanuwong, W., Thatthong, K., Yuenyong, C., & Thomas, G. P. (2012). Exploring the metacognitive orientation of the science classrooms in a Thai context. In G. A. Baskan, F. Ozdamli, S. Kanbul, & D. Özcan (Eds.), Proceedings of the 4th World Conference on Educational Sciences, (pp. 5116-5123). Elsevier Ltd. https://doi.org/10.1016/j.sbspro.2012.06.393
Donovan, M. S., & Bransford, J. D. (Eds.). (2005). How students learn: Science in the classroom. National Academies Press. https://doi.org/10.17226/11102
Flavell, J. H. (1979). Metacognition and cognitive monitoring: A new area of cognitive developmental inquiry. American Psychologist, 34, 906-911. https://doi.org/10.1037/0003-066X.34.10.906
Fraser, B. J. (1990). Individualised classroom environment questionnaire. Australian Council for Educational Research.
Fraser, B. J., Giddings, G. J., & McRobbie, C. J. (1995). Evolution and validation of a personal form of an instrument for assessing science laboratory classroom environments. Journal of Research in Science Teaching, 32, 399-422. https://doi.org/10.1002/tea.3660320408
Garner, R., & Alexander, P. A. (1989). Metacognition: Answered and unanswered questions. Educational Psychologist, 24(2), 143-158. https://doi.org/10.1207/s15326985ep2402_2
Georghiades, P. (2006). The role of metacognitive activities in the use of primary contextual use of primary pupils’ conceptions of science. Research in Science Education, 36, 29-49. https://doi.org/10.1007/s11165-004-3954-8
Hattie, J. (2014). Visible learning: A synthesis of over 800 meta-analyses relating to achievement. Routledge. https://doi.org/10.4324/9780203887332
Hsu, Y.-S., Iannone, P., She, H.-S., & Hadwin, A. F. (2016). Prologue for the IJSME Special Issue: Metacognition for science and mathematics learning in technology-infused learning environments. International Journal of Science and Mathematics Education, 14, 243-248. https://doi.org/10.1007/s10763-016-9727-9
Jolliffe, I. T. (2002). Principal component analysis (2nd ed.). Springer-Verlag. https://doi.org/10.1007/b98835
Kihlstrom, J. F. (2021). Ecological validity and “Ecological validity.” Perspectives on Psychological Science, 16(2), 466-471. https://doi.org/10.1177/1745691620966791
Lewin, K. (1936). Principles of topological psychology. McGraw. https://doi.org/10.1080/08856559.1939.10533843
Linacre, J. M. (2021). Winsteps® Rasch measurement computer program (Version 5.1.0). https://www.winsteps.com/index.htm
Linacre, J. M., & Wright, B. D. (1999). WINSTEPS Rasch analysis for all two-fact models (Version 2.98). MESA Press.
Mok, M., & Flynn, M. (2002). Dimensionality and construct validity of School Development Expectation Scale for secondary students. Journal of Applied Measurement, 3(1), 16–37.
Murray, H. A. (1938). Explorations in personality. Oxford Press.
Ohtani, K., & Hisasaka, T. (2018). Beyond intelligence: A meta-analytic review of the relationship among metacognition, intelligence, and academic performance. Metacognition and Learning, 13, 179–212. https://doi.org/10.1007/s11409-018-9183-8
Organisation for Economic Co-operation and Development. (2019a). PISA 2018: Insights and interpretations. https://bit.ly/3DG60s1
Organisation for Economic Co-operation and Development. (2019b). PISA 2018 results
(Volume I): What students know and can do. https://doi.org/10.1787/5f07c754-en
Paz, P. (2008). Development of a valid and reliable survey instrument to assess teacher practice as a function of technology support and training [Unpublished doctoral dissertation]. University of California.
Peters, E., & Kitsantas, A. (2010). The effect of nature of science metacognitive prompts on science students’ content and nature of science knowledge, metacognition, and self-regulatory efficacy. School Science and Mathematics, 110, 382-396. https://doi.org/10.1111/j.1949-8594.2010.00050.x
Pimvichai, J., Sanium, S., & Buaraphan, K. (2019). Exploration of students’ metacognitive experience in physics classroom. Journal of Physics: Conference Series, 1340, Article 012076. https://doi.org/10.1088/1742-6596/1340/1/012076
Reise, S. P., Waller, N. G., & Comfrey, A. L. (2000). Factor analysis and scale revision. Psychological Assessment, 12, 287-297. https://doi.org/10.1037/1040-3590.12.3.287
Sagun, R. D., & Prudente, M. (2021). Applying the Plan-Do-Study-Act (PDSA) action model to restructure the science classroom conforming to the metacognitive orientation standards. Educational Action Research. Advance online publication. https://doi.org/10.1080/09650792.2021.1894964
Şahin, S. (2015). The extent to which the characteristics of a metacognitive oriented learning environment predict the characteristics of a thinking-friendly classroom. Eurasian Journal of Educational Research, 15(60), 241-260. https://doi.org/10.14689/ejer.2015.60.13
Salkind, N. J. (2010). Factor loadings. In N. J. Salkind (Ed.), Encyclopedia of research design (Vol. 1, pp. 481-483). SAGE Publications, Inc. https://doi.org/10.4135/9781412961288.n149
Santos, J. A. R. (1999). Cronbach’s alpha: A tool for assessing the reliability of scales. Journal of Extension, 37(2), 1-5.
Schultz-Jones, B. A., & Ledbetter, C. E. (2013). Evaluating students’ perceptions of library and science inquiry: Validation of two new learning environment questionnaires. Learning Environments Research, 16, 329–348. https://doi.org/10.1007/s10984-013-9141-y
Scott, B. M., & Levy, M. G. (2013). Metacognition: Examining the components of a fuzzy concept. Educational Research, 2(2), 120-131. https://doi.org/10.5838/erej.2013.22.04
Smith, R. M. (1999). Rasch measurement models: Interpreting WINSTEPS/BIGSTEPS and FACETS output. MESA Press.
Sternberg, R. J. (1998). Metacognition, abilities, and developing expertise: What makes an expert student? Instructional Science, 26, 127-140. https://doi.org/10.1023/A:1003096215103
Taber, K. S. (2018). The use of Cronbach’s alpha when developing and reporting research instruments in science education. Research in Science Education, 48, 1273-1296. https://doi.org/10.1007/s11165-016-9602-2
Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach's alpha. International Journal of Medical Education, 2, 53-55. https://doi.org/10.5116/ijme.4dfb.8dfd
Taylor, P. C. S., Fraser, B. J., & White, L. R. (1994, April 4-8). CLES: An instrument for monitoring the development of constructivist learning environments [Paper presentation]. Annual Meeting of the American Educational Research Association, LA, New Orleans, United States.
Thomas, G. P. (2003). Conceptualisation, development and validation of an instrument for evaluating the metacognitive orientation of science classroom learning environments: The Metacognitive Orientation Learning Environment Scale - Science (MOLES-S). Learning Environments Research, 6(2), 175-197. https://doi.org/10.1023/A:1024943103341
Thomas, G. P. (2004). Dimensionality and construct validity of an instrument designed to measure the metacognitive orientation of science classroom learning environments. Journal of Applied Measurement, 5(4), 367-384.
Thomas, G. P. (2012). Metacognition in Science Education: Past, present and future considerations. In B. J. Fraser, K. G. Tobin, and C. J. McRobbie (Eds.), Second international handbook of science education (pp. 131-144). Springer. https://doi.org/10.1007/978-1-4020-9041-7_11
Thomas, G. P. (2013). Changing the metacognitive orientation of a classroom learning environment to stimulate metacognitive reflection regarding the nature of physics learning. International Journal of Science Education, 35(7), 1183-1207. https://doi.org/10.1080/09500693.2013.778438
Thomas, G. P. (2017). “Triangulation:” An expression for stimulating metacognitive reflection regarding the use of ‘triplet’ representations for chemistry learning. Chemistry Education Research and Practice, 18(4), 533-548. https://doi.org/10.1039/C6RP00227G
Thomas, G. P., & Anderson, D. (2014). Changing the metacognitive orientation of a classroom environment to enhance students' metacognition regarding chemistry learning. Learning Environments Research, 17(1), 139-155. https://doi.org/10.1007/s10984-013-9153-7
Thomas, G. P., Meldrum, A., & Beamish, J. (2013). Conceptualization, development and validation of an instrument for investigating elements of undergraduate physics laboratory learning environments: The UPLLES (Undergraduate Physics Laboratory Learning Environment Survey). European Journal of Physics Education, 4(4), 28-40. https://cutt.ly/1N6AuO6
Ward, G., & Fisher, D. L. (2013). Development and use of an instrument for assessing the department-level work environment: The Department-Level Environment Questionnaire (DLEQ). Learning Environments Research, 16, 113–130. https://doi.org/10.1007/s10984-013-9126-x
Wright, B. D., & Masters, G. N. (1982). Rating scale analysis. MESA Press.
Yildiz, E., & Ergin, O. (2007). The adaptation of metacognitive orientation of learning environment scale-Science (MOLES-S) into Turkish: The study of validity and reliability. Eurasian Journal of Educational Research, 28, 123-133.
Zhao, N., Wardeska, J., McGuire, S., & Cook, E. (2014). Metacognition: An effective tool to promote success in college science learning. Journal of College Science Teaching, 43(4), 48-54. https://doi.org/10.2505/4/jcst14_043_04_48