Volume 10 Issue 2 (May 2024)
Development and Validation of Instruments for Assessing the Impact of Artificial Intelligence on Students in Higher Education
artificial intelligence item measurement reliability test validity test...
The role of artificial intelligence (AI) in education remains incompletely understood, demanding further evaluation and the creation of robust assessment tools. Despite previous attempts to measure AI's impact in education, existing studies have limitations. This research aimed to develop and validate an assessment instrument for gauging AI effects in higher education. Employing various analytical methods, including Exploratory Factor Analysis, Confirmatory Factor Analysis, and Rasch Analysis, the initial 70-item instrument covered seven constructs. Administered to 635 students at Nueva Ecija University of Science and Technology – Gabaldon campus, content validity was assessed using the Lawshe method. After eliminating 19 items through EFA and CFA, Rasch analysis confirmed the construct validity and led to the removal of three more items. The final 48-item instrument, categorized into learning experiences, academic performance, career guidance, motivation, self-reliance, social interactions, and AI dependency, emerged as a valid and reliable tool for assessing AI's impact on higher education, especially among college students.
0
Cognitive Technology to Evaluate the Academic Learning of Computational Cognition in Psychology Students
academic learning cognitive assessment natural semantic networks psychology students semantic priming...
This study illustrated an alternative way to evaluate students’ academic learning. It involved the joint and intertwined application of the natural semantic network technique, computer simulations, and semantic priming experiments to assess the cognitive changes in knowledge structures due to academic learning in two groups of psychology students. The experimental group was enrolled in a course on computational cognition, while the control group was oblivious to this course. The results indicated that the cognitive assessment tools discriminate the cognitive changes produced as a result of general training undertaken in a psychology degree versus the influence of a specific course. After the course, the experimental group increased their technical vocabulary, changed their conceptual valuation of definers related to computational theories of mind, and reorganized the relations among definers according to the computational cognition approach. Also, this group presented a higher connectivity index between the concepts of the semantic network, their conceptual activation level and conceptual co-activation pattern changed, and their access level to the evaluated schema’s concepts improved. In contrast, the control group did not show significant changes in their cognitive patterns after the course. These findings suggest that cognitive tools may be helpful in the diagnosis of academic learning.
0
The Impact of Proactive Behaviors of Vocational College Teachers on Teaching Performance: The Mediating Role of Organizational Support Perception
organizational support perception proactive behaviors teaching performance vocational college teachers...
This study aims to explore the relationship between proactive behaviors, teaching performance, and organizational support among vocational college teachers. Based on the theory of organizational support, we conducted a survey of 373 teachers from four vocational colleges in Shanxi Province, using scales for proactive behaviors, organizational support, and teaching performance. The results indicate that: (a) There is a significant correlation between teachers' proactive behaviors and teaching performance; (b) There is a significant correlation between teachers' proactive behaviors and organizational support; (c) Organizational support plays a significant mediating role in the relationship between teachers' proactive behaviors and teaching performance. This study enriches the application of organizational support in vocational colleges, providing empirical evidence for improving teachers' proactive behaviors in higher education institutions, which could be useful for central or local education policy decision-makers and implementing units. Additionally, this model could be further applied beyond vocational education to other contexts or policies, demonstrating both theoretical and practical significance.
0
Profiles of Teacher-Student Relationships and Classroom Management Practices: How They Relate to Self-Efficacy, Work Stress, and Classroom Climate
classroom management prosocial classroom model teacher profile teacher-student relationships teacher wellbeing...
Teachers' classroom practice encompasses diverse facets of teacher behavior. Understanding teachers’ classroom practice is important as the literature has been well documented its association with student, teacher, and classroom outcomes. Positive teacher-student relationships and proper classroom management, both are important aspects of teachers’ classroom practices, have been empirically linked to increasing student academic performance and reducing problem behaviors. This study explored patterns of teacher classroom practices across teacher-student relationships and classroom management and validated them using a person-oriented approach, k-means clustering, on three sets of data with over 600 participants. Using indicators of classroom assessment scoring system (CLASS), three distinct teacher profiles were identified: supportive, intermediate, and detached. Supportive teachers demonstrated high levels of teacher-student relationships and classroom management, while detached teachers showed low levels of both. Intermediate teachers fell between these two groups. The study also compared these profiles based on teacher self-efficacy, work stress, and classroom climate. Supportive teachers had the highest classroom climate scores, followed by intermediate and detached. Work stress was comparable for intermediate and supportive teachers, but both were lower than detached. No group differences were found for self-efficacy. This study contributes to the understanding of teacher behaviors with students in the lower grades.
0
Empowering English as a Foreign Language Education With the Production-Oriented Approach: A Systematic Review
english as a foreign language language education language skills production-oriented approach systematic review...
The field of English as a Foreign Language (EFL) instruction has gained recognition worldwide, particularly in non-native English-speaking countries. However, traditional teaching methods fall short of meeting the needs of today's EFL learners. In response, the Production-Oriented Approach (POA) has emerged as a new pedagogical approach to address these challenges. Despite its significant impact on EFL education, there is a lack of reviews on the POA. This study conducted a systematic review to explore the POA's effectiveness, challenges, and future trends. Using the PRISMA framework, 31 articles from reputable databases (Web of Science, Education Resources Information Center, Scopus, and Google Scholar) were analyzed, covering the years 2018 to 2023. The study's comprehensive analysis, employing Nvivo, revealed that the POA has immense potential for enhancing English learners' language skills, particularly in reading, speaking, writing, and translating. Moreover, the study highlighted the POA's positive influence on learners' affective factors, including motivation, confidence, critical thinking, and self-directed learning abilities. Nonetheless, the POA faces challenges for both teachers and learners, particularly during the transition from traditional methods and the associated increase in workload. Despite these challenges, this study unequivocally establishes the POA as an effective pedagogical approach for teaching EFL. Additionally, it identifies research gaps that must be addressed to sustain and improve EFL education in the future through further development of the POA.
0
Metacognitive Awareness as a Predictor of Mathematical Modeling Competency Among Preservice Elementary Teachers
educational research mathematics education mathematical modeling metacognitive processes teacher preparation...
Mathematical modeling offers a promising approach to improving mathematics education. This study aims to determine if the concept of metacognitive awareness in the learning process is associated with mathematical modeling. This study also considers the interaction effect of sex and academic year level on both variables. Focusing the study on preservice elementary teachers might address potential issues and targeted intervention in their preparation program concerning their ability to teach and guide young learners in modeling activities. The research sample includes 140 preservice elementary teachers at Central Luzon State University, Philippines. Data collection used an adapted metacognitive awareness inventory and a validated researcher-made mathematical modeling competency test aligned with the K-12 mathematics curriculum in the Philippines. Results revealed that the preservice elementary teachers had a high metacognitive awareness and mathematical modeling competency, ranging from 22 to 31 out of 36 points. Besides, Factorial ANOVA indicates that academic year level positively affects both variables regardless of sex, and stepwise regression analysis unveiled that information management, declarative knowledge, and planning significantly predict 41.4% of the mathematical modeling competency variance. This suggests that developing metacognitive awareness supports preservice elementary teachers in performing modeling tasks that improve their competency level in mathematics.
0
Teachers’ Views on the Integration of Information and Communication Technology in the Teaching of Slovene (First Language) in Primary School
elementary school teachers ict in education primary school slovene slovenian language teachers...
Information and Communication Technology (ICT) brings modern learning approaches, forms and methods to education, and with them new opportunities for learning and teaching. The use of ICT in the classroom motivates students, enables them to participate, provides individualisation and differentiation, interactivity, and encourages creativity and critical thinking. Teachers play a very important role in this, as they are the ones who can provide students with a stimulating learning environment, including through the use of ICT. As Slovene (first language) is the subject with the most teaching hours in public primary schools in the Republic of Slovenia, we conducted an empirical study on the views of general and subject teachers of Slovene (N = 190) on the integration of information and communication technology in teaching. Teachers’ opinions were investigated through quantitative research. We found that teachers frequently use ICT in Slovene lessons, namely for repeating and consolidating learning material and for presenting new learning material, and that ICT is used most often in frontal forms of learning. Teachers mostly use LCD projectors, computers, interactive whiteboards, e-workbooks, audio recordings and videos. We also found that teachers are moderately satisfied with the available ICT equipment and e-materials, and that they feel moderately competent when it comes to using ICT in Slovene lessons. Teachers also used ICT during the COVID-19 epidemic. We also found that there are no statistically significant differences in the use of ICT between teachers teaching Slovene according to their teaching level, age and years of service.
0
Reflections on Transformation, Teamwork, and Mentoring: Student Teachers’ Self-Assessed Learning, Equality, and Equity in Competence-Based Education
collaboration conscious experiences latent meanings mindset motivation...
This research concentrated on observing academic student teachers’ teamwork, especially its effectiveness and their attitudes to collaboration and transformation, as well as their reflective, written self-assessments in relation to teamwork. Teams have been studied widely, but these kinds of special contexts are rare. The target group was higher education teachers, the context was an introduction of a new pedagogical program, and the teams acted under the guidance of mentors and occasional lecturers. Besides the content analysis, the study method was a deep analysis of the essays. The most effective positive influencers proved to be social exchanges, including mentoring, peer support, input for learning and the experiences of wellbeing. Individual distrust of working methods in teams, and emotional suspicions of their self-efficacy in transformational settings emerged as latent factors, revealing mainly the difficulty of changing traditional mindsets. The analyses offered individual and community-wide opportunities to steer education in the future.
0
Exploring the Nexus of Organizational Culture, Digital Capabilities, and Organizational Readiness for Change in Primary School in Digital Transformation: A Quantitative Analysis
digital capabilities digital transformation organizational culture organizational readiness primary schools...
In the context of Vietnam's primary schools undergoing a digital transformation, this research investigates the relationship between organizational culture (OC), digital capabilities (DC), and organizational readiness (OR) for change. This survey, which employs a quantitative methodology, includes 892 teachers and school managers from different elementary schools. Analyses were conducted using SPSS Statistics 26.0. The study shows a favorable relationship between digital skills and organizational readiness, suggesting that more digitally capable institutions are better equipped to handle change. Furthermore, a significant correlation exists between corporate culture, digital skills, and organizational readiness, indicating that schools with a creative and supportive culture are more prone to embrace digital change. These results advance knowledge of the variables affecting organizational change-readiness in Vietnam's primary school digital transformation. These results also have significant implications for educational policymakers, school administrators, and other stakeholders facilitating digital transformation in primary schools. By recognizing the benefits of digital capabilities and organizational culture for organizational change readiness, decision-makers can implement strategies to foster a supportive culture and enhance digital capabilities within educational institutions, ultimately leading to more successful and effective digital transformation initiatives.
2
Organisational Dynamics of University Social Capital: Developing Constructs Through Factor Analysis
employability trust peer networks support services teacher-student relationships university social capital...
This study is designed to illuminate the role of four key constructs—teacher-student relationships, peer networks, satisfaction with support services, and employability trust—in shaping the social capital within universities. Utilising a sample of 1902 working students derived from the Eurostudent VII survey data, this research applies both exploratory and confirmatory factor analysis to validate the proposed model. The findings indicate that all four constructs demonstrate statistically significant and positive associations with university social capital. Crucially, the measures of reliability and validity are within an acceptable range, lending credibility to the findings. The teacher-student relationship was found to be the most influential factor, highlighting its crucial value in the functioning of social capital inside universities. Along with providing a framework for future studies on the ever-changing nature of social capital in universities, the results highlight the significance of cultivating an interconnected academic community, which enriches the educational organisation as a whole.
0