logo logo International Journal of Educational Methodology

IJEM is a leading, peer-reviewed, open access, research journal that provides an online forum for studies in education, by and for scholars and practitioners, worldwide.

Subscribe to

Receive Email Alerts

for special events, calls for papers, and professional development opportunities.

Subscribe

Publisher (HQ)

RHAPSODE LTD
Eurasian Society of Educational Research
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, UK. HA4 7AE
RHAPSODE LTD
Headquarters
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, UK. HA4 7AE

'performance-based testing' Search Results



...

This study describes the development and validation of a psychometrically-sound instrument, the Active Learning Strategies Inventory (ALSI), designed to measure learners’ perceptions of their active learning strategies within an active learning context. Active learning encompasses a broad range of pedagogical practices and instructional methods that connect with an individual learner's active learning strategies. In order to fulfill the study's goals, a conceptual framework on learners’ active learning strategies was developed and proposed, drawing upon the research literature on active learning. The development and construct validation of the Active Learning Strategies Inventory (ALSI), based on the conceptual and methodological underpinnings, involved identifying five scales of learners’ active learning strategies: engagement, cognitive processing, orientation to learning, readiness to learn and motivational orientation. An item pool of 20 items was generated following an extensive review of the literature, standardized card sorting procedures including confirmatory factor analysis and scale validation of a pilot (n = 407) survey. The ALSI scale demonstrated strong internal consistency and reliability with a Cronbach's alpha ranging from 0.81 to 0.87. High item loading scores from the factor analysis provided initial support for the instrument's construct validity of the five-factor model. The ALSI scale provides a reliable and valid method for researchers and academicians who wish to measure learners' perceptions of their active learning strategies within an active learning context. Finally, we discuss the implications and address the limitations and directions for future research.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.1.201
Pages: 201-223
cloud_download 1068
visibility 1328
5
Article Metrics
Views
1068
Download
1328
Citations
Crossref
5

Scopus
4

...

Kelley’s Discrimination Index (DI) is a simple and robust, classical non-parametric short-cut to estimate the item discrimination power (IDP) in the practical educational settings. Unlike item–total correlation, DI can reach the ultimate values of +1 and ‒1, and it is stable against the outliers. Because of the computational easiness, DI is specifically suitable for the rough estimation where the sophisticated tools for item analysis such as IRT modelling are not available as is usual, for example, in the classroom testing. Unlike most of the other traditional indices for IDP, DI uses only the extreme cases of the ordered dataset in the estimation. One deficiency of DI is that it suits only for dichotomous datasets. This article generalizes DI to allow polytomous dataset and flexible cut-offs for selecting the extreme cases. A new algorithm based on the concept of the characteristic vector of the item is introduced to compute the generalized DI (GDI). A new visual method for item analysis, the cut-off curve, is introduced based on the procedure called exhaustive splitting.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.6.2.237
Pages: 237 - 258
cloud_download 887
visibility 1096
6
Article Metrics
Views
887
Download
1096
Citations
Crossref
6

Scopus

...

Progress monitoring of academic achievement is an essential element to prevent learning disorders. A prominent approach is curriculum-based measurement (CBM). Various studies have documented positive effects of CBM on students’ achievement. Nevertheless, the use of CBM is associated with additional work for teachers. The use of tablets may be of help here. Yet, although many advantages of computer- or tablet-based assessments are being discussed in the literature (e. g. innovative item formats, adaptive testing, automated scoring and feedback), there are still concerns regarding the comparability of different assessment modes (paper-pencil vs. tablet). In the study presented, we analyze the CBM data of 98 fourth graders. They processed the exact same computation items once with paper and pen and once in a tablet application. The analyses point to comparable results in the test modes, although some significant deviations can be found at item level. In addition, the children report perceived benefits when working with the tablet.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.6.4.669
Pages: 669-680
cloud_download 1080
visibility 1363
13
Article Metrics
Views
1080
Download
1363
Citations
Crossref
13

Scopus

Presenting the Meta-Performance Test, a Metacognitive Battery based on Performance

metacognition assessment content validity performance tests

Marcio Alexander Castillo-Diaz , Cristiano Mauro Assis Gomes


...

The self-report and think-aloud approaches are the two dominant methodologies to measure metacognition. This is problematic, since they generate respondent and confirmation biases, respectively. The Meta-Performance Test is an innovative battery, which evaluates metacognition based on the respondent's performance, mitigating the aforementioned biases. The Meta-Performance Test consists of two tests, the Meta-text, which evaluates metacognition in the domain of reading comprehension, and Meta-number, in the domain of arithmetic expressions solving. The main focus of this article is to present the development of the battery, in terms of its conceptual basis, development strategies and structure. Evidence of its content validity is also presented, through the evaluation of three experts in metacognition, two experts in Spanish language, two experts in mathematics and five students who represent the target population. The results of the judges' evaluations attested to the Meta-Performance Test content validity, and the target population declared that both the battery understanding and taking are adequate. Contributions and future research perspectives of the Meta-Performance Test in the field of metacognition are discussed.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.2.289
Pages: 289-303
cloud_download 1347
visibility 2096
2
Article Metrics
Views
1347
Download
2096
Citations
Crossref
2

Scopus
2

...

In modern times, the importance of education cannot be overstated. Beyond the acquisition of knowledge, perhaps the most important aim of education may be the development of character in individuals, including vitality, courage, sensitiveness, and intelligence, from which our society may experience increased prosperity, peace, and freedom. In this paper we address the daunting challenge of achieving successful, widespread, and inclusive university education. How do we enliven and engage the students in our classrooms? How can we help each and every student in the class self-actualize and reach the highest potential for learning? Active learning is one well-established and potent solution for accelerating the accumulation of knowledge. In this paper, an experiment in active learning utilizing team-based adaptive online quizzes in an introductory math finance course involving 378 undergraduate students over two years is conducted to explore the potency of this active learning methodology compared to a control group with traditional teaching. We find active learning unambiguously improves knowledge accumulation in the individual students, while simultaneously bolstering inclusive excellence across all students in the class, as measured by a relevant and meaningful quantitative metric. The paper concludes with a discussion comparing the quality of active vs. traditional teaching methods and offers interpretations of the quantitative results. The results of this paper support the widely accepted theme in the literature that active learning has a positive effect on student performance in STEM (Science, Technology, Engineering, and Math) courses.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.2.353
Pages: 353-360
cloud_download 410
visibility 740
2
Article Metrics
Views
410
Download
740
Citations
Crossref
2

Scopus

...

The article focused on the use of assessment for learning in promoting active learning and learner participation in mathematics. Assessment for learning (AfL) has been found to enhance learning and improve performance. However, teachers’ use of AfL to enhance active learning has not been clearly outlined. This study is part of the broader research study that explored mathematics teachers’ use of AfL to enhance mathematics teaching and learning in primary schools in Alexandra Township, Johannesburg. A case study research-type and a qualitative approach were used to collect data from mathematics teachers. Nine teachers were purposefully selected from whom data were collected using semi-structured interviews and non-participant observation. The findings revealed that teachers had limited pedagogical knowledge in using AfL to promote active learning in their classrooms. They failed to apply a learner-centred approach that promotes effective learner participation in mathematics classrooms. Therefore, it is recommended that teachers undergo ongoing continuous development on classroom time management and planning for the effective use of AfL.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.3.473
Pages: 473-485
cloud_download 661
visibility 1034
2
Article Metrics
Views
661
Download
1034
Citations
Crossref
2

Scopus

...

This research’s aim was to explore the role of cognitive flexibility in mediating the effect of intrinsic motivation on the creativity of junior high school students. A creativity scale, an intrinsic motivation inventory and a cognitive flexibility inventory were utilized to investigate a sample of junior high school students in Shaanxi Province in western China. 765 valid questionnaires were collected and analyzed using the structural equation model (SEM). The SEM analysis showed that intrinsic motivation and cognitive flexibility have significantly positive impacts on junior high school students’ creativity. Furthermore, a full model revealed that cognitive alternatives and cognitive control mediate the relationship intrinsic motivation and creativity, and the mediation effect of cognitive alternatives is significantly greater than that of cognitive control. In general, the current research suggests that the impact of intrinsic motivation on junior high school students’ creativity is mediated by cognitive flexibility, and its results amplify prior scholars’ research results and give educators an inspiration how to cultivate creativity for the middle school students.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.2.297
Pages: 297-312
cloud_download 459
visibility 612
0
Article Metrics
Views
459
Download
612
Citations
Crossref
0

Scopus
0

...

The study discussed in this paper is a systematic literature review related to the role of dual language programme (DLP) in mathematics education which has been published within the last 5 years. This study was conducted to identify the distribution of DLP studies in terms of year of publication, the study context covered in previous studies, the context of study areas used, focus and trends of past studies, research methods used in previous studies and the role of language in school mathematics education. This review study followed the guidelines of Preferred Reporting Items for Systematic Reviews and Meta-Analyzes (PRISMA) to analyze articles from Scopus and Web of Science. The findings of the study indicate that research trends in the implementation of the DLP on mathematics education for secondary school students showed an increase from 2017 to 2019. Most DLP-related articles are widely developed in the United States and Germany. The findings indicate that previous studies are more interested in studying the implementation of DLP in rural areas. Past studies have also preferred to use the design of either a qualitative study or a quantitative study to be implemented. Questionnaires, tests and interviews are among the research instruments that are often used for a study.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.4.669
Pages: 669-686
cloud_download 286
visibility 547
2
Article Metrics
Views
286
Download
547
Citations
Crossref
2

Scopus
2

Rethinking the Components of Regulation of Cognition through the Structural Validity of the Meta-Text Test

metacognition performance-based testing regulation of cognition structural validity

Marcio Alexander Castillo-Diaz , Cristiano Mauro Assis Gomes , Enio Galinkin Jelihovschi


...

The field of studies in metacognition points to some limitations in the way the construct has traditionally been measured and shows a near absence of performance-based tests. The Meta-Text is a performance-based test recently created to assess components of cognition regulation: planning, monitoring, and judgment. This study presents the first evidence on the structural validity of the Meta-Text, by analyzing its dimensionality and reliability in a sample of 655 Honduran university students. Different models were tested, via item confirmatory factor analysis. The results indicated that the specific factors of planning and monitoring do not hold empirically. The bifactor model containing the general cognition regulation factor and the judgment-specific factor was evaluated as the best model (CFI = .992; NFI = .963; TLI = .991; RMSEA = .021). The reliability of the factors in this model proved to be acceptable (Ω = .701 & .699). The judgment items were well loaded only by the judgment factor, suggesting that the judgment construct may actually be another component of the metacognitive knowledge dimension but having little role in cognition regulation. The results show initial evidence on the structural validity of the Meta-Text and give rise to information previously unidentified by the field which has conceptual implications for theorizing metacognitive components.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.4.687
Pages: 687-698
cloud_download 978
visibility 1318
2
Article Metrics
Views
978
Download
1318
Citations
Crossref
2

Scopus
1

Game-Based Learning Kit Method in Isometric Transformations: Usability and Effects on Students’ Achievement and Motivation

game based learning isometric transformations mathematics motivation

Siti Munirah Mohd Nasir , Zamzana Zamzamir , Nor’ain Mohd Tajudin , Sabarina Shafie , Norhayati Ahmat , Norsida Hasan


...

This study focused on the development of teaching aids for the topic of Isometric Transformations for Form 2 students in Malaysia. The first objective was to determine the usability of teaching aids in the isometric transformations kit integrates game-based learning (GBL) Method (KitTI Method) and the second objective was to examine the effectiveness of using the KitTI Method on students’ achievement and motivation. This study was directed by the Design and Development Research (DDR) model with survey and quasi-experimental designs. The sample selection was conducted by cluster sampling involving Form 2 students from schools in the district of Muallim and Batang Padang in the state of Perak. The instruments used were KitTI Method Teaching Aids Usability Questionnaire (KMTAUQ), Isometric Transformations Topic Achievement Test (ITTAT), and KitTI Method Motivation Questionnaire (KMMQ). The findings showed that the mean score of KitTI Method‘s usability was high, the treatment group obtained significantly higher improvement in achievement compared to the control group while the mean scores of pre-test achievement as a covariate and students’ motivation in learning Isometric Transformations were high. Therefore, the KitTI Method is suitable to be implemented as a guide for mathematics teachers in designing dynamic teaching and learning and is able to improve students’ achievement and motivation.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.9.2.321
Pages: 321-332
cloud_download 305
visibility 509
2
Article Metrics
Views
305
Download
509
Citations
Crossref
2

Scopus
0

The Influence of Teacher Efficacy on Education Quality: A Meta-Analysis

education quality meta-analysis study teacher efficacy

Ratna Hidayah , Muhammad Nur Wangid , Wuri Wuryandani , Moh Salimi


...

This research aims to prove the influence of teacher efficacy on learning quality with quantitative meta-analysis. The eligibility criteria in this study include: (a) The publication can be searched in Google Scholar, ERIC, DOAJ, Research Gate, and or ScienceDirect; (b) The publication is indexed in Scopus, WoS, SINTA (a portal indexing journal managed by the Ministry of Education and Culture of the Republic of Indonesia, equivalent to DOAJ and Index Copernicus), DOAJ, Index Copernicus, and at least they must be indexed in Google Scholar; (c) The topic of the studies must be relevant; (d) The studies must be carried out in the 2014-2023 year range; (e) The publication must have a value of (r), (t) or (F); (f) The studies have a magnitude of N ≥ 20. This study used the JASP application for data analysis. The results showed that: (a) the 40 studies analyzed were heterogeneous and normally distributed; (b) the influence of teacher efficacy on education quality is classified as strong (p < 0.05; rRE = 0.800); (c) publication bias was not detected. This study concluded that there is a strong influence of teacher efficacy on education quality.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.9.2.435
Pages: 435-450
cloud_download 417
visibility 673
0
Article Metrics
Views
417
Download
673
Citations
Crossref
0

Scopus
0

...

Private universities in Indonesia need to urgently enhance the lecturers' organizational citizenship behavior (OCB), especially in overcoming a transition period of learning patterns after the COVID-19 pandemic from online to offline. Therefore, this research explores employability, personality, and talent management affect OCB and proves job involvement mediates employability, personality, and talent management influences OCB. It was conducted through a survey using a Likert scale questionnaire with 230 participants of lecturers from Indonesian private universities. Path analysis supplemented by descriptive and correlational analysis was used as a data analysis technique. The results showed that employability, personality, talent management, and job involvement significantly affect OCB. In addition, job involvement mediates employability, personality, talent management influences OCB. Therefore, a new empirical model regarding employability, personality, and talent management affect OCB with job involvement mediation was developed. Accordingly, researchers and practitioners can utilize for the model in their future activities.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.9.3.463
Pages: 463-476
cloud_download 326
visibility 775
0
Article Metrics
Views
326
Download
775
Citations
Crossref
0

Scopus
0

Revolutionizing Education: Navigating the New Landscape Post-COVID-19: A Scoping Review

covid-19 impact new landscape scoping review

Abdul Fattah Mat Nang , Siti Mistima Maat , Muhammad Sofwan Mahmud


...

Education systems worldwide have been significantly disrupted due to the COVID-19 pandemic, creating an immediate need for a revamp of conventional teaching and learning techniques. To explore how this has affected the educational landscape, a scoping review was conducted. This scoping review aimed to examine the changes that occurred in the education field and to explore how it has transformed the educational landscape review. Using Arksey and O'Malley's methodology, 51 articles were selected for analysis from two leading databases: Scopus and Web of Science. All chosen articles were then subjected to thematic analysis. Three main aspects impacted by this global event were uncovered, which are technological advancements and digital transformation, changes in pedagogy and teaching methods, and mental health and well-being issues. This scoping review provides valuable insights into one of the most critical sectors affected by COVID-19, which can assist with planning future strategies for similar crises.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.10.1.819
Pages: 19-33
cloud_download 224
visibility 1194
2
Article Metrics
Views
224
Download
1194
Citations
Crossref
2

Scopus
0

...