logo logo International Journal of Educational Methodology

IJEM is a leading, peer-reviewed, open access, research journal that provides an online forum for studies in education, by and for scholars and practitioners, worldwide.

Subscribe to

Receive Email Alerts

for special events, calls for papers, and professional development opportunities.

Subscribe

Publisher (HQ)

RHAPSODE
Eurasian Society of Educational Research
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, HA4 7AE, UK
RHAPSODE
Headquarters
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, HA4 7AE, UK

' Rasch model' Search Results



...

Assessment for Learning (AfL) may be conceptualized as minute-to-minute, day-by-day interactions between learners and teachers with the improvement of learning as the principal focus. This paper traces the development of an AfL measurement instrument (scale) that can be used for research purposes prior to, during and following professional development in the area. Rasch measurement procedures were applied to data drawn from a convenience sample of 594 teachers from 44 elementary schools in Ireland to create a scale consisting of 20 items distributed across four key AfL assessment strategies: learning intentions and success criteria, questioning and classroom discussion, feedback, and peer-and self-assessment.  This scale, the Assessment for Learning Measurement instrument (AfLMi), has good psychometric properties and is interpretable in a way that makes it potentially useful during system wide improvement initiatives focused on AfL.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.3.2.103
Pages: 103-115
cloud_download 1525
visibility 2318
6
Article Metrics
Views
1525
Download
2318
Citations
Crossref
6

...

This research was conducted in order to determine whether math anxiety was effective in the selection of secondary school students. This research, in which the mixed method was adopted, was conducted in a secondary school at Siirt. The participants (157 pupils) were determined by convenient sampling method from the four different classes (two 5th grade and two 8th grade). Math anxiety levels of the students were determined by the Mathematics Anxiety Scale. Sociometry technique was used to determine the informal friends groups in each class. For this purpose, a friend preference form was used. Students' friends preferences were transformed into data matrix and Hierarchical Clustering Analysis was used to form informal friends groups for each class. Math anxiety scores of informal groups were compared with Kruskal Wallis test. Accordingly, there were significant differences between the mathematical scores of the informal groups in the branches of the 5th and 8th grades. This finding was evaluated that mathematics anxiety may be a factor in the selection of friends.  

description Abstract
visibility View cloud_download PDF
10.12973/ijem.5.1.123
Pages: 109-116
cloud_download 536
visibility 1017
2
Article Metrics
Views
536
Download
1017
Citations
Crossref
2

Scopus
0

...

Positive attitude towards statistics is a desirable aspect in developing statistical thinking and understanding statistical concept. The attitude towards statistics instrument in previous study on rural school students lacked evidence in the validity analysis. Therefore, there is a need to provide a valid instrument that can assess rural secondary school students’ attitude toward statistics. For this purpose, this study was carried out to investigate the validity and reliability analysis of the Survey Attitude towards Statistics (SATS-36) instrument from a sample of rural secondary school students. The SATS-36 is a 7-point Likert type scale questionnaire, used to measure students’ attitude towards statistics. The SATS-36 instrument was distributed to 217 Tenth grade science stream students from a rural district in Sabah, Malaysia, which comprised of 66 (30.4%) boys and 151 (69.6%) girls. A second order Confirmatory Factor Analysis (CFA) was carried out to analyze the validity of the SATS-36 instrument as well as to confirm the 6-factor model of SATS-36. The reliability of SATS-36 instrument was assessed through the Cronbach’s Alpha value. Overall, the analysis showed that the SATS-36 instrument shows favorable indices for both its validity and reliability. Thus, it can be concluded that the SATS-36 was a valid and reliable instrument for measuring students’ attitude towards statistics among rural science stream secondary school students.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.5.4.651
Pages: 651-661
cloud_download 1765
visibility 2812
21
Article Metrics
Views
1765
Download
2812
Citations
Crossref
21

Scopus
14

...

Two new instruments were created to assess secondary students’ (ages 14-18) spatial learning attitudes and their interest in science and technology, related careers ideas and perceptions about geospatial technologies. These instruments were designed to evaluate the outcomes of a geospatial learning curriculum project. During a two-year period, we explored the use of these instruments during the prototype testing and pilot testing of a series of socio-environmental science investigations. The instruments were implemented with 664 ninth grade urban students from a population traditionally underrepresented in STEM-related fields. Both classical and Rasch analyses were conducted each year to optimize the instruments. The resulting 24-item Student Interest in Science, Technology and Geospatial Technology (STEM-GEO) measure and 9-item Spatial Learning Attitudes (SLA) measure had high internal consistency reliabilities (Cronbach’s Alpha) as well as acceptable Rasch reliabilities. Content validity and construct validity evidence were also summarized and discussed.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.6.1.67
Pages: 67-81
cloud_download 772
visibility 1392
6
Article Metrics
Views
772
Download
1392
Citations
Crossref
6

Scopus
0

...

Kelley’s Discrimination Index (DI) is a simple and robust, classical non-parametric short-cut to estimate the item discrimination power (IDP) in the practical educational settings. Unlike item–total correlation, DI can reach the ultimate values of +1 and ‒1, and it is stable against the outliers. Because of the computational easiness, DI is specifically suitable for the rough estimation where the sophisticated tools for item analysis such as IRT modelling are not available as is usual, for example, in the classroom testing. Unlike most of the other traditional indices for IDP, DI uses only the extreme cases of the ordered dataset in the estimation. One deficiency of DI is that it suits only for dichotomous datasets. This article generalizes DI to allow polytomous dataset and flexible cut-offs for selecting the extreme cases. A new algorithm based on the concept of the characteristic vector of the item is introduced to compute the generalized DI (GDI). A new visual method for item analysis, the cut-off curve, is introduced based on the procedure called exhaustive splitting.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.6.2.237
Pages: 237 - 258
cloud_download 1020
visibility 1640
6
Article Metrics
Views
1020
Download
1640
Citations
Crossref
6

Scopus
0

...

Progress monitoring of academic achievement is an essential element to prevent learning disorders. A prominent approach is curriculum-based measurement (CBM). Various studies have documented positive effects of CBM on students’ achievement. Nevertheless, the use of CBM is associated with additional work for teachers. The use of tablets may be of help here. Yet, although many advantages of computer- or tablet-based assessments are being discussed in the literature (e. g. innovative item formats, adaptive testing, automated scoring and feedback), there are still concerns regarding the comparability of different assessment modes (paper-pencil vs. tablet). In the study presented, we analyze the CBM data of 98 fourth graders. They processed the exact same computation items once with paper and pen and once in a tablet application. The analyses point to comparable results in the test modes, although some significant deviations can be found at item level. In addition, the children report perceived benefits when working with the tablet.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.6.4.669
Pages: 669-680
cloud_download 1227
visibility 1917
13
Article Metrics
Views
1227
Download
1917
Citations
Crossref
13

Scopus
0

...

Although Goodman–Kruskal gamma (G) is used relatively rarely it has promising potential as a coefficient of association in educational settings.  Characteristics of G are studied in three sub-studies related to educational measurement settings. G appears to be unexpectedly appealing as an estimator of association between an item and a score because it strictly indicates the probability to get a correct answer in the test item given the score, and it accurately produces perfect latent association irrespective of distributions, degrees of freedom, number of tied pairs and tied values in the variables, or the difficulty levels in the items. However, it underestimates the association in an obvious manner when the number of categories in the item is more than four. Towards this, a dimension-corrected G (G2) is proposed and its characteristics are studied. Both G and G2 appear to be promising alternatives in measurement modelling settings, G with binary items and G2 with binary, polytomous and mixed datasets.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.1.95
Pages: 95-118
cloud_download 967
visibility 1338
10
Article Metrics
Views
967
Download
1338
Citations
Crossref
10

Scopus
0

...

The purpose of the study is to examine pre-service teachers' impromptu speaking skills on the basis of the evaluations of the instructor, peers and their own. The study employed a descriptive case study design, one of the qualitative research methods. A total of 23 pre-service math teachers taking the course of Art of Effective Speech in a state university in Turkey in the 2016-2017 academic year participated in the study. The data of the study were collected through the observations of the researcher and pre-service teachers. Descriptive analysis was used in the analysis of the data. As a result of the study, it was found that in most of the observation items, the pre-service teachers found themselves inadequate in terms of impromptu speaking skills while they were found to be adequate by their peers and instructor. In addition, it was revealed that the pre-service teachers found themselves inadequate in some items related to the use of voice while they found themselves adequate in most of the items related to articulation/diction and body language and in all of the items related to communication. However, while the instructor observed that the pre-service teachers were generally competent in all the sub-dimensions, she determined that they needed improvement in the sub-dimensions of eye contact, pausing at the appropriate place and speaking without repeating words.  

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.2.261
Pages: 261-277
cloud_download 739
visibility 1121
0
Article Metrics
Views
739
Download
1121
Citations
Crossref
0

Scopus
0

...

This study aims to produce empirical evidence of the validity and reliability of instrument items for the competency framework of agricultural teaching staff in Malaysian agricultural vocational colleges. The validity and reliability of the framework were analyzed using Rasch Model Measurement assisted by Winsteps 3.72 software. This research instrument contained 116 items, which was distributed to 30 instructors at the Teluk Intan Agricultural Vocational College, Malaysia. The selection of respondents was made by strata random where the researcher makes the strata of the population according to the percentage and then selects randomly based on the desired percentage. Validity analysis of the instrument was done through four functional testings. For reliability and separation of respondents, it was found that the individual reliability value was very good and acceptable. The results of the item polarity analysis detected no negative value (-) in the Point Measure Correlation value. Item matching analysis found that 11 items had to be dropped as they failed to meet the required conditions. From the analysis on local dependence that determines dependent items based on the standardized residual correlation value, it was discovered that the correlation value for the items used was detected; 13 items need attention. The results of the data analysis checking the functionality of the items suggested that some items should be dropped. The omission of these items has provided evidence that the instrument of competence of agricultural instructors is crucial to have a high level of validity and reliability for use in actual studies.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.3.411
Pages: 411-420
cloud_download 457
visibility 822
2
Article Metrics
Views
457
Download
822
Citations
Crossref
2

Scopus
2

Developing Competency Evaluation of Pre-service Science Teachers in Industrial Revolution 4.0: Revealing Pedagogic and Professional Competencies

industrial revolution rasch model teacher competence test development

Endang Susantini , Badrun Kartowagiran , Syukrul Hamdi , Samsul Hadi , Amat Jaedun , I Gede Astra Wesnawa , Dadang Sunendar , Lukman Abdul Rauf Laliyo


...

This study aimed to develop an instrument to assess science teacher candidates’ professional and pedagogical competence in the Industrial revolution 4.0. The instrument consisted of 30 questions and was used in the main study, which was analyzed using the Rasch model to unravel the reliability and empirical validity. The questions were developed based on a predetermined grid including the skills and literacy aspects used in the industrial revolution 4.0. The 30 revised questions were then tested on 60 students of Science Education at two State universities in Indonesia who were in their third year of study times. The Rasch model was employed to test its reliability and empirical validity that included Wright map analysis, item difficulty level, distractor analysis, and item suitability with the Rasch model. The results showed that the reliability value of the professional aspect was .95 and classified as an excellent category. Moreover, the pedagogic aspect obtained .93 and was classified as a very good category. Only one question was the most difficult and did not fit the Rasch model, while the others already fitted. This reliable and valid instrument is suggested to be useful in assessing pre-service science teachers’ competence.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.2.347
Pages: 347-362
cloud_download 479
visibility 946
2
Article Metrics
Views
479
Download
946
Citations
Crossref
2

Scopus
1

Observational Record and Self-Report of Teacher-Student Performance in High School Lessons

didactic interaction direct observation methodology verbal self-reports teacher performance criteria student performance criteria

Aldo Bazán-Ramírez , Néstor Miguel Velarde-Corrales , María Elena Rodríguez-Pérez , Jorge Guerrero-Barrios , Roberta Brita Anaya-González


...

There are different strategies to analyze teacher and student performance when they interact with each other in class. The most used strategies are direct observation and verbal reports. Even though what is observed or reported depends on theoretical frameworks regarding didactic interactions, these must be related to teacher functions such as supervision, providing feedback, and evaluation of student performance. In this study, instruments for observational recording and verbal reports were developed and validated considering teacher functions and their student performance counterparts to compare the degree of correspondence or divergence between data gathered from both strategies. 135 students enrolled in a science class and their teachers participated. The class was taught in a public high school located in center/south Mexico. Classes were videotaped and the corresponding observational records were analyzed. Two months later, verbal reports were administered to students and teachers. Coincidences and differences that were found revealed that observer-observe interaction is conditioned by social norms. These results were interpreted considering the notion of silence as a communicative element.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.3.479
Pages: 479-491
cloud_download 653
visibility 1272
2
Article Metrics
Views
653
Download
1272
Citations
Crossref
2

Scopus
1

...

This research analyzed the involvement of teachers, parents, and school committees in improving scientific attitudes in science learning using Rasch model analysis. A survey method was used in this quantitative study. Participants in the study were selected using a purposive sample of 174 teachers, parents, and school committees in Sleman and Kebumen Regencies, Indonesia. A questionnaire was used in data collection to determine the involvement of teachers, parents, and school committees in improving scientific attitudes toward science learning. The questionnaires were completed using a Likert scale of 1-4, and the data were then analyzed using the Rasch model. The result showed that all participants were the average logit items (+1.03 logit). The reliability was 0.89, indicating a positive response to improving students' scientific attitudes. The results of the Rasch model analysis suggested that the involvement of parents, teachers, and school committees in improving scientific attitudes differed according to their roles. Each instrument element was analyzed in more detail in the Rasch model. Participants' roles were reflected in the specific involvements of teachers in learning, parents at home with children, and school committees participating in school policy-making.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.4.783
Pages: 783-794
cloud_download 502
visibility 7625
0
Article Metrics
Views
502
Download
7625
Citations
Crossref
0

Scopus
0

...

The purpose of this study was to establish the factor structure and dimensionality of the Metacognitive Orientation Learning Environment Scale – Science (MOLES-S) in the Thai context. The metacognitive orientation of a science classroom learning environment is defined as the extent to which psychosocial conditions that are known to enhance students’ metacognition are evident in a specific science classroom. This study builds on earlier work in the research areas of science education, metacognition, and learning environments. A sample of 5418 Thai science students in grades 10 to 12, from 40 schools across Thailand, completed the MOLES-S that had been translated into Thai. Exploratory factor analysis was undertaken and Rasch analysis was used to calibrate the scale and explore its dimensionality. The results suggest that the MOLES-S(T), where (T) represents Thailand, has the same factor structure as the original MOLES-S, is reliable, and can be used with confidence in research into metacognition in Thai high school science classrooms.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.4.805
Pages: 805-818
cloud_download 340
visibility 701
2
Article Metrics
Views
340
Download
701
Citations
Crossref
2

Scopus
1

Graded Response Models on the Curiosity Measurement of Elementary School Students

curiosity measurement elementary school graded response models

Herwin Herwin , Riana Nurhayati , Aprilia Tina Lidyasari , Augusto da Costa


...

Curiosity is one of the most important characters for elementary school students. However, the facts in the field show that the measurement model used by the teacher to identify the student's curiosity is not yet available in a standardized manner. This study aims to develop a model for measuring the curiosity of elementary school students using the graded response model (GRM) approach. This research uses quantitative method with descriptive type. The research sample used was 236 elementary school students who were randomly selected. Data were collected using a questionnaire of 16 statement items using a Likert scale approach. The data were analyzed using the response item theory approach with the GRM. The results showed that the model for measuring student curiosity in elementary schools had good location parameters, a good discriminant index, a fairly good information function with a small estimation error. The curiosity measurement model in this study can be used as an alternative for teachers to identify students' curiosity in elementary schools.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.9.1.53
Pages: 53-62
cloud_download 442
visibility 1059
2
Article Metrics
Views
442
Download
1059
Citations
Crossref
2

Scopus
0

...

This study aims to examine the 9th-grade 2018 physics curriculum according to various criteria. A cross-sectional survey model was used. The sample consists of 36 physics teachers working in various high schools in 12 regions of Turkey in the 2022-2023 academic year. The data of the study were collected via the “9th-grade 2018 physics curriculum Evaluation Form”. The data collected via the evaluation form were determined with the multilevel Rasch analysis program. The results of the research revealed that the criteria determined in the evaluation of the 9th-grade physics curriculum differed in terms of strictness and generosity. In addition, the quantitative data analysis revealed that the physics teachers mostly comply with the criteria set in the program while they disapprove of some criteria. The physics teachers reported some deficiencies in the objectives, content, and educational status of the elements included in the program. In this context, it is recommended that the achievements of the 9th-grade 2018 physics curriculum be reviewed in line with the evaluations of the stakeholders related to the subject.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.9.1.271
Pages: 271-281
cloud_download 283
visibility 822
0
Article Metrics
Views
283
Download
822
Citations
Crossref
0

Scopus
0

...

The purposes of this research are (a) to make an instrument to measure the achievement of project-based digitalpreneurship learning in students; (b) to describe the quality of the project-based digitalpreneurship learning achievement assessment instrument for vocational high school students; (c) to measure the competence and skills. This study employed to research and development as its methodology, using a combination procedure between Oriondo and Antonio and, Mardapi. The development procedure includes three stages: instrument design, instrument testing, and measurement. A total of 795 students who participated in the study at 5 vocational high schools in Yogyakarta's special region served as responders. Data analysis in this development uses the content validity of the formula Aiken V Index, confirmatory factor analysis establishes the construct's validity, and construct reliability. Measurement instrument development. Research findings that (a) the instrument is ready to be used in the measurement; (b) the quality of the project-based digitalpreneruship learning achievement assessment instrument for vocational high school students is well tested. This is evidenced by the validity test which has a high score >.8; The proof of construct validity in this study using CFA > .5; GOF chi-square value with a critical value of df = 289, X2 = 323, p-value with a critical value of .079, RMSEA with a critical value of RMSEA .019 (≤ .08), SMRM with a critical value of SRMR 0.030 (≤ .05), CFI with a critical value of CFI .990 (> .97), and an NFI with a critical value of NFI .989 ( > .90); (c) the measurement results are identified in the process that needs to be improved again regarding the digitalpreneurship skills of vocational high school students.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.9.1.283
Pages: 283-295
cloud_download 374
visibility 694
0
Article Metrics
Views
374
Download
694
Citations
Crossref
0

Scopus
0

...

This research article focuses on the design and validation of a questionnaire to analyse future teachers' perceptions of professional skills through the use of Augmented Reality (AR) in higher education, specifically for students in the field of Educational Sciences. The sample consisted of 575 students of Early Childhood Education, Primary Education and Pedagogy during the academic year (2021/2022). The focus of this study is to authenticate a questionnaire that measures the influence of Augmented Reality (AR) on aspects such as situated learning, motivation, and the necessary instructional preparations for the successful integration of AR within classroom educational encounters. The questionnaire is an online Likert-type scale developed based on three dimensions: situated learning, motivation and training. The data were analysed using the Statistical Package for the Social Sciences (SPSS) version 25 and JASP 0.17.1. The questionnaire met the standards recommended for validation. However, improvements to the instrument are suggested. In conclusion, validation of instruments is necessary to gain a rigorous understanding of the impact of new learning environments.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.9.4.787
Pages: 787-799
cloud_download 1598
visibility 1599
0
Article Metrics
Views
1598
Download
1599
Citations
Crossref
0

Scopus
0

...

The role of artificial intelligence (AI) in education remains incompletely understood, demanding further evaluation and the creation of robust assessment tools. Despite previous attempts to measure AI's impact in education, existing studies have limitations. This research aimed to develop and validate an assessment instrument for gauging AI effects in higher education. Employing various analytical methods, including Exploratory Factor Analysis, Confirmatory Factor Analysis, and Rasch Analysis, the initial 70-item instrument covered seven constructs. Administered to 635 students at Nueva Ecija University of Science and Technology – Gabaldon campus, content validity was assessed using the Lawshe method. After eliminating 19 items through EFA and CFA, Rasch analysis confirmed the construct validity and led to the removal of three more items. The final 48-item instrument, categorized into learning experiences, academic performance, career guidance, motivation, self-reliance, social interactions, and AI dependency, emerged as a valid and reliable tool for assessing AI's impact on higher education, especially among college students.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.10.2.997
Pages: 197-211
cloud_download 611
visibility 2505
0
Article Metrics
Views
611
Download
2505
Citations
Crossref
0

...

This study evaluates the effectiveness of a twelve-week Inquiry-Based Science (IBS) program on enhancing science process skills and scientific knowledge among preschool children in Morocco. Conducted in a quasi-experimental setting, it involved 105 children (M = 60.46 months, SD = 4.32), with 37 in the IBS group and 68 in the control group. The program utilized the 5Es instructional model and the Engineering Design Process (EDP) to engage children in active, hands-on learning experiences. Statistical analysis demonstrated that the IBS group achieved substantial improvements in both science process skills and scientific knowledge relative to the control group, with between-group effect sizes (Cohen’s d) ranging from 1.02 and 2.31. These findings highlight the significant impact of structured inquiry-based approaches in early childhood education. The study underscores the need for integrating such methods into the preschool curriculum to foster scientific understanding and skills from a young age, thereby better preparing Moroccan children for future academic and professional challenges. The results advocate for educational stakeholders to consider adopting inquiry-based learning frameworks to enhance the overall quality of early childhood education in Morocco.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.10.4.543
Pages: 543-558
cloud_download 150
visibility 656
0
Article Metrics
Views
150
Download
656
Citations
Crossref
0

...

The global COVID-19 pandemic has changed human lives in myriad ways and one of its impacts has been the significant transition to distance learning that has occurred at all levels of education around the world. In this emerging system, teachers and parents have proved ill-equipped for the sudden changes involved, and a number of critical difficulties and issues pertaining to increased parental involvement have been exposed. Parents have been called upon to engage more effectively with the education of their children and to support them in various types and levels of distance learning. Parents have always formed a critical link between children and schools; however, alongside teachers, they have recently been required to assume new and unfamiliar roles and responsibilities, working together within an online educational environment. This study investigates the extent to which the transition to distance learning has affected the partnership between schools and families of students with disabilities. A qualitative research approach has been adopted, using semi-structured interviews with special education teachers. The findings are predominantly positive, with teachers believing that distance learning creates opportunities for developing stronger connections between schools and families, enabling more personalised communication, greater capacity and confidence within families, as well as opportunities for enhancing connections with the wider community.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.10.4.645
Pages: 645-654
cloud_download 55
visibility 108
0
Article Metrics
Views
55
Download
108
Citations
Crossref
0

...