logo logo International Journal of Educational Methodology

IJEM is a leading, peer-reviewed, open access, research journal that provides an online forum for studies in education, by and for scholars and practitioners, worldwide.

Subscribe to

Receive Email Alerts

for special events, calls for papers, and professional development opportunities.

Subscribe

Publisher (HQ)

RHAPSODE
Eurasian Society of Educational Research
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, HA4 7AE, UK
RHAPSODE
Headquarters
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, HA4 7AE, UK

' validity' Search Results

...

Time management for educational leaders has remained highly relevant to scholars, policymakers and practitioners. We analyzed survey responses from 98 public high school principals to examine the congruency between average total hours they worked per week against the sum total of the average hours worked per week in each of five distinct categories of leadership tasks. The observed congruence was 0.32, while Cohen’s kappa coefficient was 0.10. Female principals tended to underreport, and male principals tended to overreport, total work time. Principals with doctorate degrees exhibited higher congruence than those without, and overreporting was inversely related to highest degree. Principals in charge of large teaching staffs were more likely than their counterparts to be congruent and less likely to overreport total work time. Self-report appears to be an inaccurate method to measure time use among high school principals. If time use is a key component of the quality of principal leadership, more detailed and robust techniques for collecting time use data should be utilized in future studies.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.1.53
Pages: 53-65
cloud_download 507
visibility 940
0
Article Metrics
Views
507
Download
940
Citations
Crossref
0

Scopus
0

...

Although Goodman–Kruskal gamma (G) is used relatively rarely it has promising potential as a coefficient of association in educational settings.  Characteristics of G are studied in three sub-studies related to educational measurement settings. G appears to be unexpectedly appealing as an estimator of association between an item and a score because it strictly indicates the probability to get a correct answer in the test item given the score, and it accurately produces perfect latent association irrespective of distributions, degrees of freedom, number of tied pairs and tied values in the variables, or the difficulty levels in the items. However, it underestimates the association in an obvious manner when the number of categories in the item is more than four. Towards this, a dimension-corrected G (G2) is proposed and its characteristics are studied. Both G and G2 appear to be promising alternatives in measurement modelling settings, G with binary items and G2 with binary, polytomous and mixed datasets.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.1.95
Pages: 95-118
cloud_download 967
visibility 1348
10
Article Metrics
Views
967
Download
1348
Citations
Crossref
10

Scopus
0

...

The aim of this study is to examine the motivation levels and future expectations of preservice teachers studying in Mathematics and Science Teaching Departments comparatively. The population of study consisted of preservice teachers studying at Mathematics and Science Teaching Departments at Education Faculties of Mehmet Akif Ersoy University and Akdeniz University. The sample consisted of 470 preservice teachers. In research, the correlational survey model was used. Research data were collected with "Adult Motivation Scale" and "Future Expectations Scale". In data analyzing, statistics package program was used. Accordingly, t-test was used for variables with two categories and One Factor Analysis of Variance (ANOVA) was used for more than two categories. Sheffe multiple comparison test was used if it was significant. Pearson Correlation was used to determine whether there is a significant relationship between preservice teachers' motivation levels and future expectations. According to analysis results, motivation levels of preservice teachers were found to be high. Likewise, it was concluded that preservice teachers' expectations for future were highly positive. In preservice teachers' motivation levels and expectations for future, gender, major, type of high school they graduated and major satisfaction they study were found to be effective.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.1.119
Pages: 119-136
cloud_download 689
visibility 857
2
Article Metrics
Views
689
Download
857
Citations
Crossref
2

Scopus
0

...

The aim of this cross-sectional study is to determine the fundamental motor skills (FMS) proficiency of children with mild intellectual disabled (MID) and to compare their FMS proficiencies in terms of age and gender. This study has three purposes. These are a) Defining the FMS proficiencies of the participants, b) Examining the FMS proficiencies of the participants in terms of gender variable, c) Examining the FMS proficiencies of the participants in terms of the age variable. Participants consisted of 122 MID students aged 7-10 years (M = 8.25, SD = 0.92). FMS proficiency was evaluated with the Gross Motor Development Test-Second Edition (TGMD-2). Independent Samples t test and ANOVA test were used to test the differences between groups. As a result: a) It was observed that the participants could not perform the FMS at the mastery level. Participants failed to demonstrate FMS proficiency appropriate for their age and showed delays in FMS compared to the TGMD-2 normative sample. Most of the participants performed “below average” and “poor” for LOC and OC skills. It was determined that the participants obtained higher scores in LOC subtest compared to OC subtest, b) It was determined that males were more proficiency in FMS and subtests than females, c) No difference was found in FMS proficiency in terms of age. These results show that opportunities need to be increased to develop the FMS proficiency.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.2.225
Pages: 225-233
cloud_download 859
visibility 1324
2
Article Metrics
Views
859
Download
1324
Citations
Crossref
2

Scopus
0

...

The objectives of this research were to: 1) Study the suitability of the indicators to be included in the model, 2) Test the consistency of the model developed from the theories and research studies’ empirical data, 3) Evaluate reliability value of the main components, the sub-components and other related indicators. The population used in the research were the teachers in the schools under the local administrative organization of Thailand. The multistage random sampling was used for the selection of 660 samples from a total population of 30,359 teachers across the country. The following results were observed: 1) All of the 52 indicators used in the research were appropriate according to the specified criteria, 2) The theoretical model was found to have been consistent with the empirical data. All of the statistical figures including; Relative Chi-Square, Root Mean Square Error of Approximation, Goodness-of-Fit Index, Adjusted Goodness-of-Fit Index, Comparative Fit Index, and Normed Fit Index: NFI, were found to have met with the specified criteria in both the first and the second confirmation factor analyzes, and 3) The primary element’s factor loading was between 0.73 to 1.48, which is higher than the criteria of 0.70, the sub-element’s factor loading was between 0.67 to 1.72 and the indicators weight was between 0.68 to 1.37, which is higher than the criteria of 0.30. These results indicate that the theoretical model developed in this research can be effectively used with construct validity for the development of the targeted samples in a research study.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.2.235
Pages: 235-247
cloud_download 274
visibility 882
2
Article Metrics
Views
274
Download
882
Citations
Crossref
2

Scopus
0

...

The purpose of the study is to examine pre-service teachers' impromptu speaking skills on the basis of the evaluations of the instructor, peers and their own. The study employed a descriptive case study design, one of the qualitative research methods. A total of 23 pre-service math teachers taking the course of Art of Effective Speech in a state university in Turkey in the 2016-2017 academic year participated in the study. The data of the study were collected through the observations of the researcher and pre-service teachers. Descriptive analysis was used in the analysis of the data. As a result of the study, it was found that in most of the observation items, the pre-service teachers found themselves inadequate in terms of impromptu speaking skills while they were found to be adequate by their peers and instructor. In addition, it was revealed that the pre-service teachers found themselves inadequate in some items related to the use of voice while they found themselves adequate in most of the items related to articulation/diction and body language and in all of the items related to communication. However, while the instructor observed that the pre-service teachers were generally competent in all the sub-dimensions, she determined that they needed improvement in the sub-dimensions of eye contact, pausing at the appropriate place and speaking without repeating words.  

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.2.261
Pages: 261-277
cloud_download 739
visibility 1122
0
Article Metrics
Views
739
Download
1122
Citations
Crossref
0

Scopus
0

Presenting the Meta-Performance Test, a Metacognitive Battery based on Performance

metacognition assessment content validity performance tests

Marcio Alexander Castillo-Diaz , Cristiano Mauro Assis Gomes


...

The self-report and think-aloud approaches are the two dominant methodologies to measure metacognition. This is problematic, since they generate respondent and confirmation biases, respectively. The Meta-Performance Test is an innovative battery, which evaluates metacognition based on the respondent's performance, mitigating the aforementioned biases. The Meta-Performance Test consists of two tests, the Meta-text, which evaluates metacognition in the domain of reading comprehension, and Meta-number, in the domain of arithmetic expressions solving. The main focus of this article is to present the development of the battery, in terms of its conceptual basis, development strategies and structure. Evidence of its content validity is also presented, through the evaluation of three experts in metacognition, two experts in Spanish language, two experts in mathematics and five students who represent the target population. The results of the judges' evaluations attested to the Meta-Performance Test content validity, and the target population declared that both the battery understanding and taking are adequate. Contributions and future research perspectives of the Meta-Performance Test in the field of metacognition are discussed.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.2.289
Pages: 289-303
cloud_download 1473
visibility 2693
2
Article Metrics
Views
1473
Download
2693
Citations
Crossref
2

Scopus
2

...

The research aims were to examine the relationship among psychological resilience, patience, and happiness levels of physical education teachers employing in İzmir, Afyonkarahisar, and Muğla provinces in the Aegean Region and was to explain whether psychological resilience and patience levels predict happiness. The research was a descriptive study in the relational scanning model. The study participants consisted of 336 PE teachers, 182 (54.2%) were males, and 154 (45.8%) were females.. The data were obtained using the Brief Resilience Scale (BRS), Patience Scale and Oxford Happiness Questionnaire. In the analysis of data were used SPSS 25 statistical program. The analysis of the data descriptive statistics, correlation, and statistical regression methods were used. As a result of the research, it was determined that the psychological resilience, patience, and happiness levels were at medium levels according to the average score the PE teachers got from the scales. It was found that there is a moderate positive relationship between PE teachers' psychological resilience, patience, and happiness levels, and psychological resilience and patience levels are a significant predictor of happiness.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.2.335
Pages: 335-351
cloud_download 913
visibility 1359
6
Article Metrics
Views
913
Download
1359
Citations
Crossref
6

Scopus
0

...

The aim of the research was to investigate the relation between middle school students' perceptions of school climate and school motivation, whether school climate perceptions have a significant power on school motivation as well as to see if those perceptions and motivation differ significantly depending on gender, grade level, and school location variables. The sample of the study consisted of 674 middle school students studying in two state schools, which were located in the central district and village in Kosk province in Aydin in Turkey. Data were collected by using School Climate Perceptions Scale and School Motivation Scale with three questioned personal information form. Results showed that there were significant medium-level correlations between school climate perceptions and school motivation of middle school students. While grade-level variables had significant differences in both school climate perceptions and school motivation of middle school students, the location did not create a difference. On the other hand, gender had a significant difference only with school motivation. Finally, the model tested student-teacher relation significantly predicted 18% of the school motivations of middle school students.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.2.361
Pages: 361-372
cloud_download 593
visibility 1023
2
Article Metrics
Views
593
Download
1023
Citations
Crossref
2

Scopus
0

...

This study aimed at investigating the outcomes of the cooperation practices, which were utilized to enhance the quality of work-integrated learning at Nong Khai Technical College. The investigation covered the following three aspects: 1) the changes that had arisen from the development of specified indicators; 2) the learning that occurred, and 3) the body of knowledge, which had been obtained from the practice. A participatory action research methodology was adopted during two semesters. There were 19 teachers and 30 students involved in the project. The results of the study revealed three key features. Firstly, the post-practice evaluation in both the first and the second cycles was higher than in the pre-practice evaluation. Secondly, the researcher, research participants and the college learned from various issues of the practice. This learning included gaining an awareness of the importance of collaborative work, the importance of studying the theoretical perspective in order to enhance the existing knowledge and experiences, and the importance of planning, practice, observation, and reflection in comprehensive work. Finally, the knowledge gained was found to correlate with Kurt Lewin's Force-Field Analysis which consists of the following elements: 1) expected change, 2) driving factors for change, 3) resistance to change, and 4) overcoming resistance.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.3.387
Pages: 387-400
cloud_download 494
visibility 987
0
Article Metrics
Views
494
Download
987
Citations
Crossref
0

Scopus
0

...

This study aims to produce empirical evidence of the validity and reliability of instrument items for the competency framework of agricultural teaching staff in Malaysian agricultural vocational colleges. The validity and reliability of the framework were analyzed using Rasch Model Measurement assisted by Winsteps 3.72 software. This research instrument contained 116 items, which was distributed to 30 instructors at the Teluk Intan Agricultural Vocational College, Malaysia. The selection of respondents was made by strata random where the researcher makes the strata of the population according to the percentage and then selects randomly based on the desired percentage. Validity analysis of the instrument was done through four functional testings. For reliability and separation of respondents, it was found that the individual reliability value was very good and acceptable. The results of the item polarity analysis detected no negative value (-) in the Point Measure Correlation value. Item matching analysis found that 11 items had to be dropped as they failed to meet the required conditions. From the analysis on local dependence that determines dependent items based on the standardized residual correlation value, it was discovered that the correlation value for the items used was detected; 13 items need attention. The results of the data analysis checking the functionality of the items suggested that some items should be dropped. The omission of these items has provided evidence that the instrument of competence of agricultural instructors is crucial to have a high level of validity and reliability for use in actual studies.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.3.411
Pages: 411-420
cloud_download 457
visibility 822
2
Article Metrics
Views
457
Download
822
Citations
Crossref
2

Scopus
2

...

This article introduces the concept of the carrying capacity of data (CCD), defined as an integrated, evaluative judgment of the credibility of specific data-based inferences, informed by quantitative and qualitative analyses, leavened by experience. The sequential process of evaluating the CCD is represented schematically by a framework that can guide data analysis and statistical inference, as well as pedagogy. Aspects of each phase are illustrated with examples. A key initial activity in empirical work is data scrutiny, comprising consideration of data provenance and characteristics, as well as data limitations in light of the context and purpose of the study.  Relevant auxiliary information can contribute to evaluating the CCD, as can sensitivity analyses conducted at the modeling stage. It is argued that early courses in statistical methods, and the textbooks they rely on, typically give little emphasis to, or omit entirely, discussion of the importance of data scrutiny in scientific research. This inattention and lack of guided, practical experience leaves students unprepared for the real world of empirical studies. Instructors should both cultivate in their students a true respect for data and engage them in authentic empirical research involving real data, rather than the context-free data to which they are usually exposed.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.3.447
Pages: 447-463
cloud_download 421
visibility 901
2
Article Metrics
Views
421
Download
901
Citations
Crossref
2

Scopus
0

...

This study seeks to reveal the perceptions of pre-service visual arts teachers on social justice through art-based practices focused on social justice. Designing on visual phenomenology, this study was performed in the fall semester of the 2018-2019 academic year. Five different activities involving visual inquiries are presented to reveal the perceptions of the pre-service teachers on social justice. The research participants are 35 (13 male, 22 female) sophomore-level pre-service teachers. The data are obtained through course documents, reflective diaries and semi-structured interviews. The data are then analysed through content analysis; reliability and validity are ensured through triangulation. This study identifies four different themes: association, questioning, transformation and reflection. The findings show that the pre-service teachers questioned common issues related to social justice. It was observed in the activities performed in this study that the pre-service teachers identified the visual themes. They mentioned common social justice issues based on the things they experienced and their observations. These are such as women's rights, violence against women, children's rights, LGBT, animal rights, language and religion differences, income imbalance, racism, and discrimination. The issues they questioned were the direct expression of the individual experiences of the pre-service teachers through visuals.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.3.517
Pages: 517-545
cloud_download 542
visibility 944
2
Article Metrics
Views
542
Download
944
Citations
Crossref
2

Scopus
0

...

Response times are one of the important sources that provide information about the performance of individuals during a test process. The main purpose of this study is to show that survival models can be used in educational data. Accordingly, data sets of items measuring literacy, numeracy and problem-solving skills of the countries participating in Round 3 of the Programme for the International Assessment of Adult Competencies were used. Accelerated failure time models have been analyzed for each country and domain.  As a result of the analysis of the models in which various covariates are included as independent variables, and response time for giving correct answers is included as a dependent variable, it was found the associations between the covariates and response time for giving correct answers were concluded to vary from one domain to another or from one country to another. The results obtained from the present study have provided the educational stakeholders and practitioners with valuable information.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.4.571
Pages: 571-586
cloud_download 333
visibility 920
2
Article Metrics
Views
333
Download
920
Citations
Crossref
2

Scopus
0

...

Technical and pedagogical counseling as accompaniment benefits teachers’ development. However, there are information gaps on the specific impact of counseling with a socio-formative approach on both professionalization and the improvement of teaching practice. The objective is to analyze the relationship between these three elements. A cross-sectional study with a quantitative approach was employed. A validated questionnaire was applied to a representative sample of 212 teachers. The information analysis was carried out through statistics: descriptive, correlational, and linear regression, whose level of significance was: <.01-. 05. Teachers consider that technical and pedagogical counseling from socio-formation fosters the development of an ethical life project, promotes problem solving in their educational practice, collaborative work, metacognition, and entrepreneurship (92.78 ± 14.3). The correlational analysis showed a significant relationship between socio-formative pedagogical technical counseling and teaching practice, the latter of which was enhanced by the former. In the linear regression analysis, the best model of pedagogical technical counseling is made from socio-formation, which predicts a 71% improvement of teaching practice. As a result, this form of counseling benefits both professionalization and teaching practice through metacognition.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.1.1
Pages: 1-9
cloud_download 562
visibility 1200
0
Article Metrics
Views
562
Download
1200
Citations
Crossref
0

Scopus
0

...

This study examined the effect of Yunnan’s ethnic minority college students’ acculturation on their academic achievement under the risk of the Matthew effect. Additionally, the role played by learning motivation in the relationship between ethnic minority college students’ acculturation and academic achievement was explored. A total of 403 valid questionnaires were collected from four areas in Yunnan province, China. Consequently, the Acculturation Scale, Academic Achievement Scale, and Learning Motivation Scale were used for measurement materials. These items of scales were evaluated on a five-point Likert scale ranging from 1 (strongly disagree) to 5 (strongly agree). SPSS (statistical package for the social sciences) and AMOS (analysis of a moment structures) softwares were used for data analyses. In addition, items were analyzed through item analysis, confirmatory factor analysis, reliability analysis and regression analysis. These results indicated that ethnic minority college students with low acculturation and learning motivation or high acculturation and low learning motivation can become objects of the Matthew effect. However, this study also observed that in certain students, high acculturation and high learning motivation can prevent the Matthew effect. Thus, high acculturation is crucial for improving academic achievement in ethnic minority college students. A level of high learning motivation is a powerful moderator promoting the academic achievement of students with high acculturation.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.2.199
Pages: 199-210
cloud_download 470
visibility 814
2
Article Metrics
Views
470
Download
814
Citations
Crossref
2

Scopus
0

Effect of Thai Junior High Student Intercultural Competence on Resilience, Well-being, and Reading Attitudes

intercultural competence junior high student reading attitudes resilience well-being

Yuan-Cheng Chang , Anongkarat Bangsri , Chotikan Jabioon , Utumporn Pakdeewong


...

Students' intercultural competence and reading ability are an essential aspect of their education. Intercultural competence, defined as respect for the cultural views, beliefs, and traditions of others, is a necessary skill for effective and appropriate communication. Using a multidimensional model, this study investigated the effect of intercultural competence among Thai junior high school students on their resilience, well-being, and attitudes toward reading. A 2018 Program for International Student Assessment data set relating to 7,411 students from 289 schools in Thailand was analyzed using structural equation modeling. The research findings suggest that improved intercultural competence strengthens resilience, well-being, and attitudes toward reading.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.2.211
Pages: 211-219
cloud_download 424
visibility 809
2
Article Metrics
Views
424
Download
809
Citations
Crossref
2

Scopus
1

...

Due to the pandemic in many countries, schools were closed in 2020. Therefore, education was suspended, and distance education was started. During the Coronavirus disease (COVID-19) pandemic, teachers gave lessons online in virtual classrooms. In this study, Scale of Attitudes Towards Online Formative Assessment (S-AOFA) for teachers conducting online and distance courses was developed, and the teachers' attitudes were examined with respect to demographic variables. In the study conducted in the mixed-design method, qualitative and quantitative data were collected for the scale development and survey. Data were obtained from 369 teachers (science teacher, mathematics teacher, classroom teacher, and teachers in other fields) working in school in Turkey. S-AOFA was made up of 20 items and two factors as a five-point Likert-type. When the teachers' attitudes towards online formative assessment (AOFA) was examined, it was found that the mean for the factor of "Assessment Systems" was lower than that of the "Assessment Approaches". In addition, the findings revealed that there was no significant difference in the teachers' AOFA in terms of gender and that no significant difference existed in AOFA with respect to the school levels of the teachers (elementary, secondary and high school). Moreover, the results demonstrated that there was a low negative significant relationship between the teachers' AOFA and the number of students in which virtual lessons were given online. Lastly, there was a low level positive significant relationship between the teachers' AOFA and the in-class participation percentages of the students who were taught online in virtual classrooms. S-AOFA could be used by researchers in different studies in future.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.2.241
Pages: 241-257
cloud_download 425
visibility 853
2
Article Metrics
Views
425
Download
853
Citations
Crossref
2

Scopus
0

...

South Africa, like other countries in the world, went into lockdown due to the Coronavirus disease (COVID-19) which meant closure of venue-based exam centres, university libraries and academic offices for more than three months. This encounter forced higher institutions of learning to review and reconfigure their assessment practices and conduct alternative assessment practises like timed exams, take home exams, randomised multiple-choice examinations and an online portfolio. Over and above that South Africa experienced load shedding (interruptions to electricity supply) and connectivity challenges which impacted the online examinations. This paper explores the experiences of lecturers whilst administering online examination at a South African Open Distance e-Learning university during COVID-19. Data collected from the lecturers who administered online examination through semi-structured interviews. Thematic analyses were used to analyse the data. Lecturers reported on student challenges related to time allocation, exam security, internet connectivity and data access, digital incompetency and support received from the information communication technology (ICT) department. Academics’ reflection suggests that the system and students were not fully prepared and ready to write the online examination. The researchers propose continued technical and technological education and support for academics and students. Therefore, in line with these experiences, it is important to conduct further the research.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.2.275
Pages: 275-283
cloud_download 541
visibility 1071
14
Article Metrics
Views
541
Download
1071
Citations
Crossref
14

Scopus
8

...

This research’s aim was to explore the role of cognitive flexibility in mediating the effect of intrinsic motivation on the creativity of junior high school students. A creativity scale, an intrinsic motivation inventory and a cognitive flexibility inventory were utilized to investigate a sample of junior high school students in Shaanxi Province in western China. 765 valid questionnaires were collected and analyzed using the structural equation model (SEM). The SEM analysis showed that intrinsic motivation and cognitive flexibility have significantly positive impacts on junior high school students’ creativity. Furthermore, a full model revealed that cognitive alternatives and cognitive control mediate the relationship intrinsic motivation and creativity, and the mediation effect of cognitive alternatives is significantly greater than that of cognitive control. In general, the current research suggests that the impact of intrinsic motivation on junior high school students’ creativity is mediated by cognitive flexibility, and its results amplify prior scholars’ research results and give educators an inspiration how to cultivate creativity for the middle school students.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.2.297
Pages: 297-312
cloud_download 580
visibility 1037
2
Article Metrics
Views
580
Download
1037
Citations
Crossref
2

Scopus
0

...