' Rasch measurement model' Search Results
Measuring Teachers’ Assessment for Learning (AfL) Classroom Practices in Elementary Schools
assessment for learning measurement instrument rasch measurement formative assessment teacher professional development...
Assessment for Learning (AfL) may be conceptualized as minute-to-minute, day-by-day interactions between learners and teachers with the improvement of learning as the principal focus. This paper traces the development of an AfL measurement instrument (scale) that can be used for research purposes prior to, during and following professional development in the area. Rasch measurement procedures were applied to data drawn from a convenience sample of 594 teachers from 44 elementary schools in Ireland to create a scale consisting of 20 items distributed across four key AfL assessment strategies: learning intentions and success criteria, questioning and classroom discussion, feedback, and peer-and self-assessment. This scale, the Assessment for Learning Measurement instrument (AfLMi), has good psychometric properties and is interpretable in a way that makes it potentially useful during system wide improvement initiatives focused on AfL.
6
Investigating the Validity and Reliability of Survey Attitude towards Statistics Instrument among Rural Secondary School Students
attitude towards statistics confirmatory factor analysis rural schools validity and reliability of survey...
Positive attitude towards statistics is a desirable aspect in developing statistical thinking and understanding statistical concept. The attitude towards statistics instrument in previous study on rural school students lacked evidence in the validity analysis. Therefore, there is a need to provide a valid instrument that can assess rural secondary school students’ attitude toward statistics. For this purpose, this study was carried out to investigate the validity and reliability analysis of the Survey Attitude towards Statistics (SATS-36) instrument from a sample of rural secondary school students. The SATS-36 is a 7-point Likert type scale questionnaire, used to measure students’ attitude towards statistics. The SATS-36 instrument was distributed to 217 Tenth grade science stream students from a rural district in Sabah, Malaysia, which comprised of 66 (30.4%) boys and 151 (69.6%) girls. A second order Confirmatory Factor Analysis (CFA) was carried out to analyze the validity of the SATS-36 instrument as well as to confirm the 6-factor model of SATS-36. The reliability of SATS-36 instrument was assessed through the Cronbach’s Alpha value. Overall, the analysis showed that the SATS-36 instrument shows favorable indices for both its validity and reliability. Thus, it can be concluded that the SATS-36 was a valid and reliable instrument for measuring students’ attitude towards statistics among rural science stream secondary school students.
Tablet or Paper and Pen? Examining Mode Effects on German Elementary School Students’ Computation Skills with Curriculum-Based Measurements
progress monitoring curriculum-based measurements mode effects tablet elementary school...
Progress monitoring of academic achievement is an essential element to prevent learning disorders. A prominent approach is curriculum-based measurement (CBM). Various studies have documented positive effects of CBM on students’ achievement. Nevertheless, the use of CBM is associated with additional work for teachers. The use of tablets may be of help here. Yet, although many advantages of computer- or tablet-based assessments are being discussed in the literature (e. g. innovative item formats, adaptive testing, automated scoring and feedback), there are still concerns regarding the comparability of different assessment modes (paper-pencil vs. tablet). In the study presented, we analyze the CBM data of 98 fourth graders. They processed the exact same computation items once with paper and pen and once in a tablet application. The analyses point to comparable results in the test modes, although some significant deviations can be found at item level. In addition, the children report perceived benefits when working with the tablet.
Validity and Reliability of Instrument Competencies Framework of Agriculture Educators: The Rasch Measurement Model
agriculture instructors pilot study rasch measurement model validity and reliability...
This study aims to produce empirical evidence of the validity and reliability of instrument items for the competency framework of agricultural teaching staff in Malaysian agricultural vocational colleges. The validity and reliability of the framework were analyzed using Rasch Model Measurement assisted by Winsteps 3.72 software. This research instrument contained 116 items, which was distributed to 30 instructors at the Teluk Intan Agricultural Vocational College, Malaysia. The selection of respondents was made by strata random where the researcher makes the strata of the population according to the percentage and then selects randomly based on the desired percentage. Validity analysis of the instrument was done through four functional testings. For reliability and separation of respondents, it was found that the individual reliability value was very good and acceptable. The results of the item polarity analysis detected no negative value (-) in the Point Measure Correlation value. Item matching analysis found that 11 items had to be dropped as they failed to meet the required conditions. From the analysis on local dependence that determines dependent items based on the standardized residual correlation value, it was discovered that the correlation value for the items used was detected; 13 items need attention. The results of the data analysis checking the functionality of the items suggested that some items should be dropped. The omission of these items has provided evidence that the instrument of competence of agricultural instructors is crucial to have a high level of validity and reliability for use in actual studies.
Involvement of Teachers, Parents, and School Committees in Improving Scientific Attitudes of Elementary School Students: Application of Rasch Model Analysis
parents rasch model scientific attitude school committee teachers...
This research analyzed the involvement of teachers, parents, and school committees in improving scientific attitudes in science learning using Rasch model analysis. A survey method was used in this quantitative study. Participants in the study were selected using a purposive sample of 174 teachers, parents, and school committees in Sleman and Kebumen Regencies, Indonesia. A questionnaire was used in data collection to determine the involvement of teachers, parents, and school committees in improving scientific attitudes toward science learning. The questionnaires were completed using a Likert scale of 1-4, and the data were then analyzed using the Rasch model. The result showed that all participants were the average logit items (+1.03 logit). The reliability was 0.89, indicating a positive response to improving students' scientific attitudes. The results of the Rasch model analysis suggested that the involvement of parents, teachers, and school committees in improving scientific attitudes differed according to their roles. Each instrument element was analyzed in more detail in the Rasch model. Participants' roles were reflected in the specific involvements of teachers in learning, parents at home with children, and school committees participating in school policy-making.
Factor Structure and Dimensionality of an Instrument designed to Measure the Metacognitive Orientation of Thai Science Classroom Learning Environments
classroom learning environments metacognition science education...
The purpose of this study was to establish the factor structure and dimensionality of the Metacognitive Orientation Learning Environment Scale – Science (MOLES-S) in the Thai context. The metacognitive orientation of a science classroom learning environment is defined as the extent to which psychosocial conditions that are known to enhance students’ metacognition are evident in a specific science classroom. This study builds on earlier work in the research areas of science education, metacognition, and learning environments. A sample of 5418 Thai science students in grades 10 to 12, from 40 schools across Thailand, completed the MOLES-S that had been translated into Thai. Exploratory factor analysis was undertaken and Rasch analysis was used to calibrate the scale and explore its dimensionality. The results suggest that the MOLES-S(T), where (T) represents Thailand, has the same factor structure as the original MOLES-S, is reliable, and can be used with confidence in research into metacognition in Thai high school science classrooms.
Graded Response Models on the Curiosity Measurement of Elementary School Students
curiosity measurement elementary school graded response models...
Curiosity is one of the most important characters for elementary school students. However, the facts in the field show that the measurement model used by the teacher to identify the student's curiosity is not yet available in a standardized manner. This study aims to develop a model for measuring the curiosity of elementary school students using the graded response model (GRM) approach. This research uses quantitative method with descriptive type. The research sample used was 236 elementary school students who were randomly selected. Data were collected using a questionnaire of 16 statement items using a Likert scale approach. The data were analyzed using the response item theory approach with the GRM. The results showed that the model for measuring student curiosity in elementary schools had good location parameters, a good discriminant index, a fairly good information function with a small estimation error. The curiosity measurement model in this study can be used as an alternative for teachers to identify students' curiosity in elementary schools.
Development of a Digital-Preneurship Measurement Instrument: Alignment Approach Through Project-Based Learning
approach digitalpreneurship instrument development pjbl vocational student...
The purposes of this research are (a) to make an instrument to measure the achievement of project-based digitalpreneurship learning in students; (b) to describe the quality of the project-based digitalpreneurship learning achievement assessment instrument for vocational high school students; (c) to measure the competence and skills. This study employed to research and development as its methodology, using a combination procedure between Oriondo and Antonio and, Mardapi. The development procedure includes three stages: instrument design, instrument testing, and measurement. A total of 795 students who participated in the study at 5 vocational high schools in Yogyakarta's special region served as responders. Data analysis in this development uses the content validity of the formula Aiken V Index, confirmatory factor analysis establishes the construct's validity, and construct reliability. Measurement instrument development. Research findings that (a) the instrument is ready to be used in the measurement; (b) the quality of the project-based digitalpreneruship learning achievement assessment instrument for vocational high school students is well tested. This is evidenced by the validity test which has a high score >.8; The proof of construct validity in this study using CFA > .5; GOF chi-square value with a critical value of df = 289, X2 = 323, p-value with a critical value of .079, RMSEA with a critical value of RMSEA .019 (≤ .08), SMRM with a critical value of SRMR 0.030 (≤ .05), CFI with a critical value of CFI .990 (> .97), and an NFI with a critical value of NFI .989 ( > .90); (c) the measurement results are identified in the process that needs to be improved again regarding the digitalpreneurship skills of vocational high school students.
Development and Validation of Instruments for Assessing the Impact of Artificial Intelligence on Students in Higher Education
artificial intelligence item measurement reliability test validity test...
The role of artificial intelligence (AI) in education remains incompletely understood, demanding further evaluation and the creation of robust assessment tools. Despite previous attempts to measure AI's impact in education, existing studies have limitations. This research aimed to develop and validate an assessment instrument for gauging AI effects in higher education. Employing various analytical methods, including Exploratory Factor Analysis, Confirmatory Factor Analysis, and Rasch Analysis, the initial 70-item instrument covered seven constructs. Administered to 635 students at Nueva Ecija University of Science and Technology – Gabaldon campus, content validity was assessed using the Lawshe method. After eliminating 19 items through EFA and CFA, Rasch analysis confirmed the construct validity and led to the removal of three more items. The final 48-item instrument, categorized into learning experiences, academic performance, career guidance, motivation, self-reliance, social interactions, and AI dependency, emerged as a valid and reliable tool for assessing AI's impact on higher education, especially among college students.
0
Effectiveness of an Inquiry-Based Science Program on Enhancing Science Process Skills and Knowledge Among Moroccan Preschool Children
early childhood inquiry-based learning preschool education science education science process skills...
This study evaluates the effectiveness of a twelve-week Inquiry-Based Science (IBS) program on enhancing science process skills and scientific knowledge among preschool children in Morocco. Conducted in a quasi-experimental setting, it involved 105 children (M = 60.46 months, SD = 4.32), with 37 in the IBS group and 68 in the control group. The program utilized the 5Es instructional model and the Engineering Design Process (EDP) to engage children in active, hands-on learning experiences. Statistical analysis demonstrated that the IBS group achieved substantial improvements in both science process skills and scientific knowledge relative to the control group, with between-group effect sizes (Cohen’s d) ranging from 1.02 and 2.31. These findings highlight the significant impact of structured inquiry-based approaches in early childhood education. The study underscores the need for integrating such methods into the preschool curriculum to foster scientific understanding and skills from a young age, thereby better preparing Moroccan children for future academic and professional challenges. The results advocate for educational stakeholders to consider adopting inquiry-based learning frameworks to enhance the overall quality of early childhood education in Morocco.
0