'rater bias' Search Results
Number of Response Options, Reliability, Validity, and Potential Bias in the Use of the Likert Scale Education and Social Science Research: A Literature Review
likert scale literature review potential bias reliability and validity...
This study reviews 60 papers using a Likert scale and published between 2012 – 2021. Screening for literature review uses the PRISMA method. The data analysis technique was carried out through data extraction, then synthesized in a structured manner using the narrative method. To achieve credible research results at the stage of the data collection and data analysis process, a group discussion forum (FGD) was conducted. The findings show that only 10% of studies use a measurement scale with an even answer choice category (4, 6, 8, or 10 choices). In general, (90%) of research uses a measurement instrument that involves a Likert scale with odd response choices (5, 7, 9, or 11) and the most popular researchers use a Likert scale with a total response of 5 points. The use of a rating scale with an odd number of responses of more than five points (especially on a seven-point scale) is the most effective in terms of reliability and validity coefficients, but if the researcher wants to direct respondents to one side, then a scale with an even number of responses (six points) is possible. more suitable. The presence of response bias and central tendency bias can affect the validity and reliability of the use of the Likert scale instrument.
Evaluation of the 9th-grade 2018 Physics Curriculum With Multilevel Rasch Analysis
multilevel rasch analysis physics curriculum rater bias...
This study aims to examine the 9th-grade 2018 physics curriculum according to various criteria. A cross-sectional survey model was used. The sample consists of 36 physics teachers working in various high schools in 12 regions of Turkey in the 2022-2023 academic year. The data of the study were collected via the “9th-grade 2018 physics curriculum Evaluation Form”. The data collected via the evaluation form were determined with the multilevel Rasch analysis program. The results of the research revealed that the criteria determined in the evaluation of the 9th-grade physics curriculum differed in terms of strictness and generosity. In addition, the quantitative data analysis revealed that the physics teachers mostly comply with the criteria set in the program while they disapprove of some criteria. The physics teachers reported some deficiencies in the objectives, content, and educational status of the elements included in the program. In this context, it is recommended that the achievements of the 9th-grade 2018 physics curriculum be reviewed in line with the evaluations of the stakeholders related to the subject.