Development of a Core Competency Instrument for Research-Focused University Students
This study aimed to develop and validate a comprehensive core competency assessment instrument specifically designed for undergraduate students at a r.
- Pub. date: August 15, 2025
- Online Pub. date: July 29, 2025
- Pages: 391-401
- 134 Downloads
- 416 Views
- 0 Citations
Abstract:
This study aimed to develop and validate a comprehensive core competency assessment instrument specifically designed for undergraduate students at a research-focused university. Despite growing emphasis on competency-based education (CBE), there are limited psychometrically sound tools tailored to evaluate students’ level of core competencies in research-intensive universities. The current study proceeded in three phases: (a) development of a conceptual framework comprising six core competencies: Integrated Thinking, Knowledge Inquiry, Creative Integration, Global Citizenship, Communication & Collaboration, and Self-Management; (b) item generation and expert validation; and (c) validation through exploratory and confirmatory factor analyses. The final instrument included 77 items across the six competencies. CFA confirmed adequate model fit (CFI = .934–.957; RMSEA = .057–.088). The results showed that the validated instrument can provide a reliable and comprehensive assessment for students' core competencies in research-oriented university settings. This instrument can provide guidelines for developing competency-based education (CBE) curricula in higher education, as well as criteria for evaluating and refining existing CBE programs. This instrument functions as both a psychometrically robust assessment tool and a practical guide for institutional enhancement. It enables precise measurement of students’ core competencies, offering evidence that can inform curriculum design, academic advising, and policy development. In addition, the validated framework lays a strong groundwork for future research to investigate the long-term effects of competency-based education on student achievement, career readiness, and personal development across various higher education settings.
Keywords: Competency-based education, instrument development, research-focused university students.
0
References
Australian Council for Educational Research. (2001). Graduate skills assessment (GSA): Summary report. Australian Council for Educational Research. https://www.acer.org/files/GSA_SummaryReport.pdf
Brauer, S. (2021). Towards competence-oriented higher education: A systematic literature review of the different perspectives on successful exit profiles. Education + Training, 63(9), 1376-1390. https://doi.org/10.1108/ET-07-2020-0216
Cano, E., Lluch, L., Grané, M., & Remesal, A. (2023). Competency-based assessment practices in higher education: Lessons from the pandemics. Trends in Higher Education, 2(1), 238-254. https://doi.org/10.3390/higheredu2010012
Capella-Peris, C., Gil-Gómez, J., Martí-Puig, M., & Ruíz-Bernardo, P. (2020). Development and validation of a scale to assess social entrepreneurship competency in higher education. Journal of Social Entrepreneurship, 11(1), 23-39. https://doi.org/10.1080/19420676.2018.1545686
Chang, C. C. (2006). Development of competency-based web learning material and effect evaluation of self-directed learning aptitudes on learning achievements. Interactive Learning Environments, 14(3), 265-286. https://doi.org/10.1080/10494820600954112
Chappell, C., Gonczi, A., & Hager, P. (1999). Competency-based education. In G. Foley (Ed.), Understanding adult education and training (2nd ed., pp. 191-205). Routledge. https://doi.org/10.4324/9781003118299-18
DeBacker, D., Kingston, N., Mason, J., Parsons, K., Patelis, T., & Specht-Boardman, R. (2024). A research agenda for competency-based education. Competency-Based Education Research Journal, 1(1), 1-21. https://journals.ku.edu/cberj/article/view/23064
Edwards, P. L. (2022). Redefining higher education through competency-based education and flexible course schedules. In S. Ramlall, T. Cross, & M. Love (Eds.), Handbook of research on future of work and education: Implications for curriculum delivery and work design (pp. 145-158). IGI Global. https://doi.org/10.4018/978-1-7998-8275-6.ch009
George-Reyes, C. E., López-Caudana, E. O., & Ramírez-Montoya, M. S. (2023). Research competencies in university students: Intertwining complex thinking and Education 4.0. Contemporary Educational Technology, 15(4), Article ep478. https://doi.org/10.30935/cedtech/13767
Gervais, J. (2016). The operational definition of competency-based education. The Journal of Competency-Based Education, 1(2), 98-106. https://doi.org/10.1002/cbe2.1011
Gyll, S. P. (2021). Career development by design, not default: Creating a more efficient and data-driven process by connecting aptitude-based learner guidance to post-secondary pathways, competency-based credentials, and high-demand jobs. The Journal of Competency-Based Education, 6(1), Article e1236. https://doi.org/10.1002/cbe2.1236
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate data analysis (7th ed.). Pearson Education International.
Henderson, J. B., Norris, C. M., & Hornsby, E. R. (2024). Refining higher education's core competence and its shaping influence on the future of learning and work. Research Issues in Contemporary Education, 9(2), 139-152. https://bit.ly/3U35rQm
Holmes, A. G. D., Tuin, M. P., & Turner, S. L. (2021). Competence and competency in higher education, simple terms yet with complex meanings: Theoretical and practical issues for university teachers and assessors implementing competency-based education (CBE). Educational Process: International Journal, 10(3), 39-52. https://doi.org/10.22521/edupij.2021.103.3
Hu, L.-T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118
Janssens, O., Embo, M., Valcke, M., & Haerens, L. (2023). When theory beats practice: The implementation of competency-based education at healthcare workplaces. BMC Medical Education, 23, Article 484. https://doi.org/10.1186/s12909-023-04446-3
Jin, M., Son, Y., & Chue, H. (2011). A study on building a diagnostic system for university students’ core competencies. The Korean Educational Administration Society, 29(4), 461-486.
Klein, S., Benjamin, R., Shavelson, R., & Bolus, R. (2007). The collegiate learning assessment: Facts and fantasies. Evaluation Review, 31(5), 415-439. https://doi.org/10.1177/0193841X07303318
Kuh, G. D., & Ewell, P. T. (2010). The state of learning outcomes assessment in the United States. Higher Education Management and Policy, 22(1), 9-28. http://doi.org/10.1787/Hemp-22-5Ks5Dlhqbfr1
Long, C., Bernoteit, S., & Davidson, S. (2020). Competency-based education: A clear, equitable path forward for today's learners. Change: The Magazine of Higher Learning, 52(6), 30-37. https://doi.org/10.1080/00091383.2020.1839335
Marzano, R. J., Simms, J. A., Roy, T., Heflebower, T., & Warrick, P. B. (2012). Coaching classroom instruction. Marzano Research Laboratory.
Mellado-Moreno, P., Moreno-Olivos, A., & García-Cabrero, B. (2024). Assessment of research competence in the educational field: An analysis of measurement instruments. Alteridad, 19(2), 202-215. https://bit.ly/44xhuLE
Milner, R. J., Gusic, M. E., & Thorndyke, L. E. (2011). Perspective: Toward a competency framework for faculty. Academic Medicine, 86(10), 1204-1210. https://doi.org/10.1097/ACM.0b013e31822bd524
Nunnally, J. C. (1978). An overview of psychological measurement. In P. McReynolds (Ed.), Clinical diagnosis of mental disorders: A handbook (pp. 97-146). Plenum Press. https://doi.org/10.1007/978-1-4684-2490-4_4
Organisation for Economic Co-operation and Development. (2019, November 15). The survey of adult skills: Reader’s companion (3rd ed.). https://bit.ly/43ZrwVD
Spady, W. G. (1977). Competency-based education: A bandwagon in search of a definition. Educational Researcher, 6(1), 9-14. https://doi.org/10.3102/0013189X006001009
Spady, W. G., & Mitchell, D. E. (1977). Competency-based education: Organizational issues and implications. Educational Researcher, 6(2), 9-15. https://doi.org/10.3102/0013189X006002009
Tabachnick, B. G., & Fidell, L. S. (2006). Using multivariate statistics (5th ed.). Pearson.
Tremblay, K., Lalancette, D., & Roseveare, D. (2012). Assessment of higher education learning outcomes feasibility study report: (Volume 1) Design and implementation. Organisation for Economic Co-operation and Development. https://www.voced.edu.au/content/ngv:55173
Wynd, C. A., & Schaefer, M. A. (2002). The osteoporosis risk assessment tool: Establishing content validity through a panel of experts. Applied Nursing Research, 15(3), 184-188. https://doi.org/10.1053/apnr.2002.34243