logo logo International Journal of Educational Methodology

IJEM is a leading, peer-reviewed, open access, research journal that provides an online forum for studies in education, by and for scholars and practitioners, worldwide.

Subscribe to

Receive Email Alerts

for special events, calls for papers, and professional development opportunities.

Subscribe

Publisher (HQ)

RHAPSODE
Eurasian Society of Educational Research
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, HA4 7AE, UK
RHAPSODE
Headquarters
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, HA4 7AE, UK
Review Article

A Meta-Systematic Review of the Conceptual, Methodological, and Reporting Quality of Systematic Reviews of Research on Educational Leadership and Management in Africa

Anthony J. Onwuegbuzie , Ricardo Sabates

Formal publications in the area of educational leadership and management (EDLM) can be traced back more than a century. The 1950s saw the emergence of.


  • Pub. date: February 15, 2025
  • Online Pub. date: January 31, 2025
  • Pages: 27-42
  • 66 Downloads
  • 206 Views
  • 0 Citations

F

Formal publications in the area of educational leadership and management (EDLM) can be traced back more than a century. The 1950s saw the emergence of reviews of these EDLM works. Unfortunately, these reviews were limited because they were not systematic. Sometime after the establishment of the Campbell Collaboration as the standard for systematic reviews in the social sciences in 2000, scholars began conducting systematic reviews of the EDLM literature, including the African EDLM literature. However, little is known about the quality of this latter corpus of systematic reviews. Therefore, in this article, a systematic review of systematic reviews — a meta-systematic review — was conducted on the African EDLM literature. This meta-systematic review revealed 42 systematic reviews. The quality of these reviews was assessed using Hallinger’s analytical rubric for conducting systematic reviews, which led to the identification of strengths and weaknesses of these reviews, as well as a set of exemplary reviews. These findings offer actionable insights for policymakers and practitioners by highlighting the need for targeted training and resources to improve systematic reviews' conceptual, methodological, and reporting quality, thereby enhancing their utility for evidence-based decision-making and educational policy development.

Keywords: Africa, educational leadership and management, meta-systematic review, quality criteria, systematic review.

cloud_download PDF
Cite
Article Metrics
Views
66
Download
206
Citations
Crossref
0

References

(* denotes a work identified from the meta-systematic review)

*Anohah, E., & Suhonen, J. (2015). Modelling mobile learning policy in computing education for developing countries in Africa: A backward mapping approach. International Journal of Mobile Learning and Organisation, 9(3), 201-217. https://doi.org/10.1504/IJMLO.2015.074203

Beauregard, N., Marchand, A., & Blanc, M.-E. (2011). What do we know about the non-work determinants of workers’ mental health? A systematic review of longitudinal studies. BMC Public Health, 11, Article 439. https://doi.org/10.1186/1471-2458-11-439

*Belfiore, P., Iovino, S., & Tafuri, D. (2019). Sport management and educational management: A bibliometric analysis. Sport Science, 12(1), 61-64. https://ricerca.uniparthenope.it/handle/11367/75871

Bush, T. (2007). Educational leadership and management: Theory, policy, and practice. South African Journal of Education, 27(3), 391-406.  https://hdl.handle.net/10520/EJC32136

*Bush, T., & Glover, D. (2016a). School leadership and management in South Africa: Findings from a systematic literature review. International Journal of Educational Management, 30, 211-231. https://doi.org/10.1108/IJEM-07-2014-0101

*Bush, T., & Glover, D. (2016b). School leadership in West Africa: Findings from a systematic literature review. Africa Education Review, 13(3-4), 80-103. https://doi.org/10.1080/18146627.2016.1229572

*Bush, T., Kirezi, J., Ashford, R., & Glover, D. (2022). School leadership and gender in Africa: A systematic overview. Research in Educational Administration and Leadership, 7(4), 680-712. https://doi.org/10.30828/real.1159040

Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum.  

*Costan, E., Gonzales, G., Gonzales, R., Enriquez, L., Costan, F., Suladay, D., Atibing, N. M., Aro, J. L., Evangelista, S. S., Maturan, F., Selerio, E., Jr., & Ocampo, L. (2021). Education 4.0 in developing economies: A systematic literature review of implementation barriers and future research agenda. Sustainability, 13(22), Article 12763. https://doi.org/10.3390/su132212763

*Cruz-González, C., Rodríguez, C. L., & Segovia, J. D. (2021). A systematic review of principals’ leadership identity from 1993 to 2019. Educational Management Administration and Leadership, 49(1), 31-53. https://doi.org/10.1177/1741143219896053

*Cuéllar, C., Queupil, J. P., Cuenca, C., & Ravest, J. (2020). A systematic review on multiculturalism and educational leadership: Similarities and contrasts in knowledge production across societies. Multicultural Education Review, 12(4), 235-249. https://doi.org/10.1080/2005615X.2020.1842655

*Eckert, S., Sopory, P. Day, A., Wilkins, L., Padgett, D., Novak, J., Noyes, J., Allen, T., Alexander, N., Vanderford, M., & Gamhewage, G. (2018). Health-related disaster communication and social media: Mixed-method systematic review. Health Communication, 33(12), 1389-1400. https://doi.org/10.1080/10410236.2017.1351278

Ehsan, A., Klaas, H. S., Bastianen, A., & Spini, D. (2019). Social capital and health: A systematic review of systematic reviews. SSM - Population Health, 8, Article 100425. https://doi.org/10.1016/j.ssmph.2019.100425

EQUATOR Network. (2019). Enhancing the Quality and Transparency Of health Research. https://www.equator-network.org/

*Gómez-Leal, R., Holzer, A. A., Bradley, C., Fernández-Berrocal, P., & Patti, J. (2022). The relationship between emotional intelligence and leadership in school leaders: A systematic review. Cambridge Journal of Education, 52(1), 1-21. https://doi.org/10.1080/0305764X.2021.1927987

*González-Campos, J., Aspeé-Chacón, J., Sessarego-Espeleta, I., González-Suárez, H., & Gómez-Osorio, R. (2018). Análisis de la producción científica en política y gestión educativa publicada en SCIELO 2012-2015 [Analysis of the scientific production in politics and educational management published in SCIELO 2012-2015]. Revista Electronica Educare, 22(3). https://bit.ly/4hfQAvR

*Gümüş, S., Arar, K., & Oplatka, I. (2021). Review of international research on school leadership for social justice, equity and diversity. Journal of Educational Administration and History, 53(1), 81-99. https://doi.org/10.1080/00220620.2020.1862767

Hallinger, P. (2014). Reviewing reviews of research in educational leadership: An empirical assessment. Educational Administration Quarterly, 50(4), 539-576. https://doi.org/10.1177/0013161X13506594

*Hallinger, P. (2018). Surfacing a hidden literature: A systematic review of research on educational leadership and management in Africa. Educational Management Administration and Leadership, 46(3), 362-384. https://doi.org/10.1177/1741143217694895

*Hallinger, P. (2019a). A systematic review of research on educational leadership and management in South Africa: Mapping knowledge production in a developing society. International Journal of Leadership in Education, 22(3), 316-334. https://doi.org/10.1080/13603124.2018.1463460

*Hallinger, P. (2019b). Science mapping the knowledge base on educational leadership and management in Africa, 1960–2018. School Leadership and Management, 39(5), 537-560. https://doi.org/10.1080/13632434.2018.1545117

*Hallinger, P. (2020). Science mapping the knowledge base on educational leadership and management from the emerging regions of Asia, Africa and Latin America, 1965–2018. Educational Management Administration and Leadership, 48(2), 209-230. https://doi.org/10.1177/1741143218822772

*Hallinger, P., & Bridges, E. M. (2017). A systematic review of research on the use of problem-based learning in the preparation and development of school leaders. Educational Administration Quarterly, 53(2), 255-288. https://doi.org/10.1177/0013161X16659347

*Hallinger, P., Gümüş, S., & Bellibaş, M. Ş. (2020). 'Are principals instructional leaders yet?' A science map of the knowledge base on instructional leadership, 1940–2018. Scientometrics, 122, 1629-1650. https://doi.org/10.1007/s11192-020-03360-5

*Hallinger, P., & Kovačević, J. (2019). A bibliometric review of research on educational administration: Science mapping the literature, 1960 to 2018. Review of Educational Research, 89(3), 335-369. https://doi.org/10.3102/0034654319830380

*Hallinger, P., & Kovačević, J. (2021). Science mapping the knowledge base in educational leadership and management: A longitudinal bibliometric analysis, 1960 to 2018. Educational Management Administration and Leadership, 49(1), 5-30. https://doi.org/10.1177/1741143219859002

*Hallinger, P., & Kovačević, J. (2022). Mapping the intellectual lineage of educational management, administration and leadership, 1972–2020. Educational Management Administration and Leadership, 50(2) 192-216. https://doi.org/10.1177/17411432211006093

*Hammad, W., & Hallinger, P. (2017). A systematic review of conceptual models and methods used in research on educational leadership and management in Arab societies. School Leadership and Management, 37(5), 434-456. https://doi.org/10.1080/13632434.2017.1366441

Hong, Q. N., & Pluye, P. (2019). A conceptual framework for critical appraisal in systematic mixed studies reviews. Journal of Mixed Methods Research, 13(4), 446-460. https://doi.org/10.1177/1558689818770058

*Jambo, D., & Hongde, L. (2020). The effect of principal’s distributed leadership practice on students’ academic achievement: A systematic review of the literature. International Journal of Higher Education, 9(1), 189-198. https://doi.org/10.5430/ijhe.v9n1p189

*Kuzhabekova, A. (2021). A postcolonial feminist exploration of the scholarship on women and educational leadership with a bibliometric approach. Educational Management Administration and Leadership, 1-21. https://doi.org/10.1177/17411432211003885

*Limone, P., & Toto, G. A. (2022). Psychological strategies and protocols for promoting school well-being: A systematic review. Frontiers in Psychology, 13, Article 914063. https://doi.org/10.3389/fpsyg.2022.914063

*Lipscombe, K., Tindall-Ford, S., & Lamanna, J. (2023). School middle leadership: A systematic review. Educational Management Administration and Leadership, 51(2), 270-288. https://doi.org/10.1177/1741143220983328

*McEwan, P. J. (2015). Improving learning in primary schools of developing countries: A meta-analysis of randomized experiments. Review of Educational Research, 85(3), 353-394. https://doi.org/10.3102/0034654314553127

Meho, L. I., & Yang, K. (2007). Impact of data sources on citation counts and rankings of LIS faculty: Web of Science vs. Scopus and Google Scholar. Journal of the American Society for Information Science and Technology, 58(13), 2105-2125. https://doi.org/10.1002/asi.20677

*Mertkan, S., Arsan, N., Inal Cavlan, G., & Onurkan Aliusta, G. (2017). Diversity and equality in academic publishing: The case of educational leadership. Compare, 47(1), 46-61. https://doi.org/10.1080/03057925.2015.1136924

Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group. (2010). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA Statement. International Journal of Surgery, 8(5), 336-341. https://doi.org/10.1016/j.ijsu.2010.02.007

*Molina-Astorayme, J., & Cabanillas-Carbonell, M. (2020, October 21). Predicting academic performance using automatic learning techniques: A review of the scientific literature. Proceedings of the 2020 IEEE Engineering International Research Conference. Article number 9254065. https://hdl.handle.net/11537/26929

*Moyo, Z., Perumal, J., & Hallinger, P. (2020). Struggling to make a difference against the odds: A synthesis of qualitative research on women leading schools in Zimbabwe. International Journal of Educational Management, 34(10), 1577-1594. https://doi.org/10.1108/IJEM-01-2020-0015

*Nguyen, D., Harris, A., & Ng, D. (2020). A review of the empirical research on teacher leadership (2003–2017): Evidence, patterns and implications. Journal of Educational Administration, 58(1), 60-80. https://doi.org/10.1108/JEA-02-2018-0023

Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). McGraw-Hill.  

*Nwosu, L. I., Matashu, M., & Buabeng, A. T. (2022). A call to strengthen instructional leadership to support learner achievement during and post COVID-19: A systematic literature review approach. International Journal of Learning, Teaching and Educational Research, 21(7), 219-240. https://doi.org/10.26803/ijlter.21.7.12

Onwuegbuzie, A. J., & Frels, R. (2016). Seven steps to a comprehensive literature review: A multimodal and cultural approach. Sage.  

Onwuegbuzie, A. J., & Levin, J. R. (2005). Strategies for aggregating the statistical nonsignificant outcomes of a single study. Research in the Schools, 12(1), 10-19. https://bit.ly/40Xb0nm

Oronje, R. N., Mukiira, C., Kahurani, E., & Murunga, V. (2022). Training and mentorship as a tool for building African researchers’ capacity in knowledge translation. PLOS ONE, 17(3), Article e0266106. https://doi.org/10.1371/journal.pone.0266106

Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., … Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372, Article n71. https://doi.org/10.1136/bmj.n71

 *Pažur, M., & Kovač, V. (2019). Democratic school leadership: Analysis of current researches and open issues. [Demokratsko Školsko voĂenje: Analiza dosadaŠnjih istraŽivanja i otvorena pitanja] Metodicki Ogledi, 26(1), 33-60. https://doi.org/10.21464/mo.26.1.5

Petrosino, A., Boruch, R. F., Soydan, H., Duggan, L., & Sanchez-MecaFirst, J. (2001). Meeting the challenges of evidence-based policy: The Campbell Collaboration. The Annals of the American Academy of Political and Social Science, 578(1), 14-34. https://doi.org/10.1177/000271620157800102

*Poekert, P. E., Swaffield, S., Demir, E. K., & Wright, S. A. (2020). Leadership for professional learning towards educational equity: A systematic literature review. Professional Development in Education, 46(4), 541-562. https://doi.org/10.1080/19415257.2020.1787209

Pollock, M., Fernandes, R. M., Becker, L. A., Pieper, D., & Hartling, L. (2020). Overviews of reviews. In J. Higgins, J. Thomas, J. Chandler, M. S. Cumpston, T. Li, M. J. Page, & W. Welch, Cochrane handbook for systematic reviews of interventions (Version 6.0). Cochrane Training. https://bit.ly/40EMHcM

PRISMA. (2020). PRISMA 2020 checklist. https://bit.ly/4juIAst

*Richardson, J. W., & McLeod, S. (2009). Where should educational leadership authors publish to get noticed by the top journals in the discipline? Educational Administration Quarterly, 45(4), 631-639. https://doi.org/10.1177/0013161X09331770

Rouleau, G., Hong, Q. N., Kaur, N., Gagnon, M.-P., Côté, J., Bouix-Picasso, J., & Pluye, P. (2023). Systematic reviews of systematic quantitative, qualitative, and mixed studies reviews in healthcare research: How to assess the methodological quality of included reviews? Journal of Mixed Methods Research, 17(1), 51-69. https://doi.org/10.1177/15586898211054243

Simera, I., Moher, D., Hirst, A., Hoey, J., Schulz, K. F., & Altman, D. G. (2010). Transparent and accurate reporting increases reliability, utility, and impact of your research: Reporting guidelines and the EQUATOR Network. BMC Medicine, 8, Article 24. https://doi.org/10.1186/1741-7015-8-24

*Sudirman, A., & Gemilang, A. V. (2020). Promoting work-based learning as a praxis of educational leadership in higher education. International Journal of Learning, Teaching and Educational Research, 19(3), 149-173. https://doi.org/10.26803/ijlter.19.3.9

*Sun, J., & Leithwood, K. (2015). Leadership effects on student learning mediated by teacher emotions. Societies, 5(3), 566-582. https://doi.org/10.3390/soc5030566

*Tamadoni, A., Hosseingholizadeh, R., & Bellibaş, M. Ş. (2024). A systematic review of key contextual challenges facing school principals: Research-informed coping solutions. Educational Management Administration and Leadership, 52(1), 116-150. https://doi.org/10.1177/17411432211061439

*Tian, M., & Huber, S. G. (2020). Mapping educational leadership, administration and management research 2007–2016: Thematic strands and the changing landscape. Journal of Educational Administration, 58(2), 129-150. https://doi.org/10.1108/JEA-12-2018-0234

*Tian, M., & Huber, S. G. (2021). Mapping the international knowledge base of educational leadership, administration and management: A topographical perspective. Compare: A Journal of Comparative and International Education, 51(1), 4-23. https://doi.org/10.1080/03057925.2019.1585757

Toye, F., Seers, K., Allcock, N., Briggs, M., Carr, E., Andrews, J., & Barker, K. (2013). “Trying to pin down jelly”: Exploring intuitive processes in quality assessment for meta-ethnography. BMC Medical Research Methodology, 13, Article 46. https://doi.org/10.1186/1471-2288-13-46

*Wang, Y., & Bowers, A. J. (2016). Mapping the field of educational administration research: A journal citation network analysis. Journal of Educational Administration, 54(3), 242-269. https://doi.org/10.1108/JEA-02-2015-0013

*Webster, C. A., Glascoe, G., Moore, C., Dauenhauer, B., Egan, C. A., Russ, L. B., Orendorff, K., & Buschmeier, C. (2020). Recommendations for administrators’ involvement in school-based health promotion: A scoping review. International Journal of Environmental Research and Public Health, 17(17), Article 6249. https://doi.org/10.3390/ijerph17176249

Whiting, P., Savovi´c, J., Higgins, J. P. T., Caldwell, D. M., Reeves, B. C., Shea, B., Davies, P., Kleijnen, J., Churchill, R., & ROBIS Group. (2016). ROBIS: A new tool to assess risk of bias in systematic reviews was developed. Journal of Clinical Epidemiology, 69, 225-234. https://doi.org/10.1016/j.jclinepi.2015.06.005

Zorzela, L., Golder, S., Liu, Y., Pilkington, K., Hartling, L., Joffe, A., Loke, Y., & Vohra, S. (2014). Quality of reporting in systematic reviews of adverse events: Systematic review. BMJ, 348, Article f7668. https://doi.org/10.1136/bmj.f7668

...