Evaluating e-learning readiness using explainable machine learning and key organizational change factors in higher education

Mohamed Zine, Fouzi Harrou*, Mohammed Terbeche, Ying Sun

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

E-learning readiness (ELR) is critical for implementing digital education strategies, particularly in developing countries where online learning faces unique challenges. This study aims to provide a concise and actionable framework for assessing and predicting ELR in Algerian universities by combining the ADKAR model with advanced machine learning algorithms and Shapley Additive Explanations (SHAP). Data were collected through semi-structured interviews and questionnaires from 530 students and professors across Algerian universities, focusing on the five ADKAR factors: Awareness, Desire, Knowledge, Ability, and Reinforcement. Eight machine learning models were employed to analyze the data, selected for their ability to manage complex, high-dimensional datasets and capture non-linear relationships: k-nearest neighbors, support vector machines, partial least squares, random forests, gradient boosting, decision trees, CatBoost, and XGBoost. Results show that ensemble methods CatBoost and XGBoost achieving the best predictive performance (R2 = 0.811), reflecting their ability to explain the variance in ELR. SHAP analysis identified “Ability” as the most influential factor, followed by “Desire” and “Reinforcement.” This combination of SHAP and ADKAR provides novel insights by highlighting critical areas for intervention, such as enhancing digital skills and promoting knowledge acquisition. The use of SHAP in this study enhances model interpretability, enabling stakeholders to identify the most impactful factors and implement targeted, effective interventions to address key barriers to e-learning readiness.

Original languageEnglish (US)
Article number113396
Pages (from-to)12905-12937
Number of pages33
JournalEducation and Information Technologies
Volume30
Issue number9
DOIs
StateAccepted/In press - 2025

Keywords

  • ADKAR model
  • E-learning readiness
  • Explainable machine learning
  • Higher education
  • Online learning
  • SHAP

ASJC Scopus subject areas

  • Education
  • Library and Information Sciences

Fingerprint

Dive into the research topics of 'Evaluating e-learning readiness using explainable machine learning and key organizational change factors in higher education'. Together they form a unique fingerprint.

Cite this