Time-dependent performance prediction system for early insight in learning trends

  1. Carlos J. Villagrá-Arnedo 1
  2. Francisco J. Gallego-Durán 1
  3. Faraón Llorens-Largo 1
  4. Rosana Satorre-Cuerda 1
  5. Patricia Compañ-Rosique 1
  6. Rafael Molina-Carmona 1
  1. 1 Universitat d'Alacant
    info

    Universitat d'Alacant

    Alicante, España

    ROR https://ror.org/05t8bcz72

Revista:
IJIMAI

ISSN: 1989-1660

Ano de publicación: 2020

Volume: 6

Número: 2

Páxinas: 112-124

Tipo: Artigo

DOI: 10.9781/IJIMAI.2020.05.006 DIALNET GOOGLE SCHOLAR lock_openDialnet editor

Outras publicacións en: IJIMAI

Resumo

Performance prediction systems allow knowing the learning status of students during a term and produce estimations on future status, what is invaluable information for teachers. The majority of current systems statically classify students once in time and show results in simple visual modes. This paper presents an innovative system with progressive, time-dependent and probabilistic performance predictions. The system produces by-weekly probabilistic classifications of students in three groups: high, medium or low performance. The system is empirically tested and data is gathered, analysed and presented. Predictions are shown as point graphs over time, along with calculated learning trends. Summary blocks are with latest predictions and trends are also provided for teacher efficiency. Moreover, some methods for selecting best moments for teacher intervention are derived from predictions. Evidence gathered shows potential to give teachers insights on students' learning trends, early diagnose learning status and selecting best moment for intervention.

Referencias bibliográficas

  • A. Hellas, P. Ihantola, A. Petersen, V. V. Ajanovski, M. Gutica, T. Hynninen, A. Knutas, J. Leinonen, C. Messom, and S. N. Liao, “Predicting academic performance: A systematic literature review,” in Proceedings Companion of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education, ITiCSE 2018 Companion, (New York, NY, USA), p. 175–199, Association for Computing Machinery, 2018.
  • W. Hämäläinen and M. Vinni, “Classifiers for educational data mining,” Handbook of Educational Data Mining, Chapman & Hall/CRC Data Mining and Knowledge Discovery Series, pp. 57–71, 2010.
  • S. B. Kotsiantis, “Use of machine learning techniques for educational proposes: A decision support system for forecasting students’ grades,” Artificial Intelligence Review, vol. 37, pp. 331–344, Apr. 2012.
  • J.-F. Superby, J. Vandamme, and N. Meskens, “Determination of factors influencing the achievement of the first-year university students using data mining methods,” in Workshop on Educational Data Mining, pp. 37–44, 2006.
  • N. T. Nghe, P. Janecek, and P. Haddawy, “A comparative analysis of techniques for predicting academic performance,” in Frontiers In Education Conference - Global Engineering: Knowledge Without Borders, Opportunities Without Passports, 2007. FIE ’07. 37th Annual, pp. T2G–7– T2G–12, Oct 2007.
  • G. Dekker, M. Pechenizkiy, and J. Vleeshouwers, “Predicting students drop out: a case study,” in Educational Data Mining 2009, 2009.
  • A. K. Hamoud, A. S. Hashim, and W. A. Awadh, “Predicting student performance in higher education institutions using decision tree analysis,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 5, no. 2, p. 26, 2018.
  • S. Huang and N. Fang, “Predicting student academic performance in an engineering dynamics course: A comparison of four types of predictive mathematical models,” Computers & Education, vol. 61, no. 0, pp. 133 – 145, 2013.
  • W. Hämäläinen, J. Suhonen, E. Sutinen, and H. Toivonen, “Data mining in personalizing distance education courses,” in Proceedings of the 21st ICDE World Conference on Open Learning and Distance Education, pp. 18–21, 2004.
  • B. Minaei-Bidgoli, D. Kashy, G. Kortemeyer, and W. Punch, “Predicting student performance: an application of data mining methods with an educational web-based system,” in Frontiers in Education, 2003. FIE 2003 33rd Annual, vol. 1, pp. T2A–13, Nov 2003.
  • C. Romero, S. Ventura, P. G. Espejo, and C. Hervás, “Data mining algorithms to classify students,” in Educational Data Mining 2008, 2008.
  • Y. Freund, R. E. Schapire, et al., “Experiments with a new boosting algorithm,” in ICML, vol. 96, pp. 148–156, 1996.
  • A. Y. Wang and M. H. Newlin, “Predictors of performance in the virtual classroom: Identifying and helping at-risk cyber-students,” The Journal of Higher Education, vol. 29, no. 10, pp. 21–25, 2002.
  • I. Lykourentzou, I. Giannoukos, G. Mpardis, V. Nikolopoulos, and V. Loumos, “Early and dynamic student achievement prediction in e-learning courses using neural networks,” J. Am. Soc. Inf. Sci. Technol., vol. 60, pp. 372–380, Feb. 2009.
  • Y.-H. Hu, C.-L. Lo, and S.-P. Shih, “Developing early warning systems to predict students’ online learning performance,” Computers in Human Behavior, vol. 36, pp. 469 – 478, 2014.
  • G. Akçapınar, M. N. Hasnine, R. Majumdar, B. Flanagan, and H. Ogata, “Developing an early-warning system for spotting at-risk students by using eBook interaction logs,” Smart Learning Environments, vol. 6, p. 4, may 2019.
  • O. Petropoulou, K. Kasimatis, I. Dimopoulos, and S. Retalis, “Lae-r: A new learning analytics tool in moodle for assessing students’ performance,” Bulletin of the IEEE Technical Committee on Learning Technology, vol. 16, no. 1, p. 1, 2014.
  • T. Fawcett, “An introduction to {ROC} analysis,” Pattern Recognition Letters, vol. 27, no. 8, pp. 861 – 874, 2006. ROC Analysis in Pattern Recognition.
  • J. He, J. Bailey, B. I. Rubinstein, and R. Zhang, “Identifying at-risk students in massive open online courses.,” in AAAI, pp. 1749–1755, 2015.
  • J. A. Méndez and E. J. González, “A control system proposal for engineering education,” Computers & Education, vol. 68, pp. 266 – 274, 2013.
  • C. Villagrá-Arnedo, F. J. Gallego-Durán, R. Molina-Carmona, and F. Llorens-Largo, PLMan: Towards a Gamified Learning System, pp. 82–93. Cham: Springer International Publishing, 2016.
  • C. J. Villagrá-Arnedo, “Sistema predictivo progresivo de clasificación probabilıstica como guı ́ a para el aprendizaje,” 2016. ́
  • C. Cortes and V. Vapnik, “Support-vector networks,” Machine Learning, vol. 20, pp. 273–297, Sep 1995.
  • C. J. Villagrá-Arnedo, F. J. Gallego-Durán, F. Llorens-Largo, P. CompañRosique, R. Satorre-Cuerda, and R. Molina-Carmona, “Improving the expressiveness of black-box models for predicting student performance,” Computers in Human Behavior, vol. 72, pp. 621–631, jul 2017.