Using eye-tracking technology to identify learning styles: Behaviour patterns and identification accuracy

by | Mar 5, 2021 | Research Publications

Author(s):

  • Luo, Zhanni

Abstract:

Learning style theories have been widely used in adaptive learning systems to enhance learning outcomes. However, the previous studies on adaptive learning systems set a high entry barrier for researchers who lack programming skills, and few of the studies involved authentic everyday learning materials. This author proposes to test the feasibility of eye-tracking technology in identifying learning styles with everyday materials, as well as the identification accuracy. This author selected the Felder-Silverman’s learning style model (FSLSM) as the framework, enlisted the behaviour patterns that can be used to identify the eight learning styles in the FSLSM model, and conducted a quasi-experiment to test whether these behaviour patterns apply to eye movement differences. Then, this author compared the results of eye-tracking identification with participants’ self-report based on Index of Learning Style (ILS) questionnaire for identification accuracy. This quasi-experiment recruited 30 university students, including 19 female and 11 male. Findings showed that eye-tracking technology has the potential to quickly identify learners of different types categorised by the FSLSM theory, with accuracy ranging from 63.50% to 84.67%; however, there are disturbing factors contributing to different levels of identification accuracy, which should be investigated in future research.

Documentation:

https://doi.org/10.1007/s10639-021-10468-5

References:
  1. Alhasan, K., Chen, L., & Chen, F. (2018). An experimental study of learning behaviour in an elearning environment. Paper presented at the 2018 IEEE 20th International Conference on High Performance Computing and Communications (pp. 1398-1403). https://doi.org/10.1109/HPCC/SmartCity/DSS.2018.00231.
  2. Alhasan, K., Aliyu, S., Chen, L., & Chen, F. (2019). ICA-Based EEG Feature Analysis and Classification of Learning Styles. Paper presented at the 2019 IEEE International Conference on Dependable, Autonomic and Secure Computing (pp. 271-276). https://doi.org/10.1109/DASC/PiCom/CBDCom/CyberSciTech.2019.00057.
  3. Bernard, J., Chang, T.-W., Popescu, E., & Graf, S. (2017). Learning style identifier: Improving the precision of learning style identification through computational intelligence algorithms. Expert Systems with Applications, 75, 94–108. https://doi.org/10.1016/j.eswa.2017.01.021.Article Google Scholar 
  4. Bertea, P. E., & Hutanu, A. (2019). A Review of Eye Tracking in E-Learning. presented at the The 15th International Scientific Conference eLearning and Software for Education, Bucharest (pp.281-287). https://doi.org/10.12753/2066-026X-19-038.
  5. Cha, H. J., Kim, Y. S., Park, S. H., Yoon, T. B., Jung, Y. M., & Lee, J.-H. (2006). Learning styles diagnosis based on user interface behaviors for the customization of learning interfaces in an intelligent tutoring system. Paper presented at the International Conference on Intelligent Tutoring Systems (pp. 513-524). https://doi.org/10.1007/11774303_51.
  6. Coffield, F., Moseley, D., Hall, E., & Ecclestone, K. (2004). Learning styles and pedagogy in post-16 learning: A systematic and critical review. London: Learning & Skills Research Centre.Google Scholar 
  7. Crockett, K., Latham, A., & Whitton, N. (2017). On predicting learning styles in conversational intelligent tutoring systems using fuzzy decision trees. International Journal of Human-Computer Studies, 97, 98–115. https://doi.org/10.1016/j.ijhcs.2016.08.005.Article Google Scholar 
  8. Cuevas, J. (2015). Is learning styles-based instruction effective? A comprehensive analysis of recent research on learning styles. Theory and Research in Education, 13(3), 308–333. https://doi.org/10.1177/1477878515606621.Article Google Scholar 
  9. Duckworth, S. (n.d.). Success is an iceberg [image]. Reprinted with permission. Retrieved from https://ithemes.com/success-is-an-iceberg/. Accessed March 2021.
  10. El Guabassi, I., Bousalem, Z., Al Achhab, M., & El Mohajir, B. E. (2019). Identifying learning style through eye tracking technology in adaptive learning systems. International Journal of Electrical & Computer Engineering (pp. 4408–4416).https://doi.org/10.11591/ijece.v9i5.pp4408-4416
  11. El-Bishouty, M. M., Aldraiweesh, A., Alturki, U., Tortorella, R., Yang, J., Chang, T.-W., & Graf, S. (2019). Use of Felder and Silverman learning style model for online course design. Educational Technology Research and Development, 67(1), 161–177. https://doi.org/10.1007/s11423-018-9634-6.Article Google Scholar 
  12. Fasihuddin, H., Skinner, G., & Athauda, R. (2017). Towards adaptive open learning environments: Evaluating the precision of identifying learning styles by tracking learners’ behaviours. Education and Information Technologies, 22(3), 807–825. https://doi.org/10.1007/s10639-015-9458-5.Article Google Scholar 
  13. Feeley, A.-M., & Biggerstaff, D. L. (2015). Exam success at undergraduate and graduate-entry medical schools: Is learning style or learning approach more important? A critical review exploring links between academic success, learning styles, and learning approaches among school-leaver entry (“traditional”) and graduate-entry (“nontraditional”) medical students. Teaching and Learning in Medicine, 27(3), 237–244. https://doi.org/10.1080/10401334.2015.1046734.Article Google Scholar 
  14. Feit, A. M., Williams, S., Toledo, A., Paradiso, A., Kulkarni, H., Kane, S., & Morris, M. R. (2017). Toward everyday gaze input: Accuracy and precision of eye tracking and implications for design. Paper presented at the Proceedings of the 2017 Chi conference on human factors in computing systems (pp. 1118-1130). https://doi.org/10.1145/3025453.3025599.
  15. Felder, R. M. (2010). Are learning styles invalid?(Hint: No!). On-course Newsletter, 27, 1–7.Google Scholar 
  16. Felder, R. M., & Silverman, L. K. (1988). Learning and teaching styles in engineering education. Engineering Education, 78(7), 674–681.Google Scholar 
  17. Felder, R. M., & Soloman, B. A. (1997). Index of learning styles questionnaire. Retrieved July 2020 at https://www.webtools.ncsu.edu/learningstyles/.
  18. Felder, R. M., & Spurlin, J. (2005). Applications, reliability and validity of the index of learning styles. International Journal of Engineering Education, 21(1), 103–112. https://doi.org/10.1037/t43782-000.Article Google Scholar 
  19. García, P., Amandi, A., Schiaffino, S., & Campo, M. (2007). Evaluating Bayesian networks’ precision for detecting students’ learning styles. Computers & Education, 49(3), 794–808. https://doi.org/10.1016/j.compedu.2005.11.017.Article Google Scholar 
  20. Graf, S., & Kinshuk, K. (2007). Providing adaptive courses in learning management systems with respect to learning styles. Paper presented at the E-Learn: World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education (pp. 2576-2583).
  21. Graf, S., & Kinshuk. (2010). Using cognitive traits for improving the detection of learning styles. Paper presented at the 2010 Workshops on Database and Expert Systems Applications (pp. 74–78). https://doi.org/10.1109/DEXA.2010.35
  22. Graf, S., & Liu, T.-C. (2008). Identifying learning styles in learning management systems by using indications from students’ behaviour. Paper presented at the 2008 eighth ieee international conference on advanced learning technologies (pp. 482-486). https://doi.org/10.1109/ICALT.2008.84.
  23. Graf, S., Liu, T.-C., Chen, N.-S., & Yang, S. J. (2009). Learning styles and cognitive traits–their relationship and its benefits in web-based educational systems. Computers in Human Behavior, 25(6), 1280–1289. https://doi.org/10.1016/j.chb.2009.06.005.Article Google Scholar 
  24. Gregorc, A. F. (1985). Gregorc style delineator: A self-assessment instrument for adults: Gregorc Assoc.
  25. Hulme, J., & Allcock, S. (2010). Learning styles in the classroom: Educational benefit or planning exercise? Psychology Teaching Review, 16(2), 67–77.Google Scholar 
  26. Hwang, G.-J., Sung, H.-Y., Hung, C.-M., Huang, I., & Tsai, C.-C. (2012). Development of a personalized educational computer game based on students’ learning styles. Educational Technology Research and Development, 60(4), 623–638. https://doi.org/10.1007/s11423-012-9241-x.Article Google Scholar 
  27. Hwang, G.-J., Chiu, L.-Y., & Chen, C.-H. (2015). A contextual game-based learning approach to improving students’ inquiry-based learning performance in social studies courses. Computers & Education, 81, 13–25. https://doi.org/10.1016/j.compedu.2014.09.006.Article Google Scholar 
  28. Khenissi, M. A., Essalmi, F., Jemni, M., Graf, S., & Chen, N.-S. (2016). Relationship between learning styles and genres of games. Computers & Education, 101, 1–14. https://doi.org/10.1016/j.compedu.2016.05.005.Article Google Scholar 
  29. Koć-Januchta, M., Höffler, T., Thoma, G.-B., Prechtl, H., & Leutner, D. (2017). Visualizers versus verbalizers: Effects of cognitive style on learning with texts and pictures–an eye-tracking study. Computers in Human Behavior, 68, 170–179. https://doi.org/10.1016/j.chb.2016.11.028.Article Google Scholar 
  30. Latham, A., Crockett, K., McLean, D., & Edmonds, B. (2012). A conversational intelligent tutoring system to automatically predict learning styles. Computers & Education, 59(1), 95–109. https://doi.org/10.1016/j.compedu.2011.11.001.Article Google Scholar 
  31. Luo, Z., & Wang, Y. (2019). Eye-tracking technology in identifying visualizers and verbalizers: Data on eye-movement differences and detection accuracy. Data in Brief, 26, 104447. https://doi.org/10.1016/j.dib.2019.104447.Article Google Scholar 
  32. Luo, Z., O’Steen, B., & Brown, C. (2020). The use of eye-tracking technology to identify visualisers and verbalisers: Accuracy and contributing factors. Interactive Technology and Smart Education, 17(2), 229–247. https://doi.org/10.1108/ITSE-12-2019-0087.Article Google Scholar 
  33. Mehigan, & Pitt. (2014). Chapter four assessing eye-tracking Technology for Learning-style Detection in adaptive game-based learning. Game-Based Learning: Challenges and Opportunities, 77–111.
  34. Mehigan, B. M., Kehoe, A., & Pitt, I. (2011). Using eye tracking technology to identify visual and verbal learners. Paper presented at the 2011 IEEE International Conference on Multimedia and Expo, (pp. 1–6). https://doi.org/10.1109/ICME.2011.6012036
  35. Olmsted-Hawala, E., Holland, T., & Quach, V. (2014). Usability testing. In Eye tracking in user experience design (pp. 49-80): Elsevier. https://doi.org/10.1016/B978-0-12-408138-3.00003-0.
  36. Özpolat, E., & Akar, G. B. (2009). Automatic detection of learning styles for an e-learning system. Computers & Education, 53(2), 355–367. https://doi.org/10.1016/j.compedu.2009.02.018.Article Google Scholar 
  37. Pashler, H., McDaniel, M., Rohrer, D., & Bjork, R. (2008). Learning styles: Concepts and evidence. Psychological Science in the Public Interest, 9(3), 105–119. https://doi.org/10.1111/j.1539-6053.2009.01038.x.Article Google Scholar 
  38. Riener, C., & Willingham, D. (2010). The myth of learning styles. Change: The magazine of higher learning, 42(5), 32–35. https://doi.org/10.1080/00091383.2010.503139.Article Google Scholar 
  39. Soflano, M., Connolly, T. M., & Hainey, T. (2015). An application of adaptive games-based learning based on learning style to teach SQL. Computers & Education, 86, 192–211. https://doi.org/10.1016/j.compedu.2015.03.015.Article Google Scholar 
  40. Wang, J., Antonenko, P., & Dawson, K. (2020). Does visual attention to the instructor in online video affect learning and learner perceptions? An eye-tracking analysis. Computers & Education, 146, 103779. https://doi.org/10.1016/j.compedu.2019.103779.Article Google Scholar 
  41. Xenos, M. (2004). Prediction and assessment of student behaviour in open and distance education in computers using Bayesian networks. Computers & Education, 43(4), 345–359. https://doi.org/10.1016/j.compedu.2003.09.005.Article Google Scholar