Primary School Teacher Perspectives on Effective Dashboard Use in the Classroom
Skills, Knowledge, and Contextual Conditions
DOI:
https://doi.org/10.18608/jla.2025.8493Keywords:
teacher dashboard, primary education, adaptive learning technologies, teacher perspectives, research paperAbstract
Adaptive learning technologies (ALTs) provide teachers with student data in teacher dashboards (TDs). However, there is substantial variation in dashboard use among teachers, and many find it difficult to draw conclusions based on student data. Teachers’ skills, knowledge, and contextual conditions are believed to be essential in effective dashboard use. In this study, 26 primary school teachers using dashboards daily were interviewed about their perspectives on the skills, knowledge, and contextual conditions needed to facilitate dashboard use. Results indicated that teachers require a combination of skills, knowledge, and contextual conditions to make well-informed decisions while using a dashboard, emphasizing data literacy skills and pedagogical knowledge. In addition, teachers addressed other competencies, such as skills and knowledge related to the ALT curriculum and general computer proficiency. Also, contextual conditions at the school and technology level were found to be necessary. Based on these results, we propose various factors to explain teacher dashboard use.
References
Aleven, V., McLaughlin, E. A., Glenn, R. A., & Koedinger, K. R. (2017). Instruction based on adaptive learning technologies. In R. E. Mayer & P. A. Alexander (Eds.), Handbook of research on learning and instruction (2nd ed., pp. 522–560). Routledge.
Bodily, R., Kay, J., Aleven, V., Jivet, I., Davis, D., Xhakaj, F., & Verbert, K. (2018). Open learner models and learning analytics dashboards: A systematic review. In A. Pardo, K. Bartimote-Aufflick, G. Lynch, S. Buckingham Shum, R. Ferguson, A. Merceron, & X. Ochoa (Eds.), LAK ’18: Proceedings of the 8th International Conference on Learning Analytics & Knowledge (pp. 41–50). ACM Press. http://dx.doi.org/10.1145/3170358.3170409
Boeije, H. (2010). Analysis in qualitative research. SAGE Publications.
Blömeke, S., Gustafsson, J.-E., & Shavelson, R. J. (2015). Beyond dichotomies: Competence viewed as a continuum. Zeitschrift für Psychologie, 223(1). https://doi.org/10.1027/2151-2604/a000194
Dunlap, K., & Piro, J. S. (2016). Diving into data: Developing the capacity for data literacy in teacher education. Cogent Education, 3(1), Article 1132526. http://dx.doi.org/10.1080/2331186X.2015.1132526
Forehand, M. (2010). Bloom’s taxonomy. In M. Orey (Ed.), Emerging perspectives on learning, teaching, and technology (pp. 41–47). Global Text.
Foulger, T. S., Graziano, K. J., Schmidt-Crawford, D., & Slykhuis, D. A. (2017). Teacher educator technology competencies. Journal of Technology and Teacher Education, 25(4), 413–448. https://www.learntechlib.org/primary/p/181966/
Granger, C. A., Morbey, M. L., Lotherington, H., Owston, R. D., & Wideman, H. H. (2002). Factors contributing to teachers’ successful implementation of IT. Journal of Computer Assisted Learning, 18(4), 480–488. http://dx.doi.org/10.1046/j.0266-4909.2002.00259.doc.x
Gudmundsdottir, S., & Shulman, L. (1987). Pedagogical content knowledge in social studies. Scandinavian Journal of Educational Research, 31(2), 59–70. http://dx.doi.org/10.1080/0031383870310201
Herodotou, C., Rienties, B., Boroowa, A., Zdrahal, Z., & Hlosta, M. (2019). A large-scale implementation of predictive learning analytics in higher education: The teachers’ role and perspective. Educational Technology Research and Development, 67(5), 1273–1306. https://doi.org/10.1007/s11423-019-09685-0
Holstein, K., McLaren, B. M., & Aleven, V. (2017). Intelligent tutors as teachers’ aides: Exploring teacher needs for real-time analytics in blended classrooms. In A. Wise, P. H. Winne, G. Lynch, X. Ochoa, I. Molenaar, S. Dawson, & M. Hatala (Eds.), LAK ’17: Proceedings of the 7th International Learning Analytics & Knowledge Conference (pp. 257–266). ACM Press. https://doi.org/10.1145/3027385.3027451
Hughes, J. (2005). The role of teacher knowledge and learning experiences in forming technology-integrated pedagogy. Journal of Technology and Teacher Education, 13(2), 277–302.
Jivet, I., Scheffel, M., Specht, M., & Drachsler, H. (2018). License to evaluate: Preparing learning analytics dashboards for educational practice. In A. Pardo, K. Bartimote-Aufflick, G. Lynch, S. Buckingham Shum, R. Ferguson, A. Merceron, & X. Ochoa (Eds.), LAK ’18: Proceedings of the 8th International Conference on Learning Analytics & Knowledge (pp. 31–40). ACM Press. http://dx.doi.org/10.1145/3170358.3170421
Karssen, M., Krepel, A., Stronkhorst, E., Lourens, J. M. P., Bruck, S, van Kessel, M., & Saab, N. (2023). Monitor digitalisering funderend onderwijs: Onderzoeksrapport voortgezet (speciaal) onderwijs MYRA 2023 [Monitor digitalization of primary education: Research report secondary (special) education MYRA 2023]. Kohnstamm Instituut.
Kanouse, D. E., & Hanson, L. R., Jr. (1987). Negativity in evaluations. In E. E. Jones, D. E. Kanouse, H. H. Kelley, R. E. Nisbett, S. Valins, & B. Weiner (Eds.), Attribution: Perceiving the causes of behavior (pp. 47–62). Lawrence Erlbaum Associates.
Keuning, T., & van Geel, M. (2021). Differentiated teaching with adaptive learning systems and teacher dashboards: The teacher still matters most. IEEE Transactions on Learning Technologies, 14(2), 201–210. http://dx.doi.org/10.1109/TLT.2021.3072143
Khulbe, M., & Tammets, K. (2023). Mediating teacher professional learning with a learning analytics dashboard and training intervention. Technology, Knowledge and Learning, 28(3), 981–998. http://dx.doi.org/10.1007/s10758-023-09642-0
Knoop-van Campen, C., & Molenaar, I. (2020). How teachers integrate dashboards into their feedback practices. Frontline Learning Research, 8(4), 37–51. https://doi.org/10.14786/flr.v8i4.641
König, J., Santagata, R., Scheiner, T., Adleff, A.-K., Yang, X., & Kaiser, G. (2022). Teacher noticing: A systematic literature review of conceptualizations, research designs, and findings on learning to notice. Educational Research Review, 36, Article 100453. https://doi.org/10.1016/j.edurev.2022.100453
Krippendorff, K. (2018). Content analysis: An introduction to its methodology (4th ed.). SAGE Publications.
Loibl, K., Leuders, T., & Dörfler, T. (2020). A framework for explaining teachers’ diagnostic judgements by cognitive modeling (DiaCoM). Teaching and Teacher Education, 91, Article 103059. https://doi.org/10.1016/j.tate.2020.103059
Mandinach, E. B., & Gummer, E. S. (2016). What does it mean for teachers to be data literate: Laying out the skills, knowledge, and dispositions. Teaching and Teacher Education, 60, 366–376. http://dx.doi.org/10.1016/j.tate.2016.07.011
Mavroudi, A., Giannakos, M., & Krogstie, J. (2016). Insights on the interplay between adaptive learning and learning analytics. In J. M. Spector, C.-C. Tsai, D. G. Sampson, Kinshuk, R. Huang, N.-S. Chen, & P. Resta (Eds.), The 16th IEEE International Conference on Advanced Learning Technologies (ICALT 2016) (pp. 42–43). IEEE. https://doi.org/10.1109/ICALT.2016.84
Merk, S., Poindl, S., Wurster, S., & Bohl, T. (2020). Fostering aspects of pre-service teachers’ data literacy: Results of a randomized controlled trial. Teaching and Teacher Education, 91, Article 103043. https://doi.org/10.1016/j.tate.2020.103043.
Michaeli, S., Kroparo, D., & Hershkovitz, A. (2020). Teachers’ use of education dashboards and professional growth. The International Review of Research in Open and Distributed Learning, 21(4), 61–78. http://dx.doi.org/10.19173/irrodl.v21i4.4663
Miloradov, M., Rakic, S., & Marjanovic, U. (2022). Towards digital economy through data literate workforce. In F. Laforest, R. Troncy, L. Médini, & I. Herman (Eds.), WWW ’22: Companion Proceedings of the Web Conference 2022 (pp. 417–422). ACM Press. https://doi.org/10.1145/3487553.3524696
Molenaar, I. (2022). Towards hybrid human–AI learning technologies. European Journal of Education, 57(4), 632–645. https://doi.org/10.1111/ejed.12527
Molenaar, I., & Knoop-van Campen, C. A. N. (2019). How teachers make dashboard information actionable. IEEE Transactions on Learning Technologies, 12(3), 347–355. https://doi.org/10.1109/TLT.2018.2851585
Poortman, C. L., & Schildkamp, K. (2016). Solving student achievement problems with a data use intervention for teachers. Teaching and Teacher Education, 60, 425–433. http://dx.doi.org/10.1016/j.tate.2016.06.010
Pozdniakov, S., Martinez-Maldonado, R., Tsai, Y.-S., Echeverria, V., Srivastava, N., & Gašević, D. (2023). How do teachers use dashboards enhanced with data storytelling elements according to their data visualisation literacy skills? In I. Hilliger, H. Khosravi, B. Rienties, & S. Dawson (Eds.), LAK ’23: Proceedings of the 13th International Learning Analytics & Knowledge Conference (pp. 89–99). ACM Press. https://doi.org/10.1145/3576050.3576063
Reeves, T. D., & Honig, S. L. (2015). A classroom data literacy intervention for pre-service teachers. Teaching and Teacher Education, 50, 90–101. https://doi.org/10.1016/J.TATE.2015.05.007.
Rashid, T., & Asghar, H. M. (2016). Technology use, self-directed learning, student engagement and academic performance: Examining the interrelations. Computers in Human Behavior, 63, 604–612. http://dx.doi.org/10.1016/j.chb.2016.05.084
Robinson, O. C. (2014). Sampling in interview-based qualitative research: A theoretical and practical guide. Qualitative Research in Psychology, 11(1), 25–41. https://doi.org/10.1080/14780887.2013.801543
Rodrigues, A. L., Cerdeira, L., Machado-Taylor, M. d. L., & Alves, H. (2021). Technological skills in higher education: Different needs and different uses. Education Sciences, 11(7), Article 326. https://doi.org/10.3390/educsci11070326
Sarıyalçınkaya, A. D., Karal, H., Altinay, F., & Altinay, Z. (2021). Reflections on adaptive learning analytics: Adaptive learning analytics. In A. Azevedo, J. M. Azevedo, J. O. Uhomoibhi, & E. Ossiannilsson (Eds.), Advancing the power of learning analytics and big data in education (pp. 61–84). IGI Global. https://doi.org/10.4018/978-1-7998-7103-3.ch003
Schildkamp, K., & Kuiper, W. (2010). Data-informed curriculum reform: Which data, what purposes, and promoting and hindering factors. Teaching and Teacher Education, 26(3), 482–496. http://dx.doi.org/10.1016/j.tate.2009.06.007
Schwendimann, B. A., Rodríguez-Triana, M. J., Vozniuk, A., Prieto, L. P., Boroujeni, M. S., Holzer, A., Gillet, D., & Dillenbourg, P. (2017). Perceiving learning at a glance: A systematic literature review of learning dashboard research. IEEE Transactions on Learning Technologies, 10(1), 30–41. http://dx.doi.org/10.1109/TLT.2016.2599522
Sloan-Lynch, J., & Morse, R. (2024). Equity-forward learning analytics: Designing a dashboard to support marginalized student success. In B. Flanagan, B. Wasson, & D. Gašević (Eds.), LAK ’24: Proceedings of the 14th Learning Analytics & Knowledge Conference (pp. 1–11). ACM Press. https://doi.org/10.1145/3636555.3636844
Spiteri, M., & Chang Rundgren, S.-N. (2020). Literature review on the factors affecting primary teachers’ use of digital technology. Technology, Knowledge and Learning, 25(1), 115–128. http://dx.doi.org/10.1007/s10758-018-9376-x
Stronge, J. H. (2018). Qualities of effective teachers (3rd ed.). ASCD.
Tamir, P. (1988). Subject matter and related pedagogical knowledge in teacher education. Teaching and Teacher Education, 4(2), 99–110. http://dx.doi.org/10.1016/0742-051X(88)90011-X
Tondeur, J., Valcke, M., & Van Braak, J. (2008). A multidimensional approach to determinants of computer use in primary education: Teacher and school characteristics. Journal of Computer Assisted Learning, 24(6), 494–506. http://dx.doi.org/10.1111/j.1365-2729.2008.00285.x
van den Bosch, R. M., Espin, C. A., Chung, S., & Saab, N. (2017). Data-based decision-making: Teachers’ comprehension of curriculum-based measurement progress-monitoring graphs. Learning Disabilities Research & Practice, 32(1), 46–60. https://doi.org/10.1111/ldrp.12122
van Leeuwen, A., Knoop-van Campen, C. A. N., Molenaar, I., & Rummel, N. (2021). How teacher characteristics relate to how teachers use dashboards: Results from two case studies in K–12. Journal of Learning Analytics, 8(2), 6–21. http://dx.doi.org/10.18608/jla.2021.7325
van Leeuwen, A., & Rummel, N. (2020). Comparing teachers’ use of mirroring and advising dashboards. In C. Rensing, H. Draschler, V. Kovanović, N. Pinkwart, M. Scheffel, & K. Verbert (Eds.), LAK ’20: Proceedings of the 10th International Conference on Learning Analytics & Knowledge (pp. 26–34). ACM Press. http://dx.doi.org/10.1145/3375462.3375471
van Leeuwen, A., Rummel, N., & van Gog, T. (2019). What information should CSCL teacher dashboards provide to help teachers interpret CSCL situations? International Journal of Computer-Supported Collaborative Learning, 14(3), 261–289. http://dx.doi.org/10.1007/s11412-019-09299-x
van Leeuwen, A., Strauß, S., & Rummel, N. (2023). Participatory design of teacher dashboards: Navigating the tension between teacher input and theories on teacher professional vision. Frontiers in Artificial Intelligence, 6, Article 1039739. http://dx.doi.org/10.3389/frai.2023.1039739
Vatanartiran, S., & Karadeniz, S. (2015). A needs analysis for technology integration plan: Challenges and needs of teachers. Contemporary Educational Technology, 6(3), 206–220. https://doi.org/10.30935/cedtech/6150
Verbert, K., Govaerts, S., Duval, E., Santos, J. L., Van Assche, F., Parra, G., & Klerkx, J. (2014). Learning dashboards: An overview and future research opportunities. Personal and Ubiquitous Computing, 18(6), 1499–1514. http://dx.doi.org/10.1007/s00779-013-0751-2
Voss, T., Kunter, M., & Baumert, J. (2011). Assessing teacher candidates’ general pedagogical/psychological knowledge: Test construction and validation. Journal of Educational Psychology, 103(4), 952–969. http://dx.doi.org/10.1037/a0025125
Wolff, A., Moore, J., Zdrahal, Z., Hlosta, M., & Kuzilek, J. (2016). Data literacy for learning analytics. In D. Gašević, G. Lynch, S. Dawson, H. Drachsler, & C. P. Rosé (Eds.), LAK ’16: Proceedings of the 6th International Conference on Learning Analytics & Knowledge (pp. 500–501). ACM Press. http://dx.doi.org/10.1145/2883851.2883864
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Journal of Learning Analytics
This work is licensed under a Creative Commons Attribution 4.0 International License.
