How Teacher Characteristics Relate to How Teachers Use Dashboards
Results From Two Case Studies in K-12
DOI:
https://doi.org/10.18608/jla.2021.7325Keywords:
teacher dashboards, teacher characteristics, K-12Abstract
Teacher dashboards are a specific form of analytics in which visual displays provide teachers with information about their students; for example, concerning student progress and performance on tasks during lessons or lectures. In the present paper, we focus on the role of teacher dashboards in the context of teacher decision-making in K–12 education. There is large variation in teacher dashboard use in the classroom, which could be explained by teacher characteristics. Therefore, we investigate the role of teacher characteristics — such as experience, age, gender, and self-efficacy — in how teachers use dashboards. More specifically, we present two case studies to understand how diversity in teacher dashboard use is related to teacher characteristics. Surprisingly, in both case studies, teacher characteristics were not associated with dashboard use. Based on our findings, we propose an initial framework to understand what contributes to diversity of dashboard use. This framework might support future research to attribute diversity in dashboard use. This paper should be seen as a first step in examining the role of teacher characteristics in dashboard use in K–12 education.
References
Admiraal, W., Louws, M., Lockhorst, D., Paas, T., Buynsters, M., Cviko, A., … & Kester, L. (2017). Teachers in school-based technology innovations: A typology of their beliefs on teaching and technology. Computers and Education, 114, 57–68. https://doi.org/10.1016/j.compedu.2017.06.013
Aleven, V., McLaughlin, E. A., Glenn, R. A., & Koedinger, K. R. (2016). Instruction based on adaptive learning technologies. In R. E. Mayer & P. Alexander (Eds.), Handbook of research on learning and instruction. Abingdon-on-Thames, UK: Routledge.
Ballet, K., & Kelchtermans, G. (2009). Struggling with workload: Primary teachers’ experience of intensification. Teaching and Teacher Education, 25(8), 1150–1157. https://doi.org/10.1016/j.tate.2009.02.012
Buckingham Shum, S., Ferguson, R., & Martinez-Maldonado, R. (2019). Human-centred learning analytics. Journal of Learning Analytics, 6(2), 1–9. https://doi.org/10.18608/jla.2019.62.1
Butler, D. L., & Winne, P. H. (1995). Feedback and self-regulated learning: A theoretical synthesis. Review of Educational Research, 65(3), 245–281. https://doi.org/10.3102/00346543065003245
de Jager, B., Jansen, M., & Reezigt, G. (2005). The development of metacognition in primary school learning environments. School Effectiveness and School Improvement, 16(2), 179–196. https://doi.org/10.1080/09243450500114181
Elo, A. (1978). The rating of chess players, past and present. New York: Arco.
Gillies, R. M., Ashman, A., & Terwel, J. (Eds.) (2008). The teacher’s role in implementing cooperative learning in the classroom. New York: Springer. https://doi.org/10.1007/978-0-387-70892-8
Gudmundsdottir, S., & Shulman, L. (1987). Pedagogical content knowledge in social studies. Scandinavian Journal of Educational Research, 31(2), 59–70. https://doi.org/10.1080/0031383870310201
Hattie, J. (2012). Visible learning for teachers: Maximizing impact on learning. Abingdon-on-Thames, UK: Routledge.
Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112. https://doi.org/10.3102/003465430298487
Herodotou, C., Rienties, B., Boroowa, A., Zdrahal, Z., & Hlosta, M. (2019). A large-scale implementation of predictive learning analytics in higher education: The teachers’ role and perspective. Educational Technology Research and Development, 67(5), 1273–1306. https://doi.org/10.1007/s11423-019-09685-0
Hutchins, E. (2000). Distributed cognition. In International encyclopedia of the social and behavioral sciences. Amsterdam, Netherlands: Elsevier Science.
Kaiser, J., Südkamp, A., & Möller, J. (2017). The effects of student characteristics on teachers’ judgment accuracy: Disentangling ethnicity, minority status, and achievement. Journal of Educational Psychology, 109(6), 871–888. https://doi.org/10.1037/edu0000156
Keuvelaar-van den Bergh, L. (2013). Teacher feedback during active learning: The development and evaluation of a professional development programme. https://surfsharekit.nl/publiek/fontys/9d02c698-55da-43c2-8390-99483f29e010
Knoop-van Campen, C. A. N, & Molenaar, I. (2020). How teachers integrate dashboards into their feedback practices. Frontline Learning Research, 8(4), 37–51. http://doi.org/10.14786/flr.v8i4.641
Lin, T.-C., Tsai, C.-C., Chai, C. S., & Lee, M.-H. (2013). Identifying science teachers’ perceptions of technological pedagogical and content knowledge (TPACK). Journal of Science Education and Technology, 22(3), 325–336. https://doi.org/10.1007/s10956-012-9396-6
Mandinach, E. B., & Gummer, E. S. (2016). What does it mean for teachers to be data literate: Laying out the skills, knowledge, and dispositions. Teaching and Teacher Education, 60, 366–376. https://doi.org/10.1016/j.tate.2016.07.011
MathTutor (2018). https://mathtutor.web.cmu.edu/
Martinez-Maldonado, R., Clayphan, A., Yacef, K., & Kay, J. (2014). MTFeedback: Providing notifications to enhance teacher awareness of small group work in the classroom. IEEE Transactions on Learning Technologies, 8(2), 187–200. https://doi.org/10.1109/TLT.2014.2365027
Melero, J., Hernández-Leo, D., Sun, J., Santos, P., & Blat, J. (2015). How was the activity? A visualization support for a case of location-based learning design. British Journal of Educational Technology, 46(2), 317–329. https://doi.org/10.1111/bjet.12238
Molenaar, I., & Knoop-van Campen, C. A. N. (2017a). Teacher dashboards in practice: Usage and impact. Proceedings of the 12th European Conference on Technology Enhanced Learning (EC-TEL 2017), 12–15 September 2017, Tallinn, Estonia (pp. 125–138). Lecture Notes in Computer Science. Springer, Cham. https://doi.org/10.1007/978-3-319-66610-5_10
Molenaar, I., & Knoop-van Campen, C. A. N. (2017b). How teachers differ in using dashboards: The classroom observation app. Paper presented at the Multimodal Learning Analytics Across (Physical and Digital) Spaces workshop at the 12th European Conference on Technology Enhanced Learning (EC-TEL 2017), 12–15 September 2017, Tallinn, Estonia.
Molenaar, I., & Knoop-van Campen, C. (2019). How teachers make dashboard information actionable. IEEE Transactions on Learning Technologies 12(3), 347–355. https://doi.org/10.1109/TLT.2018.2851585
Mueller, J., Wood, E., Willoughby, T., Ross, C., & Specht, J. (2008). Identifying discriminating variables between teachers who fully integrate computers and teachers with limited integration. Computers and Education, 51(4), 1523–1537. https://doi.org/10.1016/j.compedu.2008.02.003
Rienties, B., Herodotou, C., Olney, T., Schencks, M., & Boroowa, A. (2018). Making sense of learning analytics dashboards: A technology acceptance perspective of 95 teachers. International Review of Research in Open and Distributed Learning, 19(5). https://doi.org/10.19173/irrodl.v19i5.3493
Roelofs, E., & Sanders, P. (2007). Towards a framework for assessing teacher competence. European Journal of Vocational Training, 40(1), 123–139. https://files.eric.ed.gov/fulltext/EJ776614.pdf
Schwarz, B. B., & Asterhan, C. S. (2011). E-moderation of synchronous discussions in educational settings: A nascent practice. Journal of the Learning Sciences, 20(3), 395–442. https://doi.org/10.1080/10508406.2011.553257
Schwendimann, B., Rodriguez-Triana, M., Vozniuk, A., Prieto, L., Boroujeni, M., Holzer, A., … Dillenbourg, P. (2017). Perceiving learning at a glance: A systematic literature review of learning dashboard research. IEEE Transactions on Learning Technologies, 10(1), 30–41. https://doi.org/10.1109/TLT.2016.2599522
Sergis, S., & Sampson, D. G. (2017). Teaching and learning analytics to support teacher inquiry: A systematic literature review. In A. Peña-Ayala (Ed.), Learning Analytics: Fundaments, Applications, and Trends (pp. 25–63). Springer.
Shute, V. J. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153–189. https://doi.org/10.3102/0034654307313795
Siemens, G., & Gašević, D. (2012). Guest editorial: Learning and knowledge analytics. Journal of Educational Technology & Society, 15(3), 1–2.
Teo, T. (2010). Measuring the effect of gender on computer attitudes among pre-service teachers: A multiple indicators, multiple causes (MIMIC) modeling. Campus-Wide Information Systems, 27(4), 227–239. http://doi.org/10.1108/10650741011073770
Van Es, E. A., & Sherin, M. G. (2002). Learning to notice: Scaffolding new teachers’ interpretations of classroom interactions. Journal of Technology and Teacher Education, 10(4), 571–596. Retrieved from https://www.learntechlib.org/primary/p/9171/
Van den Bergh, L., Ros, A., & Beijaard, D. (2013). Teacher feedback during active learning: Current practices in primary schools. British Journal of Educational Psychology, 83(2), 341–362. http://doi.org/10.1111/j.2044-8279.2012.02073.x
Van Den Bosch, R. M., Espin, C. A., Chung, S., & Saab, N. (2017). Data‐based decision‐making: Teachers’ comprehension of curriculum‐based measurement progress‐monitoring graphs. Learning Disabilities Research and Practice, 32(1), 46–60. https://doi.org/10.1111/ldrp.12122
Van Leeuwen, A., Janssen, J., Erkens, G., & Brekelmans, M. (2014). Supporting teachers in guiding collaborating students: Effects of learning analytics in CSCL. Computers & Education, 79, 28–39. https://doi.org/10.1016/j.compedu.2014.07.007
Van Leeuwen, A., Janssen, J., Erkens, G., & Brekelmans, M. (2015). Teacher regulation of cognitive activities during student collaboration: Effects of learning analytics. Computers & Education, 90, 80–94. https://doi.org/10.1016/j.compedu.2015.09.006
Van Leeuwen, A., & Janssen, J. (2019). A systematic review of teacher guidance during collaborative learning in primary and secondary education. Educational Research Review, 27, 71–89. https://doi.org/10.1016/j.edurev.2019.02.001
Van Leeuwen, A., Rummel, N., & van Gog, T. (2019). What information should CSCL teacher dashboards provide to help teachers interpret CSCL situations? International Journal of Computer-Supported Collaborative Learning, 14, 261–289. https://doi.org/10.1007/s11412-019-09299-x
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly, 27(3), 425-478. http://doi.org/10.2307/30036540
Verbert, K., Govaerts, S., Duval, E., Santos, J. L., Van Assche, F., Parra, G., & Klerkx, J. (2014). Learning dashboards: An overview and future research opportunities. Personal and Ubiquitous Computing, 18(6), 1499–1514. https://doi.org/10.1007/s00779-013-0751-2
Verloop, N., Van Driel, J., & Meijer, P. (2001). Teacher knowledge and the knowledge base of teaching. International Journal of Educational Research, 35(5), 441–461. https://doi.org/10.1016/S0883-0355(02)00003–4
Wise, A. F., & Jung, Y. (2019). Teaching with analytics: Towards a situated model of instructional decision-making. Journal of Learning Analytics, 6(2). https://doi.org/10.18608/jla.2019.62.4
Wong, K.-T., Teo, T., & Russo, S. (2012). Influence of gender and computer teaching efficacy on computer acceptance among Malaysian student teachers: An extended technology acceptance model. Australasian Journal of Educational Technology, 28(7), 1190–1207. https://doi.org/10.14742/ajet.796
Xhakaj, F., Aleven, V., & McLaren, B. M. (2017). Effects of a teacher dashboard for an intelligent tutoring system on teacher knowledge, lesson planning, lessons and student learning. Proceedings of the 12th European Conference on Technology Enhanced Learning (EC-TEL 2017), 12–15 September 2017, Tallinn, Estonia (pp. 315–329). Lecture Notes in Computer Science. Springer, Cham. https://doi.org/10.1007/978-3-319-66610-5_23
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2021 Journal of Learning Analytics
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Authors who publish with this journal agree to the following terms:- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons License, Attribution - NonCommercial-NoDerivs 3.0 Unported (CC BY-NC-ND 3.0) license that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
