How Teacher Characteristics Relate to How Teachers Use Dashboards

Results From Two Case Studies in K-12

Authors

DOI:

https://doi.org/10.18608/jla.2021.7325

Keywords:

teacher dashboards, teacher characteristics, K-12

Abstract

Teacher dashboards are a specific form of analytics in which visual displays provide teachers with information about their students; for example, concerning student progress and performance on tasks during lessons or lectures. In the present paper, we focus on the role of teacher dashboards in the context of teacher decision-making in K–12 education. There is large variation in teacher dashboard use in the classroom, which could be explained by teacher characteristics. Therefore, we investigate the role of teacher characteristics — such as experience, age, gender, and self-efficacy — in how teachers use dashboards. More specifically, we present two case studies to understand how diversity in teacher dashboard use is related to teacher characteristics. Surprisingly, in both case studies, teacher characteristics were not associated with dashboard use. Based on our findings, we propose an initial framework to understand what contributes to diversity of dashboard use. This framework might support future research to attribute diversity in dashboard use. This paper should be seen as a first step in examining the role of teacher characteristics in dashboard use in K–12 education.

References

Admiraal, W., Louws, M., Lockhorst, D., Paas, T., Buynsters, M., Cviko, A., … & Kester, L. (2017). Teachers in school-based technology innovations: A typology of their beliefs on teaching and technology. Computers and Education, 114, 57–68. https://doi.org/10.1016/j.compedu.2017.06.013

Aleven, V., McLaughlin, E. A., Glenn, R. A., & Koedinger, K. R. (2016). Instruction based on adaptive learning technologies. In R. E. Mayer & P. Alexander (Eds.), Handbook of research on learning and instruction. Abingdon-on-Thames, UK: Routledge.

Ballet, K., & Kelchtermans, G. (2009). Struggling with workload: Primary teachers’ experience of intensification. Teaching and Teacher Education, 25(8), 1150–1157. https://doi.org/10.1016/j.tate.2009.02.012

Buckingham Shum, S., Ferguson, R., & Martinez-Maldonado, R. (2019). Human-centred learning analytics. Journal of Learning Analytics, 6(2), 1–9. https://doi.org/10.18608/jla.2019.62.1

Butler, D. L., & Winne, P. H. (1995). Feedback and self-regulated learning: A theoretical synthesis. Review of Educational Research, 65(3), 245–281. https://doi.org/10.3102/00346543065003245

de Jager, B., Jansen, M., & Reezigt, G. (2005). The development of metacognition in primary school learning environments. School Effectiveness and School Improvement, 16(2), 179–196. https://doi.org/10.1080/09243450500114181

Elo, A. (1978). The rating of chess players, past and present. New York: Arco.

Gillies, R. M., Ashman, A., & Terwel, J. (Eds.) (2008). The teacher’s role in implementing cooperative learning in the classroom. New York: Springer. https://doi.org/10.1007/978-0-387-70892-8

Gudmundsdottir, S., & Shulman, L. (1987). Pedagogical content knowledge in social studies. Scandinavian Journal of Educational Research, 31(2), 59–70. https://doi.org/10.1080/0031383870310201

Hattie, J. (2012). Visible learning for teachers: Maximizing impact on learning. Abingdon-on-Thames, UK: Routledge.

Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112. https://doi.org/10.3102/003465430298487

Herodotou, C., Rienties, B., Boroowa, A., Zdrahal, Z., & Hlosta, M. (2019). A large-scale implementation of predictive learning analytics in higher education: The teachers’ role and perspective. Educational Technology Research and Development, 67(5), 1273–1306. https://doi.org/10.1007/s11423-019-09685-0

Hutchins, E. (2000). Distributed cognition. In International encyclopedia of the social and behavioral sciences. Amsterdam, Netherlands: Elsevier Science.

Kaiser, J., Südkamp, A., & Möller, J. (2017). The effects of student characteristics on teachers’ judgment accuracy: Disentangling ethnicity, minority status, and achievement. Journal of Educational Psychology, 109(6), 871–888. https://doi.org/10.1037/edu0000156

Keuvelaar-van den Bergh, L. (2013). Teacher feedback during active learning: The development and evaluation of a professional development programme. https://surfsharekit.nl/publiek/fontys/9d02c698-55da-43c2-8390-99483f29e010

Knoop-van Campen, C. A. N, & Molenaar, I. (2020). How teachers integrate dashboards into their feedback practices. Frontline Learning Research, 8(4), 37–51. http://doi.org/10.14786/flr.v8i4.641

Lin, T.-C., Tsai, C.-C., Chai, C. S., & Lee, M.-H. (2013). Identifying science teachers’ perceptions of technological pedagogical and content knowledge (TPACK). Journal of Science Education and Technology, 22(3), 325–336. https://doi.org/10.1007/s10956-012-9396-6

Mandinach, E. B., & Gummer, E. S. (2016). What does it mean for teachers to be data literate: Laying out the skills, knowledge, and dispositions. Teaching and Teacher Education, 60, 366–376. https://doi.org/10.1016/j.tate.2016.07.011

MathTutor (2018). https://mathtutor.web.cmu.edu/

Martinez-Maldonado, R., Clayphan, A., Yacef, K., & Kay, J. (2014). MTFeedback: Providing notifications to enhance teacher awareness of small group work in the classroom. IEEE Transactions on Learning Technologies, 8(2), 187–200. https://doi.org/10.1109/TLT.2014.2365027

Melero, J., Hernández-Leo, D., Sun, J., Santos, P., & Blat, J. (2015). How was the activity? A visualization support for a case of location-based learning design. British Journal of Educational Technology, 46(2), 317–329. https://doi.org/10.1111/bjet.12238

Molenaar, I., & Knoop-van Campen, C. A. N. (2017a). Teacher dashboards in practice: Usage and impact. Proceedings of the 12th European Conference on Technology Enhanced Learning (EC-TEL 2017), 12–15 September 2017, Tallinn, Estonia (pp. 125–138). Lecture Notes in Computer Science. Springer, Cham. https://doi.org/10.1007/978-3-319-66610-5_10

Molenaar, I., & Knoop-van Campen, C. A. N. (2017b). How teachers differ in using dashboards: The classroom observation app. Paper presented at the Multimodal Learning Analytics Across (Physical and Digital) Spaces workshop at the 12th European Conference on Technology Enhanced Learning (EC-TEL 2017), 12–15 September 2017, Tallinn, Estonia.

Molenaar, I., & Knoop-van Campen, C. (2019). How teachers make dashboard information actionable. IEEE Transactions on Learning Technologies 12(3), 347–355. https://doi.org/10.1109/TLT.2018.2851585

Mueller, J., Wood, E., Willoughby, T., Ross, C., & Specht, J. (2008). Identifying discriminating variables between teachers who fully integrate computers and teachers with limited integration. Computers and Education, 51(4), 1523–1537. https://doi.org/10.1016/j.compedu.2008.02.003

Rienties, B., Herodotou, C., Olney, T., Schencks, M., & Boroowa, A. (2018). Making sense of learning analytics dashboards: A technology acceptance perspective of 95 teachers. International Review of Research in Open and Distributed Learning, 19(5). https://doi.org/10.19173/irrodl.v19i5.3493

Roelofs, E., & Sanders, P. (2007). Towards a framework for assessing teacher competence. European Journal of Vocational Training, 40(1), 123–139. https://files.eric.ed.gov/fulltext/EJ776614.pdf

Schwarz, B. B., & Asterhan, C. S. (2011). E-moderation of synchronous discussions in educational settings: A nascent practice. Journal of the Learning Sciences, 20(3), 395–442. https://doi.org/10.1080/10508406.2011.553257

Schwendimann, B., Rodriguez-Triana, M., Vozniuk, A., Prieto, L., Boroujeni, M., Holzer, A., … Dillenbourg, P. (2017). Perceiving learning at a glance: A systematic literature review of learning dashboard research. IEEE Transactions on Learning Technologies, 10(1), 30–41. https://doi.org/10.1109/TLT.2016.2599522

Sergis, S., & Sampson, D. G. (2017). Teaching and learning analytics to support teacher inquiry: A systematic literature review. In A. Peña-Ayala (Ed.), Learning Analytics: Fundaments, Applications, and Trends (pp. 25–63). Springer.

Shute, V. J. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153–189. https://doi.org/10.3102/0034654307313795

Siemens, G., & Gašević, D. (2012). Guest editorial: Learning and knowledge analytics. Journal of Educational Technology & Society, 15(3), 1–2.

Teo, T. (2010). Measuring the effect of gender on computer attitudes among pre-service teachers: A multiple indicators, multiple causes (MIMIC) modeling. Campus-Wide Information Systems, 27(4), 227–239. http://doi.org/10.1108/10650741011073770

Van Es, E. A., & Sherin, M. G. (2002). Learning to notice: Scaffolding new teachers’ interpretations of classroom interactions. Journal of Technology and Teacher Education, 10(4), 571–596. Retrieved from https://www.learntechlib.org/primary/p/9171/

Van den Bergh, L., Ros, A., & Beijaard, D. (2013). Teacher feedback during active learning: Current practices in primary schools. British Journal of Educational Psychology, 83(2), 341–362. http://doi.org/10.1111/j.2044-8279.2012.02073.x

Van Den Bosch, R. M., Espin, C. A., Chung, S., & Saab, N. (2017). Data‐based decision‐making: Teachers’ comprehension of curriculum‐based measurement progress‐monitoring graphs. Learning Disabilities Research and Practice, 32(1), 46–60. https://doi.org/10.1111/ldrp.12122

Van Leeuwen, A., Janssen, J., Erkens, G., & Brekelmans, M. (2014). Supporting teachers in guiding collaborating students: Effects of learning analytics in CSCL. Computers & Education, 79, 28–39. https://doi.org/10.1016/j.compedu.2014.07.007

Van Leeuwen, A., Janssen, J., Erkens, G., & Brekelmans, M. (2015). Teacher regulation of cognitive activities during student collaboration: Effects of learning analytics. Computers & Education, 90, 80–94. https://doi.org/10.1016/j.compedu.2015.09.006

Van Leeuwen, A., & Janssen, J. (2019). A systematic review of teacher guidance during collaborative learning in primary and secondary education. Educational Research Review, 27, 71–89. https://doi.org/10.1016/j.edurev.2019.02.001

Van Leeuwen, A., Rummel, N., & van Gog, T. (2019). What information should CSCL teacher dashboards provide to help teachers interpret CSCL situations? International Journal of Computer-Supported Collaborative Learning, 14, 261–289. https://doi.org/10.1007/s11412-019-09299-x

Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly, 27(3), 425-478. http://doi.org/10.2307/30036540

Verbert, K., Govaerts, S., Duval, E., Santos, J. L., Van Assche, F., Parra, G., & Klerkx, J. (2014). Learning dashboards: An overview and future research opportunities. Personal and Ubiquitous Computing, 18(6), 1499–1514. https://doi.org/10.1007/s00779-013-0751-2

Verloop, N., Van Driel, J., & Meijer, P. (2001). Teacher knowledge and the knowledge base of teaching. International Journal of Educational Research, 35(5), 441–461. https://doi.org/10.1016/S0883-0355(02)00003–4

Wise, A. F., & Jung, Y. (2019). Teaching with analytics: Towards a situated model of instructional decision-making. Journal of Learning Analytics, 6(2). https://doi.org/10.18608/jla.2019.62.4

Wong, K.-T., Teo, T., & Russo, S. (2012). Influence of gender and computer teaching efficacy on computer acceptance among Malaysian student teachers: An extended technology acceptance model. Australasian Journal of Educational Technology, 28(7), 1190–1207. https://doi.org/10.14742/ajet.796

Xhakaj, F., Aleven, V., & McLaren, B. M. (2017). Effects of a teacher dashboard for an intelligent tutoring system on teacher knowledge, lesson planning, lessons and student learning. Proceedings of the 12th European Conference on Technology Enhanced Learning (EC-TEL 2017), 12–15 September 2017, Tallinn, Estonia (pp. 315–329). Lecture Notes in Computer Science. Springer, Cham. https://doi.org/10.1007/978-3-319-66610-5_23

Downloads

Published

2021-09-03

How to Cite

van Leeuwen, A., Knoop-van Campen, C. A. N., Molenaar, I., & Rummel, N. (2021). How Teacher Characteristics Relate to How Teachers Use Dashboards: Results From Two Case Studies in K-12. Journal of Learning Analytics, 8(2), 6-21. https://doi.org/10.18608/jla.2021.7325

Issue

Section

Special Section: Learning Analytics for Primary and Secondary Schools

Most read articles by the same author(s)