Learning Design and Learning Analytics: Snapshot 2020
Keywords:learning analytics, learning design
“Learning design” belongs to that interesting class of concepts that appear on the surface to be simple and self-explanatory, but which are actually definitionally vague and contested in practice. Like “learning analytics,” the field of learning design aspires to improve teaching practice, the learning experience, and learning outcomes. And like learning analytics, this interdisciplinary field also lacks a shared language, common vocabulary, or agreement over its definition and purpose, resulting in uncertainty even about who its practitioners are — Educators? Designers? Researchers? All of these? (Law, Li, Farias Herrera, Chan & Pong, 2017). Almost a decade ago, however, learning analytics researchers pointed to the rich potential for synergies between learning analytics and learning design (Lockyer & Dawson, 2011). These authors (and others since, as cited below) argued that effective alignment of learning analytics and learning design would benefit both fields, and would offer educators and investigators the evidence they need that their efforts and innovations in learning design are “worth it” in terms of improving teaching practice and learning: "The integration of research related to both learning design and learning analytics provides the necessary contextual overlay to better understand observed student behavior and provide the necessary pedagogical recommendations where learning behavior deviates from pedagogical intention" (Lockyer & Dawson, 2011, p. 155).
Bakharia, A., Corrin, L., De Barba, P., Kennedy, G., Gašević, D., Mulder, R., … Lockyer, L. (2016). A conceptual framework linking learning design with learning analytics. Proceedings of the 6th International Conference on Learning Analytics and Knowledge (LAK ʼ16), 25–29 April 2016, Edinburgh, UK (pp. 329–338). New York, NY: ACM. https://dx.doi.org/10.1145/2883851.2883944
Bennett, S., Lockyer, L., & Agostinho, S. (2018). Towards sustainable technology-enhanced innovation in higher education: Advancing learning design by understanding and supporting teacher design practice. British Journal of Educational Technology, 49(6), 1014–1026. https://dx.doi.org/10.1111/bjet.12683
Conole, G. (2012). Designing for learning in an open world. New York, NY: Springer Science & Business Media.
Corrin, L., Kennedy, G., de Barba, P. G., Lockyer, L., Gašević, D., Williams, D., … Bakharia, A. (2016). Completing the loop: Returning meaningful learning analytic data to teachers. A handbook for educators and learning analytics specialists. Sydney, NSW, Australia: Government of Australia Office for Learning and Teaching. Retrieved from https://melbourne-cshe.unimelb.edu.au/__data/assets/pdf_file/0006/2083938/Loop_Handbook.pdf
Corrin, L., Law, N., Ringtved, U., & Milligan, S. (2018). DesignLAK18: Evaluating systems and tools that link learning analytics and learning design. Companion Proceedings of the 8th International Conference on Learning Analytics and Knowledge: Towards User-Centred Learning Analytics (LAK ’18), 5–9 March 2018, Sydney, NSW, Australia (pp. 1–5). Beaumont, AB, Canada: Society for Learning Analytics Research (SoLAR). Retrieved from http://bit.ly/lak18-companion-proceedings
Donald, C., Blumenstein, M., McDonald, J., Milne, J., & Gunn, C. (2016). Matching the rhythms of teaching to learning analytics. Paper presented at the International Consortium of Educational Developers and the Higher Education Learning and Teaching Association of Southern Africa (ICED/HELTASA).
Fritz, J. (2016). LMS course design as learning analytics variable. Paper presented at the 1st Learning Analytics for Curriculum and Program Quality Improvement Workshop (PCLA 2016). Companion Proceedings of the 6th International Conference on Learning Analytics and Knowledge: Towards User-Centred Learning Analytics (LAK ’16), 25–29 April 2016, Edinburgh, UK (pp. 15–19). Beaumont, AB, Canada: Society for Learning Analytics Research (SoLAR). Retrieved from http://ceur-ws.org/Vol-1590/
Gagnon, G. W., & Collay, M. (2005). Constructivist learning design: Key questions for teaching to standards. Thousand Oaks, CA: Corwin Press.
Gašević, D., Dawson, S., Rogers, T., & Gasevic, D. (2016). Learning analytics should not promote one size fits all: The effects of instructional conditions in predicting academic success. The Internet and Higher Education, 28, 68–84. https://dx.doi.org/10.1016/j.iheduc.2015.10.002
Gašević, D., Dawson, S., & Siemens, G. (2015). Let’s not forget: Learning analytics are about learning. TechTrends, 59(1), 64–71. https://dx.doi.org/10.1007/s11528-014-0822-x
Hernández-Leo, D., Martinez-Maldonado, R., Pardo, A., Muñoz-Cristóbal, J. A., & Rodríguez-Triana, M. J. (2019). Analytics for learning design: A layered framework and tools. British Journal of Educational Technology, 50(1), 139–152. https://dx.doi.org/10.1111/bjet.12645
Knight, S., Buckingham Shum, S., & Littleton, K. (2013). Epistemology, pedagogy, assessment and learning analytics. Proceedings of the 3rd International Conference on Learning Analytics and Knowledge (LAK ’13), 8–12 April 2013, Leuven, Belgium (pp. 75–84). New York, NY: ACM. https://dx.doi.org/10.1145/2460296.2460312
Koh, E., Shibani, A., Tan, J. P.-L., & Hong, H. (2016). A pedagogical framework for learning analytics in collaborative inquiry tasks: An example from a teamwork competency awareness program. Proceedings of the 6th International Conference on Learning Analytics and Knowledge (LAK ʼ16), 25–29 April 2016, Edinburgh, Scotland (pp. 74–83). New York: ACM. https://dx.doi.org/10.1145/2883851.2883914
Koper, R. (2006). Current research in learning design. Journal of Educational Technology & Society, 9(1), 13–22.
Law, N., Li, L., Farias Herrera, L., Chan, A., & Pong, T. C. (2017). A pattern language based learning design studio for an analytics informed inter-professional design community. Interaction Design and Architecture(s) Journal, 33, 92–-112. Retrieved from http://www.mifav.uniroma2.it/inevent/events/idea2010/doc/33_5.pdf
Lockyer, L., & Dawson, S. (2011). Learning designs and learning analytics. In P. Long, G. Siemens, G. Conole, & D. Gašević (Eds.), Proceedings of the 1st International Conference on Learning Analytics and Knowledge (LAK ʼ11), 27 February–1 March 2011, Banff, AB, Canada (pp. 153–156). New York, NY: ACM. https://dx.doi.org/10.1145/2090116.2090140
Lockyer, L., Heathcote, E., & Dawson, S. (2013). Informing pedagogical action: Aligning learning analytics with learning design. American Behavioral Scientist, 57(10), 1439–1459. https://dx.doi.org/10.1177/0002764213479367
Mangaroska, K., & Giannakos, M. (2019). Learning analytics for learning design: A systematic literature review of analytics-driven design to enhance learning. IEEE Transactions on Learning Technologies, 12(4), 516–534. https://dx.doi.org/10.1109/TLT.2018.2868673
Mor, Y., & Craft, B. (2012). Learning design: Reflections upon the current landscape. Research in Learning Technology, 20, 85–94. https://dx.doi.org/10.3402/rlt.v20i0.19196
Mor, Y., Craft, B., & Maina, M. (2015). Introduction. Learning design: Definitions, current issues and grand challenges. In Y. Mor, B. Craft, & M. Maina (Eds.), The art & science of learning design (pp. ix–xxvi). Rotterdam, NL: Sense.
Nguyen, Q., Huptych, M., & Rienties, B. (2018). Using temporal analytics to detect inconsistencies between learning design and students’ behaviours. Journal of Learning Analytics, 5(3), 120–135. https://dx.doi.org/10.18608/jla.2018.53.8
Nguyen, Q., Rienties, B., Toetenel, L., Ferguson, R., & Whitelock, D. (2017). Examining the designs of computer-based assessment and its impact on student engagement, satisfaction, and pass rates. Computers in Human Behavior, 76, 703–714. https://dx.doi.org/10.1016/j.chb.2017.03.028
Persico, D., & Pozzi, F. (2015). Informing learning design with learning analytics to improve teacher inquiry. British Journal of Educational Technology, 46(2), 230–248. https://dx.doi.org/10.1111/bjet.12207
Reiser, R. A., & Dempsey, J. V. (2007). Trends and issues in instructional design and technology. Boston, MA: Allyn & Bacon.
Rienties, B., Nguyen, Q., Holmes, W., & Reedy, K. (2017). A review of ten years of implementation and research in aligning learning design with learning analytics at the Open University UK. Interaction Design and Architecture(s) Journal, 33, 134–154. Retrieved from http://www.mifav.uniroma2.it/inevent/events/idea2010/doc/33_7.pdf
Rienties, B., & Toetenel, L. (2016). The impact of learning design on student behaviour, satisfaction and performance: A cross-institutional comparison across 151 modules. Computers in Human Behavior, 60, 333–341. https://dx.doi.org/10.1016/j.chb.2016.02.074
Schmitz, M., Van Limbeek, E., Greller, W., Sloep, P., & Drachsler, H. (2017). Opportunities and challenges in using learning analytics in learning design. Proceedings of the 12th European Conference on Technology Enhanced Learning (EC-TEL 2017), 12–15 September 2017, Tallinn, Estonia.Lecture Notes in Computer Science (pp. 209–223). Cham, Switzerland: Springer. https://dx.doi.org/10.1007/978-3-319-66610-5_16
Schott, F., & Seel, N. M. (2015). Instructional design. In International encyclopedia of the social and behavioral sciences (2nd ed., pp. 196–200). Oxford, UK: Elsevier. https://dx.doi.org/10.1016/B978-0-08-097086-8.92032-4
Seel, N. M., Lehmann, T., Blumschein, P., & Podolskiy, O. A. (2017). Instructional design for learning: Theoretical foundations. Rotterdam, NL: Sense.
Stewart, C. (2017). Learning analytics: Shifting from theory to practice. Journal on Empowering Teaching Excellence, 1(1), 10. https://dx.doi.org/10.15142/T3G63W
Wise, A. (2014). Designing pedagogical interventions to support student use of learning analytics. Proceedings of the 4th International Conference on Learning Analytics and Knowledge (LAK ʼ14), 24–28 March 2014, Indianapolis, IN, USA (pp. 203–211). New York, NY: ACM. https://dx.doi.org/10.1145/2567574.2567588
Wise, A., & Vytasek, J. (2017). Learning analytics implementation design. In C. Lang, G. Siemens, A. F. Wise, & D. Gaševic (Eds.), The handbook of learning analytics (1st ed., pp. 151–160). Beaumont, AB: Society for Learning Analytics Research (SoLAR). https://dx.doi.org/10.18608/hla17.013
How to Cite
Copyright (c) 2020 Journal of Learning Analytics
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons License, Attribution - NonCommercial-NoDerivs 3.0 Unported (CC BY-NC-ND 3.0) license that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).