Student autonomy and Learning Analytics: Philosophical Considerations for Designing Feedback Tools
DOI:
https://doi.org/10.18608/jla.2024.8313Keywords:
philosophy of education, autonomy, higher education, applied ethics, artificial intelligence, feedback, self-regulated learning, self-determination, research paperAbstract
LA-based feedback applications are becoming increasingly important in higher education institutions (HEIs). However, the impact of such systems on student autonomy is contested in parts of the research debate, where hopes and ambitions of learner autonomy and self-regulated learning are confronted with fears that learners are being reduced to mere numeric constructs and are caught up in neoliberal demands to self-optimize. We explore these challenges from the debate with a focus on automated, LA feedback systems in HEIs and their impact on student autonomy. As we show, such technologies must be seen within a field of tension between heteronomous (i.e., contextual and societal) demands and autonomous, self-organized learning. Aiming to bridge the critical parts of the debate with those that highlight the potential of such technologies, we build upon meaningful conceptions of limited, situated autonomy and explore what it would mean for such feedback systems to strengthen, not undermine student autonomy. To make the concept of student autonomy applicable, we propose a list of philosophical design considerations for LA-based feedback systems. We believe that this will offer a philosophically informed intellectual tool to address common concerns raised by parts of the debate and that it can encourage further discussion on recognizing, promoting, and preserving student autonomy in higher education.
References
Bartosch, U., & Hiller, A.-K. (2019). Higher education with competence. A handbook on the qualifications framework for German higher education degrees (Framework for higher education: HQF) (S. Kieback, A.-K. Hillier, & U. Bartosch, Trans.). German Rectors’ Conference (HRK). http://www.hrk.de/fileadmin/redaktion/hrk/02-Dokumente/02-03-Studium/02-03-02-Qualifikationsrahmen/HQR_Handbook_en.pdf
Boud, D., & Dawson, P. (2023). What feedback literate teachers do: An empirically-derived competency framework. Assessment & Evaluation in Higher Education, 48(2), 158–171. https://doi.org/10.1080/02602938.2021.1910928
Buckingham Shum, S., Lim, L.-A., Boud, D., Bearman, M., & Dawson, P. (2023). A comparative analysis of the skilled use of automated feedback tools through the lens of teacher feedback literacy. International Journal of Educational Technology in Higher Education, 20(1), 40. https://doi.org/10.1186/s41239-023-00410-9
Buckingham Shum, S., Martínez-Maldonado, R., Dimitriadis, Y., & Santos, P. (2024). Human-centred learning analytics: 2019–24. British Journal of Educational Technology, 55(3), 755–768. https://doi.org/10.1111/bjet.13442
Cui, Y., Wise, A. F., & Allen, K. L. (2019). Developing reflection analytics for health professions education: A multi dimensional framework to align critical concepts with data features. Computers in Human Behavior, 100, 305–324. https://doi.org/10.1016/j.chb.2019.02.019
Damberger, T. (2021). Optimal verfehlt! Dem Phänomen Selftracking bildungsphilosophisch nachgedacht [Optimally missed! The phenomenon of self-tracking reflected on from an educational philosophy perspective]. Pädagogische Rundschau, 75(2), 181–188.
Dewey, J. (1980). The middle works, 1899–1924 (Vol. 9: 1919). Southern Illinois University Press.
Drachsler, H., & Greller, W. (2016). Privacy and analytics: It’s a DELICATE issue a checklist for trusted learning analytics. Proceedings of the 6th International Conference on Learning Analytics & Knowledge (LAK ’16), 25–29 April 2016, Edinburgh, UK (pp. 89–98). ACM Press. https://doi.org/10.1145/2883851.2883893
Floridi, L., & Sanders, J. W. (2004). On the morality of artificial agents. Minds and Machines, 14(3), 349–379. https://doi.org/10.1023/B:MIND.0000035461.63578.9d
Froehlich, L., & Weydner-Volkmann, S. (2024). Adaptive interventions reducing social identity threat to increase equity in higher distance education: A use case and ethical considerations on algorithmic fairness. Journal of Learning Analytics, 11(2), 112–122. https://doi.org/10.18608/jla.2024.8301
Holec, H. (1979). Autonomie et apprentissage des langues étrangères [Autonomy and learning foreign languages]. Council of Europe.
Ifenthaler, D. (2023). Ethische Perspektiven auf Künstliche Intelligenz im Kontext der Hochschule [Ethical perspectives on artificial intelligence in the context of higher education]. In T. Schmohl, A. Watanabe, & K. Schelling (Eds.), Künstliche Intelligenz in der Hochschulbildung: Chancen und Grenzen des KI-gestützten Lernens und Lehrens [Artificial intelligence in higher education: Opportunities and limitations of AI-supported learning and teaching] (pp. 71–86). transcript Verlag. https://doi.org/10.14361/9783839457696-004
Järvelä, S., Nguyen, A., & Molenaar, I. (2023). Advancing SRL research with artificial intelligence. Computers in Human Behavior, 147, 107847. https://doi.org/10.1016/j.chb.2023.107847
Jivet, I., Wong, J., Scheffel, M., Valle Torre, M., Specht, M., & Drachsler, H. (2021). Quantum of choice: How learners’ feedback monitoring decisions, goals and self-regulated learning skills are related. Proceedings of the 11th International Learning Analytics and Knowledge Conference (LAK ’21), 12–16 April 2021, Irvine, CA, USA (pp. 416–427). ACM Press. https://doi.org/10.1145/3448139.3448179
Jones, K. (2023). Guest editorial: The datafication of student life in higher education: Privacy problems and paths forward. Information and Learning Sciences, 124(9/10), 241–246. https://doi.org/10.1108/ILS-10-2023-265.
Kant, I. (2019). Grundlegung zur Metaphysik der Sitten [Groundwork of the metaphysics of morals] (T. Valentiner, Ed.). Reclam. (Originally published in 1785).
Karcher, M. (2020). Die (kybernetische) Bändigung des Zufalls: Dataveillance und Learning Analytics als Herausforderung erziehungswissenschaftlicher Reflexion: Versuch einer Technikfolgenabschätzung [The (cybernetic) taming of chance: Dataveillance and learning analytics as a challenge for educational reflection: An attempt at a technology assessment]. In D. Fickermann, V. Manitius, & M. Karcher (Eds.), „Neue Steuerung“ – Renaissance der Kybernetik? [“New control” – Renaissance of cybernetics?] (pp. 151–167). Waxmann Verlag GmbH. https://doi.org/10.31244/9783830991618.10
Knight, S., Buckingham Shum, S., & Littleton, K. (2014). Epistemology, assessment, pedagogy: Where learning meets analytics in the middle space. Journal of Learning Analytics, 1(2), 23‐47. https://doi.org/10.18608/jla.2014.12.3
Knight, S., Shibani, A., Abel, S., Gibson, A., Ryan, P., Sutton, N., Wight, R., Lucas, C., Sándor, Á., Kitto, K., Liu, M., Mogarkar, R. V., & Buckingham Shum, S. (2020). AcaWriter: A learning analytics tool for formative feedback on academic writing. Journal of Writing Research, 12(1), 141–186. https://doi.org/10.17239/jowr-2020.12.01.06
Matz, R., Schulz, K., Hanley, E., Derry, H., Hayward, B., Koester, B., Hayward, C., & McKay, T. (2021). Analyzing the efficacy of ECoach in supporting gateway course success through tailored support. Proceedings of the 11th International Learning Analytics and Knowledge Conference (LAK ’21), 12–16 April 2021, Irving, CA, USA (pp. 216–225). ACM Press. https://doi.org/10.1145/3448139.3448160
Meyer-Drawe, K. (1998). Streitfall „Autonomie”: Aktualität, Geschichte und Systematik einer modernen Selbstbeschreibung [The controversial issue of “autonomy”: Relevance, history and systematics of a modern self-description]. In W. Bauer (Ed.), Fragen nach dem Menschen in der umstrittenen Moderne [Questions about the human in the controversial modern era] (pp. 31–49). Baltmannsweiler.
Meyer-Drawe, K. (2015). Illusionen von Autonomie [Illusions of autonomy]. In K. Brücher (Ed.), Selbstbestimmung—Zur Analyse eines modernen Projekts [Self-determination: Analysis of a modern project] (pp. 25–41). Parodos.
Misselhorn, C. (2019). Grundfragen der Maschinenethik [Basic questions of machine ethics] (3rd ed.). Reclam.
Mougiakou, S., Vinatsella, D., Sampson, D., Papamitsiou, Z., Giannakos, M., & Ifenthaler, D. (2023). Educational data analytics for teachers and school leaders. Springer. https://doi.org/10.1007/978-3-031-15266-5.
Molloy, E., Boud, D., & Henderson, M. (2020). Developing a learning-centred framework for feedback literacy. Assessment & Evaluation in Higher Education, 45(4), 527–540. https://doi.org/10.1080/02602938.2019.1667955
Ochoa, X., & Merceron, A. (2018). Quantitative and qualitative analysis of the Learning Analytics and Knowledge Conference 2018. Journal of Learning Analytics, 5(3), 154–166. https://doi.org/10.18608/jla.2018.53.10
Oelkers, J. (2009). John Dewey und die Pädagogik [John Dewey and pedagogy]. Beltz.
Pape, H., & Kehrbaum, T. (2019). John Dewey: Über Bildung, Gewerkschaften und die demokratische Lebensform [John Dewey: On education, trade unions and the democratic way of life]. Hans-Böckler-Stiftung.
Peters, D., Calvo, R. A., & Ryan, R. M. (2018). Designing for motivation, engagement and wellbeing in digital experience. Frontiers in Psychology, 9, 797. https://doi.org/10.3389/fpsyg.2018.00797
Prinsloo, P., & Slade, S. (2017). Ethics and learning analytics: Charting the (un)charted. In C. Lang, G. Siemens, A. Wise, & D. Gašević (Eds.), The handbook of learning analytics (pp. 49–57). Society for Learning Analytics Research. https://doi.org/10.18608/hla17.004.
Reinisch, M. (2020). Big Data und Algorithmen: Instrumente einer neuen kybernetischen Steuerung an Schulen? [Big data and algorithms: Instruments of a new cybernetic control in schools?]. In D. Fickermann, V. Manitius, & M. Karcher (Eds.), „Neue Steuerung“ – Renaissance der Kybernetik? [“New control” – Renaissance of cybernetics?] (pp. 134–150). Waxmann Verlag GmbH. https://doi.org/10.31244/9783830991618.09
Reinmann, G. (2010). Selbstorganisation auf dem Prüfstand: Das Web 2.0 und seine Grenzen(losigkeit) [Self-organization under scrutiny: Web 2.0 and its limits (and lack of limits)]. In K.-U. Hugger & M. Walber (Eds.), Digitale Lernwelten: Konzepte, Beispiele und Perspektiven [Digital learning worlds: Concepts, examples and perspectives] (pp. 75–89). VS Verlag für Sozialwissenschaften. https://doi.org/10.1007/978-3-531-92365-9_5
Renner, B., Wesiak, G., Pammer-Schindler, V., Prilla, M., Müller, L., Morosini, D., Mora, S., Faltin, N., & Cress, U. (2020). Computer-supported reflective learning: How apps can foster reflection at work. Behaviour & Information Technology, 39(2), 167–187. https://doi.org/10.1080/0144929X.2019.1595726
Rössler, B. (2017). Autonomie: Ein Versuch über das gelungene Leben [Autonomy: An essay on a successful life]. Suhrkamp Verlag.
Ryan, R. M., & Deci, E. L. (2002). Overview of self-determination theory: An organismic dialectical perspective. In E. L. Deci & R. M. Ryan (Eds.), Handbook of self-determination research (pp. 3–33). The University Rochester Press.
Ryan, R. M., & Deci, E. L. (2020). Intrinsic and extrinsic motivation from a self-determination theory perspective: Definitions, theory, practices, and future directions. Contemporary Educational Psychology, 61, 101860. https://doi.org/10.1016/j.cedpsych.2020.101860
Sari, Y. E., & Karasu, G. (2020). Der Begriff „Autonomie“ in den pädagogischen Strömungen und sein geschichtlicher Hintergrund im Fremdsprachenunterricht [The concept of “autonomy” in different pedagogical paradigms and its historical background in foreign language teaching]. Diyalog Interkulturelle Zeitschrift Für Germanistik, 8(2), 412–430. https://doi.org/10.37583/diyalog.845601
Selwyn, N. (2019). What’s the problem with learning analytics? Journal of Learning Analytics, 6(3), 11–19. https://doi.org/10.18608/jla.2019.63.3.
Selwyn, N. (2020). Re-imagining ‘learning analytics’ … a case for starting again? The Internet and Higher Education, 46, 100745. https://doi.org/10.1016/j.iheduc.2020.100745.
Siemens, G. (2013). Learning analytics: The emergence of a discipline. American Behavioral Scientist, 57(10), 1380–1400. https://doi.org/10.1177/0002764213498851
Simbeck, K. (2022). Künstliche Intelligenz und Fairness im Bildungskontext [Artificial intelligence and fairness in the educational context]. In D. Verständig, C. Kast, J. Stricker, & A. Nürnberger (Eds.), Algorithmen und Autonomie: Interdisziplinäre Perspektiven auf das Verhältnis von Selbstbestimmung und Datenpraktiken [Algorithms and autonomy: Interdisciplinary perspectives on the relationship between self-determination and data practices] (pp. 91–100). Verlag Barbara Budrich. https://doi.org/10.3224/84742520
Slade, S., & Prinsloo, P. (2013). Learning analytics: Ethical issues and dilemmas. American Behavioral Scientist, 57(10), 1510–1529. https://doi.org/10.1177/0002764213479366
Summer, T. (2010). Key concept: Learner autonomy. Profil, 2, 7–10.
Verständig, D., Kast, C., Stricker, J., & Nürnberger, A. (2022). Einleitung [Introduction]. In D. Verständig, C. Kast, J. Stricker, & A. Nürnberger (Eds.), Algorithmen und Autonomie: Interdisziplinäre Perspektiven auf das Verhältnis von Selbstbestimmung und Datenpraktiken [Algorithms and autonomy: Interdisciplinary perspectives on the relationship between self-determination and data practices] (pp. 7–24). Verlag Barbara Budrich. https://doi.org/10.3224/84742520
Verständig, D., & Stricker, J. (2022). Berechnete Unbestimmtheit: Paradoxien der Freiheit im digitalen Zeitalter [Calculated indeterminacy: Paradoxes of freedom in the digital age]. In D. Verständig, C. Kast, J. Stricker, & A. Nürnberger (Eds.), Algorithmen und Autonomie: Interdisziplinäre Perspektiven auf das Verhältnis von Selbstbestimmung und Datenpraktiken [Algorithms and autonomy: Interdisciplinary perspectives on the relationship between self-determination and data practices] (pp. 25–48). Verlag Barbara Budrich. https://doi.org/10.3224/84742520
Viberg, O., Khalil, M., & Baars, M. (2020). Self-regulated learning and learning analytics in online learning environments: A review of empirical research. Proceedings of the 10th International Conference on Learning Analytics and Knowledge (LAK ’20), 23–27 March 2020, Frankfurt, Germany (pp. 524–533). ACM Press. https://doi.org/10.1145/3375462.3375483
Vigentini, L., Liu, D. Y. T., Arthars, N., & Dollinger, M. (2020). Evaluating the scaling of a LA tool through the lens of the SHEILA framework: A comparison of two cases from tinkerers to institutional adoption. The Internet and Higher Education, 45, 100728. https://doi.org/10.1016/j.iheduc.2020.100728
von Cube, F. (1965). Kybernetische Grundlagen des Lernens und Lehrens [Cybernetic foundations of learning and teaching]. Klett.
Wilson, T. S., & Ryg, M. A. (2015). Becoming autonomous: Nonideal theory and educational autonomy. Educational Theory, 65(2), 127–150. https://doi.org/10.1111/edth.12103
Winne, P. H. (2010). Bootstrapping learner’s self-regulated learning. Psychological Test and Assessment Modeling, 52(4), 472–490.
Winne, P. H. (2017). Learning analytics for self-regulated learning. In C. Lang, G. Siemens, A. Wise, & D. Gašević (Eds.), The handbook of learning analytics (pp. 241–249). Society for Learning Analytics Research. https://doi.org/10.18608/hla17.021
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education: Where are the educators? International Journal of Educational Technology in Higher Education, 16(1), 39. https://doi.org/10.1186/s41239-019-0171-0
Zimmerman, B. J. (1990). Self-regulated learning and academic achievement: An overview. Educational Psychologist, 25(1), 3–17. https://doi.org/10.1207/s15326985ep2501_2
Zimmerman, B. J., & Schunk, D. H. (Eds.). (2011). Handbook of self-regulation of learning and performance. Routledge.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Journal of Learning Analytics
This work is licensed under a Creative Commons Attribution 4.0 International License.
