Using Large Language Models for Automated Coding of Self-Regulated Learning Think-Aloud Protocol Data

Authors

DOI:

https://doi.org/10.18608/jla.2026.9025

Keywords:

large language models, self-regulated learning, think-aloud protocols, automated coding, STEM education, prompt engineering, research paper

Abstract

Documenting and understanding self-regulated learning (SRL) processes can inform the design of learning activities and scaffolds to enhance student success in STEM. Think-aloud protocols (TAPs)—prompting students to verbalize thoughts during task performance—reveal real-time, ecologically sensitive verbalizations of students’ SRL processes such as planning, monitoring, and strategy use. However, coding TAP data requires substantial resources. We investigated the capabilities of Large Language Models (LLMs) in automating the coding of SRL processes in TAPs across undergraduate STEM courses. To examine how task features, prompt engineering strategies, and SRL codes are linked to LLMs’ coding accuracy, we used a factorial design comparing different LLMs (GPT-4o, Claude 3.5 Sonnet, and Gemini 1.5 Pro) across six SRL TAP codes (representing distinct cognitive and metacognitive processes), six prompt conditions (varying few-shots and context levels), and two STEM tasks (mathematics and biology). Analysis of 600 student verbalizations revealed that mathematics tasks yielded significantly higher classification accuracy compared to biology tasks, with GPT-4o and Claude 3.5 Sonnet outperforming Gemini 1.5 Pro. Few-shot prompting showed code-specific effects, with descriptively higher accuracy for monitoring negative judgments of learning but significantly decreased accuracy for subgoal setting. The addition of contextual information showed minimal impact across tasks. Cognitive process TAP codes (e.g., mathematical problem-solving) demonstrated the most consistent cross-task classification accuracy. In contrast, metacognitive monitoring (e.g., judgment of learning) showed substantial task-dependent variations. These findings highlighted both the promise and limitations of LLMs for scaling SRL research. They suggest that theoretical alignment in prompt engineering is essential for effective automated coding of dynamic regulatory processes.

References

Ackerman, R., & Thompson, V. A. (2017). Meta-reasoning: Monitoring and control of thinking and reasoning. Trends in Cognitive Sciences, 21(8), 607-617. https://doi.org/10.1016/j.tics.2017.05.004

Alexander, P. A., Dinsmore, D. L., Parkinson, M. M., & Winters, F. I. (2011). Self-regulated learning in academic domains. In B. J. Zimmerman & D. H. Schunk (Eds.), Handbook of self-regulation of learning and performance (pp. 393-407). Routledge. https://doi.org/10.4324/9780203839010.ch25

Anderson, J. R. (1982). Acquisition of cognitive skill. Psychological Review, 89(4), 369. https://doi.org/10.1037/0033-295X.89.4.369

Anthropic. (2024). Claude 3.5: More capable, correct, and comprehensive. https://www.anthropic.com/news/claude-3-5-sonnet

Azevedo, R., Bouchet, F., Duffy, M., Harley, J., Taub, M., Trevors, G., ... & Cerezo, R. (2022). Lessons learned and future directions of MetaTutor: Leveraging multichannel data to scaffold self-regulated learning with an intelligent tutoring system. Frontiers in Psychology, 13, 813632. https://doi.org/10.3389/fpsyg.2022.813632

Azevedo, R., & Gašević, D. (2019). Analyzing multimodal multichannel data about self-regulated learning with advanced learning technologies: Issues and challenges. Computers in human behavior, 96, 207-210. https://doi.org/10.1016/j.chb.2019.03.025

Azevedo, R., Moos, D. C., Johnson, A. M., & Chauncey, A. D. (2010). Measuring cognitive and metacognitive regulatory processes during hypermedia learning: Issues and challenges. Educational Psychologist, 45(4), 210-223. https://doi.org/10.1080/00461520.2010.515934

Azevedo, R., Taub, M., & Mudrick, N. V. (2018). Understanding and reasoning about real-time cognitive, affective, and metacognitive processes to foster self-regulation with advanced learning technologies. In D. H. Schunk & J. A. Greene (Eds.), Handbook of self-regulation of learning and performance (2nd ed., pp. 254-270). Routledge. https://doi.org/10.4324/9781315697048-17

Bakharia, A., Shibani, A., Lim, L. A., McCluskey, T., & Shum, S. B. (2025). From transcripts to themes: A trustworthy workflow for qualitative analysis using large language models. In CEUR Proceedings of the Workshop ‘From Data to Discovery: LLMs for Qualitative Analysis in Education’, 15th International Learning Analytics & Knowledge Conference (LAK '25). https://hdl.handle.net/10779/DRO/DU:30473783

Barany, A., Nasiar, N., Porter, C., Zambrano, A. F., Andres, J. M. A. L., Bright, D., Choi, J., Gao, S., Giordano, C., Liu, X., Mehta, S., Shah, M., Zhang, J., & Baker, R. S. (2024). ChatGPT for education research: Exploring the potential of large language models for qualitative codebook development. In Proceedings of the 25th International Conference on Artificial Intelligence in Education. https://doi.org/10.1007/978-3-031-64299-9_10

Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1), 1–48. https://doi.org/10.18637/jss.v067.i01

Ben-Eliyahu, A., & Bernacki, M. L. (2015). Addressing complexities in self-regulated learning: A focus on contextual factors, contingencies, and dynamic relations. Metacognition and Learning, 10(1), 1-13. https://doi.org/10.1007/s11409-015-9134-6

Bernacki, M. L. (2018). Examining the cyclical, loosely sequenced, and contingent features of self-regulated learning: Trace data and their analysis. In D. H. Schunk & J. A. Greene (Eds.), Handbook of self-regulation of learning and performance (2nd ed., pp. 370–387). Routledge/Taylor & Francis Group. https://doi.org/10.4324/9781315697048-24

Bernacki, M. L., Yu, L., Kuhlmann, S. L., Plumley, R. D., Greene, J. A., Duke, R. F., Freed, R., Hollander-Blackmon, C., & Hogan, K. A. (2025). Using multimodal learning analytics to validate digital traces of self-regulated learning in a laboratory study and predict performance in undergraduate courses. Journal of Educational Psychology, 117(2), 176–205. https://doi.org/10.1037/edu0000890

Binbasaran Tuysuzoglu, B., & Greene, J. A. (2015). An investigation of the role of contingent metacognitive behavior in self-regulated learning. Metacognition and Learning, 10(1), 77-98. https://doi.org/10.1007/s11409-014-9126-y

Blackmore, C., Vitali, J., Ainscough, L., Langfield, T., & Colthorpe, K. (2021). A review of self-regulated learning and self-efficacy: The key to tertiary transition in science, technology, engineering and mathematics (STEM). International Journal of Higher Education, 10(3), 169-177. https://doi.org/10.5430/ijhe.v10n3p169

Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., Brynjolfsson, E., Buch, S., Card, D., Castellon, R., Chatterji, N., Chen, A., Creel, K., Davis, J. Q., Demszky, D., ... Liang, P. (2022). On the opportunities and risks of foundation models. arXiv. https://arxiv.org/abs/2108.07258

Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J. D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D. M., Wu, J., Winter, C., ... Amodei, D. (2020). Language models are few-shot learners. Advances in Neural Information Processing Systems, 33, 1877-1901. https://proceedings.neurips.cc/paper/2020/hash/1457c0d6bfcb4967418bfb8ac142f64a-Abstract.html

Chang, Y., Wang, X., Wang, J., Wu, Y., Yang, L., Zhu, K., ... & Xie, X. (2024). A survey on evaluation of large language models. ACM Transactions on Intelligent Systems and Technology, 15(3), 1-45. https://doi.org/10.1145/3641289

Chen, X. (2013). STEM attrition: College students’ paths into and out of STEM field. NCES 2014-001. National Center for Education Statistics. https://nces.ed.gov/pubs2014/2014001rev.pdf

Chowdhery, A., Narang, S., Devlin, J., Bosma, M., Mishra, G., Roberts, A., ... & Fiedel, N. (2023). Palm: Scaling language modeling with pathways. Journal of Machine Learning Research, 24(240), 1-113. https://www.jmlr.org/papers/volume24/22-1144/22-1144.pdf

Cicchetti, D. V., & Feinstein, A. R. (1990). High agreement but low kappa: II. Resolving the paradoxes. Journal of clinical epidemiology, 43(6), 551-558. https://doi.org/10.1016/0895-4356(90)90159-M

De Paoli, S. (2024). Performing an inductive thematic analysis of semi-structured interviews with a large language model: An exploration and provocation on the limits of the approach. Social Science Computer Review, 42(4), 997-1019. https://doi.org/10.1177/08944393231220483

Dignath, C., Buettner, G., & Langfeldt, H. P. (2008). How can primary school students learn self-regulated learning strategies most effectively? A meta-analysis on self-regulation training programmes. Educational Research Review, 3(2), 101-129. https://doi.org/10.1016/j.edurev.2008.02.003

Efklides, A. (2011). Interactions of metacognition with motivation and affect in self-regulated learning: The MASRL model. Educational Psychologist, 46(1), 6-25. https://doi.org/10.1080/00461520.2011.538645

Efklides, A., & Schwartz, B. L. (2024). Revisiting the metacognitive and affective model of self-regulated learning: Origins, development, and future directions. Educational Psychology Review, 36(2), Article 61. https://doi.org/10.1007/s10648-024-09896-9

Efklides, A., Schwartz, B. L., & Brown, V. (2017). Motivation and affect in self-regulated learning: does metacognition play a role? In Handbook of self-regulation of learning and performance (pp. 64-82). Routledge. https://doi.org/10.4324/9781315697048-5

Ericsson, K. A. (2017). Protocol analysis. In W. Bechtel & G. Graham (Eds.), A companion to cognitive science (pp. 425-432). Wiley. https://doi.org/10.1002/9781405164535.ch33

Fan, Y., Lim, L., van der Graaf, J., Kilgour, J., Raković, M., Moore, J., Molenaar, I., Bannert, M., & Gašević, D. (2022). Improving the measurement of self-regulated learning using multi-channel data. Metacognition and Learning, 17(3), 1025-1055. https://doi.org/10.1007/s11409-022-09304-z

Fan, Y., Raković, M., van der Graaf, J., Lim, L., Singh, S., Moore, J., Molenaar, I., Bannert, M., & Gašević, D. (2023). Towards a fuller picture: Triangulation and integration of the measurement of self-regulated learning based on trace and think aloud data. Journal of Computer Assisted Learning, 39(4), 1303-1324. https://doi.org/10.1111/jcal.12801

Fox, M. C., Ericsson, K. A., & Best, R. (2011). Do procedures for verbal reporting of thinking have to be reactive? A meta-analysis and recommendations for best reporting methods. Psychological Bulletin, 137(2), 316-344. https://doi.org/10.1037/a0021663

Gao, A. (2023). Prompt engineering for large language models. Available at SSRN 4504303. https://doi.org/10.2139/ssrn.4504303

Gemini Team, Anil, R., Borgeaud, S., Alayrac, J. B., Yu, J., Soricut, R., ... & Blanco, L. (2023). Gemini: A family of highly capable multimodal models. arXiv. https://doi.org/10.48550/arXiv.2312.11805

Giannakos, M., & Cukurova, M. (2023). The role of learning theory in multimodal learning analytics. British Journal of Educational Technology, 54(5), 1246–1267. https://doi.org/10.1111/bjet.13320

Greene, J. A., & Azevedo, R. (2009). A macro-level analysis of SRL processes and their relations to the acquisition of a sophisticated mental model of a complex system. Contemporary Educational Psychology, 34(1), 18-29. https://doi.org/10.1016/j.cedpsych.2008.05.006

Greene, J. A., Bernacki, M. L., & Hadwin, A. F. (2024). Self-regulation. In P. A. Schutz & K. R. Muis (Eds.). Handbook of Educational Psychology (4th Edition) (pp. 314-334). Routledge. https://doi.org/10.4324/9780429433726-17

Greene, J. A., Bolick, C. M., Caprino, A. M., Deekens, V. M., McVea, M., Yu, S., & Jackson, W. P. (2015). Fostering high-school students’ self-regulated learning online and across academic domains. The High School Journal, 99(1), 88-106. https://doi.org/10.1353/hsj.2015.0019

Greene, J. A., Bolick, C. M., & Robertson, J. (2010). Fostering historical knowledge and thinking skills using hypermedia learning environments: The role of self-regulated learning. Computers & Education, 54(1), 230-243. https://doi.org/10.1016/j.compedu.2009.08.006

Greene, J. A., Deekens, V. M., Copeland, D. Z., & Yu, S. (2018). Capturing and modeling self-regulated learning using think-aloud protocols. In D. H. Schunk & J. A. Greene (Eds.), Handbook of self-regulation of learning and performance (2nd ed., pp. 323–337). Routledge/Taylor & Francis Group. https://doi.org/10.4324/9781315697048-21

Greene, J. A., Dellinger, K. R., Tüysüzoğlu, B. B., & Costa, L. J. (2013). A two-tiered approach to analyzing self-regulated learning data to inform the design of hypermedia learning environments. In R. Azevedo & V. Aleven (Eds.), International Handbook of Metacognition and Learning Technologies, 117-128. https://doi.org/10.1007/978-1-4419-5546-3_8

Greene, J. A., Hutchison, L. A., Costa, L., & Crompton, H. (2012). Investigating how college students’ task definitions and plans relate to self-regulated learning processing and understanding of a complex science topic. Contemporary Educational Psychology, 37, 307-320. https://doi.org/10.1016/j.cedpsych.2012.02.002

Guntur, M., & Purnomo, Y. W. (2024). A meta-analysis of self-regulated learning interventions studies on learning outcomes in online and blended environments. Online Learning, 28(3), 563-584. https://doi.org/10.24059/olj.v28i3.4025

Hallgren, K. A. (2012). Computing inter-rater reliability for observational data: an overview and tutorial. Tutorials in quantitative methods for psychology, 8(1), 23. https://doi.org/10.20982/tqmp.08.1.p023

Hou, Y., Zhang, J., Lin, Z., Lu, H., Xie, R., McAuley, J., & Zhao, W. X. (2024, March). Large language models are zero-shot rankers for recommender systems. In European Conference on Information Retrieval (pp. 364-381). Cham: Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-56060-6_24

Huang, Z., Wang, Z., Xia, S., & Liu, P. (2024). Olympic arena medal ranks: Who is the most intelligent AI so far? arXiv. https://arxiv.org/abs/2406.16772

Ingkavara, T., Panjaburee, P., Srisawasdi, N., & Sajjapanroj, S. (2022). The use of a personalized learning approach to implementing self-regulated online learning. Computers and Education: Artificial Intelligence. 3(1), 100086. https://doi.org/10.1016/j.caeai.2022.100086

Järvelä, S., Järvenoja, H., & Malmberg, J. (2019). Capturing the dynamic and cyclical nature of regulation: Methodological Progress in understanding socially shared regulation in learning. International Journal of Computer-Supported Collaborative Learning, 14, 425-441. https://doi.org/10.1007/s11412-019-09313-2

Katz, A., Shakir, U., & Chambers, B. (2023). The utility of large language models and generative AI for education research. arXiv. https://arxiv.org/abs/2305.18125

Khalil, M., Prinsloo, P., & Slade, S. (2023). The use and application of learning theory in learning analytics: A scoping review. Journal of Computing in Higher Education, 35(3), 573–594. https://doi.org/10.1007/s12528-022-09340-3

Khan, S., Naseer, M., Hayat, M., Zamir, S. W., Khan, F. S., & Shah, M. (2022). Transformers in vision: A survey. ACM computing surveys (CSUR), 54(10s), 1-41. https://doi.org/10.1145/3505244

Kojima, T., Gu, S. S., Reid, M., Matsuo, Y., & Iwasawa, Y. (2022). Large language models are zero-shot reasoners. Advances in Neural Information Processing Systems, 35, 22199-22213. https://doi.org/10.48550/arXiv.2205.11916

Lenth, R. (2023). emmeans: Estimated Marginal Means, aka Least-Squares Means. https://CRAN.R-project.org/package=emmeans

Liévin, V., Hother, C. E., Motzfeldt, A. G., & Winther, O. (2024). Can large language models reason about medical questions? Patterns, 5(3). https://doi.org/10.1016/j.patter.2024.100943

Lim, T., Gottipati, S., Cheong, M., Ng, J. W., & Pang, C. (2023). Analytics-enabled authentic assessment design approach for digital education. Education and Information Technologies, 28(7), 9025-9048. https://doi.org/10.1007/s10639-022-11525-3

Lin, J., Chen, E., Han, Z., Gurung, A., Thomas, D.R., Tan, W., Nguyen, N.D., & Koedinger, K. (2024). How can i improve? Using GPT to highlight the desired and undesired parts of open-ended responses. arXiv. https://doi.org/10.48550/arXiv.2405.00291

Lin, Z., Guan, S., Zhang, W., Zhang, H., Li, Y., & Zhang, H. (2024). Towards trustworthy LLMs: a review on debiasing and dehallucinating in large language models. Artificial Intelligence Review, 57(9), 243. https://doi.org/10.1007/s10462-024-10896-y

Liu, X., Zambrano, A. F., Baker, R. S., Barany, A., Ocumpaugh, J., Zhang, J., Pankiewicz, M., Nasiar, N., & Wei, Z. (2025). Qualitative coding with GPT-4: Where it works better. Journal of Learning Analytics, 12(1), 169-185. https://doi.org/10.18608/jla.2025.8575

Lockyer, L., Heathcote, E., & Dawson, S. (2013). Informing pedagogical action: Aligning learning analytics with learning design. American Behavioral Scientist, 57(10), 1439–1459. https://doi.org/10.1177/0002764213479367

McClure, J., Smyslova, D., Hall, A., & Jiang, S. (2024). Deductive coding’s role in AI vs. human performance. In Proceedings of the 17th International Conference on Educational Data Mining (pp. 809-813). https://doi.org/10.5281/zenodo.12729958

Min, S., Lewis, M., Zettlemoyer, L., & Hajishirzi, H. (2022). MetaICL: Learning to learn in context. arXiv. https://arxiv.org/abs/2110.15943

Molenaar, I., de Mooij, S., Azevedo, R., Bannert, M., Järvelä, S., & Gašević, D. (2023). Measuring self-regulated learning and the role of AI: Five years of research using multimodal multichannel data. Computers in Human Behavior, 139, 107540. https://doi.org/10.1016/j.chb.2022.107540

Nagashima, T., Vincoli, M., Scholz, N., & Su, M. (2024). Understanding students’ nuanced views on AI-supported classroom learning through perspective taking. In Proceedings of the 25th International Conference on Artificial Intelligence in Education. Springer. https://doi.org/10.1007/978-3-031-98414-3_2

Nathan, M. J., & Koedinger, K. R. (2000). An investigation of teachers’ beliefs of students’ algebra development. Cognition and Instruction, 18(2), 209-237. https://doi.org/10.1207/S1532690XCI1802_03

National Academies of Sciences, Engineering, and Medicine. (2024). Roundtable on systemic change in undergraduate STEM education. National Academies Press. https://doi.org/10.17226/26901

OpenAI. (2023). GPT-4 technical report. arXiv. https://arxiv.org/pdf/2303.08774

Panadero, E., Klug, J., & Järvelä, S. (2016). Third wave of measurement in the self-regulated learning field: When measurement and intervention come hand in hand. Scandinavian Journal of Educational Research, 60(6), 723–735. https://doi.org/10.1080/00313831.2015.1066436

Park, J., Yu, R., Rodriguez, F., Baker, R., Smyth, P., & Warschauer, M. (2018). Understanding student procrastination via mixture models. In Proceedings of the 11th International Conference on Educational Data Mining. https://eric.ed.gov/?id=ED593094

Pérez-Álvarez, R. A., Maldonado-Mahauad, J., Sharma, K., Sapunar-Opazo, D., & Pérez-Sanagustín, M. (2020). Characterizing learners’ engagement in MOOCs: An observational case study using the NoteMyProgress tool for supporting self-regulation. IEEE transactions on Learning Technologies, 13(4), 676-688. https://doi.org/10.1109/TLT.2020.3003220

Pintrich, P. R. (2000). The role of goal orientation in self-regulated learning. In Handbook of self-regulation (pp. 451-502). Academic Press. https://doi.org/10.1016/B978-012109890-2/50043-3

Ramanathan, S., Lim, L.-A., Mottaghi, N. R., & Buckingham Shum, S. (2025). When the prompt becomes the codebook: Grounded prompt engineering (GROPROE) and its application to belonging analytics. In Proceedings of the 15th International Learning Analytics and Knowledge Conference (pp. 713-725). ACM Press. https://doi.org/10.1145/3706468.3706564

Rao, A., Pang, M., Kim, J., Kamineni, M., Lie, W., Prasad, A. K., ... & Succi, M. D. (2023). Assessing the utility of ChatGPT throughout the entire clinical workflow: development and usability study. Journal of Medical Internet Research, 25(1). https://preprints.jmir.org/preprint/48659

Saint, J., Whitelock-Wainwright, A., Gasevic, D., & Pardo, A. (2020). Trace-SRL: A framework for analysis of microlevel processes of self-regulated learning from trace data. IEEE Transactions on Learning Technologies, 13, 861-877. https://doi.org/10.1109/TLT.2020.3027496

Scarlatos, A., Baker, R. S., & Lan, A. (2025). Exploring knowledge tracing in tutor-student dialogues using LLMs. In Proceedings of the 15th International Learning Analytics and Knowledge Conference (pp. 249-259). ACM Press. https://doi.org/10.1145/3706468.3706501

Schaeffer, R., Miranda, B., & Koyejo, S. (2023). Are emergent abilities of large language models a mirage? Advances in Neural Information Processing Systems, 36, 55565-55581. https://doi.org/10.48550/arXiv.2304.15004

Shanahan, M., McDonell, K., & Reynolds, L. (2023). Role play with large language models. Nature, 623(7987), 493-498. https://doi.org/10.1038/s41586-023-06647-8

Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., ... & Natarajan, V. (2023). Large language models encode clinical knowledge. Nature, 620(7972), 172-180. https://doi.org/10.1038/s41586-023-06291-2

Tai, R. H., Bentley, L. R., Xia, X., Sitt, J. M., Fankhauser, S. C., Chicas-Mosier, A. M., & Monteith, B. G. (2024). An examination of the use of large language models to aid analysis of textual data. International Journal of Qualitative Methods, 23, 16094069241231168. https://doi.org/10.1177/16094069241231168

Taub, M., Azevedo, R., Rajendran, R., Cloude, E. B., Biswas, G., & Price, M. J. (2021). How are students’ emotions related to the accuracy of cognitive and metacognitive processes during learning with an intelligent tutoring system?. Learning and Instruction, 72, 101200. https://doi.org/10.1016/j.learninstruc.2019.04.001

Theobald, M. (2021). Self-regulated learning training programs enhance university students’ academic performance, self-regulated learning strategies, and motivation: A meta-analysis. Contemporary Educational Psychology, 66, 101976. https://doi.org/10.1016/j.cedpsych.2021.101976

Van Alten, D. C., Phielix, C., Janssen, J., & Kester, L. (2020). Self-regulated learning support in flipped learning videos enhances learning outcomes. Computers & Education, 158, 104000. https://doi.org/10.1016/j.compedu.2020.104000

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30. https://doi.org/10.48550/arXiv.1706.03762

Veenman, M. V. J., & Beishuizen, J. J. (2004). Intellectual and metacognitive skills of novices while studying texts under conditions of text difficulty and time constraint. Learning and Instruction, 14(6), 621-640. https://doi.org/10.1016/j.learninstruc.2004.09.004

Veenman, M. V. J., Elshout, J. J., & Meijer, J. (1997). The generality vs domain-specificity of metacognitive skills in novice learning across domains. Learning and Instruction, 7(2), 187-209. https://doi.org/10.1016/S0959-4752(96)00025-4

Veenman, M. V. J., Van Hout-Wolters, B. H. A. M., & Afflerbach, P. (2006). Metacognition and learning: Conceptual and methodological considerations. Metacognition and Learning, 1(1), 3-14. https://doi.org/10.1007/s11409-006-6893-0

Wei, J., Wang, X., Schuurmans, D., Bosma, M., Xia, F., Chi, E., ... & Zhou, D. (2022). Chain-of-thought prompting elicits reasoning in large language models. Advances in Neural Information Processing Systems, 35, 24824-24837. https://doi.org/10.48550/arXiv.2201.11903

White, J., Fu, Q., Hays, S., Sandborn, M., Olea, C., Gilbert, H., ... & Schmidt, D. C. (2023). A prompt pattern catalog to enhance prompt engineering with chatgpt. arXiv. https://doi.org/10.48550/arXiv.2302.11382

Wiedbusch, M. D., Kite, V., Yang, X., Park, S., Chi, M., Taub, M., & Azevedo, R. (2021, February). A theoretical and evidence-based conceptual design of metadash: An intelligent teacher dashboard to support teachers’ decision making and students’ self-regulated learning. In Frontiers in education (Vol. 6, p. 570229). Frontiers Media SA. https://doi.org/10.3389/feduc.2021.570229

Winne, P. H. (1995). Inherent details in self-regulated learning. Educational Psychologist, 30(4), 173-187. https://doi.org/10.1207/s15326985ep3004_2

Winne, P. H. (2017). Learning analytics for self-regulated learning. In C. Lang, G. Siemens, A. Wise, & D. Gašević (Eds.), Handbook of learning analytics (pp. 241-249). Society for Learning Analytics Research. https://doi.org/10.18608/hla17.021

Winne, P. H., & Hadwin, A. F. (1998). Studying as self-regulated learning. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Metacognition in Educational Theory and Practice (pp. 277-304). Routledge. https://doi.org/10.4324/9781410602350-12

Winne, P. H., & Perry, N. E. (2000). Measuring self-regulated learning. In M. Boekaerts, P. R. Pintrich, & M. Zeidner (Eds.), Handbook of Self-Regulation (pp. 531–566). Academic Press. https://doi.org/10.1016/B978-012109890-2/50045-7

Wolters, C. A., & Won, S. (2018). Validity and the use of self-report questionnaires to assess self-regulated learning. In D. H. Schunk & J. A. Greene (Eds.), Handbook of self-regulation of learning and performance (2nd ed., pp. 307–322). Routledge/Taylor & Francis Group. https://doi.org/10.4324/9781315697048-20

Yang, J., Jin, H., Tang, R., Han, X., Feng, Q., Jiang, H., ... & Hu, X. (2024). Harnessing the power of LLMs in practice: A survey on chatgpt and beyond. ACM Transactions on Knowledge Discovery from Data, 18(6), 1-32. https://doi.org/10.48550/arXiv.2304.13712

Zhang, H., Wu, C., Xie, J., Kim, C., & Carroll, J. M. (2023). QualiGPT: GPT as an easy-to-use tool for qualitative coding. arXiv. https://doi.org/10.48550/arXiv.2310.07061

Zhang, J., Borchers, C., Aleven, V., & Baker, R. S. (2024). Using large language models to detect self-regulated learning in think-aloud protocols. In Proceedings of the 17th International Conference on Educational Data Mining (pp. 157-168). https://doi.org/10.5281/zenodo.12729790

Zhao, W. X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., ... & Wen, J. R. (2023). A survey of large language models. arXiv. https://doi.org/10.48550/arXiv.2303.18223

Ziems, C., Held, W., Shaikh, O., Chen, J., Zhang, Z., & Yang, D. (2024). Can large language models transform computational social science? Computational Linguistics, 50(1), 237-291. https://doi.org/10.1162/coli_a_00502

Zimmerman, B. J. (2000). Attaining self-regulation: A social cognitive perspective. In M. Boekaerts, P. R. Pintrich, & M. Zeidner (Eds.), Handbook of self-regulation (pp. 13–39). Academic Press. https://doi.org/10.1016/B978-012109890-2/50031-7

Downloads

Published

2026-06-25

How to Cite

Ren, S., Nguyen, H., Bernacki, M., Yu, L., & Greene, J. (2026). Using Large Language Models for Automated Coding of Self-Regulated Learning Think-Aloud Protocol Data. Journal of Learning Analytics, 1-24. https://doi.org/10.18608/jla.2026.9025

Issue

Section

Research Papers