Analyzing Students’ Emerging Roles Based on Quantity and Heterogeneity of Individual Contributions in Small Group Online Collaborative Learning Using Bipartite Network Analysis
DOI:
https://doi.org/10.18608/jla.2025.8431Keywords:
emerging roles, small group CSCL, network analysis, learning analytics, collaboration analytics, research paperAbstract
Understanding students’ emerging roles in computer-supported collaborative learning (CSCL) is critical for promoting regulated learning processes and supporting learning at both individual and group levels. However, it has been challenging to disentangle individual performance from group-based deliverables. This study introduces new learning analytic methods based on student–subtask bipartite networks to gauge two conceptual dimensions — quantity and heterogeneity of individual contribution to subtasks — for understanding students’ emerging roles in online collaborative learning in small groups. We analyzed these two dimensions and explored the changes of individual emerging roles within seven groups of high school students (N=21) in two consecutive collaborative learning projects. We found a significant association in the changes between assigned leadership roles and changes in the identified emerging roles between the two projects, echoing the importance of externally facilitated regulation scaffolding in CSCL. We also collected qualitative data through a semi-structured interview to further validate the quantitative analysis results, which revealed that student perceptions of their emerging roles were consistent with the quantitative analysis results. This study contributes new learning analytic methods for collaboration analytics as well as a two-dimensional theoretical framework for understanding students’ emerging roles in small group CSCL.
References
Andrés, A. M., Mato, A. S., García, J. M. T., & Quevedo, M. J. S. (2004). Comparing the asymptotic power of exact tests in 2×2 tables. Computational Statistics & Data Analysis, 47(4), 745–756. https://doi.org/10.1016/j.csda.2003.11.012
Aviv, R., Erlich, Z., & Ravid, G. (2003). Cohesion and roles: Network analysis of CSCL communities. Proceedings of the 3rd IEEE International Conference on Advanced Learning Technologies (ICALT), 9–11 July 2003, Athens, Greece (pp. 145–149). IEEE. https://doi.org/10.1109/icalt.2003.1215045
Banihashem, S. K., Noroozi, O., van Ginkel, S., Macfadyen, L. P., & Biemans, H. J. A. (2022). A systematic review of the role of learning analytics in enhancing feedback practices in higher education. Educational Research Review, 37, 100489. https://doi.org/10.1016/j.edurev.2022.100489
Barnard, G. A. (1947). Significance tests for 2 × 2 tables. Biometrika, 34(1/2), 123–138. https://doi.org/10.2307/2332517
Chen, B., & Poquet, O. (2022). Networks in learning analytics: Where theory, methodology, and practice intersect. Journal of Learning Analytics, 9(1), 1–12. https://doi.org/10.18608/jla.2022.7697
Chen, J., Wang, M., Kirschner, P. A., & Tsai, C. C. (2018). The role of collaboration, computer use, learning environments, and supporting strategies in CSCL: A meta-analysis. Review of Educational Research, 88(6), 799–843.
Cohen, E. G., & Lotan, R. A. (2014). Designing groupwork: Strategies for the heterogeneous classroom (3rd ed.). Teachers College Press.
Coll, C., Rochera, M. J., & de Gispert, I. (2014). Supporting online collaborative learning in small groups: Teacher feedback on learning content, academic task and social participation. Computers & Education, 75, 53–64. https://doi.org/10.1016/j.compedu.2014.01.015
Creswell, J. W., Plano Clark, V. L., Gutmann, M. L., & Hanson, W. E. (2003). Advanced mixed methods research designs. In A. Tashakkori & C. Teddlie (Eds.), Handbook of mixed methods in the social and behavioral sciences (pp. 209–240). Sage Publications.
Dado, M., & Bodemer, D. (2017). A review of methodological applications of social network analysis in computer-supported collaborative learning. Educational Research Review, 22, 159–180. https://doi.org/10.1016/j.edurev.2017.08.005
de Laat, M., Lally, V., Lipponen, L., & Simons, R.-J. (2007). Investigating patterns of interaction in networked learning and computer-supported collaborative learning: A role for social network analysis. International Journal of Computer-Supported Collaborative Learning, 2(1), 87–103. https://doi.org/10.1007/s11412-007-9006-4
De Wever, B., & Strijbos, J. W. (2021). Roles for structuring groups for collaboration. In U. Cress, C. Ros, A. F. Wise, & J. Oshima (Eds.), International Handbook of Computer-Supported Collaborative Learning (pp. 315–331).
De Wever, B., Van Keer, H., Schellens, T., & Valcke, M. (2010). Roles as a structuring tool in online discussion groups: The differential impact of different roles on social knowledge construction. Computers in Human Behavior, 26(4), 516–523. https://doi.org/10.1016/j.chb.2009.08.008
Deci, E. L., & Ryan, R. M. (2008). Self-determination theory: A macrotheory of human motivation, development, and health. Canadian Psychology, 49(3), 182–185. https://doi.org/10.1037/a0012801
Dillenbourg, P. (1999). Introduction: What do you mean by “collaborative learning”? In P. Dillenbourg (Ed.), Collaborative learning: Cognitive and computational approaches (pp. 1–19). Emerald Group Publishing.
Dowell, N., Lin, Y., Godfrey, A., & Brooks, C. (2020). Exploring the relationship between emergent sociocognitive roles, collaborative problem-solving skills, and outcomes: A group communication analysis. Journal of Learning Analytics, 7(1), 38–57. https://doi.org/10.18608/jla.2020.71.4
Dowell, N. M. M., Nixon, T. M., & Graesser, A. C. (2019). Group communication analysis: A computational linguistics approach for detecting sociocognitive roles in multiparty interactions. Behavior Research Methods, 51(3), 1007–1041. https://doi.org/10.3758/s13428-018-1102-z
Feng, S., & Kirkley, A. (2020). Mixing patterns in interdisciplinary co-authorship networks at multiple scales. Scientific Reports, 10(1), 7731. https://doi.org/10.1038/s41598-020-64351-3
Feng, S., Yan, L., Zhao, L., Maldonado, R. M., & Gašević, D. (2024). Heterogenous network analytics of small group teamwork: Using multimodal data to uncover individual behavioral engagement strategies. Proceedings of the 14th Learning Analytics and Knowledge Conference (LAK ’24), 18–22 March 2024, Kyoto, Japan (pp. 587–597). ACM Press. https://doi.org/10.1145/3636555.3636918
Ferreira, M. A. D., Ferreira Mello, R., Kovanović, V., Nascimento, A., Lins, R., & Gašević, D. (2022). NASC: Network analytics to uncover socio-cognitive discourse of student roles. Proceedings of the 12th International Conference on Learning Analytics and Knowledge (LAK22), 21–25 March 2022, Online, USA (pp. 415–425). ACM Press. https://doi.org/10.1145/3506860.3506978
Fransen, J., Weinberger, A., & Kirschner, P. A. (2013). Team effectiveness and team development in CSCL. Educational Psychologist, 48(1), 9–24. https://doi.org/10.1080/00461520.2012.747947
Gašević, D., Adesope, O., Joksimović, S., & Kovanović, V. (2015). Externally-facilitated regulation scaffolding and role assignment to develop cognitive presence in asynchronous online discussions. The Internet and Higher Education, 24, 53–65. https://doi.org/10.1016/j.iheduc.2014.09.006
Gašević, D., Joksimović, S., Eagan, B. R., & Shaffer, D. W. (2019). SENS: Network analytics to combine social and cognitive perspectives of collaborative learning. Computers in Human Behavior, 92, 562–577. https://doi.org/10.1016/j.chb.2018.07.003
Hadwin, A., & Oshige, M. (2011). Self-regulation, coregulation, and socially shared regulation: Exploring perspectives of social in self-regulated learning theory. Teachers College Record, 113(2), 240–264. https://doi.org/10.1177/016146811111300204
Hansen, R. S. (2006). Benefits and problems with student teams: Suggestions for improving team projects. Journal of Education for Business, 82(1), 11–19. https://doi.org/10.3200/joeb.82.1.11-19
Heinimäki, O.-P., Volet, S., Jones, C., Laakkonen, E., & Vauras, M. (2021). Student participatory role profiles in collaborative science learning: Relation of within-group configurations of role profiles and achievement. Learning, Culture and Social Interaction, 30, 100539. https://doi.org/10.1016/j.lcsi.2021.100539
Janssen, J., Erkens, G., Kanselaar, G., & Jaspers, J. (2007). Visualization of participation: Does it contribute to successful computer-supported collaborative learning? Computers & Education, 49(4), 1037–1065. https://doi.org/10.1016/j.compedu.2006.01.004
Järvelä, S., & Järvenoja, H. (2011). Socially constructed self-regulated learning and motivation regulation in collaborative learning groups. Teachers College Record, 113(2), 350–374. https://doi.org/10.1177/016146811111300205
Järvelä, S., & Hadwin, A. F. (2013). New frontiers: Regulating learning in CSCL. Educational Psychologist, 48(1), 25–39. https://doi.org/10.1080/00461520.2012.748006
Kaliisa, R., Rienties, B., Mørch, A. I., & Kluge, A. (2022). Social learning analytics in computer-supported collaborative learning environments: A systematic review of empirical studies. Computers and Education Open, 3, 100073. https://doi.org/10.1016/j.caeo.2022.100073
Kawakubo, A. J. T., Oshima, J., & Oshima, R. (2022). Diversity in learners’ contributions to idea improvement processes among the high learning-outcome groups in a knowledge building practice. Proceedings of the 15th International Conference on Computer-Supported Collaborative Learning (CSCL 2022), 6–10 June 2022, Hiroshima, Japan (pp. 308–311). International Society of the Learning Sciences. https://repository.isls.org//handle/1/8294
Kim, M. K., & Ketenci, T. (2019). Learner participation profiles in an asynchronous online collaboration context. The Internet and Higher Education, 41, 62–76. https://doi.org/10.1016/j.iheduc.2019.02.002
Kollar, I., Fischer, F., & Hesse, F. W. (2006). Collaboration scripts: A conceptual analysis. Educational Psychology Review, 18(2), 159–185. https://doi.org/10.1007/s10648-006-9007-2
Laal, M., & Laal, M. (2012). Collaborative learning: What is it? Procedia: Social and Behavioral Sciences, 31, 491–495. https://doi.org/10.1016/j.sbspro.2011.12.092
Le, H., Janssen, J., & Wubbels, T. (2018). Collaborative learning practices: Teacher and student perceived obstacles to effective student collaboration. Cambridge Journal of Education, 48(1), 103–122.
Li, X., Hu, W., Li, Y., & Zheng, Y. (2024). Individuals in a group: Exploring engagement patterns via within-group configurations of role profiles and their impact on performance in collaborative problem solving. Interactive Learning Environments, 32(9), 5836–5851. https://doi.org/10.1080/10494820.2023.2239295
Lim, J., & Liu, Y. (2006). The role of cultural diversity and leadership in computer-supported collaborative learning: A content analysis. Information and Software Technology, 48(3), 142–153. https://doi.org/10.1016/j.infsof.2005.03.006
Ludvigsen, S., Cress, U., Rosé, C. P., Law, N., & Stahl, G. (2018). Developing understanding beyond the given knowledge and new methodologies for analyses in CSCL. International Journal of Computer-Supported Collaborative Learning, 13, 359–364.
Malmberg, J., Saqr, M., Järvenoja, H., & Järvelä, S. (2022). How the monitoring events of individual students are associated with phases of regulation: A network analysis approach. Journal of Learning Analytics, 9(1), 77–92. https://doi.org/10.18608/jla.2022.7429
Marcos-García, J.-A., Martínez-Monés, A., & Dimitriadis, Y. (2015). DESPRO: A method based on roles to provide collaboration analysis support adapted to the participants in CSCL situations. Computers & Education, 82, 335–353. https://doi.org/10.1016/j.compedu.2014.10.027
Matsuzaw, Y., Oshima, J., Oshima, R., Niihara, Y., & Sakai, S. (2011). KBDeX: A platform for exploring discourse in collaborative learning. Procedia: Social and Behavioral Sciences, 26, 198–207. https://doi.org/10.1016/j.sbspro.2011.10.576
Medina, E., Vega, D., Meseguer, R., Medina, H., Ochoa, S. F., & Magnani, M. (2016). Using indirect blockmodeling for monitoring students roles in collaborative learning networks. Proceedings of the 2016 IEEE 20th International Conference on Computer Supported Cooperative Work in Design (CSCWD), 4–6 May 2016, Nanchang, China (pp. 164–169). IEEE. https://doi.org/10.1109/cscwd.2016.7565982
Miles, M. B., Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook. SAGE Publications.
Mi, H., Zhang, Q., & Zheng, Y. (2023). Exploring the relationship between participant role and collaborative quality in online collaborative discussions. International Journal of Emerging Technologies in Learning, 18(11), 273–289. https://doi.org/10.3991/ijet.v18i11.38699
Newman, M. (2018). Networks (2nd ed.). Oxford University Press.
Nokes-Malach, T. J., Richey, J. E., & Gadgil, S. (2015). When is it better to learn together? Insights from research on collaborative learning. Educational Psychology Review, 27(4), 645–656. https://doi.org/10.1007/s10648-015-9312-8
Oshima, J., Oshima, R., & Matsuzawa, Y. (2012). Knowledge building discourse explorer: A social network analysis application for knowledge building discourse. Educational Technology Research and Development, 60(5), 903–921. https://doi.org/10.1007/s11423-012-9265-2
Peterson, A. T., & Roseth, C. J. (2016). Effects of four CSCL strategies for enhancing online discussion forums: Social interdependence, summarizing, scripts, and synchronicity. International Journal of Educational Research, 76, 147–161. https://doi.org/10.1016/j.ijer.2015.04.009
Piaget, J. (1976). Piaget’s theory. In B. Inhelder, H. H. Chipman, C. Zwingmann (Eds.), Piaget and his school: A reader in developmental psychology (pp. 11–23). Springer. https://doi.org/10.1007/978-3-642-46323-5_2
Rabbany, R., Elatia, S., Takaffoli, M., & Zaïane, O. R. (2014). Collaborative learning of students in online discussion forums: A social network analysis perspective. Educational Data Mining, 441–466. https://doi.org/10.1007/978-3-319-02738-8_16
Reffay, C., & Chanier, T. (2003). How social network analysis can help to measure cohesion in collaborative distance-learning. In B. Wasson, S. Ludvigsen, & U. Hoppe (Eds.), Designing for change in networked learning environments: Proceedings of the International Conference on Computer Support for Collaborative Learning 2003 (pp. 343–352). Springer Netherlands. https://doi.org/10.1007/978-94-017-0195-2_42
Rolim, V., Ferreira, R., Lins, R. D., & Gašević, D. (2019). A network-based analytic approach to uncovering the relationship between social and cognitive presences in communities of inquiry. The Internet and Higher Education, 42, 53–65. https://doi.org/10.1016/j.iheduc.2019.05.001
Saqr, M., & López-Pernas, S. (2022). How CSCL roles emerge, persist, transition, and evolve over time: A four-year longitudinal study. Computers & Education, 189, 104581. https://doi.org/10.1016/j.compedu.2022.104581
Saqr, M., Fors, U., & Tedre, M. (2018). How the study of online collaborative learning can guide teachers and predict students’ performance in a medical course. BMC Medical Education, 18(1), 24. https://doi.org/10.1186/s12909-018-1126-1
Saqr, M., Poquet, O., & López-Pernas, S. (2022). Networks in education: A travelogue through five decades. IEEE Access, 10, 32361–32380. https://doi.org/10.1109/access.2022.3159674
Schneider, B., Dowell, N., & Thompson, K. (2021). Collaboration analytics: Current state and potential futures. Journal of Learning Analytics, 8(1), 1–12. https://doi.org/10.18608/jla.2021.7447
Scott, J. (1988). Social network analysis. Sociology, 22(1), 109–127. https://doi.org/10.1177/0038038588022001007
Shannon, C. E. (2001). A mathematical theory of communication. ACM SIGMOBILE Mobile Computing and Communications Review, 5(1), 3–55. https://doi.org/10.1145/584091.584093
Strijbos, J.-W., & De Laat, M. F. (2010). Developing the role concept for computer-supported collaborative learning: An explorative synthesis. Computers in Human Behavior, 26(4), 495–505. https://doi.org/10.1016/j.chb.2009.08.014
Strijbos, J.-W., & Weinberger, A. (2010). Emerging and scripted roles in computer-supported collaborative learning. Computers in Human Behavior, 26(4), 491–494. https://doi.org/10.1016/j.chb.2009.08.006
Swiecki, Z. (2021). Measuring the impact of interdependence on individuals during collaborative problem-solving. Journal of Learning Analytics, 8(1), 75–94. https://doi.org/10.18608/jla.2021.7240
Swiecki, Z., & Shaffer, D. W. (2020). iSENS: An integrated approach to combining epistemic and social network analyses. Proceedings of the 10th International Conference on Learning Analytics & Knowledge (LAK ’20), 23–27 March 2020, Frankfurt, Germany (pp. 305–313). ACM Press. https://doi.org/10.1145/3375462.3375505
Talib, R., Hanif, M. K., Ayesha, S., & Fatima, F. (2016). Text mining: Techniques, applications and issues. International Journal of Advanced Computer Science and Applications, 7(11). http://dx.doi.org/10.14569/IJACSA.2016.071153
Turkkila, M., & Lommi, H. (2020). Student participation in online content-related discussion and its relation to students’ background knowledge. Education Sciences, 10(4), 106. https://doi.org/10.3390/educsci10040106
Valejo, A. D. B., de Oliveira dos Santos, W., Naldi, M. C., & Zhao, L. (2021). A review and comparative analysis of coarsening algorithms on bipartite networks. The European Physical Journal Special Topics, 230(14–15), 2801–2811. https://doi.org/10.1140/epjs/s11734-021-00159-0
van Aalst, J. (2013). Assessment in collaborative learning. In C. E. Hmelo-Silver, C. A. Chinn, C. K. K. Chan, & A. O’Donnell (Eds.), The international handbook of collaborative learning (pp. 280–296). Routledge.
Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes. Harvard University Press.
Wasserman, S., & Faust, K. (1994). Social network analysis: Methods and applications. Cambridge University Press.
Weinberger, A., & Fischer, F. (2006). A framework to analyze argumentative knowledge construction in computer-supported collaborative learning. Computers & Education, 46(1), 71–95. https://doi.org/10.1016/j.compedu.2005.04.003
Wise, A. F., & Chiu, M. M. (2011). Analyzing temporal patterns of knowledge construction in a role-based online discussion. International Journal of Computer-Supported Collaborative Learning, 6(3), 445–470. https://doi.org/10.1007/s11412-011-9120-1
Wilson, K., & Narayan, A. (2016). Relationships among individual task self-efficacy, self-regulated learning strategy use and academic performance in a computer-supported collaborative learning environment. Educational Psychology, 36(2), 236–253.
Worsley, M., Anderson, K., Melo, N., & Jang, J. (2021). Designing analytics for collaboration literacy and student empowerment. Journal of Learning Analytics, 8(1), 30–48. https://doi.org/10.18608/jla.2021.7242
Xie, K., Di Tosto, G., Lu, L., & Cho, Y. S. (2018). Detecting leadership in peer-moderated online collaborative learning through text mining and social network analysis. The Internet and Higher Education, 38, 9–17. https://doi.org/10.1016/j.iheduc.2018.04.002
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Journal of Learning Analytics
This work is licensed under a Creative Commons Attribution 4.0 International License.
