Studying the Flow Experience in Computer-Supported Collaborative Learning
A Study with PyramidApp
DOI:
https://doi.org/10.18608/jla.2024.8185Keywords:
Flow experience, collaborative learning, pyramid collaborative learning flow pattern, learning analytics, research paperAbstract
Computer-Supported Collaborative Learning (CSCL) is recognized as an effective methodology for fostering social interaction mediated by technology in ways that potentially trigger learning. The successful implementation of CSCL hinges on factors such as the scripting mechanics for activity sequencing proposed by Collaborative Learning Flow Patterns (CLFP). Yet, research in CSCL scripts has not studied if CLFPs achieves the so-called notion of “flow experience,” defined as an optimal state in which individuals are engaged and absorbed in an activity. This study proposes an approach to measure flow in the case of the Pyramid CLFP and studies the factors that influence the flow experience in the PyramidApp tool. The study tests a model that uses analysis of the Flow Short Scale and data logs. The findings show that there is a relationship between factors such as the speed of individual contributions and active participation in groups with the flow experience. Notably, the quantity of participation does not exhibit a discernible impact on the flow. The study emphasizes the interest of the modelled factors and the proposed approach for learning analytics to understand the flow experience in CLFP implementations.
References
Abuhamdeh, S. (2020). Investigating the “flow” experience: Key conceptual and operational issues. Frontiers in Psychology, 11, 158. https://doi.org/10.3389/fpsyg.2020.00158
Amarasinghe, I., Hernández-Leo, D., Theophilou, E., Roberto Sánchez Reina, J., Quintero, R. A. L. (2021). Learning gains in Pyramid computer-supported collaboration scripts: Factors and implications for design. In D. Hernández-Leo, R. Hishiyama, G. Zurita, B. Weyers, A. Nolte, & H. Ogata (Eds.), Collaboration technologies and social computing (pp. 35–50). Springer Cham. https://doi.org/10.1007/978-3-030-85071-5_3
Barkley, E. F., Major, C. H., & Cross, K. P. (2014). Collaborative learning techniques: A handbook for college faculty (2nd ed.). Jossey-Bass.
Boudreau, P., Mackenzie, S. H., & Hodge, K. (2020). Flow states in adventure recreation: A systematic review and thematic synthesis. Psychology of Sport and Exercise, 46, 101611. https://doi.org/10.1016/j.psychsport.2019.101611
Buil, I., Catalán, S., & Martínez, E. (2019). The influence of flow on learning outcomes: An empirical study on the use of clickers. British Journal of Educational Technology, 50(1), 428–439. https://doi.org/10.1111/bjet.12561
Cesari, V., Galgani, B., Gemignani, A., & Menicucci, D. (2021). Enhancing qualities of consciousness during online learning via multisensory interactions. Behavioral Sciences, 11(5), 57. https://doi.org/10.3390/bs11050057
Choe, K., Kang, Y., Seo, B. S., & Yang, B. (2015). Experiences of learning flow among Korean adolescents. Learning and Individual Differences, 39, 180–185. https://doi.org/10.1016/j.lindif.2015.03.012
Csikszentmihalyi, M. (1975). Beyond boredom and anxiety. Jossey-Bass.
Csikszentmihalyi, M. (1990). Flow: The psychology of optimal experience. Harper & Row.
Csikszentmihalyi, M., & Csikszentmihalyi, I. S. (Eds.). (1988). Optimal experience: Psychological studies of flow in consciousness. Cambridge University Press.
Csikszentmihalyi, M., & Larson, R. (2014). Flow and the foundations of positive psychology (Vol. 10, pp. 978–994). Dordrecht: Springer.
de Manzano, Ö., Theorell, T., Harmat, L., & Ullén, F. (2010). The psychophysiology of flow during piano playing. Emotion, 10(3), 301–311. https://doi.org/10.1037/a0018432
Dillenbourg, P., & Hong, F. (2008). The mechanics of CSCL macro scripts. International Journal of Computer-Supported Collaborative Learning, 3(1), 5–23. https://doi.org/10.1007/s11412-007-9033-1
Dillenbourg, P., & Tchounikine, P. (2007). Flexibility in macro-scripts for computer-supported collaborative learning. Journal of Computer Assisted Learning, 23(1), 1–13. https://doi.org/10.1111/j.1365-2729.2007.00191.x
Doğan, D., Demir, Ö., & Tüzün, H. (2022). Exploring the role of situational flow experience in learning through design in 3D multi-user virtual environments. International Journal of Technology and Design Education, 32(4), 2217–2237. https://doi.org/10.1007/s10798-021-09680-8
Elmore, P. B., & Woehlke, P. L. (1996). Research methods employed in American Educational Research Journal, Educational Researcher, and Review of Educational Research from 1978 to 1995. 1996 AERA Annual Meeting, 8–12 April 1996, New York, NY, USA. American Educational Research Association.
Engeser, S., & Rheinberg, F. (2008). Flow, performance and moderators of challenge-skill balance. Motivation and Emotion, 32(3), 158–172. https://doi.org/10.1007/s11031-008-9102-4
Ford, C., & Bryan-Kinns, N. (2022). Identifying engagement in children’s interaction whilst composing digital music at home. Proceedings of the 14th Conference on Creativity and Cognition (C&C ’22), 20–23 June 2022, Venice, Italy (pp. 443–456). ACM Press. https://doi.org/10.1145/3527927.3532794
Gao, B., Wan, Q., Chang, T., & Huang, R. (2019). A framework of learning activity design for flow experience in smart learning environment. In M. Chang, E. Popescu, Kinshuk, N.-S. Chen, M. Jemni, R. Huang, J. M. Spector, & D. G. Sampson (Eds.), Foundations and trends in smart learning: Proceedings of the 2019 International Conference on Smart Learning Environments (pp. 5–14). Springer Singapore. https://doi.org/10.1007/978-981-13-6908-7_2
Hackert, B., Lumma, A.-L., Raettig, T., Berger, B., & Weger, U. (2023). Towards a re‐conceptualization of flow in social contexts. Journal for the Theory of Social Behaviour, 53(1), 100–125. https://doi.org/10.1111/jtsb.12362
Hamari, J., Shernoff, D. J., Rowe, E., Coller, B., Asbell-Clarke, J., & Edwards, T. (2016). Challenging games help students learn: An empirical study on engagement, flow and immersion in game-based learning. Computers in Human Behavior, 54, 170–179. https://doi.org/10.1016/j.chb.2015.07.045
Hernández-Leo, D., Dimitriadis, Y., Asensio-Pérez, J. I., Villasclaras-Fernández, E. D., JorrínAbellán, Í. M., Ruiz-Requies, I., & Rubia-Avi, B. (2006). COLLAGE: A collaborative learning design editor based on patterns. Journal of Educational Technology and Society, 9(1), 58–71. http://hdl.handle.net/10230/5939
Hernández-Leo, D., Asensio-Pérez, J. I., & Dimitriadis, Y. (2005a). Computational representation of collaborative learning flow patterns using IMS learning design. Educational Technology & Society, 8(4), 75–89. https://www.jstor.org/stable/jeductechsoci.8.4.75
Hernández-Leo, D., Aseniso-Pérez, J. I., Dimitriadis, Y., Bote-Lorenzo, M. L., Jorrín-Abellán, I. M., & Villasclaras-Fernández, E. D. (2005b). Reusing IMS-LD formalized best practices in collaborative learning structuring. Advanced Technology for Learning, 2(3), 223–232.
Hernández-Leo, D., Asensio-Pérez, J. I., Dimitriadis, Y., & Villasclaras-Fernández, E. D. (2010). Generating CSCL scripts: From a conceptual model of pattern languages to the design of real scripts. In P. Goodyear & S. Retalis (Eds.), Technology-enhanced learning: Design patterns and pattern languages (pp. 49–64). Sense Publishers. https://doi.org/10.1163/9789460910623_004
Heutte, J., Fenouillet, F., Martin-Krumm, C., Gute, G., Raes, A., Gute, D., Bachelet, R., & Csikszentmihalyi, M. (2021). Optimal experience in adult learning: Conception and validation of the flow in education scale (EduFlow-2). Frontiers in Psychology, 12, 828027. https://doi.org/10.3389/fpsyg.2021.828027
Hou, H.-T., & Keng, S.-H. (2021). A dual-scaffolding framework integrating peer-scaffolding and cognitive-scaffolding for an augmented reality-based educational board game: An analysis of learners’ collective flow state and collaborative learning behavioral patterns. Journal of Educational Computing Research, 59(3), 547–573. https://doi.org/10.1177/0735633120969409
Jackson, S. A., & Marsh, H. W. (1996). Development and validation of a scale to measure optimal experience: The Flow State Scale. Journal of Sport and Exercise Psychology, 18(1), 17–35. https://doi.org/10.1123/jsep.18.1.17
Jackson, S. A., & Eklund, R. C. (2002). Assessing flow in physical activity: The Flow State Scale-2 and Dispositional Flow Scale-2. Journal of Sport and Exercise Psychology, 24(2), 133–150. https://doi.org/10.1123/jsep.24.2.133
Järvenoja, H., Järvelä, S., & Malmberg, J. (2017). Supporting groups’ emotion and motivation regulation during collaborative learning. Learning and Instruction, 70, 101090. https://doi.org/10.1016/j.learninstruc.2017.11.004
Jermann, P., Soller, A., & Lesgold, A. (2004). Computer software support for CSCL. In J.-W. Strijbos, P. A. Kirschner, & R. L. Martens (Eds.), What we know about CSCL: And implementing it in higher education (pp. 141–166). Springer Dordrecht. https://doi.org/10.1007/1-4020-7921-4_6
Kim, J. H. (2019). Multicollinearity and misleading statistical results. Korean Journal of Anesthesiology, 72(6), 558–569. https://doi.org/10.4097/kja.19087
Klein, B. D., Rossin, D., Guo, Y. M., & Ro, Y. K. (2010). An examination of the effects of flow on learning in a graduate level introductory operations management course. Journal of Education for Business, 85(5), 292–298. https://doi.org/10.1080/08832320903449600
Kloos, C. D., & Alario-Hoyos, C. (2021). Educational pyramids aligned: Bloom’s taxonomy, the DigCompEdu framework and instructional designs. 2021 World Engineering Education Forum/Global Engineering Deans Council (WEEF/GEDC), 15–18 November 2021, Madrid, Spain (pp. 110–117). IEEE. https://doi.org/10.1109/WEEF/GEDC53299.2021.9657335
Lee, H., Kim, J., & Bae, I. (2019). A research on the mediating role of flow experience between involvement and satisfaction-focus on leisure satisfaction for university students. International Journal of Recent Technology and Engineering, 8(2S6), 27–30. http://www.doi.org/10.35940/ijrte.B1006.0782S619
Lobo-Quintero, R., & Hernández-Leo, D. (2020). An analysis of the game mechanics and learning analytics behind Pyramid collaboration scripts. In M. Scheffel, N. Dowell, S. Joksimović, & G. Siemens (Eds.), Companion Proceedings of the 11th International Learning Analytics and Knowledge Conference (LAK’21), 12–16 April 2021, Online (pp. 224–236). SOLAR. https://www.solaresearch.org/core/lak20-companion-proceedings/
Mahnke, R., Benlian, A., & Hess, T. (2014). Flow experience in information systems research: Revisiting its conceptualization, conditions, and effects. Proceedings of the 2014 International Conference on Information Systems (ICIS 2014), 14–17 December 2014, Aukland, New Zealand. Association for Information Systems. https://doi.org/10.13140/2.1.4852.0486
Manathunga, K., & Hernández-Leo, D. (2018). Authoring and enactment of mobile pyramid-based collaborative learning activities. British Journal of Educational Technology, 49(2), 262–275. https://doi.org/10.1111/bjet.12588
Moral-Bofill, L., de la Llave, A. L., & Pérez-Llantada, M. C. (2023). Predictors of flow state in performing musicians: An analysis with the logistic regression method. Frontiers in Psychology, 14, 1271829. https://doi.org/10.3389%2Ffpsyg.2023.1271829
Näykki, P., Järvelä, S., Kirschner, P. A., & Järvenoja, H. (2014). Socio-emotional conflict in collaborative learning: A process-oriented case study in a higher education context. International Journal of Educational Research, 68, 1–14. https://doi.org/10.1016/j.ijer.2014.07.001
Oliveira, W., Tenório, K., Hamari, J., Pastushenko, O., & Isotani, S. (2021). Predicting students’ flow experience through behavior data in gamified educational systems. Smart Learning Environments, 8(1), 30. https://doi.org/10.1186/s40561-021-00175-6
Oliveira, W., Tenório, K., Hamari, J., & Isotani, S. (2022). The relationship between students’ flow experience and their behavior data in gamified educational systems. Proceedings of the 55th Hawaii International Conference on System Sciences, 3–7 January 2022, Virtual (pp. 64–73). University of Hawaii at Manoa. https://doi.org/10.24251/hicss.2022.008
Patel, H., Pettitt, M., & Wilson, J. R. (2012). Factors of collaborative working: A framework for a collaboration model. Applied Ergonomics, 43(1), 1–26. https://doi.org/10.1016/j.apergo.2011.04.009
Pels, F., Kleinert, J., & Mennigen, F. (2018). Group flow: A scoping review of definitions, theoretical approaches, measures and findings. PLoS One, 13(12), e0210117. https://doi.org/10.1371/journal.pone.0210117
Qureshi, M. A., Khaskheli, A., Qureshi, J. A., Raza, S. A., & Yousufi, S. Q. (2023). Factors affecting students’ learning performance through collaborative learning and engagement. Interactive Learning Environments, 31(4), 2371–2391. https://doi.org/10.1080/10494820.2021.1884886
Rheinberg, F., Vollmeyer, R., & Engeser, S. (2003). Die erfassung des flow-erlebens [Capturing the flow experience]. In J. Stiensmeier-Pelste & F. Rheinberg (Eds.), Diagnostik von motivation und selstkonzept [Diagnosics of motivation and self-concept] (pp. 261–279). Hogrefe. https://publishup.uni-potsdam.de/opus4-ubp/frontdoor/deliver/index/docId/551/file/Rheinberg_ErfassungFlow_Erleben_mitAnhangFKS.pdf
Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55(1), 68–78. https://doi.org/10.1037/0003-066X.55.1.68
Sanjamsai, S., & Phukao, D. (2018). Flow experience in computer game playing among Thai university students. Kasetsart Journal of Social Sciences, 39(2), 175–182. https://doi.org/10.1016/j.kjss.2018.03.003
Scager, K., Boonstra, J., Peeters, T., Vulperhorst, J., & Wiegant, F. (2016). Collaborative learning in higher education: Evoking positive interdependence. CBE–Life Sciences Education, 15(4), ar69. https://doi.org/10.1187%2Fcbe.16-07-0219
Sawyer, K. (2007). Improvisation and teaching. Critical Studies in Improvisation/Études critiques en improvisation, 3(2). https://doi.org/10.21083/csieci.v3i2.380
Sawyer, K. (2015). Group flow and group genius. NAMTA Journal, 40(3), 29–52. http://eric.ed.gov/?id=EJ1077079
Semerci, Y. C., & Goularas, D. (2021). Evaluation of students’ flow state in an e-learning environment through activity and performance using deep learning techniques. Journal of Educational Computing Research, 59(5), 960–987. https://doi.org/10.1177/0735633120979836
Shernoff, D. J., Csikszentmihalyi, M., Schneider, B., & Shernoff, E. S. (2003). Student engagement in high school classrooms from the perspective of flow theory. School Psychology Quarterly, 18(2), 158–176. https://doi.org/10.1521/scpq.18.2.158.21860
Sillaots, M., & Jesmin, T. (2016). Multiple regression analysis: Refinement of the model of flow. In T. Connolly & L. Boyle (Eds.), Proceedings of the 10th European Conference on Games Based Learning (ECGBL 2016), 6–7 October 2016, Paisley, Scotland, UK (pp. 609−616). Academic Conferences and Publishing International Ltd.
Theophilou, E., Sanchez-Reina, R., Hernandez-Leo, D., Odakura, V., Amarasinghe, I., & Lobo-Quintero, R. (2024). The effect of a group awareness tool in synchronous online discussions: Studying participation, quality and balance. Behaviour & Information Technology, 43(6), 1149–1163. https://doi.org/10.1080/0144929X.2023.2200543
Tsai, C.-L., Cai, Z., & Wu, X. (1998). The examination of residual plots. Statistica Sinica, 8(2), 445–465. https://www.jstor.org/stable/24306502
Van Aalst, J. (2009). Distinguishing knowledge-sharing, knowledge-construction, and knowledge-creation discourses. International Journal of Computer-Supported Collaborative Learning, 4(3), 259–287. https://doi.org/10.1007/s11412-009-9069-5
Van den Hout, J. J., Davis, O. C., & Walrave, B. (2016). The application of team flow theory. Flow experience: Empirical research and applications, 233–247. https://doi.org/10.1007/978-3-319-28634-1_15
van Schaik, P., Martin, S., & Vallance, M. (2012). Measuring flow experience in an immersive virtual environment for collaborative learning. Journal of Computer Assisted Learning, 28(4), 350–365. https://doi.org/10.1111/j.1365-2729.2011.00455.x
Vann, S. W., & Tawfik, A. A. (2020). Flow theory and learning experience design in gamified learning environments. In M. Schmidt, A. A. Tawfik, I. Jahnke, & Y. Earnshaw (Eds.), Learner and user experience research: An introduction for the field of learning design & technology (pp. 87–103). EdTech Books. https://doi.org/10.59668/36
Velamazán, M., Santos, P., Hernández-Leo, D., & Amarasinghe, I. (2022). Student preferences and behaviour in anonymous collaborative learning. Proceedings of the 15th International Conference on Computer-Supported Collaborative Learning (CSCL 2022), 6–10 June 2022, Hiroshima, Japan (pp. 419–422). International Society of the Learning Sciences. https://repository.isls.org//handle/1/8323
Wang, C.-C., & Hsu, M.-C. (2014). An exploratory study using inexpensive electroencephalography (EEG) to understand flow experience in computer-based instruction. Information & Management, 51(7), 912–923. https://doi.org/10.1016/j.im.2014.05.010
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Journal of Learning Analytics
This work is licensed under a Creative Commons Attribution 4.0 International License.
