Assessing Patterns of Students’ Attainment of Professional Standards in Higher Education
DOI:
https://doi.org/10.18608/jla.2026.9035Keywords:
higher education, professional standards, academic success, distinct achievement patterns, curriculum analytics, research paperAbstract
It is widely recognized that higher education (HE) graduates require a broad range of professional skills and abilities to succeed in their future careers. However, despite this acknowledgement, assessment practices in HE remain focused on content-based knowledge. This narrow emphasis limits the capacity to effectively and holistically evaluate a student’s professional competency and readiness for employment. This issue is particularly acute for HE degrees that require graduates to demonstrate attainment of externally regulated professional standards. While the curricula are mapped to professional standards for accreditation purposes, demonstrating a student’s attainment of these standards is not straightforward and has mostly been done through self-reported surveys. This study offers a novel curriculum analytics method for mapping assessment grades to the attainment of professional standards across a Teacher Education program. Specifically, we present an approach that uses psychometric modelling and learning analytics to identify distinct patterns in learners’ acquisition of professional standards. This method does not alter current assessment practices in HE. Instead, the approach offers a scalable, automated means to infer a learner’s attainment of documented professional standards, complementing current measures of academic success, such as GPA. The study underscores the advantages of complementing the current HE assessment practises with an outlined curriculum analytics approach, providing a holistic representation of a student’s learning progress.
References
Ajjawi, R., & Boud, D. (2023). Changing representations of student achievement: The need for innovation. Innovations in Education and Teaching International, 61(3), 597–607. https://doi.org/10.1080/14703297.2023.2192513
Armatas, C., & Spratt, C. F. (2019). Applying learning analytics to program curriculum review. The International Journal of Information and Learning Technology, 36(3), 243–253. https://doi.org/10.1108/IJILT-11-2018-0133
Australian Institute for Teaching and School Leadership (AITSL). (2011). Australian professional standards for teachers. https://www.aitsl.edu.au/docs/default-source/national-policy-framework/australian-professional-standards-for-teachers.pdf
Barnett, R. (1994). The limits of competence: Knowledge, higher education and society. Open University Press. https://eric.ed.gov/?id=ed382101
Barthakur, A., Dawson, S. & Kovanović, V. (2023). Advancing learner profiles with learning analytics: A scoping review of current trends and challenges. In 13th International Learning Analytics and Knowledge Conference (pp. 606–612). ACM Press. https://doi.org/10.1145/3576050.3576083
Barthakur, A., Jovanović, J., Zamecnik, A., Kovanović, V., Xu, G., & Dawson, S. (2024). Towards comprehensive monitoring of graduate attribute development: A learning analytics approach in higher education. In Proceedings of the 14th Learning Analytics and Knowledge Conference (pp. 79–89). ACM Press. https://doi.org/10.1145/3636555.3636852
Barthakur, A., Kovanović, V., Dawson, S., & Deneen, C. C. (2024). The application of curriculum analytics for improving assessments and quality assurance in higher education. Australasian Journal of Educational Technology, 40(4), 20—37. https://doi.org/10.14742/ajet.9383
Baumert, J., Kunter, M., Blum, W., Brunner, M., Voss, T., Jordan, A., Klusmann, U., Krauss, S., Neubrand, M., & Tsai, Y.-M. (2010). Teachers’ mathematical knowledge, cognitive activation in the classroom, and student progress. American Educational Research Journal, 47(1), 133–180. https://doi.org/10.3102/0002831209345157
Biggs, J. (1996). Enhancing teaching through constructive alignment. Higher Education, 32(3), 347–364. https://doi.org/10.1007/BF00138871
Bourke, T., & Ryan, M. (2023). How is impact defined in initial teacher education policy in Australia? Teachers and Teaching, 29(2), 133–149. https://doi.org/10.1080/13540602.2022.2144824
Bravenboer, D., & Lester, S. (2016). Towards an integrated approach to the recognition of professional competence and academic learning. Education + Training, 58(4), 409–421. https://doi.org/10.1108/ET-10-2015-0091
Brawley, S., Clark, J., Dixon, C., Ford, L., Nielsen, E., Ross, S., & Upton, S. (2015). History on trial: Evaluating learning outcomes through audit and accreditation in a national standards environment. Teaching and Learning Inquiry, 3(2), 89–105. https://doi.org/10.2979/teachlearninqu.3.2.89
Call, K. (2018). Professional teaching standards: A comparative analysis of their history, implementation and efficacy. Australian Journal of Teacher Education, 43(3), 93–108. https://doi.org/10.14221/ajte.2018v43n3.6
Cañadas, L. (2023). Contribution of formative assessment for developing teaching competences in teacher education. European Journal of Teacher Education, 46(3), 516–532. https://doi.org/10.1080/02619768.2021.1950684
Charlton, N., Weir, K., & Newsham-West, R. (2022). Assessment planning at the program level: A higher education policy review in Australia. Assessment & Evaluation in Higher Education, 47(8), 1475–1488. https://doi.org/10.1080/02602938.2022.2061911
Clapper, T. C. (2010). Creating the safe learning environment. Pailal Newsletter, 3(2), 1–6. https://www.researchgate.net/publication/257835881_Creating_the_safe_learning_environment
Dawson, S., & Hubball, H. (2014). Curriculum analytics: Application of social network analysis for improving strategic curriculum decision-making in a research-intensive university. Teaching & Learning Inquiry, 8(1), 59–74. https://doi.org/10.2979/teachlearninqu.2.2.59
Dawson, S., Pardo, A., Salehian Kia, F., & Panadero, E. (2023). An integrated model of feedback and assessment: From fine grained to holistic programmatic review. In 13th International Learning Analytics and Knowledge Conference (pp. 579–584). ACM Press. https://doi.org/10.1145/3576050.3576074
Edwards, C. H., & Edwards, L. (1999). Let’s end the grading game. The Clearing House: A Journal of Educational Strategies, Issues and Ideas, 72(5), 260–263. https://doi.org/10.1080/00098659909599403
Field, A., Miles, J., & Field, Z. (2012). Discovering statistics using R. SAGE.
Fielding, D. W., & Regehr, G. (2017). A call for an integrated program of assessment. American Journal of Pharmaceutical Education, 81(4), Article 70. https://doi.org/10.5688/ajpe81477
Finch, W. H., & French, B. F. (2015). Latent variable modeling with R. Routledge.
Frank, J. R., Snell, L. S., ten Cate, O., Holmboe, E. S., Carraccio, C., Swing, S. R., Harris, P., Glasgow, N. J., Campbell, C., Dath, D., Harden, R. M., Iobst, W., Long, D. M., Mungroo, R., Richardson, D. L., Sherbino, J., Silver, I., Taber, S., Talbot, M., … Harris, K. A. (2010). Competency-based medical education: Theory to practise. Medical Teacher, 32(8), 638–645. https://doi.org/10.3109/0142159X.2010.501190
George, A. C., Robitzsch, A., Kiefer, T., Groß, J., & Ünlü, A. (2016). The R Package CDM for cognitive diagnosis models. Journal of Statistical Software, 74(2). https://doi.org/10.18637/jss.v074.i02
Gervais, J. (2016). The operational definition of competency-based education. Competency-Based Education, 1(2), 98–106. https://doi.org/10.1002/cbe2.1011
Hattie, J. A. C. (2003, October). Teachers make a difference: What is the research evidence? Paper presented at the Building Teacher Quality: What Does the Research Tell Us? ACER Research Conference, Melbourne, Australia. http://research.acer.edu.au/research_conference_2003/4/
Khosravi, H., Sadiq, S., & Amer-Yahia, S. (2023). Data management of AI-powered education technologies: Challenges and opportunities. Learning Letters, 1, Article 2. https://doi.org/10.59453/XLUD7002
Holmes, D. W., Sheehan, M., Birks, M., & Smithson, J. (2018). Development of a competency mapping tool for undergraduate professional degree programmes, using mechanical engineering as a case study. European Journal of Engineering Education, 43(1), 126–143. https://doi.org/10.1080/03043797.2017.1324404
Hudson, P., & Grove, K. (2009). How can pre-service teachers be measured against advocated professional teaching standards? Australian Journal of Teacher Education, 34(5), 79–87. https://doi.org//10.14221/ajte.2009v34n5.6
Joksimović, S., Siemens, G., Wang, Y. E., San Pedro, M. O. Z., & Way, J. (2020). Beyond cognitive ability. Journal of Learning Analytics, 7(1), 1–4. http://dx.doi.org/10.18608/jla.2020.71.1
Kaļķe, B., Baranova, S., & Āboltiņa, L. (2022). Self-assessment of the professional competence of preschool teaching students. Acta Paedagogica Vilnensia, 48, 116–128. https://doi.org/10.15388/ActPaed.2022.48.7
Lalor, J., Lorenzi, F., & Rami, J. (2015). Developing professional competence through assessment: Constructivist and reflective practice in teacher training. Eurasian Journal of Educational Research, 15(58), 45–66. https://doi.org/10.14689/ejer.2015.58.6
Maechler, M., Rousseeuw, P., Struyf, A., Hubert, M., Hornik, K., Studer, M., Roudier, P., Gonzalez, J., Kozlowski, K., & Schubert, E. (2013). Package ‘cluster’. Dosegljivo na, 980, 1–84. https://mirrors.nics.utk.edu/cran/web/packages/cluster/cluster.pdf
Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741–749. https://psycnet.apa.org/doi/10.1037/0003-066X.50.9.741
Paek, S., Leong, P., Johnson, P., & Moore, C. (2021). Is GPA enough? A platform for promoting computer science undergraduates’ pursuit of career related extracurricular activities. International Journal of Technology in Education and Science, 5(1), 1–16. https://doi.org/10.46328/ijtes.146
Pellegrino, J. W., Chudowsky, N., & Glaser, R. (Eds.). (2001). Knowing what students know: The science and design of educational assessment. National Academies Press.
Poquet, O., Kitto, K., Jovanović, J., Dawson, S., Siemens, G., & Markauskaite, L. (2021). Transitions through lifelong learning: Implications for learning analytics. Computers and Education: Artificial Intelligence, 2, Article 100039. https://doi.org/10.1016/j.caeai.2021.100039
Ruge, G., Tokede, O., & Tivendale, L. (2019). Implementing constructive alignment in higher education: Cross-institutional perspectives from Australia. Higher Education Research & Development, 38(4), 833–848. https://doi.org/10.1080/07294360.2019.1586842
Rupp, A. A., & Templin, J. L. (2008). Unique characteristics of diagnostic classification models: A comprehensive review of the current state-of-the-art. Measurement: Interdisciplinary Research and Perspectives, 6(4), 219–262. https://doi.org/10.1080/15366360802490866
Sachs, J. (2003). Teacher professional standards: Controlling or developing teaching? Teachers and Teaching, 9(2), 175–186. https://doi.org/10.1080/13540600309373
Shtymak, A., Mulesa, P., & Malyar, M. (2020). Procedure for determination of professional competence of a higher education institution graduate. In 2020 IEEE Third International Conference on Data Stream Mining & Processing (DSMP) (pp. 460–463). https://doi.org/10.1109/DSMP47368.2020.9204112
Soh, K. C. (2010). Grade point average: What’s wrong and what’s the alternative? Journal of Higher Education Policy and Management, 33(1), 27–36. https://doi.org/10.1080/1360080X.2011.537009
Sweeney, T.-A., & Nielsen, B. (2017). Using a developmental assessment rubric to revitalise stakeholder conversations in professional experience. In J. Kriewaldt, A. Ambrosetti, D. Rorrison, & R. Capeness (Eds.), Educating future teachers: Innovative perspectives in professional experience (pp. 137–156). Springer. https://doi.org/10.1007/978-981-10-5484-6_9
Swiecki, Z., Khosravi, H., Chen, G., Martinez-Maldonado, R., Lodge, J. M., Milligan, S., Selwyn, N., & Gašević, D. (2022). Assessment in the age of artificial intelligence. Computers and Education: Artificial Intelligence, 3, 100075. https://doi.org/10.1016/j.caeai.2022.100075
Varadarajan, S., Koh, J. H. L., & Daniel, B. K. (2023). A systematic review of the opportunities and challenges of micro-credentials for multiple stakeholders. International Journal of Educational Technology in Higher Education, 20(1), Article 13. https://doi.org/10.1186/s41239-023-00393-7
Webb, N. L. (2007). Issues related to judging the alignment of curriculum standards and assessments. Applied Measurement in Education, 20(1), 7–25. https://doi.org/10.1207/s15324818ame2001_2
West, R. E., & Cheng, Z. (2022). Digital credential evolution: How open microcredentials/badges support learning in micro-, meso-, and macro-levels. In O. Zawacki-Richter & I. Jung (Eds.), Handbook of open, distance and digital education (pp. 1197–1216). Springer.
Wu, M., Tam, H. P., & Jen, T.-H. (2016). Educational measurement for applied researchers. Springer. https://doi.org/10.1007/978-981-10-3302-5
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Journal of Learning Analytics
This work is licensed under a Creative Commons Attribution 4.0 International License.
