Measuring Leadership Development in Workplace Learning Using Automated Assessments: Learning Analytics and Measurement Theory Approach

Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: [email protected]; Web site: https://www.wiley.com/en-us

Y

22

Leadership; Workplace Learning; Computer Assisted Testing; Evaluation Methods; Automation; MOOCs; Professional Development; Reflection

10.1111/bjet.13218

0007-1013
1467-8535

Technological affordances have shown promising potential in advancing the delivery of corporate learning programmes designed for professional leadership development. However, there is a considerable challenge in evaluating learners' skill acquisition, with most of the past research relying on pre- and post-tests or other forms of self-reports to measure leadership development. In that sense, these approaches measure leadership development before and after the programme, while being inefficient for measuring the development during the learning process. This study collected self-reflection answers from a professional development MOOC that allows learners to express their stepwise learning and reflect on their professional experience on leadership fronts. We developed a novel methodology and an automated system for the evaluation of leadership skills' mastery based on the depth of reflection exhibited during the learning process. We identified four groups of learners based on their course content mastery and explored the differences within groups. The results also highlight relevant insights about instructional design and provide promising avenues for future research.

As Provided

2022

EJ1350620