Analysis of Student Pair Teamwork Using GitHub Activities

International Educational Data Mining. e-mail: [email protected]; Web site: https://jedm.educationaldatamining.org/index.php/JEDM

Y

31

National Science Foundation (NSF)

1714538

Cooperative Learning; Computer Science Education; Programming; Student Projects; Learning Activities; Web Sites; Academic Achievement; Help Seeking; Undergraduate Students; Programming Languages; Group Membership; Classification; Teamwork

2157-2100

Few studies have analyzed students' teamwork (pairwork) habits in programming projects due to the challenges and high cost of analyzing complex, long-term collaborative processes. In this work, we analyze student teamwork data collected from the GitHub platform with the goal of identifying specific pair teamwork styles. This analysis builds on an initial corpus of commit message data that was manually labeled by subject matter experts. We then extend this annotation through the use of self-supervised, semi-supervised learning to develop a large-scale annotated dataset that covers multiple course offerings from a second-semester CS2 course. Further, we develop a series of predictive models to automatically identify student teamwork styles. Finally, we compare trends in students' performance and team selection for each teamwork style to see if any of them reflected better student outcomes or different trends of help-seeking among students. Our analysis showed that applying self-supervised semi-supervised methods helps us to label larger subsets of data automatically and maintains and even sometimes improves the performance of the fully supervised models on a held-out validation set. Our analysis also showed that members of teams in which all members have significant contributions tend to have better performance in class, but their help-seeking behaviors are not significantly different.

As Provided

2023

EJ1383369