TY - JOUR
T1 - Quantitative approach to collaborative learning
T2 - performance prediction, individual assessment, and group composition
AU - Cen, Ling
AU - Ruta, Dymitr
AU - Powell, Leigh
AU - Hirsch, Benjamin
AU - Ng, Jason
N1 - Publisher Copyright:
© 2016, International Society of the Learning Sciences, Inc.
PY - 2016/6/1
Y1 - 2016/6/1
N2 - The benefits of collaborative learning, although widely reported, lack the quantitative rigor and detailed insight into the dynamics of interactions within the group, while individual contributions and their impacts on group members and their collaborative work remain hidden behind joint group assessment. To bridge this gap we intend to address three important aspects of collaborative learning focused on quantitative evaluation and prediction of group performance. First, we use machine learning techniques to predict group performance based on the data of member interactions and thereby identify whether, and to what extent, the group’s performance is driven by specific patterns of learning and interaction. Specifically, we explore the application of Extreme Learning Machine and Classification and Regression Trees to assess the predictability of group academic performance from live interaction data. Second, we propose a comparative model to unscramble individual student performances within the group. These performances are then used further in a generative mixture model of group grading as an explicit combination of isolated individual student grade expectations and compared against the actual group performances to define what we coined as collaboration synergy - directly measuring the improvements of collaborative learning. Finally the impact of group composition of gender and skills on learning performance and collaboration synergy is evaluated. The analysis indicates a high level of predictability of group performance based solely on the style and mechanics of collaboration and quantitatively supports the claim that heterogeneous groups with the diversity of skills and genders benefit more from collaborative learning than homogeneous groups.
AB - The benefits of collaborative learning, although widely reported, lack the quantitative rigor and detailed insight into the dynamics of interactions within the group, while individual contributions and their impacts on group members and their collaborative work remain hidden behind joint group assessment. To bridge this gap we intend to address three important aspects of collaborative learning focused on quantitative evaluation and prediction of group performance. First, we use machine learning techniques to predict group performance based on the data of member interactions and thereby identify whether, and to what extent, the group’s performance is driven by specific patterns of learning and interaction. Specifically, we explore the application of Extreme Learning Machine and Classification and Regression Trees to assess the predictability of group academic performance from live interaction data. Second, we propose a comparative model to unscramble individual student performances within the group. These performances are then used further in a generative mixture model of group grading as an explicit combination of isolated individual student grade expectations and compared against the actual group performances to define what we coined as collaboration synergy - directly measuring the improvements of collaborative learning. Finally the impact of group composition of gender and skills on learning performance and collaboration synergy is evaluated. The analysis indicates a high level of predictability of group performance based solely on the style and mechanics of collaboration and quantitatively supports the claim that heterogeneous groups with the diversity of skills and genders benefit more from collaborative learning than homogeneous groups.
KW - Collaborative learning
KW - Group composition
KW - Machine learning
KW - Performance modeling
KW - Performance prediction
UR - http://www.scopus.com/inward/record.url?scp=84966699856&partnerID=8YFLogxK
U2 - 10.1007/s11412-016-9234-6
DO - 10.1007/s11412-016-9234-6
M3 - Article
AN - SCOPUS:84966699856
SN - 1556-1607
VL - 11
SP - 187
EP - 225
JO - International Journal of Computer-Supported Collaborative Learning
JF - International Journal of Computer-Supported Collaborative Learning
IS - 2
ER -