A data driven study of students' completion of online homework

Author / Creator

AAPT SM21 (2021)

Conferences

AAPT SM21 PS.B-SA-03: Examining student-side interactions with technology (2021)

Available as

Online

Summary

We examined the prevalence of rapid answer copying among university students completing online homework for an introductory level calculus-based physics course taught remotely during the COVID pand...

We examined the prevalence of rapid answer copying among university students completing online homework for an introductory level calculus-based physics course taught remotely during the COVID pandemic. We first compared the attempt duration distribution of 26 problems, between 42 students who self-reported as having completed the homework by themselves against the rest of the class. Significant differences were detected for 3 out of 26 problems. We then identified abnormally short problem attempts indicative of potential rapid answer copying, by fitting the attempt duration distribution of each problem with finite-mixture models, using mixtures of either normal or skewed distributions. We detected a significantly smaller fraction of short attempts from self-reporting students on only 3 out of 26 problems, and found no statistically significant difference in percentage correct of short attempts between the populations. In conclusion, our analysis did not find evidence indicating wide-spread rapid answer copying among students. We also explored differences in learning behavior between the two populations by applying process mining to the event logs of one of the homework learning modules, which reveals that some students may have copied answers after spending longer time or using multiple attempts on a given problem. However, this form of answer copying is also unlikely to be prevalent since the percentage correct on normal attempts are also similar between the two populations on most problems.

Show More