About this paper

Appears in:
Pages: 5306-5311
Publication year: 2017
ISBN: 978-84-697-3777-4
ISSN: 2340-1117
doi: 10.21125/edulearn.2017.2198

Conference name: 9th International Conference on Education and New Learning Technologies
Dates: 3-5 July, 2017
Location: Barcelona, Spain

EXPLORING THE RELATIONSHIP BETWEEN THE TIME OF COMPLETING ONLINE QUIZZES AND STUDENTS’ PERFORMANCE IN ACADEMIC WRITING

C. Armatas, A. Tse, J. Chow, D. Foung, J. Chen, C. Chan

The Hong Kong Polytechnic University (HONG KONG)
Students’ online behaviour in two academic English subjects was examined to determine if there is a relationship between students’ first attempt at topic quizzes and their academic performance. For each subject, online quizzes were released weekly on the learning management system (LMS), with quizzes remaining available until the end of semester. LMS data relating to the online quizzes was obtained for the 3078 students who completed the two subjects in the 2015/16 academic year. The plot of the cumulative percentage of students completing each quiz across the semester showed that over half of the students completed Quizzes 1, 2 and 3 in the first two weeks after they were released. However, it took four weeks to achieve a completion rate above 50% for other quizzes. At the end of semester a sudden jump was observed for the completion of quizzes. By week 13, the completion rate for Quizzes 1 to 9 reached as high as 90% while it hovered around 70% for Quizzes 10 to 13, which were released together in week 10. Results showed that fewer students did the quizzes at the time they were released. The completion pattern also showed that many students put off completing quizzes, leaving them to the end of semester.

Decision tree analysis was used to identify at-risk students based on their pattern of quiz completion. In this analysis, students were classified into three groups based on their final subject grade: at-risk students, typical students and high performing students. Membership of these categories was then used as the outcome variable in the decision tree analysis. The tree where three variables (week of first attempt of Quiz 1, 3 and 5) were entered to predict the students’ grade category membership identified that the week of first attempt for Quizzes 1, 3 and 5 were significant predictors and the likelihood of being an at-risk student was higher if Quiz 1 or 3 (together with Quiz 5) was completed late rather than early.

These results have implications for monitoring future students’ learning progress by observing quiz attempt behavior and following up students who do not complete the quizzes or complete them late. Instructors could make use of these findings to develop a notification system to monitor students’ progress. A reference point for reporting on quiz completion could be selected by the instructor, reminding the students to do the quizzes to help keep them on track. The results can also inform setting of quiz deadlines to better align monitoring and intervention. Assigning earlier deadlines could help instructors to support at-risk students according to quiz marks and completion time. To better assess for learning, instructors should also highlight the importance of completing quizzes earlier.

To improve prediction accuracy, other variables could be examined such as marks for each of the quizzes or other student behaviours in the LMS. However, this study has shown that simple indicators like time of quiz completion can predict academic performance as measured by students’ grades in the subject. For this subject, time of quiz completion appears to be an “at risk” indicator that teachers can monitor to help improve outcomes for students.
@InProceedings{ARMATAS2017EXP,
author = {Armatas, C. and Tse, A. and Chow, J. and Foung, D. and Chen, J. and Chan, C.},
title = {EXPLORING THE RELATIONSHIP BETWEEN THE TIME OF COMPLETING ONLINE QUIZZES AND STUDENTS’ PERFORMANCE IN ACADEMIC WRITING},
series = {9th International Conference on Education and New Learning Technologies},
booktitle = {EDULEARN17 Proceedings},
isbn = {978-84-697-3777-4},
issn = {2340-1117},
doi = {10.21125/edulearn.2017.2198},
url = {http://dx.doi.org/10.21125/edulearn.2017.2198},
publisher = {IATED},
location = {Barcelona, Spain},
month = {3-5 July, 2017},
year = {2017},
pages = {5306-5311}}
TY - CONF
AU - C. Armatas AU - A. Tse AU - J. Chow AU - D. Foung AU - J. Chen AU - C. Chan
TI - EXPLORING THE RELATIONSHIP BETWEEN THE TIME OF COMPLETING ONLINE QUIZZES AND STUDENTS’ PERFORMANCE IN ACADEMIC WRITING
SN - 978-84-697-3777-4/2340-1117
DO - 10.21125/edulearn.2017.2198
PY - 2017
Y1 - 3-5 July, 2017
CI - Barcelona, Spain
JO - 9th International Conference on Education and New Learning Technologies
JA - EDULEARN17 Proceedings
SP - 5306
EP - 5311
ER -
C. Armatas, A. Tse, J. Chow, D. Foung, J. Chen, C. Chan (2017) EXPLORING THE RELATIONSHIP BETWEEN THE TIME OF COMPLETING ONLINE QUIZZES AND STUDENTS’ PERFORMANCE IN ACADEMIC WRITING, EDULEARN17 Proceedings, pp. 5306-5311.
User:
Pass: