DIGITAL LIBRARY
COMPARING PERCEPTION AND REALITY: EXPLORING TEST COMPLEXITY AND STUDENT PERFORMANCE IN HIGHER EDUCATION
1 Brainster Next College (MACEDONIA)
2 Nova IMS Information Management School, Universidade Nova de Lisboa (PORTUGAL)
3 Faculty of Computer Science & Engineering, Ss. Cyril and Methodius University (MACEDONIA)
About this paper:
Appears in: ICERI2023 Proceedings
Publication year: 2023
Pages: 6654-6660
ISBN: 978-84-09-55942-8
ISSN: 2340-1095
doi: 10.21125/iceri.2023.1660
Conference name: 16th annual International Conference of Education, Research and Innovation
Dates: 13-15 November, 2023
Location: Seville, Spain
Abstract:
Building on previous work where we investigated the correlation between perceived test complexity and student performance using a subset of data from a single subject, this study expands the scope to provide a more comprehensive analysis. This time, we engage with a more robust dataset that spans an entire academic year, including 1801 records from 47 students across 9 subjects, covering 89 distinct activities.

Our aim remains constant – to explore whether there is an alignment between the professor's and students' perceptions of assignment complexity and how these perceptions influence the students' final performance. Professors were asked to rate the difficulty level of each assignment they administered, and students were requested to provide their perceived complexity upon submitting their solutions. Notably, these perceptions were collected independently, with neither party privy to the other's assessment. Student time on assignment was also measured by looking at the assignment start date, submission date and assignment due date. Two variables were extracted from this to help better understand student perception of assignment difficulty by looking at the time each student spent on a given assignment.

We employed the k-means clustering algorithm to discern patterns in the relationship between the differences in complexity perceptions and student performance. The findings revealed a clear trend: students who perceive an assignment to be more difficult than their professor's rating tend to achieve lower scores. Although exploratory in nature, these findings have significant implications. They hint at the potential of leveraging perceptions of complexity as a tool for early identification of students likely to excel or struggle in a subject. This research reaffirms the importance of considering perception data as a valuable adjunct to performance metrics in higher education.

These conclusions emphasize the importance of monitoring not only students' performance but also their perception of test complexity. This can provide a more holistic view of their learning process and help educators create a more supportive and effective learning environment.
Keywords:
Student performance, student performance prediction, exam complexity, learning management systems, k-means clustering, student procrastination.