About this paper

Appears in:
Pages: 4441-4450
Publication year: 2018
ISBN: 978-84-09-02709-5
ISSN: 2340-1117
doi: 10.21125/edulearn.2018.1115

Conference name: 10th International Conference on Education and New Learning Technologies
Dates: 2-4 July, 2018
Location: Palma, Spain

STUDENT AND INSTRUCTOR EXPERIENCES WITH A COMPUTER-BASED TESTING FACILITY

C. Zilles, M. West, D. Mussulman, C. Sacris

University of Illinois at Urbana-Champaign (UNITED STATES)
In a large engineering university, introductory engineering courses typically have hundreds of students which makes running exams challenging. To meet this challenge, over the past 4 years we've developed a large-scale Computer-Based Testing Facility (CBTF). The CBTF is a proctored computer lab where students are offered individualized exams and these exams can include a broad range of question types (e.g., numeric, graphical, design, and programming; not just multiple choice). In Fall 2017, the CBTF served 21 courses from seven different departments in the College of Engineering and over 6,000 unique students. Over 52,000 exams were proctored, including 3,500 final exams.

In this work, we explore how this large-scale introduction of computer-based testing has impacted students and instructors. Specifically, after describing the basic operation of the CBTF, we discuss the results of multiple rounds of surveys completed by students and faculty.

Some highlights from our student surveys include:
(1) students generally are more satisfied with CBTF exams relative to traditional paper exams (45% satisfied or very satisfied, vs. 17% dissatisfied or very dissatisfied), but this preference seems to vary by major, with computer science and electrical engineering majors even more strongly preferring the computerized exams,
(2) students' favorite aspects of CBTF exams include the flexibility to schedule them at convenient times, that CBTF courses generally have more frequent, shorter tests, and the opportunities to take second chance exams, and
(3) some students prefer the partial credit mechanism commonly used in traditional written exams, where credit is granted for work shown for incorrect answers.

Instructors report having generally positive experiences with the CBTF. A large majority report that once the exam content is in place they perceive reductions in the effort to run and grade exams and to handle the exceptional situations that result from running exams in large classes. Instructors also like how the CBTF enables them to run small frequent tests, run second-chance exams, and test computational skills. Instructors also reported generally high satisfaction with operational aspects of the CBTF, including rules and systems, communication with CBTF staff and proctors. About 85% of the surveyed instructors plan to continue using the CBTF, think that it should be expanded, and want more resources devoted to improving it.
@InProceedings{ZILLES2018STU,
author = {Zilles, C. and West, M. and Mussulman, D. and Sacris, C.},
title = {STUDENT AND INSTRUCTOR EXPERIENCES WITH A COMPUTER-BASED TESTING FACILITY},
series = {10th International Conference on Education and New Learning Technologies},
booktitle = {EDULEARN18 Proceedings},
isbn = {978-84-09-02709-5},
issn = {2340-1117},
doi = {10.21125/edulearn.2018.1115},
url = {http://dx.doi.org/10.21125/edulearn.2018.1115},
publisher = {IATED},
location = {Palma, Spain},
month = {2-4 July, 2018},
year = {2018},
pages = {4441-4450}}
TY - CONF
AU - C. Zilles AU - M. West AU - D. Mussulman AU - C. Sacris
TI - STUDENT AND INSTRUCTOR EXPERIENCES WITH A COMPUTER-BASED TESTING FACILITY
SN - 978-84-09-02709-5/2340-1117
DO - 10.21125/edulearn.2018.1115
PY - 2018
Y1 - 2-4 July, 2018
CI - Palma, Spain
JO - 10th International Conference on Education and New Learning Technologies
JA - EDULEARN18 Proceedings
SP - 4441
EP - 4450
ER -
C. Zilles, M. West, D. Mussulman, C. Sacris (2018) STUDENT AND INSTRUCTOR EXPERIENCES WITH A COMPUTER-BASED TESTING FACILITY, EDULEARN18 Proceedings, pp. 4441-4450.
User:
Pass: