Abstract:

The Alpen-Adria-Universität Klagenfurt (AAUK), Austria, implemented eLearning and Blended learning strategies about ten years ago. It is one of our declared goals to provide our university’s students with adequate teaching methods. However, lecturing is only one side of the coin, since the testing of knowledge is still an important and non trivial part in today’s university life. Therefore, up-to-date teaching methods (e.g., eLearning enhanced or computer-based courses) require also up-to-date testing methods. In order to fulfil this need, we implemented a self-developed secure online exam environment that enables online testing on students’ own devices without access to their own files or to unauthorized Internet webpages. Loan devices are offered in case students have no device or their device is out-dated for the secure exam environment.

Many study programmes have already implemented standardized paper-pencil tests using e.g. single or multiple-choice questions, however, being faced with enormous correction work. Online testing indeed offers a tremendous workload relief, since standardized questions are evaluated automatically. Nevertheless, lecturers also profit from the use of free-text questions, since assistance can be recognized through, inter alia, improved readability. For students the particular advantages of this form of testing lie for example in the facilitation of adding or changing answers in a much more structured and proper way. Another major benefit of online testing, especially for students, is the possibility to use various feedback options, like immediate feedback after the submission of the test or individual feedback, which students with traditional testing would not received, since they usually do not take the advantage to go the lecturers’ office to inspect the test.

Nonetheless, it has to be pinpointed that the initial efforts from the lecturers’ side might be higher due to the creation of online questions. However, over the time a question pool establishes, revealing very clearly the sustainability of online testing. Additionally, the shuffling of questions and answers decreases chances for cheating. Nevertheless, we have to highlight that we are still faced with challenges like technical restraints in lecture halls or technical problems with students’ devices.

However, online testing offers enormous possibilities. The safe exam environment, for example, enables also the integration of other software programmes like Excel or the possibility to conduct open-book test (with online resources). Furthermore, without the safe exam environment online testing applications are also possible e.g., group works can be conducted. Furthermore, online self-evaluation tests can easily be executed offering students the chance to assess and evaluate knowledge deficits. Therefore, the purpose of this paper is to give an overview of the first experiences with online testing at the AAUK, highlighting major advantages and benefits, obstacles as well as future plans and directions.

Keywords:

On-line testing methods, Secure on-line testing, safe exam environment, benefits, obstacles.