About this paper

Appears in:
Pages: 3840-3844
Publication year: 2018
ISBN: 978-84-09-02709-5
ISSN: 2340-1117
doi: 10.21125/edulearn.2018.0973

Conference name: 10th International Conference on Education and New Learning Technologies
Dates: 2-4 July, 2018
Location: Palma, Spain

SHORTER TESTS WITH MORE DIFFICULT QUESTIONS, OR LONGER TESTS WITH EASIER QUESTIONS: WHICH DO TEST TAKERS PREFER?

T. Kimura

Niigata Seiryo University (JAPAN)
Most computerized adaptive testing (CAT) algorithms select items that each test-taker should be able to answer correctly at 50% to 60 % chance level because it can reduce the number of item and shorten the test length without deteriorating measurement precision. However, experience of taking such tests may cause backwash effects, such as loss of self-confidence, loss of self-efficacy, and loss of motivation (Kimura & Nagaoka,2011).

The previous questionnaire research immediately after CAT for Japanese university students revealed that test takers tend to prefer the longer test with easier items than the shorter test with more difficult items (Kimura, 2016; Kimura & Koyama, 2016).

After developing and implementing of a Moodle-based CAT system in order to manipulate target probabilities (TP) of answering correct, Kimura (2017) enhanced the CAT system to implement a multistage CAT system on Moodle.

The purpose of this paper is to investigate if test takers actually tend to select the longer test with easier items than the shorter test with more difficult items. A two-stage CAT was administered to 78 Japanese university students. A half of them started the longer test with easier items for the first stage, and the other half started the shorter test with more difficult items for the first stage.

After the first stage, they were asked to choose:
1) to continue the test with the same TP and number of item for their second stage, or
2) to continue the test with different TP and number of item for the second stage.

Theoretically, all test taker should end with the same measurement precision. The result will be presented at the conference and some implication of the multistage CAT system will be discussed.
@InProceedings{KIMURA2018SHO,
author = {Kimura, T.},
title = {SHORTER TESTS WITH MORE DIFFICULT QUESTIONS, OR LONGER TESTS WITH EASIER QUESTIONS: WHICH DO TEST TAKERS PREFER?},
series = {10th International Conference on Education and New Learning Technologies},
booktitle = {EDULEARN18 Proceedings},
isbn = {978-84-09-02709-5},
issn = {2340-1117},
doi = {10.21125/edulearn.2018.0973},
url = {http://dx.doi.org/10.21125/edulearn.2018.0973},
publisher = {IATED},
location = {Palma, Spain},
month = {2-4 July, 2018},
year = {2018},
pages = {3840-3844}}
TY - CONF
AU - T. Kimura
TI - SHORTER TESTS WITH MORE DIFFICULT QUESTIONS, OR LONGER TESTS WITH EASIER QUESTIONS: WHICH DO TEST TAKERS PREFER?
SN - 978-84-09-02709-5/2340-1117
DO - 10.21125/edulearn.2018.0973
PY - 2018
Y1 - 2-4 July, 2018
CI - Palma, Spain
JO - 10th International Conference on Education and New Learning Technologies
JA - EDULEARN18 Proceedings
SP - 3840
EP - 3844
ER -
T. Kimura (2018) SHORTER TESTS WITH MORE DIFFICULT QUESTIONS, OR LONGER TESTS WITH EASIER QUESTIONS: WHICH DO TEST TAKERS PREFER?, EDULEARN18 Proceedings, pp. 3840-3844.
User:
Pass: