About this paper

Appears in:
Pages: 924-927
Publication year: 2012
ISBN: 978-84-615-5563-5
ISSN: 2340-1079

Conference name: 6th International Technology, Education and Development Conference
Dates: 5-7 March, 2012
Location: Valencia, Spain

POSITIONAL EFFECT OF ITEM BLOCKS IN INTERNATIONAL LARGE-SCALE ASSESSMENT CAUSED THE ITEM DIFFICULTY DIFFERENT BETWEEN TAIWAN AND THE USA

K.M. Chen, T.H. Jen

National Taiwan Normal University (TAIWAN)
Many international large-scale educational survey studies, such as TIMSS, PIRLS and PISA, adopted the incomplete balanced booklet design to make sure that the estimated ability of examinees does not covariate with the position of item blocks. By this incomplete design every two booklets contain some common items, and the ability scales of booklets drawn from the item response theory can be equated across booklets through these common items. However, the positional effect of item blocks exists somehow within a booklet, which helps in understanding the influential factors of the item difficulty. For TIMSS 2007, a student spends two class periods to complete a booklet, and each class period consists of two item blocks. The current study thus explored the effects of the class period (first vs. second class period), the position of item block within a class period (first vs. second position), and the country (Taiwan vs. USA) on the item difficulty of TIMSS 2007 by treating them as facets of item difficulty in the generalized Rasch model. As the interaction suggests a practice effect in the first class period where an item was less difficult at the second position than the first position, and a fatigue effect in the second class period where an item was more difficult at the second position than the first position across countries, the USA demonstrated a more serious fatigue effect than Taiwan. Consequently, the serious fatigue effect caused the items more difficult and lowered the ability estimate of examinees of the USA in the end of testing.
@InProceedings{CHEN2012POS,
author = {Chen, K.M. and Jen, T.H.},
title = {POSITIONAL EFFECT OF ITEM BLOCKS IN INTERNATIONAL LARGE-SCALE ASSESSMENT CAUSED THE ITEM DIFFICULTY DIFFERENT BETWEEN TAIWAN AND THE USA},
series = {6th International Technology, Education and Development Conference},
booktitle = {INTED2012 Proceedings},
isbn = {978-84-615-5563-5},
issn = {2340-1079},
publisher = {IATED},
location = {Valencia, Spain},
month = {5-7 March, 2012},
year = {2012},
pages = {924-927}}
TY - CONF
AU - K.M. Chen AU - T.H. Jen
TI - POSITIONAL EFFECT OF ITEM BLOCKS IN INTERNATIONAL LARGE-SCALE ASSESSMENT CAUSED THE ITEM DIFFICULTY DIFFERENT BETWEEN TAIWAN AND THE USA
SN - 978-84-615-5563-5/2340-1079
PY - 2012
Y1 - 5-7 March, 2012
CI - Valencia, Spain
JO - 6th International Technology, Education and Development Conference
JA - INTED2012 Proceedings
SP - 924
EP - 927
ER -
K.M. Chen, T.H. Jen (2012) POSITIONAL EFFECT OF ITEM BLOCKS IN INTERNATIONAL LARGE-SCALE ASSESSMENT CAUSED THE ITEM DIFFICULTY DIFFERENT BETWEEN TAIWAN AND THE USA, INTED2012 Proceedings, pp. 924-927.
User:
Pass: