About this paper

Appears in:
Pages: 5401-5406
Publication year: 2012
ISBN: 978-84-616-0763-1
ISSN: 2340-1095

Conference name: 5th International Conference of Education, Research and Innovation
Dates: 19-21 November, 2012
Location: Madrid, Spain

PSYCHOMETRIC PROPERTIES OF MULTIPLE-CHOICE ITEMS IN ON-LINE ASSESSMENTS

G. Montalvo, D. Marín

University of Alcalá (SPAIN)
The same database of multiple-choice questions was applied to subjects of different university degrees (chemistry and pharmacy) containing the module "Thermodynamics" in their syllabus. These questions were used to perform several on-line assessments.

The targets established were: i) checking the correct formulation and understandability of each question (item); ii) verifying the quality of each test; iii) comparing the quality of the same question when applied to various groups of students from two different degree courses; and, finally, iv) taking corrective action, including reformulating the questions or redesigning the test as a whole, when required.

Subsequent statistical evaluation of the empirical evidence collected showed that all items met the desired psychometric requirements. This analysis of the quality of the test was performed in terms of discrimination (D), difficulty (p) and the relationship between them.

Psychometric analysis has been shown to be able to detect errors in the formulation of items, thereby potentially improving the test as a whole. The fact that difficulty is more significant than discrimination when it comes to detecting errors in the items is probably due to the fact that the statistical techniques used are not valid when applied to small groups of students. However, the relationship between p and D is related to the need for an improvement action for an item. As a result, we propose basic guidelines that should be taken into account when reformulating such items.
@InProceedings{MONTALVO2012PSY,
author = {Montalvo, G. and Mar{\'{i}}n, D.},
title = {PSYCHOMETRIC PROPERTIES OF MULTIPLE-CHOICE ITEMS IN ON-LINE ASSESSMENTS},
series = {5th International Conference of Education, Research and Innovation},
booktitle = {ICERI2012 Proceedings},
isbn = {978-84-616-0763-1},
issn = {2340-1095},
publisher = {IATED},
location = {Madrid, Spain},
month = {19-21 November, 2012},
year = {2012},
pages = {5401-5406}}
TY - CONF
AU - G. Montalvo AU - D. Marín
TI - PSYCHOMETRIC PROPERTIES OF MULTIPLE-CHOICE ITEMS IN ON-LINE ASSESSMENTS
SN - 978-84-616-0763-1/2340-1095
PY - 2012
Y1 - 19-21 November, 2012
CI - Madrid, Spain
JO - 5th International Conference of Education, Research and Innovation
JA - ICERI2012 Proceedings
SP - 5401
EP - 5406
ER -
G. Montalvo, D. Marín (2012) PSYCHOMETRIC PROPERTIES OF MULTIPLE-CHOICE ITEMS IN ON-LINE ASSESSMENTS, ICERI2012 Proceedings, pp. 5401-5406.
User:
Pass: