About this paper

Appears in:
Pages: 6846-6851
Publication year: 2016
ISBN: 978-84-608-5617-7
ISSN: 2340-1079
doi: 10.21125/inted.2016.0616

Conference name: 10th International Technology, Education and Development Conference
Dates: 7-9 March, 2016
Location: Valencia, Spain

THE IMPACT ON THE QUALITY AND SATISFACTION OF THE TESTS OF AN UNCUED QUESTION FORMAT VERSUS A SHORT ANSWER QUESTION FORMAT

B. Fevereiro1, F.R. Gonçalves1, B. Torres-Guimarães1, D.F. Tomaz1, A.C. Vasconcelos-Oliveira1, J.C. Machado2, M. Severo1

1Universidade do Porto, Faculdade de Medicina (PORTUGAL)
2University of Porto, Institute of Molecular Pathology and Immunology (PORTUGAL)
Objectives:
The objectives of this study were to assess the reliability of an uncued question format (UCQ-format), when compared to a short answer question (SAQ-format) in the course of Biopathology at the Faculty of Medicine of Porto University and compare the satisfaction of students after the introduction of a glossary based on an uncued question format.

Methods:
Two hundred and eighteen students (218) were tested using SAQ-format and 283 students were assessed using UCQ-format. We resorted to both the Classical Test Theory and the Item Response Theory to compare both types of questions.
To assess the level of satisfaction with the new glossary, we analyzed the answers of 227 students that fulfilled a questionnaire that evaluates 4 dimensions (Satisfaction with new glossary (G1); Satisfaction with new answer sheet (G2); Preference between the previous and new glossary (G3); Classification on the previous course Biopathology (G4)). The Spearman's Correlation Test was applied between dimensions.

Results:
Trough the Classical Test Theory, we determined that the differences between the Difficulty Index on the first test (0.674 +/- 0.291) and on the second test (0.638 +/- 0.303) were not significant (p=0.367). In addition, the differences found on the Discrimination Index of the first and second test (0.264+/-0.152 and 0,260+/-0.152, respectively) were not statistically different (p=0.832).
Using the Item Response Theory, the Discrimination Index (SAQ: 0.685 +/- 0.163 and UCQ: 0.639 +/- 0.303) and the Difficulty Index (SAQ: 0.698 +/- 0.312 and UCQ: 0.655 +/- 0.325 after) were not statistically different between both tests (p=0.3185 and p=0.06985, respectively).
Results indicate that both approaches were reliable, with Cronbach's Alpha of 0.9298 on the SAQ-format and 0.9760 on the UCQ-format.
The students analyzed slightly disagreed with the change in the model of evaluation (XGIII=3.84).
The analysis of the satisfaction questionnaires showed that students who preferred the UCQ-format also preferred the new answer sheet. In general, students were not satisfied with the answer sheet. Similarly, students who were not satisfied with the UCQ-format preferred the previous model of evaluation (ρGI/GIII=-0.664 and ρGII/GIII=-0.542). We found no correlation between the student's classification and their preference with the new model of evaluation (p=0.428)

Conclusions:
There is no effect on the changed of format in the quality of test, however the students were not very satisfied with the new format and this fact was un correlated with the student's classification. Even though this format did not decrease the quality parameters and was more efficient tool in terms of time and resources saved by the correctors and faculty in general.
@InProceedings{FEVEREIRO2016IMP,
author = {Fevereiro, B. and Gonçalves, F.R. and Torres-Guimar{\~{a}}es, B. and Tomaz, D.F. and Vasconcelos-Oliveira, A.C. and Machado, J.C. and Severo, M.},
title = {THE IMPACT ON THE QUALITY AND SATISFACTION OF THE TESTS OF AN UNCUED QUESTION FORMAT VERSUS A SHORT ANSWER QUESTION FORMAT},
series = {10th International Technology, Education and Development Conference},
booktitle = {INTED2016 Proceedings},
isbn = {978-84-608-5617-7},
issn = {2340-1079},
doi = {10.21125/inted.2016.0616},
url = {http://dx.doi.org/10.21125/inted.2016.0616},
publisher = {IATED},
location = {Valencia, Spain},
month = {7-9 March, 2016},
year = {2016},
pages = {6846-6851}}
TY - CONF
AU - B. Fevereiro AU - F.R. Gonçalves AU - B. Torres-Guimarães AU - D.F. Tomaz AU - A.C. Vasconcelos-Oliveira AU - J.C. Machado AU - M. Severo
TI - THE IMPACT ON THE QUALITY AND SATISFACTION OF THE TESTS OF AN UNCUED QUESTION FORMAT VERSUS A SHORT ANSWER QUESTION FORMAT
SN - 978-84-608-5617-7/2340-1079
DO - 10.21125/inted.2016.0616
PY - 2016
Y1 - 7-9 March, 2016
CI - Valencia, Spain
JO - 10th International Technology, Education and Development Conference
JA - INTED2016 Proceedings
SP - 6846
EP - 6851
ER -
B. Fevereiro, F.R. Gonçalves, B. Torres-Guimarães, D.F. Tomaz, A.C. Vasconcelos-Oliveira, J.C. Machado, M. Severo (2016) THE IMPACT ON THE QUALITY AND SATISFACTION OF THE TESTS OF AN UNCUED QUESTION FORMAT VERSUS A SHORT ANSWER QUESTION FORMAT, INTED2016 Proceedings, pp. 6846-6851.
User:
Pass: