About this paper

Appears in:
Pages: 784-788
Publication year: 2012
ISBN: 978-84-616-0763-1
ISSN: 2340-1095

Conference name: 5th International Conference of Education, Research and Innovation
Dates: 19-21 November, 2012
Location: Madrid, Spain

DESIGNING QUESTIONS FOR ON-LINE EVALUATION OF PHYSICS IN ENGINEERING DEGREES IN A GRADED MULTILINGUAL FORMAT

The crucial point of preparing an online test is to develop good questions. This requires first of all the understanding of the objectives of assessment paying special attention to the design of the questions. A test is reliable when it really measures what the evaluator wants to notice [1].
Nowadays, multiple choice tests are very common and replace constructed response tests. Literature reveals that there is no consensus whether both test formats are equally suitable for measuring ability or knowledge [2, 3]. In our work we present a strategy to approximate both test formats taking advantage of each one. By using graded numerical questions we are able of rewarding partially correct answers, avoiding all-or-nothing scoring rule, or guessing strategies.

The key points of the questions can be summarized as follows:
- Numerical response. Among the possibilities of different test formats, we have chosen the numerical one because it is the most suitable to evaluate physical concepts.
- Gradually required results. In order to avoid the frustrating all-or-nothing, we have prepared questions that measure not only the final result, but the process to obtain it, evaluating the approach and intermedial responses.
- Multilingual format (Valencian, Spanish and English). The three languages are commonly used at our university courses and therefore, they should be taken into account in the assessment design.
- Structured text. We have structured the question tests into three parts: wording, data and results. Thereby we avoid possible developer mistakes when repeating data or conditions in different languages.
- Replicability. Values of the data are randomly generated in a spreadsheet. Thus, the questions are easily replicated producing similar questions to a great number of students.

Hence, educators can take advantage of low grading costs, consistent grading, and no scoring biases, while students benefit from timely feedback as well as greater coverage of the syllabus and fair grading [4].

References:
[1] Gikandi JW, Morrow D, Davis NE. Online formative assessment in higher education: A review of the literature. Comput Educ. 2011;57:2333-2351
[2] Kastner M, Stangl B. Multiple Choice and Constructed Response Tests: Do Test Format and Scoring Matter? International Conference on Education and Educational Psychology 2010. 2011;12:263-273
[3] Siri A, Freddano M. The use of item analysis for the improvement of objective examinations. 2nd International Conference on Education and Educational Psychology 2011. 2011;29
[4] Hollister K K, Berenson M L. Proctored versus unproctored online exams: studying the impact of exam environment on student performance. Decision Sciences Journal of Innovative Education 2009;7(1):271-294
@InProceedings{VIDAURRE2012DES,
author = {Vidaurre, A. and Ardid, M. and Gim{\'{e}}nez, M.H. and G{\'{o}}mez-Tejedor, J.A. and Manj{\'{o}}n, F.J. and Meseguer, J.M. and Monsoriu, J.A. and Riera, J.},
title = {DESIGNING QUESTIONS FOR ON-LINE EVALUATION OF PHYSICS IN ENGINEERING DEGREES IN A GRADED MULTILINGUAL FORMAT},
series = {5th International Conference of Education, Research and Innovation},
booktitle = {ICERI2012 Proceedings},
isbn = {978-84-616-0763-1},
issn = {2340-1095},
publisher = {IATED},
location = {Madrid, Spain},
month = {19-21 November, 2012},
year = {2012},
pages = {784-788}}
TY - CONF
AU - A. Vidaurre AU - M. Ardid AU - M.H. Giménez AU - J.A. Gómez-Tejedor AU - F.J. Manjón AU - J.M. Meseguer AU - J.A. Monsoriu AU - J. Riera
TI - DESIGNING QUESTIONS FOR ON-LINE EVALUATION OF PHYSICS IN ENGINEERING DEGREES IN A GRADED MULTILINGUAL FORMAT
SN - 978-84-616-0763-1/2340-1095
PY - 2012
Y1 - 19-21 November, 2012
CI - Madrid, Spain
JO - 5th International Conference of Education, Research and Innovation
JA - ICERI2012 Proceedings
SP - 784
EP - 788
ER -
A. Vidaurre, M. Ardid, M.H. Giménez, J.A. Gómez-Tejedor, F.J. Manjón, J.M. Meseguer, J.A. Monsoriu, J. Riera (2012) DESIGNING QUESTIONS FOR ON-LINE EVALUATION OF PHYSICS IN ENGINEERING DEGREES IN A GRADED MULTILINGUAL FORMAT, ICERI2012 Proceedings, pp. 784-788.
User:
Pass: