DEVELOPMENT AND USE OF A SET OF QUESTIONS FOR THE ON-LINE EVALUATION OF PHYSICS IN ENGINEERING DEGREES. RESULTS FROM THE EXPERIENCE AND STATISTICAL VALIDATION

This paper presents an example of using sets of on-line questions, which may be automatically corrected, for the evaluation of physics subject in engineering degrees. The exams are made from random questions from wide sets of questions classified by topics and difficulties. Tests have been performed at different stages and for different purposes: diagnosis, training and evaluation. The uses of on-line tests and traditional problem solving exams have been combined. This methodology has been applied in first-year physics subjects of four undergraduate degrees at the Universitat Politècnica de València, involving more than 500 students. In order to validate the use of this tool, we have compared the results of students in these tests with those obtained in traditional tests. Some surveys have been conducted as well, in which the students give the opinion about this tool and this kind of evaluation. Students highlight their usefulness in the diagnosis and self-assessment, although some expressed some concern about the on-line objective evaluation and prefer to be evaluated by traditional method. Statistical analysis of these data are made in order to help extracting results and conclusions about the tool that, in our opinion, is very good for learning enhancement and to complement the evaluation.