ASSESSMENT OF THE USE OF PRELIMINARY CONCEPTS TEST AND RUBRICS IN PRACTICAL LEARNING AT UNIVERSITY
Universitat Jaume I (SPAIN)
About this paper:
Conference name: 12th annual International Conference of Education, Research and Innovation
Dates: 11-13 November, 2019
Location: Seville, Spain
Abstract:
The high number of students and teachers in the laboratory practices of the course Theory of Machines and Mechanisms, shared by several engineering degrees at Universitat Jaume I, makes the teaching planning and evaluation challenging. Some issues were observed in past years, such as differences in the student knowledge of basic concepts, underpreparation before practical classes, poor quality of the written reports, absence of common objective assessment criteria and low success rate. That led us to the implementation of an action for educational improvement during the academic year 2018-2019. The aim was to improve the students' level of training before attending laboratory practices, to standardize the evaluation among teachers and to involve students in the process of assessment in order to improve learning outcomes and the quality of the reports delivered. The improvement action included, on one side, carrying out an initial evaluation with a preliminary concepts test, to estimate the basic knowledge of the students and proposing specific tutorials in order to equalize them. This method should increase the students involvement and improve the success while performing the laboratory practices. On the other side, common evaluation rubrics were created in order to standardize the correction criteria. These rubrics were also made public to the students, before the classes, in order to try to improve the quality of their reports. In addition, for some of the reports the students were asked to self-assess their own reports following the public rubric. The results indicate that teachers found the rubrics useful for objective and fair evaluation. However, the standard deviation across teachers has not been reduced with respect to the previous year by the use of them, although the differences in the student sample has to be taken into account. The effect on grades of the factors teacher and session, as well as their interaction, was significant (p<.05) according to the ANOVA tests, as already was prior to the application of the action. It was found that the student grades in the practical classes did not improved significantly. A low implication in the preparation before classes and a low tutorial attendance were observed in the collective of students, possible explaining in part the discrete improvements obtained. The self-assessment improved the grades on average where it was applied. We concluded that to promote learning quality using these techniques, the involvement of both students and teachers is necessary.Keywords:
Assessment, higher education, preliminary concepts, rubrics, self-assessment.