About this paper

Appears in:
Pages: 6416-6422
Publication year: 2010
ISBN: 978-84-614-2439-9
ISSN: 2340-1095

Conference name: 3rd International Conference of Education, Research and Innovation
Dates: 15-17 November, 2010
Location: Madrid, Spain

RATER BEHAVIOURS IN ASSESSING THE PRE-UNVIVERSITY STUDENTS’ GENERIC SKILLS

N.A. Najmuddin, S.R. Ariffin, J. Ahmad

National University of Malaysia (MALAYSIA)
Performance-based assessment is one of the methods used for measuring the generic skills of students. For this research, the performances of the pre-university students were assessed by the students’ own lecturers using a set of generic skills instrument. The lecturers gave ratings to the generic skills that were exhibited by the students during their activities in the classrooms. This study aims at examining the behaviours of the raters in the process of assessing the students’ generic skills. The instrument used consists of nine constructs of generic skills, namely teamwork, communication, leadership, critical thinking and problem solving, life-long learning and information management, entrepreneurship, ethical and professional morality, social responsibilities and management. This study used Many-Facet Rasch Measurement (MFRM) model and the data analysis was done using FACETS 3.66.1. There were 23 lecturers involved in assessing 271 pre-university students. The findings of the research show that the percentage of agreement amongst the raters is between 37.3% - 43.1% and the value of Rasch-Cohen Kappa is between 0.92 – 1.00. The raters act as trained assessors and work independently during the assessment process. The results of data analysis show that there exist differences in severity amongst the raters when assessing the generic skills of the students, and also inconsistencies among few raters in their ratings. The bias analysis shows that there is no specific pattern with regard to bias interaction between the raters and the items. However, the male raters show more bias interaction towards the items as compared to the female raters. The study on the behaviours of the raters is important because the findings can help the raters to carry out fair and appropriate assessment of the students’ generic skills.
@InProceedings{NAJMUDDIN2010RAT,
author = {Najmuddin, N.A. and Ariffin, S.R. and Ahmad, J.},
title = {RATER BEHAVIOURS IN ASSESSING THE PRE-UNVIVERSITY STUDENTS’ GENERIC SKILLS},
series = {3rd International Conference of Education, Research and Innovation},
booktitle = {ICERI2010 Proceedings},
isbn = {978-84-614-2439-9},
issn = {2340-1095},
publisher = {IATED},
location = {Madrid, Spain},
month = {15-17 November, 2010},
year = {2010},
pages = {6416-6422}}
TY - CONF
AU - N.A. Najmuddin AU - S.R. Ariffin AU - J. Ahmad
TI - RATER BEHAVIOURS IN ASSESSING THE PRE-UNVIVERSITY STUDENTS’ GENERIC SKILLS
SN - 978-84-614-2439-9/2340-1095
PY - 2010
Y1 - 15-17 November, 2010
CI - Madrid, Spain
JO - 3rd International Conference of Education, Research and Innovation
JA - ICERI2010 Proceedings
SP - 6416
EP - 6422
ER -
N.A. Najmuddin, S.R. Ariffin, J. Ahmad (2010) RATER BEHAVIOURS IN ASSESSING THE PRE-UNVIVERSITY STUDENTS’ GENERIC SKILLS, ICERI2010 Proceedings, pp. 6416-6422.
User:
Pass: