DIGITAL LIBRARY
MODIFICATION OF THE BASE OF TEST EXAM QUESTIONS FROM THE "GYNAECOLOGY AND OBSTETRICS” COURSE FOR EMERGENCY MEDICINE STUDENTS AS A FORM OF IMPROVEMENT OF AN E-EXAM
1 Division of Teaching and Outcomes of Education, Faculty of Health Sciences, Medical University of Warsaw (POLAND)
2 Medical University of Warsaw (POLAND)
3 Examination Centre of the Faculty of Medicine, Medical University of Lodz, POLAND (POLAND)
4 1st Department of Obstetrics and Gynaecology, First Faculty of Medicine, Medical University of Warsaw (POLAND)
5 Division of Emergency Medicine, Faculty of Health Sciences, Medical University of Warsaw (POLAND)
6 University Examinations Office, Medical University of Warsaw (POLAND)
About this paper:
Appears in: EDULEARN15 Proceedings
Publication year: 2015
Pages: 188-197
ISBN: 978-84-606-8243-1
ISSN: 2340-1117
Conference name: 7th International Conference on Education and New Learning Technologies
Dates: 6-8 July, 2015
Location: Barcelona, Spain
Abstract:
Background:
Beginning in the academic year 2014/2015, it is possible to get a credit and pass a test exam at Warsaw Medical University using the ASK Systems e-exam platform. An e-exam will be handled properly only if the base of test questions is prepared earlier and it includes a proper number of questions of appropriate easiness and differentiation power.
In the summer session of the academic year 2014/2015, the "Gynaecology and Obstetrics” course for the third year Bachelor’s students of Emergency Medicine at the Faculty of Health Sciences, Medical University of Warsaw, is one of the courses that is supposed to end with an e-exam.

Aim of study:
The aim of the study was to assess the quality of test questions referring to emergency medicine prepared in order to improve the test exam for the "Gynaecology and Obstetrics” course for the third year Bachelor students of Emergency Medicine at the Medical University of Warsaw.

Material and Methods:
35 test questions, close-ended questions, 4 answer options, only one correct answer. A detailed analysis of the test questions used in the following years: 2009/2010, 2010/2011, 2012/2013. A comparison of easiness and differentiation power of particular questions and answer options. Descriptive statistics.

Results:
An analysis of the quality of test questions measured with two coefficients: differentiation power and easiness of questions demonstrated that 14 out of 35 questions needed modification due to the fact that they were too easy: over 90% of the students had chosen the correct answer in the case of 7 questions and over 80% of the students had chosen the correct answer in the case of the 7 remaining questions (between 80 and 89% of the total). 19 questions had at least one answer option that had not been chosen by any of the students.

Conclusions:
1. The change in test questions based on the data referring to the functioning of test questions in the previous editions of paper-and-pen test exams might prove to be effective and efficient for improving the base of questions that is essential to carry out e-exams.
2. For further improvement of test questions, the functioning of the modified test questions needs to be analysed in detail right after the e-exam is complete.
Keywords:
E-assesssment, paper-and-pen test, quality of education, health sciences students, educational measurement.