DIGITAL LIBRARY
AN EXPERT FACULTY EXAMINER SURVEY ON THE USEFULNESS AND BENEFITS OF AN IN-HOUSE DEVELOPED OSCE AUDIO-VISUAL MONITORING SYSTEM FOR THE TRAINING AND ASSESSMENT OF CLINICAL COMPETENCE
1 University of Medicine and Pharmacy at Ho Chi Minh City (VIETNAM)
2 Center TTUHSC El Paso (UNITED STATES)
About this paper:
Appears in: INTED2021 Proceedings
Publication year: 2021
Pages: 6309-6314
ISBN: 978-84-09-27666-0
ISSN: 2340-1079
doi: 10.21125/inted.2021.1264
Conference name: 15th International Technology, Education and Development Conference
Dates: 8-9 March, 2021
Location: Online Conference
Abstract:
Introduction:
The Center for Advanced Training in Clinical Simulation (ATCS) at University of Medicine and Pharmacy at Ho Chi Minh City, Vietnam (UMP-HCMC), was established in 2017 to support the implementation of its competency-based medical training program. In view of multiple obstacles to acquire a commercially available audio-visual monitoring system, the technology division (TD) of ATCS has developed an in-house and low-cost but fully functional audio-visual (A-V) system to support all training and assessment activities.

Objective:
This study is conducted to evaluate the usefulness, functionality and benefits of an in-house and low-cost A-V system to support all training and assessment activities of a medium-size clinical simulation center including facilities for 14 OSCE stations, faculty observation, orientation, and debriefing.

Method:
The TD of ATCS was tasked to test and acquire commercially available A-V equipment, and to develop a software package that possess essential functions for managing, scheduling the training activities, and assessing the learners’ performance. We conducted a survey collecting and analyzing feedback of 44 faculty examiners (FE) who were familiar and had used the system for at least six months. We sent a questionnaire consisted of 12 questions to be rated according to 4-points Likert scale of the following areas: 1) User-friendliness; 2) Quality of the A-V system; 3) Benefit for users in Training/Assessment activities.

Results:
All 44 surveyed FE returned their questionnaires. The majority of FE recognized the strength of the A-V system in allowing them to observe deficiencies of learners (86%), to provide feedback, and/or replay in debriefing (91%). They also rated highly regarding the system technical quality: video (98%), and audio (82%). In addition, FE also recommended: 1) add more cameras to cover larger area of the OSCE room; 2) provide private and secure access for learners to review their training sessions.

Discussion:
There are several state-of-the-art and commercially available A-V system for managing all activities of the simulation center. However, these systems are expensive and require the use of proprietary hardware and high annual maintenance fee. For a medium size simulation center, the expense for the installation of such a system can easily cost over one US million dollars which is a major limiting factor for most simulation centers in the developing countries.

Conclusion:
Our study demonstrates the possibility of using off-the-shelf A-V equipment together with an in-house developing software package to fulfill most essential functions for the training and assessment activities of a medium-size clinical simulation center. To enhance the quality and maximize the benefits of the system, we must collect and analyze feedback of all users.
Keywords:
UMP, Debrief, Observation, Audio-visual equipment.