Abstract:

The advancement of information and communication technology has enabled fast connection and communication around the world. It is essential to create and develop human resources to enhance abilities, skills, expertise, mastery, especially information literacy (IL), media literacy (ML), and information and communication technology literacy (ICT Literacy: ICTL). These comprise some of the important skills for 21st century learning which help promote other skills, including life and career skills and learning and innovation skills. The purpose of this research is to develop an online Assessment Management System (AMS) for the measurement and assessment of IL, ML, and ICTL for higher education learners. This will integrate knowledge in developing the standard measurement and the creation of knowledge in educational technology and communication.

The research is divided into 3 phases:
(1) developing the conceptual framework, definition, and features of IL, ML, and ICTL for higher education learners;
(2) developing an online rubric system for the measurement and assessment of IL, ML, and ICTL for higher education learners; and
(3) testing the quality of online measurement of IL, ML, and ICTL for higher education learners.

The statistical tools used to develop the measurement to validate questions according to the conceptual framework, definition, and features of IL, ML, and ICTL are Exploratory Factor Analysis (EFA) and Confirmation Factor Analysis (CFA). The sample group consists of 2,530 higher education students. The research found that the features of quality measurement consisted of measurement that can assess students in three dimensions: IL (consisting of 5 sub-areas), ML (consisting of 4 sub-areas), and ICTL (6 sub-domains). Each dimension consists of 2 types of tools: knowledge of self-measurement to access student knowledge and attitudes, and rubric evaluation to assess the characteristics of learners in each competency. The measurement was developed to be the AMS. The specific features of the system include the development by using PHP and MySQL database and the design to interact with users with responsive UI framework. The system is compatible with MOOCs Open edX platform or can be used as stand-alone application. It can create, share, copy, and extend both Likert scales and rubric evaluation forms. The results of this research will provide guidance for educational institutions in implementing online evaluation to assess IL, ML, and ICTL. This will lead to comprehensive online teaching and learning management which will drive higher education institutions to manage online learning, ubiquitous learning, e-learning and MOOCs effectively.

Keywords:

Assessment Management System, e-Assessment, 21st Century skills.