About this paper

Appears in:
Pages: 10494-10507
Publication year: 2017
ISBN: 978-84-697-3777-4
ISSN: 2340-1117
doi: 10.21125/edulearn.2017.0991

Conference name: 9th International Conference on Education and New Learning Technologies
Dates: 3-5 July, 2017
Location: Barcelona, Spain

THE DEVELOPMENT OF KNOWLEDGE TESTS WHEN STUDYING ACADEMIC TEXTS IN HIGHER EDUCATION

E. De Bruyne, K. Aesaert, M. Valcke

Ghent University (BELGIUM)
In order to measure students’ learning performance, research on higher education mainly relies on the use of knowledge mastery tests. Although these tests are widely being used, the psychometric quality of these measurements has been given little attention. The aim of this study is to outline the development and validation of two knowledge mastery tests, serving as indicators for learning performance, through the use of item response theory. As studying academic texts is a major source for learning domain-specific content in higher education, both tests focus on knowledge mastery after studying an academic text on, respectively “problem solving theory” and “metacognition”. Both tests were administered to first-year university students (n=180 for problem solving; n=249 for metacognition) enrolled for a Bachelor programme in Educational Sciences. The items were controlled for dimensionality, model-data fit, local item dependence and monotonicity. The final measure consisted of 16 out of 30 items for the knowledge test about the problem solving text. For the knowledge test about metacognition, 21 out of 30 items remained relevant and informative. The final results indicate that both knowledge tests are reliable, in particular for low and median ability levels. This study highlights the importance of developing knowledge mastery tests that provide accurate and valid measures for learning from academic tests.
@InProceedings{DEBRUYNE2017DEV,
author = {De Bruyne, E. and Aesaert, K. and Valcke, M.},
title = {THE DEVELOPMENT OF KNOWLEDGE TESTS WHEN STUDYING ACADEMIC TEXTS IN HIGHER EDUCATION},
series = {9th International Conference on Education and New Learning Technologies},
booktitle = {EDULEARN17 Proceedings},
isbn = {978-84-697-3777-4},
issn = {2340-1117},
doi = {10.21125/edulearn.2017.0991},
url = {http://dx.doi.org/10.21125/edulearn.2017.0991},
publisher = {IATED},
location = {Barcelona, Spain},
month = {3-5 July, 2017},
year = {2017},
pages = {10494-10507}}
TY - CONF
AU - E. De Bruyne AU - K. Aesaert AU - M. Valcke
TI - THE DEVELOPMENT OF KNOWLEDGE TESTS WHEN STUDYING ACADEMIC TEXTS IN HIGHER EDUCATION
SN - 978-84-697-3777-4/2340-1117
DO - 10.21125/edulearn.2017.0991
PY - 2017
Y1 - 3-5 July, 2017
CI - Barcelona, Spain
JO - 9th International Conference on Education and New Learning Technologies
JA - EDULEARN17 Proceedings
SP - 10494
EP - 10507
ER -
E. De Bruyne, K. Aesaert, M. Valcke (2017) THE DEVELOPMENT OF KNOWLEDGE TESTS WHEN STUDYING ACADEMIC TEXTS IN HIGHER EDUCATION, EDULEARN17 Proceedings, pp. 10494-10507.
User:
Pass: