About this paper

Appears in:
Page: 1214 (abstract only)
Publication year: 2016
ISBN: 978-84-608-5617-7
ISSN: 2340-1079
doi: 10.21125/inted.2016.1265

Conference name: 10th International Technology, Education and Development Conference
Dates: 7-9 March, 2016
Location: Valencia, Spain

DEVELOPING A HIGH-STAKE DIGITAL SPOKEN LANGUAGE PROFICIENCY ASSESSMENT: RESULTS FROM PILOT TESTS

H. Kallio1, R. Hildén1, M. Kurimo2, M. Vainio1, R. Karhila2, E. Lindroos1

1University of Helsinki (FINLAND)
2Aalto University (FINLAND)
The DigiTala project aims at developing a prototype of a technology-assisted high-stake spoken language proficiency assessment using multidisciplinary expertise from language education, signal processing and phonetics. The prototype will use automatic speech recognition (ASR) tool specially developed for educational second language (L2) use. The first target application in Finland will be the new digital matriculation examination, where language tests are recorded and digitized for assessments. The objectives are to enhance the reliability and practicality of oral language testing in a high-stakes context by clarifying the phonetic realizations of assessment criteria and developing methods that enable the utilization of ASR in the assessment process. A database of all recordings and assessments will provide a unique research opportunity for scrutinizing oral proficiency.

The study integrates modern technologies and principles of agile development with a traditional examination system to develop a stakeholder-friendly assessment. Students and their teachers from five secondary schools in Finland have participated in the study. A group of ten experts on the target language will assess the fluency and pronunciation of speech samples from more than 200 students. The assessment criteria is based on the Common European Framework of Reference. Automatic assessments will be applied when the ASR tool is trained for L2 purposes.

This article will present the assessment application developed through the one-year project and the results from questionnaires collected from secondary school students and teachers who participated in pilot tests. The article will also report findings on the reliabilities on teacher and automatic assessments. The results will provide important information about the benefits as well as obstacles and challenges of a digitized assessment system.
@InProceedings{KALLIO2016DEV,
author = {Kallio, H. and Hild{\'{e}}n, R. and Kurimo, M. and Vainio, M. and Karhila, R. and Lindroos, E.},
title = {DEVELOPING A HIGH-STAKE DIGITAL SPOKEN LANGUAGE PROFICIENCY ASSESSMENT: RESULTS FROM PILOT TESTS},
series = {10th International Technology, Education and Development Conference},
booktitle = {INTED2016 Proceedings},
isbn = {978-84-608-5617-7},
issn = {2340-1079},
doi = {10.21125/inted.2016.1265},
url = {http://dx.doi.org/10.21125/inted.2016.1265},
publisher = {IATED},
location = {Valencia, Spain},
month = {7-9 March, 2016},
year = {2016},
pages = {1214}}
TY - CONF
AU - H. Kallio AU - R. Hildén AU - M. Kurimo AU - M. Vainio AU - R. Karhila AU - E. Lindroos
TI - DEVELOPING A HIGH-STAKE DIGITAL SPOKEN LANGUAGE PROFICIENCY ASSESSMENT: RESULTS FROM PILOT TESTS
SN - 978-84-608-5617-7/2340-1079
DO - 10.21125/inted.2016.1265
PY - 2016
Y1 - 7-9 March, 2016
CI - Valencia, Spain
JO - 10th International Technology, Education and Development Conference
JA - INTED2016 Proceedings
SP - 1214
EP - 1214
ER -
H. Kallio, R. Hildén, M. Kurimo, M. Vainio, R. Karhila, E. Lindroos (2016) DEVELOPING A HIGH-STAKE DIGITAL SPOKEN LANGUAGE PROFICIENCY ASSESSMENT: RESULTS FROM PILOT TESTS, INTED2016 Proceedings, p. 1214.
User:
Pass: