DIGITALTHE EVALUATION FRAMEWORK FOR IMPACT ASSESSMENT
University of Duisburg-Essen (GERMANY)
About this paper:
Appears in: ICERI2013 Proceedings
Publication year: 2013
Pages: 4654-4663
ISBN: 978-84-616-3847-5
ISSN: 2340-1095
Publication year: 2013
Pages: 4654-4663
ISBN: 978-84-616-3847-5
ISSN: 2340-1095
Conference name: 6th International Conference of Education, Research and Innovation
Dates: 18-20 November, 2013
Location: Seville, Spain
Dates: 18-20 November, 2013
Location: Seville, Spain
Abstract:
Research projects usually face the necessity that they have to provide evidence of their success in the sense that the resources invested have been used efficiently. Hereby, one of the dangers is to apply a kind of “patchwork” evaluation with – in the best of cases – loosely connected measures, which can be overcome comprehensive evaluations frameworks.Every evaluation framework should be based on a reference model or theory of its respective scientific domain. The key concepts of the domain provide the terminological basis and indicate general processes and dependencies of the domain in which the evaluation takes place. The theoretical background influences this way the objects and judgments of evaluation frameworks.
The Evaluation Framework for the Measurement of Impacts (EFI) is combining the measurement of two dimensions:
1. Impact of Outcomes and
2. Impact of Pilot Implementations.
The impact of outcomes will be measured continuously by usage indicators in the philosophy of Total Quality Management (TQM). Within one given project or process, the usage indicators will be related to the strategic objectives of the project or process. The measurement of the usage indicators has to focus the two dimensions of the given project or process: (1) the activities (within the whole project or process) and (2) the (developed and improved) outcomes.
The impact of the pilot implementations will be measured by outcome indicators for the pilot trials. Within one given project or process the outcome indicators will be related to the planned products of the project or process. The measurement of the outcome indicators has to focus the two dimensions of the pilot trials: (1) the activities/process (within the pilot implementation) and (2) the (implemented and tested) outcomes.
In this sense, the impact of outcomes allows to draw conclusions on the usage impact, meanwhile the impact of pilot implementations refers to product validation.
The presentation will focus on details of the Evaluation Framework for the Measurement of Impacts in order to allow its application in various contexts.