Developing a standardised evaluation methodology for computer based learning materials

Aruna Palipana, Phil Barker, Steve Rothberg, Fiona Lamb

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The UK-based EASEIT-Eng project (http://www.easeit-eng.ac.uk/) aims to encourage or enhance the usage of existing engineering computer-based learning materials by enabling an academic tutor to make an informed choice from a range of evaluated software. This is being achieved through: (1) establishing standardised evaluation criteria and hence an evaluation methodology, (2) conducting evaluations, focusing primarily on producing case studies of actual implementations of software and (3) providing web access to these evaluations through a dedicated, fully searchable database. The evaluation methodology described in this paper was developed with the intention that the resource demanded by an evaluation would be: (1) manageable from the perspective of the evaluator, (2) acceptable from the perspective of the academic tutor delivering the software and (3) sustainable in the sense that further evaluations could be conducted with minimal funding beyond the life of the project. The development of this unique methodology also drew on established good practice and procedures, including particularly the ANSI Dental Informatics Guidelines [1] and the NEEDS database [2]. The resulting Evaluation Manual, which has been in use since September 2000, offers full guidance on the principles behind the approach to evaluation, details on how to conduct each part of the evaluation and access to the evaluation tools. The Manual should enable new evaluators to train themselves to conduct evaluations and use the tools developed. To date, EASEIT-Eng has 42 case studies and 39 reviews covering 53 different software implementations (over 40 different products) in all the major Engineering subject areas, either completed or in progress. Academics from over 20 different UK universities have participated in the project.

Original languageEnglish
Title of host publicationProceedings of the 2002 American Society for Engineering Education Annual Conference and Exposition
Pages10599-10607
Number of pages9
Publication statusPublished - 2002
Event2002 ASEE Annual Conference and Exposition: Vive L'ingenieur - Montreal, Que., Canada
Duration: 16 Jun 200219 Jun 2002

Conference

Conference2002 ASEE Annual Conference and Exposition: Vive L'ingenieur
CountryCanada
CityMontreal, Que.
Period16/06/0219/06/02

Fingerprint

methodology
evaluation
learning
tutor
engineering
best practice
funding
software
university
resources

Cite this

Palipana, A., Barker, P., Rothberg, S., & Lamb, F. (2002). Developing a standardised evaluation methodology for computer based learning materials. In Proceedings of the 2002 American Society for Engineering Education Annual Conference and Exposition (pp. 10599-10607)
Palipana, Aruna ; Barker, Phil ; Rothberg, Steve ; Lamb, Fiona. / Developing a standardised evaluation methodology for computer based learning materials. Proceedings of the 2002 American Society for Engineering Education Annual Conference and Exposition. 2002. pp. 10599-10607
@inproceedings{62a92da0984f4ac2bdf6d1d0abedbca0,
title = "Developing a standardised evaluation methodology for computer based learning materials",
abstract = "The UK-based EASEIT-Eng project (http://www.easeit-eng.ac.uk/) aims to encourage or enhance the usage of existing engineering computer-based learning materials by enabling an academic tutor to make an informed choice from a range of evaluated software. This is being achieved through: (1) establishing standardised evaluation criteria and hence an evaluation methodology, (2) conducting evaluations, focusing primarily on producing case studies of actual implementations of software and (3) providing web access to these evaluations through a dedicated, fully searchable database. The evaluation methodology described in this paper was developed with the intention that the resource demanded by an evaluation would be: (1) manageable from the perspective of the evaluator, (2) acceptable from the perspective of the academic tutor delivering the software and (3) sustainable in the sense that further evaluations could be conducted with minimal funding beyond the life of the project. The development of this unique methodology also drew on established good practice and procedures, including particularly the ANSI Dental Informatics Guidelines [1] and the NEEDS database [2]. The resulting Evaluation Manual, which has been in use since September 2000, offers full guidance on the principles behind the approach to evaluation, details on how to conduct each part of the evaluation and access to the evaluation tools. The Manual should enable new evaluators to train themselves to conduct evaluations and use the tools developed. To date, EASEIT-Eng has 42 case studies and 39 reviews covering 53 different software implementations (over 40 different products) in all the major Engineering subject areas, either completed or in progress. Academics from over 20 different UK universities have participated in the project.",
author = "Aruna Palipana and Phil Barker and Steve Rothberg and Fiona Lamb",
year = "2002",
language = "English",
pages = "10599--10607",
booktitle = "Proceedings of the 2002 American Society for Engineering Education Annual Conference and Exposition",

}

Palipana, A, Barker, P, Rothberg, S & Lamb, F 2002, Developing a standardised evaluation methodology for computer based learning materials. in Proceedings of the 2002 American Society for Engineering Education Annual Conference and Exposition. pp. 10599-10607, 2002 ASEE Annual Conference and Exposition: Vive L'ingenieur, Montreal, Que., Canada, 16/06/02.

Developing a standardised evaluation methodology for computer based learning materials. / Palipana, Aruna; Barker, Phil; Rothberg, Steve; Lamb, Fiona.

Proceedings of the 2002 American Society for Engineering Education Annual Conference and Exposition. 2002. p. 10599-10607.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Developing a standardised evaluation methodology for computer based learning materials

AU - Palipana, Aruna

AU - Barker, Phil

AU - Rothberg, Steve

AU - Lamb, Fiona

PY - 2002

Y1 - 2002

N2 - The UK-based EASEIT-Eng project (http://www.easeit-eng.ac.uk/) aims to encourage or enhance the usage of existing engineering computer-based learning materials by enabling an academic tutor to make an informed choice from a range of evaluated software. This is being achieved through: (1) establishing standardised evaluation criteria and hence an evaluation methodology, (2) conducting evaluations, focusing primarily on producing case studies of actual implementations of software and (3) providing web access to these evaluations through a dedicated, fully searchable database. The evaluation methodology described in this paper was developed with the intention that the resource demanded by an evaluation would be: (1) manageable from the perspective of the evaluator, (2) acceptable from the perspective of the academic tutor delivering the software and (3) sustainable in the sense that further evaluations could be conducted with minimal funding beyond the life of the project. The development of this unique methodology also drew on established good practice and procedures, including particularly the ANSI Dental Informatics Guidelines [1] and the NEEDS database [2]. The resulting Evaluation Manual, which has been in use since September 2000, offers full guidance on the principles behind the approach to evaluation, details on how to conduct each part of the evaluation and access to the evaluation tools. The Manual should enable new evaluators to train themselves to conduct evaluations and use the tools developed. To date, EASEIT-Eng has 42 case studies and 39 reviews covering 53 different software implementations (over 40 different products) in all the major Engineering subject areas, either completed or in progress. Academics from over 20 different UK universities have participated in the project.

AB - The UK-based EASEIT-Eng project (http://www.easeit-eng.ac.uk/) aims to encourage or enhance the usage of existing engineering computer-based learning materials by enabling an academic tutor to make an informed choice from a range of evaluated software. This is being achieved through: (1) establishing standardised evaluation criteria and hence an evaluation methodology, (2) conducting evaluations, focusing primarily on producing case studies of actual implementations of software and (3) providing web access to these evaluations through a dedicated, fully searchable database. The evaluation methodology described in this paper was developed with the intention that the resource demanded by an evaluation would be: (1) manageable from the perspective of the evaluator, (2) acceptable from the perspective of the academic tutor delivering the software and (3) sustainable in the sense that further evaluations could be conducted with minimal funding beyond the life of the project. The development of this unique methodology also drew on established good practice and procedures, including particularly the ANSI Dental Informatics Guidelines [1] and the NEEDS database [2]. The resulting Evaluation Manual, which has been in use since September 2000, offers full guidance on the principles behind the approach to evaluation, details on how to conduct each part of the evaluation and access to the evaluation tools. The Manual should enable new evaluators to train themselves to conduct evaluations and use the tools developed. To date, EASEIT-Eng has 42 case studies and 39 reviews covering 53 different software implementations (over 40 different products) in all the major Engineering subject areas, either completed or in progress. Academics from over 20 different UK universities have participated in the project.

M3 - Conference contribution

SP - 10599

EP - 10607

BT - Proceedings of the 2002 American Society for Engineering Education Annual Conference and Exposition

ER -

Palipana A, Barker P, Rothberg S, Lamb F. Developing a standardised evaluation methodology for computer based learning materials. In Proceedings of the 2002 American Society for Engineering Education Annual Conference and Exposition. 2002. p. 10599-10607