Slide 1: Evaluation Plan for The Hazardous Substances Awareness Course
By Gordon Robinson
Slide 2: What Is It?
Computer based training module Developed in 2004 to comply with new requirements of the Hazardous Substances and New Organisms (HSNO) Act 1996 All NZ Defence Force personnel required to complete the training
Slide 3: Why Evaluate?
Important course for safety reasons No evaluation done over the three years the course has existed Need to know:
1. 2. 3.
Is course content suited to delivery by CBT? Is content current for 2008? Is course meeting the needs of the organisation?
Slide 4: E-learning Guidelines
TD1 – Is the use of e-learning the best way to achieve the learning outcomes? MT3 – How is review of the effectiveness of elearning conducted to assure alignment with the needs of the organisation?
Slide 5: Evaluation Theory
Maintenance Evaluation – to ensure the viability of an interactive product over time Eclectic-Mixed Methods-Pragmatic paradigm Multiple Methods model
Triangulation of data Cross tabulation of data
Slide 6: Methodology
Training Development staff to analyse suitability of content for e-learning
1. 2.
Paper-based questionnaire Expert review
Recent graduates to complete an electronic questionnaire Review of graduate’s assessment results HSNO Panel member to review content
Slide 7: Limitations
Small sample of learners Short timeframe - which limits:
1. 2. 3.
sample size Amount of data that can be analysed Number of issues that can be investigated
Pragmatic aspect becomes important Pilot evaluation only
Slide 8: Decisions
This evaluation will test the delivery mechanism and suitability of the content Negative trends will trigger a second, more in-depth, evaluation to determine the scope of any work that needs to be done Inaccurate content will result in immediate modifications
