Evaluation seeks to systematically assess the level of adequacy, efficiency, effectiveness and appropriateness of initiatives. It is also important that evaluation identifies any unexpected problems or benefits of the various aspects of initiative implementation. In thorough evaluations, the processes, impacts and outcomes of the program or policy are assessed through the application of a set of explicit or implicit standards (itemised ‘indicators’ by which we measure successes). The benefit of good evaluation lies in its potential to contribute to the initiative improvement and contribute to the knowledge base.
NCETA is/has been engaged in the following Evaluation Projects:
- The development of a Work Practice Questionnaire and set of related resources
- Evaluation of Police Drug Diversion Training in South Australia
1. The development of a Work Practice Questionnaire and set of related resources.
In 2001 the National Centre for Education and Training on Addiction was commissioned by the Australian Government Department of Health and Ageing to undertake a project titled Evaluating the Impact of Alcohol and Other Drug Education and Training: Development of a Measurement Tool and Training Evaluation Guidelines.
Additional support for the Evaluation Project was provided by the South Australian Department of Health. This document is one of the key products stemming from that project.
The Evaluation Project involved the development of an evaluation tool called the Work Practice Questionnaire (WPQ), and a set of related resources. wide range of factors that influence work practices in relation to alcohol and other drugs.
The WPQ is a purpose-built measurement tool designed to assess a wide range of factors that influence work practices in relation to alcohol and other drugs.
Three key products were developed as part of the Evaluation Project. They are:
1. MonographA monograph examining factors influencing training transfer and work practice change in relation to alcohol and other drugs:From Training to Work Practice Change: An Examination of Factors Influencing Training Transfer in the Alcohol and Other Drugs Field.The monograph examines a wide range of factors that influence work practices in relation to alcohol and other drugs. It provides areview of evidence related to the influence of the factors assessed in the Work Practice Questionnaire on training transfer and work practice. Strategies to address each of the factors in order to facilitate training transfer and work practice change are also discussed. |
 |
2. GuidelinesGuidelines for evaluating AOD-related training: Guidelines for Evaluating Alcohol and Other Drugs Education and Training Programs.The guidelines provide user-friendly information for evaluating alcohol and other drug education and training programs. The guidelines have been designed to support both novice and experienced trainers to develop, implement and analyse their training evaluation. The document includes a discussion of the aims and context of various types of evaluation, useful tools, tips and readings. |
 |
3. HandbookA handbook for the Work Practice Questionnaire: Handbook for the Work Practice Questionnaire (WPQ): A Training Evaluation Measurement Tool or the Alcohol and Other Drugs Field.The handbook provides a detailed description of the WPQ and its psychometric properties. The WPQ is a purpose-built measurement tool designed to assess a wide range of factors that influence work practices in relation to alcohol and other drugs. It includes 17 scales covering four domains:
A post-training section includes two scales. The Handbook describes how the tool can be used, provides results of the reliability and validity studies undertaken, and includes a copy of the full questionnaire. |
 |
 |
2. Evaluation of Police Drug Diversion Training programs (Ongoing project)
NCETA is a collaborative partner on a project to deliver Worker Training Services for the SA Police Drug Diversion Initiative. This project was developed with Flinders Department of Nursing, Spencer TAFE, Flinders Consulting and Adelaide Central Mission. This Consortium won a competitive grant to undertake and evaluate the PDDI training being undertaken in South Australia.
NCETA’s role in this project is to undertake the evaluation of the impact of the training with a view to examining the components of the training that facilitate both institutional and professional change.
This project is funded by a SA DHS grant.
Deliverables
- Completion of the training of > 100 participants with a comprehensive evaluation of the training impact.
