AIRR - ANZCA Institutional Research Repository
Skip navigation
Please use this identifier to cite or link to this item: http://hdl.handle.net/11055/209
Title: Psychometric evaluation of a direct observation of procedural skills assessment tool for ultrasound-guided regional anaesthesia.
Authors: Watson, M J
Wong, DM
Kluger, R
Chuan, A
Herrick, M D
Ng, I
Catanelli, DJ
Lin, L
Lansdown, AK
Barrington, MJ
ANZCA/FPM Author: Wong, DM
Kluger, R
Chuan, A
Ng, I
Castanelli, DJ
Lin, L
Lansdown, AK
Barrington, MJ
Issue Date: Jun-2014
Citation: Anaesthesia 2014-06; 69(6): 604-12
Abstract: Assessment tools must be investigated for reliability, validity and feasibility before being implemented. In 2013, the Australian and New Zealand College of Anaesthetists introduced workplace-based assessments, including a direct observation of a procedural skills assessment tool. The objective of this study was to evaluate the psychometric properties of this assessment tool for ultrasound-guided regional anaesthesia. Six experts assessed 30 video-recorded trainee performances of ultrasound-guided regional anaesthesia. Inter-rater reliability, assessed using absolute agreement intraclass correlation coefficients, varied from 0.10 to 0.49 for the nine individual nine-point scale items, and was 0.25 for a 'total score' of all items. Internal consistency was measured by correlation between 'total score' and 'overall performance' scale item (r = 0.68, p < 0.001). Construct validity was demonstrated by the 'total score' correlating with trainee experience (r = 0.51, p = 0.004). The mean time taken to complete assessments was 6 min 35 s.
URI: http://hdl.handle.net/11055/209
DOI: 10.1111/anae.12625
PubMed URL: https://www.ncbi.nlm.nih.gov/pubmed/24749931
Journal Title: Anaesthesia
Type: Journal Article
Research Support, Non-U.S. Gov't
Appears in Collections:Scholarly and Clinical

Files in This Item:
There are no files associated with this item.


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.