The effect of feedback on performance in a fracture detection task

Donovan, Tim ORCID: https://orcid.org/0000-0003-4112-861X , Manning, David J., Phillips, Peter ORCID: https://orcid.org/0000-0002-7473-6040 , Higham, Stephen and Crawford, Trevor (2005) The effect of feedback on performance in a fracture detection task. Proceedings of SPIE, 5749 . pp. 79-85.

Preview

PDF - Published Version Available under License CC BY-NC Download (85kB) | Preview

Abstract

Four observer groups with different levels of expertise were tested to determine the effect of feedback on eye movements and accuracy whilst performing a simple radiological task. The observer groups were 8 experts, 9 year 1 radiography students, 9 year 3 radiography students, and 10 naive observers (psychology students). The task was fracture detection in the wrist. A test bank of 32 films was compiled with 14 normals, 6 grade 1 fractures (subtle appearance), 6 grade 2 fractures, and 6 grade 3 fractures (obvious appearance). Eye tracking was carried out on all observers to demonstrate differences in visual activity. Observers were asked to rate their confidence in their decision on a ten point scale. Feedback was presented to the observers in the form of circles displayed on the film where fixations had occurred, the size of which was proportional to the length of fixation. Observers were asked to repeat their decision rating. Accuracy was determined by ROC analysis and the area under the curve (AUC). In two groups, the novices and first year radiography students, the feedback resulted in no significant difference in the AUC. In the other two groups, experts (p = 0.002) and second year radiography students (p = 0.031), feedback had a negative effect on performance. The eye tracking parameters were measured for all subjects and compared. This is work in progress, but initial analysis of the data suggests that in a simple radiological task such as fracture detection, where search is very limited, feedback by encouraging observers to look harder at the image can have a negative effect on image interpretation performance, however for the novice feedback is beneficial as post feedback eye-tracking parameters measured more closely matched those of the experts.

Item Type:	Article
Journal / Publication Title:	Proceedings of SPIE
Publisher:	Society of Photo-optical Instrumentation Engineers (SPIE)
ISSN:	1996-756X
ISBN:	9780819457233
Departments:	Academic Departments > Medical & Sport Sciences (MSS) > Health and Medical Sciences
Additional Information:	Proceedings of: 'Medical Imaging 2005: Image Perception, Observer Performance, and Technology Assessment'.
Depositing User:	Insight Administrator
Date Deposited:	19 Jan 2012 14:14
Last Modified:	11 Jan 2024 18:45
URI:	https://insight.cumbria.ac.uk/id/eprint/320

Downloads