Gesture-recognition system could reduce surgical delays

Surgeons routinely need to review medical images and records during surgery, but stepping away from the operating table and touching a keyboard and a mouse can delay the procedure and increase the risk of spreading infection-causing bacteria, according to Juan Pablo Wachs, an assistant professor of industrial engineering at Purdue University.

Researchers are said to be creating a system that uses depth-sensing cameras and specialised algorithms to recognise hand gestures as commands to manipulate MRI images on a large display. Recent research to develop the algorithms has been led by doctoral student Mithun George Jacob.

The researchers validated the system, working with veterinary surgeons to collect a set of gestures natural for clinicians and surgeons. The surgeons were asked to specify functions they perform with MRI images in typical surgeries and to suggest gestures for commands. Ten gestures were chosen: rotate clockwise and counter-clockwise; browse left and right; browse up and down; increase and decrease brightness; and zoom in and out.