Live music production system is controlled by hand gestures

The team said the system will allow performers to wirelessly compose, arrange and perform music live on stage using intuitive hand movements.

The interface of the system is a pair of sensory gloves designed by Fifth Dimension Technologies (5DT) with additional sensors from x-IO providing pitch, roll and yaw input.

Dr Tom Mitchell, an acoustic researcher from the University of the West of England, told The Engineer: ‘The majority of the development has been in integrating these sensors then mapping them.

‘So we analyse the data to identify gestures and once those gestures have been identified it’s a case of mapping those onto audio processes.

‘We’re well aware that other people have used gloves for musical purposes and even used comparable sensors, but we’re using a mapping system that’s designed in collaboration with Imogen so that she can move away from her equipment and just perform without disengaging from the audience.’

As well as this basic recall, Mitchell said the system allows the performer to adapt and improvise. For example, by making a grasping motion the performer can ’catch’ vocals or any other instrument, and filter these sounds by clasping their hands together and then ’release’ the sound again by opening their hands.