Flexible robotic arm put to work with AR

A malleable robotic arm designed and created at Imperial College London can be used with greater accuracy thanks to augmented reality (AR) goggles. 

According to Imperial, the flexible arm can twist and turn in all directions, making it customisable for applications in manufacturing, spacecraft maintenance, and injury rehabilitation.

In use, people working with the robot would manually bend the arm into the precise shape needed for each task, a level of flexibility made possible by layers of mylar sheets inside, which slide over one another and can lock into place. So far, configuring the robot into specific shapes without guidance has presented challenges.

MORE FROM ROBOTICS

To enhance the robot’s user-friendliness, researchers at Imperial’s REDS (Robotic manipulation: Engineering, Design, and Science) Lab designed a system for users to see in AR how to configure their robot. Wearing mixed reality smartglasses and through motion tracking cameras, users see templates and designs in front of them superimposed onto their real-world environment. They then adjust the robotic arm until it matches the template, which turns green on successful configuration so that the robot can be locked into place.

The team’s findings are published inIEEE Robotics & Automation Magazine.

In a statement, senior author Dr Nicolas Rojas, of Imperial’s Dyson School of Design Engineering, said: “One of the key issues in adjusting these robots is accuracy in their new position. We humans aren’t great at making sure the new position matches the template, which is why we looked to AR for help.

“We’ve shown that AR can simplify working alongside our malleable robot. The approach gives users a range of easy-to-create robot positions, for all sorts of applications, without needing so much technical expertise.”

robotic arm
The AR template turns green to indicate successful configuration (Image: Imperial College London)

The researchers tested the system on five men aged 20-26 with experience in robotics but no experience with manipulating malleable robots specifically. The subjects were able to adjust the robot accurately, and the researchers said their initial findings show that AR could be a successful approach to adapting malleable robots following further testing and user training.

Potential applications include manufacturing, building and vehicle maintenance. Because the arm is lightweight, it could also be used on spacecraft. It is also gentle enough that it could be used in injury rehabilitation, helping a patient perform an exercise while their physiotherapist performs another.

Co-first authors PhD researchers Alex Ranne and Angus Clark, said: “In many ways it can be seen as a detached, bendier, third arm. It could help in many situations where an extra limb might come in handy and help to spread the workload.”

The researchers are in the process of perfecting the robot as well as its AR component. They will next look into introducing touch and audio elements to the AR to boost its accuracy in configuring the robot.

They are also looking into strengthening the robots. Although their flexibility and softness makes them easier to configure and maybe even safer to work alongside humans, they are less rigid while in the locked position, which could affect precision and accuracy.