A remarkable new type of prosthetic inspired by Luke Skywalker’s bionic hand has allowed an amputee musician to play piano once again.
Jason Barnes, who lost part of his right arm in a work accident five years ago, has been fitted with a prosthetic arm designed by Georgia Tech researchers to give the wearer individual control of each finger.
Distinguishing it from other prosthetics on the market, the new device is powered by ultrasound signals to detect what movements a person wants to carry out.
Jason Barnes, who lost part of his right arm in a work accident five years ago, has been fitted with a prosthetic arm designed by Georgia Tech researchers to give the wearer individual control of each finger
The 28-year-old lost his right arm, just below the elbow, after he was electrocuted in 2012.
Even without his hand and most of his forearm, however, he still has the muscles in his remaining limb that control his fingers.
By attaching an ultrasound probe to the new prosthetic, the researchers were able to watch how Barnes’ muscles moved when he tries to move a particular digit.
They then fed these movements to an algorithm, which is able to determine the intention of the movement more quickly.
‘Our prosthetic arm is powered by ultrasound signals,’ said Gil Weinberg, the Georgia Tech College of Design professor who leads the project.
‘By using this new technology, the arm can detect which fingers an amputee wants to move, even if they don’t have fingers.’
An amazing video shows how Barnes uses the prosthetic to play piano, moving through a simplified version of Beethoven’s Ode to Joy.
And, according to the team, he can also play the Star Wars theme.
Most high-tech prosthetics – including Barnes’ everyday prosthesis – are controlled by electromyogram (EMG) sensors, the researchers explain.
While these allow for certain movements, they have some limitations.
‘EMG sensors aren’t very accurate,’ said Weinberg, director of Georgia Tech’s Center for Music Technology.
‘They can detect a muscle movement, but the signal is too noisy to infer which finger the person wants to move.
‘We tried to improve the pattern detection from EMG for Jason but couldn’t get finger-by-finger control.’
By attaching an ultrasound probe to the new prosthetic, the researchers were able to watch how Barnes’ muscles moved when he tries to move a particular digit. They then fed these movements to an algorithm, which is able to determine the intention of the movement
The device is able to detect continuous and simultaneous movements of each finger, according to the team.
It can also determine how much force he intends to apply.
‘It’s completely mind-blowing,’ said Barnes.
‘This new arm allows me to do whatever grip I want, on the fly, without changing modes or pressing a button.
‘I never thought we’d be able to do this.’
A remarkable new type of prosthetic inspired by Luke Skywalker’s own bionic hand (pictured left, from the Star Wars film) has allowed an amputee musician to play piano once again. In the newer movie, Skywalker’s hand has a more robotic appearance (right)
Distinguishing it from other prosthetics on the market, the new device is powered by ultrasound signals to detect what movements a person wants to carry out. An amazing video shows how Barnes uses the prosthetic to play piano
The same team previously fitted the musician with a prosthetic arm equipped with two drumsticks, allowing him to return to his ‘first love’: the drums.
As the technology continues to improve, the researchers say it could be applied to other areas of life as well.
‘If this type of arm can work on music, something as subtle and expressive as playing the piano, this technology can also be used for many other types of fine motor activities such as bathing, grooming, and feeding,’ said Weinberg.
‘I also envision able-bodied persons being able to remotely control robotic arms and hands by simply moving their fingers.’