Amazon’s Echo and other smart speakers like the Google Home could be used to monitor the rhythm of a person’s heart.
Academics created an AI-powered device which monitors regular, and irregular, heartbeats using the same tools found in smart speakers.
The prototype, which was built in a lab but could be incorporated into speakers in the future, was found to be almost as good as medical devices in hospitals.
Academics created an AI-powered device which monitors regular, and irregular, heartbeats using the same tools found in smart speakers
The prototype, which was built in a lab but could be incorporated into commercial speakers in the future, was found to be almost as good as approved medical devices found in hospitals
The search for heartbeats begins when a person sits within one to two feet of the smart speaker.
Then the system plays an inaudible continuous sound, which bounces off the person and then returns to the speaker.
Based on how the returned sound has changed, the system can isolate movements on the person – including the rise and fall of their chest as they breathe, scientists said.
Researchers say this is the first time doctors have been able to monitor both regular and irregular heartbeats without physical contact.
The heartbeat-detecting machine learning system is similar to the one used by Amazon Echo speakers to activate Alexa.
One of the hardest challenges, the researchers say, was filtering out the noise made by the person breathing.
Anran Wang, lead author of the study and a doctoral student at the University of Washington, said: ‘The motion from someone’s breathing is orders of magnitude larger on the chest wall than the motion from heartbeats, so that poses a pretty big challenge.
‘And the breathing signal is not regular so it’s hard to simply filter it out.
‘Using the fact that smart speakers have multiple microphones, we designed a new beam-forming algorithm to help the speakers find heartbeats.’
The team designed an algorithm which learns as it is used, and is not based on a predetermined dataset.
This algorithm combines signals from all of the smart speaker’s multiple microphones to identify the elusive heartbeat signal, the experts said.
Professor Shyam Gollakota, co-author of the study, said: ‘This is similar to how Alexa can always find my voice even if I’m playing a video or if there are multiple people talking in the room.
The contactless system sends inaudible sounds from the speaker out into a room and listens to how they bounce back. Depending on what it detects after the sound waves return, including the rise and fall of their chest, a machine learning algorithm can piece together the person’s heartbeat
The heartbeat-detecting machine learning system is similar to that which is used by Amazon Echos to activate Alexa (pictured). One of the hardest challenges, the researchers say, was filtering out the noise made by the person breathing
‘When I say, “hey, Alexa”, the microphones are working together to find me in the room and listen to what I say next. That’s basically what’s happening here but with the heartbeat.’
Heart rhythm is of more use to clinicians than simple heart rate, another feature which is commonly used to monitor patients.
Dr Arun Sridhar, co-author of the study, said: ‘Heart rhythm disorders are actually more common than some other well-known heart conditions.
‘Cardiac arrhythmias can cause major morbidities such as strokes, but can be highly unpredictable in occurrence, and thus difficult to diagnose.
‘Availability of a low-cost test that can be performed frequently and at the convenience of home can be a game-changer for certain patients in terms of early diagnosis and management.’
The team compared the smart speaker’s inter-beat interval with one from a standard heartbeat monitor. More than 12,000 heartbeats from healthy people and on average they were spotted within 28 milliseconds of the standard monitor, the researchers said
Currently this system is set up for spot checks so if a person is concerned about their heart rhythm they can sit in front of a smart speaker and get a reading. But the research team hopes that future versions could continuously monitor heartbeats while people are asleep, something that could help doctors diagnose conditions such as sleep apnoea
The researchers tested a prototype on two groups — 26 healthy participants and 24 patients in hospital — with a wide range of cardiac conditions, including atrial fibrillation and heart failure.
The team compared the smart speaker’s inter-beat interval with one from a standard heartbeat monitor.
More than 12,000 heartbeats from healthy people were recorded which were, on average, picked up within 28 milliseconds of the standard monitor, the researchers said.
The device was almost as effective when used on hospital patients. More than 5,600 heartbeats were measured and, on average, the prototype spotted them within 30 milliseconds of the approved medical device.
Currently this system is set up for spot checks so if a person is concerned about their heart rhythm they can sit in front of a smart speaker and get a reading.
But the research team hopes that future versions could continuously monitor heartbeats while people are asleep, something that could help doctors diagnose conditions such as sleep apnoea.
Dr Sridhar said: ‘If you have a device like this, you can monitor a patient on an extended basis and define patterns that are individualised for the patient.
‘For example, we can figure out when arrhythmias are happening for each specific patient and then develop corresponding care plans that are tailored for when the patients actually need them.
‘This is the future of cardiology. And the beauty of using these kinds of devices is that they are already in people’s homes.’
The findings of the study were published in Communications Biology.