A facial recognition system can identify someone even if their face is covered up.
The Disguised Face Identification (DFI) system uses an AI network to map facial points and reveal the identity of people.
It could eventually help to pick out criminals, protesters, or anyone who hides their identity by covering themselves with masks, scarves or sunglasses.
The software could also see the end of public anonymity, sparking privacy concerns from one academic, who has labelled it ‘authoritarian’.
A facial recognition system can identify someone even if their face is covered up. The Disguised Face Identification (DFI) system (pictured) identifies people by measuring a number of facial points that can be read even if the wearer is disguised
‘This is very interesting for law enforcement and other organisations that want to capture criminals,’ Amarjot Singh, a researcher at the University of Cambridge who worked on DIF, told Inverse.
‘The potential applications are beyond imagination.’
Led by Mr Singh, the international team of scientists published their research on the pre-print serverarXiv.
DFI uses a deep-learning AI neural network that the team trained by feeding it images of people using a variety of disguises to cover their faces.
The images had a mixture of complex and simple backgrounds to challenge the AI in a variety of scenarios.
The AI identifies people by measuring the distances and angles between 14 facial points – ten for the eyes, three for the lips, and one for the nose.
It uses these readings to estimate the hidden facial structure, and then compares this with learned images to unveil the person’s true identity.
In early tests, the algorithm correctly identified people whose faces were covered by hats or scarves 56 per cent of the time.
This accuracy dropped to 43 per cent when the faces were also wearing glasses.
The work is still in its early stages, and the algorithm needs to be fed more data before it can be brought into the field.
DFI uses an AI network trained using images of face to map facial points and reveal the identity of people. It measures the distances and angles between 14 facial points (pictured) – ten for the eyes, three for the lips, and one for the nose
DFI uses the facial point readings to estimate the hidden facial structure (bottom), and then compares this with learned images (top) to unveil the person’s true identity
Despite these hurdles, Mr Singh told Inverse: ‘We’re close to implementing it practically.’
The DFI team have called on other researchers to help develop the technology using their datasets of covered and uncovered faces.
The research, which has not yet been peer reviewed and is still awaiting publication, has sparked controversy after some raised concerns over privacy rights.
Dr Zeynep Tufekci, a sociologist at the University of North Carolina, posted the research to Twitter, claiming that the AI is ‘authoritarian’.
In early tests, the algorithm correctly identified people whose faces were covered by hats or scarves 56 per cent of the time. This accuracy dropped to 43 per cent when the faces were also wearing glasses
He tweeted: ‘The authors claim the system works about half the time even when people wear glasses. And this is just the beginning; first paper.
‘And this is maybe the third or fourth most worrying ML paper I’ve seen recently re: AI and emergent authoritarianism. Historical crossroads.
‘Yes, we can & should nitpick this and all papers but the trend is clear. Ever-increasing new capability that will serve authoritarians well.’
The DFI team will present their research at the IEEE International Conference on Computer Vision Workshop in Venice, Italy, next month.
The work is still in its early stages, and the algorithm needs to be fed more data before it can be brought into the field. The research, which has not yet been peer reviewed and is still awaiting publication, has sparked controversy after some raised concerns over privacy rights
A facial recognition system can identify someone even if their face is covered up. It could help to identity criminals, protesters, or anyone who hides their identity by covering themselves with masks, scarves or sunglasses (stock image)