Scientists develop TV gesture control system

TV’s could soon be controlled by a wave of the hand using new technology developed at a UK university.

Researchers have created the Matchpoint system that makes it possible to interact with screens simply by using body movements or waving objects.

It lets users change the channel, adjust the volume or access their TV guide simply by moving their hand, or even an everyday object like a cup of tea. 

 

TV’s could soon be controlled by Minority Report style gestures using new technology developed at a university in the UK. The Matchpoint system makes it possible to interact with screens simply by using body movements or waving objects

HOW DOES IT WORK? 

Requiring only a simple webcam, Matchpoint works by displaying moving targets that orbit a small circular ‘widget’ in the corner of the screen.

The user synchronises hand, head or object movements with the targets to activate functions such as volume, changing channel or viewing a menu.

Because the software is not trained to look for a specific body part, it provides a lot of flexibility.

It works even when hands are full or while standing, as well as when slouching on the sofa.

Users also do not need to learn specific commands to activate different functions, as is the case with some gesture controlled televisions on the market, and the user is able to decouple at will.

Computer scientists at Lancaster University developed the new technology, which has echoes of the 2002 science fiction blockbuster Minority Report.

Actor Tom Cruise uses arm and hand gestures to manipulate screen images.

While the film itself is set in the year 2054, the breakthrough means it could become a reality much sooner.

Matchpoint relies on a system called spontaneous spatial coupling to recognise specific movements, rather than tracking a particular body part.

As well as televisions, the technology can also be used with other screens.

This could allow users to pause YouTube tutorials, such as on push bike maintenance, without having to put down their tools.

Team leader Christopher Clarke, a pHD student at the university’s School of Computing and Communications, said: ‘Spontaneous spatial coupling is a new approach to gesture control that works by matching movement instead of asking the computer to recognise a specific object.

‘Our method allows for a much more user-friendly experience where you can change channels without having to put down your drink, or change your position, whether that is relaxing on the sofa or standing in the kitchen following a recipe.

‘Everyday objects in the house can now easily become remote controls so there are no more frantic searches for remote controls when your favourite programme is about to start on another channel, and now everyone in the room has the ‘remote’.

‘You could even change the channel with your pet cat.’

Requiring only a simple webcam, Matchpoint works by displaying moving targets that orbit a small circular ‘widget’ in the corner of the screen.

The user synchronises hand, head or object movements with the targets to activate functions such as volume, changing channel or viewing a menu.

Because the software is not trained to look for a specific body part, it provides a lot of flexibility.

It works even when hands are full or while standing, as well as when slouching on the sofa.

Requiring only a simple webcam, Matchpoint works by displaying moving targets that orbit a small circular 'widget' in the corner of the screen. The user synchronises hand, head or object movements with the targets to activate functions like  volume, channel and menu control

Requiring only a simple webcam, Matchpoint works by displaying moving targets that orbit a small circular ‘widget’ in the corner of the screen. The user synchronises hand, head or object movements with the targets to activate functions like volume, channel and menu control

Users also do not need to learn specific commands to activate different functions, as is the case with some gesture controlled televisions on the market, and the user is able to decouple at will.

When selecting volume adjustment or channel selection, sliders appear.

The user moves their hand, head, or object, in the required direction indicated by the slider to change the volume or to find the desired channel. 

Multiple pointers can be created to allow more than one user to point at drawings or pictures on interactive whiteboards simultaneously. 

Matchpoint also allows users to manipulate images on whiteboards by using two hands to zoom in and out, and rotate images.

The technology has echoes of the 2002 science fiction blockbuster Minority Report. Actor Tom Cruise uses arm and hand gestures to manipulate screen images. While the film itself is set in the year 2054, the breakthrough means it could become a reality much sooner

The technology has echoes of the 2002 science fiction blockbuster Minority Report. Actor Tom Cruise uses arm and hand gestures to manipulate screen images. While the film itself is set in the year 2054, the breakthrough means it could become a reality much sooner

In addition to short-term couplings, users can also link stationary objects to controls, which even when left for prolonged periods will retain their control function. 

For example, a mug sat on a table could change a track on a music player when moved left or right, and a rolling toy car could be used to adjust volume.

Objects can lose their coupling with controls simply by removing them from the camera’s field of view.

A paper on the technology will be presented at the User Interface Software and Technology 2017 conference in Quebec City, Canada, later this month.

 

Read more at DailyMail.co.uk