Jaguar Land Rover and Cambridge University are developing 'no-touch' touchscreens for cars

Humza

Posts: 687   +159
Staff member
The big picture: Carmakers go to great lengths for optimizing the UI/UX of their infotainment systems. While much of it has been streamlined thanks to Apple CarPlay and Android Auto, the actual business of interacting with the software is still a mixture of buttons, rotary knobs, touchpads, and touchscreens. Gesture-driven systems have also appeared over the past few years, with BMW offering functions like volume control, call accept/reject, and navigation through simple hand gestures on supported models. JLR and Cambridge University have now shared their vision of an AI-powered 'no-touch' touchscreen that combines all these systems to let users operate their infotainment displays from a short distance, potentially improving usability while in motion and also reducing the risk of transferring pathogens by eliminating the need for touch altogether.

It's still an ongoing debate on whether touchscreens are an effective replacement for good old physical switches and knobs. The myriad of implementations often results in similarly varied experiences, while the general consensus among carmakers remains that offering more touchscreens wherever possible would likely make for an upmarket, sophisticated vehicle ownership experience.

The modern car's relationship with our digital lives is now permanent, which means the touchscreen, either multiple or a single giant tablet, is here to stay. The latest innovation in how users could one day interact with them comes from JLR and Cambridge University, who've co-developed an AI-powered 'predictive touch' technology as a means of using a car's infotainment touchscreen without actually touching it.

The research argues that while operating a touchscreen for navigation, temperature control or entertainment functions, users can "often miss the correct item – for example due to acceleration or vibrations from road conditions – and have to reselect, meaning that their attention is taken off the road, increasing the risk of an accident."

Cambridge University engineers have developed a solution that uses a combination of machine learning, alongside vision-based sensors for detecting user gestures and quickly determining or predicting the item they intend to use/touch by pointing at it.

During lab tests, they found a reduction in screen interaction effort by up to 50 percent, thanks to the technology's ability to predict the correct user action with high accuracy, resulting in distraction-free, safer driving.

The researchers say that the tech is also useful considering the ongoing pandemic situation. Since touching the display is no longer required, there's a wide array of use cases where its deployment can be beneficial in terms of health. Public facilities like ATMs, check-in kiosks, self-service checkouts, and other industrial applications equipped with predictive touch could potentially reduce the risk of spreading coronavirus and other pathogens as the need for hand contact with interactive displays is virtually eliminated.

The tech, according to its lead developer Dr. Bashar Ahmad, is superior to "basic mid-air interaction techniques or conventional gesture recognition, " as it supports intuitive interactions with "legacy interface designs," and doesn’t require any learning on the user's end. It can also be seamlessly integrated with existing touchscreen and interactive systems, provided they're able to feed correct sensory data to the software's machine learning algorithm.

Permalink to story.

 

neeyik

Posts: 1,132   +1,114
Staff member
*Sigh* JLR still just doesn’t get it - no amount of hand waving, regardless of how accurate it picks up inputs, is going to be better than a simple dial on the dashboard. As much as I like their cars, I’m unlikely to ever buy one because of their obsession with having everything screen-based.
 

ColdSoup

Posts: 49   +104
While I don't think I can ever stomach the cost of a BMW, their touch controller is pretty awesome. Turn a knob to scroll down and then press the button to select. No touch screen required. I much prefer the knob / touch pad over a touchscreen because it can be operated by muscle memory without looking at it.
 
  • Like
Reactions: Homerlovesbeer

VitalyT

Posts: 5,007   +3,886
TechSpot Elite
Touch screens is the second worst thing to happen to cars (first thing is EU regulations). And now these guys, trying to make things worse, since the biggest problem of touchscreens is already a poor feedback, which requires you to keep looking at it.

The only real future for vehicles is the full voice control, which we do not have yet.
 
Last edited:

Uncle Al

Posts: 7,221   +5,616
The only thing I don't like about them is the "accidental touch" where you waver a moment and the selection is made without that final touch. Voice control might be better but you will need a VERY ADVANCED word filter for all those "extra words" that we use against those $)#*&^!!! drivers .....
 

Squid Surprise

Posts: 3,223   +2,107
One of my pet peeves with touch screens ha always been the fingerprints which leave them looking filthy... at least this could alleviate that :)
 

Nobina

Posts: 2,560   +2,171
They are fixing a problem they introduced and will charge you additional money for it.

Cars interiors haven't really had a "breakthrough" so they're just thinking of new ways to reinvent the wheel so they can sell you this "new and improved" version of the same ****. Personally, I don't need 95% of the gadgets new cars have, not that I can afford one in the near future.
 
  • Like
Reactions: drjekelmrhyde
Actually went for a test drive in the new shape Range Rover Evoque around Christmas, of course you go out in the top spec model with £15k extras which includes the all touch centre consoles.

It‘s incredibly hard to use and drive at the same time, plus it has irritating animations which are distracting in your peripheral vision. With buttons and knobs it’s tactile and almost muscle memory, with screen you have to refocus and concentrate on what’s being displayed which is more dangerous and distracting.
 
  • Like
Reactions: drjekelmrhyde

drjekelmrhyde

Posts: 354   +124
Why are car manufacturers against knobs and buttons so much? once muscle memory kicks in its the best method.
Because they can upcharge you more when it come to having it replaced or fixed. Plus you're not going to find third party replacement nor will you be able to get them fixed outside a dealer.