New ways to control cars: gesture recognition and virtual touch screens

    With the popularization of automobiles, automobile technology has become more and more mature, and some innovative in-vehicle technologies have also been developed accordingly. Among them, in-vehicle gesture sensing technology is one of the most popular automotive technologies. At present, major automobile manufacturers in the world are competing to study automobile gesture control systems, through which drivers can control the car through gestures without being distracted. It is believed that this futuristic automotive technology will be available in the market in the next few years.

Many vehicle manufacturers and parts manufacturers are developing gesture control technology

    Earlier this year, Hyundai Motor Company equipped a concept car with an in-car audio gesture control system, in which the driver can control the volume through gestures. Toyota and Microsoft are also jointly researching this automotive technology. In addition, Volvo Cars has equipped its concept car with a related automotive sensing system, which can monitor the driver's line of sight in real time through an infrared camera. When the system senses that the driver's line of sight falls on the in-car central control display, the system will automatically light up the in-car central control display.

    Accordingly, major auto parts companies around the world are also conducting research on related products. STMicroelectronics and Melexis are both researching this type of timeline camera (infrared camera). The working principle of this type of infrared camera is similar to that of radar. It mainly detects the changes of moving objects rather than creating images out of nothing. This type of timeline camera uses modulated infrared LEDs, in which each pulse corresponds to a time point on the timeline. By measuring the time from the beginning of light irradiation to the reflection back, the required distance can be obtained, and then the movement trajectory of the object being measured can be obtained through triangulation.

Visteon's Horizon cockpit concept incorporates three new technologies

    Visteon Corp. on May 15 unveiled a new automotive cockpit concept that showcases futuristic technologies such as 3-D gesture recognition that will be realized sooner than people think.

    Visteon has demonstrated its Horizon cockpit concept to automakers around the world, which combines three emerging technologies to change the way drivers control vehicle interior functions such as temperature, audio and navigation.

    Gesture Control – Advanced camera systems capture the user’s hand movements and replicate them on the dashboard. This allows drivers in the Horizon cockpit to easily operate specific vehicle controls simply by moving their hands or even fingers without touching the dashboard. For example, a rotary motion with one hand can adjust the volume of the radio.

    Virtual touchscreen - With a pressure-sensitive touchpad, the driver can operate the controls on the center console without actually touching them. The touchscreen can improve responsiveness by recognizing the amount of pressure applied to it. At the same time, the touchscreen can be loaded into any soft material such as leather or cloth for operation, achieving maximum assembly flexibility.

    Dual-layer display - Information is displayed on two separate but overlapping display screens through high-resolution images, with the focus on the information that the driver is manipulating. The driver can seemingly "pass through" the image on the first display and immediately see what is displayed on the second display.

    Visteon uses its expertise in human-machine interaction (HMI) to integrate these technologies to create a unique driving environment for the driver.

    "The Horizon Cockpit concept demonstrates the potential of combining real-time 3-D graphics with advanced display technologies," said Shadi Mere, Visteon innovation manager. "By combining several emerging HMI input technologies, we can create a unique cockpit system that delivers an intuitive and enjoyable driving experience."

    Before releasing the Horizon cockpit system to automakers, Visteon conducted consumer market research on the concept. 70% of consumers who participated expressed strong interest in using a virtual volume knob in their next potential new car purchase, and believed that it would be easier and more convenient than searching for a traditional volume knob while driving.

Expanded application of gesture recognition: Wake up the display screen through the air

    While this type of technology has been extensively studied and achieved great results, another automotive technology has been applied to in-vehicle touch screen control. Most in-vehicle touch screens will automatically enter a dormant state if they are not operated for a long time, and if you want to wake up the display, you need to touch the display. Now, there is no need for direct contact, just place your hand or finger near the touch screen to wake up the touch screen. Among them, a user experience system launched by Cadillac and the touch screen equipped with the 2014 Corvette support this type of nearby wake-up touch screen technology.

    In addition, major auto parts companies are researching and developing technologies to increase the wake-up distance limit of nearby wake-up touch screen technology. Among them, the CapSense touch screen sensor developed by Cypress Semiconductor can detect up to one foot away, so that by using this CapSense touch screen, the driver can control the central control display system by gestures up, down, or even turning pages without being distracted.