MINIEYE releases I-CS cockpit perception solution

Recently, we have been discussing the smart car the most. This is indeed the direction of future car development, but when it comes to what a smart car is, can you elaborate on it? I personally have four understandings of smart cars. The first is the energy type, which is completely pure electric; the second is the driving method, which is L5 level automatic driving; the third is the network, which is a powerful car networking function; the fourth is perception, which means that the cockpit can perceive your needs. Combining the above four points, I think it is a real smart car. So the press conference I attended today is about the fourth point.

MINIEYE releases I-CS cockpit perception solution

On September 27, 2021, Shenzhen Youjia Innovation Technology Co., Ltd. (MINIEYE) officially released its self-developed I-CS cockpit perception solution, which is a set of hardware and software integrated intelligent cockpit solutions that use facial recognition + gestures to allow the cockpit to perceive the status and needs of the driver and passengers. The product has been designated for more than 30 passenger car models. The company's CEO Liu Guoqing said that FAW, Dongfeng , and Geely are currently mass production cooperation customers.

The I-CS solution is based on computer vision technology and artificial intelligence, including driver monitoring system (DMS), passenger monitoring system (OMS), object recognition and human-vehicle interaction system, with core advantages such as high precision, high efficiency and high robustness. Through this solution, MINIEYE can provide leading and reliable in-cabin sensing technology and related supporting services for smart cars, and fully guarantee the safety and comfort of the in-cabin driving experience.

I-CS Solution Features

The I-CS solution provides proactive services specifically for five application scenarios: seamless vehicle entry, safe takeover, fatigue monitoring, child care, and multi-person entertainment. In these scenarios, I-CS reduces the threshold for interaction and the system's self-learning cost. Users can experience the "unnoticed" intelligent experience brought by I-CS without giving clear instructions.

Seamless entry: I-CS uses non-contact identity recognition and liveness detection technology, and has both 2D and 3D camera solutions, supporting cross-identity authentication of RGB and IR images. When the user approaches the sensor, it can quickly complete liveness judgment and identity recognition without any action, actively open the door for the user, quickly log in to the car system, and ensure the efficient operation of the cockpit system.

Safe takeover: I-CS has two sets of sight solutions, which can improve the visual perception accuracy by 3 times and can determine whether the driver's sight falls on the road ahead, central control, AI assistant, rearview mirror and other 7 viewing areas. By analyzing the driver's attention, it ensures that the driver can take over the vehicle in the automatic driving state in time at the critical moment.

Fatigue monitoring: For individual driving scenarios, I-CS has created a complete fatigue monitoring system that complies with EU standards. It can monitor the driver's head posture, eyelid opening and closing degree, line of sight direction, blinking frequency and other multi-dimensional indicators in real time, and realize quantitative grading of fatigue degree according to different behavioral characteristics. I-CS can timely warn or terminate dangerous driving behavior according to the different fatigue levels of the driver to reduce accidents.

Child care: I-CS can accurately identify adults and children by comprehensively analyzing facial attributes, human bone proportions, and height information. When a child is identified, the system will actively trigger the child care function, continuously monitor the child's status and behavior, and provide real-time feedback to the parents in the front seat to remind them to take necessary measures. Once a child is forgotten in the car, the system will remind the driver to return, and if there is no response for a long time, the alarm will be immediately sounded.

Multi-person entertainment: I-CS innovatively opens up the interactive space between the front and rear rows, and enables convenient interaction between multiple people in multiple positions through the use of natural body language such as sight, gestures, and head movements. In this scenario, the functional weight of the smart cockpit is no longer limited to the front row near the center console, and all users in the cabin can experience a new experience of proactive service.

Four major advantages

Natural body language interaction: In order to expand more service scenarios, MINIEYE proposed the underlying interaction logic of Intuitive Body Language, and implanted the concept of "human-vehicle interaction should be as natural and smooth as communication between people" into the I-CS solution, making full use of intuitive body movements to form a natural user interface, which reduces the cost of self-study while also improving the real interactive experience in the cabin.

Full stack adaptation: MINIEYE can provide flexible packaged software solutions according to the different needs of OEMs and Tier 1 suppliers. It can adapt to multiple camera modules and positions, support CPU/GPU/DSP solutions, and has mature experience in porting different embedded platforms.

High-performance computing: I-CS's self-developed accelerator can optimize its commonly used neural network models according to hardware characteristics, so that it can run efficiently on limited embedded platform resources. This self-developed technology is more friendly to resource allocation and computing power ratio in the integrated cockpit solution, and lays a good foundation for future OTA upgrades.

Complete development tool chain: Based on a mature R&D system, MINIEYE has established a complete self-developed development tool chain and a semi-automatic data annotation platform. Through multiple truth value systems and visual testing tools, it provides solid technical support for the fixed-point mass production and supporting acceptance of I-CS.

Summarize:

Personally, I think that the smart cockpit is equally important in the future smart cars. Today, when everyone is focusing more on autonomous driving, MINIEYE focuses on the cockpit perception solution. I think the smart cockpit is mainly divided into recognition and control. The recognition project is mainly for safety scenarios, while the control is for entertainment and convenience. At present, whether in terms of hardware or software, MINIEYE is undoubtedly following the first echelon of the industry.