Eyeris and OmniVision collaborate to launch the industry's first monocular 3D sensing AI solution for automotive cockpits

According to foreign media reports, on March 15, local time, Eyeris Technologies, the global leader in automotive cockpit sensing AI and sensor fusion solutions, announced its cooperation with OMNIVISION, the world's leading semiconductor solution developer. The two parties successfully integrated Eyeris' leading The cockpit monocular 3D sensing AI software is integrated with OmniVision's OAX4600 system-on-chip (SoC) platform and its 5-megapixel (MP) OX05B1S RGB-IR global shutter sensor.

Car cockpit monitoring (Image source: Eyeris)

This combined solution uses a single 2D image sensor with a dedicated NPU (Neural Processing Unit) and an integrated RGB–IR ISP (Image Signal Processor) to provide the industry’s first depth-aware cockpit monitoring AI software functionality. The integrated solution of Eyeris and OmniVision Technology can achieve in-car monitoring, cost and energy efficiency, and can also be packaged and installed in the limited space of the vehicle to further improve the safety, comfort and convenience in the vehicle.

Eyeris' 3D sensing AI could improve cockpit monitoring capabilities

Recently, Eyeris launched the world's first monocular 3D sensing AI to meet the growing demand for cockpit 3D sensing functions. The company uses proprietary technology and advanced deep neural networks to accurately restore depth information from the 3D output of 2D image sensors for all cockpit functions. Eyeris' advanced neural network model can map the car's interior and accurately predict the position of the occupant's face, body, hands, objects and other objects in the car in three-dimensional space, enabling comprehensive in-car monitoring.

Integrated solution from Eyeris and OmniVision operates at the lowest power consumption, delivers the highest performance in the industry, and reduces costs

For efficient reasoning, Eyeris integrates OmniVision Technology's AI OAX4600 platform, which is a next-generation application-specific integrated circuit (ASIC) that uses OmniVision Technology's dedicated NPU and has the performance of 2 Tera operations (TOPS). The OAX4600 offers 2Gb of stacked RAM memory, providing a unique integrated approach to reducing BOM costs, with the lowest power consumption compared to similar products on the market. Combining the most advanced ISP technology with neural network capabilities provides users with the most efficient and optimized solution on the market.

As part of the combined solution, Eyeris also integrates OmniVision's 5-megapixel OX05B1S RGB-IR image sensor, which delivers the industry's highest performance in all lighting conditions, with 940nm near-infrared sensitivity, providing enhanced Image quality and analysis. The advanced image sensor has a wide field of view, providing enough pixels to cover all regions of interest (ROI) in the vehicle, including small areas such as the driver's eyelids and pupils, which is critical to the accuracy of Eyeris' vision AI technology. .