OPPO, Ruisi Intelligent Chip, and Qualcomm join hands to jointly promote the AI ​​Motion revolution in smartphone imaging

Las Vegas, USA, January 11, 2024 RisSmart joins hands with OPPO and Qualcomm to work together to promote the application of innovative Hybrid Vision Sensing (HVS®) technology in the field of smartphones. The HVS® sensor is used to extract motion information and image data more efficiently, thereby helping to further improve camera performance and realize the AI ​​Motion function of images.

The three parties will cooperate to develop a complete solution, including obtaining raw visual information from the Hybrid Vision Sensor, transmitting it to the Snapdragon® mobile platform, and matching it with a dedicated algorithm. This cooperation plan will help realize innovative functions of smartphone imaging, such as photo deblurring, super-resolution, and video super-slow-motion reconstruction, which require algorithms based on the combination of image and motion information. It is of groundbreaking significance.

Judd Heape, Vice President of Product Management at Qualcomm, said: Compared with traditional image sensing technology, EVS technology has greater advantages in capturing motion information. The HVS® solution combines the respective advantages of image and event sensing technologies. With the support of platform hardware and algorithms, the imaging capabilities of smartphones have been significantly improved. We are pleased to cooperate with OPPO and Ruisi Intelligent Core to jointly contribute to the productization of this technology. We also believe that this technology will be more widely used in various fields.

OPPO Imaging Product Director Zhang Xuan : "Over the years, we have conducted extensive research on cutting-edge sensor technology, especially investing a lot of energy in the field of HVS® (fusion vision sensing) technology. We have in-depth cooperation with Ris Intelligent Chip and Qualcomm We have cooperated with each other and participated in multiple iterative development of chips and algorithms. We are confident in the potential of this technology and will continue to invest in it in the future. Together with our partners, we look forward to the application of this technology in the OPPO Super Light and Shadow Image Engine."

Motion information is crucial in photography and machine vision. Traditional image sensors overlap motion information within a period of time (ie, exposure time) into one frame of image, but this can easily lead to motion blur and loss of effective motion data.

Using visual sensors to effectively obtain high-precision motion information is one of the primary needs in various fields today . Based on traditional image sensors, the industry usually obtains high-precision motion information by increasing the frame rate, but at the same time, it also has to pay the price of bearing huge redundant data, which results in an increase in resource consumption, system cost, and system processing efficiency. of reduction. In addition, high frame rate means too short exposure time, which greatly weakens the camera's ability to adapt to ambient light.

Therefore, for many applications, obtaining more effective high-precision motion information by increasing the frame rate is cost-effective and impractical. A more cost-effective technical path is needed to achieve efficient capture of motion information.

Event-based Vision Senor (EVS) is an imaging technology that continuously records changes/motion information without a shutter. Through its unique in-pixel processing mechanism, it can achieve a balance between high frame rate, high dynamic range and low data redundancy when recording motion information.

Since EVS is insensitive to static information, it has poor ability to capture the key static image information required for many machine vision applications. It usually needs to be used with a traditional image sensor (RGB). However, the integration of these two technologies is not easy. , it faces the challenge of spatio-temporal registration of two types of visual information (EVS and RGB). At the same time, the cost and system complexity increase, which to a certain extent also inhibits EVS from exerting its original technical advantages. .

The Fusion Vision Sensing (HVS®) technology launched by Ruisi Intelligent Core in 2019 integrates EVS and traditional image functions on the same sensor chip. Riszhixin's ALPIX® series sensors can simultaneously output high-quality RGB images and EVS data streams, providing a cost-effective and algorithm-friendly solution for capturing images with motion information.

Deng Jian, founder and CEO of Ruisi Intelligent Core , said: "In the current field of visual sensors, people not only have higher and higher expectations for 2D RGB information; they also urgently hope that sensors can provide additional data, such as distance, spectrum and Motion information. We are working with OPPO and Qualcomm to jointly promote the seamless integration of ALPIX-Eiger® into mobile phone applications. As an enhanced RGB image sensor, its image quality is comparable to the leading image sensors on the market, while introducing EVS captures motion information. We are extremely excited and proud to witness and participate in this technology from concept to product implementation."

"What really changes the world is not the technology itself, but the value that the product applications derived from the technology bring to society. We hope to bring converged visual sensing technology (HVS®) to every user. This is our original intention, and we look forward to This cooperation has achieved fruitful results," Deng Jian added.