WPG Launches Electronic Image Stabilization (EIS) Camera Solution Based on Novatek, SmartSens and TDK Products

On September 12, 2024, WPG Holdings, a leading international semiconductor component distributor dedicated to the Asia-Pacific market, announced that its subsidiary Quanta Semiconductor has launched an electronic image stabilization (EIS) camera solution based on Novatek's NT98530 chip, SmartSens' SC850SL image sensor and TDK's ICM-42607 IMU (inertial sensor module).

Figure 1 - Display board of Wanda's EIS camera solution based on Novatek, SmartSens and TDK products

Today, the innovation of imaging technology is driving the development of all industries at an unprecedented speed, especially in the fields of consumer electronics, smart security, autonomous driving and telemedicine. High-definition, stable and low-latency video capture capabilities are becoming an indispensable key technology for building smart life. To meet this market demand, WPG Semiconductor has launched an electronic image stabilization (EIS) camera solution based on Novatek's NT98530 chip, SmartSens' SC850SL image sensor and TDK's ICM-42607 IMU (inertial sensor module).

EIS (Electric Image Stabilization) is a technology that uses the inertial sensor module IMU to obtain changes in camera posture, and then offsets the image shake caused by camera vibration by partially cropping and deforming the original image, so that the output image is stable.

Figure 2-Application scenario of Wanda's EIS camera solution based on Novatek, SmartSens and TDK products

NT98530 is a highly integrated SoC from Novatek Technology, supporting a processing rate of up to 640M pixels/second, and can achieve more than 8 million pixels/60FPS edge computing performance. The integration of the new generation DSP of CEVA SensPro2 inside the SoC, combined with its fully optimized SDK, can ensure that the SoC has sufficient performance to support complex computer vision algorithms and neural network reasoning. In addition, the SoC integrates the ARM Quad Cortex A53 CPU core, a new generation ISP, an H.265/H.264 video compression encoder, a high-performance hardware DLA module, a graphics engine, a dual display controller, an Ethernet GMAC, USB3.0 and USB 2.0 host/device, an audio codec, RTC and SD/SDIO 3.0, which can provide cost-effective edge computing IP camera solutions.

SC850SL is SmartSens' first Stacked Rolling Shutter product. It adopts Stack BSI+RS architecture design to greatly improve the product's sensitivity and low-light imaging performance. It is also equipped with SmartSens' second-generation near-infrared sensitivity NIR+ technology to significantly improve QE (quantum efficiency).

In terms of IMU selection, the solution uses the TDK ICM-42607 chip, which combines a 3-axis gyroscope and a 3-axis accelerometer, with a FIFO of up to 2.25KB, which can reduce the traffic on the serial bus interface and allow the system processor to burst read sensor data and then enter low-power mode.

Figure 3 - Block diagram of Wanda's EIS camera solution based on Novatek, SmartSens and TDK products

When designing the circuit, the TDK ICM-42607 needs to be placed parallel or perpendicular to the three-axis angle of the Sensor IC. NT98530 can connect to the TDK ICM-42607 via the SPI interface to provide EIS function and perform related setting control and data transmission. Thanks to the excellent performance of these devices, this solution can provide more stable and clear image performance for a variety of camera applications.

Core technology advantages:

• Provide relevant APIs for customers to use and adjust EIS;

• Gyro can be calibrated using the tools provided by Novatek;

• Custom Gyro data can be used.

Program Specifications:

• The chip core is Qual Cortex-A53;

• AI computing power is 2T;

• The power input is 12V/2A;

• The system OS uses Linux;

• Combined image and speech codecs;

• Use the SPI interface to connect Gyro for related control and data transmission.