Image sensor companies are experiencing a new wave of innovation

Several companies have updated their image sensors in terms of size, efficiency, or development ecosystem to accommodate applications ranging from AR to factory automation.

The augmented reality, virtual reality, and mixed reality (AR/VR/MR) market is expected to grow to a staggering $521.28 billion by 2031, and OEMs are seeking low-cost image sensors with high efficiency and performance to meet demand. Recently, OmniVision, STMicroelectronics, and Onsemi announced innovations and additions to their image sensor portfolios for AR/VR/MR and industrial applications.

OmniVision Launches “World’s Smallest, Lowest Power” Image Sensor

OmniVision recently launched its OG0TC global shutter image sensor for eye and face tracking, specifically targeting AR/VR/MR applications. Global shutter is a digital camera technology that reads all pixels in an image sensor at once, rather than reading pixel data from top to bottom as with a rolling shutter. Global shutter is particularly useful for capturing fast-moving objects without the distortion or artifacts caused by using a rolling shutter in a camera.

OG0TC Image Sensor

Image sensor makers are aiming to provide ultra-small packages for AR/VR wearables. Image courtesy of OmniVision

The OG0TC is a low-power image sensor in an ultra-small 1.64 mm x 1.64 mm package, which OmniVision says makes it suitable for AR/VR/MR headsets and glasses. The OG0TC consists of an image sensor array, an image sensor processor, and an image output interface. It also includes an SCCB interface for external communication. The image sensor array contains the image array, gain control, and a 10-bit ADC for sending pixel data to the image processor. The MIPI interface supports external transmission of image data.

OG0TC block diagram. Image courtesy of OmniVision

The OG0TC uses OmniVision's proprietary dual conversion gain (DCG) HDR technology, which optimizes each pixel based on the light input to that specific pixel. In a DCG pixel, the photoelectrons of the photodiode are read out twice with different gains: low conversion gain in high light and high conversion gain in low light. The result is an extended dynamic range of up to 140 dB. OmniVision says DCG technology is particularly useful for eliminating effects such as glare and ghosting, which can cause distortion when capturing fast-moving images. Omnivision also says that the OG0TC consumes 40% less power at 30 FPS than previous image sensors in the series.

ST builds out its image sensor development ecosystem

Other manufacturers in the space have also announced ecosystem developments and acquisitions to bolster their image sensing portfolios. STMicroelectronics recently announced that it has released a plug-and-play hardware kit, evaluation camera module, and software for its ST BrightSense global shutter image sensors.

ST's BrightSense global shutter image sensor. Image courtesy of STMicroelectronics

ST has designed these kits to make it easy to integrate sensors into a variety of applications. They are available in a variety of compact form factors, offer a variety of lens options, and feature connectors that simplify sensor mounting. For example, the CAM-55G0 is a compact camera module designed for evaluating the VD55G0 0.38-megapixel monochrome image sensor. It includes essential components such as sensor, lens, and plug-and-play connectivity for vision applications.

ST also provides complementary software tools such as a PC-based GUI and Linux drivers to help developers integrate the sensor with popular processing platforms. The evaluation software STSW-IMG501 can be downloaded free of charge from the STMicroelectronics website.

Onsemi Acquires SWIR Vision Systems

Onsemi acquires SWIR Vision Systems, integrating SWIR's colloidal quantum dot-based shortwave infrared (SWIR) technology into its portfolio. The technology is based on colloidal quantum dots (CQDs), which use crystals or nanoparticles with unique electronic or optical properties to absorb extended wavelengths of light. It extends detection capabilities beyond standard CMOS sensors, enhancing visibility through materials such as gas, plastics and fabrics.

SWIR Vision Systems' thin-film colloidal quantum dot photodiode array technology. Image courtesy of SWIR Vision Systems

SWIR technology faces barriers to widespread adoption due to the manufacturing complexity and cost of the Indium Gallium Arsenide (InGAas) process on which it is based. This acquisition will enable Onsemi to bypass these challenges by applying its manufacturing experience and silicon CMOS sensors to CQD technology for SWIR, thereby enabling low-cost, high-volume SWIR sensors. These SWIR sensors are integrated into Onsemi's products to provide more compact imaging solutions for commercial, industrial and defense applications.