Design of Color Image Enhancement System Based on FPGA

在从图像源到终端显示的过程中，电路噪声、传输损耗等会造成图像质量下降，为了改善显示器的视觉效果，常常需要进行图像增强处理。图像增强处理有很强的针对性，没有统一的*价标准，从一般的图片、视频欣赏角度来说，滤除噪声、扩展对比度、锐化以及色彩增强等处理能显著提升视觉效果。

Here we design a real-time video image processing system based on FPGA, which includes two processing methods: contrast enhancement and color saturation. Compared with DSP and ASIC solutions, FPGA has absolute advantages in performance and flexibility, and it is more common to use FPGA to design video communication systems.

1 Principle and Algorithm

Image enhancement processing can be performed in the frequency domain and the spatial domain. Typical frequency domain methods, such as histogram enhancement processing, are suitable for software system implementation; while hardware systems are more suitable for spatial domain processing. Therefore, the processing methods described in this article will all be performed in the spatial domain.

1.1 Contrast expansion

Contrast expansion is also called grayscale transformation. Its purpose is to expand the grayscale range of interest while compressing the grayscale range of no interest. The simplest and most effective method is linear transformation, which satisfies the following relationship:

f(x, y) and g(x, y) represent the grayscale values ​​of the input image and the output image, respectively. After the transformation, the grayscale values ​​within a~b are linearly stretched, and the grayscale intervals of [0, a] and [b, 255] are suppressed. From the perspective of display devices, general civilian-grade displays do not have the ability to perfectly display 256 grayscales. Therefore, suppressing the grayscale intervals of too dark [0, a] and too bright [b, 255] and enhancing the dynamic range of the middle area can avoid the waste of grayscale. From another perspective, usually an image contains only a few pixels that are too dark and too bright. Purposefully and targetedly expanding the grayscale in the middle range and compressing the grayscale at both ends can enhance the image quality and obtain better visual effects, while the loss of image information is very small.

1.2 Color Enhancement

The purpose of color enhancement is to increase the color saturation of the image in a targeted manner while ensuring that the color is not distorted, making it look brighter and more vivid, with a stronger sense of layering.

1.2.1 Introduction to the HSI Model

In color image processing, RGB, YCbCr, CMYK, etc. are commonly used color models. Their algorithms and conversions between them are easy to implement with hardware, but they are not well adapted to the colors actually interpreted from a human perspective.

Research shows that when observing a colored object from a human perspective, the object is generally described using three parameters: hue, color saturation, and brightness. Hue describes the properties of pure color, while saturation gives a measure of the degree to which a pure color is diluted by white light. Brightness is the degree of lightness or darkness of an image and is a subjective descriptive quantity. The HSI color model based on these three parameters is an ideal tool for developing image processing methods based on color description. The following briefly explains the principle of the HSI model.

Figure 1 shows a cube model of RGB color space, with the side length normalized to 1, the origin is black, and the opposite vertex is white. Connecting the black and white points gives the gray axis, and the saturation on this axis is 0, that is, there is no color component. Points with the same projection point on the gray axis have the same brightness, that is, points in the plane perpendicular to the gray axis have the same brightness value.

Take any point P in the cube, it defines a plane with the gray axis. According to the theory of color science, all colors are generated by the three colors located in the triangle defined by those colors. In this plane, the three vertices of the triangle are black, white and the color of P, and black and white cannot change the hue, so the points in this plane have the same hue as point P, that is, the isochromatic plane. Intuitively speaking, the closer the point is to the gray axis, the lighter the color, so the definition of color saturation is the distance between the point and the gray axis: the farther the distance, the stronger the saturation; the closer the distance, the weaker the saturation; if the distance is 0, the saturation is also 0, and there is no color at all.

In fact, the HSI space (isoluminance surface) is represented by the trajectory of colored points in a plane perpendicular to the grayscale axis. When the plane moves up and down along the grayscale axis, the boundary determined by the cross section formed by cutting the cube boundary is triangular or hexagonal. Here, a hexagon is taken as an example, as shown in Figure 2.

As shown in Figure 2, the three primary colors are divided by 120°. Cyan, magenta and yellow are called secondary colors, which are also divided by 120°. The primary and secondary colors are separated by 60°. For any given point Q in the figure, if the red axis is used as a reference, the angle H between the Q vector and the red axis determines its hue, and the vector length S determines its saturation. The position of the entire plane on the grayscale axis determines the brightness I of all points in the plane. So the conversion relationship from RGB to HSI is obtained: