introduction
Image and video monitoring system is a system that uses computer and communication technology to realize information monitoring of target areas. It is often used in transportation, energy, public security, telecommunications, military and other departments. With the continuous expansion of the application field of image and video monitoring systems, remote image and video monitoring systems have emerged, which meet the requirements of long-distance monitoring. Digital video monitoring system is centered on computers or embedded systems and based on video processing technology. It is in line with international standards for image data compression. It is a new type of monitoring system that comprehensively utilizes technologies such as image sensors, computer networks, automatic control and artificial intelligence. Since digital video monitoring systems digitize video images, digital monitoring has many advantages compared with traditional analog monitoring systems. Digital video systems can make full use of the fast processing power of computers to compress, analyze, store and display them. Digital video processing technology improves the quality of images and monitoring efficiency, making the system easy to manage and maintain. The entire system is a modular structure with a small size and is easy to install, use and maintain. It is precisely because digital video monitoring technology has advantages that traditional analog monitoring technology cannot match, and it conforms to the development trend of digitization, networking and intelligence in the current information society, so digital video monitoring technology is gradually replacing analog monitoring technology and is widely used in all walks of life. Embedded systems have been widely used in various fields of society due to their small size, strong real-time performance, high cost performance, and good stability. Digital remote monitoring based on ARM embedded is a new application based on modern communication technology. This design is an embedded system that uses the ARM hardware platform as the core to achieve real-time monitoring of the site, and transmits video images to the host through a wireless network to achieve functions such as analysis, storage, and display. Compared with traditional analog monitoring systems: its networking cost is greatly reduced, the system volume and weight are greatly reduced, and operation and maintenance are easier.
1 Monitoring system solution introduction
The network structure design of the remote monitoring system directly affects the performance of the system. Currently, there are three solutions for the implementation of the monitoring system network. They are introduced as follows:
(1) Using a proxy server[page]
The proxy server is usually a PC. On the one hand, it runs the TCP/IP protocol to realize the Internet access function, and on the other hand, it is connected to the embedded system through a simple bus structure (RS232, RS485, etc.). As shown in Figure 1, only a part of the code that communicates with the proxy server is needed in the system. Its advantage is that it can easily solve the problem of equipment accessing the Internet, and the development difficulty is low; the disadvantage is that the access cost is relatively high, which is not conducive to large-scale promotion. This solution is more suitable for the Internet access needs of large or expensive industrial equipment, but not suitable for low-priced equipment.
(2) Implementing Internet access by directly implementing TCP/IP protocol on embedded processors. This solution does not use an operating system, which greatly saves resources. However, it places high demands on processor performance, increases development difficulty, and is also difficult to implement technically. See Figure 2.
(3) Use a network monitoring system based on ARM Linux
This solution is similar to the second solution, but it only uses the embedded ARM Linux operating system and runs the TCP/IP protocol on the operating system. Currently, most embedded operating systems have a TCP/IP protocol stack, which reduces the difficulty of development and is more flexible to implement. Since the operation of the embedded operating system requires considerable processor resources and memory space, it also has high requirements for hardware configuration. The third solution can save development time and shorten the development cycle. The monitoring system generally also needs to configure an industrial computer or a high-performance microcomputer as a server at the control site to store intermediate data, process events with high real-time requirements, and respond to monitoring requests from the monitoring terminal.
2 Monitoring System Hardware Design
The network monitoring system based on ARM embedded system adopts TCP/IP network protocol standard, the system networking is simple, the data transmission volume is large, the speed is fast, and the whole system structure is simple. It is small in size and low in price. The remote computer can detect the equipment through the WEB browser without additional programs, and the application program is easy to develop and realize the complete sharing of information. In this system, ARM is responsible for program control and network communication, and the image and video acquisition module is responsible for data acquisition and processing. When the data or command data is transmitted, the ARM system processes the command and transmits the command data or displays it on the LCD. At the same time, the system is responsible for uploading the processing results through the network interface. After the system receives the data command, it drives the D/A output or processes the data according to the A/D input after algorithm processing, and then transmits the result to ARM. The system has the following basic functions: data acquisition, data analysis and processing, program control, and network transmission. [page]
2.1 ARM Video Surveillance Platform
The development platform of the video surveillance application system is shown in Figure 3. The system expansion slot and device expansion slot of ARM are used to add interfaces such as Ethernet interface, data storage interface and PCMCIA to the ARM system, or for other function development boards, which expand the CMOS image acquisition function and VGA display function for the ARM system.
Among them, the VGA interface realizes 4096-color display through a resistor network. The registers related to SRAM access are: SDRAM control register, read address low 16 bits, read address high 16 bits, read data register, write address low 16 bits, write address high 16 bits, write data register; the registers related to CMOS image acquisition are CMOS acquisition control register and CMOS acquisition status register; the register related to VGA display is VGA display control register. It has the following characteristics:
(1) Good real-time performance, which can meet the real-time requirements of data collection and data processing.
(2) High cost performance: the system cost should be as low as possible while meeting the requirements.
(3) Good controllability, capable of long-distance control and data transmission.
2.2 Data Acquisition Module
The video source signal comes from a highly integrated CMOS digital image sensor module MB86S20, which is a product of Fujitsu. MB86S02 not only integrates CMOS image sensor array, automatic gain signal amplifier, analog-to-digital converter, but also includes color signal processing and micro lens, including all front-end processing of image acquisition, and can directly output digital signals. The system block diagram of the module is shown in Figure 4.
MB86S02 is a sensor based on CMOS technology and uses active pixels. It has the following differences compared to traditional CCD sensors.
(1) Imaging process
CCD and CMOS use the same photosensitive material, so the basic principle of generating electrons after being exposed to light is the same, but the reading process is different: CCD transfers in frames or lines with the cooperation of synchronization signals and clock signals. The entire circuit is very complex and the readout rate is slow; CMOS reads signals in a manner similar to DRAM, with a simple circuit and a high readout rate. [page]
(2) Integration
The CCD readout circuit using special technology is relatively complex. It is difficult to integrate A/D conversion, signal processing, automatic gain control, precision amplification and storage functions into one chip. Generally, 3 to 8 chips are required to achieve this, and a multi-channel non-standard power supply voltage is also required. With the help of large-scale integrated manufacturing technology, CMOS image sensors can easily integrate the above functions into a single chip. Most CMOS image sensors have both analog and digital output signals.
(3) Power supply, power consumption and volume
CCD requires multiple power supplies, consumes a lot of power, and is relatively large in size. CMOS only needs a single power supply (3V~5V), and its power consumption is equivalent to 1/10 of CCD. Highly integrated CMOS chips can be made quite small.
(4) Performance indicators
CCD technology is already quite mature, while CMOS is in a period of rapid development. Although the image quality of high-end CMOS is not as good as that of CCD, some indicators (such as transmission rate, etc.) have exceeded CCD. Due to the many advantages of CMOS, many domestic and foreign institutions have applied CMOS image sensors to develop many products. This article mainly introduces the development status and latest development trends of commercialized CMOS image sensors, hoping to help the development of downstream products
The biggest advantage of CMOS technology is that each pixel unit can integrate one or more transistors, which has the advantages of low power consumption and miniaturization. It is very suitable for handheld devices and can reduce system power consumption and volume and improve battery efficiency. Its high degree of integration greatly simplifies the design of image application systems.
The main features of MB86S02 are as follows:
1/7-inch image sensor, effective pixel size 352×288, totaling 110,000 pixels;
Ultra-low power consumption 30mW@15fps;
Output 8-bit CMOS level parallel digital signal, YCbCr422 or YUV422 format;
Color signal processing includes: automatic gain, automatic exposure, automatic white balance, Gamma correction, etc.
Register settings through standard I2C serial interface;
Support CIF (352×288) QCIF (176×144) format;
CCIR656 standard head output;
Anti-flicker function; [page]
Low power mode;
Power consumption in power-down mode is 3μw;
The embedded processor reads the image data through the connection with the MB86S02 CMOS image module, stores it in the external high-speed SRAM through the synchronous SRAM interface, and then sends the stored image data to the PC through the UART module or RTL8019 module. Finally, the receiving program on the PC will display the received image. The buttons on the debug board can be used to select the functions of image acquisition, address reset, serial port sending, and network port sending.
3 Monitoring system software design
Figure 5 shows the ARM main program flow chart. The ARM processor obtains image information, executes the compression program, and transmits the compressed file to the monitoring host through the public telephone line. Since the system uses the same image resolution and constant table, the file headers are the same. In order to reduce the amount of transmitted data, the file header is not transmitted, and the file header is automatically added by the software on the monitoring host.
The system also uses a modem to establish a remote data connection through the public telephone network. The modem at the remote image monitoring terminal is in standby mode. It uses the "ATS0=3&D0W&W1" command to set the automatic answering mode. It automatically picks up the phone after three rings and establishes a connection with the caller after experiencing a "data storm". The modem in the monitoring center is controlled by the monitoring software to dial to establish a connection or hang up the connection.
After the data connection is established, ARM will receive the string "CONNECT", indicating that the communication line is successfully connected. At this time, the remote data connection established by the modem can be used just like a normal serial port. After receiving the acquisition command sent from the monitoring center, ARM completes image acquisition and compression processing in sequence, and then directly sends the image data to the monitoring center in the form of ASCII code through the serial port. After completing one operation, it waits for the next acquisition command.
In the application, it is necessary to receive image data from the MODEM and add a file header to it and store it on the local hard disk in standard JPEG image or MPEG video format. The image just received should also be displayed in the corresponding position of the dialog box, which requires a corresponding decoding program. You don't need to write it yourself. The Windows operating system includes support for JPEG or MPEG format. The MsCOMM control is Microsoft Communication Controller 6.0, which is included in VC 6.0. The serial communication port of the PC can be easily accessed through the MsCOMM control. Access to the MODEM is achieved through the serial port. The external MODEM is connected through the real PC serial port, and the built-in MODEM is controlled through a virtual serial port.
4 Conclusion
Video surveillance technology plays a vital role in the security of political, economic, military and cultural facilities. With the development of multimedia and computer network technology, video surveillance systems have gone through the development stages of analog surveillance and digital surveillance, and have now reached the stage of network digital video surveillance. The low-cost digital remote image monitoring system based on ARM processor is a highly reliable and efficient software and hardware work platform for embedded system development. It uses an integrated digital video acquisition module to directly obtain digital image signals; image compression does not use a dedicated compression chip, but is implemented by compression software inside the high-speed processor; and finally it is packaged and sent via the public telephone network.
This article focuses on the development and process of ARM embedded image video surveillance applications and provides solutions, establishing a low-development cost and easy-to-use embedded image video system. Using ARM embedded processors and Linux operating systems, a practical remote video surveillance system is developed, which is suitable for low-resolution, low-cost, and long-distance monitoring applications. Its main features and advantages are:
An ARM embedded processor development platform was built and a low-cost development process for embedded systems was proposed.
The front end uses an inexpensive integrated high-integration digital video acquisition module, which simplifies the design of the system front end and greatly reduces the front end cost.
Write simple embedded operating system programs, dynamically load applications, and speed up their execution.
Signal processing uses an embedded system built with a high-speed, high-performance ARM processor, and image compression is achieved through software.
Previous article:GSM Remote Monitoring System Based on ARM
Next article:Development of LCD display system for hybrid bus based on ARM
Recommended ReadingLatest update time:2024-11-16 21:33
Professor at Beihang University, dedicated to promoting microcontrollers and embedded systems for over 20 years.
- Innolux's intelligent steer-by-wire solution makes cars smarter and safer
- 8051 MCU - Parity Check
- How to efficiently balance the sensitivity of tactile sensing interfaces
- What should I do if the servo motor shakes? What causes the servo motor to shake quickly?
- 【Brushless Motor】Analysis of three-phase BLDC motor and sharing of two popular development boards
- Midea Industrial Technology's subsidiaries Clou Electronics and Hekang New Energy jointly appeared at the Munich Battery Energy Storage Exhibition and Solar Energy Exhibition
- Guoxin Sichen | Application of ferroelectric memory PB85RS2MC in power battery management, with a capacity of 2M
- Analysis of common faults of frequency converter
- In a head-on competition with Qualcomm, what kind of cockpit products has Intel come up with?
- Dalian Rongke's all-vanadium liquid flow battery energy storage equipment industrialization project has entered the sprint stage before production
- Allegro MicroSystems Introduces Advanced Magnetic and Inductive Position Sensing Solutions at Electronica 2024
- Car key in the left hand, liveness detection radar in the right hand, UWB is imperative for cars!
- After a decade of rapid development, domestic CIS has entered the market
- Aegis Dagger Battery + Thor EM-i Super Hybrid, Geely New Energy has thrown out two "king bombs"
- A brief discussion on functional safety - fault, error, and failure
- In the smart car 2.0 cycle, these core industry chains are facing major opportunities!
- The United States and Japan are developing new batteries. CATL faces challenges? How should China's new energy battery industry respond?
- Murata launches high-precision 6-axis inertial sensor for automobiles
- Ford patents pre-charge alarm to help save costs and respond to emergencies
- New real-time microcontroller system from Texas Instruments enables smarter processing in automotive and industrial applications
- Network communication---WiFi
- NSA Network Topology
- i.MX6ULL Embedded Linux Development 3-Kernel Porting
- [RISC-V MCU CH32V103 Review] + Use of TIM timer
- National Technology General MCU BOOT Interface Basic Instruction Usage Guide
- Chip Manufacturing 6-Chip Design
- EEWORLD University Hall ---- Comprehensive Experiment of Time Domain Testing Technology
- "【TGF4042 Signal Generator】" Signal Output Accuracy Measurement
- Core Route FPGA Learning Kit [ADV7123/GM7123 VGA Video Output Module] Schematic Diagram
- Thanksgiving is here. Who do you want to thank the most today?