[Renesas GUI Challenge] Substation Inspection Robot Control System Development

1. Project development background:

1. The 21st century is the era of the Internet and the use of intelligent robots to replace patrol security to complete monotonous and indispensable inspections is the trend of the future.

2. Substations are mostly located outdoors, and manual inspections have the disadvantages of complex roads, shrubs, flower beds, and sculptures everywhere, which easily form blind spots for public security. Ordinary manual inspections are prone to missed inspections and wrong inspections, especially at night when people are sleepy and tired. It is common to miss important routine inspections due to human factors;

3. When inspecting power equipment, it is difficult for humans to detect equipment anomalies or sense temperature anomalies, and personnel are not sensitive to fire detection.

4. Advantages of inspection: Since robots are not prone to fatigue, negligence, and mistakes, the inspection time, inspection route, and alarm plan can be set in advance, so that inspections can be carried out on time, the entire route can be covered, and the scanning function of blind spots can be enhanced. The use of AI technology can detect abnormal situations in real time through image analysis.

2. Project Objectives

1. This robot has a detection function. It can sense high-temperature areas that are not easy for people to find, and detect signs of fire to provide early warning. The robot transmits data to the local or remote end in real-time dual-mode reliability through WIFI6 technology. The PC or smart mobile device can monitor and control the operation of the robot in real time.

2. The intelligent inspection robot is an automatic early warning system that can automatically take pictures, record, and monitor remotely over long distances and in all directions (it can be expanded to include temperature and humidity, smoke, and noise monitoring alarms, video image analysis, and dangerous pattern recognition, etc.). It can provide the collection of movable dynamic video images to the maximum extent, realize preset positions and cruise line functions, and realize centralized management and control with other video surveillance systems. The system design meets the national regulatory management requirements.

3. The control protocol, video codec, protocol, video file format, and transmission protocol all comply with national standards; from the selection of components and parts to the specific implementation plan, the system reliability issue is taken into consideration.

4. This project uses the RA6 series as the main control to receive RTK positioning information. RTT-HMI-Board is the robot human-machine interaction control center. It allows the robot to perform real-time image analysis and face recognition with or without network connection. The advantages of terminal-side artificial intelligence include instant response, enhanced privacy protection and improved reliability.

3. System Architecture

4. GUI interface

Description: WiFi or LAN connects to the robot via IP handshake, user name login, permission control, and the robot starts inspection after setting.

Development environment: Studio+ +e2 studio+fsp_v4_4_0
The GUI components of LVGL mainly include Lable(), Button, Image, Image Button, Keyboard, Calendar, Chart, etc.