Co-create the future of chips | Collection of first-prize winning embedded design competition works based on STM32 (3)
▲ Click above to follow STM32
This issue displays 10 works in total , all of which are Embedded Artificial Intelligence Applications Competition topics .
-
The overall structural design uses sliding modules to replace traditional robotic arms, simplifying the structure, reducing costs and expanding the picking coverage;
-
Improved detection algorithm model, based on YOLOv5 and introducing attention mechanism and optimized loss function, which improves detection accuracy and bounding box positioning accuracy;
-
The flexible gripper is equipped with a pressure sensor, which can accurately grip fruits of different sizes through feedback control to prevent damage to the fruits.
-
The integrated binocular vision stereo matching algorithm obtains three-dimensional position information and achieves high-precision spatial positioning.
This work uses STM32F407ZGT6 as the main control chip and adopts three control modes. The first is to clean the entire piece of glass. Openmv scans the environment for path planning and transmits data to the main control chip. The chip controls the robot to walk the entire piece of glass. In the process of the robot moving, the ultrasonic module and infrared module are used to analyze obstacles and the gyroscope is used to detect the direction of the robot. The PID algorithm is used to adjust the direction to achieve obstacle avoidance; the second method is to use openmv for target point detection and real-time monitoring of the glass. If the glass is detected to be dirty, the local dirty point is located and the robot is started to move towards the mark point. This working mode can save a lot of power consumption and keep the glass clean and tidy; the third method: add a Bluetooth module and make a Bluetooth mobile phone app to achieve remote control. It is convenient for users to meet special cleaning requirements. There are also four micro switches on the head of the robot as a protection solution. If the ranging module cannot work under special circumstances, the robot will touch the micro switch when it walks to the edge of the glass window, and the main control chip will realize the steering of the robot through external interrupts. This work uses tracked drive wheels, rubber bottoms, large torque, strong driving ability, and will not damage the glass. It uses a special vacuum suction cup with strong adsorption capacity, and it balances the difficulties of the robot in adsorption and movement well, and can adapt to a variety of environments.
-
Combine Openmv with the window cleaning robot, use path planning technology, image recognition technology with ultrasonic ranging algorithm to accurately locate the dirty spot and control the window cleaning robot to move to the target point. This work does not require an external power cord, and uses a 12V lithium battery to power the entire window cleaning robot. The entire system realizes all functions with low power consumption;
-
Three modes are set, and a real-time monitoring mode is added when the entire glass can be cleaned, so that the entire glass can be scanned and fixed-point cleaned, which reduces the complexity of work and improves work efficiency;
-
Wireless communication (mobile phone app), the window cleaning robot is equipped with a Bluetooth module. Within a certain range, users can directly use the mobile phone APP to remotely control the window cleaning robot according to their needs. Different from WIFI , it avoids the problem of conflict when the window cleaning robot is connected to multiple users at the same time;
-
The robot can not only clean windows, but also be used as a wall-climbing robot on flat walls to enter and explore environments that are difficult or dangerous for humans, such as mines and ceilings , for survey and inspection. It can also be used for rescue and relief, helping search and rescue personnel obtain key information or find trapped people.
This work is a novel pipeline transportation detection system, which consists of a detection subsystem and a transportation subsystem. The detection subsystem is mainly composed of a flow meter, a flow meter and a water level meter. Based on
the STM32H750VBT6 main control chip,
NanoEdge AI Studio is used to train the flow, flow velocity and water level data to monitor whether the pipeline is leaking and whether the transportation status is normal. The transportation subsystem mainly transports the cargo by controlling the water pump and the water valve. In terms of parameter viewing and parameter adjustment, the project uses the Alibaba Cloud platform, the STM32F746G-DISCO development board with TouchGFX for graphical display, and a self-made WeChat applet. The system data can be monitored and controlled on the PC, offline and mobile terminals, greatly improving the efficiency of transportation management. And add a fingerprint punch-in system to make the system more formal.
-
Use a single pipeline system to detect the transported substances and realize the function of transporting multiple substances through one pipeline;
-
The system uses NanoEdge AI for edge artificial intelligence development, and through Hall sensors and algorithms, it realizes the function of real-time tracking and detection of transportation pipelines;
-
The system uses TouchGFX to develop the GUI interface, which makes the GUI interface more interactive, the display of data images smoother, and the pipeline transportation status can be observed intuitively;
-
The designed pipeline transportation system is divided into multiple small nodes. By monitoring each small node pipeline, the damaged position of the pipeline can be quickly located.
This work is an intelligent logistics system developed based on STM32H7 series and OpenMV, which can improve the efficiency and accuracy of logistics management. This system is based on STM32H723ZG. The mechanical structure of the car is designed with the help of Solidworks software and the physical printing is carried out using the 3D printing platform. The program design of the mobile control part of the car is carried out through Keil software. The OpenMV machine vision module is used as the upper computer to communicate with the microcontroller as the lower computer. The system includes a vision module, a controller module, a motor drive module, a serial port display module, a funnel carrier module, and a servo flip module.
Main innovations
-
Informatization: Through the application of information technology, the informatization management of logistics activities is realized, including the use of barcodes, RFID, sensors and other technologies to collect various information in the logistics process;
-
Automation: Use automated equipment, such as automatic sorting machines, automatic handling robots, automated warehouses, etc., to reduce manual intervention and improve operational efficiency and accuracy;
-
Networking: The intelligent logistics system realizes the real-time sharing and transmission of logistics information through network connection, so that logistics activities can be coordinated and managed on a wider scale;
-
Intelligence: The system uses artificial intelligence technologies, such as machine learning, deep learning, and expert systems, to intelligently analyze logistics data, optimize the decision-making process, and achieve intelligent scheduling and prediction;
-
Integration: The intelligent logistics system integrates multiple processes such as logistics, information flow, and capital flow to achieve optimal resource allocation and coordination of business processes;
-
Visualization: Through GIS (Geographic Information System), logistics management system, etc., the logistics process can be visualized and monitored, so that managers can grasp the logistics status in real time;
-
Real-time: Using IoT technology, the intelligent logistics system can collect and process logistics information in real time and respond quickly to market demands and changes.
-
Sensor application: The temperature and humidity sensor detects the temperature and humidity when the chestnuts move, making the system design more stable and accurate;
-
Integrated design: The multifunctional chestnut shell peeling machine is a device that integrates chestnut peeling, cleaning, drying, weighing and packaging. It increases the efficiency of chestnut peeling, improves the cleaning rate, reduces manpower and material resources, and completes the deep processing of chestnut products.
-
User interaction interface: Remote monitoring and control are achieved through mobile phone APP. Through hardware debugging and software debugging , the system performance is continuously optimized to ensure that the expected design requirements are met.
-
The physical prototype of the intelligent pen cleaning robot for large-scale breeding farms has a novel structural design, which can be flexibly adjusted according to the architectural form of the livestock and poultry pens and meet the work requirements of pen cleaning;
-
According to the current status of livestock and poultry breeding and the requirements of cleaning robot operations, two working schemes, autonomous operation and remote control, are designed: in the autonomous operation mode, sensors and single-chip microcomputers are used in combination, and in the remote control mode , Bluetooth modules, ESP32 Internet of Things modules and single-chip microcomputers are used in combination;
-
The physical prototype of the work has a good test effect. It integrates the functions of walking, manure collection and storage, and control type. All functions can be well realized, and the body structure meets the work needs.
Tablet defect detection is a key link in the tablet production process. This project is based on the STM32H7 series, using computer vision and machine learning to achieve image processing. By deploying the CNN network to the system board, it can classify tablet contamination and defects, realize the detection function, and deploy the model through the STM32Cube.AI software tool; in terms of hardware, a CMOS camera is used to take pictures and realize image data transmission and AI model reasoning, and finally a conveyor belt module is used to realize automatic identification and sorting of tablets. Compared with manual inspection, this project can greatly improve the efficiency and accuracy of tablet inspection.
-
Using CNN (convolutional neural network) deep learning, compared with general machine learning that can only distinguish the normal and defective states of one tablet, the deep learning model can identify the normal and defective states of multiple tablets, improving applicability;
-
The conveyor belt is used to simulate the working mode of the assembly line, which realizes the automation of tablet sorting and improves the efficiency of inspection.
-
Strong load capacity and high safety: The robot suspension system is installed on the top floor of the building. It bears the weight of the robot body and the weight of the stable adjustment system through steel wire ropes and negative pressure adsorption. Compared with the traditional pure adsorption wall-climbing robot, it has stronger load capacity and greater safety.
-
Large-scale spraying: The robot body mainly includes a plumb climbing mechanism and a spray gun horizontal movement mechanism, which are used to control the crawling of the robot body on the exterior wall and the horizontal movement of the spray gun to achieve large-scale spraying of the exterior wall;
-
Autonomous operation is possible: The spraying wizard can change its spraying path by changing its code settings, and achieve autonomous personalized spraying.
-
The use of independently innovated visual algorithms improves the automation and high precision of inspections;
-
Design a wireless communication buoy to avoid the problem of severe attenuation of electromagnetic waves underwater;
-
Deploy the model to the STM32H743 chip to implement embedded artificial intelligence.
Main innovations
-
The whole machine adopts bionic architecture design to ensure that the robot can perfectly reproduce the operator's control, better control the robot and design actions to meet various industrial production needs;
-
The modular design allows even untrained personnel to assemble the robot arm based on simple diagrams;
-
The motion path trajectory optimization design based on deep learning enables the robot to move along the optimal path, which is consistent with the movement logic of the human body.
-
Multi-module control strategy, including remote joystick, voice, inertial navigation, and electromyography, adapts to more production service scenarios;
-
CANBUS is used for internal communication during the process, and ESP32 is used to access the Internet for remote communication. Multiple communication methods coexist, which is in line with production scenarios.
*Disclaimer: All videos and work introductions in this article are from the 2024 7th National Undergraduate Embedded Chip and System Design Competition Application Track student submissions, and are produced by students themselves. STMicroelectronics' display of winning works is only for the purpose of displaying the contestants' works and bringing more creative inspiration to developers, and has been approved by the organizer. STMicroelectronics does not assume any legal responsibility for the content of the works or the fonts in the videos. If you have any objections, please contact STM32 Customer Service (WeChat ID: STM32_01).
© THE END