Roadside perception research: integrated radar and vision, holographic perception, giants are making plans

Multi-sensor fusion is the main development trend of roadside perception

At present, roadside perception is mainly based on high-definition cameras and millimeter-wave radar solutions. In addition, the application of integrated radar and lidar is also gradually increasing. Multi-sensor fusion is the main development trend of roadside perception.

01. AI Vision Camera　

Using cameras with visual AI analysis capabilities on the roadside can more intuitively display the current traffic status and various detailed information. Currently, Huawei, Dahua, Hikvision, etc. have launched roadside AI cameras.

Huawei's AI ultra-low-light camera supports the open-architecture SDC OS, and can load third-party algorithms through the Huawei Algorithm Mall to achieve a truly "software-defined" camera. Huawei can increase the types of camera detection targets by adding algorithms. For example, to achieve non-motor vehicle perception detection, you only need to select an excellent non-motor vehicle video detection algorithm and load it into the front-end device or ITS800 edge computing node.

Huawei AI Ultra Low-Light Camera

Source: Huawei

02. Millimeter wave radar　

Suppliers are actively improving the performance of roadside millimeter-wave radars. Based on the wide-area radar front-end and advanced data processing technology, Huiershi has launched a new generation of wide-area radar microwave intelligent perception system, which can provide richer and more diverse data; Muniu Technology launched the WAYV series ultra-long-range millimeter-wave radar in 2020, with a maximum detection distance of 1,000 meters.

In addition, 4D imaging radar is entering the roadside perception market, which can achieve all-round, three-dimensional, and multi-dimensional monitoring and tracking of large intersections and highways, and is especially suitable for vehicle-road collaborative holographic perception at large-scale complex intersections and mixed traffic in cities. Currently, manufacturers such as Continental, Huawei, and Aokoo that are engaged in roadside perception have launched 4D millimeter-wave radars.

AOKU 4D millimeter wave imaging radar

03. LiDAR　

LiDAR can obtain high-precision three-dimensional information of the target, perform electronic fence control, and independently implement some specific functions (target filtering, customized communication, etc.) in specific areas.

Traditional roadside perception solution providers such as Wanjie Technology, Xidi Intelligent Driving, and TransInfo Technology have launched roadside lidar products. In March 2021, Wanjie Technology successfully deployed a smart base station integrating V2X roadside antennas and lidars in the Xiong'an Citizen Center V2X demonstration project and the high-speed rail hub road intelligentization project.

In addition, automotive-grade lidar suppliers such as RoboSense and Ouster have also begun to penetrate the field of roadside perception. In 2020, Ouster cooperated with Liangdao Intelligence to create a lidar-based roadside solution.

Wanji Technology LiDAR Roadside Perception System

Source: Wanji Technology

04. Thunder and vision integration　

The integrated radar and vision machine adopts an integrated design, shared power supply, and unified installation, which can effectively save material costs and installation costs. In addition, the integrated radar and vision fusion machine moves the perception fusion algorithm to the end side, greatly reducing the perception delay and computing pressure on the edge side, while using the respective advantages of video and radar to improve the accuracy of the target.

At present, Dahua Technology and Hikvision, which are engaged in high-definition roadside vision, and Rayson Electronics, Huiershi, and Deguanlong, which are engaged in roadside millimeter-wave radar, have successively launched integrated radar and vision machines. Among them, Aoku launched a 4D integrated radar and vision machine in 2019, which uses the company's first-generation point cloud imaging radar Falcon; Rayson Electronics also plans to launch a new generation of integrated radar and vision machine IET6LRR in the second half of 2021, with a maximum ranging range of 425 meters.

Major Suppliers of Integrated Lightning and Vision/Lightning and Vision Fusion Solutions

Source: Zoss Automotive Research

Huawei, Baidu and others join the game and launch the "Holographic Perception Intersection" solution

Holographic perception is the underlying foundation for the development of smart roads, and roadside perception equipment is required to provide comprehensive, high-quality, and stable traffic data. Since 2020, Huawei, Baidu, Urawa Data, and Jicui Perception have successively launched holographic perception solutions.

Huawei: In 2020, Huawei released the Holographic Intersection 1.0 solution. In March 2021, Huawei further launched the Holographic Intersection 2.0 solution, which uses a combination of AI ultra-low light card port + millimeter wave radar + ITS800 edge computing node + intersection high-precision map, suitable for crossroads, T-junctions, X-shaped, T-shaped, Y-shaped, interchanges, super-large intersections, etc. Huawei will also build a holographic road section solution based on the holographic intersection in the future, realize the convergence access and analysis and communication capabilities of intersections and roadsides through edge computing units, connect traffic signals and vehicle communication units, and lay the foundation for vehicle-road collaborative services such as precise public transportation and assisted driving.

Huawei Holographic Intersection Solution 2.0

Source: Huawei

Baidu: In March 2021, Baidu launched the Baidu ACE Intelligent Intersection Solution, which realizes the perception of all factors such as road vehicles, roads, pedestrians, environment, and traffic events by deploying camera cameras, fisheye cameras, lidar, edge computing and other perception and computing equipment on the roadside, and integrates the data with Baidu Maps to make the data detection accuracy greater than 97%. ACE Intelligent Intersection is the specific application of Baidu ACE Intelligent Traffic Engine (a full-stack intelligent traffic solution integrating vehicles, roads and pedestrians) in traffic intersection scenarios.

In Baidu's ACE smart intersection solution, cameras, lidars, communication equipment, edge computing units, etc. are all customized by Baidu and its ecological partners.

Integrated perception: The original data from cameras, lidar, millimeter-wave radar, and radar-vision integrated devices are deeply integrated on the roadside to achieve 360° image-level holographic perception capabilities around the clock, with a detection distance of up to 500 meters, providing more reliable data for urban intersections.

Integrated Perception Deep Sea-1 Holographic Perception Solution Architecture

Source: Jicui Perception

In addition, Hikvision Intelligent Network has also achieved holographic intersection perception through millimeter-wave radar, cameras, and image-level solid-state lidar; Urawa Data deployed the holographic perception device "BotEye™ Holographic Eye™" in the 2020 "New Four Cross-Border" event test park.

The roadside sensing market will reach 20 billion yuan in 2025

Intelligent roadside sensing will first cover highways and urban intersections. According to official statistics, the current length of national highways is 149,600 kilometers, the overall average density of the road network in 36 major cities is 6.1 kilometers per square kilometer, and the urban construction area of ​​36 major cities is 21,000 square kilometers.

According to the forecast of Zos Automotive Research Institute, the market size of China's intelligent roadside perception equipment (including RSU, camera, millimeter-wave radar, lidar, and integrated radar and vision equipment) will reach about 20 billion yuan by 2025. Among them, cameras and millimeter-wave radars will still be the mainstream equipment used for roadside perception, and integrated radar and vision equipment and lidar will also show significant growth.

China's intelligent roadside perception market size from 2020 to 2025

Source: Zoss Automotive Research

The main contents of the "2021 Smart Road-Roadside Perception Industry Research Report" include:

Support policies, industry standards, and industrial planning for the smart road industry;

Analysis of market size and market structure of intelligent roadside sensing;

The development status and trends of key technologies such as high-definition cameras, millimeter-wave radars, integrated radar and vision devices, lidar, and multi-sensor fusion;

Case analysis of roadside sensing equipment deployment at highways and urban intersections;

Analysis and research of major roadside perception system integrators and equipment suppliers.

Table of contents　

"2021 Smart Road-Roadside Perception Industry Research Report"

　This report has 240 pages　

01. Roadside sensing guidance policies and technical standards

1.1 Smart Road Policy Guidance

1.1.1 National guiding policies in the field of intelligent transportation

1.1.2 Classification of Intelligent Highway Technologies

1.1.3 Correspondence between Smart Highway Technology Levels and Autonomous Driving Classifications

1.1.4 Smart Highway Development Plan

1.1.5 5G Smart Highway Construction

1.2 Construction of intelligent roadside standard system

1.2.1 Latest progress in roadside standard construction in 2020-2021 (1)

1.2.2 Latest progress in roadside standard construction in 2020-2021 (2)

1.2.3 Construction of intelligent roadside standard system

1.2.4 Standardization Process of Vehicle-Road Collaborative Autonomous Driving 2020-2024

1.2.5 Evaluation Content and Standards of Smart Highway Pilot Projects

1.2.6 Smart highway engineering infrastructure standards are gradually improving

1.2.7 Overall Industry Framework for Smart Highway Construction (1)

1.2.8 Overall Industry Framework for Smart Highway Construction (2)

1.2.9 Overall Industry Framework for Smart Highway Construction (3)