Article count:1109 Read by:1582604

Account Entry

The integration of radar and vision opens a new era of advanced intelligent driving

Latest update time:2024-06-06
    Reads:

To join the "Smart Car Expert Automotive Radar Industry Exchange Group", please add 18512119620 (same as WeChat), and note company-name-position to join the group



Recently, JAC Group held a centralized display of its core intelligent technology achievements during the celebration of its 60th anniversary. During this period, Geometry, a partner working hand in hand with JAC Group, also had a "show of style" with its overall intelligent driving solution built around the "vision + 4D millimeter wave imaging radar" dual-dimensional heterogeneous information fusion perception technology route.

How this technology route is currently developing, what is the technical logic behind it, and whether it can become a new breakthrough solution for OEMs in the future have become the focus of heated discussion in the current industry.


Ray (4D imaging) visual fusion:

A new option with all-weather and all-day capabilities



\

In recent years, the discussion on the "pure vision" perception route has remained hot, but at the same time, facing the trend of intelligent driving gradually evolving towards a higher level, the multi-sensor fusion perception technology route has become more and more a consensus in the industry. Although each type of sensor has its own advantages, it has to be admitted that the performance of a single sensor in complex scenarios has certain limitations, especially high-level intelligent driving requires vehicles to have the ability to cope with extreme weather and all-weather complex environments. Only by using the information complementarity and iterative development of different sensors such as cameras, millimeter-wave radars, lidars, and ultrasonic radars can the robustness and safety of the perception system be improved.

How to combine these sensors to achieve the best effect? ​​The current mainstream solutions in the industry are mainly the following two: one is "vision + lidar + ultrasound", and the other is the combination of "vision + 4D millimeter wave imaging radar".

As a high-tech enterprise and specialized enterprise deeply engaged in intelligent driving technology, Geometry Partners has been adhering to the mission of "providing safe and effective methods for large-scale mass production of intelligent/autonomous driving and connected vehicles" for 5 years since its establishment. Starting from solving the pain points such as perception bottlenecks faced in complex intelligent driving scenarios, it has developed a high-resolution 4D millimeter-wave imaging radar, combined with vision, and designed a "vision + 4D millimeter-wave imaging radar" two-dimensional heterogeneous information fusion perception technology route to create an intelligent driving solution with differentiated advantages of " multimodal, all-weather, low-cost, and easy to mass produce ", achieving better performance and better driving experience. A series of high-end intelligent driving functions such as city NOA , intercity NOA, memory driving, memory parking, and autonomous valet parking have successfully entered the vision of many OEMs.

Among them, the result of the joint development of Geometry Partners with JAC Group based on its needs - a high-level driving assistance system with urban NOA as the core function , based on the 11V6R system solution and high-level intelligent driving algorithm and all-round safety redundancy strategy, which can not only cope with conventional NOA scenarios, but also safely and efficiently handle complex working conditions such as left-right turn games, mixed traffic of people and vehicles, avoiding vehicles cutting in, special-shaped obstacles, and ghost heads. In addition, the system expands the adaptability of intelligent driving application scenarios to all-day and all-weather range, and can realize driving and parking functions in various complex weather conditions such as rain, snow, fog and haze, bringing users a better urban NOA experience.

▲Geometry Partner stationary vehicle recognition and “ghost head-on” recognition

The second is high- and low-dimensional obstacle recognition: based on the perceived data, it can accurately identify the entire environment around the vehicle, including high-altitude obstacles such as elevated signs and street lights, and low-altitude obstacles such as speed bumps, ground cracks, cones, and manhole covers, thereby improving the safety of intelligent driving.

▲Geometry Partner realizes SLAM in indoor and outdoor scenes based on 4D imaging radar point cloud

The second secret lies in BEV + Occupancy.

Based on the hardware sensor configuration, Geometry Partner also matches an intelligent and efficient algorithm architecture solution to realize high-level intelligent driving functions such as urban NOA. The system architecture builds a general perception model based on the cutting-edge technologies of BEV and Occupancy, extracts point cloud information from 4D millimeter wave imaging radar and visual semantic information through feature fusion, and realizes cognitive understanding of dynamic and static environments.

相较于其他的架构,该架构创新性的采用 360°雷(4D)视BEV特征融合+规则的混合技术 ,显著提升动态障碍物的感知能力;针对不在白名单内的障碍物感知问题,进一步采用 雷视融合Occupancy框架 ,能够智能地识别和分类各种障碍物,确保系统在面对白名单外的障碍物时,依然可以做出快速而准确的响应, 显著提升全域通用障碍物的感知性能


▲Geometry Partner Space parking detection

In terms of cost, thanks to the low-cost advantage of 4D millimeter-wave imaging radar, Geometry Partner's integrated advanced assisted driving system can further reduce costs compared to other solutions, creating a more cost-effective intelligent driving solution for customers.

It is undeniable that as a disruptive innovative technology, autonomous driving still has many technical challenges to overcome, but with the support of "password" and the continuous iteration of technology, the cost-effective intelligent driving system of Geometry Partners will accelerate the full coverage from mid-to-high-end to economical models , promote equal rights for intelligent driving, realize the social value of intelligent driving, and allow more ordinary consumers to enjoy advanced intelligent driving functions.


An "accelerator" for the mass production of high-end intelligent driving



\

At present, products based on the "vision + 4D millimeter-wave imaging radar" dual-dimensional heterogeneous information fusion perception technology route have brought new ideas and more possibilities to the field of intelligent driving because of their advantages in line with current market demands.

Under the brand strategy of "leading intelligence with intelligence", a number of passenger car models under JAC Group are also jointly developing intelligent driving solutions based on this technology route with Geometry partners, and have formed long-term exchanges and cooperation.

As the attention to this technology route continues to increase and the technology of Geometry's partners becomes more mature, in addition to SAIC, FAW, JAC, Xiaomi, and Jidu, more and more OEMs are choosing to work with Geometry's partners to jointly explore the best implementation solutions for advanced intelligent driving functions such as Urban NOA.

We should take a long-term view. We believe that with the verification of many OEMs, the technology route of 4D-vision fusion will be an "accelerator" to promote the mass production of high-end intelligent driving. Geometry partners will continue to leverage their own technological advantages to help more OEMs realize the popularization and application of high-end intelligent driving functions and promote the transformation and upgrading of the automotive industry.

Those who travel far will eventually see the stars; those who seek light will surely welcome the dawn...

About Geometry Partners

Founded at the end of October 2018, Geometry Partners is a high-tech and specialized enterprise integrating the research and development, manufacturing, sales and ecological construction of autonomous driving software and hardware products. It brings together outstanding technical experts and teams from the fields of automotive sensors and autonomous driving at home and abroad.

Since its inception, the company has innovatively used 4D millimeter wave imaging radar as one of the core sensors, combined with visible light vision, infrared imaging and other sensors to create an all-weather fusion perception system, and based on this, developed a full-stack autonomous driving system software that integrates perception, decision-making, planning and control, and can provide L2+ to L4 autonomous driving software and hardware integrated systems and overall solutions based on machine perception and deep learning. For more information, please visit www.geometricalpal.com.



Latest articles about

 
EEWorld WeChat Subscription

 
EEWorld WeChat Service Number

 
AutoDevelopers

About Us Customer Service Contact Information Datasheet Sitemap LatestNews

Room 1530, Zhongguancun MOOC Times Building,Block B, 18 Zhongguancun Street, Haidian District,Beijing, China Tel:(010)82350740 Postcode:100190

Copyright © 2005-2024 EEWORLD.com.cn, Inc. All rights reserved 京ICP证060456号 京ICP备10001474号-1 电信业务审批[2006]字第258号函 京公网安备 11010802033920号