Smart cockpits have entered the era of large models, and voice remote control interaction will soon become a thing of the past

On May 23, Baidu’s Apollo automotive intelligent business demonstrated the results of its new generation AI smart cabin exploration based on the Wenxin large model. It is reported that this is the first domestic exploration of the application of large models in the automotive industry, and is expected to promote mass production in the future. Baidu Apollo innovatively demonstrated that based on the capability exploration of the Wenxin large model, the smart cabin will have multiple capabilities such as conversational interaction in travel scenarios, logical reasoning, strategic planning, and knowledge question and answer. It also demonstrated the imperative interaction of the current smart cabin. It provides the ultimate experience of multi-sound zones covering the entire car, millisecond-level response, and full-time interaction without waking up.

The exploration of these forward-looking results allows industry users to truly feel that the conversational interaction revolution based on large language models is coming! Each car will be equipped with an AI all-round assistant that understands the user better and better meets the needs of every driver and passenger.

Efficient iteration and ultimate command-based interactive experience lead the industry

Baidu Apollo demonstrated its latest mass-produced voice product experience. Xiaodu's in-vehicle voice SDK is based on large-scale model localization and continues to promote the ultimate interactive experience in the cockpit. Smooth wake-up-free multi-channel simultaneous interaction, what is seen and said on the whole page, and millisecond-level response in the whole area make users feel like they have a personal assistant on call at any time. Everyone can have a smooth interactive experience at the same time.

In particular, the true multi-channel simultaneous dialogue capability supports up to 8 channels of simultaneous interaction and precise processing, covering the entire cockpit inside and outside, and can achieve the ultimate challenge of multi-channel simultaneous, fast, and continuous dialogue. Everyone sitting in the driver's seat, passenger seat, and back row can put forward their own demands at the same time. The voice assistant can not only identify the needs of users in different positions and solve them in sequence, completely getting rid of the family travel troubles of one person talking and the whole family shutting up. .

Intelligent cabin + Wenxin large model is the first domestic large model to be put on the bus to explore the results

Baidu Apollo also shared the country's first exploration results based on Wenxin large-scale models in vehicle scenarios, looking forward to conversational interactive vehicle voice products. Based on Wenxin's large model capabilities, Baidu Apollo conducts special training and model fine-tuning for vehicle scenarios. Without the need for manual data annotation, AI will have better language understanding and learning capabilities. In the future, smart cabins supported by large models will have multiple capabilities such as conversational interaction in travel scenarios, logical reasoning, strategic planning, and knowledge question and answer, allowing in-car assistants to have the ability to communicate with users like real people in the future, and can understand and satisfy users. The deep-seated needs of users in the car scene.

1. Early adopters of travel scene functions: the intelligent planner meets users’ travel needs in one stop

During the journey, Xiaodu's in-car voice can help you plan your trip and recommend food spots and food along the way; whether it is knowledge questions and answers or understanding of traditional culture, Xiaodu can give you satisfactory answers. When the family travels, inspirational drawing can play a role in entertaining and accompanying children. It is like a children's educational assistant, recording children's wild imagination. Just use one sentence to describe the content of the painting you want, and the AI ​​can complete a creative painting in a few seconds.

Super chat for trip planning

Inspired drawing becomes a children’s educational assistant

2. Try out car usage scenarios: a personalized AI consultant who understands both cars and you

At the same time, Baidu is also exploring how to use Wenxin’s large model capabilities to reshape the personalized driving space. In the future, the ever-changing personality function can customize personalized voice assistant personalities for different scenarios and different user characteristics and preferences to communicate emotionally with users. Users can also have a car consultant, abandoning outdated product manuals. Users can learn about vehicle functions in detail anytime, anywhere, and get information about their car at the first glance.

Variety of characters: personalized voice assistant

AI new car shopping guide function

3. The future paradigm of the third living space: large models are integrated into smart cabin scenarios to explore and meet the deep needs of users.

It is foreseeable that with the continuous innovation and iteration of large language model technology in the future, after large models are integrated into smart cabin scenarios, Baidu Apollo smart cabin will also evolve into the core carrier of the "third living space". We can rely on voice assistants to complete the circle of friends You can write copy, take photos of scenery along the way and send them to your phone with one click. You can also ask the voice assistant to complete the day's schedule and meeting reservations while driving. This intergenerational innovation in conversational human-computer interaction makes cars equipped with emotions and intelligence, like an AI voice assistant that understands you better, meeting users' deeper in-car needs.

We are currently in an era of drastic changes in the automobile industry. Intelligence has become an important factor in differentiation of automobile brands, and smart cabins are the smart car configuration that users are most likely to perceive at this stage. Baidu Apollo has always helped OEMs build intelligent competitive advantages. Its intelligent automotive solutions have been mass-produced on 134 models of 31 automobile brands, with a cumulative installation of more than 7 million vehicles.

In the future, Baidu Apollo will use Wenxin's large model capabilities to achieve smoother, more natural and more intelligent conversational human-computer interaction, help car companies win intelligent racing competitions, accompany car companies with a more open attitude, and help car companies create A good smart car will win the second half of smart cars.