Bosch launches new in-car monitoring system, smart camera makes drivers and passengers safer!

Lack of sleep, distraction, and not wearing seat belts can all have serious consequences for the safety of drivers and passengers. To avoid dangerous driving and possible road accidents, future vehicle sensors will not only need to sense external road conditions, but also need to pay attention to the status of drivers and passengers in real time. To this end, Bosch has developed a new in-vehicle monitoring system that combines cameras and artificial intelligence.

Harald Kroeger, a member of the Bosch Group's board of directors, said: "When the vehicle can accurately sense the status of the driver and passengers, driving will become safer and more convenient." The system is expected to go into production in 2022. By then, the EU will also make safety driving technologies such as driver fatigue and distraction warnings standard for new cars.

The European Commission estimates that by 2038, the new vehicle safety standards will save more than 25,000 lives and avoid more than 140,000 serious road accidents. Real-time monitoring of the in-car situation can solve the safety issues of autonomous vehicles at the source. For example, on the highway, if an autonomous vehicle wants to hand over driving control to the driver, it must ensure that the driver is not in a state of micro-sleep, reading newspapers or sending emails on a smartphone.

(Bosch and Mercedes-Benz officially launched the autonomous taxi pilot project in San Jose)

Smart cameras monitor drivers in real time

If the driver falls asleep or looks at his phone for 3 seconds, a vehicle traveling at 50 kilometers per hour will travel 42 meters without supervision. However, many people underestimate the risks involved. International studies show that nearly one in ten road traffic accidents is caused by driver distraction or fatigue. To this end, Bosch has developed an in-vehicle monitoring system that can detect and warn of such risks while providing vehicles with driving assistance functions.

The camera on the vehicle's steering wheel can monitor the driver's drowsiness, distraction, and turning his head toward the passengers and the back seat in real time. Relying on artificial intelligence, the system can analyze video information and make correct judgments: according to relevant laws and regulations and the requirements of automobile manufacturers, the system can issue warnings to distracted drivers, suggest that fatigued drivers take a break in time, and even rely on the automatic driving system to help the vehicle slow down.

Harald Kroeger said: "Cameras and artificial intelligence can make drivers and passengers safer." To achieve this goal, Bosch engineers use intelligent image processing algorithms and machine learning to let the system understand the actual state of the driver. Taking driver fatigue monitoring as an example, the in-vehicle monitoring system can combine real-time driving conditions, record information such as eyelid position and blinking frequency, and judge the driver's fatigue level. Therefore, the system can issue warnings in a timely manner and use the driver assistance system to intervene effectively in time.

The European New Car Assessment Program (Euro NCAP) plans to include driver fatigue and distraction warnings in the vehicle safety assessment system by 2025. This also proves that this warning is crucial and can effectively improve driving safety. In terms of data security, only the vehicle's built-in software has the right to evaluate the information provided by the in-vehicle monitoring system. This information will neither be stored nor disclosed.

Transfer of driving control between vehicle and driver

With the development trend of automation, it is particularly important to grasp the driver's status in real time. Once the vehicle starts to drive automatically, the car will travel on the highway without driver intervention. However, in special scenarios such as construction areas or ramps, the vehicle must return control to the driver in a timely manner. The driver needs to be ready to take over the vehicle at any time. The camera in the car is used to monitor the driver's real-time status: once the driver is in a micro-sleep, the early warning system will automatically sound an alarm. In addition, the system can also analyze the camera's records to determine whether the driver's current state is suitable for controlling the steering wheel, thereby determining the appropriate time to transfer control.

Harald Kroeger added: “Driver monitoring systems developed by Bosch are crucial for ensuring the safety of automated driving.”

(Mercedes-Benz S-Class sedan equipped with Bosch and Mercedes-Benz driving systems and software)

In-car cameras focus on passenger safety

The new in-car monitoring system not only pays attention to the driver, but also to other passengers in the car. To this end, the camera installed above or below the rearview mirror can monitor the entire cabin. When a child in the back seat accidentally unfastens the seat belt, or a rear passenger leans forward too far or puts his feet on the seat next to him, causing the airbag and seat belt pretensioner to fail to provide proper protection in the event of an accident, the monitoring system will promptly warn the driver. The system can effectively identify whether the passenger is in a position or posture where the airbag and seat belt pretensioner can provide the best protection. In addition, when a baby carrier is placed in the car, the in-car monitoring system can also prevent the airbag from deploying in the passenger seat.

According to statistics, parked vehicles are likely to be the culprit for children's deaths. In 2018 alone, more than 50 children in the United States lost their lives because they climbed into the cabin without supervision or were left in the car for a short period of time. Bosch's in-car monitoring system can effectively identify such dangers and send timely push reminders to parents' smartphones; in an emergency, the system will also automatically alarm. The "Hot Cars Act" currently under discussion in the United States fully demonstrates the legislature's strong willingness to solve such problems through technology.

Cameras for a better driving experience

The in-car monitoring system can recognize different drivers and adjust the rearview mirrors, seat position, steering wheel height and infotainment system according to personal preferences. In addition, the camera also allows the driver to control the infotainment system through sight and gestures.