Methods and systems for driving assistance

Abstract

A method and system for driving assistance is operated in a vehicle system and smart glasses. Firstly, the vehicle’s cabin model and the field of view image of the smart glasses are obtained by the vehicle system, and then the field of view image is compared with the cabin model through feature matching to determine the spatial location information of a driving assistance image. Then, the vehicle system generates the driving assistance image based on the field of view image, the cabin model and the spatial location information, and transmits the driving assistance image to the smart glasses, so that the driver can obtain more intuitive driving assistance information through the smart glasses, enhancing driving safety and driving experience.

Claims

1. A driving assistance method, implemented in an in-vehicle infotainment system and smart glasses, wherein, The method includes: the vehicle system acquiring a cabin model corresponding to the vehicle and a field-of-view image from the smart glasses; the vehicle system performing feature point matching between the field-of-view image and the cabin model to determine spatial location information for generating an assisted driving image; the vehicle system generating the assisted driving image based on the field-of-view image, the cabin model, and the spatial location information; the vehicle system transmitting the assisted driving image to the smart glasses, so that the smart glasses display the assisted driving image; the vehicle system determining the driver's desired driving direction; the vehicle system acquiring a blind spot image corresponding to the desired driving direction; and the vehicle system determining whether the driver's line of sight is consistent with the desired driving direction. When the driver's line of sight is determined to be consistent with the intended driving direction, the vehicle system generates the assisted driving image based on the field of vision image of the smart glasses, the vehicle cabin model, the spatial position information, and the blind spot image. The assisted driving image includes a perspective image of the vehicle structure area corresponding to the blind spot image. When the driver's line of sight is determined to be inconsistent with the intended driving direction, the vehicle system determines the vehicle structure area that the blind spot image fits based on the field of vision image and the vehicle cabin model to generate the assisted driving image.

2. The assisted driving method as described in claim 1, wherein, The vehicle cabin model includes a vehicle body structure area and a glass material area.

3. The assisted driving method as described in claim 2, wherein, The step of generating the assisted driving image based on the field of view image, the vehicle cabin model, and the spatial location information further includes: the vehicle system determining whether the driver's field of view includes the vehicle body structure area based on the field of view image and the vehicle cabin model; and when it is determined that the driver's field of view includes the vehicle body structure area, the vehicle system acquiring an external image corresponding to the vehicle body structure area based on the spatial location information to generate the assisted driving image.

4. The assisted driving method as described in claim 3, wherein, The step of obtaining the exterior image corresponding to the vehicle structure region based on the spatial location information to generate the assisted driving image further includes: overlaying the exterior image corresponding to the vehicle structure region onto the vehicle structure region in the field of view image to achieve a perspective effect.

5. The assisted driving method as described in claim 1, wherein, The method further includes: the vehicle system detecting objects approaching the vehicle via an ADAS system; the vehicle system adding a prompt box to the object in the assisted driving image to alert the driver of the vehicle.

6. The assisted driving method as described in claim 1, wherein, The method further includes: the vehicle system determining whether there is a second vehicle ahead based on the field of view image of the smart glasses; the vehicle system determining whether the driver intends to change lanes or overtake; when it is determined that the driver intends to change lanes or overtake, acquiring the forward-looking image of the second vehicle, and matching the forward-looking image with the location of the second vehicle in the field of view image to generate the assisted driving image.

7. The assisted driving method as described in claim 2, wherein, The glass material areas include the windows, windshield, and rearview mirrors.

8. The assisted driving method as described in claim 2, wherein, The vehicle body structure area includes the A-pillar, B-pillar, and C-pillar.

9. A driver assistance system, the system comprising a vehicle infotainment system; and smart glasses, wherein, The vehicle infotainment system includes a controller and a memory, the memory being used to store a computer program that, when executed by the controller, causes the controller to implement the assisted driving method as described in any one of claims 1 to 8.

Images