Driving assistance device and corresponding vehicle, method, computer device and medium

By integrating information acquisition, scene recognition and function recommendation units in the vehicle, identifying the scene of interest and recommending auxiliary functions, the problem of low efficiency in the recommendation of auxiliary functions in the prior art is solved, and driving safety and experience are improved.

CN114084160BActive Publication Date: 2024-11-22AUDI AG
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202010745379.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-07-29
Publication Date
2024-11-22
Estimated Expiration
2040-07-29

AI Technical Summary

Technical Problem

It is difficult for existing vehicle driving assistance devices to recommend appropriate auxiliary functions according to the needs of different users, resulting in low efficiency in assistive function utilization and poor driving experience.

Method used

A driving assistance device is designed, including an information acquisition unit, a scene recognition unit and a function recommendation unit. By obtaining driving-related information and environmental information, it identifies the scene of interest, and recommends corresponding auxiliary functions to the user when the trigger condition is met.

Benefits of technology

It improves driving safety and efficiency of auxiliary functions, improves driving experience, and ensures that auxiliary functions match user needs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114084160B_ABST
    Figure CN114084160B_ABST
Patent Text Reader

Abstract

The present invention relates to a driving assistance device and a corresponding method, vehicle, computer equipment and medium. The device comprises: an information acquisition unit configured to acquire driving-related information related to the driving of a vehicle and / or environmental-related information related to the surrounding environment of the vehicle; a scene recognition unit configured to identify a scene of interest associated with the vehicle based on the driving-related information and / or environmental-related information; and a function recommendation unit configured to: when a trigger condition is satisfied, recommend the auxiliary function of the vehicle corresponding to the scene of interest to the user currently driving the vehicle in response to the scene of interest being recognized. By utilizing the solution of the present invention, the scene of interest associated with the vehicle can be identified and appropriate auxiliary functions can be specifically recommended to the driver accordingly, thereby helping to improve the driving experience of the vehicle driver, improve driving safety and promote the effective use of available auxiliary functions.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of vehicles, and in particular to a driving assistance device for a vehicle, a vehicle comprising the same, a corresponding driving assistance method, a computer device, and a computer-readable storage medium. Background Art

[0002] Vehicles with assistance functions are known. For vehicles with assistance functions, how to recommend appropriate assistance functions to different users is a problem. Summary of the invention

[0003] The object of the present invention is to provide a solution that can identify the interesting scenes faced by the vehicle driver and recommend corresponding auxiliary functions to the driver in a targeted manner, thereby solving or alleviating the above-mentioned problems.

[0004] A driving assistance device according to an embodiment of the present invention comprises:

[0005] an information acquisition unit configured to acquire driving-related information related to driving of a vehicle and / or environment-related information related to surroundings of the vehicle;

[0006] a scene recognition unit configured to recognize a scene of interest associated with the vehicle based on the driving related information and / or the environment related information; and

[0007] The function recommendation unit is configured to: when a trigger condition is met, in response to the scene of interest being identified, recommend an auxiliary function of the vehicle corresponding to the scene of interest to a user currently driving the vehicle.

[0008] A vehicle according to an embodiment of the present invention includes the above-mentioned driving assistance device.

[0009] An embodiment of the present invention provides a driving assistance method corresponding to the above-mentioned driving assistance device.

[0010] According to an embodiment of the present invention, a computer device includes a memory and a processor. The memory stores a computer program. When the computer program is executed by the processor, the driving assistance method described above is executed.

[0011] According to an embodiment of the present invention, a non-transitory computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the above-mentioned driving assistance method is executed.

[0012] By using the solution of the present invention, it is possible to identify interesting scenes associated with the vehicle based on driving-related information related to the driving of the vehicle and / or environmental-related information related to the surrounding environment of the vehicle, and accordingly recommend appropriate auxiliary functions to the driver in a targeted manner to assist the driver in driving the vehicle. Thus, the present invention helps to improve the driving experience of the vehicle driver, improve driving safety, and promote the effective use of available auxiliary functions. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Non-limiting and non-exhaustive embodiments of the present invention are described, by way of example, with reference to the following drawings, in which:

[0014] Figure 1a is a schematic diagram showing a driving assistance device according to an embodiment of the present invention;

[0015] Figure 1b is a schematic diagram showing a driving assistance device according to another embodiment of the present invention;

[0016] Figure 2 The flowchart of a driving assistance method according to an embodiment of the present invention is schematically shown. DETAILED DESCRIPTION

[0017] In order to make the above and other features and advantages of the present invention more clear, the present invention is further described below in conjunction with the accompanying drawings. It should be understood that the specific embodiments given herein are for the purpose of explaining to those skilled in the art and are only exemplary and not restrictive.

[0018] Figure 1a A driving assistance device 100 a according to an embodiment of the present invention is schematically shown.

[0019] The driving assistance device 100a includes an information acquisition unit 101, a scene recognition unit 102, and a function recommendation unit 103. The scene recognition unit 102 is communicatively coupled to the information acquisition unit 101, and the function recommendation unit 103 is communicatively coupled to the scene recognition unit 102. The driving assistance device 100a may be used in a vehicle.

[0020] The information acquisition unit 101 may be configured to acquire driving-related information related to the driving of a vehicle and / or environmental-related information related to the surrounding environment of the vehicle. Here, the driving-related information may include at least some of the various information that may be related to the driving of the vehicle, such as: the position information of the vehicle, the driving state-related information of the vehicle, etc. The driving state-related information may include the speed, acceleration, azimuth / heading angle, steering angle, state information of vehicle components related to the driving state of the vehicle, etc. The vehicle components may include, for example but not limited to, the engine, accelerator pedal, steering system components such as steering wheel, brake system components such as brake pedal, transmission system components such as shift mechanism, turn signal, etc. of the vehicle. The environmental-related information may include information of at least some of the various possible objects in the surrounding environment of the vehicle. The objects in the surrounding environment of the vehicle may be objects within a predetermined range relative to the vehicle. The predetermined range may be determined according to the situation. For example, the predetermined range may be a range within a first distance relative to the vehicle in the lateral direction of the vehicle and within a second distance relative to the vehicle in the longitudinal direction of the vehicle. The first distance and the second distance may be equal or unequal. In addition, the first distance and the second distance may each be fixed or variable, for example, depending on the speed of the vehicle, road conditions and / or other possible factors. The objects may include various possible objects, for example: traffic participants around the vehicle such as pedestrians, cyclists, other vehicles, etc.; obstacles around the vehicle such as construction roadblocks, damaged vehicle parts, cones, etc.; roads or road parts around the vehicle, such as intersections and lanes in front of the vehicle; traffic signs around the vehicle such as traffic lights, lane markings, turn signs, etc.

[0021] The information acquisition unit 101 can acquire driving related information related to the driving of the vehicle and / or environmental related information related to the surrounding environment of the vehicle in various possible ways or any suitable combination thereof. For example, the information acquisition unit 101 may include and / or be suitable for being connected to a sensor installed at a suitable position of the vehicle (e.g., inside, front, top, rear, side and / or bottom of the vehicle, etc.), thereby capturing information with the aid of the sensor. For another example, the information acquisition unit 101 may be suitable for communicating with a source capable of providing information inside and / or outside the vehicle, such as a vehicle-mounted global navigation satellite system (GNSS), a highly automated driving (HAD) map, an online server, other vehicles and / or available infrastructure, to obtain relevant information therefrom and obtain the driving related information and / or environmental related information accordingly. The position of the vehicle can be acquired in any suitable manner, such as but not limited to GNSS or real-time dynamic carrier phase differential technology (RTK) and other technologies. The azimuth / heading angle of the vehicle can be acquired in any suitable manner, such as but not limited to using an azimuth gyroscope and the like. The speed, acceleration and steering angle of the vehicle can each be obtained in any suitable manner, such as but not limited to using on-board sensors, navigation equipment, etc. For vehicle components, their status information can be obtained in any suitable manner, such as but not limited to using sensors equipped by the vehicle components, from the system to which the vehicle components belong, etc. The sensor may include a camera, a laser radar, a millimeter wave radar, an ultrasonic sensor, a gyroscope, or any other suitable sensor, or any suitable combination thereof. The sensor may be placed and configured to be suitable for obtaining the driving-related information and / or the environment-related information.

[0022] The scene recognition unit 102 may be configured to identify a scene of interest associated with the vehicle based on the driving related information and / or environment related information acquired by the information acquisition unit 101. Here, the scene of interest may include various scenes that the vehicle may face, such as but not limited to a lane change scene, a parking scene, an intersection scene, etc.

[0023] For example, when it is determined that the vehicle is moving laterally from one lane to another lane based on information from the information acquisition unit 101, such as the vehicle's GNSS position, azimuth / heading angle, and / or steering angle, the scene recognition unit can recognize that a lane change scene has occurred. For another example, when information from the information acquisition unit, such as the status information of the vehicle's shift mechanism and the information detected by the vehicle's rearview camera, indicates that the vehicle's shift mechanism is in the R gear position and there is an empty parking space behind the vehicle, the scene recognition unit can recognize that a parking scene has occurred. For another example, the scene recognition unit can determine that the vehicle is about to accelerate through the intersection ahead or brake to stop before reaching the intersection ahead based on information from the information acquisition unit, such as the vehicle's GNSS position, the vehicle's azimuth / heading angle, the status information of the vehicle's brake pedal or accelerator pedal, and the cross traffic detected by the camera at the front of the vehicle, thereby recognizing that an intersection scene has occurred.

[0024] The function recommendation unit 103 may be configured to: when a trigger condition is satisfied, in response to the scene of interest being identified, recommend an auxiliary function of the vehicle corresponding to the scene of interest to a user currently driving the vehicle.

[0025] In one embodiment, the trigger condition includes: the user's emotion associated with driving in the scene of interest includes an emotion of interest. Here, the emotion of interest may include various possible emotions, such as but not limited to nervousness.

[0026] Alternatively or additionally, the trigger condition may include other possible conditions. For example, the vehicle may have a function recommendation mode that can be enabled and disabled, and the trigger condition may include that the function recommendation mode of the vehicle is enabled. For another example, the vehicle may have an option for the user to set a function recommendation period, and the trigger condition may include that the current time is within the function recommendation period set by the user (for example, certain days of the week such as weekdays, a certain time period of each day such as 8:00-22:00, etc.).

[0027] The recommended assistance functions may include at least one of the assistance functions possessed by the vehicle. Such assistance functions may include, for example, but not limited to, lane departure warning, lane change assistance, automatic parking assistance, adaptive cruise with stop and go function, high-speed cruise assistance, low-speed following car assist, forward collision warning, automatic emergency braking, lane keeping assistance, etc. A scenario of interest may correspond to and be associated with one or more assistance functions, and the correspondence and association between the scenario of interest and the one or more assistance functions may be predetermined and may be adjusted periodically (e.g., monthly or weekly) or according to other schedules as needed. In one embodiment, a lane change scenario may correspond to one or more assistance functions including, for example, lane departure warning and / or lane change assistance, a parking scenario may correspond to one or more assistance functions including, for example, automatic parking assistance, and an intersection scenario may correspond to one or more assistance functions including, for example, adaptive cruise with stop and go function and / or low-speed following car assist.

[0028] The function recommendation unit 103 may recommend the auxiliary function to the user in various possible ways, for example, in the form of a visual and / or audio message. The visual and / or audio message may be presented and / or sent, for example, via a display screen and / or a speaker mounted on the vehicle, and / or sent by the vehicle to a mobile device of its driver, such as a mobile phone, and presented via the latter. In one embodiment, the visual and / or audio message includes the name of the recommended auxiliary function, and may optionally include at least one of the following: a description of the recommended auxiliary function, a recommended method for enabling the auxiliary function, etc.

[0029] Figure 1b A driving assistance device 100 b according to another embodiment of the present invention is schematically shown.

[0030] Relative to Figure 1a The driving assistance device 100a of the present invention further includes an emotion recognition unit 104, an establishment and maintenance unit 105, and a condition judgment unit 106. The emotion recognition unit 104 is communicatively coupled to the information acquisition unit 101 and the scene recognition unit 102, the establishment and maintenance unit 105 is communicatively coupled to the emotion recognition unit 104, and the condition judgment unit 106 is communicatively coupled to the establishment and maintenance unit 105 and the function recommendation unit 103. The driving assistance device 100b can be used in a vehicle.

[0031] exist Figure 1bIn the case of a vehicle driving a vehicle, the information acquisition unit 101 may also be configured to: acquire emotion-related information related to the emotion of the vehicle user during driving the vehicle. Here, "emotion-related information" may include at least part of various information that can reflect the user's emotions, such as: the user's facial expressions; the user's body movements; the user's physiological information, indicators, parameters, etc. that can reflect their psychological activities or states.

[0032] The information acquisition unit 101 may include, and / or be adapted to be connected to, a sensor installed at a suitable position of the vehicle (e.g., a position above the front side of the driver's seat inside the vehicle, a position on the steering wheel, etc.) and / or a wearable device suitable for being worn by the user of the vehicle, thereby capturing information with the aid of the sensor and / or the wearable device. The sensor and the wearable device may be placed and configured to be suitable for acquiring the emotion-related information. The sensor may include a camera, a biosensor, or any other suitable sensor, or any suitable combination thereof. The wearable device may include various wearable sensors such as biosensors, or any suitable combination thereof. For example, a camera installed at a position behind the windshield inside the vehicle, especially at a position near the upper part of the windshield on the driver's side, can capture the user's facial expressions such as frowning expressions, etc., a biosensor such as a sweat sensor installed on the steering wheel of the vehicle can detect the user's sweat, and a blood pressure sensor installed on a smart wristband can be worn by the user to detect his blood pressure, thereby acquiring the emotion-related information.

[0033] The emotion recognition unit 104 may be configured to recognize the user's emotion when the scene of interest appears one or more times based on the emotion-related information from the information acquisition unit 101 .

[0034] The emotion recognition unit 104 can recognize the user's emotions from the user's emotion-related information in various possible ways, and here are just a few examples. For example, the emotion recognition unit can find the reference frown expression that best matches the frown expression of the user from the available reference frown expressions through image or pattern matching, and use the emotion represented by the best matching reference frown expression (for example, normal, nervous, very nervous, etc.) as the emotion of the user. For another example, the emotion recognition unit can compare the user's emotion-related information obtained from the information acquisition unit 101, such as a physiological parameter value, with a benchmark value or a benchmark range, and classify the user's emotions according to the comparison result, for example, classify them as normal, nervous, very nervous, etc. For example, depending on the situation, when the physiological parameter value is below or above a reference value, or within a reference range, the user's emotion can be classified as normal emotion; when the physiological parameter value is greater than or less than the reference value but less than a predetermined amount (e.g., a predetermined percentage, such as 20%, 50%, etc.), or deviates from the reference range but deviates from the reference range by less than a predetermined amount (e.g., a predetermined percentage, such as 20%, 50%, etc.), the user's emotion can be classified as nervous; when the physiological parameter value is greater than or less than the reference value by more than a corresponding predetermined amount, or deviates from the reference range by more than a corresponding predetermined amount, the user's emotion can be classified as very nervous. Here, the reference value or reference range can be determined in various suitable ways, such as but not limited to: by averaging the values ​​or ranges of a physiological parameter collected for multiple different users in a normal emotional state; by averaging the values ​​or ranges of a physiological parameter collected multiple times when a specific user is in a normal emotional state. The reference value or reference range can be a value applicable to multiple different users including the user, or it can be user-specific. Gender, age and / or any other possible factors may be considered in determining the reference value or reference range. The physiological parameter value may be, for example, but not limited to, a value representing the degree of sweating, blood pressure or heart rate. In the case where the emotion-related information obtained about the vehicle user when a certain scene of interest occurs involves multiple different physiological indicators or parameters of the user, the emotion-related information reflecting each physiological indicator or parameter may be comprehensively considered in various suitable ways, thereby determining the user's emotion when the scene of interest occurs. For example, each of a plurality of predetermined emotions (such as normal, nervous, very nervous, etc.) may correspond to a value range, an emotion value may be determined for the user based on each of the physiological indicators or parameters, weights may be determined for each of the emotion values ​​thus obtained and a weighted average value thereof may be calculated, and the user's emotion may be determined based on the weighted average value.

[0035] The establishing and maintaining unit 105 can be configured to determine the user's emotions associated with driving in the scene of interest based on the user's emotions identified by the emotion recognition unit 104 at least once when the scene of interest occurs, and accordingly establish and / or update a lookup table indicating the user's emotions associated with driving in the scene of interest.

[0036] The establishment and maintenance unit 105 may determine the user's emotion associated with driving in the scene of interest according to any appropriate criteria. In one embodiment, when the recognition result of the emotion recognition unit 104 indicates that the frequency or number of times the user is in the emotion of interest (e.g., nervousness) when the scene of interest appears within a predetermined time period exceeds a predetermined threshold, the establishment and maintenance unit may determine the user's emotion associated with driving in the scene of interest as the emotion of interest. The predetermined threshold may be appropriately determined according to the situation. In another embodiment, when the recognition result of the emotion recognition unit 104 indicates that the proportion of the user being in the emotion of interest (e.g., nervousness) when the scene of interest appears in the past or within a predetermined time period exceeds a predetermined proportion (e.g., 50%), the establishment and maintenance unit may determine the user's emotion associated with driving in the scene of interest as the emotion of interest. In yet another embodiment, when the recognition result of the emotion recognition unit 104 indicates that the user was in the emotion of interest (e.g., nervousness) when the scene of interest appears in the past or within a predetermined time period, the establishment and maintenance unit may determine the user's emotion associated with driving in the scene of interest as the emotion of interest.

[0037] In one embodiment, the lookup table includes items reflecting user identity information, scenes of interest, and user emotions. User identity information may include, for example, but not limited to, any of the following or any combination thereof: user's name, ID number, driver's license number, fingerprint, facial photo, account in the in-vehicle application, etc. For example, Table 1 shows an example form of a lookup table.

[0038] user Interesting scenes User sentiment User A Lane change scenario Nervousness User A Parking scene Nervousness User A Intersection scene Normal emotions User B Lane change scenario Normal emotions User B Parking scene Nervousness User B Intersection scene Normal emotions User C Lane change scenario Nervousness …… …… ……

[0039] Table 1

[0040] The lookup table may be updated in real time, periodically, or on other schedules as needed.The lookup table may be stored on the vehicle or on a server adapted to communicate with the vehicle.

[0041] For the user currently driving the vehicle, his identity can be identified, for example, through face recognition using a camera installed inside the vehicle, fingerprint recognition using a sensor installed on the door, and / or through the user's name, ID number, driver's license number or account information entered in an in-vehicle application.

[0042] The condition judgment unit 106 may be configured to determine the user's emotion associated with driving in the scene of interest from the lookup table, and judge whether the trigger condition is satisfied accordingly. In one embodiment, when the emotion of the user associated with driving in the scene of interest is determined by the lookup table to be the emotion of interest, the condition judgment unit may judge that the trigger condition is satisfied. Alternatively or additionally, the condition judgment unit may judge that the trigger condition is satisfied when the function recommendation mode of the vehicle is in an enabled state; and / or, the condition judgment unit may judge that the trigger condition is satisfied when the current time is within the function recommendation period set by the user.

[0043] Figure 2 The flowchart of a driving assistance method 200 according to an embodiment of the present invention is schematically shown. The driving assistance method comprises an information acquisition step S201, a scene recognition step S202 and a function recommendation step S203, and can be implemented using the driving assistance device of the present invention as described above.

[0044] In step S201, driving related information related to driving of a vehicle and / or environment related information related to the surrounding environment of the vehicle is acquired.

[0045] In step S202 , a scene of interest associated with the vehicle is identified based on the driving related information and / or the environment related information.

[0046] In step S203, when a trigger condition is satisfied, in response to the scene of interest being identified, an auxiliary function of the vehicle corresponding to the scene of interest is recommended to a user currently driving the vehicle.

[0047] In one embodiment, the trigger condition includes: the user's emotion associated with driving in the scene of interest includes an emotion of interest, and the emotion of interest is particularly nervousness. The driving assistance method may also include: determining the user's emotion associated with driving in the scene of interest from a lookup table indicating the user's emotion associated with driving in the scene of interest, and judging whether the trigger condition is met accordingly.

[0048] In one embodiment, the driving assistance method also includes: obtaining emotion-related information related to the user's emotions while driving the vehicle; identifying the user's emotions when the scene of interest occurs one or more times based on the emotion-related information; determining the user's emotions associated with driving in the scene of interest based on the identified emotions of the user when the scene of interest occurs at least once, and establishing and / or updating the lookup table accordingly.

[0049] Each of the above steps can be performed by a corresponding unit of the driving assistance device of the present invention, as described above in conjunction with Figure 1a and Figure 1b In addition, the operations and details described above in conjunction with the units of the driving assistance device of the present invention may be included in or embodied in the driving assistance method of the present invention.

[0050] It should be understood that each unit of the driving assistance device of the present invention can be implemented in whole or in part by software, hardware, firmware or a combination thereof. Each of the units can be embedded in a processor of a computer device in the form of hardware or firmware or independent of the processor, or can be stored in a memory of a computer device in the form of software for the processor to call to perform the operation of each unit. Each of the units can be implemented as an independent component or module, or two or more units can be implemented as a single component or module.

[0051] It should be understood by those skilled in the art that Figure 1a and 1b The schematic diagram of the device shown in the figure is only an exemplary block diagram of a part of the structure related to the solution of the present invention, and does not constitute a limitation on the computer device, processor or computer program embodying the solution of the present invention. The specific computer device, processor or computer program may include more or fewer components or modules than shown in the figure, or combine or split certain components or modules, or have different arrangements of components or modules.

[0052] In one embodiment, a computer device is provided, which includes a memory and a processor, wherein a computer program executable by the processor is stored on the memory, and the processor executes some or all steps of the method of the present invention when executing the computer program. The computer device can be broadly a server, a vehicle-mounted terminal, or any other electronic device with necessary computing and / or processing capabilities. In one embodiment, the computer device may include a processor, a memory, a network interface, a communication interface, etc. connected through a system bus. The processor of the computer device can be used to provide necessary computing, processing and / or control capabilities. The memory of the computer device may include a non-volatile storage medium and an internal memory. An operating system, a computer program, etc. may be stored in or on the non-volatile storage medium. The internal memory can provide an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface and the communication interface of the computer device can be used to connect and communicate with external devices through a network. The steps of the method of the present invention are executed by the processor.

[0053] The present invention may be implemented as a computer-readable storage medium having a computer program stored thereon, the computer program implementing some or all of the steps of the method of the present invention when executed by a processor. In one embodiment, the computer program is distributed on a plurality of computer devices or processors coupled to a network so that the computer program is stored, accessed and executed in a distributed manner by one or more computer devices or processors. A single method step / operation, or two or more method steps / operations, may be performed by a single computer device or processor or by two or more computer devices or processors. One or more method steps / operations may be performed by one or more computer devices or processors, and one or more other method steps / operations may be performed by one or more other computer devices or processors. One or more computer devices or processors may perform a single method step / operation, or perform two or more method steps / operations.

[0054] It will be appreciated by those skilled in the art that all or part of the steps of the method of the present invention may be performed by instructing related hardware such as a computer device or a processor through a computer program, and the computer program may be stored in a non-temporary computer-readable storage medium, which causes the steps of the method of the present invention to be performed when the computer program is executed. Depending on the circumstances, any reference to memory, storage, database or other media herein may include non-volatile and / or volatile memory. Examples of non-volatile memory include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, magnetic tape, floppy disk, magneto-optical data storage device, optical data storage device, hard disk, solid state disk, etc. Examples of volatile memory include random access memory (RAM), external cache memory, etc.

[0055] The various technical features described above can be combined arbitrarily. Although all possible combinations of these technical features are not described, any combination of these technical features should be considered to be covered by this specification as long as there is no contradiction in such combination.

[0056] Although the present invention has been described in conjunction with the embodiments, it should be understood by those skilled in the art that the above description and the accompanying drawings are only exemplary and non-restrictive, and the present invention is not limited to the disclosed embodiments. Various modifications and variations are possible without departing from the spirit of the present invention.

Claims

1. A driving assistance device, comprising: an information acquisition unit configured to acquire driving-related information related to driving of a vehicle and / or environment-related information related to surroundings of the vehicle; a scene recognition unit configured to recognize a scene of interest associated with the vehicle based on the driving related information and / or the environment related information; and A function recommendation unit is configured to: when a trigger condition is met, in response to the scene of interest being identified, recommend an auxiliary function of the vehicle corresponding to the scene of interest to a user currently driving the vehicle, wherein the trigger condition includes: the user's emotion associated with driving in the scene of interest includes an emotion of interest, wherein the correspondence between the scene of interest and the auxiliary function is predetermined, and the scene of interest includes a lane change scene, a parking scene, or an intersection scene.

2. The driving assistance device according to claim 1, wherein: The emotion of interest is tension.

3. The driving assistance device according to claim 2, further comprising: a condition determination unit configured to: determine the user's emotion associated with driving in the scene of interest from a lookup table, and determine whether the trigger condition is satisfied based on the emotion; The lookup table indicates emotions of the user associated with driving in the scenario of interest.

4. The driving assistance device according to claim 3, wherein: The information acquisition unit is further configured to: acquire emotion-related information related to the emotion of the user during driving the vehicle, wherein the driving assistance device further comprises: An emotion recognition unit configured to recognize the user's emotion when the scene of interest appears one or more times based on the emotion-related information; and The establishing and maintaining unit is configured to determine the user's emotion associated with driving in the scene of interest based on the identified emotion of the user when at least one of the scenes of interest occurs, and establish and / or update the lookup table accordingly.

5. A vehicle comprising the driving assistance device according to any one of claims 1 to 4.

6. A driving assistance method, comprising: Acquiring driving-related information related to driving of a vehicle and / or environment-related information related to surroundings of the vehicle; identifying a scene of interest associated with the vehicle based on the driving-related information and / or the environment-related information; and When a trigger condition is met, in response to the scene of interest being identified, the auxiliary function of the vehicle corresponding to the scene of interest is recommended to a user currently driving the vehicle, wherein the trigger condition includes: the user's emotion associated with driving in the scene of interest includes an emotion of interest, wherein the correspondence between the scene of interest and the auxiliary function is predetermined, and the scene of interest includes a lane change scene, a parking scene, or an intersection scene.

7. The driving assistance method according to claim 6, wherein: The emotion of interest is tension.

8. The driving assistance method according to claim 7, further comprising: determining the user's emotion associated with driving in the scene of interest from a lookup table, and judging whether the trigger condition is satisfied based on the emotion; The lookup table indicates emotions of the user associated with driving in the scenario of interest.

9. The driving assistance method according to claim 8, further comprising: acquiring emotion-related information related to the emotion of the user during driving the vehicle; Identifying the user's emotion when the scene of interest appears one or more times based on the emotion-related information; and Based on the emotion of the user when the scene of interest occurs at least once, the emotion of the user associated with driving in the scene of interest is determined, and the lookup table is established and / or updated accordingly.

10. A computer device comprising a memory and a processor, wherein a computer program is stored on the memory, and when the computer program is executed by the processor, the driving assistance method according to any one of claims 6 to 9 is executed. 11 . A non-transitory computer-readable storage medium having a computer program stored thereon, the computer program causing the driving assistance method according to any one of claims 6 to 9 to be executed when the computer program is executed by a processor.

Citation Information

Patent Citations

  • Procedure for choosing a route for a vehicle

    DE102018209980A1

  • Driving assistance system for lane keeping support, for lane change assistance, and for driver status monitoring for a vehicle

    EP1726513A1

  • Driver assistance system

    EP2942012A1

  • Vehicle control device, on-vehicle device controller, map information generation device, vehicle control method, and on-vehicle device control method

    JP2017136922A

  • Emotion-based vehicle service system, emotion cognition processing apparatus, safe driving service apparatus, and emotion-based safe driving service method

    US20130054090A1