Method for outputting interpretation information by vehicle, electronic equipment and storage medium
By monitoring the non-steady driving situation of the vehicle, identifying the driver's behavior, and outputting interpretation information, the problem of driver confusion in the autonomous driving mode is solved, and the driver's trust in the autonomous driving system is enhanced.
Patent Information
- Application Number
- CN202411304687.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-19
- Publication Date
- 2024-11-01
AI Technical Summary
In autonomous driving mode, the sudden non-steady driving behavior of the vehicle may cause confusion among the drivers, and the existing technology lacks interpretation information, affecting the driver's trust in the autonomous driving system.
By monitoring the non-steady state driving situation of the vehicle in the operation design domain of the autonomous driving system, identifying the driver's behavior characteristics, outputting interpretation information, and explaining the reasons for the vehicle's non-steady state driving.
Improve the timing accuracy of interpreting information, eliminates the driver's confusion about the non-steady driving tasks of the autonomous driving system, and improves the driver's trust in the autonomous driving system.
Smart Images

Figure CN118877005A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of autonomous driving, and in particular relates to a method for outputting interpretation information of a vehicle, an electronic device and a storage medium. Background Art
[0002] The AEB (Autonomous Emergency Braking) system monitors the road conditions ahead in real time through sensors on the front of the vehicle (such as radars, cameras, etc.), including the distance and speed of obstacles such as vehicles and pedestrians ahead. When the system determines that there is a risk of collision, it will immediately perform calculations and evaluations. First, the AEB system will issue a warning to the driver (such as sound, images, etc.) to remind the driver to pay attention and take evasive measures. If the driver fails to respond in time or the braking force is insufficient, the AEB system will automatically activate the emergency braking function, increase the braking force to reduce the speed or stop the vehicle and issue a prompt sound. Therefore, the relevant technology can only be activated to warn the driver in an emergency braking situation, and the scenario for reminding the driver is single, resulting in insufficient reminders to the driver in autonomous driving mode.
[0003] After the autonomous driving system completes a non-steady-state driving task, such as a sudden deceleration of the vehicle due to a sudden cut-in from the vehicle ahead, the driver may be confused by the sudden behavior of the autonomous driving system. The relevant technology lacks the function of explaining this sudden behavior to the driver in the car, which in turn affects the driver's trust calibration in the autonomous driving system. Summary of the invention
[0004] The present invention solves the technical problem in the related art that the vehicle is unable to adequately remind the driver in the automatic driving mode by providing a method for outputting explanation information of the vehicle, an electronic device and a storage medium.
[0005] In a first aspect of the present invention, a method for outputting explanatory information of a vehicle is provided, comprising: during a process in which an automatic driving system controls the driving of the vehicle, monitoring whether the vehicle appears in a non-steady-state driving situation within the operational design domain of the automatic driving system; in response to the vehicle appearing in a non-steady-state driving situation within the operational design domain of the automatic driving system, identifying the current behavior of the driver in the vehicle; if it is identified that the current behavior meets the behavioral characteristics of transferring from performing non-driving tasks to performing driving-related tasks, outputting explanatory information, the explanatory information being at least used to explain the reason why the vehicle appears in the non-steady-state driving situation.
[0006] In combination with the first aspect, in some embodiments, the monitoring of whether the vehicle occurs in a non-steady-state driving situation within the operating design domain of the autonomous driving system includes: obtaining longitudinal index data for measuring the longitudinal stability of the vehicle, and lateral index data for measuring the lateral stability of the vehicle under the lateral control and longitudinal control of the autonomous driving system; judging whether the vehicle occurs in a non-steady-state driving situation based on the longitudinal index data and the lateral index data; and if so, judging whether the non-steady-state driving situation is within the operating design domain of the autonomous driving system.
[0007] In combination with the first aspect, in some embodiments, judging whether the vehicle has a non-steady-state driving condition based on the longitudinal index data and the lateral index data includes: determining a first assignment based on the longitudinal index data, the first assignment characterizing the longitudinal stability of the vehicle under the longitudinal control of the automatic driving system; determining a second assignment based on the lateral index data, the second assignment characterizing the lateral stability of the vehicle under the lateral control of the automatic driving system; determining a third assignment based on the first assignment and the second assignment, the third assignment characterizing the driving stability of the vehicle under the control of the automatic driving system; if the third assignment is greater than or equal to a preset threshold, determining that the vehicle has a non-steady-state driving condition.
[0008] In combination with the first aspect, in some embodiments, determining the third assignment based on the first assignment and the second assignment includes: identifying the road conditions around the vehicle and determining a weight coefficient based on the surrounding road conditions; performing weighted sum calculation based on the first assignment, the second assignment and the weight coefficient to obtain the third assignment.
[0009] In combination with the first aspect, in some embodiments, the longitudinal indicator data includes current detection values of multiple longitudinal indicators, and determining the first assignment based on the longitudinal indicator data includes: judging whether the current detection value of each longitudinal indicator in the longitudinal indicator data reaches the indicator threshold corresponding to the longitudinal indicator to obtain a first number of achieved items; determining the first assignment based on the first number of achieved items and a first corresponding relationship, the first corresponding relationship representing the corresponding relationship between the number of achieved items and the assignment.
[0010] In combination with the first aspect, in some embodiments, the horizontal indicator data includes current detection values of multiple vertical indicators, and determining the second assignment based on the horizontal indicator data includes: judging whether the current detection value of each horizontal indicator in the horizontal indicator data reaches the indicator threshold corresponding to the horizontal indicator, so as to obtain a second number of achieved items; determining the second assignment based on the second number of achieved items and a second corresponding relationship, the second corresponding relationship representing the corresponding relationship between the number of achieved items and the assignment.
[0011] In combination with the first aspect, in some embodiments, the identifying the current behavior of the driver in the vehicle includes: determining whether the current behavior of the driver in the vehicle meets pre-set behavior determination conditions; if at least one pre-set behavior determination condition is met, determining that the current behavior of the driver in the vehicle meets the behavioral characteristics of transferring from performing non-driving tasks to performing driving-related tasks.
[0012] In combination with the first aspect, in some embodiments, determining whether the current behavior of the driver in the vehicle meets pre-set behavior judgment conditions includes: determining whether the hand behavior of the driver in the vehicle has shifted from a position for performing non-driving tasks to a position where the steering wheel of the vehicle is located; determining whether the head behavior of the driver in the vehicle has shifted from an angle for performing non-driving tasks to an angle for performing driving-related tasks; and determining whether the driver in the vehicle has performed an acceleration operation or a deceleration operation on the vehicle.
[0013] In the second aspect of the present invention, an electronic device is also provided, comprising: a processor, and a memory communicatively connected to the processor; the memory stores computer-executable instructions; the processor executes the computer-executable instructions stored in the memory to implement the method of vehicle output interpretation information described in any embodiment of the first aspect.
[0014] In the third aspect of the present invention, a computer-readable storage medium is provided, on which a computer program is stored. The computer program includes executable instructions. When the executable instructions are executed by a processor, the method of vehicle output interpretation information described in any embodiment of the first aspect is implemented.
[0015] According to the technical solutions provided by one or more embodiments of the present invention, at least the following technical effects or advantages are achieved:
[0016] By monitoring whether the vehicle appears in a non-steady-state driving situation within the operation design domain of the automatic driving system; and identifying the current behavior of the driver in the vehicle after the non-steady-state driving situation within the operation design domain appears, if it is identified that the current behavior meets the behavioral characteristics of transferring from performing non-driving tasks to performing driving-related tasks, then outputting explanatory information for explaining the reason why the vehicle appears in the said non-steady-state driving situation. Therefore, when the driver in the vehicle is confused about the non-steady-state driving situation that appears during the automatic driving process of the vehicle, an explanation can be given to the driver, thereby improving the accuracy of the timing of outputting the explanatory information. The driver will not be reminded when it is unnecessary, but can be reminded when it is necessary, so as to resolve the driver's confusion about the non-steady-state driving task of the automatic driving system and improve the driver's trust in the automatic driving of the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying creative work.
[0018] Figure 1 A flow chart showing a method for outputting interpretation information of a vehicle according to some embodiments of the present invention;
[0019] Figure 2 Shows the basis Figure 1 A control logic for a method of outputting interpretation information of a vehicle;
[0020] Figure 3 A schematic structural diagram of an electronic device according to some embodiments of the present invention is shown. DETAILED DESCRIPTION
[0021] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0022] First of all, the term "and / or" in this article is only a description of the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.
[0023] Figure 1 FIG. 1 is a flow chart showing a method for outputting interpretation information of a vehicle according to some embodiments of the present invention. Figure 1 As shown, a vehicle automatic driving control method provided by an embodiment of the present invention is applied to a vehicle with an automatic system, and includes the following steps S101 to S103.
[0024] In step S101: during the process of the automatic driving system controlling the vehicle's driving, monitoring is performed to determine whether the vehicle is in a non-steady-state driving situation within the operational design domain of the automatic driving system.
[0025] It is understandable that the non-steady-state driving of the vehicle refers to the situation in which the vehicle's motion state changes over time under the control of the automatic driving system, specifically referring to the vehicle's unstable lateral or longitudinal driving, which occurs when the automatic driving system performs at least one target driving task in response to the external environment. The target driving tasks that the automatic driving system can perform include sudden acceleration, sudden deceleration, and sharp turns that exceed the threshold. For example: the automatic driving system controls the vehicle to decelerate suddenly due to the sudden entry of the vehicle in front. The maximum acceleration (or average acceleration) within the preset time window is greater than the preset acceleration threshold and / or the rate of change of the angular acceleration within the preset time window is greater than the preset rate of change threshold. The meanings of sudden deceleration and sharp turns are similar and will not be repeated here.
[0026] There are two types of non-steady-state driving conditions of a vehicle: one is a non-steady-state driving condition that deviates from the operational design domain (ODD) of the autonomous driving system, and the other is a non-steady-state driving condition that is within the operational design domain of the autonomous driving system. In some embodiments, during the process of the autonomous driving system controlling the vehicle, the vehicle is monitored for non-steady-state driving conditions; if the vehicle is monitored for non-steady-state driving conditions, it is determined whether the driver needs to take over the vehicle; if the driver needs to take over the vehicle, a reminder message is output to remind the driver to take over the vehicle.
[0027] In some embodiments, determining whether the driver needs to take over the vehicle includes: determining whether the non-steady-state driving condition of the vehicle is within the design operating domain of the autonomous driving system; if not, it indicates that the driver needs to take over the vehicle; if so, it indicates that the autonomous driving system can continue to complete the autonomous driving task and the driver does not need to take over the vehicle.
[0028] In some embodiments, in high-level autonomous driving modes of Level L3 and above, the tasks that the driver can perform include driving-related tasks and non-driving tasks. Non-driving tasks include the driver lowering his head to watch videos, operating objects other than the steering wheel with both hands, etc. Driving-related tasks include: holding the steering wheel, looking at the road ahead or the rearview mirror on either side, accelerating and decelerating the vehicle, etc.
[0029] It is understandable that the main indicators for measuring vehicle stability during driving include longitudinal stability and lateral stability. Non-steady-state driving conditions are reflected in longitudinal stability and lateral stability. The control of the vehicle by the autonomous driving system includes lateral control and longitudinal control. Therefore, the driving performance of the autonomous driving system on the lateral control and longitudinal control of the vehicle can be used to judge whether the vehicle is in a non-steady-state driving condition.
[0030] In some embodiments, monitoring whether the vehicle is experiencing a non-steady-state driving condition within the operational design domain of the autonomous driving system includes: obtaining longitudinal index data for measuring the longitudinal stability of the vehicle, and lateral index data for measuring the lateral stability of the vehicle under the lateral control and longitudinal control of the autonomous driving system; judging whether the vehicle is experiencing a non-steady-state driving condition based on the longitudinal index data and the lateral index data, and if so, judging whether the non-steady-state driving condition of the vehicle is within the operational design domain of the autonomous driving system.
[0031] In some embodiments, longitudinal index data for measuring longitudinal stability of the vehicle and lateral index data for measuring lateral stability of the vehicle may be directly acquired through a CAN (Controller Area Network) network.
[0032] In some embodiments, judging whether a vehicle has a non-steady-state driving condition is based on longitudinal index data and lateral index data, including: determining a first assignment based on the longitudinal index data, the first assignment representing the longitudinal stability of the vehicle under the longitudinal control of the autonomous driving system; determining a second assignment based on the lateral index data, the second assignment representing the lateral stability of the vehicle under the lateral control of the autonomous driving system; determining a third assignment based on the first assignment and the second assignment, the third assignment representing the driving stability of the vehicle under the control of the autonomous driving system; if the third assignment is greater than or equal to a preset threshold, determining that a non-steady-state driving condition has occurred within the operating design domain of the autonomous driving system.
[0033] It can be understood that the longitudinal index data includes current detection values of multiple longitudinal indicators. In some embodiments, the multiple longitudinal indicators for measuring the longitudinal stability of the vehicle include one or more of the vehicle's cruise speed control accuracy, longitudinal deceleration, longitudinal deceleration change rate, longitudinal acceleration and longitudinal acceleration change rate.
[0034] In some embodiments, the longitudinal indicator data includes current detection values of multiple longitudinal indicators, and a first assignment is determined based on the longitudinal indicator data, including: judging whether the current detection value of each longitudinal indicator in the longitudinal indicator data reaches the indicator threshold corresponding to the longitudinal indicator to obtain a first number of achieved items; determining a first assignment based on the first number of achieved items and a first corresponding relationship, the first corresponding relationship representing the corresponding relationship between the number of items and the assignment.
[0035] It is understandable that the index threshold corresponding to the cruise speed control accuracy is the accuracy threshold, and the accuracy threshold is positively correlated with the slope of the road the vehicle is currently on. The greater the slope of the current road, the greater the accuracy threshold. The accuracy threshold can be set only for flat roads and slopes. For example, the accuracy threshold for flat roads is 1km / h, and the accuracy threshold for slopes is 3km / h. Different slope intervals can also be divided for slopes, and different accuracy thresholds are set for different slope intervals.
[0036] It can be understood that the index threshold corresponding to the longitudinal deceleration is the deceleration threshold, and the deceleration threshold is negatively correlated with the current vehicle speed. The greater the current vehicle speed, the smaller the deceleration threshold. For example, if the current vehicle speed is higher than 20m / s, the deceleration threshold can be set to 3.5m / s. 2 , the current vehicle speed is lower than 5m / s, the deceleration threshold can be set to 5m / s 2 When the current vehicle speed is between 5 and 20 m / s, the deceleration threshold is calculated using interpolation.
[0037] It can be understood that the index threshold corresponding to the longitudinal deceleration change rate is the first change rate threshold, and the first change rate threshold is negatively correlated with the current vehicle speed. The greater the current vehicle speed, the smaller the first change rate threshold. For example, if the current vehicle speed is higher than 20m / s, the first change rate threshold can be set to 2.5m / s 3 , the current vehicle speed is lower than 5m / s, the first rate of change threshold can be set to 5m / s 3 When the current vehicle speed is in the range of 5 to 20 m / s, the first rate of change threshold can be calculated by interpolation.
[0038] It can be understood that the index threshold corresponding to the longitudinal acceleration is the first acceleration threshold, and the first acceleration threshold is negatively correlated with the current vehicle speed. The greater the current vehicle speed, the smaller the first acceleration threshold. For example, if the current vehicle speed is higher than 20m / s, the first acceleration threshold is set to 2m / s. 2 , when the current vehicle speed is lower than 5m / s, the first acceleration threshold is set to 4m / s 2 When the current vehicle speed is between 5 and 20 m / s, the first acceleration threshold can be calculated by interpolation.
[0039] It can be understood that the index threshold corresponding to the longitudinal acceleration change rate is the second change rate threshold, and the second change rate threshold is negatively correlated with the current vehicle speed. The greater the current vehicle speed, the smaller the second change rate threshold. For example, when the current vehicle speed is higher than 20m / s, the second change rate threshold is set to 2.5m / s 2 , when the current vehicle speed is lower than 5m / s, the first acceleration threshold is set to 5m / s 2 When the current vehicle speed is between 5 and 20 m / s, the second rate of change threshold can be calculated by interpolation.
[0040] In some embodiments, determining whether the current detection value of each longitudinal indicator in the longitudinal indicator data reaches the indicator threshold corresponding to the longitudinal indicator to obtain a first number of achieved items includes: determining whether the maximum longitudinal deceleration or the average longitudinal deceleration of the vehicle within a preset time window is greater than the deceleration threshold, determining whether the longitudinal deceleration change rate within the preset time window is greater than a first change rate threshold, determining whether the maximum longitudinal acceleration or the average longitudinal acceleration within the preset time window is greater than a first acceleration threshold, determining whether the longitudinal acceleration change rate of the vehicle within the preset time window is greater than a second change rate threshold, and determining whether the cruise speed control accuracy of the vehicle is lower than the accuracy threshold; for each of the above five determinations, if the determination result of the determination is yes, it indicates that the longitudinal indicator has been achieved.
[0041] It can be understood that the first corresponding relationship represents a positive correlation between the number of achieved items and the assigned value. The more the number of achieved items, the larger the assigned value. In some embodiments, the first assigned value is assigned according to the number of achieved items of each longitudinal index affecting the longitudinal stability, so that the first assigned value can be between 1.1-1.5. Exemplarily, if only one longitudinal index is achieved, the first assigned value is 1.1; if two longitudinal indexes are achieved, the first assigned value is 1.2; ... and so on, if all five longitudinal indexes are achieved, the first assigned value is 1.5.
[0042] It can be understood that the lateral index data includes the current detection value of each lateral index among multiple lateral indexes. In some embodiments, the current detection values of multiple lateral indexes for measuring the lateral stability of the vehicle include one or two of the following current detection values of the vehicle: lateral acceleration, lateral acceleration change rate.
[0043] In some embodiments, a second assignment characterizing the lateral control stability of the vehicle by the autonomous driving system is determined based on the lateral indicator data, including: judging whether the current detection value of each lateral indicator reaches the indicator threshold corresponding to the lateral indicator to obtain a second number of achieved items; determining a second assignment based on the second number of achieved items and a second corresponding relationship, the second corresponding relationship characterizing the corresponding relationship between the number of achieved items and the assignment, the more achieved items there are, the larger the assignment.
[0044] It can be understood that the index threshold corresponding to the lateral acceleration is the second acceleration threshold, wherein the second acceleration threshold can be a preset fixed value, such as: 3m / s 2 It can be understood that the index threshold corresponding to the lateral acceleration change rate is the second lateral acceleration change rate, wherein the second lateral acceleration change rate can also be a preset fixed value, such as: 5m / s 2 .
[0045] In some embodiments, determining whether the current detection value of each lateral indicator reaches the indicator threshold corresponding to the lateral indicator includes: determining whether the lateral acceleration of the vehicle within a preset time window is greater than a second acceleration threshold, and determining whether the lateral acceleration change rate of the vehicle within the preset time window is greater than a third change rate threshold; for each of the above two judgments, if the judgment result of the judgment is yes, it indicates that the lateral indicator is achieved.
[0046] It can be understood that the second corresponding relationship represents a positive correlation between the number of items achieved and the assigned value. The more items achieved, the greater the assigned value. For example, if only one horizontal indicator is achieved, the second assigned value is 1.1, and if both horizontal indicators are achieved, the second assigned value is 1.5.
[0047] It is understandable that different road conditions may have different effects on the driving safety of the vehicle in the longitudinal and lateral non-steady-state driving. In some embodiments, according to the first assignment and the second assignment, a third assignment characterizing the stability of the vehicle control by the automatic driving system is determined, which may include: identifying the surrounding road conditions around the vehicle, and determining a weight coefficient according to the surrounding road conditions; performing a weighted sum calculation according to the first assignment, the second assignment and the weight coefficient to obtain the third assignment. It is understandable that if the third assignment is greater than or equal to the preset threshold, it is determined that the vehicle has an unsteady driving condition, otherwise, it is determined that the vehicle has not an unsteady driving condition.
[0048] In some embodiments, the weight coefficient includes a lateral weight and a longitudinal weight. The longitudinal weight is negatively correlated with the road conditions in front of the vehicle, and the lateral weight is negatively correlated with the road conditions on the left and right sides of the vehicle, that is, the better the road conditions in front of the vehicle, the smaller the longitudinal weight is set, and vice versa, the larger the longitudinal weight is set. The better the road conditions on the left and right sides of the vehicle, the smaller the lateral weight is set, and vice versa, the larger the lateral weight is set. For example, in the case where the left and right traffic volume of the vehicle is relatively large (there are vehicles on the left and right), the sudden lateral acceleration and deceleration at this time will have a greater impact on the safety of the vehicle, and also have a greater impact on the driver's psychology, thereby affecting the driver's trust in the vehicle. At this time, a larger lateral weight can be set.
[0049] In some embodiments, the lateral weight and the longitudinal weight are set within a range of 1 to 1.5. For example, the mapping relationship between the pre-calibrated weight coefficient and the road condition can be referred to as shown in Table 1 below to determine the lateral weight and the longitudinal weight within a range of 1 to 1.5 according to the surrounding road conditions:
[0050] Table 1. Weight coefficients Mapping relationship with road conditions
[0051]
[0052] In some embodiments, the third assignment S may be calculated by referring to the following formula:
[0053]
[0054] S is the third assignment, L1 is the first assignment, L2 is the second assignment, is the weight coefficient.
[0055] When the value range of the first assignment and the second assignment is 1.1 to 1.5, the preset threshold value can be set to a value between 1 and 2. In some embodiments, the preset threshold value can be a preset fixed value. In other embodiments, multiple optional gears can be preset for the preset threshold value, and the preset threshold value can be set to one of the gears according to the driver's habits. Exemplarily, 10 optional gears can be set: 1.1, 1.2, 1.3, 1.4, 1.5, 1.5, 1.6, 1.7, 1.8, 1.9.
[0056] In other embodiments, it is possible not to distinguish between longitudinal indicator data and lateral indicator data to monitor whether the vehicle is currently experiencing a non-steady-state driving situation, including: under the control of the automatic driving system, obtaining multiple indicator data for measuring the vehicle's driving stability; determining a third assignment based on the number of indicator achievement items and a third corresponding relationship, the third corresponding relationship representing the correspondence between the number of achievement items and the assignment, the more achievement items there are, the greater the assignment value.
[0057] Step S102: In response to the vehicle appearing in a non-steady-state driving situation within the operational design domain of the automatic driving system, identifying the current behavior of the driver in the vehicle.
[0058] In some embodiments, identifying the current behavior of the driver in the vehicle includes: obtaining the current behavior of the driver in the vehicle; determining whether the current behavior of the driver in the vehicle meets the behavioral characteristics of transferring from performing non-driving tasks to performing driving-related tasks, and if so, indicating that the driver is confused about the non-steady-state driving situation of the vehicle.
[0059] In step S103: if it is identified that the current behavior meets the behavior characteristics of transferring from performing a non-driving task to performing a driving-related task, then explanatory information is output, and the explanatory information is at least used to explain the reason why the vehicle has an unsteady driving condition.
[0060] In some embodiments, identifying the current behavior of the driver in the vehicle includes: determining whether the current behavior of the driver in the vehicle meets pre-set behavior determination conditions; if at least one pre-set behavior determination condition is met, then the current behavior of the driver in the vehicle is characterized by a behavior characteristic of transferring from performing non-driving tasks to performing driving-related tasks.
[0061] In high-level autonomous driving modes, driver confusion is defined as the driver's transfer from non-driving tasks to driving-related tasks. Determining whether the current behavior of the driver in the vehicle meets at least one pre-set behavior determination condition includes: determining whether the hand behavior of the driver in the vehicle is transferred from the position of performing non-driving tasks to the position of the vehicle's steering wheel; determining whether the head behavior of the driver in the vehicle is transferred from the angle of performing non-driving tasks to the angle of performing driving tasks; and determining whether the driver in the vehicle performs acceleration and deceleration operations on the vehicle.
[0062]
[0063] It is understandable that the DMS (driver monitoring system) can be used to identify the driver's head and hand behaviors in the car, including: facial orientation, eye line of sight and hand position, such as identifying whether the head is straightened, whether the eyes are looking forward, whether the driver's hands are holding the steering wheel, etc.
[0064] It is understandable that the steering wheel equipped with a capacitive sensor can be used to identify whether the driver's hands are on the steering wheel, and the vehicle's accelerator pedal and brake sensors can be used to identify whether the driver has stepped on the accelerator pedal or brake pedal.
[0065] In some embodiments, the explanation information output in step S102 at least explains the cause of the current non-steady-state driving condition of the vehicle, so as to eliminate the driver's confusion about the current non-steady-state driving condition of the vehicle.
[0066] In some embodiments, the output explanatory information includes interface information and / or voice information, wherein the interface information at least includes a textual explanation on the central control screen of the reason why the vehicle is in a non-steady-state driving situation, such as "the vehicle ahead cuts in, so the vehicle slows down". The interface information may also include other information, such as the current driving status displayed on the vehicle's instrument screen, and the current driving status includes: the level of automatic driving, performance reliability, and the surrounding road environment recognized by the vehicle.
[0067] In some embodiments, the voice information is broadcasted through the IVI (In-Vehicle Infotainment) vehicle voice, synchronously announcing the cause of the vehicle's non-steady-state driving situation, such as "the vehicle ahead cuts in, so the vehicle slows down". The text content of the central control screen is synchronized with the content of the voice broadcast and the content is consistent.
[0068] Figure 2 Shows the basis Figure 1A control logic of the method for outputting explanation information of a vehicle in the embodiment of the present invention. In order to facilitate understanding of the method for outputting explanation information of a vehicle in the embodiment of the present invention, refer to Figure 2 As shown, a control logic of the method for outputting explanation information of a vehicle in an embodiment of the present invention is given:
[0069] Step S01: The automatic driving system controls the vehicle to travel, and the following steps S02 to S06 are performed during the process of the automatic driving system controlling the vehicle to travel:
[0070] Step S02: monitor whether the vehicle is currently in a non-steady-state driving situation, if so, proceed to step S03, if not, return to step 01;
[0071] Step S03: Determine whether the driver needs to take over the vehicle; if so, proceed to step S04; if not, proceed to step S05;
[0072] Step S04: outputting a reminder message for prompting the driver to take over the vehicle;
[0073] Step S05: Determine whether the driver in the car is confused, if so, proceed to step S06;
[0074] Step S06: Output the explanation information and return to step S01.
[0075] Based on the same inventive concept, an embodiment of the present invention further provides an electronic device, such as Figure 3 As shown, the electronic device includes one or more memories 304, one or more processors 302, and at least one computer program (program code) stored in the memory 304 and executable on the processor 302. When the processor 302 executes the computer program, the method for vehicle output interpretation information described in any one of the above embodiments is implemented.
[0076] Among them, Figure 3 In the embodiment of the present invention, a bus architecture (represented by bus 300) is shown, which may include any number of interconnected buses and bridges, and bus 300 links various circuits including one or more processors represented by processor 302 and memory represented by memory 304. Bus 300 may also link various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art and are therefore not further described herein. Bus interface 305 provides an interface between bus 300 and receiver 301 and transmitter 303. Receiver 301 and transmitter 303 may be the same element, namely a transceiver, providing a unit for communicating with various other devices over a transmission medium. Processor 302 is responsible for managing bus 300 and general processing, while memory 304 may be used to store data used by processor 302 when performing operations.
[0077] Based on the same inventive concept, an embodiment of the present invention further provides a computer-readable storage medium on which a computer program is stored. The computer program includes executable instructions. When the executable instructions are executed by a processor, the method of vehicle output interpretation information described in any of the above embodiments is implemented.
[0078] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0079] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0080] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0081] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0082] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.
[0083] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.
Claims
1. A method for outputting explanation information of a vehicle, characterized in that: include: During the process of the automatic driving system controlling the driving of the vehicle, monitoring whether the vehicle is in a non-steady-state driving situation within the operation design domain of the automatic driving system; In response to the vehicle being in a non-steady-state driving condition within the operational design domain of the automated driving system, identifying a current behavior of a driver in the vehicle; If it is identified that the current behavior meets the behavior characteristics of transferring from performing a non-driving task to performing a driving-related task, then explanation information is output, where the explanation information is at least used to explain why the vehicle experiences the non-steady-state driving condition.
2. The method according to claim 1, characterized in that The monitoring of whether the vehicle is in a non-steady-state driving situation within the operational design domain of the automatic driving system includes: Under the lateral control and longitudinal control of the automatic driving system, obtaining longitudinal index data for measuring the longitudinal stability of the vehicle and lateral index data for measuring the lateral stability of the vehicle; Determining whether the vehicle is in a non-steady-state driving condition according to the longitudinal index data and the lateral index data; If so, determine whether the non-steady-state driving condition is within the operational design domain of the automatic driving system.
3. The method according to claim 2, characterized in that The determining whether the vehicle is in a non-steady-state driving state according to the longitudinal index data and the lateral index data includes: determining a first assignment based on the longitudinal index data, the first assignment representing the longitudinal stability of the vehicle under the longitudinal control of the autonomous driving system; determining a second assignment based on the lateral index data, the second assignment representing lateral stability of the vehicle under lateral control of the autonomous driving system; Determining a third assignment according to the first assignment and the second assignment, wherein the third assignment represents the driving stability of the vehicle under the control of the automatic driving system; If the third assigned value is greater than or equal to a preset threshold, it is determined that the vehicle is experiencing a non-steady-state driving condition.
4. The method according to claim 3, characterized in that Determining a third assignment according to the first assignment and the second assignment includes: Identifying the surrounding road conditions of the vehicle and determining a weight coefficient according to the surrounding road conditions; A weighted sum calculation is performed according to the first assignment, the second assignment and the weight coefficient to obtain the third assignment.
5. The method according to claim 3, characterized in that The longitudinal indicator data includes current detection values of a plurality of longitudinal indicators, and determining the first value according to the longitudinal indicator data includes: Determine whether the current detection value of each longitudinal indicator in the longitudinal indicator data reaches the indicator threshold corresponding to the longitudinal indicator to obtain a first number of achieved items; The first assignment is determined according to the first number of achieved items and a first corresponding relationship, wherein the first corresponding relationship represents a corresponding relationship between the number of achieved items and the assignment.
6. The method according to claim 3, characterized in that The horizontal indicator data includes current detection values of a plurality of vertical indicators, and determining the second assignment according to the horizontal indicator data includes: Determine whether the current detection value of each horizontal indicator in the horizontal indicator data reaches the indicator threshold corresponding to the horizontal indicator, so as to obtain a second number of achieved items; The second assignment is determined according to the second number of achieved items and a second corresponding relationship, wherein the second corresponding relationship represents a corresponding relationship between the number of achieved items and the assignment.
7. The method according to any one of claims 1 to 6, characterized in that: The identifying the current behavior of the driver in the vehicle includes: Determining whether the current behavior of the driver in the vehicle meets a preset behavior determination condition; If at least one pre-set behavior determination condition is met, it is determined that the current behavior of the driver in the vehicle meets the behavior characteristics of transferring from performing a non-driving task to performing a driving-related task.
8. The method according to claim 7, characterized in that Determining whether the current behavior of the driver in the vehicle meets a preset behavior determination condition includes: Determine whether the hand behavior of the driver in the vehicle is transferred from the position for performing non-driving tasks to the position of the steering wheel of the vehicle: Determining whether the head behavior of the driver in the vehicle has shifted from the perspective of performing a non-driving task to the perspective of performing a driving-related task; and It is determined whether the driver in the vehicle performs an acceleration operation or a deceleration operation on the vehicle.
9. An electronic device, characterized in that: include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the method for outputting interpretation information of a vehicle according to any one of claims 1 to 8.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: The computer program includes executable instructions, and when the executable instructions are executed by a processor, the method for outputting interpretation information of a vehicle according to any one of claims 1 to 8 is implemented.
