Human-computer interface design method and device for automatic driving automobile
By obtaining the confidence of the autonomous driving system and the driver feedback status and adjusting the information display intensity, the problem of unreasonable human-machine interface design of autonomous driving cars is solved, and the driver's reasonable use of autonomous driving functions is improved.
Patent Information
- Application Number
- CN202410932004.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-12
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2044-07-12
AI Technical Summary
The unreasonable design of the human-machine interface of autonomous driving cars leads to drivers not trusting or over-trustting the autonomous driving function, affecting the utilization rate of autonomous driving functions.
By obtaining the confidence of the autonomous driving system and the feedback status of the driver, determine the reasonableness and adjust the display intensity of the information based on this information to ensure that the driver obtains the most reasonable feedback.
It improves the rationality of the human-machine interface, allowing drivers to reasonably use the autonomous driving function, and avoids system abuse or deprecation caused by distrust or excessive trust.
Smart Images

Figure CN118963877A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of automobile technology, and in particular to a method and device for designing a human-machine interface for an autonomous driving vehicle. Background Art
[0002] The human-machine interface of an autonomous vehicle greatly affects the utilization rate of the autonomous driving function. A reasonable human-machine interface design will make the driver reasonably trust the autonomous driving function and the driver will reasonably use the autonomous driving function; an unreasonable human-machine interface design will make the driver distrust or over-trust the autonomous driving function. The driver's distrust of the autonomous driving function will lead to the abandonment of the autonomous driving system, and the driver's over-trust of the autonomous driving function will lead to the abuse of the autonomous driving system. Therefore, in order to make the driver use the autonomous driving function reasonably, it is necessary to consider how to make the human-machine interface of the autonomous driving car more reasonable. Summary of the invention
[0003] The present invention solves the technical problem of how to make the human-machine interface of an autonomous driving vehicle more reasonable by providing a method and device for designing the human-machine interface of an autonomous driving vehicle.
[0004] On the one hand, the present invention provides the following technical solutions:
[0005] A method for designing a human-machine interface for an autonomous driving vehicle, comprising:
[0006] Obtain the confidence of the autonomous driving system during each autonomous driving process of the vehicle, the driver's feedback status on the autonomous driving function each time, and the actual display intensity of each type of information in each version of the human-machine interface;
[0007] Determining the rationality of each feedback of the driver according to the confidence level and the feedback state;
[0008] A target display intensity for each type of information that enables the driver to provide the most reasonable feedback is determined based on the plurality of reasonable degrees and the corresponding actual display intensities.
[0009] Optionally, the system status represented by the confidence level includes a good system status, a general system status, a system that may be about to exit, a system that has exited, or is preparing to exit.
[0010] Optionally, the feedback state includes no feedback, a monitoring state, an active takeover state, and a passive takeover state.
[0011] Optionally, the information includes information related to autonomous driving, takeover reminder information and driver related information.
[0012] Optionally, determining the rationality of each feedback of the driver according to the confidence level and the feedback state includes:
[0013] Determine a rationality value corresponding to each combination of the confidence level and the corresponding feedback state;
[0014] The reasonableness is calculated based on a plurality of the reasonableness values.
[0015] Optionally, determining a target display intensity of each type of information that enables the driver to provide the most reasonable feedback according to the plurality of reasonable degrees and the corresponding actual display intensities includes:
[0016] Determine an expression between each of the reasonable degrees and the corresponding actual display strength;
[0017] The target display intensity is determined based on a plurality of the expressions.
[0018] Optionally, determining the target display strength according to a plurality of the expressions includes:
[0019] Machine learning is performed based on the multiple expressions to calculate the target display intensity.
[0020] On the other hand, the present invention also provides the following technical solutions:
[0021] A human-machine interface design device for an autonomous driving vehicle, comprising:
[0022] An acquisition module is used to obtain the confidence of the autonomous driving system during each autonomous driving process of the vehicle, the driver's feedback status on the autonomous driving function each time, and the actual display intensity of each type of information in each version of the human-machine interface;
[0023] A determination module, used for determining the rationality of each feedback of the driver according to the confidence level and the feedback state;
[0024] A target display intensity for each type of information that enables the driver to provide the most reasonable feedback is determined based on the plurality of reasonable degrees and the corresponding actual display intensities.
[0025] On the other hand, the present invention also provides the following technical solutions:
[0026] A computer device comprises a memory, a processor and a computer program stored in the memory, wherein the processor executes the computer program to implement the steps of any method for designing a human-machine interface for an autonomous vehicle.
[0027] On the other hand, the present invention also provides the following technical solutions:
[0028] A computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps of any method for designing a human-machine interface for an autonomous vehicle.
[0029] One or more technical solutions provided by the present invention have at least the following technical effects or advantages:
[0030] The present invention determines the rationality of each driver's feedback according to the confidence of the automatic driving system and the driver's feedback status on the automatic driving function, obtains a combination of the rationality of a large number of driver feedback and the actual display strength of human-machine interface information, determines the target display strength of the human-machine interface information that makes the driver's feedback most reasonable according to the combination of the rationality of a large number of driver feedback and the actual display strength of the human-machine interface information, and after setting each information of the human-machine interface based on the target display strength of each information, the human-machine interface that makes the driver's feedback most reasonable can be obtained, which means that the rationality of the human-machine interface is improved, and the driver can reasonably use the automatic driving function of the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS
[0031] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings in the following description are some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying any creative work.
[0032] Figure 1 Flow chart of a method for designing a human-machine interface for an autonomous driving vehicle in an embodiment of the present invention;
[0033] Figure 2 Schematic diagram of a human-machine interface design device for an autonomous driving vehicle in an embodiment of the present invention. DETAILED DESCRIPTION
[0034] The embodiments of the present invention solve the technical problem of how to make the human-machine interface of an autonomous driving vehicle more reasonable by providing a method and device for designing the human-machine interface of an autonomous driving vehicle.
[0035] In order to better understand the technical solution of the present invention, the technical solution of the present invention will be described in detail below in conjunction with the accompanying drawings and specific implementation methods.
[0036] like Figure 1 As shown, the human-machine interface design method for an autonomous driving vehicle according to an embodiment of the present invention includes:
[0037] Step S1, obtaining the confidence of the autonomous driving system during each autonomous driving process of the vehicle, the feedback status of the driver on the autonomous driving function each time, and the actual display intensity of each type of information in each version of the human-machine interface;
[0038] Step S2, determining the rationality of each feedback of the driver according to the confidence of the automatic driving system and the feedback status of the driver;
[0039] Step S3, determining the target display intensity of each information in the human-machine interface that enables the driver to give the most reasonable feedback according to the multiple reasonable degrees and the corresponding actual display intensities.
[0040] Among them, the confidence represents the state of the autonomous driving system, that is, the reliability and robustness of the autonomous driving system. The system state represented by the confidence may include a good system state, a general system state, a system that may be about to exit, a system that exits or is ready to exit. During each autonomous driving process, the confidence of the autonomous driving system is taken as a known value. For example, a confidence of A represents a good system state, a confidence of B represents a general system state, a confidence of C represents a system that may be about to exit, and a confidence of D represents a system that exits or is ready to exit. The confidence of the autonomous driving system can be obtained from the in-vehicle infotainment system (IVI).
[0041] During an autonomous driving process, the driver may provide multiple feedbacks to the autonomous driving function, and each feedback will result in a feedback status, which may include no feedback, supervision status, active takeover status, and passive takeover status. The supervision status represents that the driver supervises the autonomous driving function, the active takeover status represents that the driver actively takes over the vehicle, and the passive takeover status represents that the driver passively takes over the vehicle. For example, a feedback status of E represents no feedback, a feedback status of F represents a supervision status, a feedback status of G represents an active takeover status, and a feedback status of H represents a passive takeover status. Among them, the driver's no feedback and supervision status can be identified by the driver monitoring system (DMS), and the driver's active takeover status and passive takeover status can be identified by the steering wheel angle signal and the accelerator brake pedal signal.
[0042] Among them, the information displayed in the human-computer interface may include information related to autonomous driving, takeover reminder information and driver-related information. The information related to autonomous driving may include vehicle location information, weather information, lane line information, information on pedestrians and vehicles around the vehicle, vehicle speed information, vehicle next action information (such as braking, steering, U-turn, changing lanes), etc. The takeover reminder information may include visual reminder information, auditory reminder information and tactile reminder information. The driver-related information may include driver status information (normal, fatigue or distracted), driver takeover information (whether holding the steering wheel, whether actively braking), and non-driving input information input by the driver into the vehicle (including infotainment, voice input, etc.).
[0043] The display intensity of information in the human-computer interface represents whether the information is displayed and the display intensity. The display intensity of visual reminder information is the eye-catching degree of the displayed content, the display intensity of auditory reminder information is the volume and frequency of the sound, and the display intensity of tactile reminder information is the amplitude and frequency of the vibration. For example, the display intensity of information is 0, which means that the information is not displayed, and the display intensity of information is 1, which means the maximum display intensity. i can represent the serial number of the information, wi represents the actual display intensity of the i-th information, and the value range of wi is 0 to 1. After each version of the human-computer interface is determined, the actual display intensity of each type of information in the human-computer interface is determined, and the display result f of this version of the human-computer interface can be obtained. HMI =w1+w2+…+wn, where n is the total number of information types.
[0044] Among them, step S2 may include: determining the rationality value corresponding to each combination of confidence and corresponding feedback state; calculating the rationality according to multiple rationality values. In the embodiment of the present invention, there are 4 kinds of confidence, 4 kinds of feedback states, and 16 kinds of combinations of confidence and feedback states. Only when the combination of confidence and feedback state is AE, BF, CG and DH, it represents that the driver's feedback is reasonable, and the other combinations represent that the driver's feedback is unreasonable. Of course, reasonable feedback and unreasonable feedback are also graded. For example, the range of the rationality value can be -10 to 10, the range of the rationality value of the reasonable feedback combination is 1-10, the larger the rationality value of the reasonable feedback combination, the more reasonable the feedback, the range of the rationality value of the unreasonable feedback combination is -1 to -10, the smaller the rationality value of the unreasonable feedback combination, the more unreasonable the feedback, and the rationality values corresponding to the 16 combinations of confidence and feedback states can be shown in Table 1.
[0045] Table 1
[0046]
[0047]
[0048] In Table 1, the 1st to 12th combinations are unreasonable feedback combinations, and the 13th to 16th combinations are reasonable feedback combinations. It can be seen that when the confidence level of the autonomous driving system is that the system state is normal, the driver's feedback state is the most reasonable when it is the supervisory state, and when the confidence level of the autonomous driving system is that the system exits or is about to exit, the driver's feedback state is the most unreasonable when it is no feedback. Let j represent the combination number of confidence level and feedback state, yj represent the rationality value corresponding to the jth combination, and Y represent the rationality of the corresponding feedback, then Y = y1 + y2 + y3 + ... + y15 + y16, the smaller Y is, the more reasonable the driver's feedback is.
[0049] After a lot of experiments, we can get the display results of each human-computer interface. HMIThe reasonableness level Y of the corresponding driver feedback, then step S3 can select the display result f corresponding to the minimum Y value from a large number of reasonableness levels Y. HMI As the target display intensity of various information in the required human-machine interface, after setting each information of the human-machine interface based on the target display intensity of each information, the human-machine interface that makes the driver's feedback most reasonable can be obtained, which improves the rationality of the human-machine interface. Of course, step S3 may also include: determining an expression between each reasonable degree and the corresponding actual display intensity; determining the target display intensity according to multiple expressions. Among them, determining the target display intensity according to multiple expressions includes: performing machine learning based on multiple expressions to calculate the target display intensity. The expression between the reasonable degree and the corresponding actual display intensity can be set as Y=f HMI +w0, get each f HMI After the corresponding Y is calculated, the corresponding w0 can be obtained. HMI and the corresponding expression between Y, a large number of Y = f HMI The expression of +w0 constitutes the knowledge graph of human-computer interface design, and machine learning can be performed based on a large number of expressions to infer the target display intensity of each type of information in the required human-computer interface.
[0050] It can be seen from the above that the human-machine interface design method for an autonomous driving vehicle in an embodiment of the present invention determines the rationality of each driver's feedback according to the confidence of the autonomous driving system and the driver's feedback status on the autonomous driving function, and obtains a combination of the rationality of a large number of driver feedback and the actual display strength of the human-machine interface information. According to the combination of the rationality of a large number of driver feedback and the actual display strength of the human-machine interface information, the target display strength of the human-machine interface information that makes the driver's feedback most reasonable is determined. After setting each information of the human-machine interface based on the target display strength of each information, the human-machine interface that makes the driver's feedback most reasonable can be obtained. This improves the rationality of the human-machine interface, and enables the driver to reasonably use the vehicle's autonomous driving function.
[0051] like Figure 2 As shown, the embodiment of the present invention also provides a human-machine interface design device for an autonomous driving vehicle, comprising:
[0052] An acquisition module is used to obtain the confidence of the autonomous driving system during each autonomous driving process of the vehicle, the driver's feedback status on the autonomous driving function each time, and the actual display intensity of each type of information in each version of the human-machine interface;
[0053] A determination module, used for determining the rationality of each feedback of the driver according to the confidence level and the feedback state;
[0054] The target display intensity of each information that enables the driver to give the most reasonable feedback is determined according to a plurality of reasonable degrees and corresponding actual display intensities.
[0055] Furthermore, the system status represented by the confidence level may include a good system status, a general system status, a system that may be about to exit, a system exited, or a system ready to exit.
[0056] Furthermore, the feedback state may include no feedback, a monitoring state, an active takeover state, and a passive takeover state.
[0057] Furthermore, the information includes information related to autonomous driving, takeover reminder information and driver related information.
[0058] Furthermore, the determination module can also be used to:
[0059] Determine a reasonableness value corresponding to each combination of confidence level and corresponding feedback state;
[0060] The reasonableness is calculated based on a plurality of reasonableness values.
[0061] Furthermore, the determination module can also be used to:
[0062] Determine the expression between each reasonable degree and the corresponding actual demonstration intensity;
[0063] Determines target impression strength based on multiple expressions.
[0064] Furthermore, the determination module can also be used to:
[0065] Perform machine learning based on multiple expressions to calculate target display strength.
[0066] Based on the same inventive concept as the aforementioned method for designing a human-machine interface for an autonomous vehicle, an embodiment of the present invention further provides a computer device, comprising a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the steps of any of the aforementioned methods for designing a human-machine interface for an autonomous vehicle.
[0067] Among them, the bus architecture (represented by the bus), the bus can include any number of interconnected buses and bridges, and the bus links various circuits including one or more processors represented by the processor and memory represented by the memory. The bus can also link various other circuits such as peripherals, voltage regulators, and power management circuits together, which are all well known in the art and are therefore not further described herein. The bus interface provides an interface between the bus and the receiver and transmitter. The receiver and transmitter can be the same element, namely a transceiver, which provides a unit for communicating with various other devices on a transmission medium. The processor is responsible for managing the bus and general processing, while the memory can be used to store data used by the processor when performing operations.
[0068] Since the computer device introduced in the embodiment of the present invention is a computer device used to implement the human-machine interface design method for an autonomous vehicle in the embodiment of the present invention, based on the human-machine interface design method for an autonomous vehicle introduced in the embodiment of the present invention, a person skilled in the art can understand the specific implementation of the computer device in the embodiment of the present invention and its various variations, so how the computer device implements the method in the embodiment of the present invention is not described in detail here. As long as a person skilled in the art implements the computer device used in the human-machine interface design method for an autonomous vehicle in the embodiment of the present invention, it belongs to the scope of protection of the present invention.
[0069] Based on the same inventive concept as the above-mentioned method for designing a human-machine interface for an autonomous vehicle, the present invention also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of any of the above-mentioned methods for designing a human-machine interface for an autonomous vehicle.
[0070] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0071] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including an instruction device, which implements the functions specified in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0072] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0073] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.
[0074] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.
Claims
1. A method for designing a human-machine interface for an autonomous driving vehicle, characterized in that: include: Obtain the confidence of the autonomous driving system during each autonomous driving process of the vehicle, the driver's feedback status on the autonomous driving function each time, and the actual display intensity of each type of information in each version of the human-machine interface; Determining the rationality of each feedback of the driver according to the confidence level and the feedback state; A target display intensity for each type of information that enables the driver to provide the most reasonable feedback is determined based on the plurality of reasonable degrees and the corresponding actual display intensities.
2. The method for designing a human-machine interface for an autonomous driving vehicle according to claim 1, wherein: The system status represented by the confidence level includes a good system status, a general system status, a system that may be about to exit, and a system that has exited or is about to exit.
3. The method for designing a human-machine interface for an autonomous driving vehicle according to claim 1, wherein: The feedback status includes no feedback, supervision status, active takeover status, and passive takeover status.
4. The method for designing a human-machine interface for an autonomous driving vehicle according to claim 1, wherein: The information includes information related to autonomous driving, takeover reminder information and driver related information.
5. The method for designing a human-machine interface for an autonomous driving vehicle according to claim 1, wherein: Determining the rationality of each feedback of the driver according to the confidence level and the feedback state includes: Determine a rationality value corresponding to each combination of the confidence level and the corresponding feedback state; The reasonableness is calculated based on a plurality of the reasonableness values.
6. The method for designing a human-machine interface for an autonomous driving vehicle according to claim 1, wherein: Determining the target display intensity of each type of information that enables the driver to give the most reasonable feedback based on the plurality of reasonable degrees and the corresponding actual display intensity includes: Determine an expression between each of the reasonable degrees and the corresponding actual display strength; The target display intensity is determined based on a plurality of the expressions.
7. The method for designing a human-machine interface for an autonomous driving vehicle according to claim 6, wherein: The target display strength is determined according to a plurality of the expressions, including: Machine learning is performed based on the multiple expressions to calculate the target display intensity.
8. A human-machine interface design device for an autonomous driving vehicle, characterized in that: include: An acquisition module is used to obtain the confidence of the autonomous driving system during each autonomous driving process of the vehicle, the driver's feedback status on the autonomous driving function each time, and the actual display intensity of each type of information in each version of the human-machine interface; A determination module, used for determining the rationality of each feedback of the driver according to the confidence level and the feedback state; A target display intensity for each type of information that enables the driver to provide the most reasonable feedback is determined based on the plurality of reasonable degrees and the corresponding actual display intensities.
9. A computer device, characterized in that: The invention comprises a memory, a processor and a computer program stored in the memory, wherein the processor executes the computer program to implement the steps of the method according to any one of claims 1 to 7.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.
Citation Information
Patent Citations
Automatic driving interface display method, device and vehicle
CN110109453A
Interface display control method and device, vehicle-mounted terminal and storage medium
CN113232675A
Information display method, vehicle-mounted equipment, electronic device and storage medium
CN115248706A
Intelligent driving cabin dynamic interface custom display method
CN116302237A
Vehicle navigation method, device and equipment based on automatic driving and storage medium
CN117537828A
