Evaluation method, device and evaluation system for human-computer interaction system of vehicle

Abstract

The present application discloses an evaluation method, device and evaluation system for a human-computer interaction system of a vehicle. The evaluation method for the human-computer interaction system of a vehicle includes: obtaining human interaction data generated by the interaction between the person under test and the human-computer interaction system of the vehicle and external data associated with the vehicle's driving under the target driving test scenario; and based on the human interaction data and external data, evaluating the interactive elements in the human-computer interaction system to obtain evaluation data for the interactive elements. The evaluation method for the human-computer interaction system of a vehicle of the present application can comprehensively evaluate the human-computer interaction system of the vehicle, and the evaluation data can be used as a basis for optimizing the design of the human-computer interaction system to improve the user experience of the human-computer interaction system of the vehicle.

Description

Technical Field

[0001] The present application relates to technical fields such as transportation, human factors intelligence, and human-computer interaction, and in particular to an evaluation method, device, and evaluation system for a vehicle's human-computer interaction system. Background Art

[0002] The technology of the vehicle's human-machine interaction system is mainly concentrated in the core hardware development and software algorithm development of HUD (Head Up Display) and HMI (Human Machine Interface), but HMI / HUD is not evaluated from a comprehensive evaluation perspective. In addition, the existing design evaluation system is applicable to a single scenario, mainly focusing on subjective evaluation, lacking multi-dimensional comprehensive evaluation, and ignoring the construction of a comprehensive HUD / HMI evaluation system. Summary of the invention

[0003] The embodiments of the present application aim to solve at least one of the technical problems in the related art to a certain extent. To this end, the embodiment of the present application aims to provide a method, device, evaluation system, electronic device, storage medium and computer program product for evaluating a human-computer interaction system of a vehicle.

[0004] An embodiment of the present application provides a method for evaluating a human-computer interaction system of a vehicle, the method comprising: in a target driving test scenario, obtaining human interaction data generated by the interaction between a person under test and the human-computer interaction system of the vehicle and external data associated with the vehicle's driving; and based on the human interaction data and the external data, evaluating the interactive elements in the human-computer interaction system to obtain evaluation data for the interactive elements.

[0005] Exemplarily, the evaluating of the interactive elements in the human-computer interaction system based on the human interaction data and the external data includes: processing the human interaction data and the external data to obtain processed data and preliminary evaluation results; and processing the processed data and the preliminary evaluation results based on evaluation rule data to obtain evaluation data for the interactive elements.

[0006] Exemplarily, the processing of the human interaction data and the external data to obtain processed data and preliminary evaluation results includes: preprocessing the human interaction data and the external data to obtain preprocessing results as the processed data, wherein the preprocessing results include at least one of labeling the human interaction data and the external data, dividing data segments, determining the information of interest of the tested person to the human-computer interaction system, and data smoothing; and obtaining the preliminary evaluation results based on the preprocessing results, wherein the preliminary evaluation results include at least one of the correlation information between the human interaction data and the external data and the evaluation information for the interactive elements.

[0007] Exemplarily, the evaluation data includes evaluation scores, and the evaluation rule data includes evaluation indicators and scores corresponding to the evaluation indicators; based on the evaluation rule data, the processed data and the preliminary evaluation results are processed to obtain evaluation data for the interactive elements, including: processing the processed data and the preliminary evaluation results to obtain indicator values ​​corresponding to the evaluation indicators; and obtaining evaluation scores for the interactive elements based on the indicator values ​​and the scores corresponding to the evaluation indicators.

[0008] Exemplarily, the evaluating the interactive elements in the human-computer interaction system based on the human interaction data and the external data includes: obtaining subjective evaluation data for the interactive elements in the human-computer interaction system; and evaluating the interactive elements in the human-computer interaction system based on the human interaction data, the external data and the subjective evaluation data.

[0009] Exemplarily, the method further includes: evaluating the evaluation rule data, wherein the evaluation rule data includes at least one of basic evaluation data, experience evaluation data, and custom evaluation data.

[0010] Exemplarily, the evaluating the evaluation rule data includes: based on the evaluation rule data, in other driving test scenarios different from the target driving test scenarios, evaluating the interactive elements in the human-computer interaction system to obtain objective evaluation results; in the other driving test scenarios, obtaining subjective evaluation results for the interactive elements in the human-computer interaction system; and based on the objective evaluation results and the subjective evaluation results, obtaining an evaluation result for the evaluation rule data.

[0011] Exemplarily, the method also includes: selecting the target driving test scenario from candidate driving test scenarios; acquiring driving environment information for the target driving test scenario based on a data acquisition method corresponding to the target driving test scenario; and displaying the driving environment information in the human-computer interaction system to facilitate the person under test to interact with the human-computer interaction system based on the driving environment information to control the driving of the vehicle.

[0012] Exemplarily, the method further includes: obtaining updated driving environment information after the person under test interacts with the human-computer interaction system to control the driving of the vehicle based on the driving environment information; and displaying the updated driving environment information in the human-computer interaction system.

[0013] Exemplarily, the candidate driving test scenarios include at least one of the following: a virtual driving test scenario, and the data acquisition method corresponding to the virtual driving test scenario includes at least one of a method of generating data based on virtual software and a method of collecting data through virtual sensors; a virtual-reality combined driving test scenario, and the data acquisition method corresponding to the virtual-reality combined driving test scenario includes at least one of a method of generating data based on virtual software, a method of collecting data through virtual sensors, a method of collecting data through real sensors, and a method of receiving data from external devices; a real driving test scenario, and the data acquisition method corresponding to the real driving test scenario includes at least one of a method of collecting data through real sensors and a method of receiving data from external devices.

[0014] Exemplarily, the virtual driving test scene includes: a virtual vehicle cockpit, a virtual human-computer interaction system, and a virtual driving simulation environment; the virtual-reality combined driving test scene includes: a real vehicle cockpit, a real human-computer interaction system, and a virtual driving simulation environment; the real driving test scene includes: a real vehicle cockpit, a real human-computer interaction system, and a real driving environment.

[0015] Exemplarily, the method also includes: receiving editing data for the human-computer interaction system, wherein the editing data is used to edit at least one of the display content, interaction method, and display form of the interactive element; and based on the editing data, generating the human-computer interaction system, and displaying the human-computer interaction system to facilitate the tester to interact with the human-computer interaction system.

[0016] Exemplarily, the human-computer interaction system includes at least one of the following: a vehicle head-up display system, an instrument panel, an instrument, a central control screen, a co-pilot interaction device, and an entertainment screen; the human interaction data includes at least one of the following: physiological data of the person being measured, eye movement data of the person being measured, electroencephalogram data of the person being measured, hand operation trajectory data of the person being measured, motion posture data of the person being measured, facial data of the person being measured, and voice data of the person being measured; at least one of the following external data associated with vehicle driving: vehicle driving data, external traffic data, external environment data, and voice data of the human-computer interaction system.

[0017] Another embodiment of the present application provides an evaluation system, which includes: a deployment subsystem, configured to edit a human-computer interaction system, generate the human-computer interaction system, display the human-computer interaction system, select a target driving test scenario, obtain driving environment information for the target driving test scenario and display the driving environment information in the human-computer interaction system; an evaluation subsystem, configured to obtain human interaction data generated by the interaction between a test person and a vehicle's human-computer interaction system and external data associated with vehicle driving in the target driving test scenario; based on the human interaction data and the external data, evaluate the interactive elements in the human-computer interaction system to obtain evaluation data for the interactive elements; and a data communication module, configured to send the human interaction data and the external data from the deployment subsystem to the evaluation subsystem.

[0018] Another embodiment of the present application provides an evaluation device for a vehicle's human-computer interaction system, the device comprising: an acquisition module, for acquiring, in a target driving test scenario, human interaction data generated by the interaction between a person under test and the vehicle's human-computer interaction system, as well as external data associated with vehicle driving; and an evaluation module, for evaluating the interactive elements in the human-computer interaction system based on the human interaction data and the external data, to obtain evaluation data for the interactive elements.

[0019] Another embodiment of the present application provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the steps of the method described in any one of the above embodiments are implemented.

[0020] Another embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the method described in any one of the above embodiments are implemented.

[0021] Another embodiment of the present application provides a computer program product, which includes instructions. When the instructions are executed by a processor of a computer device, the computer device can perform the steps of the method described in any of the above embodiments.

[0022] In the above implementation, in the target driving test scenario, the human interaction data generated by the interaction between the person under test and the human-computer interaction system of the vehicle and the external data associated with the vehicle driving are obtained; and based on the human interaction data and the external data, the interactive elements in the human-computer interaction system are evaluated to obtain the evaluation data for the interactive elements. The evaluation method of the human-computer interaction system of the vehicle of the present application can comprehensively evaluate the human-computer interaction system of the vehicle, and the evaluation data can be used as the basis for the optimization design of the human-computer interaction system to improve the user experience of the human-computer interaction system of the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 A flow chart of a method for evaluating a human-computer interaction system of a vehicle provided in an embodiment of the present application;

[0024] Figure 2 A schematic diagram of an evaluation system for a human-computer interaction system of a vehicle provided in an embodiment of the present application;

[0025] Figure 3 A flowchart of a human-computer interaction system generated based on edited data provided in an embodiment of the present application;

[0026] Figure 4 A flowchart for selecting a target driving test scenario provided in an embodiment of the present application;

[0027] Figure 5 A flowchart for displaying updated driving environment information provided by an embodiment of the present application;

[0028] Figure 6 A flow chart for evaluating interactive elements in a human-computer interaction system provided in an embodiment of the present application;

[0029] Figure 7 A flowchart for preprocessing human interaction data and external data provided in an embodiment of the present application;

[0030] Figure 8 A flowchart for processing the processed data and preliminary evaluation results provided for the implementation mode of the present application;

[0031] Fig. 9 A flow chart for subjective evaluation of a human-computer interaction system provided in an embodiment of the present application;

[0032] Fig.10A flowchart for evaluating evaluation rule data provided for an implementation method of the present application;

[0033] Fig.11 A schematic diagram of an evaluation system provided for an embodiment of the present application;

[0034] Fig.12 A schematic diagram of a device for evaluating a human-machine interaction system of a vehicle provided in an embodiment of the present application;

[0035] Fig.13 A block diagram of an electronic device provided for an embodiment of the present application. DETAILED DESCRIPTION

[0036] Embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.

[0037] The technology of the vehicle's human-machine interaction system is mainly concentrated in the core hardware development and software algorithm development of HUD (Head Up Display) and HMI (Human Machine Interface), but HMI / HUD is not evaluated from a comprehensive evaluation perspective. In addition, the existing design evaluation system is applicable to a single scenario, mainly focusing on subjective evaluation, lacking multi-dimensional comprehensive evaluation, and ignoring the construction of a comprehensive HUD / HMI evaluation system.

[0038] This application proposes a set of HMI / HUD intelligent flexible comprehensive evaluation system, which mainly focuses on two core contents: HMI / HUD design flexible deployment platform and HMI / HUD multi-dimensional intelligent evaluation system. Both HUD and HMI in the vehicle can perform human-computer interaction. In addition, the interfaces that can perform human-computer interaction on the vehicle can also include central control screen, instrument panel, etc., which can be evaluated in this application.

[0039] Figure 1 It is a flow chart of a method for evaluating a human-computer interaction system of a vehicle according to an embodiment of the present application.

[0040] like Figure 1 As shown, the evaluation method of the vehicle's human-computer interaction system includes S1-S2.

[0041] S1, in a target driving test scenario, obtaining human interaction data generated by the interaction between the person under test and the human-computer interaction system of the vehicle and external data associated with the vehicle's driving.

[0042] S2, based on human interaction data and external data, evaluates the interactive elements in the human-computer interaction system to obtain evaluation data for the interactive elements.

[0043] Exemplarily, the target driving scene can be a virtual driving scene, a real driving scene, or a driving scene that combines the virtual and the real. After determining the target driving scene, the person being tested drives the vehicle in the target driving scene and interacts with the human-computer interaction system on the vehicle. For example, the person being tested can obtain navigation information, multimedia information, driving speed and other information by watching the vehicle's head-up display system. The act of watching can be regarded as a gaze behavior and an interactive behavior. The person being tested can control the human-computer interaction interface by voice, and voice control is also an interactive behavior. Interaction methods include manual interaction, visual interaction, voice interaction, etc. Manual interaction includes clicking, sliding, pressing, etc.

[0044] Obtain the human interaction data generated by the interaction between the person under test and the vehicle's human-computer interaction system, as well as external data related to vehicle driving. Based on the human interaction data and external data, evaluate the interactive elements in the human-computer interaction system. For example, evaluate a certain interface or a certain control in the vehicle's head-up display system based on the human interaction data and external data to obtain evaluation data for the interactive elements. The evaluation content at least includes the evaluation of design elements such as interface style and form, interaction method, etc. in the human-computer interaction system. Design elements include styles such as color, proportion, position, text, number, voice, etc., as well as different interaction methods.

[0045] In the target driving test scenario, the embodiments of the present application support the deployment of a custom designed human-computer interaction system. The vehicle driver interacts with the human-computer interaction system, and can record multi-dimensional data such as interaction, human factors, traffic and vehicle. Data analysis is performed based on multi-factor data. Combined with evaluation benchmarks, the human-computer interaction system can be comprehensively evaluated. The evaluation data can be used as a basis for optimizing the design of the human-computer interaction system to enhance the user experience of the vehicle human-computer interaction system.

[0046] As an example, the human-computer interaction system includes at least one of the following: a vehicle head-up display system, a dashboard, an instrument, a central control screen, a co-pilot interaction device, and an entertainment screen.

[0047] As an example, the human interaction data includes at least one of the following: physiological data of the person being measured, eye movement data of the person being measured, EEG data of the person being measured, hand operation trajectory data of the person being measured, motion posture data of the person being measured, facial data of the person being measured, and voice data of the person being measured.

[0048] As an example, the external data associated with the driving of a person and a vehicle includes at least one of the following: driving data of the vehicle, external traffic data, external environment data, and voice data of the human-computer interaction system. The driving data of the vehicle includes, for example, vehicle turning data, data of the pedal being stepped on, and the like. The external traffic data includes, for example, the driving trajectory data of the current vehicle, the driving trajectory data of other vehicles around, and the like. The external environment data includes, for example, weather data, lighting data, sound or voice data in the environment, and the like. The voice data of the human-computer interaction system includes, for example, the voice emitted by the human-computer interaction system in response to the instructions of the person being tested when the person being tested interacts with the human-computer interaction system.

[0049] Exemplarily, human interaction data of the person being measured and external data associated with vehicle travel can be collected through various types of sensors. External data associated with vehicle travel can also be collected through external devices. For example, the external device can be a mobile phone, a vehicle-road coordination system, etc., to obtain external data such as navigation map information. The vehicle can interact with the external device to receive data sent by the external device.

[0050] The evaluation method of the human-computer interaction system of the vehicle of the present application can evaluate the interaction adaptability between the human-computer interaction system of the vehicle and the person being tested, so as to develop a more suitable vehicle human-computer interaction system and improve the driving experience. In addition, it also supports the deployment of a custom designed human-computer interaction system. The vehicle driver interacts with the human-computer interaction system, and can record multi-dimensional data such as interaction, human factors, traffic and vehicles. Based on multi-factor data, data analysis can be performed, and combined with the evaluation benchmark, the human-computer interaction system can be comprehensively evaluated. The evaluation data can be used as the basis for the optimization design of the human-computer interaction system to enhance the user experience of the vehicle human-computer interaction system. And the human-computer interaction system of the vehicle is evaluated based on multi-dimensional human factors interaction data and external data, so that the evaluation results are more accurate.

[0051] It can be understood that the evaluation method of the present application can not only test the compatibility between the human-computer interaction system and the person being tested, but also evaluate the human-computer interaction plan, evaluate the quality of the interaction plan, and optimize the design of the interaction plan.

[0052] Figure 2 It is a schematic diagram of an evaluation system for a human-computer interaction system of a vehicle according to an embodiment of the present invention.

[0053] like Figure 2 As shown, the evaluation system of the vehicle's human-computer interaction system mainly includes three parts: deployment platform, data communication module / plug-in, and intelligent evaluation system.

[0054] The deployment platform includes: the person under test, the virtual / real driving environment, the HMI / HUD display and control system, the editing software, and the interactive interface. The person under test interacts with the HMI / HUD display and control system to enable the person under test to control the virtual / real driving environment. Data communication can be carried out between the virtual / real driving environment and the HMI / HUD display and control system. The interactive interface is edited by programming software. The editing software includes the HUD / HMI interface editing software. The content of the interactive interface, the interface communication method, the interface interaction method, etc. can be defined through the editing software. For example, the style and interaction method of the interactive interface can be defined through the editing software. The interaction method can be, for example, through voice or touch interaction. After the defined interactive interface is generated, the defined interactive interface is deployed and configured in the display and control system for display, so that the person under test can interact with the interactive interface during the test.

[0055] The data communication module / plug-in sends the collected multi-dimensional data to the intelligent evaluation system, where the multi-dimensional data includes the human interaction data generated by the interaction between the above-mentioned person under test and the human-computer interaction system of the vehicle and external data related to vehicle driving. Through the data communication module / plug-in, the multi-dimensional information communication between the HUD / HMI deployment platform and the multi-dimensional intelligent evaluation system is opened up for intelligent evaluation. The data communication module / plug-in transmits the human interaction data and external data to the intelligent evaluation system, so that the intelligent evaluation system can evaluate the interactive elements in the human-computer interaction system based on the human interaction data and external data.

[0056] As an example, the data communication module / plug-in can collect the human interaction data and external data of the person under test during driving through the data acquisition device. The human interaction data includes physiological data, eye movement data, EEG data, hand operation trajectory data, motion posture data, facial data, and voice data, among which the human interaction data is for the person under test. The external data associated with vehicle driving includes vehicle driving data, external traffic data, external environment data, and voice data of the human-computer interaction system. The vehicle driving data includes, for example, vehicle turning data and data on the pedal being stepped on. External traffic data includes, for example, the driving trajectory of the current vehicle and the driving trajectory of other vehicles around. External environment data is for the external environment, such as weather data, lighting data, voice in the environment, and so on. The voice data of the human-computer interaction system includes the voice of the interactive system. The data communication module / plug-in obtains and collects multi-dimensional data and transmits the data to the intelligent evaluation system. The data communication module / plug-in is divided into multiple solutions such as actual sensors, virtual sensors, and virtual-real combined sensors according to the test stage.

[0057] Based on the collected human interaction data and external data, the intelligent evaluation system analyzes and evaluates the data to obtain evaluation data for interactive elements. The evaluation data can include evaluation scores, evaluation reports, etc. The evaluation report contains qualitative analysis and quantitative evaluation. At the same time, the evaluation results of the intelligent evaluation system can also be used to optimize the design of the deployment platform. In addition, the data communication module / plug-in can also support data communication between the virtual / real driving environment and the HMI / HUD display and control system in the deployment platform.

[0058] As an example, the intelligent evaluation system mainly includes three modules: data acquisition module, data analysis module, and intelligent evaluation module. The data acquisition module often collects data through hardware acquisition equipment and transmits information in combination with the data communication interface. The data analysis module processes the collected human interaction data and external data. The intelligent evaluation module evaluates the interactive elements in the human-computer interaction system.

[0059] The flexibility of the vehicle's human-machine interaction system evaluation system (i.e., HMI and HUD intelligent flexible comprehensive evaluation system) is mainly reflected in:

[0060] 1) The test scenario is flexible and can take into account both virtual simulation and real vehicle testing.

[0061] 2) The test content is diverse and can evaluate various human-computer interaction solutions such as HMI / HUD / HCI. It also supports custom design of human-computer interaction content based on the human-computer interaction editing software, including color, text, shape, proportion, voice, interaction mode and other interactive contents.

[0062] 3) The test module supports custom selection. Different test module combinations can be used to propose custom test solutions based on test requirements.

[0063] The comprehensive focus of the vehicle human-machine interaction system evaluation system (i.e., HMI and HUD intelligent flexible comprehensive evaluation system) is reflected in:

[0064] 1) The evaluation system includes human-computer interaction editing software, human-computer interaction deployment platform, data communication module, and human-computer interaction evaluation platform, covering the entire process of human-computer interaction design, human-computer interaction deployment, human-computer interaction evaluation data collection and analysis, and human-computer interaction evaluation.

[0065] 2) Data integration, supporting the collection of interactive data (finger trajectory, voice interaction, clicks, etc.), human factors data (eye movement, physiology, skin electricity, brain electricity, etc.), traffic data (can focus on time and space regions, analyze the impact of interactive methods on regional traffic), vehicle data (vehicle status data such as speed, heading, acceleration, and operation data), environmental data (weather, lighting, etc.), etc., supporting multi-factor analysis, laying the foundation for comprehensive evaluation. The collected data of various categories is expected to be combined with intelligent algorithms for intelligent analysis and evaluation and personalized data precipitation to form its own database. Assist in building a personalized evaluation benchmark.

[0066] 3) Comprehensive evaluation methods, including subjective scales and objective data, qualitative analysis and quantitative evaluation, and other evaluation schemes. It also supports customers to customize the analysis of the collected relevant data.

[0067] 4) In terms of evaluation benchmarks, it supports national standards, industry experience standards, etc. as benchmarks, as well as custom benchmarks and the construction of personalized evaluation benchmarks.

[0068] The following further describes the evaluation method of the human-computer interaction system of the vehicle of the present application in combination with the deployment platform, data communication module / plug-in, and intelligent evaluation system.

[0069] As an example, Figure 3 As shown, the evaluation method of the human-computer interaction system of a vehicle also includes S301-S302.

[0070] S301, receiving editing data for a human-computer interaction system, wherein the editing data is used to edit at least one of display content, interaction mode, and display form of an interactive element.

[0071] S302, generating a human-computer interaction system based on the edited data, and displaying the human-computer interaction system to facilitate the tester to interact with the human-computer interaction system.

[0072] Exemplarily, first, editing operations on the interactive interface can be received through editing software to generate editing data, the interactive interface can be edited based on the editing data, and the edited interactive interface can be configured in the HMI / HUD display control system for display. The displayed interactive interface serves as the operating interface of the human-computer interaction system. The human-computer interaction system can be the vehicle's head-up display system HUD, the vehicle's human-computer interaction interface HMI (such as the central control screen), instrument panel, instrument, co-pilot interaction device, entertainment screen, and the person being tested interacts with the human-computer interaction system through the interactive interface during the test.

[0073] As an example, the editing data is used to edit at least one of the display content, interaction mode, and display form of the interactive element. For example, the interactive interface content, interaction mode, and display form are defined by editing software. The interactive mode is, for example, through voice or touch and other methods. The defined interactive interface is deployed and configured in the HUD / HMI display control system. For example, the style and interaction mode of the interactive interface are defined by editing software, and the interaction is performed through voice or touch. After the defined interactive interface is generated, the defined interactive interface is deployed and configured in the display control system for display, so that the person under test can interact during the test.

[0074] As an example, if the current evaluation purpose is to evaluate the display position of a certain control in the HUD / HMI interface, the position of the control can be defined in the editing software, and an interactive interface can be generated. The interactive interface is configured to the HUD / HMI display control system, and the person being tested interacts with the control during driving.

[0075] The test content of this application is more flexible, and the HUD / HMI interface can be customized and deployed, including display content, display format, interaction method, etc.

[0076] As an example, Figure 4 As shown, the evaluation method of the human-computer interaction system of a vehicle also includes S401-S403.

[0077] S401: Select a target driving test scenario from candidate driving test scenarios.

[0078] S402: Acquire driving environment information for the target driving test scenario based on a data acquisition method corresponding to the target driving test scenario.

[0079] S403, displaying the driving environment information in the human-computer interaction system, so that the person under test can interact with the human-computer interaction system based on the driving environment information to control the driving of the vehicle.

[0080] Exemplarily, the candidate driving test scenarios include multiple ones, and one of the multiple candidate driving test scenarios is selected as the target driving test scenario. Different candidate driving test scenarios correspond to different data acquisition methods. According to the data acquisition method corresponding to the target driving test scenario, driving environment information is acquired, and the driving environment information includes vehicle status information, road information, traffic information, service information, intelligent perception information, etc. The driving environment information is displayed in the human-computer interaction system to facilitate the person under test to interact with the human-computer interaction system based on the driving environment information to control the vehicle driving. For example, the acquired road information around the vehicle is displayed in the HUD / HMI display control system so that the person under test can interact with the human-computer interaction system.

[0081] As an example, the HUD / HMI display and control system obtains the driving environment information of the virtual / real driving environment through a communication interface (the communication interface can be provided by a data communication module / plug-in), and the driving environment information includes vehicle status information, road information, traffic information, service information, intelligent perception information, etc. The virtual / real driving environment module includes various sensors that can obtain information about the real environment. The virtual / real driving environment module can also interact with external devices to obtain information sent by external devices. The external device can be a mobile phone, a vehicle-road coordination system, etc. For example, a navigation map can be obtained through a mobile phone. After the obtained driving environment information is processed by the HUD / HMI built-in software algorithm, it will be displayed in the HUD / HMI display and control system in multiple types such as text, image, and voice, and includes multiple styles such as images, colors, and sound effects. For example, taking the driving environment information including traffic information as an example, the positions of other vehicles or pedestrians around the collected vehicle are displayed in the HUD / HMI display and control system so that the person being tested can interact with the human-computer interaction system.

[0082] As an example, the candidate driving test scenarios include at least one of a virtual driving test scenario, a virtual-reality combined driving test scenario, and a real driving test scenario.

[0083] For a virtual driving test scenario, a data acquisition method corresponding to the virtual driving test scenario includes at least one of a method of generating data based on virtual software and a method of collecting data through a virtual sensor.

[0084] For the virtual-reality combined driving test scenario, the data acquisition method corresponding to the virtual-reality combined driving test scenario includes at least one of a method of generating data based on virtual software, a method of collecting data through virtual sensors, a method of collecting data through real sensors, and a method of receiving data from external devices.

[0085] For a real driving test scenario, the data acquisition method corresponding to the real driving test scenario includes at least one of a method of collecting data through a real sensor and a method of receiving data from an external device.

[0086] Exemplarily, the candidate driving test scenarios include virtual driving test scenarios, virtual-reality combined driving test scenarios, and real driving test scenarios. The virtual driving test scenario can simulate vehicles, driving environments, virtual people, etc. through simulation tools, and collect human factors interaction data generated by the interaction between the person under test and the human-computer interaction system of the vehicle and external data associated with the vehicle's driving through virtual tools. The virtual tools can be virtual software, virtual sensors, etc. For example, the human factors interaction data of the person under test and external data associated with the vehicle's driving are collected through virtual software and virtual sensors. In addition to the data acquisition methods corresponding to the above-mentioned virtual driving test scenarios, the virtual-reality combined driving test scenario can also obtain human factors interaction data and external data through real sensors and external devices. For example, a navigation map is obtained through a mobile phone. The real driving test scenario is a real road test, and its corresponding data acquisition method is human factors interaction data and external data collected through real sensors and real external devices.

[0087] Specifically, the test plan supports testing in a virtual simulated driving environment, reading vehicle and traffic data through the communication module, and obtaining human factor data through human factor measurement sensors such as eye trackers and physiological bracelets; it also supports real-car on-site testing, obtaining relevant operation information through sensors, and combining communication module transmission records. You can select virtual simulated driving environment testing or real-car on-site testing based on test conditions and stages.

[0088] The human-computer interaction system supports three forms of virtual deployment, virtual-real combined deployment and hardware deployment. For example, HUD virtual deployment floats on the driving screen with a transparent background. It is deployed through hardware such as the central control screen.

[0089] As an example, the virtual driving test scene includes: a virtual vehicle cockpit, a virtual human-computer interaction system, and a virtual driving simulation environment. The virtual-real driving test scene includes: a real vehicle cockpit, a real human-computer interaction system, and a virtual driving simulation environment. The real driving test scene includes: a real vehicle cockpit, a real human-computer interaction system, and a real driving environment.

[0090] As an example, the HUD / HMI display and control system is divided into a pure virtual simulation environment display simulation test, a virtual-reality combined environment test, and a real vehicle display and control field test according to the test stage. The target driving test scenario corresponding to the pure virtual simulation environment display simulation test is a virtual driving test scenario, and the virtual driving test scenario includes a virtual vehicle cockpit, a virtual human-computer interaction system, and a virtual driving simulation environment. The virtual-reality combined driving test scenario includes a real vehicle cockpit, a real human-computer interaction system, a virtual driving simulation environment, and a real human-computer interaction system such as HMI / HUD hardware and software. The real vehicle display and control field test includes a real driving test scenario, and the real driving test scenario includes a real vehicle cockpit, a real human-computer interaction system, and a real driving environment. The real vehicle display and control field test can also be called a road test. This application can flexibly select the test type according to the required driving scenario.

[0091] As an example, Figure 5 As shown, the evaluation method of the human-computer interaction system of a vehicle also includes S501-S502.

[0092] S501, after the person under test interacts with the human-computer interaction system to control the driving of the vehicle based on the driving environment information, updated driving environment information is obtained.

[0093] S502, displaying the updated driving environment information in the human-computer interaction system.

[0094] Exemplarily, the person under test observes the human-computer interaction system, for example, observes the HMI / HUD display control interface, interacts with it, and controls the vehicle to obtain updated driving environment information, such as updated navigation, status, service, intelligent perception and other necessary information. And the updated driving environment information is displayed in the human-computer interaction system, for example, the updated navigation information is displayed on the HMI / HUD display control interface.

[0095] As an example, the person under test obtains necessary information such as navigation, status, service, and intelligent perception by observing and interacting with the HMI / HUD interface. On this basis, the person under test makes driving decisions, operates the vehicle, and updates the vehicle and environmental information in real time after operating the vehicle, as well as the data of the display and control system in real time. This forms an information closed loop and builds a HUD / HMI design and deployment platform.

[0096] The test module of the HUD / HMI deployment platform of this application is flexible and can be used for HUD, HMI, and HUD / HMI comprehensive evaluation. There are various test types, and HUD / HMI can be subjected to pure virtual testing, virtual-reality combined testing, and real-vehicle on-site testing, that is, it can be virtually driven in a virtual environment, driving in a virtual-reality combined environment, and driving in a real environment (road). The test content is flexible, and the HUD / HMI interface can be customized and deployed, including display content, display format, interaction method, etc.

[0097] As an example, Figure 6 As shown, based on human interaction data and external data, the interactive elements in the human-computer interaction system are evaluated, including S601-S602.

[0098] S601, processing the human interaction data and external data to obtain processed data and preliminary evaluation results.

[0099] S602, based on the evaluation rule data, processing the processed data and the preliminary evaluation results to obtain evaluation data for the interactive elements.

[0100] Exemplarily, human interaction data and external data are preliminarily processed to obtain processed data and preliminary evaluation results, the preliminary evaluation results, for example, preliminarily indicate whether the interaction adaptability between the interaction element and the person being tested is high enough, or the preliminary evaluation results include preliminary evaluation data for the interaction element, and the final evaluation data can be obtained based on the preliminary evaluation results. After obtaining the preliminary evaluation results, the processed data and the preliminary evaluation results are processed based on the evaluation rule data to obtain the evaluation data for the interaction element.

[0101] As an example, Figure 7 As shown, the human interaction data and external data are processed to obtain processed data and preliminary evaluation results, including S701-S702.

[0102] S701, preprocessing the human interaction data and external data to obtain preprocessing results, which can be used as processed data.

[0103] The preprocessing result includes at least one of labeling human interaction data and external data, dividing data segments, determining the information of interest of the tested person to the human-computer interaction system, and data smoothing.

[0104] S702: Obtain preliminary evaluation results based on the preprocessing results.

[0105] The preliminary evaluation results include at least one of the correlation information between human interaction data and external data and the evaluation information on the interaction elements.

[0106] Exemplarily, preprocessing the human interaction data and external data includes labeling the human interaction data and external data, dividing the data into segments, determining information of interest, and smoothing the data. For example, labeling the human interaction data and external data, such as which segment of data indicates that the vehicle is turning, and which segment of data indicates that the person under test has no response to the interactive interface. Dividing the human interaction data and external data into data segments, such as which segment of data indicates that the vehicle is driving on a straight road section. Dividing the human interaction data and external data into regions of interest, such as dividing the area where the person under test is looking at, etc. With the help of built-in algorithms, the human interaction data and external data can be smoothed and other preprocessing operations can be performed to obtain preprocessing results. Based on the preprocessing results, a preliminary evaluation result is obtained.

[0107] As an example, taking the evaluation of controls on the interactive interface as an example, for example, based on eye movement data, we know whether the user is looking at the control, and whether the position of the control on the interactive interface is appropriate. For example, based on environmental information (such as night or direct sunlight) and eye movement data (the area of ​​interest of the person being measured can be known), we know whether the position of the control on the interactive interface HUD is appropriate. For example, it is not easy for the person being measured to look at or find the control in the dark or in direct sunlight, indicating that the position of the control on the interactive interface is inappropriate. The preliminary evaluation results may also include analyzing the correlation between multi-dimensional data, and the preliminary evaluation results include correlation information between human interaction data and external data, such as whether there is a correlation between environmental data and eye movement data and the degree of correlation. The preliminary evaluation results can also be for evaluation information of interactive elements, and the preliminary evaluation results include preliminary evaluation data for interactive elements.

[0108] Specifically, in terms of evaluation methods, there are two types of evaluation: subjective evaluation and objective evaluation. Subjective evaluation includes scales, questionnaires and other forms, which evaluate the design of human-computer interaction systems through inquiries and scoring; objective evaluation includes multi-dimensional objective data such as interaction, human factors, traffic, and vehicles.

[0109] In terms of evaluation methods, there are built-in multi-dimensional data processing methods and customized processing methods. Among them, the built-in multi-dimensional data processing methods have personalized processing methods for different data, such as eye movement data support for dividing interest areas and counting eye movement characteristics in interest areas; on the other hand, there are common combing methods for data, such as data smoothing, data indicator extraction (average, median, etc.), multi-dimensional data cross analysis, etc., and also support manual labeling, dividing different data segments for quantitative analysis, such as marking different weather and road section types. Lay the foundation for the quantitative representation of evaluation results. Data indicators are helpful for manual analysis, or as data preprocessing results, they are input into the intelligent evaluation model.

[0110] In terms of evaluation results, there are qualitative evaluation results and quantitative evaluation results, which support the output of evaluation reports.

[0111] As an example, Figure 8 As shown, in one example, the evaluation data includes evaluation scores, and the evaluation rule data includes evaluation indicators and scores corresponding to the evaluation indicators; after obtaining the processed data and preliminary evaluation results, the processed data and preliminary evaluation results can be processed based on the evaluation rule data to obtain evaluation data for interactive elements, including S801-S802.

[0112] S801, processing the processed data and the preliminary evaluation results to obtain the indicator value corresponding to the evaluation indicator.

[0113] S802: Obtain an evaluation score for the interactive element based on the indicator value and the score corresponding to the evaluation indicator.

[0114] Exemplarily, the evaluation rule data includes an evaluation index and a score corresponding to the evaluation index, and the processed data and the preliminary evaluation results are processed to obtain the index value corresponding to the evaluation index. For example, the processed data indicates that the size of a certain control in the interactive interface is too small, and it is time-consuming and laborious for the tested person to find the control during the interaction process. The preliminary evaluation results include, for example, preliminary evaluation data for the control. The preliminary evaluation data is relatively low, indicating that the interaction adaptability between the control and the tested person is low, the design scheme of the human-computer interaction system is not optimized, and the user experience is low. In order to further evaluate the control more accurately, it is necessary to further evaluate based on the evaluation rule data. For example, the evaluation index is the control size. When the control size is greater than a preset size threshold, the evaluation data for the control on the interactive interface is 90 points. When the control size is less than another preset size threshold, the evaluation data for the control on the interactive interface is 60 points. Based on the index value and the score corresponding to the evaluation index, the evaluation data for the interactive element is obtained. For example, the evaluation data obtained by evaluating the control based on the evaluation rule data is 60 points.

[0115] As an example, the intelligent evaluation system automatically generates an evaluation report based on basic evaluation data (such as national standard files, which are standard files), experience evaluation data (such as industry experience data), and custom evaluation data (such as custom benchmark data) after integrating, classifying, and intelligently analyzing multi-dimensional data. The test report includes evaluation data for interactive elements. Among them, according to the national standard file, for example, when the size of the control is greater than a preset size threshold, the score for the control on the interactive interface is 90 points, and when the size of the control is less than another preset size threshold, the score for the control on the interactive interface is 60 points. According to industry experience, for example, for a certain function on the vehicle, the score through voice interaction is higher, and the score through text interaction is lower. According to the custom benchmark, for example, based on the combination of eye movement and environment, it is known that for the position of the control on the interactive interface HUD (head-up display system), at night or in direct sunlight, when the eye movement data indicates that the gaze time of the person being tested is short, the position score of the control on the interactive interface is relatively low. The evaluation report generated above can provide a decision-making basis for HUD / HMI optimization design.

[0116] Exemplarily, the evaluation score is only a specific example of quantitative analysis. The evaluation method of the present application can also support qualitative analysis, subjective evaluation, etc., so the evaluation data includes other content in addition to the evaluation score. For example, the evaluation data can be output in the form of an evaluation report, which includes two parts: qualitative analysis and quantitative evaluation. The qualitative analysis can list the relevant impacts of the design content on the driver, including fluctuations such as human factors data and vehicle data, etc.; the quantitative evaluation will give a comprehensive quantitative evaluation result from the perspectives of benchmark compliance, driving load, ease of operation, scenario applicability, etc., which may be a score, a level, etc.

[0117] In addition to the multi-dimensional evaluation data, this application also includes subjective evaluation data and objective evaluation data for evaluating the interactive elements in the human-computer interaction system.

[0118] As an example, Fig. 9 As shown, based on human interaction data and external data, the interactive elements in the human-computer interaction system are evaluated, including S901-S902.

[0119] S901, obtaining subjective evaluation data for interactive elements in a human-computer interaction system.

[0120] S902, evaluating the interactive elements in the human-computer interaction system based on the human interaction data, external data and subjective evaluation data.

[0121] Exemplarily, a questionnaire can be designed for users to fill out, and subjective evaluation data of interactive elements in the human-computer interaction system can be obtained through the questionnaire survey. The interactive elements in the human-computer interaction system can be evaluated by combining the subjective evaluation data, human interaction data and external data.

[0122] The interactive elements in the human-computer interaction system are evaluated in combination with subjective evaluation data. The evaluation results are more in line with the subjective feelings of the testers, making the evaluation results more accurate.

[0123] As an example, the evaluation method of the human-computer interaction system of a vehicle further includes: evaluating the evaluation rule data, wherein the evaluation rule data includes at least one of basic evaluation data, experience evaluation data, and custom evaluation data.

[0124] Exemplarily, the evaluation rule data includes the rule data of the national standard documents, industry experience, custom benchmarks and other rules mentioned above. The basic evaluation data can be called the national standard document rule data, the experience evaluation data is the industry experience rule data, and the custom evaluation data is the custom benchmark rule data. This application also includes evaluating the evaluation rule data itself.

[0125] As an example, Fig.10 As shown, the evaluation rule data is evaluated, including S1001-S1003.

[0126] S1001, based on the evaluation rule data, in other driving test scenarios different from the target driving test scenario, the interactive elements in the human-computer interaction system are evaluated to obtain an objective evaluation result.

[0127] S1002: Obtain subjective evaluation results of interactive elements in the human-computer interaction system in other driving test scenarios.

[0128] S1003, obtaining evaluation results for the evaluation rule data based on the objective evaluation results and the subjective evaluation results.

[0129] As an example, the evaluation rule data is used as an evaluation standard for interactive elements in a human-computer interaction system, and the evaluation rule data itself can also be evaluated. The evaluation rule data includes the national standard documents, industry experience, and custom benchmarks mentioned above. For example, at the beginning, the evaluation rule data may only include national standard documents and industry experience, and the evaluation rule data can be used to evaluate the interactive interface in a virtual scene. After the data is accumulated, a custom benchmark can be added to the evaluation rule data, and then the interactive interface can be evaluated in other scenes (such as real scenes). At the same time, the accuracy of the evaluation of the interactive interface based on the evaluation rule data can be determined in combination with subjective (questionnaire). Based on the accuracy, it can be known whether the evaluation rule data is appropriate. The evaluation rule data is evaluated in combination with the objective evaluation results and the subjective evaluation results, and the evaluation results are more accurate.

[0130] In combination with the above content, it can be seen that the process of evaluating the human-computer interaction system in this application may include the following steps:

[0131] 1. Human-computer interaction system design

[0132] 2. Deploy the human-computer interaction system based on the test scenario

[0133] 3. Testers are in place and measuring equipment is configured

[0134] 4. Driving, human-computer interaction

[0135] 5. Multi-dimensional data collection

[0136] 6. Multi-dimensional data processing

[0137] 7. Human-computer interaction evaluation

[0138] 8. Evaluation report data

[0139] 9. Update of human-computer interaction solution

[0140] 10. Next round of evaluation

[0141] In addition, the human-computer interaction evaluation benchmark can also be evaluated, including the following steps:

[0142] 1. Basic testing of the same human-computer interaction system

[0143] 2. Change the evaluation criteria

[0144] 3. Determine the degree of match between the evaluation results of different evaluation benchmarks and the actual evaluation results

[0145] This application builds an intelligent and flexible comprehensive evaluation experimental system for HUD / HMI design by deploying a platform, data communication modules / plug-ins, and an intelligent evaluation system. It can flexibly define test content, scenario applications, etc., collect and analyze multi-dimensional data, and conduct intelligent / customized evaluations, laying the foundation for HUD / HMI intelligent optimization design and evaluation.

[0146] This application also proposes an evaluation system.

[0147] like Fig.11 As shown, the evaluation system 100 includes: a deployment subsystem 10, which is configured to edit the human-computer interaction system, generate the human-computer interaction system, display the human-computer interaction system, select the target driving test scenario, obtain the driving environment information for the target driving test scenario and display the driving environment information on the human-computer interaction system; an evaluation subsystem 20, which is configured to obtain the human factor interaction data generated by the interaction between the person under test and the human-computer interaction system of the vehicle and the external data associated with the vehicle driving under the target driving test scenario; based on the human factor interaction data and the external data, the interactive elements in the human-computer interaction system are evaluated to obtain the evaluation data for the interactive elements, wherein the evaluation data is used to represent the interaction adaptability between the person under test and the interactive elements; and a data communication module 30, which is configured to send the human factor interaction data and external data from the deployment subsystem 10 to the evaluation subsystem 20.

[0148] The deployment subsystem 10 includes the above Figure 2 The deployment platform in the evaluation subsystem 20 includes the above Figure 2 The intelligent evaluation system, the data communication module 30 includes the above Figure 2 Data communication module / plug-in in.

[0149] The present application also proposes a device for evaluating a vehicle's human-computer interaction system.

[0150] like Fig.12 As shown, the evaluation device 200 of the human-computer interaction system of a vehicle includes: an acquisition module 40, which is used to obtain the human interaction data generated by the interaction between the person under test and the human-computer interaction system of the vehicle and the external data associated with the vehicle's driving in a target driving test scenario; and an evaluation module 50, which is used to evaluate the interactive elements in the human-computer interaction system based on the human interaction data and the external data, and obtain evaluation data for the interactive elements, wherein the evaluation data is used to represent the interaction adaptability between the person under test and the interactive elements.

[0151] Exemplarily, the evaluation module 50 is also used to process human interaction data and external data to obtain processed data and preliminary evaluation results; and to process the processed data and preliminary evaluation results based on the evaluation rule data to obtain evaluation data for the interactive elements.

[0152] Exemplarily, the evaluation module 50 is also used to preprocess the human interaction data and external data to obtain preprocessing results as processed data, wherein the preprocessing results include at least one of labeling the human interaction data and external data, dividing data segments, determining the information of interest of the tested person to the human-computer interaction system, and data smoothing; and based on the preprocessing results, obtaining preliminary evaluation results, wherein the preliminary evaluation results include at least one of the correlation information between the human interaction data and the external data and the evaluation information on the interactive elements.

[0153] Exemplarily, the evaluation data includes evaluation scores, and the evaluation rule data includes evaluation indicators and scores corresponding to the evaluation indicators; the evaluation module 50 is also used to process the processed data and preliminary evaluation results to obtain indicator values ​​corresponding to the evaluation indicators; and based on the indicator values ​​and the scores corresponding to the evaluation indicators, obtain evaluation scores for interactive elements.

[0154] Exemplarily, the evaluation module 50 is also used to obtain subjective evaluation data for interactive elements in the human-computer interaction system; and to evaluate the interactive elements in the human-computer interaction system based on human interaction data, external data and subjective evaluation data.

[0155] Exemplarily, the evaluation device 200 of the human-computer interaction system of the vehicle is also used to evaluate the evaluation rule data, wherein the evaluation rule data includes at least one of basic evaluation data, experience evaluation data, and custom evaluation data.

[0156] Exemplarily, the evaluation device 200 of the human-computer interaction system of a vehicle is also used to evaluate the interactive elements in the human-computer interaction system based on the evaluation rule data in other driving test scenarios different from the target driving test scenarios to obtain objective evaluation results; to obtain subjective evaluation results for the interactive elements in the human-computer interaction system in other driving test scenarios; and to obtain evaluation results for the evaluation rule data based on the objective evaluation results and the subjective evaluation results.

[0157] Exemplarily, the evaluation device 200 of the vehicle's human-computer interaction system is also used to select a target driving test scenario from candidate driving test scenarios; obtain driving environment information for the target driving test scenario based on a data acquisition method corresponding to the target driving test scenario; and display the driving environment information in the human-computer interaction system to facilitate the person being tested to interact with the human-computer interaction system based on the driving environment information to control the vehicle's driving.

[0158] Exemplarily, the evaluation device 200 of the vehicle's human-computer interaction system is also used to obtain updated driving environment information after the person under test interacts with the human-computer interaction system to control the vehicle's driving based on the driving environment information; and to display the updated driving environment information in the human-computer interaction system.

[0159] Exemplarily, the candidate driving test scenarios include at least one of the following: a virtual driving test scenario, wherein the data acquisition method corresponding to the virtual driving test scenario includes at least one of a method of generating data based on virtual software and a method of collecting data through virtual sensors; a virtual-reality combined driving test scenario, wherein the data acquisition method corresponding to the virtual-reality combined driving test scenario includes at least one of a method of generating data based on virtual software, a method of collecting data through virtual sensors, a method of collecting data through real sensors, and a method of receiving data from external devices; a real driving test scenario, wherein the data acquisition method corresponding to the real driving test scenario includes at least one of a method of collecting data through real sensors and a method of receiving data from external devices.

[0160] Exemplarily, the virtual driving test scenario includes: a virtual vehicle cockpit, a virtual human-computer interaction system, and a virtual driving simulation environment; the virtual-reality combined driving test scenario includes: a real vehicle cockpit, a real human-computer interaction system, and a virtual driving simulation environment; the real driving test scenario includes: a real vehicle cockpit, a real human-computer interaction system, and a real driving environment.

[0161] Exemplarily, the evaluation device 200 of the vehicle's human-computer interaction system is also used to receive editing data for the human-computer interaction system, wherein the editing data is used to edit at least one of the display content, interaction method, and display form of the interactive elements; and based on the editing data, generate the human-computer interaction system, and display the human-computer interaction system to facilitate the tester to interact with the human-computer interaction system.

[0162] Exemplarily, the human-computer interaction system includes at least one of the following: a vehicle head-up display system, an instrument panel, instruments, a central control screen, a co-pilot interaction device, and an entertainment screen; the human factors interaction data includes at least one of the following: physical data of the person being tested, eye movement data of the person being tested, EEG data of the person being tested, hand operation trajectory data of the person being tested, motion posture data of the person being tested, facial data of the person being tested, and voice data of the person being tested; at least one of the following external data associated with vehicle driving: vehicle driving data, external traffic data, external environment data, and voice data of the human-computer interaction system.

[0163] Fig.13 A block diagram of an electronic device provided for an embodiment of the present application.

[0164] An embodiment of the present application provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor implements the evaluation method of the human-computer interaction system when executing the computer program.

[0165] like Fig.13 As shown, for ease of understanding, the embodiment of the present application shows a specific electronic device 1300.

[0166] The electronic device 1300 is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0167] like Fig.13 As shown, the device 1300 includes a computing unit 1301, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 1302 or a computer program loaded from a storage unit 1308 into a random access memory (RAM) 1303. In the RAM 1303, various programs and data required for the operation of the electronic device 1300 can also be stored. The computing unit 1301, the ROM 1302, and the RAM 1303 are connected to each other via a bus 1304. An input / output (I / O) interface 1305 is also connected to the bus 1304.

[0168] Multiple components in the electronic device 1300 are connected to the I / O interface 1305, including: an input unit 1306, such as a keyboard, a mouse, etc.; an output unit 1307, such as various types of displays, speakers, etc.; a storage unit 1308, such as a disk, an optical disk, etc.; and a communication unit 1309, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 1309 allows the electronic device 1300 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0169] The computing unit 1301 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 1301 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 1301 executes the various methods described above, such as the evaluation method of the human-computer interaction system. For example, in some embodiments, the evaluation method of the human-computer interaction system may be implemented as a computer software program, which is tangibly included in a machine-readable medium, such as a storage unit 1308. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 1300 via the ROM 1302 and / or the communication unit 1309. When the computer program is loaded into the RAM 1303 and executed by the computing unit 1301, the evaluation method of the human-computer interaction system described above may be executed. Alternatively, in other embodiments, the computing unit 1301 may be configured to execute the evaluation method of the human-computer interaction system in any other appropriate manner (for example, by means of firmware).

[0170] It should be noted that the logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be specifically implemented in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purposes of this application, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection portion with one or more wirings (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or otherwise processing in a suitable manner if necessary, and then stored in a computer memory.

[0171] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0172] In the description of the present application, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In the present application, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0173] In the description of the present application, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise", "axial", "radial", "circumferential" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present application.

[0174] In addition, the terms "first", "second", etc. used in the embodiments of the present application are only used for descriptive purposes and should not be understood as indicating or implying relative importance, or implicitly indicating the number of technical features indicated in the present embodiment. Therefore, the features defined by the terms "first", "second", etc. in the embodiments of the present application can explicitly or implicitly indicate that at least one of the features is included in the embodiment. In the description of the present application, the word "multiple" means at least two or two or more, such as two, three, four, etc., unless otherwise clearly and specifically defined in the embodiments.

[0175] In this application, unless otherwise clearly specified or limited in the embodiments, the terms "installed", "connected", "connected" and "fixed" etc. appearing in the embodiments should be understood in a broad sense. For example, the connection can be a fixed connection, a detachable connection, or an integrated connection. It can be understood that it can also be a mechanical connection, an electrical connection, etc.; of course, it can also be a direct connection, or an indirect connection through an intermediate medium, or it can be the internal connection of two elements, or the interaction relationship between two elements. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to the specific implementation situation.

[0176] In the present application, unless otherwise clearly specified and limited, a first feature being “above” or “below” a second feature may mean that the first and second features are in direct contact, or the first and second features are in indirect contact through an intermediate medium. Moreover, a first feature being “above”, “above”, and “above” a second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is higher in level than the second feature. A first feature being “below”, “below”, and “below” a second feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature is lower in level than the second feature.

[0177] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A method for evaluating a vehicle's human-computer interaction system, characterized in that: The method comprises: Selecting a target driving test scenario from the candidate driving test scenarios; Acquiring driving environment information for the target driving test scenario based on a data acquisition method corresponding to the target driving test scenario; Displaying the driving environment information in the human-computer interaction system to facilitate the person under test to interact with the human-computer interaction system based on the driving environment information to control the driving of the vehicle; In the target driving test scenario, obtaining human interaction data generated by the interaction between the person under test and the human-machine interaction system of the vehicle and external data associated with the vehicle's driving; and Based on the human interaction data and the external data, the interactive elements in the human-computer interaction system are evaluated to obtain evaluation data for the interactive elements. Among them, the candidate driving test scenarios include at least one of virtual driving test scenarios, virtual-reality combined driving test scenarios, and real driving test scenarios; the data acquisition method corresponding to the virtual driving test scenarios includes at least one of a method of generating data based on virtual software and a method of collecting data through virtual sensors; the data acquisition method corresponding to the virtual-reality combined driving test scenarios includes at least one of a method of generating data based on virtual software, a method of collecting data through virtual sensors, a method of collecting data through real sensors, and a method of receiving data from external devices; the data acquisition method corresponding to the real driving test scenarios includes at least one of a method of collecting data through real sensors and a method of receiving data from external devices.

2. The method according to claim 1, characterized in that The evaluating the interactive elements in the human-computer interaction system based on the human interaction data and the external data includes: Processing the human factor interaction data and the external data to obtain processed data and preliminary evaluation results; and Based on the evaluation rule data, the processed data and the preliminary evaluation results are processed to obtain evaluation data for the interactive element.

3. The method according to claim 2, characterized in that The processing of the human factor interaction data and the external data to obtain processed data and preliminary evaluation results includes: Preprocessing the human interaction data and the external data to obtain preprocessing results as the processed data, wherein the preprocessing results include at least one of labeling the human interaction data and the external data, dividing data segments, determining the information of interest of the tested person to the human-computer interaction system, and data smoothing; and Based on the preprocessing result, the preliminary evaluation result is obtained, wherein the preliminary evaluation result includes at least one of the correlation information between the human factor interaction data and the external data and the evaluation information for the interaction element.

4. The method according to claim 2, characterized in that: The evaluation data includes evaluation scores, and the evaluation rule data includes evaluation indicators and scores corresponding to the evaluation indicators; the evaluation data after processing and the preliminary evaluation results are processed based on the evaluation rule data to obtain evaluation data for the interactive element, including: Processing the processed data and the preliminary evaluation results to obtain an indicator value corresponding to the evaluation indicator; and Based on the indicator value and the score corresponding to the evaluation indicator, an evaluation score for the interactive element is obtained.

5. The method according to claim 1, characterized in that The evaluating the interactive elements in the human-computer interaction system based on the human interaction data and the external data includes: Obtaining subjective evaluation data for interactive elements in the human-computer interaction system; and Based on the human interaction data, the external data and the subjective evaluation data, the interaction elements in the human-computer interaction system are evaluated.

6. The method according to claim 2, characterized in that The method further comprises: The evaluation rule data is evaluated, wherein the evaluation rule data includes at least one of basic evaluation data, experience evaluation data, and user-defined evaluation data.

7. The method according to claim 6, characterized in that The evaluating the evaluation rule data includes: Based on the evaluation rule data, in other driving test scenarios different from the target driving test scenario, evaluating the interactive elements in the human-computer interaction system to obtain an objective evaluation result; In the other driving test scenario, obtaining subjective evaluation results of the interactive elements in the human-computer interaction system; and Based on the objective evaluation result and the subjective evaluation result, an evaluation result for the evaluation rule data is obtained.

8. The method according to claim 1, characterized in that The method further comprises: After the person under test interacts with the human-computer interaction system to control the driving of the vehicle based on the driving environment information, updated driving environment information is obtained; and The updated driving environment information is displayed in the human-computer interaction system.

9. The method according to claim 1, characterized in that: The virtual driving test scenario includes: a virtual vehicle cockpit, a virtual human-computer interaction system, and a virtual driving simulation environment; The virtual-reality combined driving test scenario includes: a real vehicle cockpit, a real human-computer interaction system, and a virtual driving simulation environment; The real driving test scenario includes: a real vehicle cockpit, a real human-computer interaction system, and a real driving environment.

10. The method according to any one of claims 1 to 9, characterized in that: The method further comprises: receiving editing data for the human-computer interaction system, wherein the editing data is used to edit at least one of display content, interaction mode, and display form of the interactive element; and Based on the edited data, the human-computer interaction system is generated and displayed, so as to facilitate the tester to interact with the human-computer interaction system.

11. The method according to any one of claims 1 to 9, characterized in that: The human-computer interaction system includes at least one of the following: a vehicle head-up display system, an instrument panel, an instrument, a central control screen, a co-pilot interaction device, and an entertainment screen; The human interaction data includes at least one of the following: physiological data of the person being measured, eye movement data of the person being measured, electroencephalogram data of the person being measured, hand operation trajectory data of the person being measured, motion posture data of the person being measured, facial data of the person being measured, and voice data of the person being measured; The external data associated with vehicle driving includes at least one of the following: vehicle driving data, external traffic data, external environment data, and voice data of the human-computer interaction system.

12. An evaluation system, characterized in that: The system comprises: A deployment subsystem is configured to edit a human-computer interaction system, generate the human-computer interaction system, display the human-computer interaction system, select a target driving test scenario from candidate driving test scenarios, obtain driving environment information for the target driving test scenario based on a data acquisition method corresponding to the target driving test scenario, and display the driving environment information on the human-computer interaction system; wherein the candidate driving test scenarios include at least one of a virtual driving test scenario, a virtual-reality combined driving test scenario, and a real driving test scenario; the data acquisition method corresponding to the virtual driving test scenario includes at least one of a method of generating data based on virtual software and a method of collecting data through a virtual sensor; the data acquisition method corresponding to the virtual-reality combined driving test scenario includes at least one of a method of generating data based on virtual software, a method of collecting data through a virtual sensor, a method of collecting data through a real sensor, and a method of receiving data from an external device; the data acquisition method corresponding to the real driving test scenario includes at least one of a method of collecting data through a real sensor and a method of receiving data from an external device; An evaluation subsystem is configured to obtain human interaction data generated by the interaction between the person under test and the human-computer interaction system of the vehicle and external data associated with the vehicle's driving in the target driving test scenario; based on the human interaction data and the external data, evaluate the interactive elements in the human-computer interaction system to obtain evaluation data for the interactive elements; and The data communication module is configured to send the human interaction data and the external data from the deployment subsystem to the evaluation subsystem.

13. A device for evaluating a human-computer interaction system of a vehicle, characterized in that: The device is used to select a target driving test scenario from candidate driving test scenarios; and obtain driving environment information for the target driving test scenario based on a data acquisition method corresponding to the target driving test scenario; The driving environment information is displayed in the human-computer interaction system, so that the person being tested can interact with the human-computer interaction system based on the driving environment information to control the driving of the vehicle; the device comprises: an acquisition module, used to acquire human interaction data generated by the interaction between the person under test and the human-computer interaction system of the vehicle and external data associated with the driving of the vehicle in the target driving test scenario; and An evaluation module is used to evaluate the interactive elements in the human-computer interaction system based on the human interaction data and the external data to obtain evaluation data for the interactive elements. Among them, the candidate driving test scenarios include at least one of virtual driving test scenarios, virtual-reality combined driving test scenarios, and real driving test scenarios; the data acquisition method corresponding to the virtual driving test scenarios includes at least one of a method of generating data based on virtual software and a method of collecting data through virtual sensors; the data acquisition method corresponding to the virtual-reality combined driving test scenarios includes at least one of a method of generating data based on virtual software, a method of collecting data through virtual sensors, a method of collecting data through real sensors, and a method of receiving data from external devices; the data acquisition method corresponding to the real driving test scenarios includes at least one of a method of collecting data through real sensors and a method of receiving data from external devices.

14. An electronic device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 11 are implemented.

15. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 11 are implemented.

Images