User experience simulation test device and method for automobile cabin car entertainment system, electronic equipment and medium

Abstract

The invention discloses a user experience simulation test device and method for an automobile cabin vehicle-mounted entertainment system, electronic equipment and a medium. The device may comprise: a mechanical arm module for simulating a touch operation of a user; the eye movement tracking module is used for recording the sight track of the user when the user operates navigation, entertainment and other functions, and generating a heat map and fixation point distribution data; the sound simulation module is used for simulating user voice instruction input and testing the voice recognition and response capability of the in-vehicle infotainment system; the sensor module is used for monitoring and recording parameters in the simulation operation process; the control module is used for controlling operation of the mechanical arm module, the eye movement tracking module and the sound simulation module and processing and analyzing data obtained by the sensor module. By simulating the actual operation behavior of the user, the performance and the user experience of the vehicle-mounted information entertainment system are evaluated, and the design and optimization efficiency of the vehicle-mounted information entertainment system is improved.

Description

Technical Field

[0001] The present invention relates to the automotive field, and more specifically, to a user experience simulation test device, method, electronic equipment and medium for an automotive cockpit vehicle system. Background Art

[0002] With the development of intelligent and interconnected vehicles, the vehicle computer system has become a core component of the car cockpit, providing multiple functions such as navigation, entertainment, and communication. However, existing testing methods often fail to fully simulate the operation behavior of real users, resulting in problems such as slow response and unfriendly interface of the vehicle computer system in actual use.

[0003] Therefore, it is necessary to develop a user experience simulation test device, method, electronic equipment and medium for a car cockpit system.

[0004] The information disclosed in the background technology section of the present invention is only intended to deepen the understanding of the general background technology of the present invention, and should not be regarded as acknowledging or suggesting in any form that the information constitutes the prior art already known to those skilled in the art. Summary of the invention

[0005] The present invention proposes a user experience simulation test device, method, electronic equipment and medium for a car cockpit vehicle system, which can evaluate the performance and user experience of the vehicle system by simulating the user's actual operating behavior, thereby improving the design and optimization efficiency of the vehicle system.

[0006] In a first aspect, the embodiments of the present disclosure further provide a user experience simulation test device for a vehicle cockpit system, including a mechanical arm module, an eye tracking module, a sound simulation module, a sensor module, and a control module, wherein:

[0007] A robotic arm module, used to simulate the user's touch operation;

[0008] Eye tracking module, used to record the user's gaze trajectory when operating navigation, entertainment and other functions, and generate heat maps and gaze point distribution data;

[0009] The sound simulation module is used to simulate the user's voice command input and test the voice recognition and response capabilities of the vehicle system;

[0010] Sensor modules for monitoring and recording parameters during simulation operations;

[0011] A control module is used to control the operations of the robotic arm module, the eye tracking module and the sound simulation module, and to process and analyze the data obtained by the sensor module.

[0012] Preferably, the robotic arm module comprises:

[0013] The robotic arm contains multiple joints to achieve multiple degrees of freedom of movement;

[0014] The end effector replaces different types of touch pens according to different tasks to simulate the user's actions of operating the touch screen.

[0015] Preferably, the eye tracking module includes a camera and an infrared sensor to capture and record the gaze point and line of sight movement of the user's eyes in real time.

[0016] Preferably, the sound simulation module comprises:

[0017] A speaker for playing pre-recorded voice commands;

[0018] Microphone, used to record the voice response of the vehicle system.

[0019] Preferably, the control module comprises:

[0020] A central control unit, used to control the operation of the robotic arm module, the eye tracking module and the sound simulation module through a preset user behavior script;

[0021] The data processing unit is used to receive and analyze sensor data in real time and generate test reports.

[0022] In a second aspect, an embodiment of the present disclosure provides a user experience simulation test method, including:

[0023] Record the user's behavior data in the vehicle system;

[0024] Performing statistical analysis on the behavior data, and extracting operation modes and behavior characteristics as analysis results;

[0025] According to the analysis results, write a user behavior script and import it into the control module;

[0026] The control module controls the operations of the robotic arm module, the eye tracking module and the sound simulation module according to the user behavior script;

[0027] The sensor module monitors and records parameters during the simulation operation, and the control module processes and analyzes the data obtained by the sensor module.

[0028] Preferably, the behavior data includes the user's hand movements, line of sight movements, and voice commands.

[0029] Preferably, the analysis results include the user's operation path, gaze point distribution, and voice command frequency.

[0030] In a third aspect, an embodiment of the present disclosure further provides an electronic device, the electronic device comprising:

[0031] A memory storing executable instructions;

[0032] A processor runs the executable instructions in the memory to implement the user experience simulation test method.

[0033] In a fourth aspect, an embodiment of the present disclosure further provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the user experience simulation test method is implemented.

[0034] The methods and apparatus of the present invention have other features and advantages that will be apparent from, or will be described in detail in, the accompanying drawings and subsequent detailed descriptions incorporated herein, which together serve to explain the specific principles of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] The above and other objects, features and advantages of the present invention will become more apparent through a more detailed description of exemplary embodiments of the present invention in conjunction with the accompanying drawings, wherein like reference numerals generally represent like components throughout the exemplary embodiments of the present invention.

[0036] Figure 1 A block diagram of a user experience simulation test device for a vehicle cockpit system according to an embodiment of the present invention is shown.

[0037] Figure 2 A flow chart showing the steps of a user experience simulation testing method according to an embodiment of the present invention.

[0038] Figure 3 A schematic diagram of user experience simulation test execution logic according to an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0039] The preferred embodiments of the present invention will be described in more detail below. Although the preferred embodiments of the present invention are described below, it should be understood that the present invention can be implemented in various forms and should not be limited to the embodiments set forth herein.

[0040] To facilitate understanding of the solutions and effects of the embodiments of the present invention, four specific application examples are given below. Those skilled in the art should understand that the examples are only for facilitating understanding of the present invention, and any specific details thereof are not intended to limit the present invention in any way.

[0041] Example 1

[0042] Figure 1A block diagram of a user experience simulation test device for a vehicle cockpit system according to an embodiment of the present invention is shown.

[0043] like Figure 1 As shown, the user experience simulation test device for the vehicle cockpit system includes a mechanical arm module, an eye tracking module, a sound simulation module, a sensor module, and a control module, wherein:

[0044] A robotic arm module, used to simulate the user's touch operation;

[0045] Eye tracking module, used to record the user's gaze trajectory when operating navigation, entertainment and other functions, and generate heat maps and gaze point distribution data;

[0046] The sound simulation module is used to simulate the user's voice command input and test the voice recognition and response capabilities of the vehicle system;

[0047] Sensor modules for monitoring and recording parameters during simulation operations;

[0048] The control module is used to control the operation of the robotic arm module, the eye tracking module and the sound simulation module, and to process and analyze the data obtained by the sensor module.

[0049] In one example, the robotic arm module includes:

[0050] The robotic arm contains multiple joints to achieve multiple degrees of freedom of movement;

[0051] The end effector replaces different types of touch pens according to different tasks to simulate the user's actions of operating the touch screen.

[0052] In one example, the eye tracking module includes a camera and an infrared sensor to capture and record the user's eye gaze point and line of sight movement in real time.

[0053] In one example, the sound simulation module includes:

[0054] A speaker for playing pre-recorded voice commands;

[0055] Microphone, used to record the voice response of the vehicle system.

[0056] In one example, the control module includes:

[0057] A central control unit, used to control the operation of the robotic arm module, the eye tracking module and the sound simulation module through a preset user behavior script;

[0058] The data processing unit is used to receive and analyze sensor data in real time and generate test reports.

[0059] Specifically, the device includes a robotic arm module, an eye tracking module, a sound simulation module, a sensor module, and a control module:

[0060] The robot module simulates the user's touch operations in the vehicle system, such as clicking, sliding and rotating. The robot module contains multiple joints and can achieve multiple degrees of freedom, such as extension, rotation, bending, etc. The end effector can be replaced according to different tasks, such as using different types of touch pens to simulate the user's operation of the touch screen. The movement of the robot arm is controlled by a pre-written script to achieve accurate simulation operations. Through the flexible operation of the robot arm and the end effector, the user's finger operation on the touch screen is simulated, and the pressure sensor is combined to record the strength and position of each operation.

[0061] The eye tracking module records the user's gaze trajectory when operating navigation, entertainment and other functions, and generates heat maps and gaze point distribution data. Record and analyze the user's gaze movement and gaze point when using the car system, and evaluate the rationality of interface design and information display. The eye tracking module consists of a high-precision camera and infrared sensor, which can capture and record the user's gaze point and gaze movement in real time. By analyzing the gaze data, you can understand the interface area and information that the user pays attention to during operation.

[0062] The sound simulation module simulates user voice command input to test the voice recognition and response capabilities of the vehicle system. Pre-recorded voice commands are played through high-fidelity speakers, and the microphone records the voice feedback of the vehicle system to evaluate the accuracy and response speed of voice interaction. The sound simulation module includes high-fidelity speakers and microphones to simulate user voice input and voice feedback of the vehicle system. The speaker can play pre-recorded voice commands, and the microphone is used to record the voice response of the vehicle system.

[0063] The sensor module monitors and records various parameters during the simulation operation, such as operating force, position change, temperature, etc., and provides comprehensive data support. The sensor module records the pressure, position and ambient temperature data of the robot arm during operation in real time, and the data processing unit performs real-time analysis and report generation. The sensor module includes a variety of sensors, such as pressure sensors, position sensors, temperature sensors, etc. These sensors are used to monitor and record the user's operation process and environmental parameters. For example, the pressure sensor can record the user's pressing force on the touch screen, the position sensor can monitor the position change of the robot arm, and the temperature sensor can record the change of the ambient temperature in the car.

[0064] The control module coordinates the operation of the robotic arm, eye tracking module and sound simulation module, and processes and analyzes the sensor data. The control module includes a central control unit and a data processing unit. The central control unit controls the operation of the robotic arm, eye tracking device and sound simulation module through a preset user behavior script. The data processing unit is responsible for receiving and analyzing sensor data in real time and generating a test report.

[0065] The steps to apply this system are:

[0066] 1. System initialization:

[0067] (1) Start the central control unit of the test device.

[0068] (2) Initialize each module (robotic arm module, eye tracking module, sound simulation module, sensor module).

[0069] (3) Load predefined test scenarios and user behavior scripts.

[0070] 2. Behavior entry:

[0071] (1) Real user operation records: Use high-precision cameras, eye tracking devices, and sensor modules to record real user operation behaviors.

[0072] (2) Data collection: Collect data such as hand movements (such as touch screen clicks and slides), eye movement, and voice commands.

[0073] (3) Data storage: The collected user behavior data is stored in the data processing unit for subsequent analysis.

[0074] 3. Behavioral analysis:

[0075] (1) Data import: Import the entered behavioral data into the data analysis system.

[0076] (2) Statistical analysis: Perform statistical analysis on the data and extract typical operation patterns (such as common gesture operations, areas where the gaze stays, and commonly used voice commands).

[0077] (3) Behavioral feature extraction: Identify and extract behavioral features such as user operation path, gaze point distribution, and voice command frequency.

[0078] (4) Generate user behavior model: Based on the analysis results, establish a user behavior model and define the operation script.

[0079] 4. Behavior simulation:

[0080] (1) Script writing: Write a simulation script based on the user behavior model to define the operation steps of the robotic arm, eye tracking device, and sound simulation module.

[0081] (2) Script import: Import the simulation script into the control module.

[0082] (3) Operation execution:

[0083] Robotic arm simulation: Control the robotic arm to perform hand operations according to the script, such as touch screen clicks and slides.

[0084] Gaze simulation: Control the eye tracking device to simulate the user's gaze movement and record the gaze point.

[0085] Voice simulation: Use the sound simulation module to play pre-recorded voice commands to simulate user voice interaction.

[0086] 5. Real-time monitoring: The sensor module monitors the position, force change, ambient temperature, etc. of the robot arm in real time to ensure the accuracy and safety of the simulation operation.

[0087] 6. Data collection:

[0088] (1) Real-time data acquisition: During the behavior simulation process, the sensor module collects operation data (such as pressure, position change, and gaze point movement) in real time.

[0089] (2) Voice response recording: The microphone records the voice response of the vehicle system and evaluates the voice interaction performance of the system.

[0090] (3) Data storage: All collected data are transmitted to the data processing unit for storage and preliminary processing.

[0091] 7. Data analysis and evaluation:

[0092] (1) Data organization: Organize and categorize stored data in preparation for detailed analysis.

[0093] (2) Performance analysis: Statistics on performance indicators such as system response time, interface switching speed, and voice response time.

[0094] (3) User experience analysis: evaluate user experience indicators such as interface friendliness, operation success rate, and user line of sight distribution.

[0095] (4) Anomaly detection: Detect and record abnormal operations or system failures that occur during the simulation process.

[0096] 8. Test report generation:

[0097] (1) Result summary: Comprehensive performance indicators and user experience data.

[0098] (2) Report generation: Generate detailed test reports, including response time statistics, interface friendliness evaluation, operation success rate analysis, etc.

[0099] (3) Optimization suggestions: Based on the analysis results, provide system optimization and improvement suggestions to help improve the design of the vehicle system and user experience.

[0100] 9. Result output and feedback:

[0101] (1) Real-time display: The test results and data analysis progress are displayed in real time on the user interface module.

[0102] (2) Report output: Output detailed test reports for reference by the system development and optimization team.

[0103] (3) Feedback collection: Collect feedback from the system development team on test results and optimization suggestions to further improve the test process and methods.

[0104] Example 2

[0105] Figure 2 A flow chart showing the steps of a user experience simulation testing method according to an embodiment of the present invention.

[0106] like Figure 2 As shown, the user experience simulation test method includes:

[0107] Step 101, recording the behavior data of the user's operation in the vehicle system;

[0108] Step 102, performing statistical analysis on the behavior data, extracting operation modes and behavior characteristics as analysis results;

[0109] Step 103, write a user behavior script based on the analysis results and import it into the control module;

[0110] Step 104, the control module controls the operation of the robotic arm module, the eye tracking module and the sound simulation module according to the user behavior script;

[0111] Step 105 , the sensor module monitors and records parameters during the simulation operation, and the control module processes and analyzes data obtained by the sensor module.

[0112] In one example, the behavioral data includes the user's hand movements, eye movement, and voice commands.

[0113] In one example, the analysis results include the user's operation path, gaze point distribution, and voice command frequency.

[0114] Figure 3 A schematic diagram of user experience simulation test execution logic according to an embodiment of the present invention is shown.

[0115] Specifically, Figure 3 As shown, the method includes:

[0116] High-precision cameras, eye tracking devices and sensors are used to record the operation behaviors of real users in the vehicle system, generating behavioral data, including the user's hand movements, eye movement, voice commands, etc. The recorded behavioral data is statistically analyzed to extract typical operation modes and behavioral characteristics, including analysis of the user's operation path, gaze point distribution, voice command frequency, etc.

[0117] According to the analysis results, the user behavior script is written and imported into the control module. The control module drives the robotic arm, eye tracking device and sound simulation module to perform the preset simulation behavior. The robotic arm simulates the user's hand operation according to the script, the eye tracking device simulates the user's line of sight movement, and the sound simulation module simulates voice interaction.

[0118] The sensor module and eye tracking device collect data during the simulation, including operating force, position change, gaze point change, etc. The data processing unit analyzes the collected data to evaluate the response speed, interface friendliness and user experience of the vehicle system.

[0119] Example 3

[0120] The present disclosure provides an electronic device, which includes: a memory storing executable instructions; and a processor, which runs the executable instructions in the memory to implement the above-mentioned user experience simulation test method.

[0121] An electronic device according to an embodiment of the present disclosure includes a memory and a processor.

[0122] The memory is used to store non-temporary computer-readable instructions. Specifically, the memory may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may, for example, include random access memory (RAM) and / or cache memory (cache), etc. The non-volatile memory may, for example, include read-only memory (ROM), hard disk, flash memory, etc.

[0123] The processor may be a central processing unit (CPU) or other forms of processing units having data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device to perform desired functions. In one embodiment of the present disclosure, the processor is used to run the computer-readable instructions stored in the memory.

[0124] Those skilled in the art should be able to understand that in order to solve the technical problem of how to obtain a good user experience, the present embodiment may also include well-known structures such as a communication bus and an interface, and these well-known structures should also be included in the protection scope of the present disclosure.

[0125] For detailed description of this embodiment, reference may be made to the corresponding descriptions in the aforementioned embodiments, which will not be repeated here.

[0126] Example 4

[0127] An embodiment of the present disclosure provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the user experience simulation test method is implemented.

[0128] According to the computer-readable storage medium of the embodiment of the present disclosure, non-transitory computer-readable instructions are stored thereon. When the non-transitory computer-readable instructions are executed by a processor, all or part of the steps of the above-mentioned methods of each embodiment of the present disclosure are executed.

[0129] The above-mentioned computer-readable storage media include, but are not limited to: optical storage media (e.g., CD-ROM and DVD), magneto-optical storage media (e.g., MO), magnetic storage media (e.g., magnetic tape or mobile hard disk), media with built-in rewritable non-volatile memory (e.g., memory card) and media with built-in ROM (e.g., ROM box).

[0130] Those skilled in the art should understand that the purpose of the above description of the embodiments of the present invention is only to exemplarily illustrate the beneficial effects of the embodiments of the present invention, and is not intended to limit the embodiments of the present invention to any given examples.

[0131] The embodiments of the present invention have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments.

Claims

1. A user experience simulation test device for a car cockpit system, characterized in that: It includes a robotic arm module, an eye tracking module, a sound simulation module, a sensor module, and a control module, among which: A robotic arm module, used to simulate the user's touch operation; Eye tracking module, used to record the user's gaze trajectory when operating navigation, entertainment and other functions, and generate heat maps and gaze point distribution data; The sound simulation module is used to simulate the user's voice command input and test the voice recognition and response capabilities of the vehicle system; Sensor modules for monitoring and recording parameters during simulation operations; A control module is used to control the operations of the robotic arm module, the eye tracking module and the sound simulation module, and to process and analyze the data obtained by the sensor module.

2. The user experience simulation test device for a vehicle cockpit system according to claim 1, wherein: The robotic arm module comprises: The robotic arm contains multiple joints to achieve multiple degrees of freedom of movement; The end effector replaces different types of touch pens according to different tasks to simulate the user's actions of operating the touch screen.

3. The user experience simulation test device for a vehicle cockpit system according to claim 1, wherein: The eye tracking module includes a camera and an infrared sensor, which captures and records the user's eye gaze point and line of sight movement in real time.

4. The user experience simulation test device for a vehicle cockpit system according to claim 1, wherein: The sound simulation module comprises: A speaker for playing pre-recorded voice commands; Microphone, used to record the voice response of the vehicle system.

5. The user experience simulation test device for a vehicle cockpit system according to claim 1, wherein: The control module comprises: A central control unit, used to control the operation of the robotic arm module, the eye tracking module and the sound simulation module through a preset user behavior script; The data processing unit is used to receive and analyze sensor data in real time and generate test reports.

6. The user experience simulation test method for a user experience simulation test system for a vehicle cockpit system according to any one of claims 1 to 5, characterized in that: include: Record the user's behavior data in the vehicle system; Performing statistical analysis on the behavior data, and extracting operation modes and behavior characteristics as analysis results; According to the analysis results, write a user behavior script and import it into the control module; The control module controls the operations of the robotic arm module, the eye tracking module and the sound simulation module according to the user behavior script; The sensor module monitors and records parameters during the simulation operation, and the control module processes and analyzes the data obtained by the sensor module.

7. The user experience simulation test method according to claim 6, wherein: The behavior data includes the user's hand movements, eye movement, and voice commands.

8. The user experience simulation test method according to claim 6, wherein: The analysis results include the user's operation path, gaze point distribution, and voice command frequency.

9. An electronic device, characterized in that: The electronic device comprises: A memory storing executable instructions; A processor, wherein the processor runs the executable instructions in the memory to implement the user experience simulation test method described in any one of claims 6 to 8.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the user experience simulation test method described in any one of claims 6 to 8 is implemented.

Images