Method and device for determining display mode effect, equipment and storage medium

Abstract

The invention discloses a method and device for determining a display mode effect, equipment and a storage medium, and relates to the technical field of simulated flight. The method comprises the following steps: sending a playing test instruction to a display device to indicate the display device to interact with a tested person by displaying an image corresponding to an interaction test task in at least two preset display modes, and receiving test result data of the interaction test task and interaction feeling evaluation data of the tested person, and generating effect evaluation of each preset display mode of the display equipment according to the test result data and the interactive feeling evaluation data. According to the technical scheme provided by the embodiment of the invention, the objective test data and the subjective experience of the user are combined, and the evaluation on the display effect of the display equipment is accurately and efficiently determined.

Description

Technical Field

[0001] The present invention relates to the field of flight simulation technology, and in particular to a method, device, equipment and storage medium for determining a display mode effect. Background Art

[0002] In the aviation field, head-mounted displays (HMDs) are increasingly being used, serving as an alternative to heads-up displays (HUDs). These devices provide pilots with real-time situational awareness and visual feedback. Through optical systems, they project crucial information displayed by various avionics instruments during flight, including navigation and warnings, into the distance. Using HMDs, pilots can view avionics information in real time, playing a crucial role in improving operational effectiveness and flight safety.

[0003] Faced with increasingly complex flight scenarios, head-mounted displays are becoming an indispensable tool for pilots to complete various tasks. Situational awareness assessment is crucial for understanding how individuals or systems understand, interpret, and respond to visual information in complex environments. This is crucial for improving pilots' decision-making quality, response speed, and overall mission efficiency.

[0004] However, the evaluation of the display effects of head-mounted display devices is currently mainly carried out through methods such as expert scoring, which relies on the subjective experience analysis of experts, resulting in low evaluation efficiency and mediocre results. Summary of the Invention

[0005] The present invention provides a method, apparatus, device and storage medium for determining a display mode effect, so as to solve the problem of evaluating the display effect of a display device.

[0006] In a first aspect, the present invention provides a method for determining a display mode effect, comprising:

[0007] Sending a play test instruction to a display device to instruct the display device to interact with the testee by displaying an image corresponding to the interactive test task in at least two preset display modes;

[0008] Receive the test result data of the interactive test task and the interactive experience evaluation data of the tested person;

[0009] An effect evaluation of each preset display mode of the display device is generated according to the test result data and the interactive experience evaluation data.

[0010] In a second aspect, the present invention provides a device for determining a display mode effect, comprising:

[0011] An instruction sending module is used to send a play test instruction to the display device to instruct the display device to interact with the test person by displaying an image corresponding to the interactive test task in at least two preset display modes;

[0012] A data receiving module, configured to receive the test result data of the interactive test task and the interactive experience evaluation data of the tested person;

[0013] The effect evaluation module is used to generate an effect evaluation of each preset display mode of the display device based on the test result data and the interactive experience evaluation data.

[0014] In a third aspect, the present invention provides an electronic device, comprising:

[0015] at least one processor;

[0016] and a memory communicatively coupled to the at least one processor;

[0017] The memory stores a computer program that can be executed by at least one processor, and the computer program is executed by at least one processor so that the at least one processor can execute the method for determining the display mode effect of the first aspect mentioned above.

[0018] In a fourth aspect, the present invention provides a computer-readable storage medium storing computer instructions, which are used to enable a processor to implement the method for determining a display mode effect according to the first aspect when executing the computer instructions.

[0019] The scheme for determining the display mode effect provided by the present invention instructs the display device to display interactive test tasks in multiple display modes, and receives test result data and interactive experience evaluation data of the tested personnel performing the interactive test tasks. Based on these data, the display effect of the display device in different visual modes can be evaluated. Compared with the traditional relatively rough manual qualitative analysis, this scheme can combine objective test data with the user's subjective experience to accurately and efficiently determine the evaluation of the display effect of the display device.

[0020] It should be understood that the content described in this section is not intended to identify the key or important features of the present invention, nor is it intended to limit the scope of the present invention. Other features of the present invention will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0022] Figure 1 This is a flowchart of a method for determining a display mode effect provided according to a first embodiment of the present invention;

[0023] Figure 2 This is a schematic diagram of a display system provided according to the first embodiment of the present invention;

[0024] Figure 3 This is a flowchart of a method for determining a display mode effect provided according to a second embodiment of the present invention;

[0025] Figure 4 2 is a schematic structural diagram of a device for determining a display mode effect according to a third embodiment of the present invention;

[0026] Figure 5 It is a structural diagram of an electronic device provided according to the fourth embodiment of the present invention. DETAILED DESCRIPTION

[0027] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of the present invention.

[0028] It should be noted that the terms "first," "second," and the like in the specification and claims of the present invention and the accompanying drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than that illustrated or described herein. In the description of the present invention, unless otherwise specified, "plurality" refers to two or more. "And / or" describes an association relationship between associated objects, indicating that three relationships can exist. For example, "A and / or B" can mean: A exists alone, A and B exist simultaneously, and B exists alone. The character " / " generally indicates that the associated objects are in an "or" relationship. In addition, the terms "including" and "having," and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or device that includes a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units that are not explicitly listed or that are inherent to such process, method, product, or device.

[0029] Example 1

[0030] Figure 1 A flowchart of a method for determining a display mode effect is provided for embodiment 1 of the present invention. This embodiment is applicable to situations where the effect of a display mode is determined. The method can be executed by a device for determining a display mode effect. The device for determining a display mode effect can be implemented in the form of hardware and / or software. The device for determining a display mode effect can be configured in an electronic device. The electronic device can be composed of two or more physical entities or one physical entity.

[0031] like Figure 1 As shown, the method for determining the display mode effect provided in the first embodiment of the present invention can be applied to the field of flight simulation, and specifically includes the following steps:

[0032] S101: Send a play test instruction to a display device to instruct the display device to interact with a person being tested by displaying images corresponding to an interactive test task in at least two preset display modes.

[0033] In this embodiment, an interactive test task that requires the test person to interact with the display device can be pre-set. The task is used to test the display effect of the display device under different preset display modes. Then, a play test instruction is sent to the display device (such as a head-mounted display device, etc.) to instruct the display device to start displaying the image corresponding to the interactive test task. The interactive test tasks include interactive test tasks related to simulated flight. Among them, the display mode effect can also be understood as display efficiency, that is, the display is the work efficiency and effect demonstrated during the display process.

[0034] S102: Receive the test result data of the interactive test task and the interactive experience evaluation data of the tested person.

[0035] In this embodiment, while displaying the image corresponding to the interactive test task, the display device can receive the testee's response data via a preset device (such as a joystick) and generate test result data based on the response data. The display device can also display interactive experience evaluation question data to the testee and receive the testee's answers to the questions, based on which interactive experience evaluation data can be generated. The device incorporating this method can receive both the test result data and the interactive experience evaluation data.

[0036] S103: Generate an effect evaluation of each preset display mode of the display device according to the test result data and the interactive experience evaluation data.

[0037] In this embodiment, by analyzing the test result data and the interactive experience evaluation data, an evaluation of the effectiveness of each preset display mode of the display device can be generated. For example, by analyzing the test result data, objective data such as the success rate, task time, error rate, and efficiency of the interactive test task can be determined. By analyzing the interactive experience evaluation data, the subjective experience of interacting with the display device can be determined. Based on these objective data and subjective experience data, an evaluation of the effectiveness can be obtained.

[0038] The technical solution of the embodiment of the present invention instructs the display device to display interactive test tasks in multiple display modes, and receives test result data and interactive experience evaluation data of the tested person performing the interactive test tasks. Based on these data, the display effect of the display device in different visual modes can be evaluated. Compared with the traditional relatively rough manual qualitative analysis, this solution can combine objective test data with the user's subjective experience to accurately and efficiently determine the evaluation of the display effect of the display device.

[0039] Optionally, the interactive test task includes a first visual cognition task; the first visual cognition task is a task for testing target recognition, mental workload and visual fatigue in a created simulated flight scene.

[0040] Specifically, a display device may be used to display simulated flight images to create a simulated flight scene. The first visual cognition task may include at least one of: a flight instrument icon stimulus presentation awareness task, a flight instrument target symbol visual search task, and a low-visibility flight display monitoring task.

[0041] For example, Figure 2 A schematic diagram of a display system is shown in FIG. Figure 2 21 is a head mounted display device, 22 is an operating handle, and 23 is a joystick. Figure 2 As shown, the head-mounted display device can be worn on the head of the person being tested, and is connected to the USB interface and display interface (DisplayPort) of the computer through a USB cable and a video cable respectively. The operating handle can be held by the person being tested and is wirelessly connected to the head-mounted display device via Bluetooth. The computer can implement this method. Before each interactive test task officially begins, the person being tested must complete the pre-test task in accordance with the requirements of the displayed instructions. The task type and operation method of the pre-test task are exactly the same as those of the interactive test task. The purpose is to confirm that the person being tested has correctly mastered the method of completing the test task. The pre-test requires the person being tested to complete the pre-test task three times in a row. If all three tasks can be completed correctly, the interactive test task will be entered.

[0042] During the flight display monitoring mission, the testee manipulates the primary-view aircraft to track another target aircraft by operating the joystick and control bar that come with the display device. The target aircraft will randomly change speed and altitude throughout the mission. The primary-view aircraft controlled by the testee is required to maintain a certain approximate speed and altitude with the target aircraft, and its forward and backward position should not exceed that of the target aircraft. The testee's aircraft's attitude may be forced to change due to factors such as weather and mechanical failures in the simulated flight scenario. The testee should adjust the primary-view aircraft's attitude to the correct range. A random icon may appear on the primary-view aircraft's instrument panel. The testee should identify the specific aircraft icon and select it using the "trigger button" on the joystick that comes with the display device.

[0043] In the flight instrument target symbol visual search task, the display device presents an image with a random airplane icon and several distractor icons. The airplane icon has a randomly oriented character at its center. Participants are required to memorize the shape of the airplane icon and the character's orientation. They are then asked to select the previously displayed airplane icon from among multiple airplane icon types and then select the previously displayed character's orientation from among multiple character orientations.

[0044] Optionally, the interactive test task also includes a second visual cognition task; the second visual cognition task is a task for testing target recognition, mental workload and visual fatigue in a non-simulated flight scene.

[0045] Specifically, the second visual cognition task is a task that tests target recognition, mental workload, and visual fatigue in a non-simulated flight scenario (normal scenario). The second visual cognition task may include at least one of: a simple tracking task, a multi-target tracking task, a comparative search task, a simple specific attribute search task, a simple homogeneous / heterogeneous search task, a perception warning information matching task, and a perception judgment task.

[0046] For example, in a simple tracking task, several airplane-shaped 3D icons are displayed in a rectangular area of ​​a simulated flight scene. Then, several random airplane icons begin to flash. These flashing airplanes are the ones the subject is asked to track. After the flashing stops, all the airplanes begin to move randomly and collide. After the airplanes finish moving, the test subject is required to select all the previously flashing airplanes. Alternatively, while the airplane icons are moving, one to three polyhedron images appear randomly and disappear after a few seconds. After selecting an airplane and submitting the answer, the test subject is also required to select the number of polyhedron icons that appear.

[0047] Optionally, the interactive test task includes a third visual cognition task; the third visual cognition task is a task for testing target recognition, mental workload and visual fatigue respectively after adding interference to the created simulated flight scene and non-simulated flight scene.

[0048] Specifically, adding interference to the simulated flight and non-simulated flight scenarios can be understood as adding images that interfere with the test subject's vision. The third visual cognition task includes at least one of a static task + target judgment task, a static task + spatial orientation judgment task, a static task + digital (angle) judgment task, and a static task + visual digital memory task.

[0049] Example 2

[0050] Figure 3 This is a flowchart of a method for determining a display mode effect provided in the second embodiment of the present invention. The technical solution of the embodiment of the present invention is further optimized on the basis of the above-mentioned optional technical solutions, and provides a specific method for determining the effect of the display mode.

[0051] Optionally, generating an effectiveness evaluation of each preset display mode of the display device based on the test result data and the interactive feeling evaluation data includes: determining evaluation indicators based on the test result data, wherein the evaluation indicators include at least one of the reaction time of the tested person, the task execution accuracy, and the number of task execution errors; and generating an evaluation report containing the effectiveness evaluation of each preset display mode of the display device using the evaluation indicators and the interactive feeling evaluation data.

[0052] Optionally, the display device includes a wearable display device; the preset display mode includes at least two of a virtual reality (VR) display mode, an augmented reality (AR) display mode, and an extended reality (XR) display mode.

[0053] like Figure 3As shown, a method for determining a display mode effect provided by the second embodiment of the present invention specifically includes the following steps:

[0054] S201. Send a play test instruction to a wearable display device to instruct the wearable display device to interact with the testee by displaying an image corresponding to the interactive test task in a virtual reality (VR) display mode, an augmented reality (AR) display mode, and an extended reality (XR) display mode.

[0055] Specifically, in the virtual reality (VR) display mode, the display device displays the image corresponding to the interactive test task through VR technology; in the augmented reality (AR) display mode, the display device displays the image corresponding to the interactive test task through AR technology; in the extended reality (XR) display mode, the display device displays the image corresponding to the interactive test task through XR technology.

[0056] S202: Receive the test result data of the interactive test task and the interactive experience evaluation data of the tested person.

[0057] Optionally, the interactive experience evaluation data includes at least one of the tested person's mental workload evaluation, test load evaluation, dizziness experience evaluation, comfort level evaluation, interactive satisfaction evaluation of the display interface of the display device, simulated flight interactive effect evaluation, sleepiness level evaluation, emotional experience evaluation and situational awareness evaluation; the test load evaluation is an evaluation of the difficulty of the interactive test task.

[0058] For example, the content of the mental workload assessment of the test subject may include questions in the following six dimensions:

[0059] 1) Mental Demand: How much mental effort does this task require?

[0060] 2) Physical Burden: How physically demanding is this mission?

[0061] 3) Time requirement: Does the progress of this task make you feel rushed?

[0062] 4) Task performance: How successful were you in completing this task?

[0063] 5) Level of Effort: How much effort do you need to put in to achieve your goal in this task?

[0064] 6) Frustration: Do you feel any anxiety, discouragement, stress, or annoyance?

[0065] The six dimensions were compared pairwise, resulting in 15 possible permutations and combinations. The dimension with the greatest correlation to mental workload was selected. Weights were calculated based on the number of times each dimension was selected. Total mental workload is the weighted average of the scores for the six dimensions: Total mental workload = Mental Demand × Mental Weight + Physical Demand × Physical Weight + Time Demand × Time Weight + Self-Performance × Self-Performance Weight + Effort × Effort Weight + Frustration × Frustration Weight. The total score was converted to a 100-point scale, with higher scores indicating greater mental workload.

[0066] The test load evaluation can be determined using the Cooper-Harper scale. Specifically, the test load evaluation can be based on the Cooper-Harper scale completed by the test subject. The dizziness evaluation can be based on the Simulator Sickness Questionnaire (SSQ) completed by the test subject. The comfort level evaluation can be based on the Virtual Reality Sickness Questionnaire (VRSQ) completed by the test subject.

[0067] The interaction satisfaction evaluation can be the content of the interface scoring questionnaire filled out by the test subjects. Specific questions in the questionnaire may include: the appropriateness of the size of the indicator cursor, the degree to which the indicator cursor can accurately lock the target, the degree to which the guiding intention of the indicator cursor can be understood, the appropriateness of the overall layout of the user interface, the degree of eye fatigue during use, the degree of dizziness during use, the degree of satisfaction with the switching speed between the interface, app and video, the degree of illusion during use, the degree of screen freezes, the degree to which the appearance of the indicator cursor prevents me from immersing myself in the app, the degree to which the field of view of the glasses has been fully utilized, the beauty of the main interface, the beauty of the video list interface, the beauty of the download page, the beauty of the 3D video interface, the beauty of the panoramic video interface, the appropriate brightness of the screen, the degree to which the brightness change when switching between screens causes me discomfort, the appropriate placement and ease of finding of the operation buttons, the appropriate size of the operation buttons, the degree to which the prompts are expressed without ambiguity, the reasonable and clear classification of the navigation bar, and the degree of satisfaction with the overall design of the app interface.

[0068] The evaluation of the simulated flight interaction effect can be the content of the interface interaction evaluation questionnaire filled out by the test subjects. The questionnaire includes 12 specific questions, including 8 closed-ended questions and 4 open-ended questions. The closed-ended questions use a 6-point scoring method (1-6, 6 points Litke), and the respondents choose a level from 1 (most negative) to 6 (most positive) to answer, except for the fourth question, which chooses a level from 1 (inadequate) to 6 (very sufficient). The following are the 12 specific questions:

[0069] 1) Have you used a HUD (Heads-Up Display) or HMD (Head-Mounted Display) in a cockpit before?

[0070] 2) How do you feel about the layout, color, and size of displayed data?

[0071] 3) Do you think AR technology is beneficial?

[0072] 4) What do you think about the amount of information displayed?

[0073] 5) If your plane had such a device, would you use it?

[0074] 6) Are the flight parameters displayed clearly?

[0075] 7) Does the HMD increase your situational awareness?

[0076] 8) Does the HMD reduce your workload?

[0077] Open questions

[0078] 9) What indications do you think are missing from the display?

[0079] 10) Which instructions in the display do you think are redundant / unnecessary?

[0080] 11) Would you prefer HMD or traditional HUD?

[0081] 12) If you had the chance, would you buy such a device?

[0082] The sleepiness level evaluation may be the content of the Stanford Sleepiness Scale filled out by the test person, and the emotional feeling evaluation and situational awareness evaluation may be the content of the PAD Emotion Scale filled out by the test person.

[0083] S203 . Determine an evaluation index based on the test result data, wherein the evaluation index includes at least one of the reaction time of the tested person, the task execution accuracy rate, and the number of task execution errors.

[0084] Specifically, different types of evaluation indicators can be determined for different interactive testing tasks.

[0085] For example, for simple homogeneous and heterogeneous search tasks, as well as target recognition and simple specific attribute search tasks, the evaluation indicators that need to be determined include:

[0086] Calculate the following for each round of tasks: 1) Accuracy rate: number of correct answers / number of correct answers * 100%; 2) Error rate: number of incorrect answers / number of correct answers * 100%; 3) Correction rate (unchecking an incorrect selection after discovery): number of modified clicks / total number of clicks (for the same icon, selecting and unchecking counts as one); 4) Efficiency: time spent on answering in this round / number of correct answers.

[0087] Calculation for tasks of the same difficulty (multiple rounds of tasks with the same difficulty): 1) Difficulty accuracy rate: total number of correct answers / number of correct answers * 100%; 2) Difficulty error rate: total number of incorrect answers / number of correct answers * 100%; 3) Difficulty correction rate (unchecking after discovering a wrong selection): total number of clicks modified / total number of clicks (for the same icon, selecting and unchecking counts as one); 4) Difficulty efficiency: total answering time / number of correct answers.

[0088] For the same task, the evaluation report can present visual charts of the overall accuracy, overall error rate, overall correction rate, and overall efficiency under different difficulty levels under the same visual element configuration and the same visual mode. An example is as follows:

[0089] The total accuracy rate of the task as a whole (the overall task process of a single mode) is calculated as: the number of experiments with correct answers / the total number of formal experiments*100%.

[0090] For the task of detecting and matching warning information, the following evaluation metrics are required: For tasks of the same difficulty level (including multiple rounds of tasks of the same difficulty level), 1) overall accuracy rate: total correct answers / total times * 100%; 2) overall error rate: total incorrect answers / total times * 100%; 3) average answer time: sum of answer time per round / round. The evaluation report should present a visual chart of the overall accuracy rate, error rate, and average answer time for each difficulty level under the same visual element configuration and visual mode.

[0091] For the flight instrument target symbol visual search task, the evaluation indicators that need to be determined include:

[0092] Graphic Recognition:

[0093] 1) Overall accuracy: total number of correct answers / total number of answers*100%;

[0094] 2) Overall error rate: total number of incorrect answers / total number of answers*100%;

[0095] 3) Overall reaction time: total response time / total number of times*100%;

[0096] Character orientation recognition:

[0097] 1) Overall accuracy: total number of correct answers / total number of answers*100%;

[0098] 2) Overall error rate: total number of incorrect answers / total number of answers*100%;

[0099] 3) Total reaction time: total response time / total number of times*100%.

[0100] For simple tracking tasks, the evaluation indicators that need to be determined include:

[0101] Calculation for each round of tasks: 1) Accuracy rate: number of correct answers / number of correct answers * 100%; 2) Error rate: number of incorrect answers / number of correct answers * 100%; 3) Correction rate (unchecking after discovering a wrong selection): number of modified clicks / total number of clicks (for the same icon, selecting and unchecking counts as one); 4) Efficiency: time spent on answering in this round / number of correct answers; 5) Answer status for each task: correct / incorrect (multi-task mode only); time spent on answering each task: time from the appearance of the multi-task answer page to submission (multi-task mode only). Calculation for tasks of the same difficulty level (including multiple rounds of tasks of the same difficulty level): 1) Difficulty Correction Rate: Total number of correct answers / Number of correct answers * 100%; 2) Difficulty Error Rate: Total number of incorrect answers / Number of correct answers * 100%; 3) Difficulty Correction Rate (number of clicks that were unchecked after being discovered incorrectly): Total number of clicks corrected / Total number of clicks (for the same icon, checking and unchecking count as one); 4) Difficulty Efficiency: Total answering time / Number of correct answers; 5) Per-task Correction Rate: Number of correct answers per task / Number of rounds of the experiment for that difficulty level (Multi-task mode only); 6) Per-task Average Answering Time: Total time spent in the per-task interface / Number of rounds of the experiment for that difficulty level (Multi-task mode only). Calculation for the entire task (the entire task flow in a single mode): 1) Total Correction Rate: Number of trials with correct answers / Total number of formal trials * 100%; 2) Total Per-task Correction Rate: Number of correct answers per task / Total number of rounds of the experiment (Multi-task mode only).

[0102] For the flight display monitoring task, the evaluation indicators that need to be determined include: Indicator 1: Reaction time per round, calculation formula: reaction time = time when the subject starts operating - time when the aircraft state starts to change; Indicator 2: Operation time per round, calculation formula: operation time = completion time of each round - time when the subject starts operating; if the operation fails within the given time, operation time = deadline operation time - time when the subject starts operating; Indicator 3: Number of speed response errors, calculation formula: number of speed response errors = sum (speed response failure); Indicator 4: Number of altitude response errors, calculation formula: number of altitude response errors = sum (altitude response failure); Indicator 5: Number of tilt response errors, calculation formula: tilt Number of response errors = sum(tilt response failures); Indicator 5: Number of sub-task response errors, calculated as: Number of sub-task response errors = sum(sub-task response failures); Indicator 6: Single operation accuracy, calculated as: Single operation accuracy = sum(number of correct operations) / sum(speed response, height response, tilt response, number of sub-task requests); Indicator 7: Overall operation accuracy, calculated as: Overall operation accuracy = sum(correct response rounds) / total rounds; Indicator 8: Total reaction time, calculated as: total reaction time = sum(reaction time per round); Indicator 9: Total operation time, calculated as: total operation time = sum(operation time per round). "sum" represents the cumulative sum.

[0103] S204: Generate an evaluation report including an evaluation of the effects of the virtual reality (VR) display mode, augmented reality (AR) display mode, and extended reality (XR) display mode of the wearable display device using the evaluation indicators and the interactive experience evaluation data.

[0104] Specifically, the evaluation report may include evaluation indicators and interactive experience evaluation data for each preset display mode. The evaluation indicators and interactive experience evaluation data can also be further mined and summarized to obtain an evaluation of the effectiveness of each preset display mode. For example, if the evaluation indicators and interactive experience evaluation data are input into a preset large prediction model (such as ChatGPT), the model output will be the effectiveness evaluation of each preset display mode.

[0105] The method for determining the display mode effect provided by an embodiment of the present invention evaluates the display effect of a display device through a series of typical visual tasks and simulated flight tasks, and adopts a testing method that combines precise objective test data with user subjective experience data, thereby improving the effectiveness and accuracy of the display effect evaluation results and ensuring the comprehensiveness of the test.

[0106] Example 3

[0107] Figure 4 This is a schematic diagram of a device for determining a display mode effect according to the third embodiment of the present invention. Figure 4 As shown, the device includes: an instruction sending module 301, a data receiving module 302 and an effect evaluation module 303, wherein:

[0108] An instruction sending module is used to send a play test instruction to the display device to instruct the display device to interact with the test person by displaying an image corresponding to the interactive test task in at least two preset display modes;

[0109] A data receiving module, configured to receive the test result data of the interactive test task and the interactive experience evaluation data of the tested person;

[0110] The effect evaluation module is used to generate an effect evaluation of each preset display mode of the display device based on the test result data and the interactive experience evaluation data.

[0111] The apparatus for determining display mode effects provided by embodiments of the present invention instructs a display device to display interactive test tasks in multiple display modes and receives test result data and interactive experience evaluation data from the test subjects performing the interactive test tasks. Based on this data, the display effects of the display device in different visual modes can be evaluated. Compared to traditional, relatively crude, manual qualitative analysis, this apparatus combines objective test data with the user's subjective experience to accurately and efficiently determine an evaluation of the display device's display effects.

[0112] Optionally, the interactive test task includes a first visual cognition task; the first visual cognition task is a task for testing target recognition, mental workload and visual fatigue in a created simulated flight scene.

[0113] Optionally, the interactive test task also includes a second visual cognition task; the second visual cognition task is a task for testing target recognition, mental workload and visual fatigue in a non-simulated flight scene.

[0114] Optionally, the interactive test task includes a third visual cognition task; the third visual cognition task is a task for testing target recognition, mental workload and visual fatigue respectively after adding interference to the created simulated flight scene and non-simulated flight scene.

[0115] Optional, effect evaluation module includes:

[0116] An evaluation index unit, configured to determine an evaluation index based on the test result data, wherein the evaluation index includes at least one of the reaction time of the tested person, the accuracy of task execution, and the number of task execution errors;

[0117] An evaluation report generating unit is used to generate an evaluation report including an effect evaluation of each preset display mode of the display device by using the evaluation index and the interactive experience evaluation data.

[0118] Optionally, the interactive experience evaluation data includes at least one of the tested person's mental workload evaluation, test load evaluation, dizziness experience evaluation, comfort level evaluation, interactive satisfaction evaluation of the display interface of the display device, simulated flight interactive effect evaluation, sleepiness level evaluation, emotional experience evaluation and situational awareness evaluation; the test load evaluation is an evaluation of the difficulty of the interactive test task.

[0119] Optionally, the display device includes a wearable display device; the preset display mode includes at least two of a virtual reality (VR) display mode, an augmented reality (AR) display mode, and an extended reality (XR) display mode.

[0120] The apparatus for determining the display mode effect provided by the embodiment of the present invention can execute the method for determining the display mode effect provided by any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0121] Example 4

[0122] Figure 5 A schematic diagram of the structure of an electronic device 40 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or claimed herein.

[0123] like Figure 5As shown, the electronic device 40 includes at least one processor 41 and a memory, such as a read-only memory (ROM) 42, a random access memory (RAM) 43, etc., which is communicatively connected to the at least one processor 41. The memory stores a computer program that can be executed by the at least one processor, and the processor 41 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 42 or the computer program loaded from the storage unit 48 into the random access memory (RAM) 43. Various programs and data required for the operation of the electronic device 40 can also be stored in the RAM 43. The processor 41, ROM 42, and RAM 43 are connected to each other via a bus 44. An input / output (I / O) interface 45 is also connected to the bus 44.

[0124] Multiple components in the electronic device 40 are connected to the I / O interface 45, including an input unit 46, such as a keyboard, a mouse, etc.; an output unit 47, such as various types of displays, speakers, etc.; a storage unit 48, such as a magnetic disk, an optical disk, etc.; and a communication unit 49, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 49 allows the electronic device 40 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0125] Processor 41 can be any general-purpose and / or specialized processing component with processing and computing capabilities. Some examples of processor 41 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various specialized artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any other suitable processor, controller, microcontroller, etc. Processor 41 executes the various methods and processes described above, such as the method for determining the display mode effect.

[0126] In some embodiments, the method for determining a display mode effect may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 48. In some embodiments, part or all of the computer program may be loaded and / or installed on electronic device 40 via ROM 42 and / or communication unit 49. When the computer program is loaded into RAM 43 and executed by processor 41, one or more steps of the method for determining a display mode effect described above may be performed. Alternatively, in other embodiments, processor 41 may be configured to perform the method for determining a display mode effect in any other suitable manner (e.g., by means of firmware).

[0127] Various embodiments of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system-on-chip (SOC) systems, complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0128] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when the computer program is executed by the processor, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The computer program may be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0129] The computer device provided above can be used to execute the method for determining the display mode effect provided in any of the above embodiments, and has corresponding functions and beneficial effects.

[0130] Example 5

[0131] In the context of the present invention, a computer-readable storage medium may be a tangible medium having computer-executable instructions for performing, when executed by a computer processor, a method for determining a display mode effect, the method comprising:

[0132] Sending a play test instruction to a display device to instruct the display device to interact with the testee by displaying an image corresponding to the interactive test task in at least two preset display modes;

[0133] Receive the test result data of the interactive test task and the interactive experience evaluation data of the tested person;

[0134] An effect evaluation of each preset display mode of the display device is generated according to the test result data and the interactive experience evaluation data.

[0135] In the context of the present invention, computer-readable storage medium can be a tangible medium that can contain or store a computer program for use with an instruction execution system, device or equipment or used in conjunction with an instruction execution system, device or equipment. Computer-readable storage medium can include but is not limited to electronic, magnetic, optical, electromagnetic, infrared or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, computer-readable storage medium can be a machine-readable signal medium. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0136] The computer device provided above can be used to execute the method for determining the display mode effect provided in any of the above embodiments, and has corresponding functions and beneficial effects.

[0137] It is worth noting that in the embodiment of the above-mentioned device for determining the display mode effect, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention.

[0138] Note that the above are only preferred embodiments of the present invention and the technical principles employed. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments, and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments and may include many other equivalent embodiments without departing from the concept of the present invention. The scope of the present invention is determined by the scope of the appended claims.

Claims

1. A method for determining a display mode effect, characterized in that: include: Sending a play test instruction to a display device to instruct the display device to interact with the testee by displaying an image corresponding to the interactive test task in at least two preset display modes; Receive the test result data of the interactive test task and the interactive experience evaluation data of the tested person; An effect evaluation of each preset display mode of the display device is generated according to the test result data and the interactive experience evaluation data.

2. The method according to claim 1, characterized in that The interactive test task includes a first visual cognition task; The first visual cognition task is a task that tests target recognition, mental workload and visual fatigue in a simulated flight scene.

3. The method according to claim 2, characterized in that The interactive test task also includes a second visual cognition task; The second visual cognition task is a task that tests target recognition, mental workload and visual fatigue in a non-simulated flight scenario.

4. The method according to any one of claims 1 to 3, characterized in that The interactive test task includes a third visual cognition task; The third visual cognition task is a task that tests target recognition, mental workload and visual fatigue respectively after adding interference to the created simulated flight scene and non-simulated flight scene.

5. The method according to claim 1, wherein Generating an effect evaluation of each preset display mode of the display device according to the test result data and the interactive experience evaluation data includes: Determining an evaluation indicator based on the test result data, wherein the evaluation indicator includes at least one of the reaction time of the tested person, the accuracy of task execution, and the number of task execution errors; An evaluation report including an effect evaluation of each preset display mode of the display device is generated by using the evaluation index and the interactive experience evaluation data.

6. The method according to claim 1 or 5, characterized in that The interactive experience evaluation data includes at least one of the following: the mental workload evaluation, test workload evaluation, dizziness experience evaluation, comfort level evaluation, interactive satisfaction evaluation of the display interface of the display device, simulated flight interactive effect evaluation, sleepiness level evaluation, emotional experience evaluation, and situational awareness evaluation of the tested person; The test load evaluation is an evaluation of the difficulty of the interactive test task.

7. The method according to claim 1, characterized in that The display device includes a wearable display device; the preset display mode includes at least two of a virtual reality (VR) display mode, an augmented reality (AR) display mode, and an extended reality (XR) display mode.

8. A device for determining a display mode effect, characterized in that: include: An instruction sending module is used to send a play test instruction to the display device to instruct the display device to interact with the test person by displaying an image corresponding to the interactive test task in at least two preset display modes; A data receiving module, configured to receive the test result data of the interactive test task and the interactive experience evaluation data of the tested person; The effect evaluation module is used to generate an effect evaluation of each preset display mode of the display device based on the test result data and the interactive experience evaluation data.

9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor. The computer program is executed by the at least one processor to enable the at least one processor to perform the method for determining a display mode effect according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the method for determining a display mode effect according to any one of claims 1 to 7 when executed.

Images