Method and device for testing eye movement precision of head-mounted display

Abstract

The invention provides a head-mounted display eye movement precision test method and device, and relates to the technical field of eye movement tracking precision test.The method comprises the steps that when an artificial eye moves according to preset parameters, first eye movement data, obtained by an encoder collection module, of the artificial eye is obtained, acquiring second eye movement data of the artificial eye sent by an eye movement program in the head-mounted display; comparing the first eye movement data with the second eye movement data to obtain a comparison result; judging whether the eye movement tracking precision of the head-mounted display meets a preset precision requirement or not according to the comparison result; if the eye movement tracking precision meets the preset precision requirement, determining that an eye movement tracking system of the head-mounted display is normal; and if the eye movement tracking precision does not meet the preset precision requirement, determining that the eye movement tracking system of the head-mounted display is abnormal. The technical effect of the invention is that the precision of the eye movement tracking system of the head-mounted display can be effectively tested.

Description

Technical Field

[0001] The present application relates to the technical field of eye tracking accuracy testing, and in particular to a method and device for testing eye tracking accuracy of a head mounted display. Background Art

[0002] With the rapid development of virtual reality (VR) and augmented reality (AR) technologies, head-mounted displays (HMDs) are increasingly being used in various fields. In order to improve user experience, eye tracking technology is widely used in head-mounted displays to monitor and analyze user eye movements to achieve more natural and immersive interactions. However, the accuracy of the eye tracking system is crucial to the user experience. If the system cannot accurately capture the user's eye movement information, it will directly affect the effect of the application. Therefore, how to effectively test and ensure the accuracy of the head-mounted display eye tracking system has become an urgent problem to be solved.

[0003] Existing eye tracking accuracy testing methods usually rely on complex calibration processes and actual user testing. The accuracy of the system is evaluated by having users wear a head-mounted display and perform a series of preset eye movements, and then collecting and comparing eye movement data. These methods can detect system accuracy problems to a certain extent, but these methods rely on the participation of actual users, and the test results are easily affected by user operations, resulting in inaccurate test results. Summary of the invention

[0004] The present application provides a head-mounted display eye movement accuracy testing method and device, which are used to effectively test the accuracy of the head-mounted display eye tracking system.

[0005] In a first aspect, the present application provides a method for testing eye movement accuracy of a head-mounted display, the method comprising: when an artificial eye moves according to preset parameters, obtaining first eye movement data of the artificial eye obtained by an encoder acquisition module, and obtaining second eye movement data of the artificial eye sent by an eye movement program in the head-mounted display; comparing the first eye movement data with the second eye movement data to obtain a comparison result; based on the comparison result, determining whether the eye movement tracking accuracy of the head-mounted display meets the preset accuracy requirement; if the eye movement tracking accuracy meets the preset accuracy requirement, determining that the eye movement tracking system of the head-mounted display is normal; if the eye movement tracking accuracy does not meet the preset accuracy requirement, determining that the eye movement tracking system of the head-mounted display is abnormal.

[0006] By adopting the above technical solution, artificial eyes are used instead of actual user eyes for testing, and the test process no longer depends on user operation, which greatly improves the repeatability and reliability of the data. The motion parameters of the artificial eye are preset and can be strictly controlled and repeated, so the test conditions are consistent each time, eliminating errors caused by improper user operation or randomness. The complex user calibration steps and line of sight movement process are eliminated, the test process is simplified, and time costs are significantly saved. Through the preset artificial eye movement parameters, the eye movement behavior in actual use can be simulated more accurately, which can effectively test the accuracy of the head-mounted display eye tracking system.

[0007] Optionally, the method of obtaining the first eye movement data of the artificial eye acquired by the encoder acquisition module, and obtaining the second eye movement data of the artificial eye sent by the eye movement program in the head-mounted display, includes: starting the encoder acquisition module and the eye movement program in the head-mounted display; acquiring the first eye movement data of the artificial eye at a preset acquisition frequency through the encoder acquisition module, the first eye movement data including multiple first data; acquiring the second eye movement data of the artificial eye through the eye movement program in the head-mounted display, the second eye movement data including multiple second data.

[0008] By adopting the above technical solution, the synchronous start of the two acquisition systems reduces the time deviation and lays the foundation for the accurate comparison of subsequent data. High-frequency data acquisition can capture subtle changes in eye movements and provide more comprehensive and accurate eye movement information. Secondly, the first eye movement data obtained by the encoder acquisition module is used as a reference standard, which forms a direct correspondence with the second eye movement data obtained by the head-mounted display eye movement program, facilitating accurate performance evaluation. This correspondence makes it possible to directly compare the two sets of data at each time point, thereby analyzing the accuracy and response characteristics of the head-mounted display eye tracking system in detail.

[0009] Optionally, comparing the first eye movement data and the second eye movement data to obtain a comparison result includes: one-to-one matching of multiple first data in the first eye movement data with multiple second data in the second eye movement data; calculating the difference between each pair of corresponding first data and second data, and taking the difference between each pair of corresponding first data and second data as the comparison result.

[0010] By adopting the above technical solution, an accurate quantitative evaluation of the performance of the head-mounted display eye tracking system is achieved through one-to-one data comparison and difference calculation. It provides continuous performance indicators with high temporal resolution, which can reflect the performance of the system in various eye movement states in detail. This method not only helps to identify small fluctuations and potential problems in system performance, but also provides a rich data foundation for in-depth statistical analysis and visual display. The standardized comparison process improves the comparability of test results and facilitates long-term performance tracking and comparison between different products.

[0011] Optionally, judging whether the eye tracking accuracy of the head-mounted display meets the preset accuracy requirements based on the comparison result includes: calculating the average value of the difference between each pair of corresponding first data and second data, and taking the average value of the difference as the deviation value of the eye tracking accuracy of the head-mounted display; judging whether the deviation value is within a preset deviation interval; if the deviation value is within the preset deviation interval, determining that the eye tracking accuracy meets the preset accuracy requirements; if the deviation value is not within the preset deviation interval, determining that the eye tracking accuracy does not meet the preset accuracy requirements.

[0012] By adopting the above technical solution, by calculating the average value of the difference as the deviation value and comparing it with the preset deviation range, a concise and effective way to evaluate the eye tracking accuracy of the head-mounted display is provided. The above method simplifies complex performance data into a single, easy-to-understand indicator, while reducing the impact of single measurement errors by using the average value, thereby improving the reliability of the evaluation. The use of preset deviation intervals provides flexibility for the evaluation, and the standards can be adjusted according to the needs of different application scenarios. This binary judgment mechanism (satisfied or not satisfied) makes the results clear and easy to implement, which is conducive to making quality control decisions quickly.

[0013] Optionally, when the artificial eye moves according to preset parameters, before obtaining the first eye movement data of the artificial eye acquired by the encoder acquisition module, and obtaining the second eye movement data of the artificial eye sent by the eye movement program in the head-mounted display, it also includes: fixing the head-mounted display to be tested on a head model of a test workbench, wherein the artificial eye is arranged at the eye position of the head model; installing and running the eye movement tracking program in the head-mounted display; setting parameters for controlling the movement of the artificial eye in the analysis system, wherein the parameters include the direction and speed of rotation of the artificial eye; and sending control instructions to a drive device that controls the movement of the artificial eye, so that the artificial eye moves according to the parameters.

[0014] By adopting the above technical solution, the method achieves precise control of test conditions by fixing the display on the head model with artificial eyes, installing and running the eye tracking program, setting the parameters of artificial eye movement, and sending control instructions. It eliminates the uncertainty caused by human factors and improves the consistency and repeatability of the test; it simulates various possible eye movement scenarios, allowing for a comprehensive evaluation of equipment performance; it provides a standardized test process to ensure the comparability of results between different batches or models of products; and it also improves test efficiency, especially in large-scale production and quality control.

[0015] Optionally, the method also includes: acquiring the first eye movement data and the second eye movement data under different lighting conditions; comparing the first eye movement data and the second eye movement data under different lighting conditions to obtain multiple comparison results under different lighting conditions; judging whether the eye tracking accuracy of the head-mounted display under different lighting conditions meets the preset accuracy requirement based on the multiple comparison results; if the eye tracking accuracy meets the preset accuracy requirement under all different lighting conditions, it is determined that the eye tracking system of the head-mounted display is normal under different lighting conditions; if the eye tracking accuracy does not meet the preset accuracy requirement under any lighting condition, it is determined that there is an abnormality in the eye tracking system of the head-mounted display.

[0016] By adopting the above technical solution, the present application significantly improves the comprehensiveness and accuracy of the comparison results by performing difference calculation on the target data after synchronization processing, and judging whether each parameter meets the preset accuracy requirements based on the comparison results. If the eye tracking accuracy does not meet the preset accuracy requirements, the system is further calibrated and optimized by determining the parameters to be adjusted and generating a calibrated eye movement program, thereby ensuring the stability and user experience of the head-mounted display eye tracking system. At the same time, by testing under different lighting conditions, the reliability and stability of the system are further verified, ensuring the efficiency and reliability of the system in various environments. This solution not only overcomes the problem of incomplete data comparison in the prior art, but also improves the pertinence and effectiveness of testing and calibration, ensuring the efficiency and reliability of the system in practical applications.

[0017] Optionally, if the eye tracking accuracy does not meet the preset accuracy requirement, after determining that the eye tracking system of the head-mounted display is abnormal, it also includes: generating abnormal alarm information, and sending the abnormal alarm information to the terminal device of the operator, so that the operator can debug and repair the head-mounted display.

[0018] By adopting the above technical solution, by generating abnormal alarm information and sending it to the operator's terminal device, the operator can debug and repair the head-mounted display in time. This operation greatly improves the system's real-time monitoring capability, maintenance efficiency and overall reliability, ensures the efficiency and stability of the head-mounted display in actual applications, and significantly improves the user experience and the service life of the equipment.

[0019] In a second aspect, the present application provides a head-mounted display eye movement accuracy testing device, the device comprising: the device comprising: an acquisition module, a comparison module, a judgment module and a determination module; wherein the acquisition module is used to obtain first eye movement data of the artificial eye sent by the eye movement program in the head-mounted display when the artificial eye moves according to preset parameters, and obtain second eye movement data of the artificial eye obtained by the encoder acquisition module; the comparison module is used to compare the first eye movement data and the second eye movement data to obtain a comparison result; the judgment module is used to judge whether the eye movement tracking accuracy of the head-mounted display meets the preset accuracy requirement based on the comparison result; the determination module is used to determine that the eye movement tracking system of the head-mounted display is normal if the eye movement tracking accuracy meets the preset accuracy requirement; if the eye movement tracking accuracy does not meet the preset accuracy requirement, determine that the eye movement tracking system of the head-mounted display is abnormal.

[0020] In a third aspect, the present application provides an electronic device that adopts the following technical solution: it includes a processor, a memory, a user interface, and a network interface, the memory is used to store instructions, the user interface and the network interface are used to communicate with other devices, and the processor is used to execute the instructions stored in the memory so that the electronic device executes a computer program such as any of the above-mentioned head-mounted display eye movement accuracy testing methods.

[0021] In a fourth aspect, the present application provides a computer-readable storage medium, which adopts the following technical solution: storing a computer program that can be loaded by a processor and execute any of the above-mentioned head-mounted display eye movement accuracy testing methods.

[0022] In summary, the present application includes at least one of the following beneficial technical effects: By using artificial eyes instead of actual user eyes for testing, the test process no longer relies on user operation, which greatly improves the repeatability and reliability of the data. The motion parameters of the artificial eye are preset and can be strictly controlled and repeated, so the test conditions are consistent each time, eliminating errors caused by improper user operation or randomness. The complex user calibration steps and line of sight movement process are eliminated, simplifying the test process and significantly saving time costs. Through the preset artificial eye movement parameters, the eye movement behavior in actual use can be simulated more accurately, which can effectively test the accuracy of the head-mounted display eye tracking system. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 It is an HMD eye movement accuracy analysis system provided in an embodiment of the present application; Figure 2 It is a flowchart of a head mounted display eye movement accuracy testing method provided in an embodiment of the present application; Figure 3 It is a structural schematic diagram of a head-mounted display eye movement accuracy testing device provided in an embodiment of the present application; Figure 4 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application.

[0024] Description of reference numerals: 1000, electronic device; 1001, processor; 1002, communication bus; 1003, user interface; 1004, network interface; 1005, memory. DETAILED DESCRIPTION

[0025] In order to enable those skilled in the art to better understand the technical solutions in this specification, the technical solutions in the embodiments of this specification will be clearly and completely described below in conjunction with the drawings in the embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this application, not all of the embodiments.

[0026] In the description of the embodiments of the present application, words such as "illustrative", "for example" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "illustrative", "for example" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "illustrative", "for example" or "for example" is intended to present related concepts in a concrete way.

[0027] In the application scenario of the present invention, the eye movement recognition accuracy test of the head-mounted display (HMD) device is widely used in the research and development and production of virtual reality (VR), augmented reality (AR) and mixed reality (MR) devices. Especially in VR head-mounted displays, eye tracking technology is used to improve user experience, such as line of sight control and gaze point rendering. Through accuracy testing, it is ensured that the device can accurately capture the user's eye movements to avoid delays or errors. In AR devices, eye movement recognition is used for interactive operations and information display, and accuracy testing ensures that the device can still accurately identify the user's line of sight in complex environments. MR devices combine virtual and real environments, and eye tracking technology is particularly important in them. The test accuracy helps to improve the interactive experience and accuracy of the device.

[0028] like Figure 1 As shown, Figure 1This is an HMD eye movement accuracy analysis system provided in an embodiment of the present application. Before conducting the test, you need to make adequate preparations. First, in terms of equipment preparation, ensure that the HMD device to be tested functions normally and install the eye movement recognition software. You also need to prepare a simulation head equipped with an artificial eye and a high-speed camera that can simulate human eye movement. At the same time, prepare an encoder acquisition module to accurately record the movement information of the artificial eye. It is necessary to ensure that its acquisition frequency and accuracy meet the test requirements. In terms of software preparation, install and configure the eye movement recognition program on the HMD device to capture and record eye movement data in real time, and send the captured and recorded eye movement data to the analysis report module for subsequent processing and analysis of the eye movement data. The analysis report module has image analysis and data comparison functions.

[0029] In terms of environmental preparation, ensure that the test environment has moderate light and no interference to avoid external factors affecting the collection of eye movement data, and use fixtures on the test bench to fix the HMD device and the simulation head to ensure the stability of the device and model position during the test. The drive instruction module sends instructions to the motor drive encoder. After receiving the instructions, the rotating device controls the rotating device to realize the motion parameters such as the rotation angle, speed and direction of the simulation head and artificial eye, simulate different eye movement situations, and configure the encoder's acquisition frequency and data recording format to ensure data accuracy and consistency. Before the test, calibrate the HMD device, simulation head and encoder to ensure coordination and synchronization between the devices, and calibrate the eye movement recognition program and data analysis report module to ensure that they accurately capture and process eye movement data.

[0030] Figure 2 is a flow chart of a head mounted display eye movement accuracy test method provided in an embodiment of the present application. It should be understood that although Figure 2 The steps in the flowchart are shown in sequence as indicated by the arrows, but the steps are not necessarily executed in the order indicated by the arrows; unless otherwise specified in this document, there is no strict order restriction for the execution of the steps, and the steps may be executed in other orders; and Figure 2 At least part of the steps may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.

[0031] This application discloses a head mounted display eye movement accuracy test method, such as Figure 2 As shown, the method includes S101-S104.

[0032] S101, when the artificial eye moves according to preset parameters, first eye movement data of the artificial eye acquired by the encoder acquisition module is acquired, and second eye movement data of the artificial eye sent by the eye movement program in the head mounted display is acquired.

[0033] In one example, the drive instruction module first sends instructions to the motor drive encoder to control the rotating device to make the artificial eye move according to the preset motion parameters. These preset parameters include rotation angle, speed and direction, etc., to simulate various possible eye movement situations. At the same time, the encoder acquisition module accurately records the actual movement data of the artificial eye at a preset high acquisition frequency. These data are regarded as baseline data, i.e., the first eye movement data. At the same time, the eye movement program running in the head-mounted display captures and records the movement of the artificial eye through its built-in eye tracking system to generate the second eye movement data.

[0034] The acquisition process of these two sets of data is carried out synchronously to ensure the time consistency of the data. The first eye movement data acquired by the encoder acquisition module represents the actual movement trajectory of the artificial eye, which is highly accurate and reliable. The second eye movement data acquired by the head-mounted display eye movement program reflects the recognition result of the device's own eye tracking system. In this way, a set of accurate benchmark data and a set of recognition data to be tested can be obtained.

[0035] The main advantage of this dual data collection method is that it provides an objective and accurate basis for comparison. By comparing the two sets of data, the accuracy of the head-mounted display eye tracking system can be accurately evaluated. This method eliminates the errors and uncertainties that may be caused by relying on actual users in traditional tests, and improves the repeatability and reliability of the test. In addition, due to the use of high-precision encoders and preset motion parameters, this method can simulate a variety of complex eye movement situations, including fast movements, small movements, etc., so as to comprehensively evaluate the performance of the eye tracking system in various situations.

[0036] The two sets of data obtained by this method provide a reliable basis for subsequent data comparison and analysis, which helps to accurately determine whether the accuracy of the head-mounted display eye tracking system meets the preset requirements, and then determine whether the system is operating normally. This is not only conducive to improving the quality control level of the head-mounted display, but also provides valuable data support for product optimization and improvement.

[0037] Based on the above embodiment, as an optional implementation manner, in S101, obtaining first eye movement data of the artificial eye obtained by the encoder acquisition module, and obtaining second eye movement data of the artificial eye sent by the eye movement program in the head mounted display, include: Start the encoder acquisition module and the eye movement program in the head-mounted display; collect first eye movement data of the artificial eye at a preset acquisition frequency through the encoder acquisition module, the first eye movement data including multiple first data; obtain second eye movement data of the artificial eye through the eye movement program in the head-mounted display, the second eye movement data including multiple second data.

[0038] In one example, the encoder acquisition module and the eye movement program in the head-mounted display are first started simultaneously. This step ensures the synchronous startup of the two data acquisition systems, reduces time deviation, and lays the foundation for accurate comparison of subsequent data. After startup, the encoder acquisition module collects the first eye movement data of the artificial eye at a preset acquisition frequency. This preset frequency should generally be higher than the highest frequency of human eye movement to ensure that all subtle eye movement changes can be captured. For example, it may be set to 1000Hz or higher, depending on the test requirements and equipment capabilities. The collected first eye movement data includes multiple first data, which may include timestamps, X, Y, Z coordinates of the eye position, and movement speed and other information.

[0039] At the same time, the eye movement program in the head-mounted display is also continuously acquiring the second eye movement data of the artificial eye. This process simulates the situation in which the head-mounted display tracks the user's eye movements in actual usage scenarios. The acquired second eye movement data also includes multiple second data, and its data structure and content should be consistent with the first eye movement data for subsequent direct comparison.

[0040] The key to this method is to ensure that the acquisition process of the two sets of data is synchronized and continuous. By using a preset high acquisition frequency, high temporal resolution eye movement data can be obtained, which is particularly important for capturing rapid eye movements or small eye movements. At the same time, since the two systems are started and run synchronously, it can be ensured that the first data and the second data at each moment are directly corresponding, which greatly simplifies the subsequent data comparison and analysis process.

[0041] S102, comparing the first eye movement data and the second eye movement data to obtain a comparison result.

[0042] In one example, the first eye movement data and the second eye movement data need to be processed synchronously on the same time axis. Since the two sets of data may have different sampling frequencies or time delays, they need to be mapped to a unified time reference through interpolation or alignment algorithms. Then, each time point in the two sets of data is compared one by one to calculate the difference between them. These difference values ​​are usually expressed as position errors (such as angle differences or pixel differences).

[0043] In order to ensure the accuracy of the comparison results, statistical analysis methods can be used to process these difference values. For example, statistical indicators such as average error, maximum error, minimum error and standard deviation can be calculated to comprehensively evaluate the recognition accuracy of the HMD device under different eye movement parameters. In addition, the comparison results can be intuitively displayed by drawing an error distribution graph or a curve graph showing the error changing over time.

[0044] The effect of the above comparison is to clearly point out the eye movement recognition error of the HMD device under different conditions, thereby providing specific data support for subsequent device optimization. For example, if the error is large at certain angles or speeds, the eye movement recognition algorithm of the HMD device can be optimized for these situations to improve the overall recognition accuracy. At the same time, error analysis can also help discover defects in the design or manufacturing process of the device, providing a basis for quality control and improvement.

[0045] Based on the above embodiment, as an optional implementation, in S102, comparing the first eye movement data and the second eye movement data to obtain a comparison result specifically includes: The plurality of first data in the first eye movement data are matched one by one with the plurality of second data in the second eye movement data; the difference between each pair of corresponding first data and second data is calculated, and the difference between each pair of corresponding first data and second data is used as the comparison result.

[0046] In one example, first, a plurality of first data in the first eye movement data is matched one-to-one with a plurality of second data in the second eye movement data. This matching process is based on the timestamps or sampling numbers of the two sets of data, ensuring that each pair of data represents the eye movement state at the same moment. The importance of this step is to establish an accurate correspondence between the two sets of data, laying the foundation for the subsequent difference calculation.

[0047] After establishing the correspondence, the system calculates the difference between each pair of corresponding first data and second data. This difference calculation process may involve multiple dimensions, such as the difference in the X, Y, and Z coordinates of the eye position, or the difference in the eye movement speed. Each calculated difference directly reflects the deviation between the measurement results of the head-mounted display eye tracking system and the actual eye movement state (recorded by a high-precision encoder) at a specific moment or specific parameter. These differences are used as comparison results and constitute the core data for evaluating the accuracy of the eye tracking system.

[0048] The advantage of this method is that it provides a direct and quantitative way to evaluate the performance of an eye tracking system. By calculating the difference at each moment, we can get the dynamic changes in system performance, rather than just a static average. This is crucial for understanding the performance of the system under different eye movement states. For example, these difference data can be used to analyze the accuracy difference of the system during rapid eye movement and slow eye movement, or to identify the performance bottleneck of the system within a specific eye movement range.

[0049] Another important advantage of this method is its high customizability and flexibility. Depending on the specific evaluation needs, you can choose to focus on specific parameters or time periods for more targeted analysis. For example, you can focus on the accuracy of eye position or focus on the accuracy of eye movement speed.

[0050] S103: judging whether the eye tracking accuracy of the head mounted display meets a preset accuracy requirement according to the comparison result.

[0051] In one example, the preset accuracy requirements need to be clarified first. These requirements are usually determined during the equipment design and development phase, and may include specific indicators such as average error, maximum error, standard deviation, etc. For example, the preset accuracy requirements may stipulate that the average error does not exceed 0.5 degrees, the maximum error does not exceed 1 degree, and the standard deviation does not exceed 0.2 degrees.

[0052] After obtaining the comparison results, these statistical indicators are compared with the preset accuracy requirements one by one. If all error indicators in the comparison results are within the preset range, it can be judged that the eye tracking accuracy of the HMD device meets the requirements. The specific judgment process can be achieved by writing an automated detection program, which can read the comparison results, compare them with the preset accuracy requirements, and output the judgment results.

[0053] If some indicators in the comparison results are beyond the preset range, further analysis of the cause of the error is required. This may involve re-examining the data acquisition process, calibration methods, algorithm performance, etc. Through detailed error analysis, the specific reasons for the large recognition error can be found, for example, the error is large at certain specific angles or speeds, or the recognition accuracy is unstable under certain specific environmental conditions.

[0054] Based on the above embodiment, as an optional implementation, in S103, judging whether the eye tracking accuracy of the head mounted display meets the preset accuracy requirement according to the comparison result includes: Calculate the average value of the difference between each pair of corresponding first data and second data, and use the average value of the difference as the deviation value of the eye tracking accuracy of the head-mounted display; determine whether the deviation value is within a preset deviation interval; if the deviation value is within the preset deviation interval, determine that the eye tracking accuracy meets the preset accuracy requirement; if the deviation value is not within the preset deviation interval, determine that the eye tracking accuracy does not meet the preset accuracy requirement.

[0055] In one example, the average value of the difference between each pair of corresponding first data and second data is first calculated. This average value is defined as the deviation value of the eye tracking accuracy of the head-mounted display. The reason for choosing to use the average value as the evaluation criterion is that it can comprehensively reflect the overall performance of the system during the entire test process, smooth out the impact of instantaneous fluctuations, and provide a more stable and reliable evaluation indicator.

[0056] After calculating the deviation value, the next step is to determine whether the deviation value is within the preset deviation range. This preset deviation range is an acceptable error range predetermined based on product performance requirements and industry standards. The advantage of setting such an interval instead of a fixed threshold is that it takes into account the reasonable errors that may exist in the measurement process and provides a more flexible and practical evaluation standard.

[0057] The judgment process uses a simple and clear binary decision logic: if the deviation value is within the preset deviation range, it is determined that the eye tracking accuracy meets the preset accuracy requirements; conversely, if the deviation value is not within this range, it is determined that the eye tracking accuracy does not meet the preset accuracy requirements. The advantage of this judgment method is that its results are clear, easy to understand and implement, and it is conducive to making quality control decisions quickly.

[0058] S104: If the eye tracking accuracy meets the preset accuracy requirement, it is determined that the eye tracking system of the head mounted display is normal; if the eye tracking accuracy does not meet the preset accuracy requirement, it is determined that the eye tracking system of the head mounted display is abnormal.

[0059] In one example, after obtaining the comparison results, these statistical indicators are compared one by one with the preset accuracy requirements. If all error indicators in the comparison results are within the preset range, the eye tracking system of the head-mounted display is determined to be normal. Specifically, the automated detection program reads the comparison results, compares them with the preset accuracy requirements, and outputs the judgment results. If all error indicators meet the preset requirements, the program will mark the device status as "normal" and generate a relevant report to record the various error indicators and comparison results. In this way, when the device enters the production and marketing stage, it can be confirmed that its performance meets the design expectations and can provide a reliable user experience.

[0060] When the artificial eye moves according to the preset parameters, before obtaining the first eye movement data of the artificial eye obtained by the encoder acquisition module and obtaining the second eye movement data of the artificial eye sent by the eye movement program in the head mounted display, it also includes: The head-mounted display to be tested is fixed on a head model of a test workbench, with an artificial eye provided at the eye position of the head model; an eye tracking program is installed and run in the head-mounted display; parameters for controlling the movement of the artificial eye are set in the analysis system, the parameters including the direction and rotation speed of the artificial eye; and control instructions are sent to a driving device for controlling the movement of the artificial eye so that the artificial eye moves according to the parameters.

[0061] In one example, first, the head-mounted display to be tested is fixed on the head model of the test bench, and the artificial eyes are installed at the eye positions of the head model. The importance of this step is that it simulates the wearing state of the head-mounted display in actual use, while providing a stable test platform. The advantage of using a head model instead of a real tester is that it eliminates the uncertainty caused by human factors, such as slight head movements or blinking, thereby improving the consistency and repeatability of the test.

[0062] Next, install and run the eye tracking program in the head-mounted display. This step ensures that the device under test is in normal working condition and the eye tracking function is correctly activated. By using a standardized eye tracking program, it can be ensured that different batches or different models of head-mounted displays are tested in the same software environment, which improves the comparability of the test results.

[0063] Then, the parameters for controlling the artificial eye movement, including the direction and speed of rotation, are set in the analysis system. This step allows precise control of the test conditions to simulate a variety of possible eye movement scenarios. By systematically varying these parameters, the performance of the head-mounted display under different eye movement states can be fully evaluated. For example, rapid eye movements and slow eye movements can be set, or eye movement patterns in different usage scenarios such as reading and observation can be simulated. This parameterized test method helps to identify performance characteristics or potential problems of the device under specific conditions.

[0064] Finally, control instructions are sent to the drive device that controls the movement of the artificial eye, so that the artificial eye moves according to the set parameters. This step converts the preset test parameters into actual physical movement and begins the formal testing process. By precisely controlling the movement of the artificial eye, repeatable and comparable test conditions can be created to ensure consistency in each test.

[0065] The method also includes: obtaining first eye movement data and second eye movement data under different lighting conditions; comparing the first eye movement data and the second eye movement data under different lighting conditions to obtain multiple comparison results under different lighting conditions; judging whether the eye tracking accuracy of the head-mounted display under different lighting conditions meets the preset accuracy requirement according to the multiple comparison results; if the eye tracking accuracy under all different lighting conditions meets the preset accuracy requirement, determining that the eye tracking system of the head-mounted display is normal under different lighting conditions; if the eye tracking accuracy under any lighting condition does not meet the preset accuracy requirement, determining that there is an abnormality in the eye tracking system of the head-mounted display.

[0066] In one example, the first eye movement data and the second eye movement data obtained under different lighting conditions are compared to obtain multiple comparison results. Through the comparison, the performance of the system under different lighting conditions can be analyzed to find out possible errors and inconsistencies. These comparison results will serve as an important basis for judging the performance of the system.

[0067] Based on these comparison results, it is necessary to determine whether the eye tracking accuracy of the head-mounted display under different lighting conditions meets the preset accuracy requirements. If the eye tracking accuracy meets the preset accuracy requirements under all different lighting conditions, it can be determined that the eye tracking system of the head-mounted display is normal under different lighting conditions. This shows that the system can maintain high-precision eye tracking performance under various ambient lighting conditions and has good environmental adaptability and stability.

[0068] However, if the eye tracking accuracy does not meet the preset accuracy requirements under any lighting conditions, it is determined that there is an abnormality in the eye tracking system of the head-mounted display. This indicates that the system cannot achieve the expected accuracy standard under specific lighting conditions and may require further adjustment and optimization. At this time, it is necessary to deeply analyze the specific factors that lead to the decline in accuracy, such as sensor sensitivity, algorithm adaptability, etc., and make corresponding improvements.

[0069] If the eye tracking accuracy does not meet the preset accuracy requirement, after determining that the eye tracking system of the head-mounted display is abnormal, it also includes: generating abnormal alarm information and sending the abnormal alarm information to the terminal device of the operator so that the operator can debug and repair the head-mounted display.

[0070] In one example, when the system detects that the eye tracking accuracy does not meet the preset accuracy requirements, it determines that the eye tracking system is abnormal. At this time, the system automatically generates abnormal alarm information. The abnormal alarm information includes detailed information such as abnormal type, specific abnormal data, possible cause analysis, etc., to help operators quickly locate the problem.

[0071] Next, the system sends the generated abnormal alarm information to the operator's terminal device. The sending method can be real-time push to the operator's mobile phone, tablet or computer and other terminal devices through the network to ensure that the operator can receive the alarm information in time. After receiving the alarm information, the operator can perform targeted debugging and maintenance according to the detailed description in the alarm information.

[0072] Based on the above method, the present application also discloses a head mounted display eye movement accuracy testing device, such as Figure 3 As shown, Figure 3 It is a structural schematic diagram of a head-mounted display eye movement accuracy testing device provided in an embodiment of the present application.

[0073] A head-mounted display eye movement accuracy test device comprises: an acquisition module, a comparison module, a judgment module and a determination module; wherein the acquisition module is used to acquire first eye movement data of an artificial eye acquired by an encoder acquisition module and acquire second eye movement data of the artificial eye sent by an eye movement program in the head-mounted display when the artificial eye moves according to preset parameters; the comparison module is used to compare the first eye movement data with the second eye movement data to obtain a comparison result; the judgment module is used to judge whether the eye movement tracking accuracy of the head-mounted display meets the preset accuracy requirement according to the comparison result; the determination module is used to determine that the eye movement tracking system of the head-mounted display is normal if the eye movement tracking accuracy meets the preset accuracy requirement; if the eye movement tracking accuracy does not meet the preset accuracy requirement, determine that the eye movement tracking system of the head-mounted display is abnormal.

[0074] It should be noted that: when the device provided in the above embodiment realizes its function, only the division of the above functional modules is used as an example. In actual application, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0075] See also Figure 4 , is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 4 As shown, the electronic device 1000 may include: at least one processor 1001 , at least one network interface 1004 , a user interface 1003 , a memory 1005 , and at least one communication bus 1002 .

[0076] The communication bus 1002 is used to realize the connection and communication between these components.

[0077] The user interface 1003 may include a display screen (Display) and a camera (Camera). Optionally, the user interface 1003 may also include a standard wired interface and a wireless interface.

[0078] The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a WI-FI interface).

[0079] Among them, the processor 1001 may include one or more processing cores. The processor 1001 uses various interfaces and lines to connect various parts in the entire server, and executes various functions of the server and processes data by running or executing instructions, programs, code sets or instruction sets stored in the memory 1005, and calling data stored in the memory 1005. Optionally, the processor 1001 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 1001 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 1001, and it can be implemented separately through a chip.

[0080] Among them, the memory 1005 may include a random access memory (Random Access Memory, RAM) and may also include a read-only memory (Read-Only Memory). Optionally, the memory 1005 includes a non-transitory computer-readable storage medium. The memory 1005 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 1005 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store data involved in the above-mentioned various method embodiments, etc. The memory 1005 may also be optionally at least one storage device located away from the aforementioned processor 1001. As Figure 4As shown, the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and an application program for a head-mounted display eye movement accuracy testing method.

[0081] exist Figure 4 In the electronic device 1000 shown, the user interface 1003 is mainly used to provide an input interface for the user and obtain the data input by the user; and the processor 1001 can be used to call the memory 1005 to store An application of a head-mounted display eye movement accuracy testing method, when executed by one or more processors, enables an electronic device to execute one or more of the methods described in the above embodiments.

[0082] An electronic device readable storage medium stores instructions, which, when executed by one or more processors, enable the electronic device to execute one or more of the methods described in the above embodiments.

[0083] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all described as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the order of the actions described, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required for the present application.

[0084] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0085] In the several embodiments provided in the present application, it should be understood that the disclosed devices can be implemented in other ways. For example, the device embodiments described above are only schematic, such as the division of the units, which is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some service interfaces, and the indirect coupling or communication connection of devices or units can be electrical or other forms.

[0086] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0087] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0088] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a memory and includes several instructions for a computer device (which can be a personal computer, server or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned memory includes: various media that can store program codes, such as USB flash drives, mobile hard drives, magnetic disks or optical disks.

[0089] The above is only an exemplary embodiment of the present disclosure, and the scope of the present disclosure cannot be limited thereto. That is, any equivalent changes and modifications made according to the teachings of the present disclosure are still within the scope of the present disclosure. After considering the specification and practicing the disclosure here, those skilled in the art will easily think of other embodiments of the present disclosure. This application is intended to cover any modification, use or adaptation of the present disclosure, which follows the general principles of the present disclosure and includes common knowledge or customary technical means in the technical field not recorded in the present disclosure. The description and examples are only regarded as exemplary, and the scope and spirit of the present disclosure are defined by the claims.

Claims

1. A head mounted display eye movement accuracy test method, characterized in that: The method comprises: When the artificial eye moves according to preset parameters, first eye movement data of the artificial eye acquired by the encoder acquisition module is acquired, and second eye movement data of the artificial eye sent by the eye movement program in the head mounted display is acquired; Comparing the first eye movement data with the second eye movement data to obtain a comparison result; According to the comparison result, determining whether the eye tracking accuracy of the head mounted display meets a preset accuracy requirement; If the eye tracking accuracy meets the preset accuracy requirement, it is determined that the eye tracking system of the head-mounted display is normal; if the eye tracking accuracy does not meet the preset accuracy requirement, it is determined that the eye tracking system of the head-mounted display is abnormal.

2. The head mounted display eye movement accuracy testing method according to claim 1, characterized in that: The step of acquiring the first eye movement data of the artificial eye acquired by the encoder acquisition module, and acquiring the second eye movement data of the artificial eye sent by the eye movement program in the head mounted display, comprises: Start the encoder acquisition module and the eye movement program in the head-mounted display; Collecting first eye movement data of the artificial eye at a preset collection frequency by the encoder collection module, wherein the first eye movement data includes a plurality of first data; The second eye movement data of the artificial eye is acquired through an eye movement program in the head mounted display, where the second eye movement data includes a plurality of second data.

3. The head mounted display eye movement accuracy testing method according to claim 2, characterized in that: The comparing the first eye movement data and the second eye movement data to obtain a comparison result includes: One-to-one correspondence between a plurality of first data in the first eye movement data and a plurality of second data in the second eye movement data; The difference between each pair of corresponding first data and second data is calculated, and the difference between each pair of corresponding first data and second data is used as a comparison result.

4. The head mounted display eye movement accuracy testing method according to claim 3, characterized in that: The step of judging, according to the comparison result, whether the eye tracking accuracy of the head mounted display meets a preset accuracy requirement includes: Calculating an average value of the difference between each pair of corresponding first data and second data, and using the average value of the difference as a deviation value of the eye tracking accuracy of the head mounted display; Determining whether the deviation value is within a preset deviation interval; If the deviation value is within the preset deviation range, it is determined that the eye tracking accuracy meets the preset accuracy requirement; If the deviation value is not within the preset deviation interval, it is determined that the eye tracking accuracy does not meet the preset accuracy requirement.

5. The head mounted display eye movement accuracy testing method according to claim 1, characterized in that: When the artificial eye moves according to the preset parameters, before obtaining the first eye movement data of the artificial eye obtained by the encoder acquisition module and obtaining the second eye movement data of the artificial eye sent by the eye movement program in the head mounted display, it also includes: Fixing the head mounted display to be tested on a head model of a test workbench, wherein the artificial eye is provided at the eye position of the head model; Install and run the eye tracking program in the head mounted display; Setting parameters for controlling the movement of the artificial eye in the analysis system, wherein the parameters include the direction and speed of rotation of the artificial eye; A control instruction is sent to a driving device for controlling the movement of the artificial eye, so that the artificial eye moves according to the parameters.

6. The head mounted display eye movement accuracy testing method according to claim 1, characterized in that: The method further comprises: Acquire the first eye movement data and the second eye movement data under different lighting conditions; Comparing the first eye movement data and the second eye movement data under different lighting conditions to obtain a plurality of comparison results under different lighting conditions; According to the multiple comparison results, determining whether the eye tracking accuracy of the head mounted display under different lighting conditions meets the preset accuracy requirement; If the eye tracking accuracy meets the preset accuracy requirement under all different lighting conditions, it is determined that the eye tracking system of the head mounted display is normal under different lighting conditions; If the eye tracking accuracy does not meet the preset accuracy requirement under any lighting condition, it is determined that there is an abnormality in the eye tracking system of the head-mounted display.

7. The head mounted display eye movement accuracy testing method according to claim 1, characterized in that: If the eye tracking accuracy does not meet the preset accuracy requirement, after determining that the eye tracking system of the head mounted display is abnormal, the method further includes: Generate abnormal alarm information, and send the abnormal alarm information to the terminal device of the operator, so that the operator can debug and repair the head mounted display.

8. A head mounted display eye movement accuracy test device, characterized in that: The device comprises: an acquisition module, a comparison module, a judgment module and a determination module; wherein, The acquisition module is used to acquire the first eye movement data of the artificial eye acquired by the encoder acquisition module and acquire the second eye movement data of the artificial eye sent by the eye movement program in the head mounted display when the artificial eye moves according to the preset parameters; The comparison module is used to compare the first eye movement data with the second eye movement data to obtain a comparison result; The judgment module is used to judge whether the eye tracking accuracy of the head mounted display meets the preset accuracy requirement according to the comparison result; The determination module is used to determine that the eye tracking system of the head-mounted display is normal if the eye tracking accuracy meets the preset accuracy requirement; if the eye tracking accuracy does not meet the preset accuracy requirement, determine that the eye tracking system of the head-mounted display is abnormal.

9. An electronic device, characterized in that: It includes a processor, a memory, a user interface and a network interface, the memory is used to store instructions, the user interface and the network interface are used to communicate with other devices, and the processor is used to execute the instructions stored in the memory so that the electronic device executes the method as described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that: A computer program is stored which can be loaded by a processor and execute the method according to any one of claims 1 to 7.

Images