Switchable test device, test method, electronic device, storage medium, and program product

By using switchable testing equipment and the coordinated operation of simulated eyeballs and driving components, the switching of testing devices within different field of view is realized, solving the problems of low testing efficiency and inability to simulate eyeball rotation in existing technologies, and improving testing accuracy and efficiency.

WO2025252260A1PCT designated stage Publication Date: 2025-12-11YONGJIANG LAB
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2025/107412
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-11-04
Filing Date
2025-07-07
Publication Date
2025-12-11

AI Technical Summary

Technical Problem

Existing near-eye display testing equipment is inefficient when switching between large and small field-of-view cameras, cannot simulate eye movement, and cannot simultaneously test the binocular characteristics of head-mounted displays and combine eye tracking to test dynamic gaze point rendering effects.

Method used

A switchable testing device is provided, including a simulated eyeball, a motion controller, and first and second drive components. Through the coordinated operation of these components, the testing device can switch and rotate synchronously within different field of view ranges, integrating multiple testing functions to simulate eyeball rotation to test the binocular characteristics of the head-mounted display.

Benefits of technology

It improves testing efficiency and accuracy, enabling simultaneous testing of the binocular characteristics of the head-mounted display while simulating eye movement, and accurately simulating the observation phenomena during eye movements.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2025107412_11122025_PF_FP_ABST
    Figure CN2025107412_11122025_PF_FP_ABST
Patent Text Reader

Abstract

Provided in the present application are a switchable test device, a test method, an electronic device, a storage medium, and a program product, belonging to the technical field of visual devices. The switchable test device comprises a simulated eyeball, a motion controller, a first drive assembly, a second drive assembly, and at least one test component mounted on the simulated eyeball. The motion controller is connected to the first drive assembly and the second drive assembly, and the first drive assembly and the second drive assembly are connected to the simulated eyeball; the motion controller is used for controlling the first drive assembly and the second drive assembly on the basis of test requirements so as to drive the simulated eyeball and the test component to rotate synchronously until a target test component is switched to a test position, the target test component being one of the at least one test component. In the technical solution of the present application, the test component can be rotated to the test position while the simulated eyeball rotates, achieving the integration of test functions on one apparatus.
Need to check novelty before this filing date? Find Prior Art

Description

Switchable test device, method, electronic device, storage medium and program product

[0001] The present application claims priority to the Chinese patent application No. 202410726913.5, filed on June 5, 2024, entitled “Switchable test device”, the content of which is incorporated herein by reference in its entirety.

[0002] The present application claims priority to the Chinese patent application No. 202411562882.0, filed on November 4, 2024, entitled “Switchable test device, method, electronic device, storage medium and program product”, the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0003] The present application belongs to the technical field of visual equipment, and in particular relates to a switchable test device, method, electronic device, storage medium and program product. BACKGROUND

[0004] In the near-eye display test process, when testing different items, the head-mounted display needs to be switched between the large field of view camera and the small field of view camera, and needs to be aligned twice, which is low in efficiency.

[0005] For example, a large FOV (field of view) camera is needed for full-field brightness color uniformity, distortion and other tests, which is fast in test speed and high in efficiency. However, for MTF (modulation transfer function) testing, a large FOV camera cannot meet the demand, and a high PPD, small FOV camera (rotatable) is needed for testing to simulate the results observed by the central fovea of the human eye.

[0006] Moreover, the existing test process can only test the monocular characteristics of the head-mounted display, cannot simultaneously test the binocular characteristics of the head-mounted display under the condition of simulating eye rotation, and cannot test the effect of dynamic fixation point rendering in combination with eye movement tracking. SUMMARY

[0007] The present application aims to at least solve one of the technical problems existing in the prior art. To this end, the present application proposes a switchable test device, which can rotate the test device to a test position under the condition of simulating eye rotation, and realize the integration of test functions on one device.

[0008] Another object of the present application is to simultaneously test the binocular characteristics of the head-mounted display under the condition of simulating eye rotation, accurately simulate the phenomena observed when the eyes move, and improve the test efficiency and accuracy.

[0009] In a first aspect, the present application provides a switchable test device, comprising: a test device for testing a device under test, the switchable test device comprising an artificial eyeball, a motion controller, a first driving assembly, a second driving assembly, and at least one test device mounted on the artificial eyeball.

[0010] The motion controller is connected with the first driving assembly and the second driving assembly, and the first driving assembly and the second driving assembly are connected with the artificial eyeball.

[0011] The motion controller is configured to control the first driving assembly and the second driving assembly to drive the artificial eyeball and the test device to rotate synchronously until a target test device switches to a test position according to a test requirement.

[0012] The target test device is one of the at least one test device.

[0013] In an optional embodiment, the at least one test device comprises at least one of a first camera, a second camera, a high-frequency luminance meter, and a near-infrared radiation illuminometer.

[0014] In an optional embodiment, a field of view angle range of the first camera is different from a field of view angle range of the second camera.

[0015] In an optional embodiment, the field of view angle range of the first camera is 0°-30°, and the field of view angle range of the second camera is 0°-120°.

[0016] In an optional embodiment, the target test device is the first camera, and the switchable test device is configured to test at least one of a definition, an angular resolution, an eyebox, a pupil distance, a vergence conflict, and a binocular image combining precision of the device under test.

[0017] And / or, the target test device is the second camera, and the switchable test device is configured to test at least one of a distortion, a chromatic aberration, a luminance / color uniformity, a ghost image, a contrast, and a large field of view binocular image combining precision of a full field of view of the device under test.

[0018] And / or, the target test device is the high-frequency luminance meter, and the switchable test device is configured to test a binocular Photo-to-photo delay of the device under test.

[0019] And / or, the target test device is the near-infrared radiation illuminometer, and the switchable test device is configured to test an illuminance of a near-infrared light source on a cornea of the device under test.

[0020] In an optional embodiment, the switchable test apparatus comprises two simulated eyeballs, two first driving assemblies and two second driving assemblies, each simulated eyeball is connected with a corresponding first movement driving assembly and a corresponding second driving assembly, and each simulated eyeball is installed with at least one test device.

[0021] The movement controller is configured to control the first movement driving assembly and the second driving assembly to drive the corresponding simulated eyeball and the corresponding test device to rotate synchronously until the corresponding target test device switches to the test position.

[0022] In an optional embodiment, the target test devices on the two simulated eyeballs are both first cameras.

[0023] The switchable test apparatus is configured to test at least one of the clarity, the interpupillary distance, the eyebox, the binocular image, the vergence conflict of the to-be-tested device.

[0024] In an optional embodiment, the target test devices on the two simulated eyeballs are a first camera and a second camera respectively.

[0025] The switchable test apparatus is configured to test the dynamic distortion of the to-be-tested device; or, the first camera is configured to test at least one of the clarity, the angular resolution, the eyebox of the to-be-tested device, and the second camera is configured to test at least one of the color difference of the full field of view, the uniformity of the brightness / color, the contrast, the ghost image of the to-be-tested device.

[0026] In an optional embodiment, the target test devices on the two simulated eyeballs are a high-frequency luminance meter and a second camera respectively.

[0027] The switchable test apparatus is configured to test the ghost image of the to-be-tested device.

[0028] In an optional embodiment, the target test devices on the two simulated eyeballs are both high-frequency luminance meters.

[0029] The switchable test apparatus is configured to test the binocular Photo-to-photo delay or the binocular refresh rate consistency of the to-be-tested device.

[0030] In an optional embodiment, the target test devices on the two simulated eyeballs are both near-infrared radiation illuminometers.

[0031] The switchable test apparatus is configured to test the damage of the infrared light source of the to-be-tested device to the human eye.

[0032] In an optional embodiment, the first driving assembly comprises a first driving device and a first rotating component; the first driving device is connected with the motion controller; the first driving device and the first rotating component are drivingly connected; the first rotating component is connected with the simulated eyeball; wherein the first rotating component is used to drive the simulated eyeball to move around the axis of the first rotating component, so as to adjust the pitch angle of the simulated eyeball.

[0033] The second driving assembly comprises a second driving device and a second rotating component; the second driving device is connected with the motion controller; the second driving device and the second rotating component are drivingly connected; the second rotating component is connected with the simulated eyeball and the first rotating component; wherein the second rotating component is used to drive the simulated eyeball and the first rotating component to move around the axis of the second rotating component, so as to adjust the horizontal azimuth angle of the simulated eyeball.

[0034] In a possible implementation, the rotation axis of the first rotating component is not parallel to the rotation axis of the second rotating component, and the two rotation axes are in two non-parallel planes, so as to ensure that the first rotating component and the second rotating component rotate according to the test requirements, drive the simulated eyeball to rotate, and make the test device on the simulated eyeball switch to the test position.

[0035] In an optional embodiment, the line connecting the pupil of the simulated eyeball and the eyeball center forms a first included angle with the rotation axis of the first rotating component.

[0036] In an optional embodiment, the maximum rotation angle of the second rotating component is determined based on the pupil distance of the two simulated eyeballs.

[0037] In an optional embodiment, the maximum rotation angle of the first rotating component is 360 degrees, and the maximum rotation angle of the second rotating component is less than 360 degrees.

[0038] In an optional embodiment, the switchable test device further comprises a third driving assembly and two eyeball pedestals corresponding to the two simulated eyeballs.

[0039] The first rotating component is connected with the corresponding simulated eyeball through the corresponding eyeball pedestal; the second rotating component is connected with the corresponding first rotating component and the corresponding simulated eyeball through the corresponding eyeball pedestal and drives the two to rotate synchronously.

[0040] The third driving assembly is connected with the two eyeball pedestals respectively.

[0041] The third driving assembly is used to drive the two eyeball pedestals to move towards each other or in opposite directions under the control of the motion controller, so as to adjust the distance between the two simulated eyeballs.

[0042] In an optional implementation, the switchable test device further comprises a fourth driving assembly connected with the two eyeball bases, and the fourth driving assembly is further connected with the motion controller.

[0043] The fourth driving assembly is configured to drive the eyeball bases to move along the axial direction of the second rotating component to adjust the height of the simulated eyeball under the control of the motion controller.

[0044] In an optional implementation, the motion controller is further configured to control the first driving assembly and the second driving assembly to drive the simulated eyeball to rotate to switch the target test device on the simulated eyeball according to different test requirements.

[0045] In a second aspect, the present application further provides a test method for testing a device under test, the test method comprising:

[0046] determining a target test device in response to a test requirement;

[0047] controlling the first driving assembly and the second driving assembly to move to drive the simulated eyeball and the test device to rotate synchronously until the target test device is switched to a test position;

[0048] controlling the target test device to test the device under test at the test position;

[0049] wherein the simulated eyeball is provided with at least one test device, and the target test device is one of the at least one test device.

[0050] In a possible implementation, after the target test device is controlled to test the device under test at the test position, the method further comprises:

[0051] obtaining test information of the target test device, and determining a test result of the test requirement for the device under test according to the test information.

[0052] In an optional implementation, the test requirement comprises at least one of test clarity, angular resolution, user eye movable range, interpupillary distance, vergence conflict, binocular image accuracy, distortion of full field of view, chromatic aberration, brightness / color uniformity, ghost image, contrast, binocular photo-to-photo delay, binocular refresh rate consistency, near-infrared light source illumination on the cornea, and infrared light source damage to the human eye.

[0053] The test device comprises at least one of a first camera, a second camera, a high-frequency brightness meter, and a near-infrared radiation illuminometer; and the field of view angle range of the first camera is different from the field of view angle range of the second camera.

[0054] In an optional implementation, the number of the simulated eyeballs is one, and the determination of the target test device according to the test requirement comprises:

[0055] the test requirement is to test at least one of the clarity, the angular resolution, the user eye movable range, the interpupillary distance, the vergence conflict, and the binocular photo-to-photo accuracy of the device under test, and the target testing device is determined to be the first camera;

[0056] the test requirement is to test at least one of the distortion, the chromatic aberration, the luminance / color uniformity, the ghost image, the contrast, and the binocular photo-to-photo accuracy of the device under test, and the target testing device is determined to be the second camera;

[0057] the test requirement is to test the binocular photo-to-photo delay of the device under test, and the target testing device is determined to be the high-frequency luminance meter;

[0058] the test requirement is to test the illuminance of the near-infrared light source on the cornea of the device under test, and the target testing device is determined to be the near-infrared radiation illuminometer.

[0059] In an optional embodiment, the number of simulated eyeballs is two, and a testing device is installed on each simulated eyeball, and according to the test requirement, the target testing device is determined as follows:

[0060] the test requirement is to test at least one of the clarity, the interpupillary distance, the user eye movable range, the binocular photo-to-photo accuracy, and the vergence conflict of the device under test, and the target testing device on each simulated eyeball is determined to be the first camera;

[0061] the test requirement is to test the dynamic distortion of the device under test, or, at the same time, the test requirement is to test at least one of the clarity, the angular resolution, the user eye movable range of the device under test, and at least one of the chromatic aberration, the luminance / color uniformity, the contrast, and the ghost image of the full field of view of the device under test, and the target testing devices on the two simulated eyeballs are determined to be the first camera and the second camera respectively;

[0062] the test requirement is to test the ghost image of the device under test, and the target testing devices on the two simulated eyeballs are determined to be the high-frequency luminance meter and the second camera respectively;

[0063] the test requirement is to test the binocular photo-to-photo delay or the binocular refresh rate consistency of the device under test, and the target testing devices on the two simulated eyeballs are determined to be the high-frequency luminance meter;

[0064] the test requirement is to test the damage of the infrared light source to the human eye of the device under test, and the target testing devices on the two simulated eyeballs are determined to be the near-infrared radiation illuminometer.

[0065] In an optional embodiment, the test requirement is to test the interpupillary distance of the device under test, and the target testing devices on the two simulated eyeballs are determined to be the first camera; wherein the field of view angle of the first camera ranges from 0 to 30 degrees;

[0066] controlling the target testing device to test the device under test at the testing position includes:

[0067] adjusting positions of the two simulated eyeballs respectively to make optical axes of the first cameras on the two simulated eyeballs parallel;

[0068] determining that the first cameras on the two simulated eyeballs have the same distance to the corresponding visual devices in the device under test;

[0069] adjusting positions of the two simulated eyeballs translationally to make the first cameras on the two simulated eyeballs aligned with MTF centers of the corresponding visual devices;

[0070] obtaining a pupil distance between the two simulated eyeballs, and taking the pupil distance as a pupillary distance of the device under test.

[0071] In an optional embodiment, the testing requirement is to test a movable range of a user's eye of the device under test, and the target testing devices on the two simulated eyeballs are both the first cameras; wherein a field of view angle range of the first camera is 0-30°.

[0072] the controlling the target testing device to test the device under test at the testing position includes:

[0073] controlling the two simulated eyeballs to rotate to a plurality of field of view angles of the device under test; wherein each field of view angle has a corresponding azimuth angle;

[0074] in each group of field of view angle and azimuth angle, performing focusing operations on the two first cameras to ensure that images in the two first cameras are clear;

[0075] in each group of field of view angle and azimuth angle, controlling the two simulated eyeballs to move translationally along a direction of the corresponding azimuth angle, and in the process of translation, testing MTFs of the corresponding visual devices in the device under test by using the first cameras;

[0076] when the MTFs of the visual devices meet a preset threshold, controlling the two simulated eyeballs to stop translation, recording translation amounts of the two simulated eyeballs respectively, and controlling the two simulated eyeballs to move in a direction of approaching or moving away from the device under test to test a three-dimensional region of the movable range of the user's eye of the device under test, and obtain the movable range of the user's eye of the device under test corresponding to each field of view angle.

[0077] In an optional embodiment, the testing requirement is to test a clarity of the device under test, and the target testing devices on the two simulated eyeballs are both the first cameras; wherein a field of view angle range of the first camera is 0-30°.

[0078] controlling the target testing device to test the device under test at the testing position includes:

[0079] Two simulated eyeballs are controlled to rotate to multiple field-of-view angles of the device under test; each field-of-view angle has a corresponding azimuth angle.

[0080] In each set of the field of view and the azimuth angle, the two first cameras are focused to ensure that the images in the two first cameras are clear;

[0081] In each set of field of view and azimuth angles, the MTF of the corresponding visual device in the device under test is tested using the first camera;

[0082] The sharpness of the device under test is determined based on the MTF of the visual device.

[0083] In one optional implementation, the test requirement is to test the binocular image of the device under test, and the target test device on the two simulated eyeballs is a first camera; wherein, the field of view of the first camera is 0 to 30°.

[0084] Controlling the target test device to test the device under test at the test position includes:

[0085] Two simulated eyeballs are controlled to rotate to multiple field-of-view angles of the device under test; each field-of-view angle has a corresponding azimuth angle.

[0086] In each set of field of view and azimuth angles, record the first angle β_left and the second angle β_right of the two simulated eyeballs rotating in the vertical direction;

[0087] Based on the first angle β_left and the second angle β_right, calculate the corresponding field of view and the binocular image combining accuracy β_left-β_right under the corresponding azimuth angle.

[0088] In one alternative implementation, the test requirement is to test the convergence conflict of the device under test, and the two target test devices on the simulated eyeballs are both first cameras; wherein, the field of view of the first camera is 0 to 30°.

[0089] Controlling the target test device to test the device under test at the test position includes:

[0090] Two simulated eyeballs are controlled to rotate to multiple field angles of view of the device under test; wherein each field angle has a corresponding azimuth angle.

[0091] In each set of field of view and azimuth angles, the third angle α_left and the fourth angle α_right of the two simulated eyeballs rotating in the horizontal direction are recorded, the interpupillary distance i, and the first virtual image distance VID_left and the second virtual image distance VID_right obtained by the two first cameras are recorded.

[0092] According to the third angle a_left, the fourth angle a_right and the pupil i, the conjugate distance D of the two first cameras is calculated;

[0093] According to the conjugate distance D, and the average of the first virtual image distance VID_left and the second virtual image distance VID_right, the vergence conflict corresponding to each field of view angle is calculated.

[0094] In an alternative embodiment, the test requirement is to test the dynamic distortion of the device under test, and the target test devices on the two simulated eyeballs are the first camera and the second camera respectively; wherein the field of view angle of the first camera ranges from 0 to 30°, and the field of view angle of the second camera ranges from 0 to 120°.

[0095] Controlling the target test devices to test the device under test at the test position includes:

[0096] Controlling the first camera and the second camera to align with the left and right target optical axes of the device under test respectively;

[0097] In a static state, using the second camera to obtain the first static distortion of each position in the global picture;

[0098] According to the image obtained by the second camera, the position information of the target point in the obtained image relative to the first camera is calculated;

[0099] According to the position information, the rotation angle of the first camera is determined;

[0100] According to the rotation angle, the simulated eyeball on which the first camera is located is controlled to rotate, and the rotation axis of the simulated eyeball is adjusted, so that the first camera aligns with different target points, and the second dynamic distortion corresponding to each target point is obtained by using the first camera;

[0101] According to the first static distortion and the second dynamic distortion corresponding to each target point, the dynamic distortion of the device under test is determined.

[0102] In an alternative embodiment, the test requirement is to test the color and brightness of the ghost image of the device under test, and the target test devices on the two simulated eyeballs are the second camera and the high-frequency brightness meter respectively; wherein the field of view angle of the second camera ranges from 0 to 120°.

[0103] Controlling the target test devices to test the device under test at the test position includes:

[0104] Controlling the second camera to obtain a global picture and identify the position of the ghost image, and taking the position of the ghost image as a target point;

[0105] According to the position information of the target point, the analog eyeball where the high-frequency luminance meter is located is controlled to rotate so that the high-frequency luminance meter is aimed at the target point.

[0106] The color and brightness of the ghost image are tested by using the high-frequency luminance meter, and the test results are taken as the color and brightness of the ghost image of the to-be-tested device.

[0107] In an optional embodiment, the test requirement is to test the damage of the infrared light source of the to-be-tested device to the human eye, and the target testing devices on the two analog eyeballs are both near-infrared radiation illuminometers.

[0108] The control of the target testing device to test the to-be-tested device at the test position comprises:

[0109] The two analog eyeballs are controlled to rotate so as to traverse all the corresponding field angles of the to-be-tested device by using each analog eyeball.

[0110] The illuminance of the infrared light source of the to-be-tested device is tested in real time by using the near-infrared radiation illuminometer installed on each analog eyeball respectively.

[0111] According to the illuminance of the infrared light source of the to-be-tested device and a preset illuminance threshold, the damage of the infrared light source of the to-be-tested device to the human eye is determined.

[0112] In an optional embodiment, the test method further comprises:

[0113] In response to different test requirements, the first driving assembly and the second driving assembly are controlled to drive the analog eyeball to rotate so as to switch the target testing device located at the test position.

[0114] In a third aspect, the present application further provides an electronic device, comprising a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the program is executed by the processor to implement the test method of the second aspect.

[0115] In a fourth aspect, the present application further provides a non-transitory computer readable storage medium, wherein the non-transitory computer readable storage medium stores a computer program, and the computer program is executed by a processor to implement the test method of the second aspect.

[0116] In a fifth aspect, the present application further provides a computer program product comprising a computer program, wherein the computer program is executed by a processor to implement the test method of the first aspect.

[0117] Additional aspects and advantages of the present application will be in part apparent and in part pointed out hereinafter. BRIEF DESCRIPTION OF DRAWINGS

[0118] The above and / or additional aspects and advantages of the present application will become apparent and more readily appreciated from the following description, taken in conjunction with the following drawings in which:

[0119] FIG. 1 is a structural schematic diagram of an eye tracking device according to an embodiment of the present application;

[0120] FIG. 2 is a top view of an eye tracking device according to an embodiment of the present application;

[0121] FIG. 3 is a partial schematic diagram of an eye tracking device according to an embodiment of the present application;

[0122] FIG. 4 is a structural schematic diagram of an eye tracking device according to an embodiment of the present application;

[0123] FIG. 5 is a schematic diagram of a simulated eye fixation target point of an eye tracking device according to an embodiment of the present application;

[0124] FIG. 6 is a schematic diagram of a simulated eye fixation target point of an eye tracking device according to an embodiment of the present application;

[0125] FIG. 7 is a flowchart of an eye tracking control method according to an embodiment of the present application;

[0126] FIG. 8 is a schematic diagram of a simulated eye rotation generating a deviation according to an embodiment of the present application;

[0127] FIG. 9 is a schematic diagram of a simulated eye rotation generating a deviation according to an embodiment of the present application;

[0128] FIG. 10 is a flowchart of an eye tracking control device controlling a simulated eye movement according to an embodiment of the present application;

[0129] FIG. 11 is a flowchart of an eye tracking control method according to an embodiment of the present application;

[0130] FIG. 12 is a structural schematic diagram of an eye tracking control device according to an embodiment of the present application;

[0131] FIG. 13 is a structural schematic diagram of an electronic device according to an embodiment of the present application;

[0132] FIG. 14 is a structural schematic diagram of a test device according to an embodiment of the present application;

[0133] FIG. 15 is a structural schematic diagram of a simulated eye on which a first camera and a second camera are mounted according to an embodiment of the present application;

[0134] FIG. 16 is a structural schematic diagram of a first camera and a second camera mounted on a simulated eye and switched by a first rotation axis according to an embodiment of the present application;

[0135] FIG. 17 is a structural diagram of a first camera and a second camera mounted on a simulated eyeball of a head-mounted display according to an embodiment of the present application;

[0136] FIG. 18 is a diagram of a simulated eyeball with different functional test devices arbitrarily collocated with a deformable simulated eyeball according to an embodiment of the present application;

[0137] FIG. 19a is a diagram of a simulated eyeball testing an eye box without Z direction change according to an embodiment of the present application;

[0138] FIG. 19b is a diagram of a simulated eyeball testing an eye box after Z direction translation according to an embodiment of the present application;

[0139] FIG. 20 is a diagram of a test pattern for binocular display of a head-mounted display according to an embodiment of the present application;

[0140] FIG. 21 is a diagram of a vergence conflict test according to an embodiment of the present application;

[0141] FIG. 22 is a diagram of a binocular image combination test according to an embodiment of the present application;

[0142] FIG. 23 is a diagram of a dynamic distortion test using a first camera and a second camera in combination according to an embodiment of the present application;

[0143] FIG. 24 is a diagram of a binocular Photo-to-photo delay and binocular refresh rate consistency test according to an embodiment of the present application;

[0144] FIG. 25 is a flowchart of a pupillary distance test according to an embodiment of the present application;

[0145] FIG. 26 is a flowchart of a test of eye boxes of left and right eyes of a head-mounted display according to an embodiment of the present application;

[0146] FIG. 27 is a flowchart of a test of binocular image combination and vergence conflict of a head-mounted display according to an embodiment of the present application;

[0147] FIG. 28 is a flowchart of a binocular image combination test according to an embodiment of the present application;

[0148] FIG. 29 is a flowchart of a vergence conflict test according to an embodiment of the present application;

[0149] FIG. 30 is a flowchart of a distortion test according to an embodiment of the present application;

[0150] FIG. 31 is a flowchart of a ghost image test according to an embodiment of the present application.

[0151] Reference signs: 110-simulated eyeball; 110-eyeball structure; 120-pseudophakia patch; 210-bracket; 211-first fixing plate; 212-second fixing plate; 230-first rotating part; 240-second rotating part; 260-eyeball base; 270-linear slide; 300-display screen. DETAILED DESCRIPTION

[0152] The technical solutions in the embodiments of the present application will be clearly described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art belong to the scope of protection of the present application.

[0153] The terms "first", "second", and the like in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be exchanged under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally a category and do not limit the number of objects, for example, the first object can be one or more. In addition, "and / or" in the specification and claims indicates at least one of the connected objects, and the character " / ", generally indicates that the front and rear associated objects are in a "or" relationship.

[0154] The switchable test device, test method, electronic device and readable storage medium provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings and specific embodiments and application scenarios.

[0155] In some embodiments of the present application, the switchable test device can have one simulated eyeball, or two simulated eyeballs.

[0156] In some embodiments, the test device on the simulated eyeball can be one or two or more.

[0157] In some embodiments, when there are two simulated eyeballs, the test devices on the left and right simulated eyeballs can be the same, different, or the test devices on the two simulated eyeballs can be partially the same.

[0158] For the convenience of description, some embodiments hereinafter are described based on the switchable test device with two simulated eyeballs, and equipped with at least two different test devices on the simulated eyeballs, but this does not mean that the following various embodiments are not applicable to the test device with only one simulated eyeball, or not applicable to the test device with only one test device on the simulated eyeball. In other words, only one eye or only one test device can also realize the corresponding operation, which can be arranged and combined according to actual needs.

[0159] In some examples, the switchable test device includes a simulated eyeball, a motion controller, a first driving assembly, a second driving assembly, and at least one test device mounted on the simulated eyeball.

[0160] The motion controller is connected with the first motion driving assembly and the second driving assembly, and the first motion driving assembly and the second driving assembly are connected with the simulated eyeball.

[0161] The motion controller is configured to control the first motion driving assembly and the second driving assembly to drive the simulated eyeball and the test device to rotate synchronously until the target test device is switched to the test position according to the test requirement.

[0162] The target test device is one of the at least one test device.

[0163] In some examples, the first driving assembly includes a first driving device and a first rotating part, the first driving device is connected with the motion controller, the first driving device and the first rotating part are drivingly connected, and the first rotating part is connected with the simulated eyeball, wherein the first rotating part is configured to drive the simulated eyeball to move around the axis of the first rotating part to adjust the pitch angle of the simulated eyeball.

[0164] The second driving assembly includes a second driving device and a second rotating part, the second driving device is connected with the motion controller, the second driving device and the second rotating part are drivingly connected, and the second rotating part is connected with the simulated eyeball and the first rotating part, wherein the second rotating part is configured to drive the simulated eyeball and the first rotating part to move around the axis of the second rotating part to adjust the horizontal azimuth angle of the simulated eyeball.

[0165] It is worth noting that the switchable test device of the present application can adopt the structure design of the following eye movement tracking device, and through the rotation cooperation between the two-axis structures, the position switching of the test device on the simulated eyeball and / or the switching and position transformation between different test devices can be realized. That is, the structure adopts the structure of the following eye movement tracking device, and at least one test device is mounted on the simulated eyeball, thereby forming a switchable test device.

[0166] The switchable eyeball test device further comprises a displacement platform, which drives or is integrated with the first rotating shaft, the second rotating shaft and the simulated eyeball, or drives or is integrated with the first rotating shaft, the second rotating shaft, the simulated eyeball and the like to advance or retreat on a horizontal plane, thereby realizing translation.

[0167] Of course, in some embodiments, the test device further comprises a third driving assembly for adjusting the distance between the simulated eyeballs, a fourth driving assembly for adjusting the height of the simulated eyeballs, and the pairing relationship between the X / Y / Z and the displacement platform, the third driving assembly and the fourth driving assembly is determined according to actual needs.

[0168] In some embodiments, when the switchable test device is constituted by the eye tracking device as shown in FIG. 1, the third driving assembly and the fourth driving assembly correspond to the third driving assembly and the fourth driving assembly of the eye tracking device.

[0169] In some embodiments, the displacement platform corresponds to the Z axis, the third driving assembly corresponds to the X axis, and the fourth driving assembly corresponds to the Y axis.

[0170] The cooperation of the displacement platform, the third driving assembly and the fourth driving assembly can realize the displacement of the test device in the XYZ direction, which is described as a whole formed by the integration of the first rotating shaft, the second rotating shaft and the simulated eyeball, or the integration of the three and the combination of other platforms and the like.

[0171] In a specific example, as shown in FIG. 1, the structure design of the test device of the embodiments of the present application is as follows: the eye tracking device comprises a simulated eyeball 100, a first rotating component 230 and a second rotating component 240.

[0172] As shown in FIG. 1, the first rotating component 230 is connected with the simulated eyeball 100, the line connecting the pupil of the simulated eyeball 100 and the eyeball center forms a first included angle with the axial direction of the first rotating component 230, and the first rotating component 230 is used to drive the simulated eyeball 100 to move around the axial direction of the first rotating component 230, so as to adjust the pitch angle of the simulated eyeball 100.

[0173] The pitch angle refers to the angle change of the gaze direction of the simulated eyeball 100 in the vertical direction, which corresponds to the eyeball movement of the human eye upward or downward. The second rotating component 240 is connected with the simulated eyeball 100 and the first rotating component 230, and the second rotating component 240 is used to drive the simulated eyeball 100 and the first rotating component 230 to move around the axial direction of the second rotating component 240, so as to adjust the horizontal azimuth angle of the simulated eyeball 100.

[0174] In this embodiment, the first rotating component 230 is used to adjust the pitch angle of the simulated eyeball 100, and the second rotating component 240 is used to adjust the horizontal azimuth angle of the simulated eyeball 100. The rotation axis of the first rotating component 230 and the rotation axis of the second rotating component 240 are in two non-parallel planes. Through the first rotating component 230 and the second rotating component 240, the simulated eyeball 100 can realize full-range rotation.

[0175] It should be noted that the visual line exit direction of the simulated eyeball 100 is the direction of the line connecting the pupil and the eyeball center of the simulated eyeball 100. The line connecting the pupil and the eyeball center forms a first included angle (the first included angle is not 0° or 180°) with the axial direction of the first rotating component 230. When the first rotating component 230 drives the simulated eyeball 100 to move around the axial direction of the first rotating component 230, the vertical position of the pupil on the simulated eyeball 100 changes, and the included angle between the visual line exit direction and the horizontal plane changes, thereby realizing pitch angle adjustment.

[0176] It can be understood that if the line connecting the pupil and the eyeball center is on the same line as the axial direction of the first rotating component 230, when the first rotating component 230 drives the simulated eyeball 100 to move around the axial direction of the first rotating component 230, the pupil of the simulated eyeball 100 is on the rotation axis, and the vertical position of the pupil does not change, so that the pitch angle adjustment cannot be realized.

[0177] In actual implementation, the setting angle of the axial direction of the first rotating component 230 can be adjusted according to the angle range of the pitch angle required to be adjusted by the simulated eyeball 100. The first rotating component 230 can be horizontally arranged, or can be arranged in an inclined direction at a certain included angle with the horizontal direction.

[0178] For example, the axial direction of the first rotating component 230 is horizontal, the line connecting the pupil and the eyeball center forms a first included angle with the axial direction of the first rotating component 230, and when the first rotating component 230 drives the simulated eyeball 100 to rotate, the motion track of the pupil on the simulated eyeball 100 is in the vertical plane, thereby realizing pitch angle adjustment of the visual line exit direction of the simulated eyeball 100.

[0179] For another example, the axial direction of the first rotating component 230 is an inclined direction at a certain included angle with the horizontal direction, and the axial direction of the first rotating component 230 is not a completely vertical direction. The line connecting the pupil and the eyeball center forms a first included angle with the axial direction of the first rotating component 230. When the first rotating component 230 drives the simulated eyeball 100 to rotate, the motion track of the pupil on the simulated eyeball 100 is in a non-horizontal plane, and the pitch angle adjustment can also be realized.

[0180] In this embodiment, the pitch angle adjustment of the simulated eyeball 100 can be realized through the first driving assembly, and the horizontal azimuth angle adjustment of the simulated eyeball 100 can be realized through the second driving assembly.

[0181] In actual implementation, the first driving assembly can include a first driving device and the first rotating part 230, the first driving device being configured to drive the first rotating part 230 to rotate the simulated eyeball 100 around the axial direction of the first rotating part 230, so as to adjust the pitch angle of the simulated eyeball 100.

[0182] The second driving assembly can include a second driving device and the second rotating part 240, the second driving device being configured to drive the second rotating part 240 to rotate the simulated eyeball 100 and the first rotating part 230 synchronously around the axial direction of the second rotating part 240.

[0183] In this embodiment, the first driving device is a power source for driving the first rotating part 230 to rotate, and the second driving device is a power source for driving the second rotating part 240 to rotate. The first driving device and the second driving device can be a stepper motor, a direct current motor or the like.

[0184] It can be understood that the rotation of the second rotating part 240 alone will not affect the pitch angle of the simulated eyeball 100. By adjusting the pitch angle and the horizontal azimuth angle of the simulated eyeball 100 through the first rotating part 230 and the second rotating part 240 respectively, the line of sight of the simulated eyeball 100 can be directed to any target point to be tracked.

[0185] The rotation axis of the first rotating part 230 is not parallel to the rotation axis of the second rotating part 240, and the two rotation axes are located on two non-parallel planes. In this way, when the eye movement tracking device tracks a target point, according to the position information of the simulated eyeball 100 and the target point and the first included angle, the first rotating part 230 drives the simulated eyeball 100 to rotate to adjust the pitch angle of the simulated eyeball 100, and the second rotating part 240 drives the simulated eyeball 100 and the first rotating part 230 to rotate synchronously to adjust the horizontal azimuth angle of the simulated eyeball 100.

[0186] In actual implementation, the axial direction of the first rotating part 230 and the axial direction of the second rotating part 240 can be perpendicular to each other, which is suitable for directing the simulated eyeball 100 to a target point located in front of the simulated eyeball 100. The axial direction of the first rotating part 230 can be inclined upward or downward relative to the horizontal direction, so that the simulated eyeball 100 can direct to a target point with a larger pitch angle.

[0187] In this embodiment, the eye movement tracking device is configured to adjust the pitch angle by rotating the simulated eyeball 100 by a first target angle through the first rotating part 230, and adjust the horizontal azimuth angle by rotating the simulated eyeball 100 by a second target angle through the second rotating part 240, according to the eyeball coordinate information of the simulated eyeball 100 and the position information of the target point to be tracked, so that the simulated eyeball directs to the target point.

[0188] The first target angle corresponds to an angle at which the first rotating component 230 needs to drive the simulated eyeball 100 to rotate, and the second target angle corresponds to an angle at which the second rotating component 240 needs to drive the simulated eyeball 100 and the first rotating component 230 to rotate simultaneously.

[0189] When the first rotating component 230 drives the simulated eyeball 100 to rotate by the first target angle, and the second rotating component 240 drives the simulated eyeball 100 and the first rotating component 230 to rotate by the second target angle, the pupil of the simulated eyeball 100 can be adjusted to be on the same straight line as the target point, that is, the line of sight is aligned with the target point.

[0190] It can be understood that the eyeball coordinate information of the two simulated eyeballs 100 is different, and the first target angle and the second target angle of the two simulated eyeballs 100 are also different.

[0191] In this embodiment, the first target angle and the second target angle can be calculated according to the difference between the current eyeball coordinate information of the simulated eyeball 100 and the eyeball coordinate information corresponding to the simulated eyeball 100 when the simulated eyeball 100 rotates to the target point of gaze.

[0192] According to the first target angle and the second target angle, control parameters for controlling the first rotating component 230 to rotate by the first target angle and the second rotating component 240 to rotate by the second target angle are calculated, and the control parameters are output in corresponding target control instructions. The first driving device controls the first rotating component 230 to rotate by the first target angle, and the second driving device controls the second rotating component 240 to rotate by the second target angle, so that the simulated eyeball 100 gazes at the target point.

[0193] In actual execution, the movement controller of the eye tracking device can control the rotation direction and speed of the first driving device and the second driving device, drive the first rotating component 230 and the second rotating component 240 to rotate, and the first driving device and the second driving device move simultaneously to realize the pitch angle rotation and horizontal rotation of the simulated eyeball 100, and simulate the complex motion of the human eye in multiple dimensions.

[0194] The pitch angle rotation and horizontal rotation of the simulated eyeball 100 can be controlled independently.

[0195] According to the eye tracking device provided in the embodiments of the present application, by arranging the first rotating component 230 and the second rotating component 240, the full range of angle adjustment of the simulated eyeball 100 is realized, the action of the simulated eyeball 100 gazing at the target point is decomposed into the rotation of the first rotating component 230 and the second rotating component 240, and the simulated eyeball 100 gazes at the target point through the pitch angle rotation and horizontal rotation, which accurately simulates the complex motion of the human eye in multiple dimensions and effectively improves the motion control precision of the simulated eyeball.

[0196] In some examples, the motion controller is further configured to control the first driving assembly and the second driving assembly to drive the simulated eyeballs to rotate according to different test requirements, so as to switch the target test device on the simulated eyeballs.

[0197] Optionally, the switchable test device further comprises a third driving assembly and two eyeball pedestals corresponding to the two simulated eyeballs.

[0198] The first rotating component is connected to the corresponding simulated eyeball through the corresponding eyeball pedestal, and the second rotating component is connected to the corresponding first rotating component and the corresponding simulated eyeball through the corresponding eyeball pedestal and drives the two to rotate synchronously.

[0199] The third driving assembly is connected to the two eyeball pedestals respectively.

[0200] The third driving assembly is configured to drive the two eyeball pedestals to move towards or away from each other under the control of the motion controller, so as to adjust the distance between the two simulated eyeballs.

[0201] In some embodiments, the test device comprising the eye tracking device shown in FIG. 1 further comprises an eyeball pedestal 260, and the simulated eyeball 100 is located on the eyeball pedestal 260.

[0202] The first rotating component 230 is connected to the simulated eyeball 100 through the eyeball pedestal 260, and the second rotating component 240 is connected to the first rotating component 230 and the simulated eyeball 100 through the eyeball pedestal 260 and can drive the two to rotate synchronously.

[0203] The third driving assembly is connected to the two eyeball pedestals 100 respectively, and drives the two eyeball pedestals 260 to move towards or away from each other, so as to adjust the pupil distance between the two simulated eyeballs 100.

[0204] In this embodiment, the two eyeball pedestals 260 can be arranged side by side in the first direction, and one simulated eyeball 100 is arranged on each eyeball pedestal 260.

[0205] It can be understood that the first direction indicates the orientation relationship, which is only for the convenience of describing the arrangement of the two eyeball pedestals 260, and does not indicate or imply that the eyeball pedestals 260 or the simulated eyeballs 100 must have a specific orientation relationship.

[0206] For example, the first direction can be the horizontal left-right direction, the horizontal front-back direction, or other directions.

[0207] The eyeball pedestal 260 is a pedestal for placing the simulated eyeball 100, and the bracket 210, the first rotating component 230, and the second rotating component 240, etc. can also be arranged on the eyeball pedestal 260.

[0208] In actual implementation, the simulated eyeball 100, the support 210 and the first rotating component 230 can be placed on the upper cover of the eyeball base 260; the second rotating component 240 can be placed in the accommodating cavity of the eyeball base 260, and a part extending from the upper cover is connected with the support 210 to drive the simulated eyeball 100, the support 210 and the first rotating component 230 to rotate in the horizontal direction.

[0209] In this embodiment, the second driving device can also be arranged in the accommodating cavity of the eyeball base 260, wherein one end of the second rotating component 240 is connected with the output end of the second driving device, and the other end of the second rotating component 240 is connected with the support 210.

[0210] In some embodiments, the axes of the two first rotating components 230 form a second included angle when the two simulated eyeballs 100 are in the initial position.

[0211] It should be noted that the simulated eyeball 100, the support 210 and the first rotating component 230 of the simulated eyeball 100 are relatively protruding structures in the eye movement tracking device (the second rotating component 240 is vertically placed and can be arranged in the eyeball base 260 of the simulated eyeball 100, which is relatively not protruding), if the two first rotating components 230 are placed in the same direction, the rotation of the second rotating component 240 can cause mechanical interference of the structures such as the simulated eyeball 100, the support 210 and the first rotating component 230, and mechanical interference between the protruding simulated eyeball 100 and the eye movement tracking device under test, thereby affecting the test results of the device.

[0212] As shown in FIG. 2, the axes of the two first rotating components 230 form a second included angle when the two simulated eyeballs 100 are in the initial position, that is, the relatively protruding simulated eyeball 100 is placed offset, leaving a non-interference rotating space for the structures such as the simulated eyeball 100, the support 210 and the first rotating component 230, and when the second rotating component 240 rotates, mechanical interference of the structures such as the simulated eyeball 100, the support 210 and the first rotating component 230 can be avoided, and the rotation of the two first rotating components 230 does not affect each other, ensuring the normal operation of the simulated eyeball 100 in two directions.

[0213] In this embodiment, the axes of the two first rotating components 230 form a second included angle, and the simulated eyeball 100 is placed offset, which can effectively prevent mechanical interference of the eye movement tracking device.

[0214] In some embodiments, the eye movement tracking device can further include a third driving assembly for adjusting the pupil distance between the two simulated eyeballs 100.

[0215] In this embodiment, the third driving assembly is connected with the two eyeball bases 260, and is used to drive the two eyeball bases 260 to move towards or away from each other in the first direction, so as to adjust the pupil distance between the two simulated eyeballs 100.

[0216] It can be understood that the simulated eyeballs 100 are placed on the eyeball bases 260, and when the third driving assembly drives the two eyeball bases 260 to move towards or away from each other, the distance between the two eyeball bases 260 changes, and the pupil distance between the two simulated eyeballs 100 changes accordingly. The pupil distance between the two simulated eyeballs 100 can be adjusted by the motion controller controlling the third driving assembly, and the pupil distance between the two simulated eyeballs 100 can be adjusted by the motion controller controlling the third driving assembly. The pupil distance between the two simulated eyeballs 100 can be adjusted by the motion controller controlling the third driving assembly.

[0217] In some embodiments, the third driving assembly includes a third driving device and a linear slide 270, and the third driving device and the linear slide 270 are connected, and the two eyeball bases 260 are arranged on the linear slide 270.

[0218] In this embodiment, the motion controller outputs a control instruction to the third driving device, and the linear slide 270 can drive the two eyeball bases 260 to realize linear motion under the driving of the third driving device, so as to realize the adjustment of the pupil distance between the two simulated eyeballs 100.

[0219] It can be understood that the third driving device is a power source for driving the linear slide 270, and the third driving device can be a stepping motor, a direct current motor or the like.

[0220] In actual execution, the eye movement tracking device can include a device base, and the device base defines a containing space for containing the third driving device. The linear slide 270 is mounted on the device base, and the two eyeball bases 260 are arranged on the linear slide 270. Under the driving of the third driving device, the pupil distance between the two simulated eyeballs 100 is adjusted.

[0221] In some embodiments, the maximum rotation angle of the second rotating part 240 is determined based on the pupil distance between the two simulated eyeballs 100.

[0222] It can be understood that according to the pupil distance between the two simulated eyeballs 100, the gaze directions of the two simulated eyeballs 100 are analyzed, and the rotation angle range in which mechanical interference occurs between the two simulated eyeballs 100 is determined, and then the maximum rotation angle of the second rotating part 240 for driving the simulated eyeballs 100 to realize horizontal rotation is determined.

[0223] In some embodiments, the maximum rotation angle of the first rotating part 230 is 360 degrees, and the maximum rotation angle of the second rotating part 240 is less than 360 degrees.

[0224] In this embodiment, the first rotating component 230 can drive the simulated eyeball 100 to rotate by 360 degrees to adjust the pitch angle of the simulated eyeball 100, and the maximum rotation angle of the second rotating component 240 is less than 360 degrees, which can avoid mechanical interference of the simulated eyeball 100, the support 210 and the first rotating component 230, and the rotation angle less than 360 degrees is more in line with the rotation rule of the real human eye.

[0225] In some embodiments, the eye movement tracking device further comprises a support 210.

[0226] As shown in FIG. 3, the support 210 comprises a first fixed plate 211 and a second fixed plate 212 perpendicular to each other, the other end of the first rotating component 230 is connected with the simulated eyeball 100 through the mounting hole of the first fixed plate 211, and the other end of the second rotating component 240 is connected with the second fixed plate 212.

[0227] In this embodiment, the support 210 is a frame for supporting and installing the simulated eyeball 100, and each simulated eyeball 100 corresponds to one support 210.

[0228] In this embodiment, the simulated eyeball 100 is installed on the support 210, the first rotating component 230 is installed on the first fixed plate 211, the second rotating component 240 is installed on the second fixed plate 212, the first rotating component 230 drives the simulated eyeball 100 to rotate, and the second rotating component 240 drives the support 210, the simulated eyeball 100 and the first rotating component 230 to rotate together.

[0229] It should be noted that when the two simulated eyeballs 100 are in the starting position, the axes of the two first rotating components 230 form an included angle, the support 210 is a relatively protruding structure in the eye movement tracking device, and the simulated eyeball 100 is placed offset, which can avoid mechanical interference of the support 210 and the first rotating component 230 on the support 210.

[0230] In actual execution, the first driving device can also be arranged on the first fixed plate 211, wherein the first driving device is installed on one side of the first fixed plate 211, one end of the first rotating component 230 is connected with the output end of the first driving device, and the other end of the first rotating component 230 passes through the mounting hole of the first fixed plate 211 and is connected with the simulated eyeball 100 on the other side of the first fixed plate 211.

[0231] In some embodiments, the simulated eyeball 100 can comprise an eyeball structure 110 and a prosthetic eye patch 120, the eyeball structure 110 is provided with a cut surface, the prosthetic eye patch 120 covers the cut surface, and the radius of the prosthetic eye patch 120 is smaller than the radius of the eyeball structure 110.

[0232] The eye structure 110 is a spherical structure simulating a human eye, and is provided with a cut surface on which a false eye patch 120 simulating an iris of a human eye is attached, the iris having a size smaller than that of the whole eye, and the radius of the false eye patch 120 can be set according to the radius of the iris of different human eyes.

[0233] In this embodiment, by designing the eye structure 110 and the false eye patch 120, different sizes, curvatures and radii of human eyes can be simulated, so that the simulation eye 100 is closer to a real human eye.

[0234] In actual implementation, the eye structure 110 can be manufactured by 3D printing technology or numerical control machine tool technology, and when the eye movement tracking device is used for testing, the eye structure 110 and the false eye patch 120 can be recognized by camera image recognition technology to track the eye movement trajectory.

[0235] In some embodiments, the cut surface of the eye structure 110 is perpendicular to the axial direction of the first rotating part 230.

[0236] As shown in FIG. 4, the cut surface of the eye structure 110 is perpendicular to the axial direction of the first rotating part 230, and the center of the false eye patch 120 attached to the cut surface is the pupil. When the simulation eye 100 is rotated by the first rotating part 230, the movement trajectory of the pupil of the false eye patch 120 is not the maximum circular cut surface of the movement of the eye structure 110, and there is a certain angle difference between the trajectory of the pupil and the vertical plane in front of the eye movement tracking device.

[0237] For example, as shown in FIG. 5, when the first rotating part 230 of the simulation eye 100 corresponding to the left eye rotates clockwise, the pupil initially facing the front display screen 300 will gradually move away from the display screen 300, and the movement trajectory of the pupil in the horizontal plane will also form a certain angle with the display screen 300.

[0238] In this embodiment, the first rotating part 230 of the simulation eye 100 is rotated to adjust the pitch angle of the simulation eye 100, and the pupil has a certain positional deviation, and the second rotating part 240 of the simulation eye 100 is controlled to rotate to compensate for the angle.

[0239] For example, when the pupil of the simulation eye 100 corresponding to the left eye moves away from the display screen 300, the second rotating part 240 of the simulation eye 100 is controlled to rotate clockwise to compensate for the angle, thereby narrowing the distance between the pupil and the display screen 300.

[0240] In some embodiments, the eye movement tracking device can further include a fourth driving assembly connected to the eye base 260.

[0241] Each fourth driving assembly is connected with one eyeball base 260, and is used to drive the eyeball base 260 to move along the axial direction of the second rotating component 240, so as to adjust the height of the simulated eyeball 100.

[0242] In this embodiment, the eyeball base 260 is a base that can be lifted and lowered. The motion controller outputs a control instruction to the fourth driving assembly. Under the driving of the fourth driving assembly, the eyeball base 260 moves along the axial direction of the second rotating component 240, so as to realize the height adjustment of the simulated eyeball 100.

[0243] The eye tracking device according to the embodiments of the present application can realize the rotation of the pitch angle, the rotation in the horizontal direction, the adjustment of the pupil distance and the height adjustment, and can accurately simulate the multi-dimensional complex motion of different eyes.

[0244] In some embodiments of the present application, the above-mentioned switchable test device comprises two simulated eyeballs, each of which is provided with a first rotating shaft and a second rotating shaft, and the simulated eyeball can rotate under the driving of the first rotating shaft and the second rotating shaft.

[0245] The test device is provided on the simulated eyeball and rotates synchronously with the simulated eyeball. The first rotating shaft and the second rotating shaft drive the simulated eyeball to rotate, and then drive the test device to rotate until the required test device is switched to the test position.

[0246] In some embodiments, the switching can refer to the change of the spatial position of the same test device, the switching between different devices, or the switching between different devices and the change of the spatial position of the device.

[0247] In some embodiments, the first camera and the second camera are installed on each simulated eyeball, and the field angles of the first camera and the second camera are not equal.

[0248] In some embodiments, the field angle of the first camera is 0-30°, and the field angle of the second camera is 0-120°. The first camera and the second camera are switched by the rotation of the first rotating shaft and the second rotating shaft.

[0249] In some embodiments, the first camera and the second camera are switched only by the rotation of the first rotating shaft by 180°. As shown in FIGS. 15, 16 and 17.

[0250] The first camera is used to test the clarity, PPD (Pixels Per Degree, angular resolution), eye box (movable range of the user's eye), IPD (Interpupillary Distance, pupil distance), VAC (Vergence-Accommodation Conflict, vergence conflict) and binocular image accuracy.

[0251] The second camera is used to test distortion, chromatic aberration, brightness / color uniformity, ghost image, contrast, and large field of view binocular image of the full field of view.

[0252] The lens diaphragm is preposed and can be automatically focused.

[0253] The camera is externally provided with a fake eye patch, so that the simulated eyeball can be recognized by an eye movement tracking device.

[0254] The test device can be combined in the first camera and the first camera, the second camera and the second camera, and the first camera and the second camera by rotating the first rotating shaft and the second rotating shaft, so as to meet different test requirements.

[0255] Use process: the first camera is combined with the first camera, and the clarity is tested. In an embodiment, the first rotating shaft is rotated by 180° to switch to the second camera, and the distortion of the full field of view is tested. The first camera is combined with the second camera, and different test items of the left and right eyes are tested respectively, so as to improve the test efficiency.

[0256] The distance between the first camera entrance pupil and the second camera entrance pupil and the center of the simulated eyeball is the same, and the simulated eyeball is synchronously rotated around the eyeball center. During testing, the camera can clearly and completely capture the virtual image of the measured head-mounted display. At the same time, by rotating the simulated eyeball, the camera rotating with the simulated eyeball can capture image information of different field angles of the measured product, and the image information is transmitted to the calculation module for processing.

[0257] Of course, the two simulated eyeballs can also be installed with a high-frequency brightness meter (PD) and / or a near-infrared radiation illuminometer, which are combined for use on the same simulated eyeball, or are respectively installed on the corresponding simulated eyeball, and can also be combined with the first camera and the second camera. That is, at least one of the first camera, the second camera, the high-frequency brightness meter (PD), and the near-infrared radiation illuminometer can be installed on the simulated eyeball, or at least two or more of them can be installed according to actual needs.

[0258] In some embodiments, the first camera, the second camera, the high-frequency brightness meter, and the near-infrared radiation illuminometer are installed on the simulated eyeball, and the distance from the center of the simulated eyeball can be the same or different.

[0259] In some embodiments, the above-mentioned test devices are combined and located at the same distance from the center of the simulated eyeball.

[0260] The high-frequency brightness meter (PD) is used to test the binocular photon to photon delay.

[0261] Near-infrared radiation illuminance measuring device, measuring near-infrared light (NIR) light source on the cornea illuminance, for evaluating the impact of eye movement module infrared light source on human eyes.

[0262] The calculation module processes the test results in real time to determine whether the image quality meets the requirements.

[0263] At the same time, the simulated eyeball can be replaced with eyeballs of different sizes (eyeball diameter can be 19-30mm) according to requirements, can be replaced with pupils of different sizes (2-8mm), and can be replaced with iris colors.

[0264] The different functional test devices on the simulated eyeball can be arbitrarily matched with the deformable eyeball. As shown in FIG. 18.

[0265] In one embodiment, the first camera is used in combination with the first camera, as shown in FIGS. 19a-19b, 20, 26-29:

[0266] The first camera has a field of view angle of 0-30°, and the first camera is used in combination with the first camera to test the IPD.

[0267] 1) Adjust the rotation axis to make the optical axes of the two first cameras in the left and right simulated eyeballs parallel. The distance between the first camera entrance pupil of the left eyeball and the left target of the head-mounted display is ER_left, and the distance between the first camera entrance pupil of the right eyeball and the right target of the head-mounted display is ER_right. Adjust the position of the head-mounted display until ER_left = ER_right. By adjusting the third driving assembly and / or the fourth driving assembly, the left eyeball is translated in the X / Y direction until the first camera of the left eyeball is aligned with the MTF center of the left target of the head-mounted display. Similarly, by adjusting the third driving assembly and / or the fourth driving assembly, the right eyeball is adjusted until the first camera of the right eyeball is aligned with the MTF center of the head-mounted display. The pupillary distance between the two simulated eyeballs is obtained, which is the IPD of the head-mounted display. The pupillary distance test flowchart is shown in FIG. 25.

[0268] 2) Referring to FIG. 26, the first camera has a field of view angle of 0-30°, and the first camera is used in combination with the first camera to test the eye box (the range in which the user's eyes can move).

[0269] Under the cooperation of the first rotation axis and the second rotation axis, the two simulated eyeballs rotate around the eyeball center to a certain field of view angle θ (for example, 30°) and an azimuth angle η (for example, 45°) of the VR head-mounted display. The third driving assembly and the fourth driving assembly translate the simulated eyeball along the direction of the azimuth angle, and the first camera tests the MTF until the MTF drops to a certain threshold (for example, 0.5), and the translation distance X / Y at this time is recorded.

[0270] The displacement platform drives the simulated eyeball to translate in the Z direction (the direction away from or close to the head-mounted display), and the three-dimensional area of the eye box is tested. The size of the eye box under the field of view angle θ is obtained.

[0271] Figure 19a simulates the eye box under the condition that the Z direction of the simulated eyeball is unchanged, and figure 19b simulates the eye box after the simulated eyeball translates in the Z direction.

[0272] This scheme can simultaneously test the left and right eye boxes of the head-mounted display, improving the test efficiency. The corresponding flowchart is shown in figure 26.

[0273] 3) The field of view angle of the first camera is 0-30°, the first camera is used in combination with the first camera group, and is used for testing the clarity.

[0274] The head-mounted display displays vertical stripes (4on4off) on both eyes, the eye movement tracking function of the head-mounted display is turned on, the camera shoots the vertical stripes, and the MTF value is calculated according to (Lmax-Lmin) / (Lmax+Lmin). The size and difference of the MTF values obtained by the left camera and the right camera are compared.

[0275] Among them, 2) and 3) above can be combined, and the flowchart is shown in figure 27.

[0276] 4) Referring to figures 22 and 28, the field of view angle of the first camera is 0-30°, the first camera is used in combination with the first camera group, and is used for testing the binocular image.

[0277] The head-mounted display displays the test chart shown in figure 20 on both eyes, and the motion control module controls the rotation of the simulated eyeball. The left eyeball rotates α_left, β_left, and the right eyeball rotates α_right, β_right, so that the centers of the left and right cameras are respectively aligned with the centers of the position points of the left and right eyes.

[0278] The binocular image calculation formula is: β_left-β_right.

[0279] 5) Referring to figures 21 and 29, the field of view angle of the first camera is 0-30°, the first camera is used in combination with the first camera group, and is used for testing the VAC (vergence conflict).

[0280] The head-mounted display displays the test chart shown in figure 20 on both eyes, and the motion control module controls the rotation of the simulated eyeball. The left camera rotates α_left, β_left, and the right camera rotates α_right, β_right, so that the centers of the left and right cameras are respectively aligned with the centers of the position points of the left and right eyes. The virtual image distance tested by the left camera is VID_left, and the virtual image distance tested by the right camera is VID_right

[0281] The difference between the camera focus plane position VID and the image position D is calculated, i.e. VID_left - D, and the formula for D is as follows:

[0282] Tan (a_left) = i_left / D;

[0283] Tan (a_right) = i_right / D;

[0284] i_left + i_right = i.

[0285] The flowcharts corresponding to the above 4) and 5) can be combined as shown in FIG. 28.

[0286] In one embodiment, the first camera and the second camera are used in combination:

[0287] 1) The field of view of the first camera is 0-30°, and the field of view of the second camera is 0-120°. The first camera and the second camera are used in combination to test different test items at the same time.

[0288] The first camera tests the definition, PPD (angular resolution), and eyebox, while the second camera tests the color difference, luminance / color uniformity, contrast, and ghost image of the full field of view. The test results of the first camera and the second camera are processed in parallel by the calculation module, improving the test efficiency.

[0289] 2) The field of view of the first camera is 0-30°, and the field of view of the second camera is 0-120°. The first camera and the second camera are used in combination to test dynamic distortion, as shown in FIG. 23.

[0290] Referring to FIG. 30, the second camera takes a global picture, and according to the image taken by the second camera, the position information of the target point relative to the first camera is calculated. The rotation axis drives the first camera on the simulated eyeball to rotate, so that the first camera is aligned with the target point.

[0291] The second camera takes a checkerboard in a static state, and calculates the static distortion D1 of each position based on the center of the pupil. At the same time, after the first camera is aligned with the target point, a local small field of view checkerboard is taken, and the dynamic distortion D2 based on the center of the eyeball is calculated. The difference between D1 and D2 is compared to evaluate the dynamic distortion.

[0292] In one embodiment, the high-frequency luminance meter and the second camera are used in combination:

[0293] Referring to FIG. 31, the high-frequency luminance meter can measure luminance and color, and the field of view of the second camera is 0-120°. The high-frequency luminance meter and the second camera are used in combination to test ghost image characteristics.

[0294] The second camera takes a global picture and identifies the position of the ghost image. The position of the ghost image is taken as a target point. According to the position information of the target point calculated by the second camera, the high-frequency luminance meter on the simulated eyeball is rotated to align the high-frequency luminance meter with the target point.

[0295] The high-frequency luminance meter tests the color and brightness of the ghost image.

[0296] The two simulated eyeballs can also be equipped with high-frequency luminance meters (PD) or near-infrared radiation illuminometers. Both can be installed on the same simulated eyeball and used together, or combined with the first camera and the second camera.

[0297] In some embodiments, the corresponding test flowchart is shown in FIG. 29.

[0298] When the measuring device is a near-infrared radiation illuminometer, it can be used to measure the damage of infrared light sources from virtual reality devices such as head-mounted devices to human eyes. In some embodiments, the near-infrared radiation illuminometer is combined with the near-infrared radiation illuminometer to measure the damage of infrared light sources to human eyes.

[0299] When the eyeball rotates, the distance between the eyeball and the infrared light source of the head-mounted device is different, and the degree of damage of the infrared light source to the human eye is also different.

[0300] 1) The simulated eyeball traverses all the field angles of the head-mounted device to be tested (-60° < α_left < 60°, -60° < α_right < 60°, -50° < β_left < 50°, -50° < β_left < 50°).

[0301] 2) The near-infrared radiation illuminometer on the simulated eyeball tests the illuminance of the infrared light source in real time, respectively, and records the corresponding α_left, β_left, E_left and α_right, β_right, E_right. Determine whether the illuminance meets E < 100 W / m2.

[0302] The above embodiments can also be applied to test devices with only one simulated eyeball. In this case, the simulated eyeball will rotate one or more times according to the requirements to switch the corresponding test devices to the test position for testing.

[0303] By using the design of the present application, the test functions of different test devices can be integrated on one test device. By installing different test devices on the simulated eyeball and rotating the simulated eyeball to call the corresponding test devices according to the requirements, the design can be applied to monocular test devices and binocular test devices. For binocular test devices, different combinations of devices called by left and right simulated eyeballs can achieve the same or different functions, thereby realizing the integration of functions and the efficiency and accuracy of testing.

[0304] For example, in some embodiments, the measurement device can also be a high frequency luminance meter (PD), which can be used in combination with the high frequency luminance meter to test binocular Photo-to-photo latency, binocular refresh rate consistency, as shown in FIG. 24.

[0305] The light signal for the left eye of the head-mounted display enters the PD from the optical fiber 1, the light signal for the right eye of the head-mounted display enters the PD from the optical fiber 2, and the light signal of the real world enters the PD from the optical fiber 3. The calculation module processes the signals to obtain the latency of the left eye relative to the real world, the latency of the right eye relative to the real world, and the relative latency of the left and right eyes.

[0306] In another aspect, the embodiments of the present application also provide a testing method for testing a device under test, the testing method comprising:

[0307] In response to a testing requirement, determining a target testing device.

[0308] Controlling the first driving assembly and the second driving assembly to move to drive the simulated eyeball and the target testing device to rotate synchronously until the target testing device switches to a testing position.

[0309] Controlling the target testing device to test the device under test at the testing position.

[0310] The simulated eyeball is provided with at least one testing device, and the target testing device is one of the at least one testing device.

[0311] Optionally, after controlling the target testing device to test the device under test at the testing position, the method further comprises: acquiring testing information of the target testing device, and determining a testing result of the testing requirement for the device under test according to the testing information.

[0312] Optionally, the testing requirement comprises at least one of testing clarity, angular resolution, user eye movable range, interpupillary distance, vergence conflict, binocular image combining accuracy, distortion of full field of view, chromatic aberration, brightness / color uniformity, ghost image, contrast, large field of view binocular image combining, binocular Photo-to-photo latency, binocular refresh rate consistency, illuminance of near-infrared light source on cornea, and damage of infrared light source to human eye.

[0313] The testing device comprises at least one of a first camera, a second camera, a high frequency luminance meter, and a near-infrared radiation illuminometer; wherein the field of view angle range of the first camera is different from the field of view angle range of the second camera.

[0314] In an example, the number of simulated eyeballs is one, and according to the testing requirement, determining the target testing device comprises:

[0315] the target testing device is determined to be a first camera when the testing requirement is to test at least one of the clarity, the angular resolution, the user eye movable range, the interpupillary distance, the vergence conflict, and the binocular photo-to-photo accuracy of the device under test;

[0316] the target testing device is determined to be a second camera when the testing requirement is to test at least one of the distortion, the chromatic aberration, the luminance / color uniformity, the ghost image, the contrast, and the binocular photo-to-photo accuracy of the full field of view of the device under test;

[0317] the target testing device is determined to be a high-frequency luminance meter when the testing requirement is to test the binocular photo-to-photo delay of the device under test;

[0318] the target testing device is determined to be a near-infrared radiation illuminometer when the testing requirement is to test the illuminance of a near-infrared light source on the cornea of the device under test.

[0319] Optionally, the number of the simulated eyeballs is two, and the testing device is installed on each of the simulated eyeballs, and the target testing device is determined according to the testing requirement, and the target testing device includes:

[0320] the target testing device on each of the two simulated eyeballs is determined to be a first camera when the testing requirement is to test at least one of the clarity, the interpupillary distance, the user eye movable range, the binocular photo-to-photo accuracy, and the vergence conflict of the device under test;

[0321] the target testing devices on the two simulated eyeballs are determined to be a first camera and a second camera respectively when the testing requirement is to test at least one of the chromatic aberration, the luminance / color uniformity, the contrast, and the ghost image of the full field of view of the device under test, or the testing requirement is to test at least one of the clarity, the angular resolution, and the user eye movable range of the device under test at the same time;

[0322] the target testing devices on the two simulated eyeballs are determined to be a high-frequency luminance meter and a second camera respectively when the testing requirement is to test the ghost image of the device under test;

[0323] the target testing devices on the two simulated eyeballs are determined to be high-frequency luminance meters when the testing requirement is to test the binocular photo-to-photo delay or the binocular refresh rate consistency of the device under test;

[0324] the target testing devices on the two simulated eyeballs are determined to be near-infrared radiation illuminometers when the testing requirement is to test the damage of an infrared light source to the human eye of the device under test.

[0325] In an embodiment, the target testing devices on the two simulated eyeballs are determined to be first cameras when the testing requirement is to test the interpupillary distance of the device under test, and the field of view angle of the first camera ranges from 0 to 30 degrees;

[0326] controlling the target testing device to test the to-be-tested device at the testing position includes:

[0327] adjusting positions of the two simulated eyeballs respectively to make optical axes of the first cameras on the two simulated eyeballs parallel;

[0328] determining that distances from the first cameras on the two simulated eyeballs to corresponding visual devices in the to-be-tested device are the same;

[0329] translating the positions of the two simulated eyeballs to make the first cameras on the two simulated eyeballs aligned with MTF centers of the corresponding visual devices;

[0330] acquiring a pupil distance between the two simulated eyeballs, and taking the pupil distance as a pupil distance of the to-be-tested device.

[0331] In an embodiment, the testing requirement is to test a movable range of a user's eye of the to-be-tested device, and the target testing devices on the two simulated eyeballs are both the first cameras; wherein a field of view angle range of the first cameras is 0-30°.

[0332] controlling the target testing device to test the to-be-tested device at the testing position includes:

[0333] controlling the two simulated eyeballs to rotate to make the simulated eyeballs rotate to a plurality of field of view angles of the to-be-tested device; wherein each of the field of view angles has a corresponding azimuth angle.

[0334] In each of the field of view angles and the azimuth angles, the two simulated eyeballs are controlled to be translated along a direction of the corresponding azimuth angle, and in the process of the translation, the MTF of the corresponding visual device in the to-be-tested device is tested by the first camera.

[0335] When the MTF of the visual device meets a preset threshold, the two simulated eyeballs are controlled to stop the translation, and the two simulated eyeballs are controlled to move in a direction close to or away from the to-be-tested device to test a three-dimensional region of the movable range of the user's eye of the to-be-tested device, and obtain the movable range of the user's eye of the to-be-tested device corresponding to each field of view angle.

[0336] For example, the testing requirement is to test binocular image fusion of the to-be-tested device, and the target testing devices on the two simulated eyeballs are both the first cameras; wherein a field of view angle range of the first cameras is 0-30°.

[0337] controlling the target testing device to test the to-be-tested device at the testing position includes:

[0338] controlling the two simulated eyeballs to rotate to make the simulated eyeballs rotate to a plurality of field of view angles of the to-be-tested device; wherein each of the field of view angles has a corresponding azimuth angle;

[0339] record a first angle β_left and a second angle β_right of rotation of the two simulated eyeballs in a vertical direction in each set of the field of view angle and the azimuth angle;

[0340] calculate a binocular image accuracy β_left-β_right corresponding to the field of view angle and the azimuth angle according to the first angle β_left and the second angle β_right.

[0341] Optionally, the test requirement is to test the vergence conflict of the device under test, and the target test device on the two simulated eyeballs is a first camera; wherein the field of view angle of the first camera ranges from 0 to 30 degrees.

[0342] controlling the target test device to test the device under test at the test position includes:

[0343] controlling the two simulated eyeballs to rotate so as to rotate the simulated eyeballs to a plurality of field of view angles of the device under test; wherein each field of view angle has a corresponding azimuth angle;

[0344] record a third angle α_left and a fourth angle α_right of rotation of the two simulated eyeballs in a horizontal direction, a pupil distance i, and a first virtual image distance VID_left and a second virtual image distance VID_right obtained by the two first cameras in each set of field of view angle and azimuth angle;

[0345] calculate a combined image distance D of the two first cameras according to the third angle α_left, the fourth angle α_right and the pupil distance i;

[0346] calculate a vergence conflict corresponding to each field of view angle according to the combined image distance D and an average value of the first virtual image distance VID_left and the second virtual image distance VID_right.

[0347] In an optional embodiment, the test requirement is to test the dynamic distortion of the device under test, and the target test device on the two simulated eyeballs is a first camera and a second camera respectively; wherein the field of view angle of the first camera ranges from 0 to 30 degrees, and the field of view angle of the second camera ranges from 0 to 120 degrees.

[0348] controlling the target test device to test the device under test at the test position includes:

[0349] controlling the first camera and the second camera to be aligned with the left and right target optical axes of the device under test respectively;

[0350] acquire a first static distortion of each position in the global picture by using the second camera in a static state;

[0351] According to the image acquired by the second camera, position information of a target point in the acquired image relative to the first camera is calculated;

[0352] According to the position information, a rotation angle of the first camera is determined;

[0353] According to the rotation angle, a simulated eyeball on which the first camera is located is controlled to rotate, and a rotation axis of the simulated eyeball is adjusted, so that the first camera is aligned with different target points, and a second dynamic distortion corresponding to each target point is acquired by using the first camera;

[0354] According to the first static distortion and the second dynamic distortion corresponding to each target point, a dynamic distortion of the device under test is determined.

[0355] In an embodiment, the test requirement is to test the color and brightness of the ghost image of the device under test, and the target test devices on the two simulated eyeballs are respectively a second camera and a high-frequency brightness meter; wherein the field of view angle of the second camera is 0-120°;

[0356] Controlling the target test devices to test the device under test at the test position includes:

[0357] Controlling the second camera to acquire a global picture and identifying the position of the ghost image, and taking the position of the ghost image as a target point;

[0358] According to the position information of the target point, the simulated eyeball on which the high-frequency brightness meter is located is controlled to rotate, so that the high-frequency brightness meter is aligned with the target point;

[0359] The color and brightness of the ghost image are tested by using the high-frequency brightness meter, and the test results are taken as the color and brightness of the ghost image of the device under test.

[0360] For example, the test requirement is to test the damage of the infrared light source of the device under test to the human eye, and the target test devices on the two simulated eyeballs are both near-infrared radiation illuminometers.

[0361] Controlling the target test devices to test the device under test at the test position includes:

[0362] Controlling the two simulated eyeballs to rotate so as to traverse all the field of view angles corresponding to the device under test by using each simulated eyeball;

[0363] The illuminance of the infrared light source of the device under test is tested in real time by using the near-infrared radiation illuminometer installed on each simulated eyeball;

[0364] According to the illuminance of the infrared light source of the device under test and a preset illuminance threshold, the damage of the infrared light source of the device under test to the human eye is determined.

[0365] Optionally, the test method further comprises:

[0366] In response to different test requirements, the first driving assembly and the second driving assembly are controlled to drive the simulated eyeball to rotate to switch the target test device located at the test position.

[0367] In the embodiments of the present application, the structures and principles described in the above test method can refer to the related structures and principles in the above switchable test device, which will not be described again.

[0368] It is worth noting that in some embodiments, the test method of the switchable test device can use the following eye tracking method to control the simulated eyeball to rotate to drive the test device to move, adjust the spatial position, and perform related tests on the device under test.

[0369] The following is for the convenience of description, that is, the movement of the simulated eyeball is described from the perspective of the eye tracking control method, but obviously, this movement logic is applicable to the movement logic of the simulated eyeball driving the test device for corresponding tests in the switchable test device.

[0370] The eye tracking control method provided by the embodiments of the present application can accurately simulate complex eye movement by fixing the pupil distance, and decomposing the action of the simulated eyeball 100 staring at the target point into the rotation of the first rotating part 230 and the second rotating part 240, and through the pitch angle rotation and the horizontal direction rotation.

[0371] The eye tracking control method of the embodiments of the present application acts on two simulated eyeballs 100 with the first rotating part 230 and the second rotating part 240 to track the target point, the rotation axis of the first rotating part 230 and the rotation axis of the second rotating part 240 are not parallel, and the two rotation axes are in two non-parallel planes, and the line connecting the pupil of the simulated eyeball 100 and the eyeball center forms a first included angle with the axial direction of the first rotating part 230.

[0372] The eye tracking control method of the embodiments of the present application can be used to control the movement of the simulated eyeball 100 of the above eye tracking device, and accurately simulate complex continuous eye movement.

[0373] The execution subject of the eye tracking control method provided by the embodiments of the present application can be an electronic device or a functional module or functional entity capable of implementing the eye tracking control method in the electronic device. The following will take the electronic device as an example to describe the eye tracking control method provided by the embodiments of the present application.

[0374] As shown in FIG. 7, the eye tracking control method includes steps 710 to 730.

[0375] Step 710, obtaining the eyeball coordinate information of the two simulated eyeballs 100 and the coordinate information of the target point to be tracked, and determining the pupil distance between the two simulated eyeballs 100 according to the eyeball coordinate information.

[0376] In this step, the coordinate information of the target point and the eyeball coordinate information of the two simulated eyeballs 100 can be obtained by establishing a spatial rectangular coordinate system according to the relative position relationship of the simulated eyeballs 100 and the target point.

[0377] For example, as shown in FIG. 5, the simulated eyeballs 100 gaze at the target point of the display screen 300, when the eye tracking device is located at the original position, the eyeball centers of the two simulated eyeballs 100 are d and e respectively, the vertical mapping points of d and e on the display screen 300 are a and b respectively, ad=be=h, h is the visual depth, that is, the distance between the eyeball center of the simulated eyeball 100 and the display screen 300, de=IPD, IPD is the pupil distance.

[0378] Wherein, the midpoint of the line connecting points a and b is the screen center point O of the display screen 300, and point c is the target point on the display screen 300.

[0379] A spatial rectangular coordinate system can be established with the midpoint of the line connecting the two simulated eyeballs 100 (the midpoint of the line connecting points d and e) as the coordinate origin, the line connecting the two simulated eyeballs 100 as the x-axis, the line connecting the midpoint of the line connecting the two simulated eyeballs 100 to the screen center point of the display screen 300 as the y-axis, and the vertical direction as the z-axis.

[0380] According to the relative position relationship of point c and the screen center point O, the coordinate information (x0, h, z0) of point c is obtained, and the eyeball coordinate information of the two simulated eyeballs 100 is (1 / 2IPD, 0, 0) and (-1 / 2IPD, 0, 0) respectively.

[0381] In this embodiment, a spatial rectangular coordinate system can be established at a certain position of the eye tracking device, or a spatial rectangular coordinate system can be established at a certain position of the display screen 300 to obtain the coordinate information of the target point and the eyeball coordinate information of the two simulated eyeballs 100.

[0382] It should be noted that the eyeball coordinate information of the simulated eyeball 100 includes the coordinate information of each position of the simulated eyeball 100, for example, the eyeball coordinate information includes the coordinate information of the positions of the eyeball structure 110, the artificial eye patch 120, the pupil and other structures.

[0383] In this step, the pupil distance, that is, the distance of the line connecting the eyeball centers of the two simulated eyeballs 100, is calculated according to the eyeball coordinate information of the two simulated eyeballs 100.

[0384] For example, the eye coordinate information of the two simulated eyeballs 100 is (1 / 2 IPD, 0, 0) and (-1 / 2 IPD, 0, 0) respectively, and the pupil distance between the two simulated eyeballs 100 is IPD.

[0385] Step 720, when the pupil distance and the target pupil distance meet the preset condition, based on the eye coordinate information of the two simulated eyeballs 100 and the coordinate information of the target point, determining the first target angle and the second target angle of the rotation required for each simulated eyeball 100 to track the target point.

[0386] Wherein, the target pupil distance is a preset pupil distance value.

[0387] It should be noted that the pupil distance and the target pupil distance meet the preset condition, which can be that the pupil distance is equal to the target pupil distance, or the pupil distance and the target pupil distance have a multiple relationship.

[0388] For example, when the pupil distance between the two simulated eyeballs 100 is equal to the preset target pupil distance, according to the eye coordinate information of the two simulated eyeballs 100 and the coordinate information of the target point, the position deviation between the line of sight direction of the simulated eyeball 100 and the target point is judged, and the position deviation is adjusted by the rotation of the first rotating part 230 and the second rotating part 240. The line of sight direction of the simulated eyeball 100 is directly opposite to the target point, that is, the simulated eyeball 100 gazes at the target point.

[0389] Wherein, the first target angle corresponds to the angle of the first rotating part 230 driving the simulated eyeball 100 to rotate when the simulated eyeball 100 tracks the target point, and the second target angle corresponds to the angle of the second rotating part 240 driving the first rotating part 230 and the simulated eyeball 100 to rotate synchronously when the simulated eyeball 100 tracks the target point.

[0390] In this step, according to the coordinate information of the target point and the eye coordinate information of the simulated eyeball 100, the position deviation between the line of sight exit direction of the simulated eyeball 100 and the target point is judged, and the line of sight exit direction of the simulated eyeball 100 is adjusted to be directly opposite to the target point by the rotation of the first rotating part 230 and the second rotating part 240.

[0391] In actual execution, the first target angle and the second target angle can be calculated by subtracting the current eye coordinate information of the simulated eyeball 100 from the corresponding eye coordinate information of the simulated eyeball 100 when it rotates to gaze at the target point.

[0392] When the first rotating component 230 drives the simulated eyeball 100 to rotate by the first target angle, and the second rotating component 240 drives the simulated eyeball 100 and the first rotating component 230 to rotate synchronously by the second target angle, the eyeball center, the pupil of the simulated eyeball 100 and the target point can be adjusted on the same straight line, that is, the visual line of the simulated eyeball 100 is directly opposite to the target point.

[0393] It can be understood that the eyeball coordinate information of the two simulated eyeballs 100 is different, and the first target angle and the second target angle of the two simulated eyeballs 100 are also different.

[0394] In step 730, a target control instruction is output based on the first target angle and the second target angle, to control the first rotating component 230 to drive the simulated eyeball 100 to rotate by the first target angle, and to control the second rotating component 240 to drive the first rotating component 230 and the simulated eyeball 100 to rotate synchronously by the second target angle.

[0395] In this embodiment, the control parameters for controlling the first rotating component 230 to rotate by the first target angle and the second rotating component 240 to rotate by the first target angle are calculated, to obtain a corresponding target control instruction, to control the first rotating component 230 to rotate by the first target angle, and to control the second rotating component 240 to rotate by the second target angle, so that the simulated eyeball 100 gazes at the target point.

[0396] Taking the first rotating component 230 driving the simulated eyeball 100 to rotate in the vertical direction to realize the pitch angle adjustment, and the second rotating component 240 driving the simulated eyeball 100 to rotate in the horizontal direction as an example.

[0397] In this embodiment, the first target angle Pc and the second target angle Qc are calculated according to the coordinate information and the eyeball coordinate information, and a corresponding target control instruction is output, to rotate the first rotating component 230 by Pc and to rotate the second rotating component 240 by Qc, so that the visual line of the simulated eyeball 100 can be adjusted to be directly opposite to the target point.

[0398] According to the eye movement tracking control method provided in the embodiments of the present application, the pupil distance between the two simulated eyeballs 100 is fixed, the action of the simulated eyeball 100 gazing at the target point is decomposed into the rotation of the first rotating component 230 and the second rotating component 240 by acquiring the coordinate information and the eyeball coordinate information of the target point, and the motion control is performed, so that the simulated eyeball 100 gazes at the target point, the motion control precision of the eye movement tracking device is improved, and the complex eyeball movement is accurately simulated through the pitch angle rotation and the horizontal direction rotation.

[0399] In some embodiments, the eye movement tracking control method can further include:

[0400] When the pupil distance between the two simulated eyeballs 100 does not meet the preset condition with the target pupil distance, the pupil distance between the two simulated eyeballs 100 is adjusted until the preset condition is met with the target pupil distance.

[0401] For example, the pupil distance between the two simulated eyeballs 100 can be changed by driving the two eyeball bases 260 to move towards or away from each other through the third driving assembly of the eye tracking device, until the pupil distance between the two simulated eyeballs 100 is adjusted to the target pupil distance, facilitating the angle decomposition of the rotation of the first rotating part 230 and the second rotating part 240, and improving the motion control accuracy of the simulated eyeball 100.

[0402] In some embodiments, step 730, based on the eyeball coordinate information of the two simulated eyeballs 100 and the coordinate information of the target point, determining the first target angle and the second target angle at which each simulated eyeball 100 needs to rotate to track the target point, comprises:

[0403] Based on the eyeball coordinate information and the coordinate information of the target point, determining a target pitch angle at which the simulated eyeball 100 gazes at the target point;

[0404] Based on the target pitch angle and the first included angle, determining the first target angle of the simulated eyeball 100;

[0405] Based on the eyeball coordinate information, the coordinate information of the target point and the first target angle, determining the second target angle.

[0406] In this embodiment, based on the eyeball coordinate information, the target pitch angle at which each simulated eyeball 100 gazes at the target point can be calculated through the right triangle algorithm of the pitch angle, and the target pitch angle is used to represent the included angle between the line of sight of the pupil and the horizontal plane when the simulated eyeball 100 gazes at the target point.

[0407] As shown in FIG. 6, connecting the target point of the display screen 300 and the two simulated eyeballs 100 together can obtain a triangle, and through the right triangle algorithm of the pitch angle, the target pitch angle at which each simulated eyeball 100 gazes at the target point can be calculated.

[0408] Based on the fact that the included angle between the line of sight of the pupil and the horizontal plane is equal to the target pitch angle, the coordinate information of the target position of the pupil in the vertical direction when the simulated eyeball 100 rotates to gaze at the target point can be obtained through the trigonometric function operation.

[0409] It should be noted that the axial direction of the first rotating part 230 and the line of sight of the simulated eyeball 100 have a first included angle, and the movement of the pupil position when the first rotating part 230 rotates is related to the first included angle, that is, when calculating the first target angle, the first included angle needs to be combined for calculation.

[0410] For example, the first rotating component 230 has a first included angle of 45° with the line-of-sight exit direction of the simulated eyeball 100, and the target tilt angle of the simulated eyeball 100 is in the range of 0° to 90°. After conversion through the rectangular coordinate system and the trigonometric function, the first target angle is obtained as 45°, that is, the first rotating component 230 rotates 360°, and the simulated eyeball 100 can be adjusted in the tilt angle range of 0° to 90°.

[0411] In actual implementation, the first rotating component 230 drives the simulated eyeball 100 to move around the axis of the first rotating component 230, and drives the pupil to move from the current position to the target position of the fixation target point. According to the current position and the target position, and in combination with the first included angle, the first target angle is calculated.

[0412] It should be noted that the specific calculation and derivation of the target tilt angle through the eyeball coordinate information and the coordinate information of the target point are derived by the person skilled in the art according to the calculation principle of the included angle between the line-of-sight exit direction and the horizontal plane, which is not described herein. It can be understood that when the two simulated eyeballs 100 are placed side by side, corresponding to the left eye and the right eye of the human eye respectively, the eyeball coordinate information of the two simulated eyeballs 100 is different, and the target tilt angles corresponding to the two simulated eyeballs 100 are different, which are β-left and β-right respectively, and the first target angles calculated in combination with the first included angle are also different.

[0413] For example, as shown in FIG. 6, the two simulated eyeballs 100 are placed side by side, corresponding to the left eye and the right eye respectively, and the two simulated eyeballs 100 are driven by the first rotating component 230 to fixate on the target point c above the display screen 300. The two simulated eyeballs 100 correspond to the tilt angles β-left and β-right respectively.

[0414] It can be understood that after the rotation angle of the first rotating component 230 is fixed, the rotation of the second rotating component 240 will not change the tilt angle of the simulated eyeball 100. After the first target angle is calculated, the second target angle is calculated in combination with the coordinate information of the target point and the eyeball coordinate information of the simulated eyeball 100.

[0415] In some embodiments, determining the second target angle based on the eyeball coordinate information, the coordinate information of the target point, and the first target angle can include:

[0416] Based on the first target angle and the motion trajectory of the pupil, the projection displacement deviation of the pupil on the horizontal plane before and after the first rotating component 230 rotates is determined;

[0417] Based on the projection displacement deviation and the distance between the projection and the eyeball center, the second compensation angle is determined, which compensates for the angle deviation of the pupil on the horizontal plane;

[0418] Based on the coordinate information of the target point and the eye coordinate information, a target azimuth angle of the simulated eyeball 100 on the horizontal plane is determined.

[0419] Based on the second compensation angle and the target azimuth angle, a second target angle is determined.

[0420] It should be noted that when the first rotating component 230 rotates the first target angle, the position of the vertical projection of the pupil movement track of the simulated eyeball 100 to the horizontal plane will have a certain displacement (i.e., projection displacement deviation), which causes the pupil to have an angle deviation of the horizontal azimuth angle. The second compensation angle is calculated to compensate for the angle deviation of the pupil on the horizontal plane caused by the rotation of the first rotating component 230 by the first target angle.

[0421] For example, as shown in FIG. 8, the circle R1 is the movement track of the pupil of the simulated eyeball 100 rotating one circle, and r is the radius of the plane on which the pupil movement track is located.

[0422] In this embodiment, the first rotating component 230 rotates the first target angle β, and the pupil moves from the K1 position to the K2 position. According to the trigonometric function relationship in the circle, the projection displacement deviation of the pupil on the horizontal plane caused by the rotation of the first rotating component 230 by the first target angle can be calculated.

[0423] As shown in FIG. 9, the circle R2 is the vertical projection of the simulated eyeball 100, which can be regarded as the projection of the cross section of the second rotating component 240. The angle deviation of the pupil from the K1 position to the K2 position is, i.e., the second compensation angle is. The distance between the projection and the eyeball center can be the distance between the actual movement track of the pupil and the eyeball center.

[0424] In this embodiment, according to the projection displacement deviation a1 and the distance h1 between the projection and the eyeball center, the included angle γ = -arctan a1 / h1 can be calculated by the trigonometric function relationship of the vertical projection, and the auxiliary dotted line can be used to calculate the second compensation angle.

[0425] The following describes a specific embodiment for calculating the second compensation angle.

[0426] As shown in FIG. 6, the axial directions of the first rotating components 230 of the two simulated eyeballs 100 form a second included angle of 90°, and the included angle between the axial direction of the first rotating component 230 and the display screen 300 in front of the simulated eyeball 100 is 45°.

[0427] The simulated eyeball 100 is offset and placed, and the included angle between the maximum cross section of the simulated eyeball 100 and the display screen 300 in front of the simulated eyeball 100 can be calculated according to the second included angle. The included angle between the auxiliary dotted line shown in FIG. 6 and the maximum cross section of the simulated eyeball 100 can be calculated according to the included angle.

[0428] Wherein, the included angle, the second compensation angle and the sum of the angles are 90 degrees, and the second compensation angle.

[0429] When the two first rotating parts 230 of the simulated eyeballs 100 form a second included angle of 90° in the axial direction, the plane perpendicular to the axial direction of the first rotating part 230 and the display screen 300 in front of the simulated eyeballs 100 form an included angle of 45°.

[0430] In this embodiment, after the first rotating part 230 rotates the first target angle Pc, the second compensation angle that the second rotating part 240 needs to compensate in the horizontal direction is

[0431] It can be understood that the two simulated eyeballs 100 are placed offset, which can leave a non-interference rotating space for the structures such as the simulated eyeballs 100 and the first rotating part 230, and when the second rotating part 240 rotates, mechanical interference of the simulated eyeballs 100 and the first rotating part 230 can be avoided, and the rotation of the two first rotating parts 230 does not affect each other.

[0432] It should be noted that after the first rotating part 230 rotates the first target angle, the included angle between the visual line exit direction of the simulated eyeball 100 and the horizontal plane reaches the target pitch angle, and after the second rotating part 240 rotates the second compensation angle for compensation, the pupil returns to the initial position of the horizontal direction, that is, the coordinates of the pupil in the vertical direction change (form the target pitch angle with the horizontal plane), but the coordinates in the horizontal direction do not change. According to the coordinate information of the initial position and the target point of the target position, the target azimuth angle can be calculated to complete the entire adjustment of the horizontal azimuth angle of the simulated eyeball 100.

[0433] It can be understood that the target azimuth angle is calculated according to the coordinate information of the pupil in the initial position and the target position of the target point, and the calculation of the target azimuth angle is irrelevant to the second compensation angle. The calculation sequence is not limited.

[0434] In this embodiment, when the simulated eyeball 100 gazes at the target point, the eyeball center, the pupil and the target point are on the same straight line (the visual line exit direction), and the target azimuth angle can be determined according to the coordinate information of the target point and the original eyeball coordinate information.

[0435] In this embodiment, the second target angle of the second rotating part 240 is equal to the sum of the second compensation angle and the target azimuth angle, that is, the second target angle. After the first rotating part 230 rotates the first target angle and the second rotating part 240 rotates the second target angle, the visual line exit direction of the pupil directly faces the target point, that is, the simulated eyeball 100 gazes at the target point.

[0436] A specific embodiment will be described below.

[0437] As shown in FIG. 10, in the case of the completion of the last single-axis / multi-axis movement of the eye tracking device, it is determined whether the pupil distance adjustment is required for the eye movement, i.e., whether the pupil distance between the two simulated eyeballs 100 is equal to 64 mm.

[0438] When the pupil distance between the two simulated eyeballs 100 is not equal to 64 mm, the third driving assembly is used to adjust the pupil distance between the two simulated eyeballs 100 to 64 mm.

[0439] According to the current position and the target position, the angle of the eye movement is calculated, wherein the target position is the position of the simulated eyeball 100 when the simulated eyeball 100 gazes at the target point on the display screen 300.

[0440] According to the eye coordinate information and the coordinate information of the target point, the angles of the horizontal and pitch rotation of the left eye and the right eye are calculated, i.e., the first target angle and the second target angle, wherein the first target angle of the first rotating part 230 of the left eye is 11.26°, the first target angle of the first rotating part 230 of the right eye is 10.19°, and the second target angle of the two second rotating parts 240 is 15.02°.

[0441] The parameters required for adjusting the driving motor of the two rotating shafts are calculated, the movement of the motor is controlled, the state parameters of the motor are obtained, and it is determined whether the overall movement of the eye is completed.

[0442] In this embodiment, the pupil distance between the two simulated eyeballs 100 is first adjusted to meet the preset condition with the target pupil distance, and then the action of the simulated eyeball 100 gazing at the target point is decomposed into the rotation of the first rotating part 230 and the second rotating part 240, and the first rotating part 230 and the second rotating part 240 are controlled to rotate, respectively, to realize the pitch angle rotation and the horizontal direction rotation, so that the simulated eyeball 100 gazes at the target point on the display screen 300, the movement of the simulated eyeball 100 is accurately simulated, and the control precision of the eye movement is high.

[0443] In some embodiments, the first rotating part 230 is driven by the first driving device, the second rotating part 240 is driven by the second driving device, and the target point has a plurality of target points; the eye movement tracking control method can further include:

[0444] After obtaining the coordinate information of the plurality of target points, the target movement type and the movement control parameters corresponding to the target movement type are determined;

[0445] According to the target movement type, the first driving device and the second driving device are controlled to drive the first rotating part 230 and the second rotating part 240, respectively, according to the movement control parameters.

[0446] In this embodiment, the plurality of coordinate information of the target point can be obtained, the movement trajectory of the target point is analyzed, and the target movement type of the target point is identified.

[0447] For example, the target point can be a point of saccadic movement type, and the target point moves line by line on the display screen 300.

[0448] For another example, the target point can be a point of fixation movement type, and the target point is fixed on the display screen 300.

[0449] For another example, the target point can be a point of jumping movement type, and the target point randomly jumps on the display screen 300.

[0450] After determining the target movement type of the target point, corresponding movement control parameters can be matched according to the target movement type of the target point, and the movement control parameters can include rotation amplitude, speed, acceleration and the like.

[0451] When the first rotating component 230 and the second rotating component 240 are controlled to rotate, movement control is performed based on the calculated first target angle and the second target angle according to the pre-set movement control parameters, so as to simulate complex continuous eye movement conforming to the movement law of the target movement type.

[0452] In this embodiment, according to a series of coordinate information of the target point, the movement type is automatically judged according to the distance and angle difference between the target points, and corresponding movement parameters are matched, and the angle is automatically calculated according to the pre-set movement control logic, so as to control the simulated eyeball 100 to perform corresponding movement.

[0453] A specific embodiment will be introduced below.

[0454] As shown in FIG. 11, movement data of the target point is output according to coordinate information of a plurality of target points.

[0455] According to the movement data, the horizontal axis displacement interval distance is calculated, and when the horizontal axis displacement interval distance is less than 0.1 mm, it is judged that the movement type of the target point is saccadic mode.

[0456] When the horizontal axis displacement interval distance is greater than or equal to 0.1 mm, the position variance of each point is calculated, and when the position variance of each point is less than 0.1 mm, it is judged that the movement type of the target point is fixation mode.

[0457] When the position variance of each point is greater than or equal to 0.1 mm, it is judged whether there is a distance greater than 1 mm between adjacent two points, and when there is a distance greater than 1 mm between adjacent two points, it is judged that the movement type of the target point is jumping mode.

[0458] After judging the movement type of the target point, corresponding movement control parameters are matched according to the movement type, the motor rotation angle and speed of the two rotating shafts are calculated, the motor movement process is started, and the simulated eyeball 100 is moved until the movement data is read.

[0459] In this embodiment, the conjugate movement of the human eye and the convergence and divergence eye movement are accurately simulated by the movement type judgment and the movement parameter matching. Not only the saccade, smooth pursuit, fixation and vestibulo-ocular reflex and other eye movement modes can be simulated, but also the convergence and divergence eye movement can be simulated, and the complex continuous eye movement can be accurately simulated.

[0460] In some embodiments, the target movement type is input by the user.

[0461] In this embodiment, the user inputs the target movement type of the target point, and the eye movement tracking device calculates the target angles of the two rotation axes according to the movement control parameters corresponding to the target movement type according to the coordinate information of the plurality of target points to perform movement control.

[0462] In actual execution, the user input corresponding to the target movement type can be a touch operation, including but not limited to a click operation, a sliding operation and a pressing operation of the eye movement tracking device or other terminal devices connected with the eye movement tracking device; or can be a physical key input or a voice input.

[0463] Of course, in other embodiments, the user input corresponding to the target movement type can also be in other forms, including but not limited to character input, etc., which can be determined according to actual needs, and the embodiments of the present application are not limited thereto.

[0464] In some embodiments, the target movement type is determined based on the coordinate information of the plurality of target points.

[0465] In this embodiment, the eye movement tracking device automatically identifies the target movement type of the target point according to the coordinate information of the plurality of target points, and finds out the movement control parameters corresponding to the target movement type, and calculates the target angles of the two rotation axes according to the movement control parameters corresponding to the target movement type to perform movement control.

[0466] In some embodiments, the coordinate information of the target point can be obtained by the following steps:

[0467] The coordinate information of the target point input by the user is obtained.

[0468] In this embodiment, the user inputs the coordinate information of one or more target points of the target point.

[0469] In actual execution, the user input corresponding to the coordinate information of the target point can be a touch operation, including but not limited to a click operation, a sliding operation and a pressing operation of the eye movement tracking device or other terminal devices connected with the eye movement tracking device; or can be a physical key input or a voice input.

[0470] Of course, in other embodiments, the user input corresponding to the coordinate information of the target point can also be in other forms, including but not limited to character input, etc., which can be determined according to actual needs, and the embodiments of the present application do not limit this.

[0471] In some embodiments, the coordinate information of the target point can be obtained by the following steps:

[0472] obtaining image information of the target point;

[0473] determining the coordinate information of the target point based on the image information of the target point.

[0474] In this embodiment, the eye tracking device can autonomously identify the coordinate information of the target point according to the image information of the target point.

[0475] In actual execution, the eye tracking device can autonomously identify the coordinate information of the target point according to the image sequence of the target point, and can also identify the target motion type of the target point motion according to the coordinate information of multiple target points.

[0476] The eye tracking control method provided by the embodiments of the present application can be executed by an eye tracking control device. In the embodiments of the present application, the eye tracking control device is taken as an example to illustrate the eye tracking control device provided by the embodiments of the present application.

[0477] The embodiments of the present application also provide an eye tracking control device.

[0478] As shown in FIG. 12, the eye tracking control device includes:

[0479] The acquisition module 1210 is configured to acquire the eye coordinate information of the two simulated eyeballs 100 and the coordinate information of the target point to be tracked, and determine the pupil distance between the two simulated eyeballs 100 according to the eye coordinate information.

[0480] The first processing module 1220 is configured to, when the pupil distance and the target pupil distance satisfy a preset condition, determine the first target angle and the second target angle at which each simulated eyeball 100 needs to rotate to track the target point based on the eye coordinate information of the two simulated eyeballs 100 and the coordinate information of the target point.

[0481] The second processing module 1230 is configured to output a target control instruction based on the first target angle and the second target angle, control the first rotating component 230 to rotate the simulated eyeball 100 by the first target angle, and control the second rotating component 240 to synchronously rotate the first rotating component 230 and the simulated eyeball 100 by the second target angle.

[0482] According to the eye movement tracking control device provided in the embodiment of the present application, the pupil distance between the two simulation eyeballs 100 is fixed, the action of the simulation eyeball 100 staring at the target point is disassembled into the rotation of the first rotating part 230 and the second rotating part 240 by acquiring the coordinate information of the target point and the coordinate information of the eyeball, and the motion control is performed, so that the simulation eyeball 100 stares at the target point, the motion control precision of the eye movement tracking is improved, and the complex eyeball movement is accurately simulated through the pitch angle rotation and the horizontal direction rotation.

[0483] In some embodiments, the second processing module 1230 is configured to determine a target pitch angle required for the simulation eyeball 100 to track the target point based on the coordinate information of the eyeball and the coordinate information of the target point.

[0484] The first target angle of the simulation eyeball 100 is determined based on the target pitch angle and the first included angle.

[0485] The second target angle is determined based on the coordinate information of the eyeball, the coordinate information of the target point and the first target angle.

[0486] In some embodiments, the second processing module 1230 is configured to determine a projection displacement deviation of the pupil on the horizontal plane before and after the rotation of the first rotating part 230 based on the first target angle and the motion trajectory of the pupil.

[0487] The second compensation angle is determined based on the projection displacement deviation and the distance between the projection and the eyeball center, and the second compensation angle compensates the angle deviation of the pupil on the horizontal plane.

[0488] The target azimuth angle of the simulation eyeball 100 on the horizontal plane is determined based on the coordinate information of the target point and the coordinate information of the eyeball.

[0489] The second target angle is determined based on the second compensation angle and the target azimuth angle.

[0490] In some embodiments, the first rotating part 230 is driven by a first driving device, the second rotating part 240 is driven by a second driving device, and the target point has a plurality of target points.

[0491] The second processing module 1230 is further configured to determine a target motion type and corresponding motion control parameters after acquiring the coordinate information of the plurality of target points.

[0492] The second processing module 1230 is further configured to control the first driving device and the second driving device to drive the first rotating part 230 and the second rotating part 240, respectively, according to the motion control parameters according to the target motion type.

[0493] In some embodiments, the motion control parameters include a rotation amplitude, a speed and an acceleration.

[0494] In some embodiments, the target motion type is input by a user, or the target motion type is determined based on coordinate information of the target points.

[0495] In some embodiments, the acquisition module 1210 is configured to acquire image information of the target points.

[0496] Based on the image information of the target points, the coordinate information of the target points is determined.

[0497] Alternatively, the coordinate information of the target points input by a user is acquired.

[0498] In some embodiments, the first processing module 1220 is further configured to adjust the pupil distance between the two simulated eyeballs 100 until the preset condition is met between the target pupil distance and the pupil distance between the two simulated eyeballs 100 when the preset condition is not met between the target pupil distance and the pupil distance between the two simulated eyeballs 100.

[0499] The eye movement tracking control apparatus in the embodiments of the present application can be an electronic device or a component in an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices other than a terminal. For example, the electronic device can be a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, a mobile Internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), and the like. The electronic device can also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine, or a self-service machine, and the like. The embodiments of the present application are not limited in this regard.

[0500] The eye movement tracking control apparatus in the embodiments of the present application can be a device with an operating system. The operating system can be an Android operating system, an IOS operating system, or other possible operating systems. The embodiments of the present application are not limited in this regard.

[0501] The eye movement tracking control apparatus provided in the embodiments of the present application can implement each process implemented by the method embodiments of FIGS. 7 to 11. To avoid repetition, details are not described herein.

[0502] The embodiments of the present application further provide a test apparatus 1400.

[0503] As shown in FIG. 14, the test device 1400 includes the eye tracking device 1402, the control device 1401, the data recording module 1403 and the result analysis module 1404.

[0504] The control device 1401 is connected with the eye tracking device 1402, and the control device 1401 is configured to control the simulation eyeball 100 to move so as to test the to-be-tested device.

[0505] The to-be-tested device can be an instrument for recording and analyzing human eye movement, and the position and duration of human eye fixation can be determined by measuring the position, speed and acceleration of the eyeball.

[0506] In this embodiment, the eye tracking device 1402 is used to replace the real human eye, and the to-be-tested device records the movement data of the simulation eyeball 100 in the eye tracking device 1402, and the sensitivity, discreteness and stability of the to-be-tested device are determined according to the movement data.

[0507] The control device 1401 can define the parameters such as the speed, acceleration, path and amplitude of the movement of the simulation eyeball 100, send instructions to each driving device of the eye tracking device 1402, control the simulation eyeball 100 to realize the actions such as the pitch angle rotation, the horizontal direction rotation, the pupil distance adjustment and the height adjustment, and accurately simulate the multi-dimensional complex movement of the human eye.

[0508] In actual execution, the control device 1401 can be connected with the motion controller of the eye tracking device 1402, the control device 1401 outputs the instruction signal to the motion controller, and the motion controller sends the instructions to the driving devices such as the first driving device and the second driving device, so as to control the simulation eyeball 100 to realize the actions such as the pitch angle rotation, the horizontal direction rotation, the pupil distance adjustment and the height adjustment.

[0509] In this embodiment, the data recording module 1403 of the test device 1400 is connected with the eye tracking device 1402, and the data recording module 1403 includes a data collector and a test device interface module.

[0510] The data collector collects the eyeball movement data of the simulation eyeball 100, and the test device interface module is connected with the to-be-tested device, and the test device interface module is configured to collect the eyeball movement data recorded by the to-be-tested device.

[0511] The data collector is configured to directly collect the movement data of the simulation eyeball 100, the test device interface module is connected with the to-be-tested device, and the movement data of the simulation eyeball 100 collected by the to-be-tested device is recorded, and the sensitivity, discreteness and stability of the to-be-tested device are tested through the two movement data.

[0512] The result analysis module 1404 is connected with the data collector and the test equipment interface module respectively, and is used for testing the accuracy of the to-be-tested equipment based on the eye movement data of the simulation eyeball 100 and the eye movement data recorded by the to-be-tested equipment.

[0513] The testing of the accuracy of the to-be-tested equipment refers to testing the precision and accuracy of the eye movement tracking of the to-be-tested equipment.

[0514] In some embodiments, the control equipment 1401 comprises a parameter definition module and a motion control module.

[0515] The parameter definition module is connected with the motion control module, and the parameter definition module is used for inputting the eye movement parameters of the simulation eyeball 100 to determine the eye movement data of the simulation eyeball 100.

[0516] The motion control module is connected with the parameter definition module and the eye movement tracking equipment 1402 respectively, and the motion control module is used for outputting the eye movement parameters to the eye movement tracking equipment 1402 to control the movement of the simulation eyeball 100.

[0517] In this embodiment, the user inputs different eye movement parameters in the parameter definition module to control the simulation eyeball 100 to move.

[0518] In some embodiments, the eye movement data of the simulation eyeball 100 is analyzed by the control equipment 1401 according to the target point to be tracked and the position information of the simulation eyeball 100.

[0519] In this embodiment, the control equipment 1401 can control the simulation eyeball 100 to track the target point autonomously without manually inputting the related parameters of the target point.

[0520] The testing process of the testing device 1400 will be introduced in detail below.

[0521] Step one, define the test parameters.

[0522] Before testing, the type and parameters of the eye rotation are defined in the parameter definition module of the control equipment 1401, including a series of parameters such as the starting angle, the ending angle, the movement speed, the acceleration, the acceleration time, the deceleration, the deceleration time, and the movement trajectory, which are used for subsequent motion control and data recording of the eye movement tracking equipment 1402.

[0523] Step two, motion control.

[0524] The motion control module of the control equipment 1401 controls the driving device of the eye movement tracking equipment 1402 to realize the control and recording of the eye movement of the eye movement tracking equipment 1402.

[0525] Step three, data recording.

[0526] The data collector (data collector unit) of the data recording module 1403 directly records parameters such as the eye movement trajectory, speed and acceleration of the simulated eyeball 100, and the test equipment interface module (test equipment interface unit) records the movement data of the simulated eyeball 100 collected by the to-be-tested equipment, for subsequent data analysis and result comparison.

[0527] Step four, test result analysis.

[0528] The actual movement parameters of the eye movement tracking device 1402 and the movement parameters collected by the to-be-tested equipment are compared and analyzed to evaluate a series of parameters such as the accuracy, precision and dispersion of the to-be-tested equipment.

[0529] Compared with the traditional test method (real eye test), the test device 1400 of the embodiment of the application can measure multiple parameters such as the rotation, speed and acceleration of the eye in different directions, can more comprehensively test the to-be-tested equipment, the simulated eyeball 100 of the eye movement tracking device 1402 rotates more accurately and has higher stability, the control device 1401 can realize accurate and reliable data recording and analysis, the test process is automated, the test efficiency is improved, and the accuracy is higher.

[0530] According to the test device 1400 provided in the embodiment of the application, the to-be-tested equipment is tested by the eye movement tracking device 1402, the eye movement tracking device 1402 can accurately simulate the complex movement of the human eye in multiple dimensions, and the accuracy of the eye movement test is improved.

[0531] In some embodiments, as shown in FIG. 13, the embodiment of the application further provides an electronic device 1300, which includes a processor 1301, a memory 1302, and a computer program stored in the memory 1302 and executable on the processor 1301. The program is executed by the processor 1301 to implement each process of the above-mentioned test method embodiment and achieve the same technical effect. To avoid repetition, details are not repeated here.

[0532] It should be noted that the electronic device in the embodiment of the application includes the mobile electronic device and the non-mobile electronic device described above.

[0533] The embodiment of the application further provides a non-transitory computer readable storage medium, which stores a computer program. The computer program is executed by a processor to implement each process of the above-mentioned test method embodiment and achieve the same technical effect. To avoid repetition, details are not repeated here.

[0534] The processor is a processor in the electronic device in the above embodiments. The readable storage medium includes a computer readable storage medium, such as a computer readable only memory (ROM), a random access memory (RAM), a magnetic disc, or an optical disc, etc.

[0535] The application also provides a computer program product, including a computer program, which is executed by a processor to implement the above test method.

[0536] The processor is a processor in the electronic device in the above embodiments. The readable storage medium includes a computer readable storage medium, such as a computer readable only memory (ROM), a random access memory (RAM), a magnetic disc, or an optical disc, etc.

[0537] It should be noted that, in this document, the terms "comprising", "including", or any other variant thereof are intended to cover non-exclusive inclusions, so that a process, method, article, or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed, or further includes elements inherent to such a process, method, article, or device. Without more limitations, the element defined by the statement "including a" does not exclude the presence of another identical element in the process, method, article, or device including the element.

[0538] In addition, it should be noted that the scope of the method and device in the application is not limited to performing functions in the order shown or discussed, but can also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method can be performed in an order different from the described order, and various steps can also be added, omitted, or combined. In addition, the features described with reference to certain examples can be combined in other examples.

[0539] In the description of the application, it should be understood that the orientations or positional relationships indicated by the terms "center", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "inner", "outer", "clockwise", "counterclockwise", "axial", etc. are based on the orientations or positional relationships shown in the drawings, and are only for the convenience of describing the application and simplifying the description, and do not indicate or imply that the devices or elements referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore cannot be understood as a limitation on the application.

[0540] In the description of the application, reference has been made to descriptive terms such as "one embodiment", "some embodiments", "an embodiment", "example", "specific example" or "some examples" etc. It is emphasized that each of these terms refers to a specific feature, structure, material or characteristic described in connection with a particular embodiment or example. The descriptive terms are not necessarily referring to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics can be combined in any suitable manner in one or more embodiments or examples.

[0541] While embodiments of the application have been shown and described, it is to be understood that the application is not limited to the details of the embodiments described, since the scope of the application is defined with respect to the appended claims.

Claims

1. A switchable test apparatus, characterized by A switchable test device for testing a device under test, the switchable test device comprising an artificial eyeball, a motion controller, a first driving assembly, a second driving assembly, and at least one test device mounted on the artificial eyeball; the motion controller is connected with the first motion driving assembly and the second driving assembly, and the first motion driving assembly and the second driving assembly are connected with the artificial eyeball; the motion controller is configured to control the first motion driving assembly and the second driving assembly to drive the artificial eyeball and the test device to rotate synchronously until a target test device switches to a test position according to a test requirement; wherein the target test device is one of the at least one test device.

2. The switchable test apparatus of claim 1, wherein, The at least one test device comprises at least one of a first camera, a second camera, a high-frequency luminance meter, and a near-infrared radiation illuminometer.

3. The switchable test apparatus of claim 2, wherein, A field of view angle range of the first camera is different from a field of view angle range of the second camera.

4. The switchable test apparatus of claim 3, wherein, The field of view angle range of the first camera is 0°-30°, and the field of view angle range of the second camera is 0°-120°.

5. The switchable test apparatus of claim 2, wherein, The target test device is the first camera, and the switchable test device is configured to test at least one of a definition, an angular resolution, a user eye movable range, a pupil distance, a vergence conflict, and a binocular image combining accuracy of the device under test. The target test device is the second camera, and the switchable test device is configured to test at least one of a distortion, a chromatic aberration, a luminance / color uniformity, a ghost image, a contrast, and a large field of view binocular image combining accuracy of a full field of view of the device under test. The target test device is the high-frequency luminance meter, and the switchable test device is configured to test a binocular Photo-to-photo delay of the device under test. The target test device is the near-infrared radiation illuminometer, and the switchable test device is configured to test an illuminance of a near-infrared light source on a cornea of the device under test.

6. The switchable test apparatus of claim 2, wherein, The switchable test device comprises two artificial eyeballs, two first driving assemblies, and two second driving assemblies, each of the artificial eyeballs is connected with a corresponding first motion driving assembly and a corresponding second driving assembly, and each of the artificial eyeballs is mounted with at least one test device. The motion controller is configured to control the first motion driving assembly and the second driving assembly to drive the corresponding artificial eyeball and the corresponding test device to rotate synchronously until the corresponding target test device switches to a test position.

7. The switchable test apparatus of claim 6, wherein, The target test devices on the two artificial eyeballs are both the first cameras. The switchable test device is configured to test at least one of a definition, a pupil distance, a user eye movable range, a binocular image combining, and a vergence conflict of the device under test.

8. The switchable test apparatus of claim 6, wherein, The target test devices on the two artificial eyeballs are the first camera and the second camera, respectively. The switchable test device is used for testing dynamic distortion of the device under test; or, the first camera is used for testing at least one of clarity, angular resolution, and user eye movable range of the device under test, and the second camera is used for testing at least one of color difference, brightness / color uniformity, contrast, and ghost image of the full field of view of the device under test.

9. The switchable test apparatus of claim 6, wherein, The target test devices on the two simulated eyeballs are the high-frequency luminance meter and the second camera respectively; The switchable test device is used for testing ghost image of the device under test.

10. The switchable test apparatus of claim 6, wherein, The target test devices on the two simulated eyeballs are the high-frequency luminance meter respectively; The switchable test device is used for testing binocular Photo-to-photo delay or binocular refresh rate consistency of the device under test.

11. The switchable test apparatus of claim 6, wherein, The target test devices on the two simulated eyeballs are the near-infrared radiation illuminometer respectively; The switchable test device is used for testing damage of an infrared light source to a human eye.

12. The switchable test device according to any one of claims 1 to 11, characterized in that The first driving assembly comprises a first driving device and a first rotating part; the first driving device is connected with the motion controller; the first driving device and the first rotating part are drivingly connected; the first rotating part is connected with the simulated eyeball; the first rotating part is used to drive the simulated eyeball to move around the axis of the first rotating part, so as to adjust the pitch angle of the simulated eyeball. The second driving assembly comprises a second driving device and a second rotating part; the second driving device is connected with the motion controller; the second driving device and the second rotating part are drivingly connected; the second rotating part is connected with the simulated eyeball and the first rotating part; the second rotating part is used to drive the simulated eyeball and the first rotating part to move around the axis of the second rotating part, so as to adjust the horizontal azimuth angle of the simulated eyeball.

13. The switchable test apparatus of claim 12, wherein, The rotation axes of the first rotating part and the second rotating part are not parallel and are located on two non-parallel planes, so as to ensure that the first rotating part and the second rotating part rotate according to the test requirement, drive the simulated eyeball to rotate, and switch the test device on the simulated eyeball to the test position.

14. The switchable test apparatus of claim 12, wherein, The line connecting the pupil and the eyeball center of the simulated eyeball forms a first included angle with the rotation axis of the first rotating part.

15. The switchable test apparatus of claim 12, wherein, The maximum rotation angle of the second rotating part is determined based on the pupil distance of the two simulated eyeballs.

16. The switchable test apparatus of claim 12, wherein, The maximum rotation angle of the first rotating part is 360 degrees, and the maximum rotation angle of the second rotating part is less than 360 degrees.

17. The switchable test apparatus of claim 12, wherein, The switchable test device further comprises a third driving assembly and two eyeball pedestals corresponding to the two simulated eyeballs; The first rotating part is connected with the corresponding simulated eyeball through the corresponding eyeball pedestal; the second rotating part is connected with the corresponding first rotating part and the corresponding simulated eyeball through the corresponding eyeball pedestal and drives the two to rotate synchronously; The third driving assembly is connected with the two eyeball pedestals respectively. The third driving assembly is configured to drive the two eye bases to move towards or away from each other under the control of the motion controller, so as to adjust the distance between the two simulated eyeballs.

18. The switchable test apparatus of claim 17, wherein, The switchable test device further comprises a fourth driving assembly connected with the two eye bases, and the fourth driving assembly is further connected with the motion controller. The fourth driving assembly is configured to drive the eye bases to move along the axial direction of the second rotating component under the control of the motion controller, so as to adjust the height of the simulated eyeballs.

19. The switchable test device according to any one of claims 1-18, wherein, The motion controller is further configured to control the first driving assembly and the second driving assembly to drive the simulated eyeballs to rotate according to different test requirements, so as to switch the target test device on the simulated eyeballs.

20. A test method, characterized by, A test method for testing a device under test, the test method comprising: determining a target test device in response to a test requirement; controlling a first driving assembly and a second driving assembly to move, so as to drive the simulated eyeballs and the test device to rotate synchronously until the target test device is switched to a test position; controlling the target test device to test the device under test at the test position; wherein the simulated eyeballs are provided with at least one test device, and the target test device is one of the at least one test device.

21. The method of claim 20, wherein, After the step of controlling the target test device to test the device under test at the test position, the method further comprises: obtaining test information of the target test device, and determining a test result of the test requirement for the device under test according to the test information.

22. The test method of claim 20, wherein, The test requirement comprises at least one of testing clarity, angular resolution, user eye movable range, interpupillary distance, vergence conflict, binocular image accuracy, distortion of full field of view, chromatic aberration, brightness / color uniformity, ghost image, contrast, large field of view binocular image, binocular Photo-to-photo delay, binocular refresh rate consistency, illuminance of near-infrared light source on cornea, and damage of infrared light source to human eye. The test device comprises at least one of a first camera, a second camera, a high-frequency brightness meter, and a near-infrared radiation illuminometer; wherein the field of view angle range of the first camera is different from the field of view angle range of the second camera.

23. The test method of claim 22, wherein, The number of the simulated eyeballs is one, and according to the test requirement, the step of determining a target test device comprises: when the test requirement is at least one of testing clarity, angular resolution, user eye movable range, interpupillary distance, vergence conflict, and binocular image accuracy of the device under test, the target test device is determined to be the first camera; when the test requirement is at least one of testing distortion of full field of view, chromatic aberration, brightness / color uniformity, ghost image, contrast, and large field of view binocular image of the device under test, the target test device is determined to be the second camera; when the test requirement is testing binocular Photo-to-photo delay of the device under test, the target test device is determined to be the high-frequency brightness meter; when the test requirement is testing illuminance of near-infrared light source on cornea of the device under test, the target test device is determined to be the near-infrared radiation illuminometer.

24. The test method of claim 22, wherein, The number of the simulation eyeballs is two, and the test device is installed on each of the simulation eyeballs, and the target test device is determined according to the test requirement, and the target test device on the two simulation eyeballs is determined as the first camera when the test requirement is at least one of the definition, the interpupillary distance, the movable range of the user's eye, the binocular image, and the vergence conflict of the to-be-tested equipment; The test requirement is to test the dynamic distortion of the to-be-tested equipment, or the test requirement is to test at least one of the definition, the angular resolution, and the movable range of the user's eye of the to-be-tested equipment at the same time, and at least one of the chromatic aberration, the uniformity of the brightness / color, the contrast, and the ghost image of the full field of view of the to-be-tested equipment, and the target test device on the two simulation eyeballs is determined as the first camera and the second camera respectively; The test requirement is to test the ghost image of the to-be-tested equipment, and the target test device on the two simulation eyeballs is determined as the high-frequency luminance meter and the second camera respectively; the test requirement is to test the binocular Photo-to-photo delay or the binocular refresh rate consistency of the to-be-tested equipment, and the target test device on the two simulation eyeballs is determined as the high-frequency luminance meter; The test requirement is to test the damage of the infrared light source to the human eye of the to-be-tested equipment, and the target test device on the two simulation eyeballs is determined as the near-infrared radiation illuminometer. The test requirement is to test the interpupillary distance of the to-be-tested equipment, and the target test device on the two simulation eyeballs is determined as the first camera; wherein the field of view angle range of the first camera is 0-30°; 25. The test method of claim 24, wherein, The control of the target test device in the test position for testing the to-be-tested equipment includes: The positions of the two simulation eyeballs are respectively rotated and adjusted to make the optical axes of the first cameras on the two simulation eyeballs parallel; The distances from the entrance pupils of the first cameras on the two simulation eyeballs to the corresponding visual devices in the to-be-tested equipment are determined to be the same; The positions of the two simulation eyeballs are translationally adjusted to make the MTF centers of the first cameras on the two simulation eyeballs and the corresponding visual devices aligned; The interpupillary distance between the two simulation eyeballs is obtained, and the interpupillary distance is taken as the interpupillary distance of the to-be-tested equipment. The test requirement is to test the movable range of the user's eye of the to-be-tested equipment, and the target test device on the two simulation eyeballs is determined as the first camera; wherein the field of view angle range of the first camera is 0-30°; 26. The test method of claim 24, wherein, The control of the target test device in the test position for testing the to-be-tested equipment includes: The two simulation eyeballs are controlled to rotate to a plurality of field of view angles of the to-be-tested equipment; wherein each field of view angle has a corresponding azimuth angle; In each set of the field of view angle and the azimuth angle, the focusing operation is performed on the two first cameras to ensure that the images in the two first cameras are clear; In each set of the field of view angle and the azimuth angle, the focusing operation is performed on the two first cameras to ensure that the images in the two first cameras are clear; In each of the field of view and the azimuth angle, the two simulated eyeballs are controlled to translate along a direction corresponding to the azimuth angle, and in the process of translation, the MTF of the corresponding visual device in the to-be-tested device is tested by using the first camera; When the MTF of the visual device meets a preset threshold, the two simulated eyeballs are controlled to stop translation, the translation amounts of the two simulated eyeballs are recorded respectively, and the two simulated eyeballs are controlled to move along a direction close to or away from the to-be-tested device to test a three-dimensional area of a movable range of a user's eye of the to-be-tested device, and the movable range of the user's eye of the to-be-tested device corresponding to each field of view is obtained.

27. The test method of claim 24, wherein, The test requirement is to test the resolution of the to-be-tested device, and the target testing device on the two simulated eyeballs is the first camera; wherein the field of view angle range of the first camera is 0-30°. The control of the target testing device in the test position to test the to-be-tested device comprises: The two simulated eyeballs are controlled to rotate, so that the simulated eyeballs rotate to a plurality of field of views of the to-be-tested device; wherein each field of view has a corresponding azimuth angle; In each of the field of view and the azimuth angle, the two first cameras are focused to ensure that the images in the two first cameras are clear; In each of the field of view and the azimuth angle, the MTF of the corresponding visual device in the to-be-tested device is tested by using the first camera; According to the MTF of the visual device, the resolution of the to-be-tested device is determined.

28. The test method of claim 24, wherein, The test requirement is to test the binocular image fusion of the to-be-tested device, and the target testing device on the two simulated eyeballs is the first camera; wherein the field of view angle range of the first camera is 0-30°. The control of the target testing device in the test position to test the to-be-tested device comprises: The two simulated eyeballs are controlled to rotate, so that the simulated eyeballs rotate to a plurality of field of views of the to-be-tested device; wherein each field of view has a corresponding azimuth angle; In each of the field of view and the azimuth angle, the first angle β_left and the second angle β_right of the two simulated eyeballs rotating along the vertical direction are recorded; According to the first angle β_left and the second angle β_right, the binocular image fusion precision β_left-β_right under the field of view and the azimuth angle is calculated.

29. The test method of claim 24, wherein, The test requirement is to test the vergence conflict of the to-be-tested device, and the target testing device on the two simulated eyeballs is the first camera; wherein the field of view angle range of the first camera is 0-30°. The control of the target testing device in the test position to test the to-be-tested device comprises: The two simulated eyeballs are controlled to rotate, so that the simulated eyeballs rotate to a plurality of field of views of the to-be-tested device; wherein each field of view has a corresponding azimuth angle; In each group of the field of view angle and the azimuth angle, record two third angles α_left and fourth angles α_right of the two simulated eyeballs rotating in the horizontal direction, a pupil distance i, and two first virtual image distances VID_left and VID_right obtained by testing the two first cameras; Calculate a combined image distance D of the two first cameras according to the third angle α_left, the fourth angle α_right and the pupil distance i; Calculate a vergence conflict corresponding to each field of view angle according to the combined image distance D and an average value of the first virtual image distance VID_left and the second virtual image distance VID_right.

30. The test method of claim 24, wherein, The test requirement is to test dynamic distortion of the to-be-tested device, and target testing devices on the two simulated eyeballs are the first camera and the second camera respectively; wherein, a field of view angle range of the first camera is 0-30°, and a field of view angle of the second camera is 0-120°; The control of the target testing devices to test the to-be-tested device at the test position comprises: Controlling the first camera and the second camera to be aligned with left and right target optical axes of the to-be-tested device respectively; In a static state, acquiring a first static distortion of each position in a global picture by using the second camera; According to image acquired by the second camera, calculating position information of a target point in the acquired image relative to the first camera; According to the position information, determining a rotation angle of the first camera; According to the rotation angle, controlling a simulated eyeball on which the first camera is located to rotate, and adjusting a rotation axis of the simulated eyeball, so that the first camera is aligned with different target points, and acquiring a second dynamic distortion corresponding to each target point by using the first camera; According to the first static distortion and the second dynamic distortion corresponding to each target point, determining the dynamic distortion of the to-be-tested device.

31. The test method of claim 24, wherein, The test requirement is to test color and brightness of a ghost image of the to-be-tested device, and target testing devices on the two simulated eyeballs are the second camera and the high-frequency brightness meter respectively; wherein, a field of view angle of the second camera is 0-120°; The control of the target testing devices to test the to-be-tested device at the test position comprises: Controlling the second camera to acquire a global picture and identify a position of the ghost image, and taking the position of the ghost image as a target point; According to position information of the target point, controlling a simulated eyeball on which the high-frequency brightness meter is located to rotate, so that the high-frequency brightness meter is aligned with the target point; Testing color and brightness of the ghost image by using the high-frequency brightness meter, and taking test results as color and brightness of the ghost image of the to-be-tested device.

32. The test method of claim 24, wherein, The test requirement is to test damage of an infrared light source of the to-be-tested device to human eyes, and target testing devices on the two simulated eyeballs are near-infrared radiation illuminometers respectively; The control of the target testing devices to test the to-be-tested device at the test position comprises: Controlling the two simulated eyeballs to rotate, so that each simulated eyeball traverses all field of view angles corresponding to the to-be-tested device; The illuminance of the infrared light source of the device under test is tested in real time by a near-infrared radiation illuminometer installed on each of the simulated eyeballs; According to the illuminance of the infrared light source of the device under test and a preset illuminance threshold, the damage of the infrared light source of the device under test to the human eye is determined.

33. The test method according to any one of claims 20-32, wherein, The test method further comprises: In response to different test requirements, the first driving assembly and the second driving assembly are controlled to drive the simulated eyeballs to rotate, so as to switch the target test device located at the test position.

34. An electronic device, comprising: A computer program product comprising a processor, a memory, and a computer program stored on the memory and executable on the processor, wherein the program, when executed by the processor, implements the test method of any one of claims 20-33.

35. A non-transitory computer-readable storage medium, comprising: A non-transitory computer readable storage medium having stored thereon a computer program, wherein the program, when executed by a processor, implements the test method of any one of claims 20-33.

36. A computer program product, characterised in that, A computer program product, wherein the program, when executed by a processor, implements the test method of any one of claims 20-33.

Citation Information

Patent Citations

  • Testing method and testing device for near-to-eye display equipment and storage medium

    CN113252309A

  • Eyeball camera system and method for display system calibration

    CN114128256A

  • Simulation eyeball applied to human body interaction equipment test

    CN117348735A

  • Eye movement tracking equipment and testing device

    CN117991502A

  • Eye movement tracking control method and device, electronic equipment and storage medium

    CN118034488A