Switchable test device and method, electronic device, storage medium and program product

Abstract

The invention provides switchable test equipment, a switchable test method, electronic equipment, a storage medium and a program product, and belongs to the technical field of visual equipment. The switchable test equipment comprises a simulated eyeball, a motion controller, a first driving assembly, a second driving assembly and at least one test device installed on the simulated eyeball. The motion controller is connected with the first motion driving assembly and the second driving assembly, and the first motion driving assembly and the second driving assembly are connected with the simulated eyeball; the motion controller is used for controlling the first motion driving assembly and the second driving assembly according to test requirements so as to drive the simulated eyeball and the test device to rotate synchronously until the target test device is switched to a test position; wherein the target test device is one of the at least one test device. According to the technical scheme, the test device can be rotated to the test position under the condition that eyeball rotation is simulated, and integration of test functions on one device is achieved.

Description

[0001] This application claims the priority of the Chinese patent application filed with the China Patent Office on June 5, 2024, with application number 202410726913.5 and application name “An eye tracking device and testing device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application belongs to the technical field of visual equipment, and in particular, relates to a switchable test equipment, method, electronic equipment, storage medium and program product. Background Art

[0003] During the near-eye display test, when testing different items, the headset (head-mounted display) needs to switch between a large field of view camera and a small field of view camera, which requires secondary alignment and is inefficient.

[0004] For example, a large FOV (field of view) camera is needed to test the brightness and color uniformity and distortion of the entire field of view. The test speed is fast and the efficiency is high. However, for MTF (sharpness) testing, a large FOV camera cannot meet the needs. At this time, a high PPD, small FOV camera (rotatable) is needed to test and simulate the results observed in the fovea of ​​the human eye.

[0005] Moreover, the existing testing process can only test the monocular characteristics of the headset, and cannot simulate eye movement to test the binocular characteristics of the headset at the same time, nor can it combine eye tracking to test the effect of dynamic gaze point rendering. Summary of the invention

[0006] The present application aims to solve at least one of the technical problems existing in the prior art. To this end, the present application proposes a switchable test device, which can rotate the test device to a test position under the condition of simulating eyeball rotation, so as to realize the integration of test functions on one device.

[0007] Another purpose of the present application is to simultaneously test the binocular characteristics of the head display while simulating eye movement, accurately simulate the phenomena observed during binocular movement, and improve test efficiency and accuracy.

[0008] In a first aspect, the present application provides a switchable test device, including: for testing a device to be tested, the switchable test device includes a simulated eyeball, a motion controller, a first drive component, a second drive component, and at least one test device installed on the simulated eyeball.

[0009] The motion controller is connected to the first motion drive component and the second drive component, and the first motion drive component and the second drive component are connected to the simulated eyeball.

[0010] The motion controller is used to control the first motion drive component and the second drive component according to the test requirements to drive the simulated eyeball and the test device to rotate synchronously until the target test device is switched to the test position.

[0011] The target test device is one of the at least one test device.

[0012] In an optional embodiment, at least one test device includes at least one of a first camera, a second camera, a high-frequency luminance meter, and a near-infrared radiation illuminance meter.

[0013] In an optional implementation, the field of view angle range of the first camera is different from the field of view angle range of the second camera.

[0014] In an optional implementation, the field of view angle of the first camera ranges from 0° to 30°, and the field of view angle of the second camera ranges from 0° to 120°.

[0015] In an optional embodiment, the target test device is a first camera, and the switchable test device is used to test at least one of the clarity, angular resolution, eyebox, pupil distance, convergence conflict, and binocular combination accuracy of the device under test.

[0016] And / or, the target test device is a second camera, and the switchable test device is used to test at least one of the distortion, chromatic aberration, brightness / color uniformity, ghost image, contrast and large field binocular imaging of the full field of view of the device under test.

[0017] And / or, the target test device is a high-frequency luminance meter, and the switchable test device is used to test the binocular photo-to-photo delay of the device under test.

[0018] And / or, the target test device is a near-infrared radiation illuminometer, and the switchable test device is used to test the illuminance of the near-infrared light source of the device to be tested on the cornea.

[0019] In an optional embodiment, the switchable test device includes two simulated eyeballs, two first drive components and two second drive components, each simulated eyeball is connected to a corresponding first motion drive component and a corresponding second drive component, and each simulated eyeball is equipped with at least one test device.

[0020] The motion controller is used to control the first motion drive component and the second drive component to drive the corresponding simulated eyeball and the corresponding test device to rotate synchronously until the corresponding target test device is switched to the test position.

[0021] In an optional embodiment, the two target test devices on the simulated eyeballs are both first cameras.

[0022] The switchable test device is used to test at least one of the clarity, pupil distance, user eye movable range, binocular image formation, and convergence conflict of the device under test.

[0023] In an optional embodiment, the two target test devices simulating the eyeball are respectively a first camera and a second camera.

[0024] The switchable test device is used to test the dynamic distortion of the device under test; or, the first camera is used to test at least one of the clarity, angular resolution, and eyebox of the device under test, while the second camera is used to test at least one of the chromatic aberration, brightness / color uniformity, contrast, and ghost images of the full field of view of the device under test.

[0025] In an optional embodiment, the two target test devices simulating the eyeball are a high-frequency luminance meter and a second camera.

[0026] Switchable test equipment is used to test ghost images of the device under test.

[0027] In an optional embodiment, the two target test devices on the simulated eyeballs are both high-frequency luminance meters.

[0028] The switchable test device is used to test the binocular photo-to-photo delay or binocular refresh rate consistency of the device under test.

[0029] In an optional embodiment, the two target test devices on the simulated eyeballs are both near-infrared radiation illuminance meters.

[0030] The switchable test equipment is used to test the damage of the infrared light source of the device under test to the human eye.

[0031] In an optional embodiment, the first drive assembly includes a first drive device and a first rotating component; the first drive device is connected to the motion controller, the first drive device and the first rotating component are drivingly connected, and the first rotating component is connected to the simulated eyeball, wherein the first rotating component is used to drive the simulated eyeball to move axially around the first rotating component to adjust the pitch angle of the simulated eyeball.

[0032] The second driving assembly includes a second driving device and a second rotating component, the second driving device is connected to the motion controller, the second driving device and the second rotating component are drivingly connected, the second rotating component is connected to the simulated eyeball and the first rotating component, wherein the second rotating component is used to drive the simulated eyeball and the first rotating component to move axially around the second rotating component to adjust the horizontal azimuth angle of the simulated eyeball.

[0033] In one possible implementation, the rotation axis of the first rotating component is not parallel to the rotation axis of the second rotating component and the two rotation axes are located on two non-parallel planes, so as to ensure that the first rotating component and the second rotating component rotate in coordination according to the test requirements to drive the simulated eyeball to rotate, so that the test device on the simulated eyeball switches to the test position.

[0034] In an optional embodiment, a line connecting the pupil of the simulated eyeball and the center of the eyeball forms a first angle with the rotation axis of the first rotating component.

[0035] In an optional embodiment, the maximum rotation angle of the second rotating component is determined based on the pupil distance of the two simulated eyeballs.

[0036] In an optional embodiment, the maximum rotation angle of the first rotating component is 360 degrees, and the maximum rotation angle of the second rotating component is less than 360 degrees.

[0037] In an optional embodiment, the switchable testing device further includes a third driving assembly and two eyeball bases arranged corresponding to the two simulated eyeballs.

[0038] The first rotating component is connected to the corresponding simulated eyeball through the corresponding eyeball base, and the second rotating component is connected to the corresponding first rotating component and the corresponding simulated eyeball through the corresponding eyeball base and drives the two to rotate synchronously.

[0039] The third driving assembly is connected to the two eyeball bases respectively.

[0040] The third driving component is used to drive the two eyeball bases to move towards or in opposite directions under the control of the motion controller to adjust the distance between the two simulated eyeballs.

[0041] In an optional embodiment, the switchable testing device further comprises a fourth driving assembly connected to the two eyeball bases, and the fourth driving assembly is further connected to the motion controller.

[0042] The fourth driving component is used to drive the eyeball base to move along the axial direction of the second rotating component to adjust the height of the simulated eyeball under the control of the motion controller.

[0043] In an optional embodiment, the motion controller is also used to control the first drive component and the second drive component to drive the simulated eyeball to rotate according to different test requirements, so as to switch the target test device on the simulated eyeball.

[0044] In a second aspect, the present application further provides a testing method for testing a device to be tested, the testing method comprising:

[0045] In response to the test requirements, determining a target test device;

[0046] Controlling the movement of the first driving assembly and the second driving assembly to drive the simulated eyeball and the test device to rotate synchronously until the target test device is switched to the test position;

[0047] Controlling the target test device to test the device under test at the test position;

[0048] Wherein, at least one test device is installed on the simulated eyeball, and the target test device is one of the at least one test device.

[0049] In a possible implementation, after controlling the target test device to test the device under test at the test position, the method further includes:

[0050] The test information of the target test device is obtained, and the test result for the test requirement of the device under test is determined according to the test information.

[0051] In an optional embodiment, the test requirements include testing at least one of clarity, angular resolution, user eye movable range, pupil distance, convergence conflict, binocular image accuracy, full field distortion, chromatic aberration, brightness / color uniformity, ghost image, contrast, large field binocular image, binocular photo-to-photo delay, binocular refresh rate consistency, illumination of near-infrared light source on cornea, and damage of infrared light source to human eyes;

[0052] The test device includes at least one of a first camera, a second camera, a high-frequency luminance meter, and a near-infrared radiation illuminance meter; wherein the field of view angle range of the first camera is different from the field of view angle range of the second camera.

[0053] In an optional implementation manner, the number of simulated eyeballs is one, and according to the test requirements, determining the target test device includes:

[0054] The test requirement is to test at least one of the clarity, angular resolution, user eye movable range, pupil distance, convergence conflict, and binocular image accuracy of the device under test, and determine that the target test device is the first camera;

[0055] The test requirement is to test at least one of distortion, chromatic aberration, brightness / color uniformity, ghost image, contrast and large field binocular image of the full field of view of the device under test, and determine that the target test device is the second camera;

[0056] The test requirement is to test the binocular photo-to-photo delay of the device under test, and the target test device is determined to be a high-frequency brightness meter;

[0057] The test requirement is to test the illumination of the near-infrared light source of the device under test on the cornea, and determine that the target test device is a near-infrared radiation illuminometer.

[0058] In an optional implementation, the number of simulated eyeballs is two, each simulated eyeball is equipped with a test device, and according to the test requirements, determining the target test device includes:

[0059] The test requirement is to test at least one of the clarity, pupil distance, movable range of the user's eyes, binocular image formation, and convergence conflict of the device under test, and to determine that both target test devices on the two simulated eyeballs are the first camera;

[0060] The test requirement is to test the dynamic distortion of the device under test, or the test requirement is to test at least one of the clarity, angular resolution, and movable range of the user's eyes of the device under test, and at the same time test at least one of the chromatic aberration, brightness / color uniformity, contrast, and ghost images of the full field of view of the device under test, and determine that the target test devices on the two simulated eyeballs are the first camera and the second camera respectively;

[0061] The test requirement is to test the ghost image of the device under test, and determine that the target test devices on the two simulated eyeballs are a high-frequency brightness meter and a second camera;

[0062] The test requirement is to test the binocular photo-to-photo delay or binocular refresh rate consistency of the device under test, and to ensure that the target test devices on the two simulated eyeballs are both high-frequency brightness meters;

[0063] The test requirement is to test the damage of the infrared light source of the device under test to the human eye, and to determine that the target test devices on the two simulated eyeballs are both near-infrared radiation illuminance meters.

[0064] In an optional implementation, the test requirement is to test the pupil distance of the device under test, and the target test devices on the two simulated eyeballs are both first cameras; wherein the field of view angle range of the first camera is 0 to 30°;

[0065] Controlling the target test device to test the device under test at the test location includes:

[0066] Rotate and adjust the positions of the two simulated eyeballs respectively so that the optical axes of the first cameras on the two simulated eyeballs are parallel;

[0067] Determine that the entrance pupils of the first cameras on the two simulated eyeballs are at the same distance from the corresponding visual device in the device under test;

[0068] Adjusting the positions of the two simulated eyeballs by translation so that the first cameras on the two simulated eyeballs are aligned with the MTF centers of the corresponding visual devices;

[0069] The pupil distance between the two simulated eyeballs is obtained, and the pupil distance is used as the pupil distance of the device under test.

[0070] In an optional implementation, the test requirement is to test the movable range of the eyes of the user of the device under test, and the target test devices on the two simulated eyeballs are both first cameras; wherein the field of view angle range of the first camera is 0 to 30°;

[0071] The controlling the target test device to test the device under test at the test position comprises:

[0072] Controlling the two simulated eyeballs to rotate so that the simulated eyeballs rotate to multiple viewing angles of the device under test; wherein each viewing angle has a corresponding azimuth angle;

[0073] In each set of field of view angles and azimuth angles, focusing operations are performed on the two first cameras to ensure that images in the two first cameras are clear;

[0074] In each set of field angles and azimuth angles, two simulated eyeballs are controlled to translate along the direction of the corresponding azimuth angle, and during the translation process, the MTF of the corresponding visual device in the device under test is tested using the first camera;

[0075] When the MTF of the visual device meets the preset threshold, the two simulated eyeballs are controlled to stop translating, the translation amounts of the two simulated eyeballs are recorded respectively, and the two simulated eyeballs are controlled to move in a direction close to or away from the device under test to test the three-dimensional area of ​​the movable range of the user's eyes of the device under test, and the movable range of the user's eyes of the device under test corresponding to each field of view angle is obtained.

[0076] In an optional implementation, the test requirement is to test the clarity of the device under test, and the target test devices on the two simulated eyeballs are both first cameras; wherein the field of view angle range of the first camera is 0 to 30°;

[0077] Controlling the target test device to test the device under test at the test location includes:

[0078] Controlling the two simulated eyeballs to rotate so that the simulated eyeballs rotate to multiple viewing angles of the device under test; wherein each viewing angle has a corresponding azimuth angle;

[0079] In each set of the field of view angle and the azimuth angle, performing a focusing operation on the two first cameras to ensure that the images in the two first cameras are clear;

[0080] In each set of the field angles and the azimuth angles, using the first camera to test the MTF of the corresponding visual device in the device under test;

[0081] Determine the clarity of the device under test based on the MTF of the visual device.

[0082] In an optional implementation, the test requirement is to test binocular combined imaging of the device under test, and the target test devices on the two simulated eyeballs are both first cameras; wherein the field of view angle range of the first camera is 0 to 30°;

[0083] Controlling the target test device to test the device under test at the test location includes:

[0084] Controlling the two simulated eyeballs to rotate so that the simulated eyeballs rotate to multiple viewing angles of the device under test; wherein each viewing angle has a corresponding azimuth angle;

[0085] In each set of field angles and azimuth angles, record the first angle β_left and the second angle β_right of two simulated eyeballs rotating in the vertical direction;

[0086] According to the first angle β_left and the second angle β_right, the binocular combination accuracy β_left-β_right corresponding to the field of view angle and the azimuth angle is calculated.

[0087] In an optional implementation, the test requirement is to test the convergence conflict of the device under test, and the target test devices on the two simulated eyeballs are both first cameras; wherein the field of view angle range of the first camera is 0 to 30°;

[0088] Controlling the target test device to test the device under test at the test location includes:

[0089] Controlling the two simulated eyeballs to rotate so that the simulated eyeballs rotate to a plurality of viewing angles of the device under test; wherein each of the viewing angles has a corresponding azimuth angle;

[0090] In each set of field angles and azimuth angles, record the third angle α_left and the fourth angle α_right of the two simulated eyeball rotations in the horizontal direction, the pupil distance i, and the first virtual image distance VID_left and the second virtual image distance VID_right obtained by the two first cameras test;

[0091] Calculate the combined image distance D of the two first cameras according to the third angle α_left, the fourth angle α_right and the pupil distance i;

[0092] The convergence conflict corresponding to each of the field of view angles is calculated according to the combined image distance D and an average value of the first virtual image distance VID_left and the second virtual image distance VID_right.

[0093] In an optional implementation, the test requirement is to test the dynamic distortion of the device under test, and the two target test devices simulating the eyeball are respectively a first camera and a second camera; wherein the field of view angle range of the first camera is 0 to 30°, and the field of view angle of the second camera is 0 to 120°;

[0094] Controlling the target test device to test the device under test at the test location includes:

[0095] Control the first camera and the second camera to respectively align with the left and right optical axes of the device under test;

[0096] In a stationary state, using a second camera to obtain a first static distortion of each position in the global image;

[0097] Calculating, based on the image acquired by the second camera, position information of a target point in the acquired image relative to the first camera;

[0098] Determining a rotation angle of the first camera according to the position information;

[0099] According to the rotation angle, controlling the simulated eyeball where the first camera is located to rotate, and adjusting the rotation axis of the simulated eyeball, so that the first camera is aimed at different target points, and using the first camera to obtain a second dynamic distortion corresponding to each of the target points;

[0100] The dynamic distortion of the device under test is determined according to the first static distortion and the second dynamic distortion corresponding to each of the target points.

[0101] In an optional implementation, the test requirement is to test the color and brightness of the ghost image of the device under test, and the two target test devices on the simulated eyeball are respectively a second camera and a high-frequency brightness meter; wherein the field of view of the second camera is 0 to 120°;

[0102] Controlling the target test device to test the device under test at the test location includes:

[0103] Control the second camera to obtain a global image, identify the position of the ghost image, and use the position of the ghost image as a target point;

[0104] According to the position information of the target point, the simulated eyeball where the high-frequency brightness meter is located is controlled to rotate so that the high-frequency brightness meter is aligned with the target point;

[0105] The color and brightness of the ghost image are tested using a high-frequency luminance meter, and the test results are used as the color and brightness of the ghost image of the device under test.

[0106] In an optional implementation, the test requirement is to test the damage of the infrared light source of the device under test to the human eye, and the target test devices on the two simulated eyeballs are both near-infrared radiation illuminance meters;

[0107] Controlling the target test device to test the device under test at the test location includes:

[0108] Controlling the two simulated eyeballs to rotate so as to utilize each simulated eyeball to traverse all the field of view angles corresponding to the device under test;

[0109] The near-infrared radiation illuminance meter installed on each simulated eyeball is used to test the illuminance of the infrared light source of the device under test in real time;

[0110] The damage of the infrared light source of the device under test to the human eye is determined according to the illumination of the infrared light source of the device under test and a preset illumination threshold.

[0111] In an optional embodiment, the testing method further includes:

[0112] In response to different test requirements, the first drive assembly and the second drive assembly are controlled to drive the simulated eyeball to rotate so as to switch the target test device located at the test position.

[0113] In a third aspect, the present application further provides an electronic device, comprising a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the program implements the testing method of the second aspect when executed by the processor.

[0114] In a fourth aspect, the present application further provides a non-transitory computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the testing method of the second aspect is implemented.

[0115] In a fifth aspect, the present application also provides a computer program product, including a computer program, which implements the testing method of the first aspect when the computer program is executed by a processor.

[0116] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0117] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0118] Figure 1 It is one of the structural schematic diagrams of the eye tracking device provided in the embodiment of the present application;

[0119] Figure 2 is a top view of an eye tracking device provided in an embodiment of the present application;

[0120] Figure 3 is a partial schematic diagram of an eye tracking device provided in an embodiment of the present application;

[0121] Figure 4 This is the second structural schematic diagram of the eye tracking device provided in the embodiment of the present application;

[0122] Figure 5 This is one of the schematic diagrams of simulating eye gaze target points of an eye tracking device provided in an embodiment of the present application;

[0123] Figure 6 This is the second schematic diagram of a simulated eye gaze target point of an eye tracking device provided in an embodiment of the present application;

[0124] Figure 7 It is one of the flow charts of the eye tracking control method provided in the embodiment of the present application;

[0125] Figure 8 This is one of the schematic diagrams of simulating the deviation caused by eyeball rotation provided in the embodiments of the present application;

[0126] Fig. 9 This is the second schematic diagram of simulating the deviation caused by eyeball rotation provided in the embodiment of the present application;

[0127] Fig.10 is a flow chart of an eye tracking control device provided in an embodiment of the present application controlling simulated eye movement;

[0128] Fig.11 is a flow chart of an eye tracking control method provided by an embodiment of the present application;

[0129] Fig.12 is a schematic diagram of the structure of an eye tracking control device provided in an embodiment of the present application;

[0130] Fig.13 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0131] Fig.14 is a schematic diagram of the structure of the test device provided in the embodiment of the present application;

[0132] Fig.15 This is a schematic diagram of a structure simulating the installation of a first camera and a second camera on an eyeball provided by an embodiment of the present application;

[0133] Fig.16 is a structural schematic diagram of a first camera and a second camera installed on an eyeball that simulate switching by rotating through a first rotation axis, provided by an embodiment of the present application;

[0134] Fig.17 It is a structural schematic diagram of a first camera and a second camera installed on a simulated eyeball of a head display provided by an embodiment of the present application;

[0135] Fig.18It is a schematic diagram of a test device simulating different functions on an eyeball provided by an embodiment of the present application, which can be arbitrarily matched with a simulated eyeball of a variable shape;

[0136] Fig.19a It is a schematic diagram of testing an eye box in a case where the Z direction of an eyeball remains unchanged, provided by an embodiment of the present application;

[0137] Fig.19b is a schematic diagram of testing an eye box after simulating an eyeball to translate in the Z direction, provided in an embodiment of the present application;

[0138] Fig. 20 It is a test chart of binocular display of a head-mounted display provided in an embodiment of the present application;

[0139] Fig.21 This is a schematic diagram of a radiation conflict test provided by an embodiment of the present application.

[0140] Fig. 22 This is a schematic diagram of a binocular image test provided in an embodiment of the present application.

[0141] Fig.23 This is a schematic diagram of using a first camera and a second camera in combination to test dynamic distortion provided by an embodiment of the present application;

[0142] Fig.24 This is a schematic diagram of testing binocular Photo-to-photo delay and binocular refresh rate consistency provided by an embodiment of the present application;

[0143] Fig.25 This is a flow chart of a pupil distance test provided in an embodiment of the present application;

[0144] Fig.26 This is a flow chart of simultaneously testing the left and right eye boxes of a head-mounted display provided by an embodiment of the present application;

[0145] Fig. 27 This is a flow chart of a combined test of binocular image combination and convergence conflict of a head display provided by an embodiment of the present application;

[0146] Fig.28 This is a flow chart of a binocular image test provided by an embodiment of the present application;

[0147] Fig.29 It is a flow chart of testing radiation conflict provided by an embodiment of the present application;

[0148] Fig.30 This is a flow chart of a distortion test provided by an embodiment of the present application;

[0149] Fig.31 This is a flow chart of testing ghost images provided in an embodiment of the present application.

[0150] Reference numerals:

[0151] Simulated eyeball 100, eyeball structure 110, artificial eye patch 120, bracket 210, first fixing plate 211, second fixing plate 212, first rotating component 230, second rotating component 240, eyeball base 260, linear slide 270, display screen 300. DETAILED DESCRIPTION

[0152] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0153] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0154] The switchable test device, test method, electronic device and readable storage medium provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.

[0155] In some embodiments of the present application, the switchable testing device may have one simulated eyeball or two simulated eyeballs.

[0156] In some embodiments, the number of test devices simulating the eyeball may be one, two, or more.

[0157] In some embodiments, when there are two simulated eyeballs, the test devices on the left and right simulated eyeballs may be the same, may be different, or the test devices on the two simulated eyeballs may be partially the same.

[0158] For the convenience of description, some of the embodiments below are explained based on a switchable test device with two simulated eyeballs, and the simulated eyeballs are equipped with at least two different test devices. However, this does not mean that the various embodiments described below are not applicable to a test device with only one simulated eyeball, or that they are not applicable to a test device with only one test device on the simulated eyeball. In other words, corresponding operations can be achieved with only a single eye or only a single test device, and the specific arrangements and combinations can be made according to actual needs, which will not be repeated here.

[0159] In some examples, the switchable test device includes a simulated eyeball, a motion controller, a first drive component, a second drive component, and at least one test device mounted on the simulated eyeball.

[0160] The motion controller is connected to the first motion drive component and the second drive component, and the first motion drive component and the second drive component are connected to the simulated eyeball.

[0161] The motion controller is used to control the first motion drive component and the second drive component according to the test requirements to drive the simulated eyeball and the test device to rotate synchronously until the target test device is switched to the test position.

[0162] The target test device is one of the at least one test device.

[0163] In some examples, the first drive assembly includes a first drive device and a first rotating component; the first drive device is connected to the motion controller, the first drive device and the first rotating component are drivingly connected, and the first rotating component is connected to the simulated eyeball, wherein the first rotating component is used to drive the simulated eyeball to move axially around the first rotating component to adjust the pitch angle of the simulated eyeball.

[0164] The second driving assembly includes a second driving device and a second rotating component, the second driving device is connected to the motion controller, the second driving device and the second rotating component are drivingly connected, the second rotating component is connected to the simulated eyeball and the first rotating component, wherein the second rotating component is used to drive the simulated eyeball and the first rotating component to move axially around the second rotating component to adjust the horizontal azimuth angle of the simulated eyeball.

[0165] It is worth noting that the switchable test device of the present application can adopt the following structural design of the eye tracking device, and realize the position switching of the test device on the simulated eyeball through the rotation cooperation between the two-axis structure, and / or realize the switching and position transformation between different test devices. That is, the structure adopts the following eye tracking device structure, simulating at least one test device to be assembled on the eyeball, thereby forming a switchable test device.

[0166] The switchable eyeball test device also includes a displacement platform, which drives the first rotation axis, the second rotation axis and the simulated eyeball, or an integrated system consisting of the first rotation axis, the second rotation axis, the simulated eyeball and other components to move forward or backward on a horizontal plane to achieve translation.

[0167] Of course, in some embodiments, the testing device also includes a third driving component for adjusting the distance between the simulated eyeballs, and a fourth driving component for adjusting the height of the simulated eyeballs. As for the pairing relationship between X / Y / Z and the displacement platform, the third driving component, and the fourth driving component, it is determined according to actual needs.

[0168] In some embodiments, the switchable test device uses Figure 1 When the eye tracking device is constructed as shown, the third driving component and the fourth driving component correspond to the third driving component and the fourth driving component of the eye tracking device.

[0169] In some embodiments, the displacement platform corresponds to the Z-axis, the third driving assembly corresponds to the X-axis, and the fourth driving assembly corresponds to the Y-axis.

[0170] The cooperation of the displacement platform, the third drive assembly and the fourth drive assembly can realize the displacement of the test equipment in the XYZ direction. The displacement is described as a whole by the integration formed by the first rotation axis, the second rotation axis and the simulated eyeball, or the integration formed by the three and other tables.

[0171] In a specific example, Figure 1 As shown, the structure designed by the test device of the embodiment of the present application is the following eye tracking device structure, and the eye tracking device includes: a simulated eyeball 100, a first rotating component 230 and a second rotating component 240.

[0172] like Figure 1 As shown, the first rotating component 230 is connected to the simulated eyeball 100, and the line connecting the pupil and the center of the simulated eyeball 100 forms a first angle with the axial direction of the first rotating component 230. The first rotating component 230 is used to drive the simulated eyeball 100 to move axially around the first rotating component 230 to adjust the pitch angle of the simulated eyeball 100.

[0173] The pitch angle refers to the angular change in the gaze direction of the simulated eyeball 100 in the vertical direction, corresponding to the upward or downward eye movement of the human eye. The second rotating component 240 connects the simulated eyeball 100 and the first rotating component 230, and the second rotating component 240 is used to drive the simulated eyeball 100 and the first rotating component 230 to move axially around the second rotating component 240 to adjust the horizontal azimuth of the simulated eyeball 100.

[0174] In this embodiment, the first rotating component 230 is used to adjust the pitch angle of the simulated eyeball 100, and the second rotating component 240 is used to adjust the horizontal azimuth angle of the simulated eyeball 100. The rotation axis of the first rotating component 230 and the rotation axis of the second rotating component 240 are in two non-parallel planes. The first rotating component 230 and the second rotating component 240 can realize the all-round rotation of the simulated eyeball 100.

[0175] It should be noted that the line of sight of the simulated eyeball 100 is the direction of the line connecting the pupil and the center of the eyeball of the simulated eyeball 100. The line connecting the pupil and the center of the eyeball forms a first angle with the axial direction of the first rotating component 230 (the first angle is not 0° or 180°). When the first rotating component 230 drives the simulated eyeball 100 to move around the axial direction of the first rotating component 230, the vertical position of the pupil on the simulated eyeball 100 changes, and the angle between the line of sight and the horizontal plane changes accordingly, thereby realizing the pitch angle adjustment.

[0176] It can be understood that if the line connecting the pupil and the center of the eyeball is on the same straight line as the axis of the first rotating component 230, when the first rotating component 230 drives the simulated eyeball 100 to move around the axis of the first rotating component 230, the pupil of the simulated eyeball 100 is on the rotation axis, and the position of the pupil in the vertical direction will not change, and the pitch angle adjustment cannot be achieved.

[0177] In actual implementation, the axial setting angle of the first rotating component 230 can be adjusted according to the angle range of the pitch angle required to adjust the simulated eyeball 100. The first rotating component 230 can be set in a horizontal direction or in an inclined direction with a certain angle to the horizontal direction.

[0178] For example, the axis of the first rotating component 230 is horizontal, and the line connecting the pupil and the center of the eyeball forms a first angle with the axis of the first rotating component 230. When the first rotating component 230 drives the simulated eyeball 100 to rotate, the movement trajectory of the pupil on the simulated eyeball 100 is on a vertical plane, thereby realizing the pitch angle adjustment of the line of sight of the simulated eyeball 100.

[0179] For another example, the axial direction of the first rotating component 230 is inclined at a certain angle to the horizontal direction, and the axial direction of the first rotating component 230 is not completely vertical. The line connecting the pupil and the center of the eyeball forms a first angle with the axial direction of the first rotating component 230. When the first rotating component 230 drives the simulated eyeball 100 to rotate, the movement trajectory of the pupil on the simulated eyeball 100 is on a non-horizontal plane, and the pitch angle adjustment can also be achieved.

[0180] In this embodiment, the pitch angle adjustment of the simulated eyeball 100 can be achieved through the first driving component, and the horizontal azimuth angle adjustment of the simulated eyeball 100 can be achieved through the second driving component.

[0181] In actual implementation, the first driving assembly may include a first driving device and a first rotating component 230 , wherein the first driving device is used to drive the first rotating component 230 to drive the simulated eyeball 100 to rotate around the axial direction of the first rotating component 230 to adjust the pitch angle of the simulated eyeball 100 .

[0182] The second driving assembly may include a second driving device and a second rotating component 240 , wherein the second driving device is used to drive the second rotating component 240 to drive the simulated eyeball 100 and the first rotating component 230 to rotate synchronously around the axial direction of the second rotating component 240 .

[0183] In this embodiment, the first driving device is a power source for driving the first rotating component 230 to rotate, and the second driving device is a power source for driving the second rotating component 240 to rotate. The first driving device and the second driving device can be stepping motors, DC motors and other devices.

[0184] It can be understood that the rotation of the second rotating component 240 alone will not affect the pitch angle of the simulated eyeball 100; the pitch angle and horizontal azimuth angle of the simulated eyeball 100 are adjusted respectively by the first rotating component 230 and the second rotating component 240, so that the line of sight of the simulated eyeball 100 can focus on any target point to be tracked.

[0185] The rotation axis of the first rotating component 230 is not parallel to the rotation axis of the second rotating component 240 and the two rotation axes are in two non-parallel planes to ensure that, when the eye tracking device tracks the target point, according to the position information of the simulated eyeball 100 and the target point and the first angle, the first rotating component 230 drives the simulated eyeball 100 to rotate to adjust the pitch angle of the simulated eyeball 100, and the second rotating component 240 drives the simulated eyeball 100 and the first rotating component 230 to rotate synchronously to adjust the horizontal azimuth angle of the simulated eyeball 100.

[0186] In actual implementation, the axial direction of the first rotating component 230 and the axial direction of the second rotating component 240 can be perpendicular to each other, which is suitable for looking at a target located in front of the simulated eyeball 100; the axial direction of the first rotating component 230 can be tilted upward or downward relative to the horizontal direction so that the simulated eyeball 100 looks at a target point with a larger pitch angle.

[0187] Among them, the eye tracking device is used to drive the simulated eyeball 100 to rotate to a first target angle for pitch angle adjustment through the first rotating component 230 according to the eye coordinate information of the simulated eyeball 100 and the position information of the target point to be tracked, and to drive the simulated eyeball 100 to rotate to a second target angle for horizontal azimuth adjustment through the second rotating component 240, so that the simulated eyeball focuses on the target point.

[0188] The first target angle corresponds to the angle at which the first rotating component 230 needs to drive the simulated eyeball 100 to rotate, and the second target angle corresponds to the angle at which the second rotating component 240 needs to drive the simulated eyeball 100 and the first rotating component 230 to rotate simultaneously.

[0189] When the first rotating component 230 drives the simulated eyeball 100 to rotate to the first target angle, and the second rotating component 240 drives the simulated eyeball 100 and the first rotating component 230 to rotate to the second target angle, the pupil of the simulated eyeball 100 and the target point can be adjusted to be in the same straight line, that is, the line of sight is aligned with the target point.

[0190] It can be understood that the eye coordinate information of the two simulated eyeballs 100 is different, and the first target angle and the second target angle of the two simulated eyeballs 100 are also different.

[0191] In this embodiment, the first target angle and the second target angle can be calculated by subtracting the current eye coordinate information of the simulated eye 100 and the corresponding eye coordinate information when the simulated eye 100 rotates to the fixation target point.

[0192] Based on the first target angle and the second target angle, control parameters for controlling the first rotating component 230 to rotate to the first target angle and the second rotating component 240 to rotate to the second target angle are calculated and output as corresponding target control instructions. The first rotating component 230 is controlled to rotate to the first target angle by the first driving device, and the second rotating component 240 is controlled to rotate to the second target angle by the second driving device, so as to simulate the eyeball 100 looking at the target point.

[0193] In actual implementation, the motion controller of the eye tracking device can be used to control the rotation direction, speed and other parameters of the first drive device and the second drive device to drive the first rotating component 230 and the second rotating component 240 to rotate, and the first drive device and the second drive device move simultaneously to simulate the pitch angle rotation and horizontal rotation of the eyeball 100 and simulate the multi-dimensional complex movement of the human eye.

[0194] The pitch angle rotation and horizontal rotation of the simulated eyeball 100 can be controlled separately.

[0195] According to the eye tracking device provided in the embodiment of the present application, by setting the first rotating component 230 and the second rotating component 240, the all-round angle adjustment of the simulated eyeball 100 is realized, and the action of the simulated eyeball 100 looking at the target point is decomposed into the rotation of the first rotating component 230 and the second rotating component 240. Through the pitch angle rotation and the horizontal azimuth angle rotation, the simulated eyeball 100 looks at the target point, accurately simulating the complex multi-dimensional movements of the human eye, and effectively improving the movement control accuracy of the simulated eyeball.

[0196] In some examples, the motion controller is also used to control the first drive component and the second drive component to drive the simulated eyeball to rotate according to different test requirements, so as to switch the target test device on the simulated eyeball.

[0197] Optionally, the switchable testing device also includes a third driving component and two eyeball bases arranged corresponding to the two simulated eyeballs.

[0198] The first rotating component is connected to the corresponding simulated eyeball through the corresponding eyeball base, and the second rotating component is connected to the corresponding first rotating component and the corresponding simulated eyeball through the corresponding eyeball base and drives the two to rotate synchronously.

[0199] The third driving assembly is connected to the two eyeball bases respectively.

[0200] The third driving component is used to drive the two eyeball bases to move towards or in opposite directions under the control of the motion controller to adjust the distance between the two simulated eyeballs.

[0201] In some embodiments, reference Figure 1 The test device constituted by the eye tracking device shown further includes an eyeball base 260 , on which the simulated eyeball 100 is located.

[0202] The first rotating component 230 is connected to the simulated eyeball 100 through the eyeball base 260 , and the second rotating component 240 is connected to the first rotating component 230 and the simulated eyeball 100 through the eyeball base 260 and can drive the two to rotate synchronously.

[0203] The third driving component is connected to the two eyeball bases 100 respectively, and drives the two eyeball bases 260 to move towards or opposite to each other, so as to adjust the pupil distance between the two simulated eyeballs 100.

[0204] In this embodiment, two eyeball bases 260 may be arranged side by side along the first direction, and each eyeball base 260 may be provided with a simulated eyeball 100 .

[0205] It is understandable that the orientation relationship indicated by the first direction is only for the convenience of describing the arrangement of the two eyeball bases 260, rather than indicating or implying that the eyeball bases 260 or simulated eyeballs 100 must have a specific orientation relationship.

[0206] For example, the first direction may be a horizontal left-right direction, a horizontal front-back direction, or other directions.

[0207] The eyeball base 260 is a base for placing the simulated eyeball 100 , and mechanisms such as the bracket 210 , the first rotating component 230 and the second rotating component 240 may also be arranged on the eyeball base 260 .

[0208] In actual implementation, the simulated eyeball 100, the bracket 210 and the first rotating component 230 can be placed on the upper cover of the eyeball base 260; the second rotating component 240 can be placed in the accommodating cavity of the eyeball base 260, and the part extending from the upper cover is connected to the bracket 210, driving the simulated eyeball 100, the bracket 210 and the first rotating component 230 to rotate in the horizontal direction together.

[0209] In this embodiment, the second driving device can also be arranged in the accommodating cavity of the eyeball base 260, wherein one end of the second rotating component 240 is connected to the output end of the second driving device, and the other end of the second rotating component 240 is connected to the bracket 210.

[0210] In some embodiments, when the two simulated eyeballs 100 are at the starting position, the axes of the two first rotating components 230 form a second angle.

[0211] It should be noted that the simulated eyeball 100, the bracket 210 of the simulated eyeball 100 and the first rotating component 230 are relatively protruding structures in the eye tracking device (the second rotating component 240 is placed vertically and can be set in the eyeball base 260 of the simulated eyeball 100, which is relatively non-protruding). If the two first rotating components 230 are placed in the same direction, the rotation of the second rotating component 240 may cause mechanical interference between structures such as the simulated eyeball 100, the bracket 210 and the first rotating component 230. The protruding simulated eyeball 100 may also mechanically interfere with the eye tracker waiting to be tested, thereby affecting the equipment test results.

[0212] like Figure 2 As shown, when the two simulated eyeballs 100 are in the starting position, the axes of the two first rotating components 230 form a second angle, that is, the relatively protruding simulated eyeballs 100 are offset and placed, leaving a rotation space without interference for structures such as the simulated eyeballs 100, the bracket 210 and the first rotating component 230. When the second rotating component 240 rotates, mechanical interference between structures such as the simulated eyeball 100, the bracket 210 and the first rotating component 230 can be avoided, and the rotation of the two first rotating components 230 does not affect each other, thereby ensuring the normal operation of the simulated eyeball 100 in two directions.

[0213] In this embodiment, the axes of the two first rotating components 230 form a second angle, simulating the offset placement of the eyeball 100, which can effectively prevent mechanical interference of the eye tracking device.

[0214] In some embodiments, the eye tracking device may further include a third driving component for adjusting the pupil distance between the two simulated eyeballs 100 .

[0215] In this embodiment, the third driving component is connected to the two eyeball bases 260 , and the third driving component is used to drive the two eyeball bases 260 to move toward or away from each other along a first direction to adjust the pupil distance between the two simulated eyeballs 100 .

[0216] It can be understood that the simulated eyeball 100 is placed on the eyeball base 260. When the third driving component drives the two eyeball bases 260 to move toward or away from each other, the distance between the two eyeball bases 260 changes, and the pupil distance between the two simulated eyeballs 100 changes accordingly. The third driving component can be controlled by a motion controller to adjust the pupil distance between the two simulated eyeballs 100, thereby simulating the human eye conditions with different pupil distances.

[0217] In some embodiments, the third driving assembly includes a third driving device and a linear slide 270 , the third driving device and the linear slide 270 are connected, and two eyeball bases 260 are disposed on the linear slide 270 .

[0218] In this embodiment, the motion controller outputs control instructions to the third drive device. Driven by the third drive device, the linear slide 270 can drive the two eyeball bases 260 to achieve linear motion, thereby adjusting the pupil distance between the two simulated eyeballs 100.

[0219] It can be understood that the third driving device is a power source for driving the linear slide 270 , and the third driving device can be a stepping motor, a DC motor or the like.

[0220] In actual implementation, the eye tracking device may include a device base, in which a storage space is defined for accommodating a third driving device. A linear slide 270 is installed on the device base, and two eyeball bases 260 are arranged on the linear slide 270. Under the drive of the third driving device, the pupil distance between the two simulated eyeballs 100 is adjusted.

[0221] In some embodiments, the maximum rotation angle of the second rotating component 240 is determined based on the pupil distance of the two simulated eyeballs 100 .

[0222] It can be understood that by analyzing the gaze directions of the two simulated eyeballs 100 based on the pupil distance of the two simulated eyeballs 100, the rotation angle range of the two simulated eyeballs 100 that mechanically interferes can be determined, and then the maximum rotation angle of the simulated eyeball 100 that can be driven by the second rotating component 240 to achieve horizontal rotation can be determined.

[0223] In some embodiments, the maximum rotation angle of the first rotating component 230 is 360 degrees, and the maximum rotation angle of the second rotating component 240 is less than 360 degrees.

[0224] In this embodiment, the first rotating component 230 can drive the simulated eyeball 100 to rotate 360 ​​degrees in all directions and adjust the pitch angle of the simulated eyeball 100; the maximum rotation angle of the simulated eyeball 100 driven by the second rotating component 240 is less than 360 degrees, which can avoid mechanical interference between the simulated eyeball 100, the bracket 210 and the first rotating component 230 and other structures. The rotation angle less than 360 degrees is also more in line with the rotation law of the real human eye.

[0225] In some embodiments, the eye tracking device also includes a stand 210 .

[0226] like Figure 3 As shown, the bracket 210 includes a first fixing plate 211 and a second fixing plate 212 that are perpendicular to each other. The other end of the first rotating component 230 passes through the mounting hole of the first fixing plate 211 and is connected to the simulated eyeball 100 ; the other end of the second rotating component 240 is connected to the second fixing plate 212 .

[0227] The bracket 210 is a frame for supporting and installing the simulated eyeball 100 , and each simulated eyeball 100 corresponds to one bracket 210 .

[0228] In this embodiment, the simulated eyeball 100 is installed on the bracket 210, the first rotating component 230 is installed on the first fixed plate 211, and the second rotating component 240 is installed on the second fixed plate 212. The first rotating component 230 drives the simulated eyeball 100 to rotate, and the second rotating component 240 drives the bracket 210, the simulated eyeball 100 and the first rotating component 230 to rotate together.

[0229] It should be noted that when the two simulated eyeballs 100 are in the starting position, the axes of the two first rotating parts 230 form an angle. The bracket 210, as a relatively protruding structure in the eye tracking device, simulates the offset placement of the eyeball 100, which can avoid mechanical interference between the bracket 210 and the first rotating part 230 on the bracket 210.

[0230] In actual implementation, the first driving device can also be arranged on the first fixed plate 211, wherein the first driving device is installed on one side of the first fixed plate 211, one end of the first rotating component 230 is connected to the output end of the first driving device, and the other end of the first rotating component 230 passes through the mounting hole of the first fixed plate 211 and is connected to the simulated eyeball 100 on the other side of the first fixed plate 211.

[0231] In some embodiments, the simulated eyeball 100 may include an eyeball structure 110 and a fake eye patch 120 . The sphere of the eyeball structure 110 is provided with a cut surface, and the fake eye patch 120 covers the cut surface. The radius of the fake eye patch 120 is smaller than the radius of the eyeball structure 110 .

[0232] Among them, the eyeball structure 110 is a spherical structure that simulates the human eye. The eyeball structure 110 is provided with a cut surface, and the cut surface is covered with a fake eye patch 120 that simulates the human eye iris. The size of the iris is smaller than the size of the entire eyeball. The radius of the fake eye patch 120 can be set according to the radius of the iris of different human eyes.

[0233] In this embodiment, by designing the eyeball structure 110 and the artificial eye patch 120, different sizes, curvatures, and arcs of human eyes can be simulated, so that the simulated eyeball 100 is closer to the real human eye.

[0234] In actual implementation, the eyeball structure 110 can be manufactured using 3D printing technology or CNC machine tool technology. When the eye tracking device is used to test the eye tracking device, its eyeball structure 110 and the fake eye patch 120 can be identified by camera image recognition technology to track the eye movement trajectory.

[0235] In some embodiments, the cross-section of the eyeball structure 110 is perpendicular to the axial direction of the first rotating component 230 .

[0236] like Figure 4 As shown, the cross-section of the eyeball structure 110 is perpendicular to the axis of the first rotating component 230, and the center position of the artificial eye patch 120 covering the cross-section is the pupil. When the first rotating component 230 drives the simulated eyeball 100 to rotate, the movement trajectory of the pupil of the artificial eye patch 120 is not the maximum circular cross-section of the eyeball structure 110, and there is a certain angle difference between the trajectory of the pupil and the vertical plane in front of the eye tracking device.

[0237] For example, Figure 5 As shown, when the first rotating component 230 of the simulated eyeball 100 corresponding to the left eye rotates clockwise, the pupil initially facing the display screen 300 in front will gradually move away from the display screen 300, and the movement trajectory of the pupil projected on the horizontal plane will also form a certain angle with the display screen 300.

[0238] In this embodiment, the first rotating component 230 of the simulated eyeball 100 rotates to adjust the pitch angle of the simulated eyeball 100, causing a certain position deviation of the pupil, and the second rotating component 240 of the simulated eyeball 100 is controlled to rotate for angle compensation.

[0239] For example, when the pupil of the simulated eyeball 100 corresponding to the left eye is away from the display screen 300, the second rotating component 240 of the simulated eyeball 100 is controlled to rotate clockwise to perform angle compensation, thereby shortening the distance between the pupil and the display screen 300.

[0240] In some embodiments, the eye tracking device may further include a fourth drive assembly connected to the eye base 260 .

[0241] Each fourth driving assembly is connected to an eyeball base 260 , and the fourth driving assembly is used to drive the eyeball base 260 to move along the axial direction of the second rotating component 240 to adjust the height of the simulated eyeball 100 .

[0242] In this embodiment, the eyeball base 260 is a base that can be raised and lowered, and the motion controller outputs a control instruction to the fourth drive component. Driven by the fourth drive component, the eyeball base 260 moves along the axial direction of the second rotating component 240 to achieve height adjustment of the simulated eyeball 100.

[0243] The eye tracking device of the embodiment of the present application can realize pitch angle rotation, horizontal rotation, pupil distance and height adjustment, and can accurately simulate the multi-dimensional complex movements of different human eyes.

[0244] In some embodiments of the present application, the switchable testing device comprises two simulated eyeballs, each simulated eyeball is provided with a first rotation axis and a second rotation axis, and the simulated eyeball can rotate driven by the first rotation axis and the second rotation axis.

[0245] A test device is provided on the simulated eyeball, and the test device rotates synchronously with the simulated eyeball. The first rotating shaft and the second rotating shaft drive the simulated eyeball to rotate, which in turn drives the test device to rotate until the required test device is switched to the test position.

[0246] In some embodiments, switching may refer to a change in the spatial position of the same test device, or switching between different devices, or switching between different devices in conjunction with a change in the spatial position of the device.

[0247] In some embodiments, a first camera and a second camera are installed on each simulated eyeball, and the field of view angles of the first camera and the second camera are not equal.

[0248] In some embodiments, the field of view of the first camera is 0-30°, the field of view of the second camera is 0-120°, and the first camera and the second camera are switched with each other through the rotation of the first rotation axis and the second rotation axis.

[0249] In some embodiments, the first camera and the second camera are switched only by rotating the first rotation axis 180°. Fig.15 , Fig.16 as well as Fig.17 shown.

[0250] The first camera is used to test clarity, PPD (Pixels Per Degree), eyebox (the range of user eye movement), IPD (Interpupillary Distance), VAC (Vergence-Accommodation Conflict) and binocular image accuracy.

[0251] The second camera is used to test the distortion, chromatic aberration, brightness / color uniformity, ghost images, contrast, and large-field binocular imaging of the entire field of view.

[0252] The lens aperture is front-mounted and can automatically focus.

[0253] A fake eye patch is set outside the camera so that the simulated eyeball can be recognized by the eye tracking device.

[0254] Through the rotational coordination of the first rotating axis and the second rotating axis, the test equipment can make the camera combination of the two simulated eyeballs currently in the test position be the first camera combined with the first camera, the second camera combined with the second camera, or the first camera combined with the second camera, so as to achieve different test requirements.

[0255] Usage process: The first camera is used in combination with the second camera to test clarity, etc. In one embodiment, the first rotation axis is rotated 180° to switch to the second camera to test the distortion of the full field of view, etc. The first camera is used in combination with the second camera to test different test items for the left and right purposes, respectively, to improve test efficiency.

[0256] The entrance pupils of the first and second cameras are at the same distance from the center of the simulated eyeball, and they rotate synchronously with the center of the eyeball as the rotation center. During the test, the camera can clearly and completely capture the virtual image of the head display under test. At the same time, by rotating the simulated eyeball, the camera that rotates with the simulated eyeball can capture image information of the tested product at different viewing angles, and transmit this image information to the computing module for processing.

[0257] Of course, the two simulated eyeballs can also be equipped with a high-frequency luminance meter (PD) and / or a near-infrared radiation illuminance meter, and both can be installed on the same simulated eyeball for combined use, or each can be installed on its corresponding simulated eyeball, and can also be used in combination with the first camera and the second camera. That is, a simulated eyeball can be equipped with at least one of the first camera, the second camera, the high-frequency luminance meter (PD), and the near-infrared radiation illuminance meter, or at least two or more, which can be selected according to actual needs.

[0258] In some embodiments, the first camera, the second camera, the high-frequency brightness meter, and the near-infrared radiation illuminance meter may be located on the simulated eyeball at the same or different distances relative to the center of the simulated eyeball.

[0259] In some embodiments, when the above-mentioned test devices are combined, the positions located on the simulated eyeball are all at the same distance from the center of the simulated eyeball.

[0260] High frequency photometer (PD) for testing binocular photon to photon delay.

[0261] Near-infrared radiation illuminance measurement equipment measures the illuminance of near-infrared (NIR) light sources on the cornea and is used to evaluate the impact of the infrared light source of the eye movement module on the human eye.

[0262] The computing module processes the test results in real time to determine whether the image quality meets the requirements.

[0263] At the same time, the simulated eyeball can be replaced with eyeballs of different sizes (the diameter of the eyeball can be 19-30mm), pupils of different sizes (2-8mm), iris colors, etc. according to needs.

[0264] The test device simulating different functions of the eyeball can be matched with the eyeball of variable shape at will. Fig.18 shown.

[0265] In one embodiment, the first camera is used in combination with the second camera, such as Figure 19a-19b , Fig. 20 , Figure 26-29 As shown:

[0266] The first camera has a field of view of 0 to 30°, and the first camera is used in combination with the second camera to test IPD.

[0267] 1) Adjust the rotation axis so that the optical axes of the two first cameras in the left and right simulated eyeballs are parallel. The distance between the entrance pupil of the left eyeball's first camera and the left eye of the head display is ER_left, and the distance between the entrance pupil of the right eyeball's first camera and the right eye of the head display is ER_right. Adjust the position of the head display until ER_left = ER_right. By adjusting the third drive component and / or the fourth drive component, drive the left eyeball to translate in the X / Y direction until the first camera of the left eyeball is aligned with the MTF (Modulation Transfer Function) center of the left eye of the head display. Similarly, adjust the right eyeball by adjusting the third drive component and / or the fourth drive component until the first camera of the right eyeball is aligned with the MTF center of the head display. Obtain the pupil distance between the two simulated eyeballs, which is the IPD of the head display. The pupil distance test flow chart is as follows: Fig.25 shown.

[0268] 2)Reference Fig.26 , the first camera has a field of view of 0 to 30°, and the first camera is used in combination with the first camera to test the eye box (the range within which the user's eyes can move).

[0269] With the cooperation of the first rotation axis and the second rotation axis, the two simulated eyeballs rotate around the center of the ball to a certain field of view angle θ (for example, 30°) and azimuth angle η (for example, 45°) of the VR headset. The third driving assembly and the fourth driving assembly drive the simulated eyeballs to translate along the direction of the azimuth angle. The first camera tests the MTF until the MTF drops to a certain threshold (for example, 0.5), and records the translation distance X / Y at this time.

[0270] The displacement platform drives the simulated eyeball to translate in the Z direction (away from or close to the head display) to test the three-dimensional area of ​​the eyebox. The test obtains the size of the eye box under the field of view angle θ.

[0271] Fig.19a Test the eye box while simulating the eyeball's Z direction remains unchanged. Fig.19b Test the eye box after simulating the eyeball to translate in the Z direction.

[0272] This solution can test the left and right eye boxes of the headset at the same time, improving the test efficiency. The corresponding flow chart is as follows: Fig.26 shown.

[0273] 3) The first camera has a field of view of 0 to 30°, and the first camera is used in combination with the first camera to test clarity.

[0274] The headset displays vertical stripes on both eyes (4on4off). The eye tracking function of the headset is turned on. The camera captures the vertical stripes and calculates the MTF value based on (Lmax-Lmin) / (Lmax+Lmin). Compare the MTF values ​​and differences obtained by the left and right cameras.

[0275] Among them, the above 2) and 3) can be combined into a flow chart as shown in Fig. 27 shown.

[0276] 4)Reference Fig. 22 and Fig.28 The field of view of the first camera is 0-30°, and the first camera is used in combination with the first camera to test binocular image formation.

[0277] Both eyes of the head display show Fig. 20 In the test picture of binocular display of the head display shown, the motion control module controls the simulated eye movement, the left eye rotates α_left, β_left, and the right eye rotates α_right, β_right, so that the center of the left and right cameras are respectively aligned with the center of one of the position points of the left and right eyes.

[0278] Binocular image calculation formula: β_left-β_right.

[0279] 5)Reference Fig.21 and Fig.29, the field of view of the first camera is 0-30°, and the first camera is used in combination with the first camera to test VAC (convergence conflict).

[0280] Both eyes of the head display show Fig. 20 The test image of the binocular display of the head display is shown. The motion control module controls the simulated eyeball rotation. The left camera rotates α_left, β_left, and the right camera rotates α_right, β_right, so that the center of the left and right cameras is aligned with the center of one of the position points of the left and right eyes respectively. The virtual image distance of the left camera test is VID_left, and the virtual image distance of the right camera test is VID_right

[0281] Calculate the difference between the camera focus plane position VID and the combined image position D, that is, VID_left-D. The calculation formula for D is as follows:

[0282] Tan(α_left)=i_left / D;

[0283] Tan(α_right)=i_right / D;

[0284] i_left+i_right=i.

[0285] The flowcharts corresponding to the above 4) and 5) can be combined into the following: Fig.28 shown.

[0286] In one embodiment, the first camera is used in combination with the second camera:

[0287] 1) The first camera has a field of view of 0 to 30°, and the second camera has a field of view of 0 to 120°. The first camera and the second camera are used in combination to test different test items at the same time.

[0288] While the first camera tests the clarity, PPD (angular resolution), and eyebox, the second camera tests the color difference, brightness / color uniformity, contrast, and ghost images of the entire field of view. The test results of the first and second cameras are processed in parallel by the calculation module to improve the test efficiency.

[0289] 2) The first camera has a field of view of 0 to 30°, and the second camera has a field of view of 0 to 120°. The first camera and the second camera are used in combination to test dynamic distortion, such as Fig.23 shown.

[0290] Reference Fig.30 The second camera takes a global picture. Based on the image taken by the second camera, the position information of the target point relative to the first camera is calculated. The rotation axis drives the first camera on the simulated eyeball to rotate so that the first camera is aligned with the target point.

[0291] The second camera takes a picture of the chessboard in a stationary state and calculates the static distortion D1 of each position based on the center of the pupil. At the same time, the first camera is aimed at the target point and takes a picture of the local small field of view chessboard to calculate the dynamic distortion D2 based on the center of the eyeball. The difference between D1 and D2 is compared to evaluate the dynamic distortion.

[0292] In one embodiment, a high frequency brightness meter is used in combination with a second camera:

[0293] Reference Fig.31 The high-frequency brightness meter can measure brightness and color. The field of view of the second camera is 0 to 120°. The high-frequency brightness meter is used in combination with the second camera to test ghost image characteristics.

[0294] The second camera takes a global picture, identifies the position of the ghost image, and uses the ghost image position as the target point. According to the position information of the target point calculated by the second camera, the rotation axis drives the high-frequency brightness meter on the simulated eyeball to rotate so that the high-frequency brightness meter is aligned with the target point.

[0295] A high-frequency photometer tests the color and brightness of ghost images.

[0296] The two simulated eyeballs may also be equipped with a high-frequency brightness meter (PD) or a near-infrared radiation illuminometer. Both may be installed on the same simulated eyeball and used in combination, and may also be used in combination with the first camera and the second camera.

[0297] In some embodiments, the corresponding test flow chart is as follows Fig.29 shown.

[0298] When the measuring device is a near-infrared radiation illuminometer, it can be used to measure the damage to human eyes caused by infrared light sources emitted by virtual reality devices such as head-mounted displays. In some embodiments, a near-infrared radiation illuminometer is used in combination with a near-infrared radiation illuminometer to measure the damage to human eyes caused by infrared light sources.

[0299] When the eyeball moves, the distance between the eyeball and the infrared light source of the head-mounted display device is different, and the degree of damage to the human eye by the infrared light source is also different.

[0300] 1) Simulate the eyeball to traverse the field of view angles corresponding to all the head-mounted displays to be tested (-60°<α_left<60°, -60°<α_right<60°, -50°<β_left<50°, -50°<β_left<50°).

[0301] 2) Simulate the near-infrared radiation illuminance meter on the eyeball to test the illuminance of the infrared light source in real time, record the corresponding α_left, β_left, E_left and α_right, β_right, E_right, and determine whether the illuminance meets E<100W / m2.

[0302] The above-mentioned embodiments are also applicable to a test device having only one simulated eyeball. In this case, the simulated eyeball may rotate once or multiple times as required, so as to switch the corresponding test device to the test position for testing as required.

[0303] By adopting the design of the present application, the test functions of different test equipment can be integrated into one test equipment. By installing different test devices on the simulated eyeball and rotating the simulated eyeball, the corresponding test device can be called according to the needs. This can be applicable to both monocular test equipment and binocular test equipment. For binocular test equipment, the same or different functions can be achieved through different combinations of devices called by the left and right simulated eyeballs, thereby realizing functional integration and efficient and accurate testing.

[0304] For example, in some embodiments, the measuring device may also be a high-frequency luminance meter (PD). The high-frequency luminance meter and the high-frequency luminance meter may be used in combination to test binocular photo-to-photo delay and binocular refresh rate consistency, such as Fig.24 shown.

[0305] The optical signal of the left eye of the headset enters the PD from optical fiber 1, the optical signal of the right eye of the headset enters the PD from optical fiber 2, and the optical signal of the real world enters the PD from optical fiber 3. The computing module processes the signals to obtain the delay of the left eye relative to the real world, the delay of the right eye relative to the real world, and the relative delay of the left and right eyes.

[0306] In another aspect, an embodiment of the present application further provides a testing method for testing a device to be tested, the testing method comprising:

[0307] In response to the test requirement, a target test device is determined.

[0308] The first driving assembly and the second driving assembly are controlled to move so as to drive the simulated eyeball and the test device to rotate synchronously until the target test device is switched to the test position.

[0309] The target test device is controlled to test the device under test at the test position.

[0310] Wherein, at least one test device is installed on the simulated eyeball, and the target test device is one of the at least one test device.

[0311] Optionally, after controlling the target test device to test the device under test at the test position, the method further includes: acquiring test information of the target test device, and determining a test result for a test requirement of the device under test according to the test information.

[0312] Optionally, the test requirements include testing at least one of clarity, angular resolution, user eye movable range, pupil distance, convergence conflict, binocular image accuracy, full field distortion, chromatic aberration, brightness / color uniformity, ghost image, contrast, large field binocular image, binocular photo-to-photo delay, binocular refresh rate consistency, illumination of near-infrared light source on cornea, and damage of infrared light source to human eyes;

[0313] The test device includes at least one of a first camera, a second camera, a high-frequency luminance meter, and a near-infrared radiation illuminance meter; wherein the field of view angle range of the first camera is different from the field of view angle range of the second camera.

[0314] In one example, the number of simulated eyeballs is one, and according to the test requirements, determining the target test device includes:

[0315] The test requirement is to test at least one of the clarity, angular resolution, user eye movable range, pupil distance, convergence conflict, and binocular image accuracy of the device under test, and determine that the target test device is the first camera;

[0316] The test requirement is to test at least one of distortion, chromatic aberration, brightness / color uniformity, ghost image, contrast and large field binocular image of the full field of view of the device under test, and determine that the target test device is the second camera;

[0317] The test requirement is to test the binocular photo-to-photo delay of the device under test, and the target test device is determined to be a high-frequency brightness meter;

[0318] The test requirement is to test the illumination of the near-infrared light source of the device under test on the cornea, and determine that the target test device is a near-infrared radiation illuminometer.

[0319] Optionally, the number of simulated eyeballs is two, each simulated eyeball is equipped with a test device, and according to the test requirements, the target test device is determined to include:

[0320] The test requirement is to test at least one of the clarity, pupil distance, movable range of the user's eyes, binocular image formation, and convergence conflict of the device under test, and to determine that both target test devices on the two simulated eyeballs are the first camera;

[0321] The test requirement is to test the dynamic distortion of the device under test, or the test requirement is to test at least one of the clarity, angular resolution, and movable range of the user's eyes of the device under test, and at the same time test at least one of the chromatic aberration, brightness / color uniformity, contrast, and ghost images of the full field of view of the device under test, and determine that the target test devices on the two simulated eyeballs are the first camera and the second camera respectively;

[0322] The test requirement is to test the ghost image of the device under test, and determine that the target test devices on the two simulated eyeballs are a high-frequency brightness meter and a second camera;

[0323] The test requirement is to test the binocular photo-to-photo delay or binocular refresh rate consistency of the device under test, and to ensure that the target test devices on the two simulated eyeballs are both high-frequency brightness meters;

[0324] The test requirement is to test the damage of the infrared light source of the device under test to the human eye, and to determine that the target test devices on the two simulated eyeballs are both near-infrared radiation illuminance meters.

[0325] In one embodiment, the test requirement is to test the pupil distance of the device under test, and the target test devices on the two simulated eyeballs are both first cameras; wherein the field of view angle range of the first camera is 0 to 30°;

[0326] Controlling the target test device to test the device under test at the test location includes:

[0327] respectively adjusting the positions of the two simulated eyeballs so that the optical axes of the first cameras on the two simulated eyeballs are parallel;

[0328] Determine that the entrance pupils of the first cameras on the two simulated eyeballs are at the same distance from the corresponding visual device in the device under test;

[0329] The positions of the two simulated eyeballs are translated so that the first cameras on the two simulated eyeballs are aligned with the MTF centers of the corresponding visual devices;

[0330] The pupil distance between the two simulated eyeballs is obtained, and the pupil distance is used as the pupil distance of the device under test.

[0331] In one embodiment, the test requirement is to test the movable range of the eyes of the user of the device under test, and the target test devices on the two simulated eyeballs are both first cameras; wherein the field of view angle range of the first camera is 0 to 30°.

[0332] Controlling the target test device to test the device under test at the test location includes:

[0333] The two simulated eyeballs are controlled to rotate so as to rotate the simulated eyeballs to a plurality of viewing angles of the device under test; wherein each of the viewing angles has a corresponding azimuth angle.

[0334] In each set of the field of view angle and the azimuth angle, the two simulated eyeballs are controlled to translate along the direction of the corresponding azimuth angle, and during the translation process, the MTF of the corresponding visual device in the device under test is tested using the first camera.

[0335] When the MTF of the visual device meets the preset threshold, the two simulated eyeballs are controlled to stop translating, and the two simulated eyeballs are controlled to move in a direction close to or away from the device under test to test the three-dimensional area of ​​the movable range of the user's eyes of the device under test, and the movable range of the user's eyes of the device under test corresponding to each field of view angle is obtained.

[0336] Exemplarily, the test requirement is to test binocular imaging of the device under test, and the target test devices on the two simulated eyeballs are both first cameras; wherein the field of view angle range of the first camera is 0 to 30°.

[0337] Controlling the target test device to test the device under test at the test location includes:

[0338] Controlling the two simulated eyeballs to rotate so that the simulated eyeballs rotate to multiple viewing angles of the device under test; wherein each viewing angle has a corresponding azimuth angle;

[0339] In each set of the field angle and the azimuth angle, recording a first angle β_left and a second angle β_right of two simulated eyeballs rotating in the vertical direction;

[0340] According to the first angle β_left and the second angle β_right, the binocular combination accuracy β_left-β_right corresponding to the field of view angle and the azimuth angle is calculated.

[0341] Optionally, the test requirement is to test the convergence conflict of the device under test, and the target test devices on the two simulated eyeballs are both first cameras; wherein the field of view angle range of the first camera is 0 to 30°.

[0342] Controlling the target test device to test the device under test at the test location includes:

[0343] Controlling the two simulated eyeballs to rotate so that the simulated eyeballs rotate to multiple viewing angles of the device under test; wherein each viewing angle has a corresponding azimuth angle;

[0344] In each set of field angles and azimuth angles, record the third angle α_left and the fourth angle α_right of the two simulated eyeballs rotating in the horizontal direction, the pupil distance i, and the first virtual image distance VID_left and the second virtual image distance VID_right obtained by the two first cameras tested;

[0345] Calculate the combined image distance D of the two first cameras according to the third angle α_left, the fourth angle α_right and the pupil distance i;

[0346] The convergence conflict corresponding to each of the field of view angles is calculated according to the combined image distance D and an average value of the first virtual image distance VID_left and the second virtual image distance VID_right.

[0347] In an optional implementation, the test requirement is to test the dynamic distortion of the device under test, and the two target test devices simulating the eyeball are respectively a first camera and a second camera; wherein the field of view angle range of the first camera is 0 to 30°, and the field of view angle of the second camera is 0 to 120°;

[0348] Controlling the target test device to test the device under test at the test location includes:

[0349] Controlling the first camera and the second camera to respectively align with the left and right optical axes of the device under test;

[0350] In a stationary state, using the second camera to obtain a first static distortion of each position in the global image;

[0351] Calculating, based on the image acquired by the second camera, position information of a target point in the acquired image relative to the first camera;

[0352] Determining a rotation angle of the first camera according to the position information;

[0353] According to the rotation angle, controlling the simulated eyeball where the first camera is located to rotate, and adjusting the rotation axis of the simulated eyeball, so that the first camera is aimed at different target points, and using the first camera to obtain a second dynamic distortion corresponding to each of the target points;

[0354] The dynamic distortion of the device under test is determined according to the first static distortion and the second dynamic distortion corresponding to each of the target points.

[0355] In one embodiment, the test requirement is to test the color and brightness of the ghost image of the device under test, and the two target test devices on the simulated eyeball are respectively a second camera and a high-frequency brightness meter; wherein the field of view of the second camera is 0 to 120°;

[0356] Controlling the target test device to test the device under test at the test location includes:

[0357] Controlling the second camera to acquire a global image, and identifying the position of a ghost image, and using the position of the ghost image as a target point;

[0358] According to the position information of the target point, controlling the simulated eyeball where the high-frequency brightness meter is located to rotate so that the high-frequency brightness meter is aligned with the target point;

[0359] The color and brightness of the ghost image are tested by using the high-frequency luminance meter, and the test result is used as the color and brightness of the ghost image of the device under test.

[0360] Exemplarily, the test requirement is to test the damage of the infrared light source of the device under test to the human eye, and the target test devices on the two simulated eyeballs are both near-infrared radiation illuminance meters.

[0361] Controlling the target test device to test the device under test at the test location includes:

[0362] Controlling the two simulated eyeballs to rotate so as to utilize each simulated eyeball to traverse all the viewing angles corresponding to the device under test;

[0363] Using the near-infrared radiation illuminometer installed on each of the simulated eyeballs to test the illuminance of the infrared light source of the device to be tested in real time;

[0364] The damage of the infrared light source of the device under test to human eyes is determined according to the illumination of the infrared light source of the device under test and a preset illumination threshold.

[0365] Optionally, the testing method further includes:

[0366] In response to different test requirements, the first drive assembly and the second drive assembly are controlled to drive the simulated eyeball to rotate so as to switch the target test device located at the test position.

[0367] In the embodiment of the present application, the structure and principle described in the above-mentioned test method can refer to the relevant structure and relevant principle in the above-mentioned switchable test device, which will not be repeated here.

[0368] It is worth noting that in some embodiments, the testing method of the switchable testing device can use the following eye tracking method to control the simulated eye movement to drive the test device to move, adjust the spatial position, and perform relevant tests on the device under test.

[0369] For ease of description, the following describes the simulated eye movement from the perspective of the eye tracking control method, but it is obvious that this movement logic is applicable to the movement logic of a switchable test device that drives the test device to perform corresponding tests by simulating the eye.

[0370] The eye tracking control method provided in the embodiment of the present application, by fixing the pupil distance, decomposes the action of simulating the eyeball 100 to gaze at the target point into the rotation of the first rotating component 230 and the second rotating component 240, and accurately simulates complex eyeball movements through pitch angle rotation and horizontal rotation.

[0371] The eye tracking control method of the embodiment of the present application acts on two simulated eyeballs 100 having a first rotating component 230 and a second rotating component 240 to track a target point. The rotation axis of the first rotating component 230 and the rotation axis of the second rotating component 240 are not parallel and the two rotation axes are in two non-parallel planes. The line connecting the pupil and the center of the simulated eyeball 100 forms a first angle with the axial direction of the first rotating component 230.

[0372] The eye tracking control method of the embodiment of the present application can be used to control the simulated eye movement 100 of the above-mentioned eye tracking device and accurately simulate complex continuous eye movements.

[0373] The executor of the eye tracking control method provided in the embodiment of the present application may be an electronic device or a functional module or functional entity in the electronic device that can implement the eye tracking control method. The eye tracking control method provided in the embodiment of the present application is described below using an electronic device as an example of the executor.

[0374] like Figure 7 As shown, the eye tracking control method includes steps 710 to 730.

[0375] Step 710 : Obtain eyeball coordinate information of two simulated eyeballs 100 and coordinate information of the target point to be tracked, and determine the pupil distance between the two simulated eyeballs 100 according to the eyeball coordinate information.

[0376] In this step, a spatial rectangular coordinate system may be established to obtain the coordinate information of the target point and the eye coordinate information of the two simulated eyeballs 100 according to the relative positional relationship between the simulated eyeball 100 and the target point.

[0377] For example, Figure 5 As shown, the simulated eyeball 100 is gazing at a target point on the display screen 300. When the eye tracking device is located at the original position, the eye centers of the two simulated eyeballs 100 are d and e respectively, and the vertical mapping points of d and e on the display screen 300 are a and b respectively. Ad=be=h, where h is the visual depth, i.e., the distance between the eye center of the simulated eyeball 100 and the display screen 300, and de=IPD, where IPD is the pupil distance.

[0378] The midpoint of the line connecting the two points a and b is the screen center point O of the display screen 300 , and point c is the target point on the display screen 300 .

[0379] A spatial rectangular coordinate system can be established with the midpoint of the line connecting the two simulated eyeballs 100 (the midpoint of the line connecting points d and e) as the coordinate origin, the line connecting the two simulated eyeballs 100 as the x-axis, the line connecting the midpoint of the line connecting the two simulated eyeballs 100 to the center point of the display screen 300 as the y-axis, and the vertical direction as the z-axis.

[0380] According to the relative position relationship between point c and the center point O of the screen, the coordinate information (x0, h, z0) of point c is obtained, and the eye coordinate information of the two simulated eyeballs 100 are (1 / 2IPD, 0, 0) and (-1 / 2IPD, 0, 0) respectively.

[0381] In this embodiment, a spatial rectangular coordinate system can be established at a certain position of the eye tracking device, or at a certain position of the display screen 300 to obtain the coordinate information of the target point and the eye coordinate information of the two simulated eyeballs 100.

[0382] It should be noted that the eyeball coordinate information of the simulated eyeball 100 includes coordinate information of various positions of the simulated eyeball 100 , for example, the eyeball coordinate information includes coordinate information of structural positions such as the eyeball structure 110 , the artificial eye patch 120 , and the pupil.

[0383] In this step, the pupil distance, that is, the distance between the eyeball centers of the two simulated eyeballs 100 , is calculated based on the eyeball coordinate information of the two simulated eyeballs 100 .

[0384] For example, the eyeball coordinate information of the two simulated eyeballs 100 are respectively (1 / 2IPD, 0, 0) and (-1 / 2IPD, 0, 0), and the pupil distance between the two simulated eyeballs 100 is IPD.

[0385] Step 720: When the pupil distance and the target pupil distance meet preset conditions, based on the eye coordinate information of the two simulated eyeballs 100 and the coordinate information of the target point, determine the first target angle and the second target angle that each simulated eyeball 100 needs to rotate to track the target point.

[0386] The target pupil distance is a preset pupil distance value.

[0387] It should be noted that the pupil distance and the target pupil distance meet a preset condition, which may be that the pupil distance is equal to the target pupil distance, or that the pupil distance and the target pupil distance are in a multiple relationship.

[0388] For example, when the pupil distance between the two simulated eyeballs 100 is equal to the preset target pupil distance, the position deviation between the line of sight direction of the simulated eyeball 100 and the target point is determined based on the eye coordinate information of the two simulated eyeballs 100 and the coordinate information of the target point, and the position deviation is adjusted by rotating the first rotating component 230 and the second rotating component 240 so that the line of sight direction of the simulated eyeball 100 is facing the target point, that is, the simulated eyeball 100 is looking at the target point.

[0389] Among them, the first target angle corresponds to the angle that the first rotating component 230 should drive the simulated eyeball 100 to rotate when the simulated eyeball 100 tracks the target point, and the second target angle corresponds to the angle that the second rotating component 240 should drive the first rotating component 230 and the simulated eyeball 100 to rotate synchronously when the simulated eyeball 100 tracks the target point.

[0390] In this step, based on the coordinate information of the target point and the eye coordinate information of the simulated eyeball 100, the position deviation between the line of sight of the simulated eyeball 100 and the target point is determined, and the line of sight of the simulated eyeball 100 is adjusted to face the target point by rotating the first rotating component 230 and the second rotating component 240.

[0391] In actual implementation, the first target angle and the second target angle can be calculated based on the current eye coordinate information of the simulated eye 100 and the eye coordinate information corresponding to when the simulated eye 100 rotates to the gaze target point.

[0392] When the first rotating component 230 drives the simulated eyeball 100 to rotate to the first target angle, and the second rotating component 240 drives the simulated eyeball 100 and the first rotating component 230 to synchronously rotate to the second target angle, the eyeball center, pupil and target point of the simulated eyeball 100 can be adjusted to the same straight line, that is, the line of sight of the simulated eyeball 100 is facing the target point.

[0393] It can be understood that the eye coordinate information of the two simulated eyeballs 100 is different, and the first target angle and the second target angle of the two simulated eyeballs 100 are also different.

[0394] Step 730, based on the first target angle and the second target angle, output a target control instruction to control the first rotating component 230 to drive the simulated eyeball 100 to rotate the first target angle and control the second rotating component 240 to drive the first rotating component 230 and the simulated eyeball 100 to rotate synchronously to the second target angle.

[0395] In this embodiment, control parameters for controlling the first rotating component 230 to rotate to a first target angle and the second rotating component 240 to rotate to a first target angle are calculated to obtain corresponding target control instructions, and the first rotating component 230 is controlled to rotate to a first target angle and the second rotating component 240 is controlled to rotate to a second target angle, so as to simulate the eyeball 100 gazing at the target point.

[0396] Take for example that the first rotating component 230 drives the simulated eyeball 100 to rotate in the vertical direction to achieve pitch angle adjustment; and the second rotating component 240 drives the simulated eyeball 100 to rotate in the horizontal direction.

[0397] In this embodiment, the first target angle P is calculated based on the coordinate information and the eyeball coordinate information.c , the second target angle is Q c , output the corresponding target control instruction, rotate the first rotating component 230 by P c , the second rotating member 240 rotates Q c Afterwards, the line of sight of the simulated eyeball 100 can be adjusted to face the target point.

[0398] According to the eye tracking control method provided in the embodiment of the present application, the pupil distance between the two simulated eyeballs 100 is fixed, and the action of the simulated eyeball 100 looking at the target point is decomposed into the rotation of the first rotating component 230 and the second rotating component 240 by acquiring the coordinate information of the target point, and motion control is performed so that the simulated eyeball 100 looks at the target point, thereby improving the motion control accuracy of the eye tracking device, and accurately simulating complex eye movements through pitch angle rotation and horizontal rotation.

[0399] In some embodiments, the eye tracking control method may further include:

[0400] When the pupil distance between the two simulated eyeballs 100 and the target pupil distance do not satisfy the preset condition, the pupil distance between the two simulated eyeballs 100 is adjusted until the pupil distance and the target pupil distance satisfy the preset condition.

[0401] For example, the third driving component of the eye tracking device can be used to drive the two eyeball bases 260 to move toward or away from each other, thereby changing the pupil distance between the two simulated eyeballs 100 until the pupil distance between the two simulated eyeballs 100 is adjusted to the target pupil distance, thereby facilitating the subsequent angle decomposition of the rotation of the first rotating component 230 and the second rotating component 240, and improving the motion control accuracy of the simulated eyeball 100.

[0402] In some embodiments, step 730, based on the eyeball coordinate information of the two simulated eyeballs 100 and the coordinate information of the target point, determining the first target angle and the second target angle that each simulated eyeball 100 needs to rotate to track the target point includes:

[0403] Based on the eyeball coordinate information and the coordinate information of the target point, determining the target pitch angle of the simulated eyeball 100 gazing at the target point;

[0404] Determine a first target angle of the simulated eyeball 100 based on the target pitch angle and the first included angle;

[0405] Based on the eyeball coordinate information, the coordinate information of the target point and the first target angle, a second target angle is determined.

[0406] In this embodiment, based on the eye coordinate information, the target pitch angle required for each simulated eye 100 to look at the target point can be calculated through the right-angle triangle algorithm of the pitch angle. The target pitch angle is used to characterize the angle between the line of sight of the pupil and the horizontal plane when the simulated eye 100 looks at the target point.

[0407] like Figure 6 As shown, by connecting the target point of the display screen 300 and the two simulated eyeballs 100, a triangle can be obtained. Through the right-angle triangle algorithm of the pitch angle, the target pitch angle of each simulated eyeball 100 looking at the target point can be calculated.

[0408] Based on the fact that the angle between the pupil's sight line emission direction and the horizontal plane is equal to the target pitch angle, trigonometric calculations can be performed to obtain the vertical coordinate information of the pupil's target position when the simulated eyeball 100 rotates to the target point.

[0409] It should be noted that there is a first angle between the axial direction of the first rotating component 230 and the line of sight emission direction of the simulated eyeball 100. The movement of the pupil position caused by the rotation of the first rotating component 230 is related to the first angle, that is, when calculating the first target angle, it is necessary to combine the first angle for calculation.

[0410] For example, there is a first angle of 45° between the first rotating component 230 and the line of sight of the simulated eyeball 100. When the target pitch angle range of the simulated eyeball 100 is -45°≤β≤45°, after conversion through the rectangular coordinate system and trigonometric functions, the first target angle can be obtained as -45°≤β≤45°. That is, when the first rotating component 230 rotates 360 degrees, it can drive the simulated eyeball 100 to adjust the pitch angle within the angle range of -45°≤β≤45°.

[0411] In actual implementation, the first rotating component 230 drives the simulated eyeball 100 to move axially around the first rotating component 230, driving the pupil to move from the current position to the target position of the gaze target point, and the first target angle is calculated based on the current position and the target position combined with the first angle.

[0412] It should be noted that the specific calculation and derivation of the target pitch angle by using the eyeball coordinate information and the coordinate information of the target point is derived by those skilled in the art based on the calculation principle of the angle between the line of sight emission direction and the horizontal plane, which will not be repeated here. It can be understood that when two simulated eyeballs 100 are placed side by side, corresponding to the left eye and the right eye of the human eye respectively, the eyeball coordinate information of the two simulated eyeballs 100 is different, and the target pitch angles corresponding to the two simulated eyeballs 100 are different, namely β-left and β-right, and the first target angle calculated in combination with the first angle is also different.

[0413] For example, Figure 6 As shown, two simulated eyeballs 100 are placed side by side, corresponding to the left eye and the right eye respectively. Driven by the first rotating component 230, the two simulated eyeballs 100 look at the target point c above the display screen 300. The two simulated eyeballs 100 correspond to pitch angles β-left and β-right respectively.

[0414] It can be understood that after the rotation angle of the first rotating component 230 is fixed, the rotation of the second rotating component 240 will not change the pitch angle of the simulated eyeball 100. After the first target angle is calculated, the coordinate information of the target point and the eye coordinate information of the simulated eyeball 100 are combined to calculate the second target angle.

[0415] In some embodiments, determining the second target angle based on the eyeball coordinate information, the target point coordinate information, and the first target angle may include:

[0416] Based on the first target angle and the movement trajectory of the pupil, determining the projection displacement deviation of the pupil on the horizontal plane before and after the first rotating component 230 rotates;

[0417] Based on the projection displacement deviation and the distance between the projection and the center of the eyeball, a second compensation angle is determined, and the second compensation angle compensates for the angular deviation of the pupil in the horizontal plane;

[0418] Determine the target azimuth of the simulated eyeball 100 on the horizontal plane based on the coordinate information of the target point and the coordinate information of the eyeball;

[0419] A second target angle is determined based on the second compensation angle and the target azimuth angle.

[0420] It should be noted that when the first rotating component 230 rotates to the first target angle, the vertical projection of the movement trajectory of the pupil of the simulated eyeball 100 to the horizontal plane will produce a certain displacement (i.e., projection displacement deviation), resulting in an angular deviation of the pupil in the horizontal azimuth. The second compensation angle is calculated to compensate for the angular deviation of the pupil in the horizontal plane caused by the first rotating component 230 rotating to the first target angle.

[0421] For example, Figure 8 As shown, circle R1 is a motion trajectory simulating a pupil rotation of the eyeball 100, and r is the radius of the plane where the pupil motion trajectory is located.

[0422] In this embodiment, the first rotating component 230 rotates the first target angle β, and the pupil moves from position K1 to position K2. According to the trigonometric function relationship within the circle, it can be calculated that the projection displacement deviation a1=r×cosβ generated by the pupil rotating at the first target angle in the horizontal plane caused by the first rotating component 230 can be obtained.

[0423] like Fig. 9 As shown, circle R2 is a vertical projection of the simulated eyeball 100, which can be regarded as a projection of the cross section of the second rotating component 240. The angle offset generated when the pupil moves from position K1 to position K2 is α1, that is, the second compensation angle is α1, and the distance between the projection and the center of the eyeball can be the distance between the plane where the actual movement trajectory of the pupil is located and the center of the eyeball.

[0424] In this embodiment, according to the projection displacement deviation a1 and the distance h1 between the projection and the eyeball center, the angle can be calculated by the trigonometric function relationship of the vertical projection. The second compensation angle α1 can be calculated by drawing an auxiliary dotted line.

[0425] A specific embodiment for calculating the second compensation angle α1 is introduced below.

[0426] like Figure 6 As shown, the axial directions of the first rotating parts 230 of the two simulated eyeballs 100 form a second angle of 90°, and the angle α between the plane perpendicular to the axial direction of the first rotating part 230 and the display screen 300 directly in front of the simulated eyeballs 100 is 45°.

[0427] The simulated eyeball 100 is offset and placed, and the angle formed by the maximum cross section of the simulated eyeball 100 and the display screen 300 in front can be calculated according to the second angle, and the following can be calculated according to the angle: Figure 6 The angle α between the auxiliary dotted line shown and the maximum cross section of the sphere.

[0428] The sum of the included angle α, the second compensation angle α1 and the angle γ is 90 degrees, and the second compensation angle α1 = 90° - α - γ.

[0429] When the axes of the first rotating components 230 of the two simulated eyeballs 100 form a second angle of 90°, the angle α between the plane perpendicular to the axis of the first rotating component 230 and the display screen 300 directly in front of the simulated eyeballs 100 is 45°.

[0430] In this embodiment, the first rotating member 230 rotates the first target angle P c After that, the second compensation angle of the second rotating member 240 in the horizontal direction is α1=45°-arctan(cosp c ).

[0431] It can be understood that the offset placement of the two simulated eyeballs 100 can leave a rotation space without interference for the simulated eyeball 100 and the first rotating component 230 and other structures. When the second rotating component 240 rotates, mechanical interference between the simulated eyeball 100 and the first rotating component 230 and other structures can be avoided, and the rotation of the two first rotating components 230 does not affect each other.

[0432] It should be noted that after the first rotating component 230 rotates to the first target angle, the angle between the line of sight of the simulated eyeball 100 and the horizontal plane reaches the target pitch angle. After the second rotating component 240 rotates to the second compensation angle for compensation, the pupil returns to its initial position in the horizontal direction, that is, the vertical coordinate of the pupil changes (forming a target pitch angle with the horizontal plane), but the horizontal coordinate remains unchanged. Based on this initial position and the coordinate information of the target point, the target azimuth can be calculated to complete all adjustments to the horizontal azimuth of the simulated eyeball 100.

[0433] It can be understood that the target azimuth angle is calculated based on the coordinate information of the pupil at the initial position and the target position of the gaze target point. The calculation of the target azimuth angle is independent of the second compensation angle. The second compensation angle can also be calculated first, and there is no limitation on the calculation order.

[0434] In this embodiment, when the simulated eyeball 100 is gazing at the target point, the eyeball center, pupil and target point are on the same straight line (line of sight exit direction), and the target azimuth angle α2 can be determined according to the coordinate information of the target point and the original eyeball coordinate information.

[0435] In this embodiment, the second target angle of the second rotating component 240 is equal to the sum of the second compensation angle and the target azimuth angle, that is, the second target angle Q c =α1+α2, when the first rotating component 230 rotates the first target angle and the second rotating component 240 rotates the second target angle, the line of sight of the pupil faces the target point, that is, the eyeball 100 is simulated to gaze at the target point.

[0436] A specific embodiment is described below.

[0437] like Fig.10 As shown, when the last single-axis / multi-axis movement of the eye tracking device is completed, it is determined whether the eye movement requires pupil distance adjustment, that is, whether the pupil distance between the two simulated eyeballs 100 is equal to 64 mm.

[0438] When the pupil distance between the two simulated eyeballs 100 is not equal to 64 mm, the pupil distance between the two simulated eyeballs 100 is adjusted to 64 mm through the third driving component.

[0439] The angle that the eyeball needs to move is calculated according to the current position and the target position, wherein the target position is the position of the simulated eyeball 100 when gazing at the target point of the display screen 300.

[0440] According to the eyeball coordinate information and the target point coordinate information, the horizontal and pitch rotation angles required for the left eye and the right eye are calculated, namely, the first target angle and the second target angle, wherein the first target angle of the first rotating component 230 of the left eye is 11.26°, the first target angle of the first rotating component 230 of the right eye is 10.19°, and the second target angles of the two second rotating components 240 are 15.02°.

[0441] Decompose and calculate the parameters that need to be adjusted for the drive motors of the two rotating axes, control the motors to complete the movement, obtain the motor state parameters, and determine whether the overall eye movement is completed.

[0442] In this embodiment, the pupil distance between the two simulated eyeballs 100 is first adjusted to make it meet the preset conditions with the target pupil distance, and then the action of the simulated eyeball 100 looking at the target point is disassembled into the rotation of the first rotating component 230 and the second rotating component 240, and the rotation of the first rotating component 230 and the second rotating component 240 are controlled respectively to realize the pitch angle rotation and the horizontal direction rotation, so that the simulated eyeball 100 looks at the target point on the display screen 300, accurately simulating the movement of the eyeball 100, and the eyeball movement control accuracy is high.

[0443] In some embodiments, the first rotating component 230 is driven by a first driving device, the second rotating component 240 is driven by a second driving device, and there are multiple target points; the eye tracking control method may further include:

[0444] After obtaining the coordinate information of multiple target points, determining the target motion type and the motion control parameters corresponding to the target motion type;

[0445] According to the target motion type, the first driving device and the second driving device are controlled to drive the first rotating component 230 and the second rotating component 240 respectively according to the motion control parameters.

[0446] In this embodiment, the target motion type of the target point can be identified by acquiring multiple coordinate information of the target point and analyzing the motion trajectory of the target point.

[0447] For example, the target point may be a point of a panning motion type, and the target point moves line by line on the display screen 300 .

[0448] For another example, the target point may be a point of a gaze motion type, and the target point on the display screen 300 is fixed.

[0449] For another example, the target point may be a point of a saccadic motion type, and the target point on the display screen 300 jumps randomly.

[0450] After determining the target motion type of the target point, the corresponding motion control parameters may be matched according to the target motion type of the target point. The motion control parameters may include parameters such as rotation amplitude, speed, acceleration, etc.

[0451] When the first rotating component 230 and the second rotating component 240 are controlled to rotate, motion control is performed based on the calculated first target angle and second target angle according to preset motion control parameters to simulate complex continuous eye movements that conform to the motion rules of the target motion type.

[0452] In this embodiment, based on a series of coordinate information of the target points, the movement type is automatically determined according to the distance and angle difference between the target points, and the corresponding movement parameters are matched. According to the preset movement control logic, the angle is automatically calculated to control the simulated eyeball 100 to perform corresponding movements.

[0453] A specific embodiment is described below.

[0454] like Fig.11 As shown, the motion data of the target points are output according to the coordinate information of multiple target points.

[0455] According to the motion data, the horizontal axis displacement interval is calculated. When the horizontal axis displacement interval is less than 0.1 mm, the motion type of the target point is determined to be a scanning mode.

[0456] When the horizontal axis displacement interval is greater than or equal to 0.1 mm, the position variance of each point is calculated. When the position variance of each point is less than 0.1 mm, the movement type of the target point is judged to be the gaze mode.

[0457] When the position variance of each point is greater than or equal to 0.1 mm, it is determined whether there are two adjacent points with a distance greater than 1 mm. When the distance between two adjacent points is greater than 1 mm, the motion type of the target point is determined to be a saccade mode.

[0458] After determining the movement type of the target point, the corresponding motion control parameters are matched according to the movement type, the motor rotation angle and speed of the two rotating axes are calculated, the motor movement process is started, and the eyeball movement is simulated until the movement data is read.

[0459] In this embodiment, the conjugate motion and convergence movement of the human eye are accurately simulated through motion type judgment and motion parameter matching. Not only can eye movements such as saccades, smooth pursuit, fixation and vestibular ocular reflex be simulated, but also convergence and divergence eye movements can be simulated, accurately simulating complex continuous eye movements.

[0460] In some embodiments, the target motion type is user input.

[0461] In this embodiment, the user inputs the target motion type of the target point, and the eye tracking device calculates the target angles of the two rotation axes for motion control based on the coordinate information of multiple target points and the motion control parameters corresponding to the target motion type.

[0462] In actual implementation, the user input corresponding to the target motion type can be a touch operation, including but not limited to a click operation, a sliding operation, and a pressing operation of an eye tracking device or other terminal device connected to the eye tracking device; it can also be a physical button input or a voice input.

[0463] Of course, in other embodiments, the user input corresponding to the target motion type may also be in other forms, including but not limited to character input, etc., which can be determined according to actual needs and is not limited in this embodiment of the present application.

[0464] In some embodiments, the target motion type is determined based on coordinate information of multiple target points.

[0465] In this embodiment, the eye tracking device automatically identifies the target motion type of the target point based on the coordinate information of multiple target points, and finds out the motion control parameters corresponding to the target motion type, and calculates the target angles of the two rotation axes for motion control according to the motion control parameters corresponding to the target motion type.

[0466] In some embodiments, the coordinate information of the target point can be obtained by the following steps:

[0467] Get the coordinate information of the target point entered by the user.

[0468] In this embodiment, the user inputs coordinate information of one or more target points.

[0469] In actual implementation, the user input corresponding to the coordinate information of the target point can be a touch operation, including but not limited to a click operation, a sliding operation, and a pressing operation of an eye tracking device or other terminal device connected to the eye tracking device; it can also be a physical button input or a voice input.

[0470] Of course, in other embodiments, the user input corresponding to the coordinate information of the target point may also be in other forms, including but not limited to character input, etc., which can be determined according to actual needs and is not limited in this embodiment of the present application.

[0471] In some embodiments, the coordinate information of the target point can be obtained by the following steps:

[0472] Get the image information of the target point;

[0473] Based on the image information of the target point, the coordinate information of the target point is determined.

[0474] In this embodiment, the eye tracking device can autonomously identify and obtain the coordinate information of the target point based on the image information of the target point.

[0475] In actual implementation, the eye tracking device can autonomously identify the coordinate information of the target point based on the image sequence of the target point, and can also identify the target motion type of the target point based on the coordinate information of multiple target points.

[0476] The eye tracking control method provided in the embodiment of the present application can be executed by an eye tracking control device. In the embodiment of the present application, the eye tracking control device executing the eye tracking control method is taken as an example to illustrate the eye tracking control device provided in the embodiment of the present application.

[0477] The embodiment of the present application also provides an eye tracking control device.

[0478] like Fig.12 As shown, the eye tracking control device includes:

[0479] The acquisition module 1210 is used to acquire eyeball coordinate information of two simulated eyeballs 100 and coordinate information of a target point to be tracked, and determine the pupil distance between the two simulated eyeballs 100 according to the eyeball coordinate information;

[0480] The first processing module 1220 is used to determine the first target angle and the second target angle that each simulated eyeball 100 needs to rotate to track the target point based on the eyeball coordinate information of the two simulated eyeballs 100 and the coordinate information of the target point when the pupil distance and the target pupil distance meet the preset conditions;

[0481] The second processing module 1230 is used to output a target control instruction based on the first target angle and the second target angle, control the first rotating component 230 to drive the simulated eyeball 100 to rotate the first target angle, and control the second rotating component 240 to drive the first rotating component 230 and the simulated eyeball 100 to rotate synchronously to the second target angle.

[0482] According to the eye tracking control device provided in the embodiment of the present application, the pupil distance between the two simulated eyeballs 100 is fixed, and the action of the simulated eyeball 100 looking at the target point is decomposed into the rotation of the first rotating component 230 and the second rotating component 240 by acquiring the coordinate information of the target point, and motion control is performed so that the simulated eyeball 100 looks at the target point, thereby improving the motion control accuracy of eye tracking, and accurately simulating complex eye movements through pitch angle rotation and horizontal rotation.

[0483] In some embodiments, the second processing module 1230 is used to determine the target pitch angle required for the simulated eyeball 100 to rotate when tracking the target point based on the eyeball coordinate information and the target point coordinate information;

[0484] Determine a first target angle of the simulated eyeball 100 based on the target pitch angle and the first included angle;

[0485] Based on the eyeball coordinate information, the coordinate information of the target point and the first target angle, a second target angle is determined.

[0486] In some embodiments, the second processing module 1230 is used to determine the projection displacement deviation of the pupil on the horizontal plane before and after the first rotating component 230 rotates based on the first target angle and the movement trajectory of the pupil;

[0487] Based on the projection displacement deviation and the distance between the projection and the center of the eyeball, a second compensation angle is determined, and the second compensation angle compensates for the angular deviation of the pupil in the horizontal plane;

[0488] Determine the target azimuth of the simulated eyeball 100 on the horizontal plane based on the coordinate information of the target point and the coordinate information of the eyeball;

[0489] A second target angle is determined based on the second compensation angle and the target azimuth angle.

[0490] In some embodiments, the first rotating component 230 is driven by a first driving device, the second rotating component 240 is driven by a second driving device, and there are multiple target points;

[0491] The second processing module 1230 is also used to determine the target motion type and the corresponding motion control parameters after obtaining the coordinate information of the multiple target points;

[0492] The second processing module 1230 is further used to control the first driving device and the second driving device to drive the first rotating component 230 and the second rotating component 240 respectively according to the motion control parameters according to the target motion type.

[0493] In some embodiments, the motion control parameters include rotation amplitude, speed, and acceleration.

[0494] In some embodiments, the target motion type is input by a user, or the target motion type is determined based on coordinate information of multiple target points.

[0495] In some embodiments, the acquisition module 1210 is used to acquire image information of a target point;

[0496] Based on the image information of the target point, determine the coordinate information of the target point;

[0497] Alternatively, obtain the coordinate information of the target point input by the user.

[0498] In some embodiments, the first processing module 1220 is further used to adjust the pupil distance between the two simulated eyeballs 100 until the pupil distance meets the preset condition when the pupil distance between the two simulated eyeballs 100 does not meet the target pupil distance.

[0499] The eye tracking control device in the embodiment of the present application can be an electronic device or a component in an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc. It can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0500] The eye tracking control device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an IOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0501] The eye tracking control device provided in the embodiment of the present application can achieve Figures 7 to 11 To avoid repetition, the various processes implemented by the method embodiment are not described here.

[0502] The embodiment of the present application also provides a testing device 1400 .

[0503] like Fig.14 As shown, the testing device 1400 includes the above-mentioned eye tracking device 1402 , a control device 1401 , a data recording module 1403 and a result analysis module 1404 .

[0504] The control device 1401 is connected to the eye tracking device 1402 , and the control device 1401 is used to control the simulated eyeball 100 movement of the eye tracking device 1402 so as to test the device to be tested.

[0505] Among them, the device to be tested may be an instrument for recording and analyzing human eye movements, which can determine information such as the position and duration of human eye gaze by measuring the position, speed and acceleration of the eyeball.

[0506] In this embodiment, an eye tracking device 1402 is used to replace a real human eye, and the device to be tested records the movement data of the simulated eyeball 100 in the eye tracking device 1402. Based on the movement data, parameters such as sensitivity, discreteness and stability of the device to be tested are determined.

[0507] The control device 1401 can define parameters such as the speed, acceleration, path and movement amplitude of the simulated eyeball 100, send instructions to the various driving devices of the eye tracking device 1402, and control the simulated eyeball 100 to achieve actions such as pitch angle rotation, horizontal rotation, pupil distance and height adjustment, and accurately simulate the multi-dimensional complex movement of the human eye.

[0508] In actual implementation, the control device 1401 can be connected to the motion controller of the eye tracking device 1402. The control device 1401 outputs a command signal to the motion controller, and the motion controller then sends commands to the first drive device, the second drive device and other drive devices to control the simulated eyeball 100 to achieve pitch angle rotation, horizontal rotation, pupil distance and height adjustment and other actions.

[0509] In this embodiment, the data recording module 1403 of the testing device 1400 is connected to the eye tracking device 1402 , and the data recording module 1403 includes a data collector and a testing device interface module.

[0510] The data collector is used to collect the eye movement data of the simulated eyeball 100, the test device interface module is connected to the device to be tested, and the test device interface module is used to collect the eye movement data recorded by the device to be tested.

[0511] The data collector is used to directly collect the motion data of the simulated eyeball 100. The test device interface module is connected to the device to be tested to record the motion data of the simulated eyeball 100 collected by the device to be tested. The sensitivity, discreteness and stability of the device to be tested are tested through the two motion data.

[0512] The result analysis module 1404 is connected to the data collector and the test device interface module respectively, and is used to test the accuracy of the device to be tested based on the eye movement data of the simulated eyeball 100 and the eye movement data recorded by the device to be tested.

[0513] Among them, testing the accuracy of the device to be tested refers to testing the precision and accuracy of the eye tracking of the device to be tested.

[0514] In some embodiments, the control device 1401 includes a parameter definition module and a motion control module.

[0515] The parameter definition module is connected to the motion control module, and the parameter definition module is used to input the eye movement parameters of the simulated eyeball 100 to determine the eye movement data of the simulated eyeball 100;

[0516] The motion control module is connected to the parameter definition module and the eye tracking device 1402 respectively. The motion control module is used to output the eye movement parameters to the eye tracking device 1402 to control the movement of the simulated eye 100 .

[0517] In this embodiment, the user inputs different eye movement parameters in the parameter definition module to control the simulated eye 100 to move.

[0518] In some embodiments, the eye movement data of the simulated eyeball 100 is obtained by analyzing the control device 1401 based on the target point to be tracked and the position information of the simulated eyeball 100 .

[0519] In this embodiment, the control device 1401 can control the simulated eyeball 100 to track the target point autonomously without manually inputting the relevant parameters of the target point.

[0520] The testing process of the testing device 1400 is described in detail below.

[0521] Step 1: Define test parameters.

[0522] Before conducting the test, the type and parameters of eye rotation are defined in the parameter definition module of the control device 1401, including a series of parameters such as the starting angle, the ending angle, the movement speed, the acceleration, the acceleration time, the deceleration, the deceleration time, and the movement trajectory, which are used for the subsequent motion control and data recording of the eye tracking device 1402.

[0523] Step 2: Motion control.

[0524] The motion control module of the control device 1401 controls the driving device of the eye tracking device 1402 to control and record the eye movement of the eye tracking device 1402 .

[0525] Step 3: Data recording.

[0526] The data acquisition device (data acquisition device unit) of the data recording module 1403 directly records the eye movement trajectory, speed, acceleration and other parameters of the simulated eyeball 100, and the test equipment interface module (test equipment interface unit) records the movement data of the simulated eyeball 100 collected by the device to be tested for subsequent data analysis and result comparison.

[0527] Step 4: Analyze test results.

[0528] The actual motion parameters of the eye tracking device 1402 and the motion parameters collected by the device under test are compared and analyzed to evaluate a series of parameters such as the accuracy, precision and discreteness of the device under test.

[0529] Compared with the traditional testing method (real human eye test), the testing device 1400 of the embodiment of the present application can measure multiple parameters such as rotation, speed, acceleration of the eyes in different directions, and can test the device to be tested more comprehensively. The eye tracking device 1402 simulates the rotation of the eyeball 100 with greater precision and stability. The control device 1401 can achieve accurate and reliable data recording and analysis, and the testing process is automated, which improves the test efficiency and has higher accuracy.

[0530] According to the test device 1400 provided in the embodiment of the present application, the device to be tested is tested by using the eye tracking device 1402. The eye tracking device 1402 can accurately simulate the complex multi-dimensional movements of the human eye and improve the accuracy of the eye movement test.

[0531] In some embodiments, Fig.13 As shown, an embodiment of the present application also provides an electronic device 1300, including a processor 1301, a memory 1302, and a computer program stored in the memory 1302 and executable on the processor 1301. When the program is executed by the processor 1301, the various processes of the above-mentioned test method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0532] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

[0533] An embodiment of the present application also provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various processes of the above-mentioned test method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0534] The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0535] An embodiment of the present application also provides a computer program product, including a computer program, which implements the above-mentioned testing method when executed by a processor.

[0536] The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0537] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0538] In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in a reverse order according to the functions involved. For example, the described methods may be performed in an order different from that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.

[0539] In the description of the present application, it should be understood that the terms "center", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "inside", "outside", "clockwise", "counterclockwise", "axial", etc., indicating orientations or positional relationships, are based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present application.

[0540] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials, or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0541] Although the embodiments of the present application have been shown and described, those skilled in the art will appreciate that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present application, and that the scope of the present application is defined by the claims and their equivalents.

Claims

1. A switchable test device, characterized in that: Used to test a device to be tested, the switchable test device comprises a simulated eyeball, a motion controller, a first drive component, a second drive component, and at least one test device mounted on the simulated eyeball; The motion controller is connected to the first motion drive component and the second drive component, and the first motion drive component and the second drive component are connected to the simulated eyeball; The motion controller is used to control the first motion drive assembly and the second drive assembly according to the test requirements, so as to drive the simulated eyeball and the test device to rotate synchronously until the target test device is switched to the test position; The target test device is one of the at least one test device.

2. The switchable test device according to claim 1, characterized in that: The at least one test device includes at least one of a first camera, a second camera, a high frequency luminance meter, and a near infrared radiation illuminance meter.

3. The switchable test device according to claim 2, characterized in that: The field of view angle range of the first camera is different from the field of view angle range of the second camera.

4. The switchable test device according to claim 3, characterized in that: The field of view angle of the first camera ranges from 0° to 30°, and the field of view angle of the second camera ranges from 0° to 120°.

5. The switchable test device according to claim 2, characterized in that: The target test device is the first camera, and the switchable test device is used to test at least one of the clarity, angular resolution, user eye movable range, pupil distance, convergence conflict, and binocular image accuracy of the device under test; And / or, the target test device is the second camera, and the switchable test device is used to test at least one of distortion, chromatic aberration, brightness / color uniformity, ghost image, contrast and large-field binocular combined imaging of the full field of view of the device under test; And / or, the target test device is the high-frequency luminance meter, and the switchable test device is used to test the binocular photo-to-photo delay of the device under test; And / or, the target test device is the near-infrared radiation illuminometer, and the switchable test device is used to test the illuminance of the near-infrared light source of the device to be tested on the cornea.

6. The switchable test device according to claim 2, characterized in that: The switchable test device comprises two simulated eyeballs, two first drive components and two second drive components, each simulated eyeball is connected to the corresponding first motion drive component and the corresponding second drive component, and each simulated eyeball is equipped with at least one test device; The motion controller is used to control the first motion drive component and the second drive component to drive the corresponding simulated eyeball and the corresponding test device to rotate synchronously until the corresponding target test device is switched to a test position.

7. The switchable test device according to claim 6, characterized in that: The target test devices on the two simulated eyeballs are both the first cameras; The switchable testing device is used to test at least one of the clarity, pupil distance, user eye movable range, binocular image formation, and convergence conflict of the device under test.

8. The switchable test device according to claim 6, characterized in that: The two target test devices on the simulated eyeball are respectively the first camera and the second camera; The switchable test device is used to test the dynamic distortion of the device under test; or, while the first camera is used to test at least one of the clarity, angular resolution, and user eye movable range of the device under test, the second camera is used to test at least one of the chromatic aberration, brightness / color uniformity, contrast, and ghost images of the full field of view of the device under test.

9. The switchable test device according to claim 6, characterized in that: The two target test devices on the simulated eyeball are respectively the high-frequency luminance meter and the second camera; The switchable testing device is used to test the ghost image of the device under test.

10. The switchable test device according to claim 6, characterized in that: The target test devices on the two simulated eyeballs are both the high-frequency luminance meters; The switchable test device is used to test the binocular photo-to-photo delay or binocular refresh rate consistency of the device under test.

11. The switchable test device according to claim 6, characterized in that: The target test devices on the two simulated eyeballs are both the near-infrared radiation illuminometers; The switchable testing device is used to test the damage of the infrared light source of the device under test to human eyes.

12. The switchable test device according to any one of claims 1 to 11, characterized in that: The first driving assembly includes a first driving device and a first rotating component; the first driving device is connected to the motion controller, the first driving device is drivingly connected to the first rotating component, and the first rotating component is connected to the simulated eyeball, wherein the first rotating component is used to drive the simulated eyeball to move axially around the first rotating component to adjust the pitch angle of the simulated eyeball; The second driving assembly includes a second driving device and a second rotating component, the second driving device is connected to the motion controller, the second driving device and the second rotating component are drivingly connected, the second rotating component is connected to the simulated eyeball and the first rotating component, wherein the second rotating component is used to drive the simulated eyeball and the first rotating component to move axially around the second rotating component to adjust the horizontal azimuth angle of the simulated eyeball.

13. The switchable test device according to claim 12, characterized in that: The rotation axis of the first rotating component is not parallel to the rotation axis of the second rotating component and the two rotation axes are located on two non-parallel planes, so as to ensure that the first rotating component and the second rotating component rotate in coordination according to the test requirements to drive the simulated eyeball to rotate, so that the test device on the simulated eyeball is switched to the test position.

14. The switchable test device according to claim 12, characterized in that: A line connecting the pupil of the simulated eyeball and the center of the eyeball forms a first angle with the rotation axis of the first rotating component.

15. The switchable test device according to claim 12, characterized in that: The maximum rotation angle of the second rotating component is determined based on the pupil distance of the two simulated eyeballs.

16. The switchable test device according to claim 12, characterized in that: The maximum rotation angle of the first rotating component is 360 degrees, and the maximum rotation angle of the second rotating component is less than 360 degrees.

17. The switchable test device according to claim 12, characterized in that: The switchable testing device further comprises a third driving assembly and two eyeball bases corresponding to the two simulated eyeballs; The first rotating component is connected to the corresponding simulated eyeball via the corresponding eyeball base, and the second rotating component is connected to the corresponding first rotating component and the corresponding simulated eyeball via the corresponding eyeball base and drives the two to rotate synchronously; The third driving assembly is connected to the two eyeball bases respectively; The third driving component is used to drive the two eyeball bases to move towards or opposite to each other under the control of the motion controller to adjust the distance between the two simulated eyeballs.

18. The switchable test device according to claim 17, characterized in that The switchable testing device further comprises a fourth drive assembly connected to the two eyeball bases, and the fourth drive assembly is also connected to the motion controller; The fourth driving component is used to drive the eyeball base to move along the axial direction of the second rotating component to adjust the height of the simulated eyeball under the control of the motion controller.

19. The switchable test device according to any one of claims 1 to 11, characterized in that: The motion controller is also used to control the first drive component and the second drive component to drive the simulated eyeball to rotate according to different test requirements, so as to switch the target test device on the simulated eyeball.

20. A testing method, characterized in that: Used to test the device under test, the testing method includes: In response to the test requirements, determining a target test device; Controlling the movement of the first driving assembly and the second driving assembly to drive the simulated eyeball and the test device to rotate synchronously until the target test device is switched to a test position; Controlling the target test device to test the device under test at the test position; Wherein, at least one of the test devices is mounted on the simulated eyeball, and the target test device is one of the at least one test device.

21. The method according to claim 20, characterized in that After controlling the target test device to test the device under test at the test position, the method further includes: The test information of the target test device is acquired, and a test result for the test requirement of the device under test is determined according to the test information.

22. The testing method according to claim 20, characterized in that: The test requirements include testing clarity, angular resolution, user eye movable range, pupil distance, convergence conflict, binocular image accuracy, full field distortion, chromatic aberration, brightness / color uniformity, ghost images, contrast, large field binocular image, binocular photo-to-photo delay, binocular refresh rate consistency, illumination of near-infrared light source on cornea, and damage of infrared light source to human eyes. The test device includes at least one of a first camera, a second camera, a high-frequency luminance meter, and a near-infrared radiation illuminometer; wherein a field of view angle range of the first camera is different from a field of view angle range of the second camera.

23. The testing method according to claim 22, characterized in that: The number of the simulated eyeball is one, and according to the test requirements, determining the target test device includes: The test requirement is to test at least one of the clarity, angular resolution, user eye movable range, pupil distance, convergence conflict, and binocular image accuracy of the device under test, and the target test device is determined to be the first camera; The test requirement is to test at least one of distortion, chromatic aberration, brightness / color uniformity, ghost image, contrast and large-field binocular imaging of the full field of view of the device under test, and determine that the target test device is the second camera; The test requirement is to test the binocular photo-to-photo delay of the device under test, and the target test device is determined to be the high-frequency brightness meter; The test requirement is to test the illumination of the near-infrared light source of the device under test on the cornea, and determine that the target test device is the near-infrared radiation illuminometer.

24. The testing method according to claim 22, characterized in that: The number of the simulated eyeballs is two, each of which is equipped with the test device. According to the test requirements, determining the target test device includes: The test requirement is to test at least one of the clarity, pupil distance, movable range of the user's eyes, binocular image formation, and convergence conflict of the device under test, and to determine that both target test devices on the two simulated eyeballs are the first cameras; The test requirement is to test the dynamic distortion of the device under test, or the test requirement is to test at least one of the clarity, angular resolution, and movable range of the user's eyes of the device under test, and at the same time test at least one of the chromatic aberration, brightness / color uniformity, contrast, and ghost images of the full field of view of the device under test, and determine that the two target test devices on the simulated eyeballs are the first camera and the second camera respectively; The test requirement is to test the ghost image of the device under test, and determine that the target test devices on the two simulated eyeballs are the high-frequency brightness meter and the second camera respectively; the test requirement is to test the binocular Photo-to-photo delay or binocular refresh rate consistency of the device under test, and determine that the target test devices on the two simulated eyeballs are both the high-frequency brightness meter; The test requirement is to test the damage of the infrared light source of the device under test to the human eye, and to determine that the target test devices on the two simulated eyeballs are both the near-infrared radiation illuminance meters.

25. The testing method according to claim 24, characterized in that: The test requirement is to test the pupil distance of the device under test, and the target test devices on the two simulated eyeballs are both the first cameras; wherein the field of view angle range of the first camera is 0 to 30°; The controlling the target test device to test the device under test at the test position includes: Rotating and adjusting the positions of the two simulated eyeballs respectively so that the optical axes of the first cameras on the two simulated eyeballs are parallel; Determining that the distances between the entrance pupils of the first cameras on the two simulated eyeballs and the corresponding visual devices in the device under test are the same; Adjusting the positions of the two simulated eyeballs by translation so that the first cameras on the two simulated eyeballs are aligned with the MTF centers of the corresponding visual devices; The pupil distance between the two simulated eyeballs is obtained, and the pupil distance is used as the pupil distance of the device to be tested.

26. The testing method according to claim 24, characterized in that: The test requirement is to test the movable range of the eyes of the user of the device under test, and the target test devices on the two simulated eyeballs are both the first cameras; wherein the field of view angle range of the first camera is 0 to 30°; The controlling the target test device to test the device under test at the test position includes: Controlling the two simulated eyeballs to rotate so that the simulated eyeballs rotate to multiple viewing angles of the device under test; wherein each viewing angle has a corresponding azimuth angle; In each set of the field of view angle and the azimuth angle, performing a focusing operation on the two first cameras to ensure that the images in the two first cameras are clear; In each set of the field of view angle and the azimuth angle, the two simulated eyeballs are controlled to translate along the direction corresponding to the azimuth angle, and during the translation, the MTF of the corresponding visual device in the device under test is tested using the first camera; When the MTF of the visual device meets a preset threshold, the two simulated eyeballs are controlled to stop translating, the translation amounts of the two simulated eyeballs are recorded respectively, and the two simulated eyeballs are controlled to move in a direction approaching or away from the device under test, so as to test the three-dimensional area of ​​the movable range of the user's eyes of the device under test, and obtain the movable range of the user's eyes of the device under test corresponding to each field of view angle.

27. The testing method according to claim 24, characterized in that: The test requirement is to test the clarity of the device under test, and the target test devices on the two simulated eyeballs are both the first cameras; wherein the field of view angle range of the first camera is 0 to 30°; The controlling the target test device to test the device under test at the test position comprises: Controlling the two simulated eyeballs to rotate so that the simulated eyeballs rotate to multiple viewing angles of the device under test; wherein each viewing angle has a corresponding azimuth angle; In each set of the field of view angle and the azimuth angle, performing a focusing operation on the two first cameras to ensure that the images in the two first cameras are clear; In each set of the field of view angle and the azimuth angle, using the first camera to test the MTF of the corresponding visual device in the device under test; The clarity of the device under test is determined according to the MTF of the visual device.

28. The testing method according to claim 24, characterized in that: The test requirement is to test the binocular image of the device under test, and the target test devices on the two simulated eyeballs are both the first camera; wherein the field of view angle range of the first camera is 0 to 30°; The controlling the target test device to test the device under test at the test position includes: Controlling the two simulated eyeballs to rotate so that the simulated eyeballs rotate to multiple viewing angles of the device under test; wherein each viewing angle has a corresponding azimuth angle; In each set of the field angle and the azimuth angle, recording a first angle β_left and a second angle β_right of two simulated eyeballs rotating in the vertical direction; According to the first angle β_left and the second angle β_right, the binocular combination accuracy β_left-β_right corresponding to the field of view angle and the azimuth angle is calculated.

29. The testing method according to claim 24, characterized in that: The test requirement is to test the convergence conflict of the device under test, and the target test devices on the two simulated eyeballs are both the first cameras; wherein the field of view angle range of the first camera is 0 to 30°; The controlling the target test device to test the device under test at the test position comprises: Controlling the two simulated eyeballs to rotate so that the simulated eyeballs rotate to multiple viewing angles of the device under test; wherein each viewing angle has a corresponding azimuth angle; In each set of field angles and azimuth angles, record the third angle α_left and the fourth angle α_right of the two simulated eyeballs rotating in the horizontal direction, the pupil distance i, and the first virtual image distance VID_left and the second virtual image distance VID_right obtained by the two first cameras tested; Calculate the combined image distance D of the two first cameras according to the third angle α_left, the fourth angle α_right and the pupil distance i; The convergence conflict corresponding to each of the field of view angles is calculated according to the combined image distance D and an average value of the first virtual image distance VID_left and the second virtual image distance VID_right.

30. The testing method according to claim 24, characterized in that: The test requirement is to test the dynamic distortion of the device under test, and the two target test devices on the simulated eyeballs are the first camera and the second camera respectively; wherein the field of view angle range of the first camera is 0 to 30°, and the field of view angle of the second camera is 0 to 120°; The controlling the target test device to test the device under test at the test position comprises: Controlling the first camera and the second camera to respectively align with the left and right optical axes of the device under test; In a stationary state, using the second camera to obtain a first static distortion at each position in the global image; Calculating, based on the image acquired by the second camera, position information of a target point in the acquired image relative to the first camera; Determining a rotation angle of the first camera according to the position information; According to the rotation angle, controlling the simulated eyeball where the first camera is located to rotate, and adjusting the rotation axis of the simulated eyeball, so that the first camera is aimed at different target points, and using the first camera to obtain a second dynamic distortion corresponding to each of the target points; The dynamic distortion of the device under test is determined according to the first static distortion and the second dynamic distortion corresponding to each of the target points.

31. The testing method according to claim 24, characterized in that: The test requirement is to test the color and brightness of the ghost image of the device under test, and the two target test devices on the simulated eyeballs are the second camera and the high-frequency brightness meter; wherein the field of view of the second camera is 0 to 120°; The controlling the target test device to test the device under test at the test position comprises: Controlling the second camera to acquire a global image, and identifying the position of a ghost image, and using the position of the ghost image as a target point; According to the position information of the target point, controlling the simulated eyeball where the high-frequency brightness meter is located to rotate so that the high-frequency brightness meter is aligned with the target point; The color and brightness of the ghost image are tested by using the high-frequency luminance meter, and the test result is used as the color and brightness of the ghost image of the device under test.

32. The testing method according to claim 24, characterized in that: The test requirement is to test the damage of the infrared light source of the device under test to the human eye, and the target test devices on the two simulated eyeballs are both near-infrared radiation illuminance meters; The controlling the target test device to test the device under test at the test position comprises: Controlling the two simulated eyeballs to rotate so as to utilize each simulated eyeball to traverse all the viewing angles corresponding to the device under test; Using the near-infrared radiation illuminometer installed on each of the simulated eyeballs to test the illuminance of the infrared light source of the device to be tested in real time; The damage of the infrared light source of the device under test to human eyes is determined according to the illumination of the infrared light source of the device under test and a preset illumination threshold.

33. The testing method according to any one of claims 20 to 32, characterized in that: The test method also includes: In response to different test requirements, the first drive assembly and the second drive assembly are controlled to drive the simulated eyeball to rotate so as to switch the target test device located at the test position.

34. An electronic device, characterized in that: The invention comprises a processor, a memory and a computer program stored in the memory and executable on the processor, wherein the program implements the testing method according to any one of claims 20 to 33 when executed by the processor.

35. A non-transitory computer-readable storage medium, characterized in that: The non-transitory computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the testing method according to any one of claims 20 to 33 is implemented.

36. A computer program product, characterized in that The invention comprises a computer program, which implements the testing method according to any one of claims 20 to 33 when executed by a processor.

Images