Eye tracker, eye tracker assembly system, eye tracker measurement method and storage medium

Abstract

The invention relates to the technical field of head-mounted display equipment, in particular to an eye tracker, an eye tracker assembly system, an eye tracker measurement method and a storage medium, the eye tracker comprises a main shell, an auxiliary shell, an eye movement module, a light emitting module and an elastic connection module; wherein the eye movement module is mounted on the main shell; the light-emitting module is arranged on the side, where the eye movement module is installed, of the main shell and electrically connected with the eye movement module. The first end of the main shell is fixedly connected with the first end of the auxiliary shell through the elastic connecting module, and the second end of the main shell is fixedly connected with the second end of the auxiliary shell through the elastic connecting module. The eye tracker designed by the invention can be assembled with any type of head-mounted display equipment, so that the universality of the eye tracker is effectively improved.

Description

Technical Field

[0001] The present application relates to the technical field of head-mounted display devices, and particularly to an eye tracker, an eye tracker assembly system, an eye tracker measurement method, and a storage medium. Background Art

[0002] With the continuous progress of VR (Virtual Reality) technology or AR (Augmented Reality) technology, users have put forward higher requirements for the visual effects of head-mounted display devices, and eye movement data is crucial for the visual effects and content design of head-mounted display devices.

[0003] At present, there are a variety of head-mounted display devices on the market, but not all head-mounted display devices are equipped with an eye tracker (i.e., an eye movement tracking accessory), and the eye movement tracking accessories on the market are only customized for single-model products and cannot be used universally with various head-mounted display devices. That is to say, the existing eye movement tracking accessories have the technical problem of poor universality. Summary of the Invention

[0004] The main purpose of the present application is to provide an eye tracker, an eye tracker assembly system, an eye tracker measurement method, and a storage medium, aiming to improve the universality of the eye tracker.

[0005] To achieve the above object, the present application provides an eye tracker, which includes: a main housing, a sub-housing, an eye movement module, a light-emitting module, and an elastic connection module; wherein,

[0006] The eye movement module is installed on the main housing;

[0007] The light-emitting module is disposed on one side of the main housing where the eye movement module is installed and is electrically connected to the eye movement module;

[0008] The first end of the main housing is fixedly connected to the first end of the sub-housing through the elastic connection module, and the second end of the main housing is fixedly connected to the second end of the sub-housing through the elastic connection module.

[0009] Optionally, the light-emitting module includes a flexible cable;

[0010] The flexible cable is laid on one side of the main housing where the eye movement module is installed and is electrically connected to the eye movement module;

[0011] The flexible cable is also laid on the cable layout side of the sub-housing, and the cable layout side is the same side as the side of the main housing where the eye movement module is installed.

[0012] Optionally, the light-emitting module further includes a plurality of light-emitting components, and the plurality of light-emitting components are evenly arranged side by side at intervals on the flexible cable and are electrically connected to the flexible cable.

[0013] Optionally, the elastic connection module includes a spring module and a connecting shaft. Among them, the spring module includes a first spring component, a second spring component, and a third spring component;

[0014] The first round hook of the first spring component is fixedly connected to the first end of the main housing by snap connection, the second round hook of the first spring component is fixedly connected to the first end of the sub-housing by snap connection, the first round hook of the second spring component is fixedly connected to the second end of the main housing by snap connection, the first round hook of the third spring component is fixedly connected to the second end of the sub-housing by snap connection, the second round hook of the second spring component is fixedly connected to the first hole position of the connecting shaft by snap connection, and the second round hook of the third spring component is fixedly connected to the second hole position of the connecting shaft by snap connection.

[0015] Optionally, the eye tracker further includes a silica gel pad;

[0016] The silica gel pad is press-fitted into the interior of the first hole position and the interior of the second hole position for fixedly connecting the second round hook of the second spring component to the first hole position and fixedly connecting the second round hook of the third spring component to the second hole position;

[0017] The silica gel pad is arranged on the side opposite to the side where the main housing installs the eye movement module, and the silica gel pad is also arranged on the silica gel pad arrangement side of the sub-housing and the silica gel pad arrangement side of the connecting shaft; among them,

[0018] The silica gel pad arrangement side of the sub-housing and the silica gel pad arrangement side of the connecting shaft are both on the same side of the side opposite to the side where the main housing installs the eye movement module.

[0019] Optionally, the eye tracker further includes a data processing module and a storage module;

[0020] The data processing module is externally arranged outside the main housing and is electrically connected to the eye movement module;

[0021] The storage module is integrated in the data processing module; and / or,

[0022] The storage module is externally arranged outside the data processing module and is electrically connected to the data processing module.

[0023] In addition, to achieve the above object, the present application further provides an eye tracker assembly system, and the eye tracker assembly system includes the eye tracker according to any one of the above, and a head-mounted display device;

[0024] The eye tracker assembly system is used to perform a pulling operation on the secondary housing and the connecting shaft after the main housing is snap-fixed to the barrel wall of the head-mounted display device, so as to obtain a triangular fastening structure constructed by the mutual acting forces among the main housing, the secondary housing, and the connecting shaft, and the triangular fastening structure is fixedly connected to the barrel wall of the head-mounted display device.

[0025] In addition, to achieve the above object, the present application further provides an eye tracker measurement method, characterized in that the eye tracker measurement method is applied to the eye tracker as described in any one of the above, and / or the eye tracker assembly system as described above;

[0026] The eye tracker measurement method includes:

[0027] After the eye tracker is assembled to the barrel wall of the head-mounted display device, the corneal reflection spot is obtained by the eye tracker, and the mirror distance between the mirror surface of the eye tracker and the display mirror surface of the head-mounted display device is obtained;

[0028] After the user correctly wears the head-mounted display device, based on the corneal reflection spot, the light propagation distance of the incident light source of the light-emitting component from the corneal position to the mirror surface of the eye tracker is determined, and the exit pupil distance of the head-mounted display device is determined based on the light propagation distance and the mirror distance.

[0029] Optionally, after the step of obtaining the corneal reflection spot by the eye tracker, the eye tracker measurement method further includes:

[0030] Eye movement tracking is performed based on the corneal reflection spot to obtain the position of the key points of the wearer's eye corners, and coordinate transformation is performed on the position of the key points of the eye corners to obtain the relative displacement of the head-mounted display device relative to the wearer;

[0031] When the relative displacement matches the eye box size of the head-mounted display device, it is determined that the wearing firmness of the head-mounted display device is qualified.

[0032] In addition, to achieve the above object, the present application further provides a storage medium, the storage medium is a computer-readable storage medium, and an eye tracker measurement program is stored on the computer-readable storage medium. When the eye tracker measurement program is executed by a processor, the steps of the above eye tracker are implemented.

[0033] The present application designs an eye tracker that can be adapted to a variety of head-mounted display devices. The eye tracker includes a main housing, a sub-housing, an eye movement module, a light-emitting module, and an elastic connection module. Among them, the eye movement module is installed on the main housing, the light-emitting module is arranged on one side of the main housing where the eye movement module is installed, and the main housing and the sub-housing are fixed through the elastic connection module. That is, the eye tracker is automatically adapted to the head-mounted display device through the spring force of the elastic connection module. Specifically, through the spring force of the elastic connection module, the main housing, the sub-housing, and the elastic connection module can automatically fit on the barrel wall of the head-mounted display device that needs to be measured. That is, the size of the eye tracker can be automatically adjusted according to the product model of the head-mounted display device and assembled with various product models of head-mounted display devices, avoiding the phenomenon of poor versatility of the eye tracker in the prior art due to being restricted by the product models of head-mounted display devices and requiring multiple customized eye trackers to be assembled with corresponding product models of head-mounted display devices. That is, the eye tracker designed in the present application can be assembled with any model of head-mounted display device, effectively improving the versatility of the eye tracker and thus greatly facilitating the use of users. Brief Description of the Drawings

[0034] Figure 1 is a schematic structural diagram of the first embodiment of the eye tracker of the present application;

[0035] Figure 2 is a schematic structural diagram of the eye tracker involved in the embodiment solution of the present application;

[0036] Figure 3 is a schematic diagram of an application scenario of the eye tracker involved in the embodiment solution of the present application;

[0037] Figure 4 is a schematic diagram of the flow of the measurement method of the eye tracker involved in the embodiment solution of the present application;

[0038] Figure 5 is a schematic diagram of another application scenario of the eye tracker involved in the embodiment solution of the present application.

[0039] Description of the Reference Numerals in the Drawings:

[0040] Label Name Label Name 100 Eye tracker 10 Main housing 20 Sub housing 30 Eye movement module 40 Light-emitting module 50 Elastic connection module 501 Connecting shaft 5021 First spring assembly 5022 Second spring assembly 5023 Third spring assembly 401 Flexible cable 402 Light-emitting component M10 Spring protective sleeve M20 Spring 70 Data processing module 80 Storage module 200 Head-mounted display device 60 Silicone pad T10 Eye tracker assembly system

[0041] The realization of the purpose, functional features, and advantages of the present application will be further described with reference to the embodiments and the accompanying drawings. Detailed Embodiments

[0042] Exemplary embodiments will be described in detail herein, and examples thereof are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0043] It should be noted that in this document, the terms "comprising", "including" or any other variant thereof are intended to cover non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article or device. Without further limitation, an element defined by the phrase "comprising a..." does not exclude the presence of additional identical elements in the process, method, article or device comprising such element. In addition, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined based on their explanations in the specific embodiments or further in combination with the context of the specific embodiments.

[0044] It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from each other. For example, without departing from the scope of this document, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "when" or "upon" or "in response to determining". Furthermore, as used herein, the singular forms "a", "an" and "the" are also intended to include the plural forms unless the context indicates otherwise. It should be further understood that the terms "comprising", "including" indicate the presence of the stated features, steps, operations, elements, components, items, kinds, and / or groups, but do not exclude the presence, occurrence or addition of one or more other features, steps, operations, elements, components, items, kinds, and / or groups. The terms "or", "and / or", "including at least one of the following" and the like used in the present application may be interpreted inclusively, or mean any one or any combination. For example, "including at least one of the following: A, B, C" means "any one of the following: A; B; C; A and B; A and C; B and C; A and B and C", and again, "A, B or C" or "A, B and / or C" means "any one of the following: A; B; C; A and B; A and C; B and C; A and B and C". An exception to this definition occurs only when the combination of elements, functions, steps or operations is mutually exclusive in some way.

[0045] It should be understood that although the steps in the flowcharts in the embodiments of the present application are shown in sequence according to the indications of the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless there is a clear indication in this article, the execution of these steps has no strict order restriction, and they can be executed in other orders. Moreover, at least a part of the steps in the figure may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be executed alternately or in turn with at least a part of other steps or sub-steps or stages of other steps.

[0046] Depending on the context, the words "if" and "when" as used herein may be interpreted as "when" or "while" or "in response to determining" or "in response to detecting". Similarly, depending on the context, the phrase "if determined" or "if detecting (stated condition or event)" may be interpreted as "when determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)".

[0047] It should be noted that in this article, step codes such as S10 and S20 are adopted. The purpose is to more clearly and briefly express the corresponding content and do not constitute a substantial limitation in terms of order. Those skilled in the art may execute S20 first and then S10 during specific implementation, etc., but these should all be within the protection scope of the present application.

[0048] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0049] In the following description, suffixes such as "module", "component", or "unit" used to represent elements are only for the convenience of explaining the present application and have no specific meaning in themselves. Therefore, "module", "component", or "unit" can be used interchangeably.

[0050] An embodiment of the present application provides an eye tracker 100, as shown in Figure 1 shown Figure 1 is a schematic structural diagram of the first embodiment of the eye tracker of the present application.

[0051] The eye tracker 100 of the present application includes: a main housing 10, a secondary housing 20, an eye movement module 30, a light-emitting module 40, and an elastic connection module 50. Among them, the eye movement module 30 is installed on the main housing 10; the light-emitting module 40 is disposed on one side of the main housing 10 where the eye movement module 30 is installed and is electrically connected to the eye movement module 30; the first end of the main housing 10 is fixedly connected to the first end of the secondary housing 20 through the elastic connection module 50, and the second end of the main housing 10 is fixedly connected to the second end of the secondary housing 20 through the elastic connection module 50.

[0052] In this embodiment, the eye movement module 30 includes a camera and a camera circuit board. The camera is encapsulated on the camera circuit board, and the image acquisition device is fixed to the main housing 10 by fixing means such as hot melting, screws, and buckles to prevent the eye movement module 30 from shaking during image acquisition. Then, the light-emitting module 40 is disposed on one side of the main housing 10 where the eye movement module 30 is installed and is electrically connected to the eye movement module 30, so that the eye movement module 30 can be used to capture in real time the corneal reflection spot generated by the light source of the light-emitting module 40 irradiating the cornea, and a mechanical connection loop between the main housing 10 and the secondary housing 20 is constructed through the elastic connection module 50.

[0053] It should be noted that the head-mounted display device can be understood as a product prototype, which can be understood as a verification model without functions in the design stage. The product prototype can be, for example, a Mixed Reality (MR) product, an Augmented Reality (AR) product, a Virtual Reality (VR) product, an Extended Reality (XR) product, or a combination thereof. Moreover, most of the VR / AR / MR / XR lens barrels of the above product prototypes are prototypes or elliptical. The diameter range of the VR / AR / MR / XR lens barrels can be 45 - 65 mm, but the diameter range of the VR / AR / MR / XR lens barrels can also be customized according to the user's needs, and the present application does not make any restrictions in this regard. In addition, the head-mounted display device is not only a product prototype but also compatible with non-functional prototypes, functional prototypes, actual products, etc., and adapts to all stages of the research and development of the head-mounted display device, and the present application does not make any restrictions in this regard.

[0054] In one embodiment, the elastic connection module 50 may include a spring module and a connecting shaft 501. A mechanical connection loop is constructed via the main housing 10, the sub-housing 20, and the connecting shaft 501 through the spring module. When the eye tracker 100 needs to be assembled to the head-mounted display device, first, the main housing 10 is clamped on the barrel wall of the head-mounted display device to be measured, and then the elastic force of the spring module is used to pull the sub-housing 20 and the connecting shaft 501, so that the main housing 10, the sub-housing 20, and the connecting shaft 501 contact the barrel wall to be measured, so that the eye tracker 100 designed in this application can automatically adapt to different-shaped and different-diameter barrels by stretching the spring module. That is, the eye tracker 100 designed in this application can be applied to the collection of eye movement data of head-mounted display devices of different product models, effectively improving the versatility of the eye tracker 100.

[0055] Further, in some feasible embodiments, the light-emitting module 40 includes a flexible cable 401;

[0056] The flexible cable 401 is disposed on one side of the main housing 10 where the eye movement module 30 is installed and is electrically connected to the eye movement module 30;

[0057] The flexible cable 401 is also disposed on the cable arrangement side of the sub-housing 20, and the cable arrangement side is the same side as the side of the main housing 10 where the eye movement module 30 is installed.

[0058] In this embodiment, refer to Figure 2 , Figure 2 is a schematic structural diagram of the eye tracker involved in the embodiment solution of this application. The flexible cable 401 is disposed on one side of the main housing 10 where the eye movement module 30 is installed and is electrically connected to the eye movement module 30, so as to timely feedback the light-emitting signal of the light-emitting module 40 to the eye movement module 30. At this time, the eye movement module 30 automatically triggers the camera to take a real-time shot of the corneal reflection spot generated by the light source of the light-emitting module 40 irradiating the cornea according to the received light-emitting signal. In addition, as Figure 2 shows, the flexible cable 401 is also disposed on the cable arrangement side of the sub-housing 20, and the cable arrangement side is the same side as the side of the main housing 10 where the eye movement module 30 is installed, thus providing a stable power supply path for a plurality of light-emitting components 402 provided on the subsequent sub-housing.

[0059] Further, in some other feasible embodiments, the light-emitting module 40 further includes a plurality of light-emitting components 402, and the plurality of light-emitting components 402 are evenly arranged side by side at intervals on the flexible cable 401 and are electrically connected to the flexible cable 401.

[0060] In this embodiment, the light-emitting component 402 can be a circular-shaped LED lamp. That is, the LED lamp can be regarded as a point light source, and multiple point light sources are arranged side by side at uniform intervals on the flexible cable 401, so that the light emitted by the light-emitting component 402 can be uniform and sufficient. The number of the light-emitting components 402 is not limited herein.

[0061] Further, in some feasible embodiments, the elastic connection module 50 includes a spring module and a connecting shaft 501. Among them, the spring module includes a first spring assembly 5021, a second spring assembly 5022, and a third spring assembly 5023;

[0062] The first circular hook of the first spring assembly 5021 is fixedly connected to the first end of the main housing 10 by snap connection, the second circular hook of the first spring assembly 5021 is fixedly connected to the first end of the sub-housing 20 by snap connection, the first circular hook of the second spring assembly 5022 is fixedly connected to the second end of the main housing 10 by snap connection, the first circular hook of the third spring assembly 5023 is fixedly connected to the second end of the sub-housing 20 by snap connection, the second circular hook of the second spring assembly 5022 is fixedly connected to the first hole position of the connecting shaft 501 by snap connection, and the second circular hook of the third spring assembly 5023 is fixedly connected to the second hole position of the connecting shaft 501 by snap connection.

[0063] In this embodiment, the first spring assembly 5021, the second spring assembly 5022, and the third spring assembly 5023 can be spring devices with the same product model. Among them, the spring device includes a spring protection sleeve M10 and a spring M20. The spring M20 passes through the opening of the spring protection sleeve M10, thereby effectively reducing the loss rate of the spring M20. That is, in this application, the spring M20 is protected by the spring protection sleeve M10, effectively extending the service life of the spring M20.

[0064] It should be noted that the first spring assembly 5021, the second spring assembly 5022, and the third spring assembly 5023 can also be spring devices with different product models.

[0065] In another embodiment, cylinders fixedly connected to the circular hooks in the spring device are provided at both the head and tail ends of the main housing 10. The cylinders are fixedly provided in a protruding shape at both the head and tail ends of the main housing 10; cylinders fixedly connected to the circular hooks in the spring device are also provided at both the head and tail ends of the sub-housing 20. The cylinders are fixedly provided in a protruding shape at both the head and tail ends of the sub-housing 20.

[0066] It should be noted that the first end of the main housing 10 can be the head end of the main housing 10 or the tail end of the main housing 10. That is, when the first end of the main housing 10 is the head end of the main housing 10, the second end of the main housing 10 is the tail end of the main housing 10. Additionally, the first end of the auxiliary housing 20 can be the head end of the auxiliary housing 20 or the tail end of the main and auxiliary housing 20. That is, when the first end of the auxiliary housing 20 is the head end of the auxiliary housing 20, the second end of the auxiliary housing 20 is the tail end of the auxiliary housing 20.

[0067] Furthermore, in some other feasible embodiments, the eye tracker further includes a silica gel pad 60;

[0068] The silica gel pad 60 is press-fitted into the interior of the first hole position and the interior of the second hole position, and is used for fixedly connecting the second round hook of the second spring assembly 5022 with the first hole position, and fixedly connecting the second round hook of the third spring assembly 5023 with the second hole position;

[0069] The silica gel pad 60 is arranged on the side opposite to the side where the main housing 10 mounts the eye movement module 30. The silica gel pad 60 is also arranged on the silica gel pad arrangement side of the auxiliary housing 20 and the silica gel pad arrangement side of the connecting shaft; wherein, the silica gel pad arrangement side of the auxiliary housing 20 and the silica gel pad arrangement side of the connecting shaft 501 are on the same side of the side opposite to the side where the main housing mounts the eye movement module.

[0070] In this embodiment, the silica gel pad 60 is press-fitted into the interior of the first hole position and the interior of the second hole position, that is, the silica gel pad 60 is extruded into the interior of the first hole position and the second hole position for interference connection. Among them, interference connection means that the interference value after the cooperation of the first hole position / second hole position and the silica gel pad 60 reaches a tight connection. Specifically, after the silica gel pad 60 is extruded into the interior of the first hole position and the second hole position, the diameter of the silica gel pad 60 is compressed, and the diameter of the first hole position / second hole position is enlarged, so that the silica gel pad 60 undergoes elastic deformation, and then pressure is generated on the mating surface of the first hole position / second hole position and the silica gel pad 60, thereby obtaining a tight connection.

[0071] In another embodiment, a silica gel pad 60 is disposed on the opposite side of the main housing 10 where the eye movement module 30 is installed, on the side of the silica gel pad arrangement of the secondary housing 20, and on the side of the silica gel pad arrangement of the connecting shaft 501. That is, the main housing 10 is clamped on the barrel wall of the head-mounted display device to be measured, and then the elastic force of the spring module is used to pull the secondary housing 20 and the connecting shaft 501, so that the silica gel pads on the main housing 10, the silica gel pads on the secondary housing 20, and the silica gel pads on the connecting shaft 501 contact the barrel wall of the head-mounted display device to be measured, and the gap between the eye tracker 100 and the barrel wall of the head-mounted display device to be measured is filled by the silica gel pads, so that an elastic pressure is generated between the surface of the eye tracker 100 and the surface of the barrel wall. The elastic pressure generated between the surface of the eye tracker 100 and the surface of the barrel wall can firmly connect the eye tracker 100 to the barrel wall of the head-mounted display device to be measured, thereby realizing the adaptation of the eye tracker 100 to head-mounted display devices of different product models and effectively improving the versatility of the eye tracker 100.

[0072] Further, in some feasible embodiments, the eye tracker 100 further includes a data processing module 70 and a storage module 80;

[0073] The data processing module 70 is externally disposed outside the main housing 10 and is electrically connected to the eye movement module 30;

[0074] The storage module 80 is integrated in the data processing module 70; and / or,

[0075] The storage module 80 is externally disposed outside the data processing module 70 and is electrically connected to the data processing module 70.

[0076] In this embodiment, referring to Figure 3 , Figure 3 , is a schematic diagram of an application scenario of an eye tracker involved in the embodiment solution of the present application. The data processing module 70 may be a central processing device, and the central processing device may be an MCU or a CPU, which is used to perform eye movement tracking analysis on the corneal reflection light spots captured by the eye tracker 100. Specifically, the central processing device performs eye movement tracking analysis on the corneal reflection light spots captured by the eye tracker 100, and can accurately obtain the eye movement data of the wearer, the positions of the key points of the corners of the eyes, and the exit pupil distance of the head-mounted display device. Among them, the eye movement data includes, but is not limited to, the blink frequency, pupil size, and line of sight direction of the wearer.

[0077] In summary, the present application designs an eye tracker that can be adapted to a variety of head-mounted display devices. The eye tracker 100 includes a main housing 10, a sub-housing 20, an eye movement module 30, a light-emitting module 40, and an elastic connection module 50. Among them, the eye movement module 30 is installed on the main housing 10, the light-emitting module 40 is arranged on one side of the main housing 10 where the eye movement module 30 is installed, and the main housing 10 and the sub-housing 20 are fixed through the elastic connection module 50, that is, the eye tracker 100 is automatically adapted to the head-mounted display device through the spring force of the elastic connection module 50. Specifically, due to the spring force of the elastic connection module 50, the main housing 10, the sub-housing 20, and the elastic connection module 50 can automatically fit on the barrel wall of the head-mounted display device to be measured. That is, the size of the eye tracker 100 can be automatically adjusted according to the product model of the head-mounted display device for assembly with various product models of head-mounted display devices, avoiding the phenomenon of poor versatility of the eye tracker in the prior art where multiple eye trackers need to be customized for assembly with corresponding product models of head-mounted display devices due to the constraint of the product model of the head-mounted display device. That is, the eye tracker 100 designed in the present application can be assembled with any model of head-mounted display device, effectively improving the versatility of the eye tracker 100 and thus greatly facilitating the use of users.

[0078] Further, based on the first embodiment of the eye tracker of the present application, a second embodiment of the application of the eye tracker of the present application in an eye tracker assembly system is proposed.

[0079] Referring to Figure 3 , the eye tracker assembly system T10 of the present application includes the above-mentioned eye tracker 100 and a head-mounted display device 200;

[0080] The eye tracker assembly system T10 is used to perform a pulling operation on the sub-housing 20 and the connecting shaft 501 after the main housing 10 is snap-fixed on the barrel wall of the head-mounted display device 200, so as to obtain a triangular fastening structure constructed by the mutual acting forces among the main housing 10, the sub-housing 20, and the connecting shaft 501, and the triangular fastening structure is fixedly connected to the barrel wall.

[0081] In this embodiment, when assembling the eye tracker and the head-mounted display device 200 to be measured, the eye tracker assembly system T10 first snap-fixes the main housing 10 to the barrel wall of the head-mounted display device 200 to be measured, and then pulls the sub-housing 20 and the connecting shaft 501, that is, uses the elastic force of the spring module to make the silicone pads on the main housing 10, the silicone pads on the sub-housing 20, and the silicone pads on the connecting shaft 501 contact the barrel wall of the head-mounted display device to be measured. Then, by using the pressure of the silicone pads and the elastic force of the spring, a stable triangular fastening structure is formed, so that the eye tracker 100 is firmly connected to the barrel wall of the head-mounted display device to be measured, thereby realizing the adaptation of the eye tracker 100 to head-mounted display devices 200 of different product models, and effectively improving the versatility of the eye tracker 100.

[0082] Furthermore, based on the first embodiment of the eye tracker of the present application and the second embodiment of the application of the eye tracker of the present application in the eye tracker assembly system, the present application also provides an eye tracker measurement method, which is applied to the above-mentioned eye tracker and / or the above-mentioned eye tracker assembly system.

[0083] Referring to Figure 4 , Figure 4 is a schematic flowchart of the eye tracker measurement method involved in the embodiment solution of the present application. The eye tracker measurement method of the present application may include the following implementation steps:

[0084] Step S10: After the eye tracker 100 is assembled to the barrel wall of the head-mounted display device 200, obtain the corneal reflection spot through the eye tracker 100, and obtain the mirror distance between the mirror surface of the eye tracker 100 and the display mirror surface of the head-mounted display device.

[0085] In this embodiment, referring to Figure 5 , Figure 5 is another application scenario schematic diagram of the eye tracker involved in the embodiment solution of the present application. After the eye tracker 100 is assembled to the barrel wall of the head-mounted display device 200, the eye movement module 30 takes a real-time photo of the corneal reflection spot generated by the light source of the light-emitting module 40 irradiating the cornea of the wearer. Then, the data processing module 70 in the eye tracker 100 measures the distance from the mirror surface of the eye tracker 100 to the display mirror surface of the head-mounted display device based on the captured corneal reflection spot, and can accurately obtain the mirror distance between the mirror surface of the eye tracker 100 and the display mirror surface of the head-mounted display device 200.

[0086] It should be noted that the mirror surface of the eye tracker 100 can be understood as the lens mirror surface of the camera in the eye movement module 30. In addition, the display mirror surface of the head-mounted display device can be understood as the lens mirror surface assembled on the barrel of the head-mounted display device 200.

[0087] Step S20: After the user correctly wears the head-mounted display device, based on the corneal reflection spot, determine the light propagation distance of the incident light source of the light-emitting component from the corneal position to the mirror surface of the eye tracker, and determine the exit pupil distance of the head-mounted display device 200 based on the light propagation distance and the mirror surface distance.

[0088] In this embodiment, after the data processing module 70 receives the corneal reflection spot captured by the camera in the eye movement module 30, measure the light propagation distance of the incident light source in the corneal reflection spot from the corneal position to the mirror surface of the eye tracker, and then calculate the difference between the light propagation distance and the mirror surface distance, the exit pupil distance of the head-mounted display device 200 can be accurately obtained, so that the user can detect the clarity of the image imaging of the head-mounted display device 200 in real time according to the measured exit pupil distance.

[0089] It should be noted that the incident light source can be understood as the light source emitted by the light-emitting component 402.

[0090] In addition, it should be noted that the expression formula of the exit pupil distance of the head-mounted display device 200 is shown in formula (1):

[0091] ER (Eye Relif) = a - b formula (1);

[0092] Wherein, ER is the exit pupil distance of the head-mounted display device 200, a is the light propagation distance of the incident light source of the light-emitting component from the corneal position to the mirror surface of the eye tracker, and b is the mirror surface distance between the mirror surface of the eye tracker 100 and the display mirror surface of the head-mounted display device 200.

[0093] In another embodiment, when the exit pupil distance matches the preset clear imaging distance, determine that the clear imaging degree of the head-mounted display device is qualified. Specifically, determine the error allowable range corresponding to the preset clear imaging distance, judge whether the exit pupil distance is within the error allowable range, if the exit pupil distance is within the error allowable range, determine that the exit pupil distance matches the preset clear imaging distance, and output the information that the clear imaging degree of the head-mounted display device is qualified, that is, the clear imaging degree of the head-mounted display device is qualified.

[0094] Furthermore, in some feasible embodiments, after step 10 above: obtaining the corneal reflection spot through the eye tracker 100, the eye tracker measurement method may further include the following implementation steps:

[0095] Step A100: Perform eye movement tracking based on the corneal reflection spot to obtain the position of the key points of the wearer's eye corners, and perform coordinate transformation on the position of the key points of the eye corners to obtain the relative displacement of the head-mounted display device relative to the wearer.

[0096] In this embodiment, eye movement tracking is performed based on the corneal reflection spot, and the positions of the key points at the corners of the wearer's eyes can be accurately obtained. Coordinate transformation is performed on the positions of the key points at the corners of the eyes, and the relative displacement of the head-mounted display device relative to the wearer can be accurately obtained.

[0097] Step A200: When the relative displacement matches the eye box size of the head-mounted display device 200, it is determined that the wearing firmness of the head-mounted display device is qualified.

[0098] In this embodiment, the relative displacement (average c) is compared with half of the eye box size of the head-mounted display device 200. If average c ≤ half of the eye box size, when the relative displacement matches the eye box size of the head-mounted display device 200, it can be further determined that the wearing firmness of the head-mounted display device is qualified.

[0099] It should be noted that the eye box size (i.e., Eye Box) can be understood as a conical area between the display mirror surface of the head-mounted display device and the wearer's eyeball, and it is also the area where the display content is the clearest.

[0100] In another embodiment, if average c > half of the eye box size, it can be determined that the wearing firmness of the head-mounted display device is poor.

[0101] In summary, the eye tracker 100 designed in this application can adapt to lens barrels with different shapes and diameters through a stretched spring module, and can be applied to the collection of eye movement data of head-mounted display devices of different product models, effectively improving the versatility of the eye tracker 100. And when the eye tracker 100 is worn on the human body, the displacement of the head-mounted display device as a whole relative to the human head and face can be judged through the eye feature points, achieving the effect of testing the wearing firmness of the head-mounted display device. In addition, the eye movement module can cooperate with the product prototype (i.e., the head-mounted display device) to measure the exit pupil distance data of the design model to judge whether the design of the product prototype is reasonable, effectively saving the customization cost of the eye tracker that needs to be customized to be consistent with the product prototype model.

[0102] In addition, the present invention also provides a storage medium, the storage medium is a computer-readable storage medium, and an eye tracker measurement program is stored on the computer-readable storage medium. The eye tracker measurement program is executed by a processor to perform the following eye tracker measurement operations:

[0103] After the eye tracker is assembled on the barrel wall of the head-mounted display device, the corneal reflection spot is obtained through the eye tracker, and the mirror distance between the mirror surface of the eye tracker and the display mirror surface of the head-mounted display device is obtained;

[0104] Based on the corneal reflection spot, determine the light propagation distance from the incident light source of the light-emitting component to the mirror surface of the eye tracker, and determine the exit pupil distance of the head-mounted display device based on the light propagation distance and the mirror distance.

[0105] Further, the eye tracker measurement program is further executed by the processor to perform the following eye tracker measurement operations:

[0106] Perform eye movement tracking based on the corneal reflection spot to obtain the position of the key points at the corners of the wearer's eyes, and perform coordinate transformation on the position of the key points at the corners of the eyes to obtain the relative displacement of the head-mounted display device relative to the wearer.

[0107] When the relative displacement matches the eye box size of the head-mounted display device, determine that the wearing firmness of the head-mounted display device is qualified.

[0108] The specific implementation manner of the computer-readable storage medium of the present invention is basically the same as that of the above-mentioned embodiments of the eye tracker measurement method, and will not be described in detail here.

[0109] It can be understood that the above scenarios are only examples and do not constitute a limitation on the application scenarios of the technical solutions provided by the embodiments of the present application. The technical solutions of the present application can also be applied to other scenarios. For example, as known to those of ordinary skill in the art, with the evolution of the system architecture and the emergence of new service scenarios, the technical solutions provided by the embodiments of the present application are equally applicable to similar technical problems.

[0110] The serial numbers of the above embodiments of the present application are only for description and do not represent the advantages or disadvantages of the embodiments.

[0111] The steps in the method of the embodiments of the present application can be adjusted, combined, and deleted according to actual needs.

[0112] The units in the devices of the embodiments of the present application can be combined, divided, and deleted according to actual needs.

[0113] In the present application, for the description of the same or similar term concepts, technical solutions, and / or application scenarios, generally only the first detailed description is made when it appears for the first time. When it appears repeatedly later, for the sake of brevity, it is generally not repeated. When understanding the technical solutions and other contents of the present application, for the same or similar term concepts, technical solutions, and / or application scenarios that are not detailed later, reference can be made to the relevant detailed descriptions before.

[0114] In the present application, the descriptions of the various embodiments have their own emphases. For the parts not detailed or recorded in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0115] The technical features of the technical solution of the present application can be combined arbitrarily. For the sake of concise description, not all possible combinations of the various technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope recorded in the present application.

[0116] Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium as described above (such as ROM / RAM, magnetic disk, optical disk), and includes several instructions for causing a terminal device (which can be a mobile phone, computer, server, controlled terminal, or network device, etc.) to execute the methods of each embodiment of the present application.

[0117] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions according to the embodiments of the present application are generated in whole or in part. The computer can be a general computer, a special computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website, computer, server, or data center to another website, computer, server, or data center by wire (such as coaxial cable, optical fiber, digital subscriber line) or wirelessly (such as optical, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that the computer can access or a data storage device such as a server or data center that includes one or more integrated available media. The available medium can be a magnetic medium (such as a floppy disk, storage disk, magnetic tape), an optical medium (such as a DVD), or a semiconductor medium (such as a solid state disk (SSD)), etc.

[0118] The above are only the preferred embodiments of the present application, and do not limit the patent scope of the present application accordingly. Any equivalent structural or equivalent process transformation made by using the content of the specification and drawings of the present application, or directly or indirectly applied in other related technical fields, shall be included in the patent protection scope of the present application by the same token.

Claims

1. An eye tracker, characterized in that: The eye tracker comprises: a main housing, a sub-housing, an eye movement module, a light emitting module and an elastic connection module; wherein, The eye movement module is installed on the main housing; The light emitting module is arranged on a side of the main housing where the eye movement module is installed, and is electrically connected to the eye movement module; The first end of the main shell is fixedly connected to the first end of the auxiliary shell through the elastic connection module, and the second end of the main shell is fixedly connected to the second end of the auxiliary shell through the elastic connection module.

2. The eye tracker according to claim 1, characterized in that: The light-emitting module includes a flexible cable; The flexible cable is arranged on a side of the main housing where the eye-tracking module is installed, and is electrically connected to the eye-tracking module; The flexible cable is also arranged on the cable arrangement side of the auxiliary shell, and the cable arrangement side is the same side of the main shell where the eye movement module is installed.

3. The eye tracker according to claim 2, characterized in that: The light-emitting module further comprises a plurality of light-emitting components, and the plurality of light-emitting components are evenly arranged side by side at intervals on the flexible cable and are electrically connected to the flexible cable.

4. The eye tracker according to claim 3, characterized in that: The elastic connection module comprises a spring module and a connecting shaft, wherein the spring module comprises a first spring component, a second spring component and a third spring component; The first circular hook of the first spring assembly is fixedly connected with the first end of the main housing by snapping, the second circular hook of the first spring assembly is fixedly connected with the first end of the auxiliary housing by snapping, the first circular hook of the second spring assembly is fixedly connected with the second end of the main housing by snapping, the first circular hook of the third spring assembly is fixedly connected with the second end of the auxiliary housing by snapping, the second circular hook of the second spring assembly is fixedly connected with the first hole of the connecting shaft by snapping, and the second circular hook of the third spring assembly is fixedly connected with the second hole of the connecting shaft by snapping.

5. The eye tracker according to claim 4, characterized in that: The eye tracker also includes a silicone pad; The silicone pad is interference-fitted into the inside of the first hole and the inside of the second hole, and is used to fix the second round hook of the second spring assembly to the first hole, and to fix the second round hook of the third spring assembly to the second hole; The silicone pad is arranged on the opposite side of the main housing where the eye-tracking module is installed, and the silicone pad is also arranged on the silicone pad arrangement side of the auxiliary housing and the silicone pad arrangement side of the connecting shaft; wherein, The silicone pad arrangement side of the auxiliary shell and the silicone pad arrangement side of the connecting shaft are both on the same side of the main shell opposite to the side where the eye movement module is mounted.

6. The eye tracker according to claim 1, characterized in that: The eye tracker also includes a data processing module and a storage module; The data processing module is externally arranged outside the main housing and is electrically connected to the eye movement module; The storage module is integrated into the data processing module; and / or, The storage module is externally arranged outside the data processing module and is electrically connected to the data processing module.

7. An eye tracker assembly system, characterized in that: The eye tracker assembly system comprises an eye tracker as claimed in any one of claims 1 to 6, and a head-mounted display device; The eye tracker assembly system is used to pull the sub-shell and the connecting shaft after the main shell is snap-fastened to the barrel wall of the head-mounted display device, so as to obtain a triangular fastening structure constructed by the interaction force between the main shell, the sub-shell and the connecting shaft, and the triangular fastening structure is fixedly connected to the barrel wall of the lens barrel.

8. An eye tracker measurement method, characterized in that: The eye tracker measurement method is applied to the eye tracker according to any one of claims 1 to 6, and / or the eye tracker assembly system according to claim 7; The eye tracker measurement method comprises: After the eye tracker is assembled on the barrel wall of the head-mounted display device, the corneal reflection spot is obtained by the eye tracker, and the mirror distance between the mirror surface of the eye tracker and the display mirror surface of the head-mounted display device is obtained; After the user correctly wears the head-mounted display device, the light propagation distance of the incident light source of the light-emitting component from the corneal position to the mirror surface of the eye tracker is determined based on the corneal reflection light spot, and the exit pupil distance of the head-mounted display device is determined based on the light propagation distance and the mirror surface distance.

9. The eye tracker measurement method according to claim 8, characterized in that: After the step of obtaining the corneal reflection spot by the eye tracker, the eye tracker measurement method further includes: Performing eye tracking based on the corneal reflection spot to obtain the key point positions of the eye corners of the wearer, and performing coordinate transformation on the key point positions of the eye corners to obtain the relative displacement of the head mounted display device relative to the wearer; When the relative displacement matches the eye box size of the head mounted display device, it is determined that the wearing firmness of the head mounted display device is qualified.

10. A storage medium, the storage medium being a computer-readable storage medium, characterized in that: An eye tracker measurement program is stored on the computer-readable storage medium, and when the eye tracker measurement program is executed by the processor, the steps of the eye tracker measurement method according to any one of claims 8 to 9 are implemented.

Images