Eye movement tracking module and near-eye display equipment
By integrating and adapting eye tracking modules of different forms on smart glasses, the problem that existing smart glasses cannot adapt to eye tracking in different forms is solved, and widely applicable eye tracking functions are achieved, improving user experience and device reliability.
Patent Information
- Application Number
- CN202311778905.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-12-21
- Publication Date
- 2025-06-24
- Estimated Expiration
- 2043-12-21
AI Technical Summary
Due to the large differences in morphological characteristics of existing smart glasses, the existing eye movement tracking devices can only be adapted to specific shapes of smart glasses, and cannot meet the eye movement tracking needs of different shapes of smart glasses.
An eye tracking module and a near-eye display device are provided. The module is composed of a flexible circuit board, a light emitting component and an imaging module. Combined with a clamping method of rail + nut step tightening, it can adapt to different forms of optical modules to realize the eye tracking function.
This makes most near-eye display devices have eye tracking functions, which improves the experience of human-computer interaction, reduces user fatigue, and saves space through modular design and reduces the risk factor for equipment use.
Smart Images

Figure CN120195871A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of near-eye display, and particularly to an eye movement tracking module and a near-eye display device. Background Art
[0002] Near-eye display devices such as augmented reality (AR) or virtual reality (VR) are wearable devices for near-eye display, and have gradually gained wide market applications. Currently, in the process of human-computer interaction of existing near-eye display devices, the user usually observes or selects different targets in a virtual scene by turning the head or manual operation. However, in the face of a relatively complex scene or when it is necessary to change the selection scene multiple times, the user needs to turn the head or perform manual operations multiple times, which easily increases the user's fatigue and reduces the experience of human-computer interaction.
[0003] Since the eye muscles are immune to fatigue (moving the eyes does not feel tired), human-computer interaction through eye movement can reduce user fatigue. In addition, with the development of fixation rendering technology, by capturing the user's fixation point, image enhancement is performed on the fixation point area to present high-quality images, while weakening the images in non-fixation point areas, so as to reduce the hardware requirements of the device or application while improving the data processing speed.
[0004] However, existing smart glasses usually do not have an eye movement tracking function and cannot meet the requirements of eye movement interaction. In order to enable existing smart glasses to have an eye movement tracking function, an eye movement tracking device has emerged on the market at present, which can be detachably installed on existing smart glasses to realize the application of eye movement tracking technology. However, due to the large differences in the morphological characteristics of existing smart glasses, and this eye movement tracking device can only be adapted to smart glasses of a specific form, so how to enable smart glasses of different forms to have an eye movement tracking function is a technical problem that urgently needs to be solved at present. Summary of the Invention
[0005] One advantage of the present invention is to provide an eye movement tracking module and a near-eye display device, which can be adapted to optical modules of different forms, so that most near-eye display devices have an eye movement tracking function.
[0006] Another advantage of the present invention is to provide an eye movement tracking module and a near-eye display device, wherein, in one embodiment of the present invention, the eye movement tracking module can save and optimize local rendering resources in the human-computer interaction scenario of the near-eye display device, and improve the product experience of the near-eye display device.
[0007] Another advantage of the present invention lies in providing an eye movement tracking module and a near-eye display device. Among them, in one embodiment of the present invention, the eye movement tracking module can be clamped to most near-eye display modules by means of a guide rail + nut step tightening, with strong applicability, simple structure, and small volume.
[0008] Another advantage of the present invention lies in providing an eye movement tracking module and a near-eye display device. Among them, in one embodiment of the present invention, the near-eye display device can, through modular design, not only save the usage space of the device but also reduce the risk coefficient during device use, ensuring the comfort of data collection and use.
[0009] Another advantage of the present invention lies in providing a near-eye display device. In order to achieve the above advantages, expensive materials or complex structures are not required in the present invention. Therefore, the present invention successfully and effectively provides a solution, not only providing a simple near-eye display device but also increasing the practicality and reliability of the near-eye display device.
[0010] In order to achieve at least one of the above advantages or other advantages and purposes of the present invention, the present invention provides an eye movement tracking module for enabling a near-eye display module to have an eye movement tracking function, including:
[0011] An eye movement tracking component, including a flexible circuit board for electrically connecting to the near-eye display module, a plurality of light-emitting components electrically connected to the flexible circuit board, and an imaging module electrically connected to the flexible circuit board; the flexible circuit board has an annular structure, and the plurality of light-emitting components are circumferentially arranged on the flexible circuit board; and
[0012] An eye movement clamping component, including a pair of eye movement frames and a pair of spacing adjustment mechanisms; the two eye movement frames are arranged end-to-end at intervals and fixedly connected to the flexible circuit board; the two spacing adjustment mechanisms are respectively arranged between the ends of the two eye movement frames to adjust the end spacing between the two eye movement frames, for forming an adjustable clamping space adapted to the optical module of the near-eye display module between the two eye movement frames.
[0013] According to an embodiment of the present application, the spacing adjustment mechanism includes a guide member and an adjustment nut. The guide member has a fixed end fixedly connected to the end of one eye movement frame and a sliding end slidably connected to the end of the other eye movement frame; the adjustment nut passes through the end of the other eye movement frame and is threadedly connected to the sliding end of the guide member for limiting the maximum end spacing between the two eye movement frames.
[0014] According to an embodiment of the present application, the eye movement frame has a sliding groove matching the sliding end of the guiding member, and the sliding end of the guiding member is slidably inserted into the sliding groove of the eye movement frame; the adjusting nut slidably penetrates through the sliding groove and is threadedly connected to the sliding end.
[0015] According to an embodiment of the present application, the spacing adjusting mechanism further includes an elastic member, and the elastic member is disposed between the ends of the two eye movement frames; the elastic member is a spring accommodated within the sliding groove, and the spring is sleeved on the adjusting nut; one end of the spring abuts against the guiding member, and the other end of the spring abuts against the bottom of the sliding groove.
[0016] According to an embodiment of the present application, the eye movement clamping assembly further includes a flexible gasket and a locking ball, and the flexible gasket is fixed to the eye movement frame; the eye movement frame is provided with a threaded hole matching the locking ball, and the locking ball is threadedly connected to the eye movement frame to protrude from the threaded hole.
[0017] According to an embodiment of the present application, the eye movement frame includes an arc-shaped frame for fixedly mounting the flexible circuit board, an adjusting end portion radially extending outward from the arc-shaped frame, and a clamping arm body axially extending forward from the arc-shaped frame; the guiding member is fixedly connected to the adjusting end portion of one eye movement frame, and the sliding groove is provided in the adjusting end portion of the other eye movement frame; the flexible gasket is bonded to the inner surface of the clamping arm body, and the threaded hole is provided in the clamping arm body of the eye movement frame, so that the locking ball threadedly connected to the threaded hole penetrates through the flexible gasket.
[0018] According to an embodiment of the present application, the flexible circuit board includes an annular plate body, a plurality of mounting plate bodies obliquely extending forward from the inner edge of the annular plate body, and a connecting plate body extending forward from the outer edge of the annular plate body; the light-emitting member and the imaging module are respectively electrically mounted on the rear side of the mounting plate body; the two eye movement frames are spaced apart and mounted on the front side of the annular plate body; the eye movement frame further has a positioning groove provided in the arc-shaped frame, and the mounting plate body correspondingly fits into the positioning groove of the arc-shaped frame.
[0019] According to an embodiment of the present application, the light-emitting member is an infrared light source; the imaging module is an infrared camera.
[0020] According to an embodiment of the present application, the eye movement tracking module further includes a pair of light-transmitting covers, and each light-transmitting cover correspondingly covers the eye movement frame to cover the eye movement tracking assembly.
[0021] According to another aspect of the present application, an embodiment of the present application further provides a near-eye display device, including:
[0022] A near-eye display module, including a head-mounted frame and a pair of optical modules assembled on the head-mounted frame; and
[0023] The eye movement tracking module as described in any one of the above, and the eye movement tracking module correspondingly clamps the optical module. Description of the Drawings
[0024] Figure 1 A three-dimensional schematic diagram of a near-eye display device according to an embodiment of the present invention;
[0025] Figure 2 An exploded schematic diagram of the near-eye display device according to the above embodiment of the present invention;
[0026] Figure 3 A three-dimensional schematic diagram of the eye movement tracking module in the near-eye display device according to the above embodiment of the present invention;
[0027] Figure 4 A three-dimensional schematic diagram of the eye movement tracking module from another perspective according to the above embodiment of the present invention;
[0028] Figure 5 An exploded schematic diagram of the eye movement tracking module according to the above embodiment of the present invention;
[0029] Figure 6 A front view schematic diagram of the eye movement tracking module according to the above embodiment of the present invention;
[0030] Figure 7 Shows Figure 6 A cross-sectional schematic diagram taken along line A-A in the eye movement tracking module shown;
[0031] Figure 8 Shows Figure 6 A cross-sectional schematic diagram taken along line B-B in the eye movement tracking module shown.
[0032] Description of Main Component Symbols: 1. Eye Tracking Module; 10. Eye Tracking Component; 11. Flexible Circuit Board; 111. Ring Plate Body; 112. Mounting Plate Body; 113. Connecting Plate Body; 12. Light Emitting Component; 120. Infrared Light Source; 13. Imaging Module; 130. Infrared Camera; 20. Eye Movement Clamping Component; 200. Adjustable Clamping Space; 21. Eye Frame; 2101. Slide Slot; 2102. Threaded Hole; 2103. Positioning Slot; 211. Arc Frame Body; 212. Adjusting End; 213. Clamping Arm Body; 22. Spacing Adjustment Mechanism; 221. Guide Component; 2211. Fixed End; 2212. Slide End; 222. Adjusting Nut; 223. Elastic Component; 2230. Spring; 23. Flexible Gasket; 24. Locking Ball; 30. Transparent Cover Plate; 5. Near-Eye Display Module; 51. Head Mounting Frame Body; 52. Optical Module.
[0033] The above description of main component symbols further elaborates on the present invention in conjunction with the accompanying drawings and specific embodiments. Specific Embodiments
[0034] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of the present invention.
[0035] Those skilled in the art should understand that in the disclosure of the present invention, the orientation or positional relationships indicated by the terms "longitudinal", "transverse", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc. are based on the orientation or positional relationships shown in the accompanying drawings. It is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation. Therefore, the above terms should not be construed as limiting the present invention.
[0036] In the present invention, the term "one" in the claims and the specification should be understood as "one or more". That is, in one embodiment, the number of an element can be one, while in other embodiments, the number of the element can be multiple. Unless it is clearly indicated in the disclosure of the present invention that the number of the element is only one, the term "one" should not be understood as being unique or single, and the term "one" should not be construed as a limitation on the number.
[0037] In the description of the present invention, it should be understood that terms such as "first", "second", etc. are only for descriptive purposes and cannot be construed as indicating or implying relative importance. In the description of the present invention, it should be noted that unless otherwise clearly specified and defined, terms such as "connected" and "coupled" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through a medium. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.
[0038] In the description of this specification, the description with reference to terms such as "one embodiment", "some embodiments", "example", "specific example", or "some examples", etc. means that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described can be combined in a suitable manner in any one or more embodiments or examples. In addition, without contradiction, those skilled in the art can combine and combine the different embodiments or examples described in this specification and the features of different embodiments or examples.
[0039] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those of ordinary skill in the technical field to which the present invention belongs. The terms used in the description of the present invention in this specification are only for the purpose of describing specific embodiments and are not intended to limit the present invention. The term "or / and" used herein includes any and all combinations of one or more of the related listed items.
[0040] Considering that there are significant differences in the morphological characteristics of existing smart glasses, and existing eye tracking devices can only be adapted to smart glasses of specific forms, the technical problem that urgently needs to be solved at present is how to enable smart glasses of different forms to have eye tracking functions. To solve this problem, the present application provides an eye tracking module and a near-eye display device, which can be adapted to optical modules of different forms, enabling most near-eye display devices to have eye tracking functions.
[0041] Specifically, referring to the appendix Figures 1 to 8As shown, an embodiment of the present invention provides a near-eye display device, which may include an eye movement tracking module 1 and a near-eye display module 5. The eye movement tracking module 1 is detachably mounted on the near-eye display module 5 to form a near-eye display device with an eye movement tracking function, enabling the user wearing the near-eye display device to perform human-computer interaction only by moving the eyeballs, without the need to turn the head or manually perform human-computer interaction, which helps reduce user fatigue and improve the experience of human-computer interaction. It can be understood that, as Figure 2 shown, the near-eye display module 5 of the present application generally includes a head-mounted frame body 51 for wearing and a pair of optical modules 52 assembled on the head-mounted frame body 51. When the user wears the near-eye display module 5 through the head-mounted frame body 51, the two optical modules 52 are respectively located in front of the user's two eyes to achieve near-eye display; in addition, the near-eye display module 5 of the present application can be, but is not limited to, implemented as an XR wearable device such as an AR glasses or a VR glasses.
[0042] More specifically, as Figures 2 to 5 shown, the eye movement tracking module 1 may include an eye movement tracking component 10 and an eye movement clamping component 20. The eye movement tracking component 10 includes a flexible circuit board 11 for electrically connecting with the near-eye display module 5, a plurality of light-emitting elements 12 electrically connected to the flexible circuit board 11, and an imaging module 13 electrically connected to the flexible circuit board 11; the flexible circuit board 11 has an annular structure, and the plurality of light-emitting elements 12 are circumferentially arranged on the flexible circuit board 11. The eye movement clamping component 20 includes a pair of eye movement frames 21 and a pair of spacing adjustment mechanisms 22; the two eye movement frames 21 are arranged end-to-end at intervals and fixedly connected to the flexible circuit board 11; the two spacing adjustment mechanisms 22 are respectively arranged between the ends of the two eye movement frames 21 to adjust the end spacing between the two eye movement frames 21, so as to form an adjustable clamping space 200 adapted to the optical module 52 of the near-eye display module 5 between the two eye movement frames 21.
[0043] It should be noted that, in order to achieve the thinning of the device, the optical module 52 generally uses a folded optical path (pancake) for imaging display. Although different near-eye display modules 5 have great differences in morphological characteristics, the optical module 52 protrudes from the head-mounted frame body 51. Therefore, the eye movement tracking module 1 of the present application can clamp the optical module 52 of most near-eye display modules 5 because an adjustable clamping space 200 adapted to the optical module 52 is formed between the two eye movement frames 21. It can not only be used to match most near-eye display modules 5 to achieve the eye movement tracking function, with strong applicability, but also can save the use space of the device, reduce the risk coefficient of device use, and ensure the comfort of data collection and use.
[0044] In addition, the near-eye display device of the present application adopts a modular design: on the one hand, a plurality of light-emitting elements 12 and an imaging module 13 are integrated together to form a standard eye movement tracking module 1; on the other hand, the mounting size of the eye movement tracking module 1 (i.e., the adjustable clamping space 200) is adjusted through the eye movement clamping assembly 20, enabling the eye movement tracking module 1 to become a separate external eye movement module with a wide range of applications, so as to match head-mounted devices with different characteristics at the structural design level, improve its practicability, and achieve the organic integration of a single module (eye movement tracking module 1) and a head-mounted device (near-eye display module 5), enabling most near-eye display devices to have an eye movement tracking function.
[0045] Exemplarily, as Figure 5 and Figure 7 shown, the spacing adjustment mechanism 22 may include a guide member 221 and an adjustment nut 222; the guide member 221 has a fixed connection end 2211 fixedly connected to the end of one eye movement frame 21 and a sliding connection end 2212 slidably connected to the end of the other eye movement frame 21; the adjustment nut 222 passes through the end of the other eye movement frame 21 and is threadedly connected to the sliding connection end 2212 of the guide member 221 for restricting the maximum end spacing between the two eye movement frames 21, so as to releasably clamp the optical module 52 of the near-eye display module 5. In this way, when the adjustment nut 222 is screwed to reduce the maximum end spacing between the two eye movement frames 21, the adjustable clamping space 200 between the two eye movement frames 21 is reduced to clamp the optical module 52 of the near-eye display module 5, realizing the convenient clamping between the eye movement tracking module 1 and the near-eye display module 5; when the adjustment nut 222 is screwed in the reverse direction to increase the maximum end spacing between the two eye movement frames 21, the adjustable clamping space 200 between the two eye movement frames 21 is enlarged to release the optical module 52 of the near-eye display module 5, realizing the convenient disassembly between the eye movement tracking module 1 and the near-eye display module 5.
[0046] Optionally, the maximum end spacing between the two eye movement frames 21 can be adjusted between 0 mm and 10 mm, so as to firmly clamp the optical modules 52 of most near-eye display modules 5, with a wide range of applications.
[0047] Optionally, as Figure 5 and Figure 7 shown, the eye movement frame 21 has a sliding groove 2101 matching the sliding connection end 2212 of the guide member 221, and the sliding connection end 2212 of the guide member 221 is slidably inserted into the sliding groove 2101 of the eye movement frame 21 to guide the two eye movement frames 21 to approach or move away from each other along the extension direction of the guide member 221; the adjustment nut 222 slidably penetrates through the sliding groove 2101 and is threadedly connected to the sliding connection end 2212 of the guide member 221, thereby effectively adjusting the end spacing between the two eye movement frames 21.
[0048] Optionally, as Figure 5 and Figure 7 shown, the spacing adjustment mechanism 22 further includes an elastic member 223. The elastic member 223 is disposed between the ends of the two eye movement frames 21, so that the two eye movement frames 21 are maintained at the maximum end spacing under the action of the elastic member 223, which is convenient for sleeving on the optical module 52 and is beneficial to subsequently screwing the adjusting nut 222 to clamp the optical module 52.
[0049] It should be noted that, as Figure 5 and Figure 7 shown, the elastic member 223 can be, but is not limited to, implemented as a spring 2230. One end of the spring 2230 abuts against a guide member 221 fixedly connected to one eye movement frame 21, and the other end of the spring 2230 abuts against the bottom of a sliding groove 2101 formed in the other eye movement frame 21, so as to apply an elastic force to separate the two eye movement frames 21 from each other. It can be understood that the guide member 221 mentioned in the present application can be, but is not limited to, implemented as a guide post extending from the end of one eye movement frame 21 towards the end of the other eye movement frame 21.
[0050] Optionally, as Figure 7 shown, the spring 2230 is accommodated within the sliding groove 2101, and the spring 2230 is sleeved on the adjusting nut 222, so as to ensure that the spring 2230 expands and contracts along the extension direction of the guide member 221, which is beneficial to improving the service life of the spring 2230.
[0051] According to the above example of the present application, as Figures 4 to 6 shown, the eye movement clamping assembly 20 can further include a flexible gasket 23. The flexible gasket 23 is fixedly provided on the eye movement frame 21, so that when the eye movement clamping assembly 20 is clamped on the optical module 52, the flexible gasket 23 is located between the eye movement frame 21 and the optical module 52, so as to increase the contact friction force between the eye movement frame 21 and the optical module 52 and improve the clamping firmness between the eye movement clamping assembly 20 and the optical module 52. It can be understood that the flexible gasket 23 mentioned in the present application can be, but is not limited to, implemented as a gasket made of, such as, rubber or silica gel.
[0052] Optionally, as Figures 4 to 8As shown, the eye movement clamping assembly 20 may further include a locking ball 24; the eye movement frame 21 is provided with a threaded hole 2102 matching the locking ball 24, and the locking ball 24 is threadedly connected to the eye movement frame 21 to extend out of the threaded hole 2102, facilitating that when the eye movement clamping assembly 20 is clamped to the optical module 52, it abuts against the outer peripheral surface of the optical module 52, so as to make up for the gap between the eye movement frame 21 and the optical module 52 by adjusting the locking ball 24, which helps to further improve the clamping firmness between the eye movement clamping assembly 20 and the optical module 52.
[0053] Optionally, as Figure 4 and Figure 5 shown, the eye movement frame 21 includes an arc-shaped frame body 211 for fixedly mounting the flexible circuit board 11, an adjustment end 212 radially extending outward from the arc-shaped frame body 211, and a clamping arm body 213 axially extending forward from the arc-shaped frame body 211; the guide member 221 is fixedly connected to the adjustment end 212 of one eye movement frame 21, and the sliding groove 2101 is opened in the adjustment end 212 of the other eye movement frame 21; the flexible gasket 23 is bonded to the inner surface of the clamping arm body 213, and the threaded hole 2102 is opened in the clamping arm body 213 of the eye movement frame 21, so that the locking ball 24 threadedly connected to the threaded hole 2102 can penetrate through the flexible gasket 23 for tightly abutting against the optical module 52, ensuring that the eye movement frame 21 is not easily disengaged from the optical module 52 when the near-eye display device is working. It can be understood that the forward direction mentioned in this application refers to the direction from the user's eyes towards the optical module 52, that is, the optical module 52 is located in front of the user's eyes.
[0054] According to the above embodiments of the present application, as Figure 5 shown, the light-emitting member 12 in the eye movement tracking assembly 10 may but is not limited to be implemented as an infrared light source 120; correspondingly, the imaging module 13 in the eye movement tracking assembly 10 may be implemented as an infrared camera 130. In this way, when the eye movement tracking module 1 is communicably clamped to the near-eye display module 5, the infrared light source 120 can emit infrared light to the user's eyes, and the infrared camera can collect the light information reflected by the eyes, so as to collect and process the eye movement information, and then perform preliminary eye movement interaction on the user.
[0055] Optionally, as Figure 5As shown, the flexible circuit board 11 includes an annular plate body 111, a plurality of mounting plate bodies 112 extending obliquely forward from the inner edge of the annular plate body 111, and a connecting plate body 113 extending forward from the outer edge of the annular plate body 111; the light-emitting member 12 and the imaging module 13 are respectively mounted on the rear side of the mounting plate body 112 in an energizable manner, and the connecting plate body 113 is used for communicatively electrically connecting to the near-eye display module 5; two eye movement frames 21 are spaced apart and mounted on the front side of the annular plate body 111 to support the flexible circuit board 11. It can be understood that the connecting plate body 113 mentioned in the present application may but is not limited to be provided with general interfaces such as a standard serial port, a Type-C interface, or a USB interface.
[0056] Optionally, as Figure 5 and Figure 8 shown, the eye movement frame 21 further has a positioning groove 2103 opened in the arc-shaped frame body 211, and the mounting plate body 112 is correspondingly embedded in the positioning groove 2103 of the arc-shaped frame body 211 to position and support the infrared light source 120 and the infrared camera 130.
[0057] For example, as Figure 5 shown, the number of infrared light sources 120 in the eye movement tracking component 10 of the present application can be eight, and the number of infrared cameras 130 in the eye movement tracking component 10 can be one; the eight infrared light sources 120 are axially symmetrically distributed on the flexible circuit board 11, and the infrared camera 130 is located at a position between two infrared light sources 120, so as to adapt to eight infrared light sources 120 simultaneously through one infrared camera 130, so that the eight infrared light sources 120 respectively correspond to eight orientations of the eyes, which is beneficial to more accurately collect eye movement information. It can be understood that since a plurality of infrared light sources 120 are distributed around the flexible circuit board 11, and the infrared light beams emitted by each infrared light source 120 can directly irradiate the eyes, a plurality of light spots will be formed on the eyes. Therefore, when the eyes rotate to different positions, the infrared camera 130 will collect images of different light spots to complete the capture of the eyes, thereby achieving a high eye movement tracking efficiency and further improving the human-computer interaction efficiency.
[0058] According to the above embodiments of the present application, as Figures 2 to 8 shown, the eye movement tracking module 1 may further include a pair of light-transmitting cover plates 30, and each light-transmitting cover plate 30 is correspondingly covered on the eye movement frame 21 to cover the eye movement tracking component 10, so that the infrared light emitted by the infrared light source 120 in the eye movement tracking component 10 first passes through the light-transmitting cover plate 30 and then propagates to the eyes, and the infrared light reflected by the eyes first passes through the light-transmitting cover plate 30 and then is received by the infrared camera 130, so as to play a decorative and protective role.
[0059] Optionally, as Figures 3 to 5As shown, the light-transmitting cover plate 30 is snap-connected to the eye movement frame 21 to achieve stable connection between the two. It can be understood that the eye movement frame 21 of the present application is provided with positioning card holes, and the light-transmitting cover plate 30 has positioning pins matching the positioning card holes. The positioning pins are inserted into the positioning card holes to achieve stable snap connection between the two.
[0060] It should be noted that in the near-eye display device of the present application, an eye movement tracking module 1 can be respectively clamped on the left and right optical modules 52 to track the eyes. That is, the left and right eyeballs of the user are respectively irradiated by infrared light, and data is collected through an infrared camera, and through algorithm calculation, the results are used in human-computer interaction. In this way, the near-eye display device of the present application can realize the function of controlling the virtual scene by eyeball rotation through the tracking of the eyeballs. It can not only realize different functions according to different rotation situations to achieve more interactions, but also use the collected eyeball data to realize local rendering of the virtual scene, reduce the energy consumption generated by other interaction methods, and improve the product experience of the near-eye display device.
[0061] It can be understood that the principle of the eye movement interaction algorithm in the eye movement tracking module 1 mentioned in the present application can be but is not limited to being implemented as follows: first, use an infrared camera to take an eye image to obtain the pupil center position through image processing technology; then use the Purkinje spot formed by the reflection of the infrared light source on the cornea as the base point of the relative position between the camera and the eyeball, and combine the pupil center position to obtain the line-of-sight vector coordinates, so as to determine the gaze point position coordinates through the angle mapping relationship.
[0062] The technical features of the above embodiments can be combined arbitrarily. For the sake of concise description, not all possible combinations of the technical features in the above embodiments are described. However, as long as the combinations of these technical features do not conflict, they should be considered as the scope described in this specification.
[0063] The above embodiments only represent several implementation manners of the present invention, and the description is relatively specific and detailed, but it should not be construed as a limitation on the scope of the invention patent. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present invention, several deformations and improvements can be made, and these all belong to the protection scope of the present invention.
Claims
1. An eye movement tracking module for enabling a near-eye display module to have an eye movement tracking function, characterized in that, Comprising: An eye movement tracking component, including a flexible circuit board for electrically connecting to the near-eye display module, a plurality of light-emitting elements electrically connected to the flexible circuit board, and an imaging module electrically connected to the flexible circuit board; the flexible circuit board has an annular structure, and the plurality of light-emitting elements are circumferentially arranged on the flexible circuit board; And An eye movement clamping component, including a pair of eye movement frames and a pair of spacing adjustment mechanisms; the two eye movement frames are arranged end-to-end at intervals and fixedly connected to the flexible circuit board; the two spacing adjustment mechanisms are respectively arranged between the ends of the two eye movement frames to adjust the end spacing between the two eye movement frames, so as to form an adjustable clamping space adapted to the optical module of the near-eye display module between the two eye movement frames.
2. The eye movement tracking module according to claim 1, wherein The spacing adjustment mechanism includes a guide member and an adjustment nut, the guide member has a fixed end fixedly connected to the end of one eye movement frame and a sliding end slidably connected to the end of the other eye movement frame; the adjustment nut passes through the end of the other eye movement frame and is threadedly connected to the sliding end of the guide member to limit the maximum end spacing between the two eye movement frames.
3. The eye movement tracking module according to claim 2, wherein The eye movement frame has a sliding groove matching the sliding end of the guide member, and the sliding end of the guide member is slidably inserted into the sliding groove of the eye movement frame; the adjustment nut slidably penetrates through the sliding groove and is threadedly connected to the sliding end.
4. The eye movement tracking module according to claim 3, wherein The spacing adjustment mechanism further includes an elastic member, and the elastic member is arranged between the ends of the two eye movement frames; the elastic member is a spring accommodated in the sliding groove, and the spring is sleeved on the adjustment nut; One end of the spring abuts against the guide member, and the other end of the spring abuts against the bottom of the sliding groove.
5. The eye movement tracking module according to claim 4, wherein The eye movement clamping component further includes a flexible gasket and a locking ball, the flexible gasket is fixedly arranged on the eye movement frame; the eye movement frame is provided with a threaded hole matching the locking ball, and the locking ball is threadedly connected to the eye movement frame to protrude from the threaded hole.
6. The eye movement tracking module according to claim 5, characterized in that, The eye movement frame includes an arc-shaped frame body for fixedly mounting the flexible circuit board, an adjustment end portion radially extending outward from the arc-shaped frame body, and a clamping arm body axially extending forward from the arc-shaped frame body; the guide member is fixedly connected to the adjustment end portion of one eye movement frame, and the sliding groove is opened in the adjustment end portion of the other eye movement frame; the flexible gasket is bonded to the inner surface of the clamping arm body, and the threaded hole is opened in the clamping arm body of the eye movement frame, so that the locking ball threadedly connected to the threaded hole penetrates through the flexible gasket.
7. The eye movement tracking module according to claim 6, wherein The flexible circuit board includes an annular plate body, a plurality of mounting plate bodies extending obliquely forward from the inner edge of the annular plate body, and a connecting plate body extending forward from the outer edge of the annular plate body; the light-emitting component and the imaging module are respectively mounted on the rear side of the mounting plate body in an energizable manner; the two eye movement frames are mounted on the front side of the annular plate body at intervals; the eye movement frame further has a positioning groove formed in the arc-shaped frame body, and the mounting plate body is correspondingly embedded in the positioning groove of the arc-shaped frame body.
8. The eye movement tracking module according to any one of claims 1 to 7, characterized in that, The light-emitting component is an infrared light source; the imaging module is an infrared camera.
9. The eye movement tracking module according to any one of claims 1 to 7, characterized in that It further includes a pair of light-transmitting cover plates, and each light-transmitting cover plate is correspondingly disposed on the eye movement frame to cover the eye movement tracking component.
10. Near-eye display device, characterized in that, Comprising: A near-eye display module, including a head-mounted frame body and a pair of optical modules assembled on the head-mounted frame body; And The eye movement tracking module according to any one of claims 1 to 9, wherein the eye movement tracking module correspondingly clamps the optical module.
Citation Information
Patent Citations
Head-mounted visual aiming control system
CN108732746A
Multifunctional visual function detection device and method based on VR technology and eye movement tracking
CN109645955A
Display module, manufacturing method thereof and head-mounted display equipment
CN114296233A
Assembly for eye tracking system and corresponding head mounted device using same
CN116893510A
Eye movement tracking module and VR device
CN117250752A