Eye movement tracking device of head-mounted display equipment and head-mounted display equipment

Abstract

The invention relates to the technical field of electronic products, in particular to an eye movement tracking device of a head-mounted display device and the head-mounted display device.The eye movement tracking device of the head-mounted display device comprises a light source, a lens cone, a display screen, a camera and an optical component, the light source is arranged at one end of the lens cone, the display screen is arranged at the other end of the lens cone, and the camera is arranged at the other end of the lens cone; the display side of the display screen faces the inner cavity of the lens cone, the display screen is provided with a first display area and a second display area, the transmittance of the first display area to light of the light source working wave band is larger than that of the second display area, the camera is arranged on the side, away from the inner cavity, of the display screen, and the shooting view angle of the camera is covered by the first display area. The camera is used for receiving light which comes from the light source, is reflected by human eyes and penetrates through the optical assembly through the first display area. The camera receives the light which is reflected by the human eyes and penetrates through the optical assembly through the first display area, tracking is achieved, the structural strength of the lens cone can be guaranteed, and the field angle loss of the camera is effectively reduced.

Description

Technical Field

[0001] The present disclosure relates to the technical field of electronic products, and particularly to an eye movement tracking device and a head-mounted display device of a head-mounted display device. Background Art

[0002] A virtual reality (VR) glasses is a virtual reality head-mounted display device. Eye movement tracking is a key feature function of virtual reality devices. Accurately tracking the eye movement of users can reflect the change of attention in real time on virtual characters, which makes the interaction in the virtual world more immersive. Moreover, eye movement tracking can track the fixation points of users, enabling virtual reality devices to reduce the load of the GPU (Graphics Processing Unit) and provide a higher-quality graphics experience through concave rendering.

[0003] Currently, for eye movement tracking, an eye movement tracking camera is designed on a virtual reality device, and the eye movement is tracked by shooting the light spot reflected by the user's eyeball through the eye movement tracking camera. However, it is necessary to open holes on the barrel of the lens to install the eye movement tracking camera, and the eye movement tracking camera is placed obliquely relative to the user's eyeball, which not only reduces the structural strength of the barrel but also causes a large loss in the field of view angle. Summary of the Invention

[0004] To solve the above technical problems, the present disclosure provides an eye movement tracking device and a head-mounted display device of a head-mounted display device.

[0005] In a first aspect, the present disclosure provides an eye movement tracking device of a head-mounted display device, including a light source, a barrel, a display screen, a camera, and an optical component. The light source is disposed at one end of the barrel, the display screen is disposed at the other end of the barrel, and the display side of the display screen faces the inner cavity of the barrel. The display screen has a first display area and a second display area. The transmittance of the first display area for light in the working wavelength band of the light source is greater than that of the second display area. The camera is disposed on the side of the display screen facing away from the inner cavity, and the shooting angle of the camera is covered by the first display area. The optical component is disposed in the barrel, and the camera is configured to receive, through the first display area, light from the light source that is reflected by the human eye and passes through the optical component.

[0006] Optionally, the pixel density of the first display area is less than the pixel density of the second display area;

[0007] And / or, the proportion of the metal trace area in the first display area is less than the proportion of the metal trace area in the second display area.

[0008] Optionally, the display screen includes a panel and a light-transmitting cover plate which are stacked, the light-transmitting cover plate faces the inner cavity of the lens barrel, and the panel has the first display area and the second display area.

[0009] Optionally, the display screen also includes a light-shielding protective layer, which is located on the side of the panel away from the light-transmitting cover plate, and the light-shielding protective layer is provided with a light-transmitting hole corresponding to the first display area. The camera is connected to the protective layer, and the shooting angle of the camera is covered by the light-transmitting hole.

[0010] Optionally, the eye tracking device of the head-mounted display device further includes a mounting bracket, the camera is mounted on the mounting bracket, and the mounting bracket is sealed and connected to the light-shielding protective layer in a circumferential direction of the light-transmitting hole.

[0011] Optionally, the camera has a sealing skirt extending along its circumference, and the sealing skirt is sealed and connected to the light-shielding protective layer in the circumference of the light-transmitting hole.

[0012] Optionally, the light emitted by the light source is infrared light.

[0013] Optionally, the light source includes a plurality of light-emitting elements, and the plurality of light-emitting elements are arranged at intervals along the circumference of the lens barrel.

[0014] Optionally, the lens barrel comprises a first lens barrel and a second lens barrel connected to each other, the light source is arranged at an end of the first lens barrel away from the second lens barrel, and the display screen is installed at an end of the second lens barrel away from the first lens barrel.

[0015] In a second aspect, the present disclosure provides a head-mounted display device, including an eye tracking device of the head-mounted display device provided in the first aspect.

[0016] Compared with the prior art, the technical solution provided by the embodiments of the present disclosure has the following advantages:

[0017] By arranging the camera on the side of the display screen facing away from the inner cavity, and by setting the light transmittance of the first display area of the display screen to be greater than the light transmittance of the second display area, the camera can receive light from the light source and reflected by the human eye through the first display area, thereby tracking eye movements. There is no need to open a hole in the lens barrel, which can ensure the structural strength of the lens barrel. In addition, since the camera is opposite to the human eye when shooting, the field of view loss of the camera can be effectively reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0019] To more clearly illustrate the technical solutions in the embodiments of the present disclosure or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0020] Figure 1 Is a cross-sectional schematic diagram of the eye movement tracking device described in the embodiments of the present disclosure;

[0021] Figure 2 Is Figure 1 A partially enlarged schematic diagram;

[0022] Figure 3 Is a partial cross-sectional schematic diagram of another eye movement tracking device described in the embodiments of the present disclosure.

[0023] Among them, 1. Light source;

[0024] 2. Lens barrel; 21. First lens barrel; 22. Second lens barrel;

[0025] 3. Display screen; 31. Light-transmitting hole;

[0026] 4. Camera;

[0027] 5. Mounting bracket;

[0028] 6. Optical component. Specific embodiments

[0029] In order to more clearly understand the above-mentioned objects, features and advantages of the present disclosure, the following will further describe the solutions of the present disclosure. It should be noted that, without conflict, the embodiments of the present disclosure and the features in the embodiments can be combined with each other.

[0030] Many specific details are set forth in the following description in order to fully understand the present disclosure, but the present disclosure can also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only a part of the embodiments of the present disclosure, rather than all of the embodiments.

[0031] Such as Figure 1 And Figure 2As shown in the figure, an eye movement tracking device for a head-mounted display device provided by an embodiment of the present disclosure includes a light source 1, a lens barrel 2, a display screen 3, a camera 4, and an optical component 6. Among them, the light source 1 is arranged at one end of the lens barrel 2. The display screen 3 is arranged at the other end of the lens barrel 2, and the display side of the display screen 3 faces the inner cavity of the lens barrel 2. The display screen 3 has a first display area and a second display area. The transmittance of the first display area for light in the working wavelength band of the light source 1 is greater than that of the second display area. The camera 4 is arranged on the side of the display screen 3 facing away from the inner cavity. The shooting angle of view of the camera 4 is covered by the first display area. The camera 4 is used to receive, through the first display area, light from the light source 1 that is reflected by the human eye and passes through the optical component 6.

[0032] Understandably, by arranging the camera 4 on the side of the display screen 3 facing away from the inner cavity, and by setting the transmittance of the first display area of the display screen 3 for light in the working wavelength band of the light source 1 to be greater than that of the second display area, the camera 4 can receive light from the light source 1 that is reflected by the human eye and passes through the optical component 6, thereby realizing the tracking of eye movements. Compared with the prior art, there is no need to open holes on the lens barrel 2, which can ensure the structural strength of the lens barrel 2. Moreover, since the camera 4 faces the human eye during shooting, the loss of the field of view angle of the camera 4 can be effectively reduced.

[0033] In addition, the structural design is simplified, which is beneficial to cost reduction. Moreover, the position of the camera 4 is insensitive to the slight movement and rotation relative to the human eye, the assembly accuracy requirements for the eye movement tracking device of the head-mounted display device are reduced, and the manufacturability is good.

[0034] In addition, when the eye movement tracking device of the head-mounted display device is worn, the central position of the camera 4 and the theoretical central position of the human eye are on the same straight line, or the human eye is within the field of view angle of the camera 4, which is beneficial to improving the tracking effect of eye movements.

[0035] It should be noted that the display side of the display screen 3 mentioned above refers to the side of the display screen where the display picture is located.

[0036] There are various ways to set the transmittance of the above-mentioned first display area for light in the working band of the light source 1 to be greater than that of the second display area. One way is to set the pixel density of the first display area to be less than that of the second display area. That is, by reducing the number of pixel units in the first display area and increasing the aperture ratio, the transmittance of light can be increased, thereby improving the shooting effect of the camera 4. Another way is to set the proportion of the metal trace area in the first display area to be less than that in the second display area. That is to say, when the overall pixel density of the display screen 3 remains unchanged, the first display area is set to drive multiple pixel units with one pixel circuit, thereby reducing the proportion of the metal trace area in the first display area, and further increasing the transmittance of light and improving the shooting effect of the camera 4. Another way can be to adopt the above two methods simultaneously, setting the pixel density of the first display area to be less than that of the second display area, and at the same time setting the proportion of the metal trace area in the first display area to be less than that in the second display area.

[0037] It should be noted that in some embodiments, the above-mentioned display screen 3 is integrally divided into a first display area and a second display area, and the shooting angle of the camera 4 is covered by the first display area.

[0038] In some embodiments, the light emitted by the above-mentioned light source 1 is infrared light. That is to say, the working band of the light source 1 is the infrared band, and at this time the infrared light transmittance of the first display area is greater than that of the second display area. Or, the light emitted by the light source 1 can also be visible light.

[0039] Furthermore, the above-mentioned light source 1 includes a light-emitting member, and a plurality of light-emitting members are arranged at intervals along the circumferential direction of the lens barrel 2. Specifically, the above-mentioned light source 1 can be an LED lamp ring, and the LED lamp ring is arranged on the annular end surface at one end of the lens barrel 2. The LED lamp ring has a plurality of LED lamps, and at this time the light-emitting member is the LED lamp. Or it can also be a plurality of separate LED lamps, and the plurality of LED lamps are arranged at intervals along the circumferential direction of the lens barrel 2.

[0040] As Figure 1 shown, in some embodiments, the above-mentioned lens barrel 2 includes a first lens barrel 21 and a second lens barrel 22 connected to each other. The light source 1 is arranged at one end of the first lens barrel 21 away from the second lens barrel 22, and the display screen 3 is installed at one end of the second lens barrel 22 away from the first lens barrel 21.

[0041] The above-mentioned optical component 6 is arranged in the first lens barrel 21. The light emitted by the light source 1 is reflected by the human eye and then passes through the optical component 6, and then passes through the first display area and is received by the camera 4.

[0042] Among them, the optical component 6 includes an optical film material and an optical lens. Both the optical film material and the optical lens are mature existing technologies and will not be elaborated here.

[0043] The above display screen 3 includes a panel and a light-transmitting cover plate that are stacked. The light-transmitting cover plate faces the inner side of the lens barrel 2, and the panel has a first display area and a second display area. Among them, both the panel and the light-transmitting cover plate are mature existing technologies and will not be elaborated here.

[0044] Understandably, when the eye tracking device of the head-mounted display device is in use, the user's eyes can view the content displayed on the display screen 3 through the lens barrel 2. The light-transmitting cover plate can not only protect the panel but also does not affect the light emitted by the panel and the light source 1 from passing through.

[0045] Furthermore, the display screen 3 further includes a light-shielding protective layer. The light-shielding protective layer is located on the side of the panel facing away from the light-transmitting cover plate. The light-shielding protective layer is provided with a light-transmitting hole 31 corresponding to the first display area. The camera 4 is connected to the protective layer, and the shooting angle of the camera 4 is covered by the light-transmitting hole 31.

[0046] By providing the light-transmitting hole 31 on the light-shielding protective layer, the camera 4 can be placed outside the display screen 3. The camera 4 receives the light emitted from the light source 1, reflected by the human eye, and passing through the optical component 6 through the light-transmitting hole 31 and the first display area. Among them, the light-shielding protective layer is an iron frame or a copper foil.

[0047] Refer to Figure 1 and Figure 2 , in some embodiments, the eye tracking device of the above head-mounted display device further includes a mounting bracket 5. The camera 4 is mounted on the mounting bracket 5, and the mounting bracket 5 is sealingly connected to the protective layer in the circumferential direction of the light-transmitting hole 31.

[0048] Understandably, the connection with the light-shielding protective layer is achieved through the mounting bracket 5, and the gap between the camera 4 and the light-transmitting hole 31 is sealed. Specifically, the above mounting bracket 5 can be adhesively bonded to the light-shielding protective layer by dispensing glue or applying adhesive tape.

[0049] Furthermore, the mounting bracket 5 is arranged around the camera 4, and the camera 4 and the mounting bracket 5 can be adhesively bonded by dispensing glue or applying adhesive tape. The fixation of the camera 4 is achieved, and the sealing between the camera 4 and the light-transmitting hole 31 is achieved.

[0050] Refer to Figure 3 , in some other embodiments, the camera 4 may have a sealing skirt extending along its circumference, and the sealing skirt is sealingly connected to the light-shielding protective layer in the circumferential direction of the light-transmitting hole 31.

[0051] The present disclosure also provides a head-mounted display device, including the above eye tracking device and a lens frame. The eye tracking device of the head-mounted display device is arranged on the lens frame.

[0052] Furthermore, there are two of the above eye tracking devices. The two eye tracking devices are respectively used to track the user's two eyes.

[0053] The head-mounted display device has the technical effects of the eye movement tracking device of the head-mounted display device in the above embodiments, which will not be elaborated herein.

[0054] It should be noted that in this text, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article or device. Without further limitation, an element defined by the phrase "comprising a..." does not exclude the presence of additional identical elements in the process, method, article or device comprising the element.

[0055] The above are only specific embodiments of the present disclosure, enabling those skilled in the art to understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to these embodiments described herein, but rather to the broadest scope consistent with the principles and novel features disclosed herein.

Claims

1. An eye movement tracking device for a head-mounted display device, characterized in that, It includes a light source (1), a lens barrel (2), a display screen (3), a camera (4) and an optical component (6). The light source (1) is arranged at one end of the lens barrel (2), the display screen (3) is arranged at the other end of the lens barrel (2), and the display side of the display screen (3) faces the inner cavity of the lens barrel (2). The display screen (3) has a first display area and a second display area. The light transmittance of the first display area for the light in the working wavelength band of the light source (1) is greater than that of the second display area. The camera (4) is arranged on the side of the display screen (3) away from the inner cavity, and the shooting angle of the camera (4) is covered by the first display area. The optical component (6) is arranged in the lens barrel (2). The camera (4) is used to receive, through the first display area, the light from the light source (1) that is reflected by the human eye and passes through the optical component (6).

2. The eye movement tracking device of the head-mounted display device according to claim 1, characterized in that, The pixel density of the first display area is less than that of the second display area; and / or, the proportion of the metal trace area in the first display area is less than that in the second display area.

3. The eye movement tracking device of the head-mounted display device according to claim 1, characterized in that, The display screen (3) includes a panel and a light-transmitting cover plate arranged in a stacked manner. The light-transmitting cover plate faces the inner cavity of the lens barrel (2), and the panel has the first display area and the second display area.

4. The eye movement tracking device of the head-mounted display device according to claim 3, characterized in that, The display screen (3) further includes a light-shielding protection layer. The light-shielding protection layer is located on the side of the panel away from the light-transmitting cover plate. The light-shielding protection layer is provided with a light-transmitting hole (31) corresponding to the first display area. The camera (4) is connected to the protection layer, and the shooting angle of the camera (4) is covered by the light-transmitting hole (31).

5. The eye movement tracking device of the head-mounted display device according to claim 4, characterized in that The eye movement tracking device of the head-mounted display device further includes a mounting bracket (5). The camera (4) is mounted on the mounting bracket (5), and the mounting bracket (5) is hermetically connected to the light-shielding protection layer in the circumferential direction of the light-transmitting hole (31).

6. The eye movement tracking device of the head-mounted display device according to claim 4, wherein, The camera (4) has a sealing skirt extending along its circumference, and the sealing skirt is hermetically connected to the light-shielding protection layer in the circumferential direction of the light-transmitting hole (31).

7. The eye movement tracking device of the head-mounted display device according to claim 1, characterized in that, The light emitted by the light source (1) is infrared light.

8. The eye movement tracking device of the head-mounted display device according to claim 1, characterized in that, The light source (1) includes a plurality of light-emitting elements, and the plurality of light-emitting elements are arranged at intervals along the circumference of the lens barrel (2).

9. The eye movement tracking device of the head-mounted display device according to claim 1, wherein, The lens barrel (2) includes a connected first lens barrel (21) and a second lens barrel (22). The light source (1) is arranged at one end of the first lens barrel (21) away from the second lens barrel (22), and the display screen (3) is mounted at one end of the second lens barrel (22) away from the first lens barrel (21).

10. A head-mounted display device, characterized in that, It includes the eye movement tracking device of the head-mounted display device according to any one of claims 1 to 9.

Images