Wearable display device

Abstract

The application discloses a wearable display device, and relates to the technical field of virtual reality. The wearable display device has high processing efficiency for the electric signals sent by each photoelectric sensing assembly, so that the wearable display device can quickly determine the position of the gaze point of the user's eyes on the display panel based on the electric signals sent by each photoelectric sensing assembly, thereby improving the display efficiency of the display panel and increasing the refresh rate of the display panel. In addition, since the photoelectric sensing assembly receives the light signals reflected by the user's eyes from the target structure in the lens assembly, the light signals received by each photoelectric sensing assembly are prevented from penetrating through different structures, the reliability of the light signals received by each photoelectric sensing assembly is ensured, and the accuracy of determining the position of the gaze point is ensured.

Description

Technical Field

[0001] This application relates to the field of virtual reality technology, and in particular to a wearable display device. Background Technology

[0002] Virtual reality (VR) devices are devices that can create virtual environments through displayed images, allowing users to immerse themselves in those virtual environments.

[0003] In related technologies, VR devices include a display panel, a camera, a processor, and a driving circuit. The camera captures images of the user's eyes. The processor determines the position of the user's gaze point on the display panel based on the eye images and performs local rendering of the desired display image based on the gaze point position. The driving circuit drives the display panel to display the image based on the locally rendered image sent by the processor. Because the processor can perform local rendering only on the area where the gaze point is located in the display image, without needing to perform global rendering of the display image, it not only reduces the processor's load but also ensures the display effect of the display panel.

[0004] However, in related technologies, the processor is inefficient at determining the position of the gaze point based on the eye image captured by the camera, which in turn leads to low display efficiency of the display panel. Summary of the Invention

[0005] This application provides a wearable display device that solves the problem of low efficiency in determining the position of the gaze point in related technologies. The technical solution is as follows:

[0006] On one hand, a wearable display device is provided, the wearable display device comprising:

[0007] A display panel having a display area and a peripheral area surrounding the display area;

[0008] Multiple light-emitting elements, the light emitted by the multiple light-emitting elements being used to illuminate the user's eyes;

[0009] A lens assembly is located on the light-emitting side of the display panel. The lens assembly includes a lens frame and a lens located within the lens frame. The light transmittance of the lens frame is greater than a threshold.

[0010] In addition, a plurality of photoelectric sensing components are located in the peripheral area. Each photoelectric sensing component is used to receive light signals reflected from the light-emitting element by the user's eye through the target structure and convert the light signals into electrical signals. The electrical signals are used to determine the position of the user's eye gaze point on the display panel. The target structure is the lens or the lens frame.

[0011] Optionally, the plurality of light-emitting elements are infrared light-emitting diodes.

[0012] Optionally, the target structure is the lens frame;

[0013] The target area of ​​the lens frame is used to transmit infrared light and absorb visible light, and the target area includes an area for the light signal of the light-emitting element to be reflected through the user's eye.

[0014] Optionally, the wearable display device further includes: an optical structure;

[0015] The optical structure is located between the photoelectric sensing component and the lens component. The orthographic projection of the optical structure on the display panel is located in the peripheral area. The optical structure has a light-shielding area and multiple light-transmitting areas. Each light-transmitting area is used to transmit the light signal to at least one of the photoelectric sensing components.

[0016] Optionally, the lens is circular in shape; the distance l between the center of each light-transmitting area and the center of the display area of ​​the display panel satisfies:

[0017]

[0018] Wherein, d1 is the distance between the user's eye and the lens, d2 is the distance between the lens and the display panel, R1 is the radius of the lens, and a is the maximum movement radius of the pupil.

[0019] Optionally, the plurality of light-emitting elements are evenly arranged, and each light-emitting element is fixedly connected to the side of the lens frame away from the display panel; the distance R2 between the side of each light-emitting element closest to the lens and the center of the lens satisfies:

[0020]

[0021] Optionally, the target area of ​​the lens frame is located between the light-emitting element and the lens;

[0022] Alternatively, the target area of ​​the lens frame may be the entire area of ​​the lens frame.

[0023] Optionally, the material of the target area of ​​the lens frame includes at least one of acrylonitrile-butadiene-styrene copolymer, polycarbonate, and polymethyl methacrylate.

[0024] Optionally, the target structure is the lens;

[0025] The lens is used to transmit infrared light as well as visible light.

[0026] Optionally, the wearable display device further includes: an optical structure;

[0027] The optical structure is located between the photoelectric sensing component and the lens component. The orthographic projection of the optical structure on the display panel is located in the peripheral area. The optical structure has a light-shielding area and multiple light-transmitting areas. Each light-transmitting area is used to transmit the light signal to at least one of the photoelectric sensing components.

[0028] Optionally, the lens is circular in shape; the radius R2 of the lens satisfies:

[0029]

[0030] Wherein, l is the distance between the center of the light-transmitting area and the center of the display area of ​​the display panel, d1 is the distance between the user's eye and the lens in a direction perpendicular to the display panel, d2 is the distance between the lens and the display panel in a direction perpendicular to the display panel, and a is the maximum movement radius of the pupil.

[0031] Optionally, the wearable display device includes: a light filter;

[0032] The filter is located on the side of the plurality of photoelectric sensing components away from the display panel, and the orthographic projection of the filter on the display panel covers the orthographic projection of the plurality of photoelectric sensing components on the display panel; the filter is used to transmit infrared light and absorb visible light.

[0033] Optionally, the wearable display device further includes: a light-transmitting layer;

[0034] The transparent layer is located on the side of the plurality of photoelectric sensing components away from the display panel.

[0035] Optionally, the surrounding area includes: a first area extending along a first direction and a second area extending along a second direction, wherein the first direction intersects the second direction;

[0036] The plurality of photoelectric sensing components include a plurality of first photoelectric sensing components and a plurality of second photoelectric sensing components; the plurality of first photoelectric sensing components are located in the first region and arranged along the first direction, and the plurality of second photoelectric sensing components are located in the second region and arranged along the second direction.

[0037] Optionally, the wearable display device further includes: a processing circuit;

[0038] The processing circuit is connected to each of the photoelectric sensing components, and the processing circuit is used to determine the position of the user's gaze point on the display panel based on the magnitude of the signal value of the electrical signal sent by each of the photoelectric sensing components and the position of at least one of the photoelectric sensing components.

[0039] The beneficial effects of the technical solution provided in this application include at least the following:

[0040] This application provides a wearable display device that has high processing efficiency for the electrical signals sent by each photoelectric sensing component. Therefore, the wearable display device can quickly determine the position of the user's gaze point on the display panel based on the electrical signals sent by each photoelectric sensing component, thereby improving the efficiency of image display and achieving a high refresh rate. Furthermore, since the photoelectric sensing components receive the light signals reflected from the user's eye from the target structure in the lens assembly, it can prevent the light signals received by each photoelectric sensing component from passing through different structures, ensuring the reliability of the light signals received by each photoelectric sensing component and thus ensuring the accuracy of determining the gaze point position. Attached Figure Description

[0041] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0042] Figure 1 This is a schematic diagram of the structure of a wearable display device provided in an embodiment of this application;

[0043] Figure 2 This is a schematic diagram of the structure of another wearable display device provided in an embodiment of this application;

[0044] Figure 3 This is a top view of a display panel provided in an embodiment of this application;

[0045] Figure 4 This is a schematic diagram of a display panel and a photoelectric sensing component provided in an embodiment of this application;

[0046] Figure 5 This is a schematic diagram of another display panel and photoelectric sensing component provided in an embodiment of this application;

[0047] Figure 6 This is a schematic diagram of the structure of another wearable display device provided in the embodiments of this application;

[0048] Figure 7This is a schematic diagram of the structure of another wearable display device provided in the embodiments of this application;

[0049] Figure 8 This is a schematic diagram of the structure of a lens assembly provided in an embodiment of this application;

[0050] Figure 9 This is a schematic diagram of another lens assembly provided in an embodiment of this application;

[0051] Figure 10 This is a schematic diagram of the structure of another wearable display device provided in the embodiments of this application;

[0052] Figure 11 This is a schematic diagram of an optical structure and photoelectric sensing component provided in an embodiment of this application;

[0053] Figure 12 This is a schematic diagram of another optical structure and photoelectric sensing component provided in the embodiments of this application. Detailed Implementation

[0054] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0055] The terminology used in the embodiments section of this application is for illustrative purposes only and is not intended to limit the application. Unless otherwise defined, the technical or scientific terms used in the embodiments of this application should have the ordinary meaning understood by one of ordinary skill in the art to which this application pertains. The terms "first," "second," "third," and similar terms used in the patent application specification and claims of this application do not indicate any order, quantity, or importance, but are merely used to distinguish different components. Similarly, the terms "a" or "one," and similar terms do not indicate a quantity limitation, but rather indicate the presence of at least one. The terms "comprising" or "including," and similar terms mean that the elements or objects preceding "comprising" or "including" encompass the elements or objects listed following "comprising" or "including" and their equivalents, and do not exclude other elements or objects. The terms "connected," "linked," and similar terms are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. "Up," "down," "left," "right," etc., are used only to indicate relative positional relationships; when the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0056] Figure 1 This is a schematic diagram of the structure of a wearable display device provided in an embodiment of this application. (Reference) Figure 1As can be seen, the wearable display device 10 may include: a display panel 101, multiple light-emitting elements 102, a lens assembly 103, and multiple photoelectric sensing components 104. Among them, Figure 1 The image shows two light-emitting elements 102 and two photoelectric sensing components 104.

[0057] refer to Figure 1 The lens assembly 103 can be located on the light-emitting side of the display panel 101. The lens assembly 103 includes a lens frame 1031 and a lens 1032 located within the lens frame 1031. A user can view the image displayed on the display panel 101 through the lens 1032. The lens frame 1031 is used to support and fix the lens 1032. The lens frame 1031 can be annular, and the area within the lens frame 1031 refers to the region enclosed by the annular structure of the lens frame 1031.

[0058] In this embodiment, the light emitted by the light-emitting element 102 is used to illuminate the user's eye, and the user's eye can reflect the light emitted by the light-emitting element 102. Each photoelectric sensing component 104 is used to receive the light signal of the light-emitting element 102 reflected by the user's eye through the target structure, and convert the light signal into an electrical signal, which is used to determine the position of the user's eye's gaze point on the display panel 101. The target structure is either a lens 1032 or a lens frame 1031.

[0059] Since the transmittance of the lens frame 1031 is greater than the threshold (allowing light to pass through), and the material of the lens 1032 is usually a transparent material (allowing light to pass through), the light signal of the light-emitting element 102 reflected by the user's eye can pass through both the lens frame 1031 and the lens 1032. However, each photoelectric sensing component 104 can only receive the light signal of the light-emitting element 102 reflected by the user's eye that passes through the target structure.

[0060] Each photoelectric sensing component 104 is used to receive the light signal of the light-emitting element 102 reflected by the user's eye through the target structure. This can be interpreted as: each photoelectric sensing component 104 is only used to receive the light signal of the light-emitting element 102 reflected by the user's eye through the target structure, and will not receive the light signal of the light-emitting element 102 reflected by the user's eye through another structure in the lens assembly 103 other than the target structure.

[0061] That is, the photosensitive area of ​​each photoelectric sensing component 104 can overlap with the optical path of the light signal of the light-emitting element 102 reflected by the user's eye through the target area, and does not overlap with the optical path of the light signal of the light-emitting element 102 reflected by the user's eye through another structure other than the target structure.

[0062] As one possible scenario, refer to Figure 1 The target structure is the lens frame 1031. The light signal reflected from the user's eye by the light-emitting element 102 that passes through the lens frame 1031 is received by the photoelectric sensing component 104. The light signal reflected from the user's eye by the light-emitting element 102 that passes through the lens 1032 is not received by the photoelectric sensing component 104.

[0063] As another possible scenario, see reference Figure 2 The target structure is lens 1032. The light signal reflected from the user's eye by the light-emitting element 102 that passes through the lens 1032 is received by the photoelectric sensing component 104. The light signal reflected from the user's eye by the light-emitting element 102 that passes through the lens frame 1031 is not received by the photoelectric sensing component 104.

[0064] In this embodiment, since the photoelectric sensing component 104 receives the light signal reflected by the user's eye from one of the structures (target structures) in the lens assembly 103, it is possible to avoid the light signals received by each photoelectric sensing component 104 from passing through different structures and affecting the reliability of the light signals received by each photoelectric sensing component 104, thus ensuring the accuracy of determining the position of the gaze point.

[0065] Figure 3 This is a top view of a display panel provided in an embodiment of this application. (Reference) Figure 3 It can be seen that the display panel 101 may have a display area 101a and a surrounding area 101b around the display area 101a. Combined with... Figures 1 to 3 Multiple photoelectric sensing components 104 can be located in the surrounding area 101b.

[0066] Since multiple photoelectric sensing components 104 are located in the peripheral area 101b of the display panel 101, these multiple photoelectric sensing components 104 will not affect the normal display of the display panel 101, and the display effect of the display panel 101 is good.

[0067] In this embodiment, because different areas of the human eye have different reflectivities for light (e.g., infrared light), the photoelectric sensing component 104 receives different light signals reflected from different areas of the human eye. The photoelectric sensing component 104 converts these different light signals into electrical signals with different signal values, thereby enabling the wearable display device to determine the position of the user's gaze point on the display panel 101 based on the magnitude of the electrical signal value.

[0068] Typically, electrical signals involve less data than images, resulting in higher data volume. Therefore, wearable display devices are more efficient at processing electrical signals than images. In this embodiment, the wearable display device processes the electrical signals sent by each photoelectric sensing component 104 efficiently, enabling it to quickly determine the position of the user's gaze point on the display panel 101. This, in turn, improves the efficiency of image display on the display panel 101, resulting in a higher refresh rate for the display panel 101.

[0069] In summary, the embodiments of this application provide a wearable display device. The wearable display device has high processing efficiency for the electrical signals sent by each photoelectric sensing component. Therefore, the wearable display device can quickly determine the position of the user's eye gaze point on the display panel based on the electrical signals sent by each photoelectric sensing component, thereby improving the efficiency of the display panel in displaying images and achieving a high refresh rate.

[0070] Furthermore, since the photoelectric sensing components receive the light signals reflected from the user's eye from the target structure in the lens assembly, it is possible to prevent the light signals received by each photoelectric sensing component from passing through different structures, thus ensuring the reliability of the light signals received by each photoelectric sensing component and thereby ensuring the accuracy of determining the position of the gaze point.

[0071] In this embodiment, the wearable display device 10 may further include a processing circuit (not shown). This processing circuit may be connected to each photoelectric sensing component 104. The processing circuit may pre-store the positions of each photoelectric sensing component 104. This processing circuit can be used to determine the position of the user's gaze point on the display panel 101 based on the magnitude of the signal values ​​of the electrical signals transmitted by each photoelectric sensing component 104 and the position of at least one photoelectric sensing component 104.

[0072] Optionally, the light-emitting element 102 can be an infrared light-emitting diode (LED). Since the reflectivity of infrared light varies considerably among the pupil, sclera, and iris of the user's eye, designing the light-emitting element 102 as an infrared LED allows the photoelectric sensing component 104 to receive infrared light signals reflected from the pupil, sclera, and iris, facilitating the processing circuitry of the wearable display device 10 in determining the user's gaze point on the display panel 101. For example, the wavelength range of the light emitted by the light-emitting element 102 can be from 850 nm to 940 nm.

[0073] refer to Figure 3As can be seen, the peripheral area 101b of the display panel 101 includes: a first area (101b1 and 101b3) extending along the first direction X and a second area (101b2 and 101b4) extending along the second direction Y. Wherein, the first direction X and the second direction Y intersect.

[0074] Combination Figure 3 and Figure 4 As can be seen, the plurality of photoelectric sensing components 104 may include: a plurality of first photoelectric sensing components 104a and a plurality of second photoelectric sensing components 104b. The plurality of first photoelectric sensing components 104a are located in a first region 101b1 and are arranged along a first direction X. The plurality of second photoelectric sensing components 104b are located in a second region 101b2 and are arranged along a second direction Y.

[0075] Optionally, a plurality of first photoelectric sensing components 104a are evenly arranged along a first direction X, and a plurality of second photoelectric sensing components 104b are evenly arranged along a second direction Y.

[0076] In this embodiment, the wearable display device 10 includes a processing circuit that can receive electrical signals from each of a plurality of first photoelectric sensing components 104a, and can determine at least one target first photoelectric sensing component from the plurality of first photoelectric sensing components 104a. The processing circuit can also receive electrical signals from each of a plurality of second photoelectric sensing components 104b, and can determine at least one target second photoelectric sensing component from the plurality of second photoelectric sensing components 104b. Finally, the processing circuit can determine the position of the user's gaze point on the display panel 101 based on the position of at least one target first photoelectric sensing component and the position of at least one target second photoelectric sensing component.

[0077] The signal value of the electrical signal transmitted by the first photoelectric sensing component can be less than or equal to a first threshold, and the signal value of the electrical signal transmitted by the second photoelectric sensing component can be less than or equal to a second threshold. The first threshold and the second threshold can be equal or unequal; this embodiment does not limit this.

[0078] The user's eye includes the pupil, sclera, and iris. Since the pupil is the darkest in color, the signal value of the light signal reflected from it is the smallest. Furthermore, the signal value of the electrical signal converted from the reflected light signal is also the smallest. Therefore, based on the signal value of the electrical signal transmitted by the first photoelectric sensing component (which is less than or equal to a first threshold) and the signal value of the electrical signal transmitted by the second photoelectric sensing component (which is less than or equal to a second threshold), the position of the user's pupil's gaze point on the display panel 101 can be determined. Here, the signal value of the light signal represents the intensity of the light.

[0079] Optionally, the first threshold and the second threshold can be fixed values ​​pre-stored in the processing circuit. Alternatively, the first threshold can be determined by the processing circuit based on the signal values ​​of the electrical signals received from the plurality of first photoelectric sensing components 104a. The second threshold can be determined by the processing circuit based on the signal values ​​of the electrical signals received from the plurality of second photoelectric sensing components 104b.

[0080] For example, the processing circuit can arrange the signal values ​​of N electrical signals sent by N first photoelectric sensing components 104a in ascending order, and can determine the signal value at the nth position as a first threshold. Here, N is an integer greater than 1, and n is an integer greater than 1 and less than N / 2. The processing circuit can also arrange the signal values ​​of M electrical signals sent by M second photoelectric sensing components 104b in ascending order, and can determine the signal value at the mth position as a second threshold. Here, M is an integer greater than 1, and m is an integer greater than 1 and less than M / 2.

[0081] Alternatively, the processing circuit may determine the signal value with the smallest signal value among the multiple first photoelectric sensing components 104a received as a first threshold, and determine the signal value with the smallest signal value among the multiple second photoelectric sensing components 104b received as a second threshold.

[0082] In this embodiment, the processing circuit can determine the position of the target first photoelectric sensor component with the smallest signal value among the plurality of first photoelectric sensor components 104a, and can determine the position of the target second photoelectric sensor component with the smallest signal value among the plurality of second photoelectric sensor components 104b. Based on the positions of the target first photoelectric sensor component and the target second photoelectric sensor component, the processing circuit can determine the position of the user's gaze point on the display panel 101.

[0083] refer to Figure 3 The first direction X is perpendicular to the second direction Y. The first direction X can be the pixel row direction of the display panel 101, and the second direction Y can be the pixel column direction of the display panel 101.

[0084] refer to Figure 3 The surrounding area 101b may include two first areas (101b1 and 101b3) and two second areas (101b2 and 101b4). The two first areas (101b1 and 101b3) may be arranged along the second direction Y and are located on both sides of the display area 101a. The two second areas (101b2 and 101b4) may be arranged along the first direction X and are located on both sides of the display area 101a.

[0085] refer to Figure 5Among the plurality of first photoelectric sensing components 104a included in the plurality of photoelectric sensing components 1044, a portion of the first photoelectric sensing components 104a are located in a first region 101b1, and another portion of the first photoelectric sensing components 104a are located in another first region 101b3. Among the plurality of second photoelectric sensing components 104b included in the plurality of photoelectric sensing components 104, a portion of the second photoelectric sensing components 104b are located in a second region 101b2, and another portion of the second photoelectric sensing components 104b are located in another second region 101b4.

[0086] Therefore, the processing circuit can determine the position of the user's eye gaze point on the display panel 101 based on the first photoelectric sensing component 104a in two first regions (101b1 and 101b3) and the second photoelectric sensing component 104b in two second regions (101b2 and 101b4), thereby improving the accuracy of the determined gaze point position.

[0087] Figure 6 This is a schematic diagram of another wearable display device provided in an embodiment of this application. (Reference) Figure 6 As can be seen, the wearable display device 10 may further include an optical structure 105. This optical structure 105 may be located between the photoelectric sensing component 104 and the lens component 103. (Reference) Figure 7 The optical structure 105 can be a ring structure, and the orthographic projection of the optical structure 105 on the display panel 101 is located in the peripheral area 101b.

[0088] Optionally, the optical structure 105 may have a light-shielding area and multiple light-transmitting areas. Each light-transmitting area can be used to transmit light signals to at least one photoelectric sensing component 104. That is, light reflected by the user's eye can shine from the light-transmitting area onto the photoelectric sensing component 104.

[0089] The material of the light-shielding area of ​​the optical structure 105 can be an opaque material. The optical structure 105 may have a through-hole 105a, so the light-transmitting area can be formed by the through-hole in the optical structure 105. Figure 7 The diagram shows four through holes 105a, which are located in the middle of one side of the optical structure 105.

[0090] Alternatively, the optical structure 105 may have a different number of through holes. Optionally, the optical structure 105 may have an even greater number of through holes, which can form an array of holes, and the light-transmitting area can be composed of the array of holes. For example, the number of through holes on the optical structure 105 may be the same as the number of photoelectric sensing components 104 included in the wearable display device, and they may correspond one-to-one.

[0091] Alternatively, the optical structure 105 may have slits, in which case the light-transmitting area can be formed by the slits on the optical structure 105. Or, the optical structure 105 may have multiple slits, which can form a slit array, in which case the light-transmitting area can be formed by the slit array. Alternatively, the light-transmitting area of ​​the optical structure 105 may be formed by a lens 1032 or a cylindrical lens, or other light-transmitting structures.

[0092] As an optional implementation, refer to Figure 6 The target structure is a lens frame 1031. The target area of ​​the lens frame 1031 can be used to transmit infrared light and absorb visible light, and the target area includes an area for the light signal of the light-emitting element 102 reflected through the user's eye.

[0093] Optionally, the material of the target area of ​​the lens frame 1031 includes at least one of acrylonitrile butadiene styrene copolymers (ABS), polycarbonate (PC), and polymethyl methacrylate (PMMA).

[0094] Among them, ABS material is a black, high-gloss material with a specific gravity of 1.08 and a near-infrared light transmittance of up to 90%. Furthermore, ABS material has a refractive index of 1.56, good temperature resistance (it does not soften even at 90 degrees Celsius), good fluidity, and high mechanical strength, making it suitable for forming lens frame 1031. PC material is also a black, high-gloss material with strong absorption of visible light and a high near-infrared light transmittance of up to 93%. PC material also has good temperature resistance (it does not deform even at 120 degrees Celsius), is resistant to aging, has high mechanical strength, and is impact-resistant and shatterproof, making it suitable for forming lens frame 1031. PMMA material is a black material with good smoothness, an absorption rate of 99.9% for visible light, and a near-infrared light transmittance of 95%, making it suitable for forming lens frame 1031.

[0095] Since the light-emitting element 102 is an infrared light-emitting diode, the light emitted by the light-emitting element 102 is infrared light. On the one hand, because the target area of ​​the lens frame 1031 can transmit infrared light, the light emitted by the light-emitting element 102, after being reflected by the user's eyes, can pass through the target area of ​​the lens frame 1031 and illuminate the photoelectric sensing component 104. On the other hand, because the target area of ​​the lens frame 1031 can absorb visible light, the user will not see the photoelectric sensing component 104 located in the peripheral area 101b of the display panel 101 when wearing the wearable display device 10, resulting in a better user experience.

[0096] In this embodiment of the application, the fact that the photoelectric sensing component 104 receives the light signal of the light-emitting element 102 reflected from the user's eye through the lens frame 1031 can be used to indicate that the photoelectric sensing component 104 receives the light signal reflected from the entire area of ​​the user's eye through the lens frame 1031, but does not receive the light signal of the light-emitting element 102 reflected from any area of ​​the user's eye through the lens 1032.

[0097] Optionally, if the light reflected from the first target area of ​​the user's eye can be transmitted through the lens frame 1031 and illuminate the photoelectric sensing component 104 located in the peripheral area 101b of the display panel 101, then the light reflected from all areas of the user's eye can be transmitted through the lens frame 1031 and illuminate the photoelectric sensing component 104 located in the second target area.

[0098] The orthographic projection of the first target area of ​​the user's eye on the display panel 101 is farther from the orthographic projection of the photoelectric sensing component 104 located in the second target area on the display panel 101 than the orthographic projection of other areas of the user's eye on the display panel 101.

[0099] For example, the first target area of ​​the user's eye can be the area at the bottom of the user's eye. The photoelectric sensing component 104 of the second target area can be the photoelectric sensing component 104 of the upper area 101b1 of the peripheral area 101b. That is, if the light reflected from the bottom of the user's eye can be transmitted through the lens frame 1031 and illuminate the photoelectric sensing component 104 of the upper area 101b1 of the peripheral area 101b, then the light reflected from all areas of the user's eye can be transmitted through the lens frame 1031 and illuminate the photoelectric sensing component 104 of the upper area 101b1 of the peripheral area 101b.

[0100] Alternatively, the first target area of ​​the user's eye can be the uppermost area of ​​the user's eye. The photoelectric sensing component 104 of the second target area can be the photoelectric sensing component 104 of the lower area 101b3 of the peripheral area 101b. That is, if the light reflected from the uppermost area of ​​the user's eye can be transmitted through the lens frame 1031 and illuminate the photoelectric sensing component 104 located in the lower area 101b3 of the peripheral area 101b, then the light reflected from all areas of the user's eye can be transmitted through the lens frame 1031 and illuminate the photoelectric sensing component 104 located in the lower area 101b3 of the peripheral area 101b.

[0101] Alternatively, the first target area of ​​the user's eye can be the leftmost area of ​​the user's eye. The photoelectric sensing component 104 of the second target area can be the photoelectric sensing component 104 of the right area 101b2 of the peripheral area 101b. That is, if the light reflected from the leftmost area of ​​the user's eye can be transmitted through the lens frame 1031 and illuminate the photoelectric sensing component 104 of the right area 101b2 of the peripheral area 101b, then the light reflected from all areas of the user's eye can be transmitted through the lens frame 1031 and illuminate the photoelectric sensing component 104 of the right area 101b2 of the peripheral area 101b.

[0102] Alternatively, the first target area of ​​the user's eye can be the rightmost area of ​​the user's eye. The photoelectric sensing component 104 of the second target area can be the photoelectric sensing component 104 of the left area 101b4 of the peripheral area 101b. That is, if the light reflected from the rightmost area of ​​the user's eye can be transmitted through the lens frame 1031 and illuminate the photoelectric sensing component 104 of the left area 101b4 of the peripheral area 101b, then the light reflected from all areas of the user's eye can be transmitted through the lens frame 1031 and illuminate the photoelectric sensing component 104 of the left area 101b4 of the peripheral area 101b.

[0103] In this embodiment, the lens 1032 can be circular. To ensure that light reflected from the first target area of ​​the user's eye can be transmitted through the lens frame 1031 and illuminate the photoelectric sensing component 104 located in the second target area, the distance l between the center of the light-transmitting area of ​​the optical structure 105 and the center of the display area 101a of the display panel 101 must satisfy the following:

[0104]

[0105] The light-transmitting area of ​​the optical structure 105 is used to transmit light signals to the photoelectric sensing component 104 located in the second target area. The distance l between the center of the light-transmitting area of ​​the optical structure 105 and the center of the display area 101a of the display panel 101 can refer to the distance along the target direction between the center of the light-transmitting area of ​​the optical structure 105 and the center of the display area 101a of the display panel 101. This target direction can be perpendicular to the extension direction of the second target area.

[0106] For example, the target direction can be the second direction Y, and the extension direction of the second target region can be the first direction X. Alternatively, the target direction can be the first direction X, and the extension direction of the second target region can be the second direction Y.

[0107] In formula (1) above, d1 is the distance between the user's eye and the lens 1032, d2 is the distance between the lens 1032 and the display panel 101, R1 is the radius of the lens 1032, and a is the maximum radius of pupil movement. The distance d1 between the user's eye and the lens 1032 can be considered as an approximate distance between the user's eye and the lens 1032 when the user is wearing the wearable display device. Furthermore, different people have different eye sizes, and their maximum radius of pupil movement also varies. Therefore, the maximum radius of pupil movement a can be an empirical value, for example, 8 millimeters (mm).

[0108] Assuming d1 is 30mm, d2 is 30mm, a is 8mm, and R1 is 20mm, then according to the above formula (1), we can conclude that l ≥ 48mm. That is, if the distance l between the center of the light-transmitting area of ​​the optical structure 105 and the center of the display area 101a of the display panel 101 is greater than or equal to 48mm, it can be guaranteed that the light reflected from any area of ​​the user's eye can be transmitted through the lens frame 1031 and illuminate the photoelectric sensing component 104 located in the second target area.

[0109] In this embodiment of the application, the above formula (1) can be obtained by transforming the following formula (2):

[0110]

[0111] Among them, the above formula (2) can be obtained according to the similarity theorem of triangles.

[0112] In the embodiments of this application, reference is made to Figure 6 Each of the multiple light-emitting elements 102 can be fixedly connected to the side of the lens frame 1031 away from the display panel 101, and the multiple light-emitting elements 102 are evenly arranged. In this case, in order to prevent the light-emitting elements 102 fixed on the lens frame 1031 from blocking the light signal reflected from the user's eyes, the distance R2 between the side of the light-emitting element 102 closer to the lens 1032 and the center of the display area 101a of the display panel 101 must satisfy:

[0113]

[0114] The meaning of each symbol in the above formula (3) can be found in the specific description of the symbols in formula (1) above. This application embodiment will not repeat the details here.

[0115] The distance R2 between the side of the light-emitting element 102 near the lens 1032 and the center of the display area 101a of the display panel 101 can refer to the distance along the target direction between the side of the light-emitting element 102 near the lens 1032 and the center of the display area 101a of the display panel 101. This target direction can be perpendicular to the extension direction of the second target area.

[0116] For example, the target direction can be the second direction Y, and the extension direction of the second target region can be the first direction X. Alternatively, the target direction can be the first direction X, and the extension direction of the second target region can be the second direction Y.

[0117] Assuming d1 is 30mm, d2 is 30mm, a is 8mm, R1 is 20mm, and l is 48mm, then according to the above formula (3), R2 ≥ 28mm. That is, if the distance R2 between the side of the light-emitting element 102 closest to the lens 1032 and the center of the display area 101a of the display panel 101 is greater than or equal to 28mm, the light-emitting element 102 fixed on the lens frame 1031 can be prevented from blocking the light signal reflected by the user's eyes.

[0118] In this embodiment of the application, the above formula (3) can be obtained by transforming the following formula (4):

[0119]

[0120] Among them, the above formula (4) can be obtained according to the similarity theorem of triangles.

[0121] In this embodiment, if the light-emitting element 102 is not fixed on the side of the lens frame 1031 away from the display panel 101, but is integrated into the display panel 101, then when the target structure is the lens frame 1031, it is not necessary to make the distance R2 between the side of the light-emitting element 102 close to the lens 1032 and the center of the display area 101a of the display panel 101 satisfy the above formula (3). It is only necessary to make the light emitted by the light-emitting element 102 able to illuminate the user's eyes.

[0122] Optional, see reference Figure 8 The light-emitting element 102 is fixedly connected to the side of the lens frame 1031 away from the display panel 101, and the target area of ​​the lens frame 1031 can be located between the light-emitting element 102 and the lens 1032. Alternatively, refer to... Figure 9 The light-emitting element 102 is fixedly connected to the side of the lens frame 1031 away from the display panel 101, and the target area of ​​the lens frame 1031 can be the entire area of ​​the lens frame 1031. Alternatively, refer to... Figure 9The light-emitting element 102 is not fixedly connected to the side of the lens frame 1031 away from the display panel 101, and the target area of ​​the lens frame 1031 can also be the entire area of ​​the lens frame 1031.

[0123] In this implementation, infrared light is transmitted through the target area of ​​the lens frame 1031, and the photoelectric sensing component 104 receives the light signal reflected from the light-emitting element 102 through the user's eye, which passes through the lens frame 1031. This achieves the purpose of the photoelectric sensing component 104 receiving the light signal reflected from the user's eye through one structure. Therefore, the reliability of the light signals received by each photoelectric sensing component 104 can be avoided by preventing the light signals from passing through different structures, thus ensuring the accuracy of determining the position of the gaze point.

[0124] As another alternative implementation, refer to Figure 10 The target structure is lens 1032. This lens 1032 can transmit both infrared and visible light.

[0125] Since the light-emitting element 102 is an infrared light-emitting diode, the light emitted by the light-emitting element 102 is infrared light. On the one hand, since the lens 1032 can transmit infrared light, the light emitted by the light-emitting element 102, after being reflected by the user's eye, can pass through the lens 1032 and illuminate the photoelectric sensing component 104. On the other hand, since the lens 1032 can transmit visible light, the user can view the image displayed on the display panel 101 through the lens 1032 when wearing the wearable display device 10.

[0126] In this embodiment of the application, the fact that the photoelectric sensing component 104 receives the light signal of the light-emitting element 102 reflected from the user's eye through the lens 1032 can be used to indicate that the photoelectric sensing component 104 receives the light signal of the light-emitting element 102 reflected from the entire area of ​​the user's eye through the lens 1032, but does not receive the light signal of the light-emitting element 102 reflected from any area of ​​the user's eye through the lens frame 1031.

[0127] Optionally, if the light reflected from the third target area of ​​the user's eye can be transmitted through the lens 1032 and illuminate the photoelectric sensing component 104 located in the fourth target area in the peripheral area 101b, then the light reflected from all areas of the user's eye can be transmitted through the lens 1032 and illuminate the photoelectric sensing component 104 located in the fourth target area.

[0128] Among them, the orthographic projection of the third target area of ​​the user's eye on the display panel 101 is closer to the orthographic projection of the photoelectric sensing component 104 located in the fourth target area on the display panel 101 than the orthographic projection of other areas of the user's eye on the display panel 101.

[0129] For example, the third target area of ​​the user's eye can be the area at the very bottom of the user's eye. The photoelectric sensing component 104 of the fourth target area can be the photoelectric sensing component 104 of the lower area 101b3 of the peripheral area 101b. That is, if the light reflected from the area at the very bottom of the user's eye can be transmitted through the lens 1032 and illuminate the photoelectric sensing component 104 of the lower area 101b3 of the peripheral area 101b, then the light reflected from all areas of the user's eye can be transmitted through the lens 1032 and illuminate the photoelectric sensing component 104 of the lower area 101b3 of the peripheral area 101b.

[0130] Alternatively, the third target area of ​​the user's eye can be the uppermost area of ​​the user's eye. The photoelectric sensing component 104 of the fourth target area can be the photoelectric sensing component 104 of the upper region 101b1 of the peripheral area 101b. That is, if the light reflected from the uppermost area of ​​the user's eye can be transmitted through the lens 1032 and illuminate the photoelectric sensing component 104 of the upper region 101b1 of the peripheral area 101b, then the light reflected from all areas of the user's eye can be transmitted through the lens 1032 and illuminate the photoelectric sensing component 104 of the upper region 101b1 of the peripheral area 101b.

[0131] Alternatively, the third target area of ​​the user's eye can be the rightmost area of ​​the user's eye. The photoelectric sensing component 104 of the fourth target area can be the photoelectric sensing component 104 of the right area 101b2 of the peripheral area 101b. That is, if the light reflected from the rightmost area of ​​the user's eye can be transmitted through the lens 1032 and illuminate the photoelectric sensing component 104 of the right area 101b2 of the peripheral area 101b, then the light reflected from all areas of the user's eye can be transmitted through the lens 1032 and illuminate the photoelectric sensing component 104 of the right area 101b2 of the peripheral area 101b.

[0132] Alternatively, the third target area of ​​the user's eye can be the leftmost area of ​​the user's eye. The photoelectric sensing component 104 of the fourth target area can be the photoelectric sensing component 104 of the left area 101b4 of the peripheral area 101b. That is, if the light reflected from the leftmost area of ​​the user's eye can be transmitted through the lens 1032 and illuminate the photoelectric sensing component 104 of the left area 101b4 of the peripheral area 101b, then the light reflected from all areas of the user's eye can be transmitted through the lens 1032 and illuminate the photoelectric sensing component 104 of the left area 101b4 of the peripheral area 101b.

[0133] In this embodiment, the lens 1032 can be circular. To ensure that light reflected from the third target region of the user's eye can be transmitted through the lens 1032 and illuminate the photoelectric sensing component 104 located in the fourth target region, the radius R2 of the lens 1032 must satisfy the following:

[0134]

[0135] Wherein, l is the distance between the center of the light-transmitting area and the center of the display area 101a of the display panel 101, d1 is the distance between the user's eye and the lens 1032, d2 is the distance between the lens 1032 and the display panel 101, and a is the maximum movement radius of the pupil.

[0136] The distance d1 between the user's eye and the lens 1032 can be considered as an approximate distance when the user wears the wearable display device 10. Furthermore, since different people have different eye sizes, their maximum pupil radius of motion also varies. Therefore, the maximum pupil radius of motion a can be an empirical value, such as 8mm.

[0137] Additionally, the light-transmitting area of ​​the optical structure 105 is used to transmit light signals to the photoelectric sensing component 104 located in the fourth target area. The distance l between the center of the light-transmitting area of ​​the optical structure 105 and the center of the display area 101a of the display panel 101 can refer to the distance along the target direction between the center of the light-transmitting area of ​​the optical structure 105 and the center of the display area 101a of the display panel 101. This target direction can be perpendicular to the extension direction of the fourth target area.

[0138] For example, the target direction can be the second direction Y, and the extension direction of the fourth target region can be the first direction X. Alternatively, the target direction can be the first direction X, and the extension direction of the fourth target region can be the second direction Y.

[0139] In this embodiment of the application, the above formula (5) can be obtained by transforming the following formula (6):

[0140]

[0141] Formula (6) can be obtained from the similarity theorem of triangles.

[0142] In this implementation, by increasing the radius of the lens 1032 and enabling the photoelectric sensing component 104 to receive the light signal reflected from the light-emitting element 102 through the user's eye via the lens 1032, the photoelectric sensing component 104 achieves the purpose of receiving the light signal reflected from the user's eye through a single structure. This avoids the reliability of the light signals received by each photoelectric sensing component 104 being affected by light signals passing through different structures, thus ensuring the accuracy of determining the position of the gaze point.

[0143] In the embodiments of this application, reference is made to Figure 6 and Figure 10 The wearable display device 10 may further include a light filter 106. The light filter 106 may be located on the side of the plurality of photoelectric sensing components 104 away from the display panel 101, and the orthographic projection of the light filter 106 on the display panel 101 overlaps the orthographic projection of the plurality of photoelectric sensing components 104 on the display panel 101. The light filter 106 may be used to absorb infrared light and visible light.

[0144] By setting a filter 106 on the side of the photoelectric sensing component 104 away from the display panel 101, visible light is filtered out, so as to avoid the light emitted by the display panel 101 from affecting the light signal received by the photoelectric sensing component 104 and to ensure the accuracy of the determined gaze point position.

[0145] refer to Figure 6 and Figure 10 It can also be seen that the wearable display device 10 may further include a light-transmitting layer 107. This light-transmitting layer 107 is located on the side of the plurality of photoelectric sensing components 104 away from the display panel 101. Furthermore, Figure 6 and Figure 10 In this process, the orthographic projection of the light-transmitting layer 107 on the display panel 101 covers the orthographic projection of the multiple photoelectric sensing components 104 on the display panel 101.

[0146] Figure 11 This is a schematic diagram of an optical structure and photoelectric sensing component provided in an embodiment of this application. Figure 12 This is a schematic diagram of another optical structure and photoelectric sensing component provided in an embodiment of this application. Wherein, Figure 11 The wearable display device 10 shown includes a light-transmitting layer 107. Figure 12 The wearable display device 10 shown does not include the light-transmitting layer 107.

[0147] Combination Figure 11 and Figure 12In the scheme where the light-transmitting layer 107 is provided, the distance w1 between the optical structure 105 and the photoelectric sensing component 104 is greater than the distance w2 between the optical structure 105 and the photoelectric sensing component 104 in the scheme where the light-transmitting layer 107 is not provided. That is, by providing the light-transmitting layer 107 in the wearable display device 10, the area of ​​the user's eye corresponding to the light signal that each photoelectric sensing component 104 can receive can be reduced, thereby improving the accuracy of the light signal received by the photoelectric sensing component 104 and thus improving the accuracy of the determined gaze point position.

[0148] In summary, the embodiments of this application provide a wearable display device. The wearable display device has high processing efficiency for the electrical signals sent by each photoelectric sensing component. Therefore, the wearable display device can quickly determine the position of the user's eye gaze point on the display panel based on the electrical signals sent by each photoelectric sensing component, thereby improving the efficiency of the display panel in displaying images and achieving a high refresh rate.

[0149] Furthermore, since the photoelectric sensing components receive the light signals reflected from the user's eye from the target structure in the lens assembly, it is possible to prevent the light signals received by each photoelectric sensing component from passing through different structures, thus ensuring the reliability of the light signals received by each photoelectric sensing component and thereby ensuring the accuracy of determining the position of the gaze point.

[0150] The above description is merely an optional embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A wearable display device, characterized in that, The wearable display device includes: A display panel having a display area and a peripheral area surrounding the display area; Multiple light-emitting elements, the light emitted by the multiple light-emitting elements being used to illuminate the user's eyes; A lens assembly is located on the light-emitting side of the display panel. The lens assembly includes a lens frame and a lens located within the lens frame. The light transmittance of the lens frame is greater than a threshold. In addition, a plurality of photoelectric sensing components are located in the peripheral area. Each photoelectric sensing component is used to receive light signals from the light-emitting element reflected by the user's eye through the target structure, and will not receive light signals from the light-emitting element reflected by the user's eye through another structure. The light signals are converted into electrical signals, which are used to determine the position of the user's gaze point on the display panel. The target structure is the lens or the lens frame, and the other structure is another structure other than the target structure between the lens and the lens frame.

2. The wearable display device according to claim 1, characterized in that, The plurality of light-emitting elements are infrared light-emitting diodes.

3. The wearable display device according to claim 2, characterized in that, The target structure is the lens frame; The target area of ​​the lens frame is used to transmit infrared light and absorb visible light, and the target area includes an area for the light signal of the light-emitting element to be reflected through the user's eye.

4. The wearable display device according to claim 3, characterized in that, The wearable display device further includes: an optical structure; The optical structure is located between the photoelectric sensing component and the lens component. The orthographic projection of the optical structure on the display panel is located in the peripheral area. The optical structure has a light-shielding area and multiple light-transmitting areas. Each light-transmitting area is used to transmit the light signal to at least one of the photoelectric sensing components.

5. The wearable display device according to claim 4, characterized in that, The lens is circular in shape; the distance between the center of each light-transmitting area and the center of the display area of ​​the display panel. satisfy: ； Wherein, d1 is the distance between the user's eye and the lens, d2 is the distance between the lens and the display panel, R1 is the radius of the lens, and a is the maximum movement radius of the pupil.

6. The wearable display device according to claim 5, characterized in that, The plurality of light-emitting elements are evenly arranged, and each light-emitting element is fixedly connected to the side of the lens frame away from the display panel; the distance R2 between the side of each light-emitting element closest to the lens and the center of the lens satisfies: 。 7. The wearable display device according to claim 6, characterized in that, The target area of ​​the lens frame is located between the light-emitting element and the lens; Alternatively, the target area of ​​the lens frame may be the entire area of ​​the lens frame.

8. The wearable display device according to any one of claims 3 to 7, characterized in that, The material of the target area of ​​the lens frame includes at least one of acrylonitrile-butadiene-styrene copolymer, polycarbonate, and polymethyl methacrylate.

9. The wearable display device according to claim 2, characterized in that, The target structure is the lens; The lens is used to transmit infrared light as well as visible light.

10. The wearable display device according to claim 9, characterized in that, The wearable display device further includes: an optical structure; The optical structure is located between the photoelectric sensing component and the lens component. The orthographic projection of the optical structure on the display panel is located in the peripheral area. The optical structure has a light-shielding area and multiple light-transmitting areas. Each light-transmitting area is used to transmit the light signal to at least one of the photoelectric sensing components.

11. The wearable display device according to claim 10, characterized in that, The lens is circular in shape; the radius R2 of the lens satisfies: ； Among them, the d1 is the distance between the center of the light-transmitting area and the center of the display area of ​​the display panel, d2 is the distance between the lens and the display panel in a direction perpendicular to the display panel, and a is the maximum movement radius of the pupil.

12. The wearable display device according to any one of claims 1 to 7, and 9 to 11, characterized in that, The wearable display device includes: a light filter; The filter is located on the side of the plurality of photoelectric sensing components away from the display panel, and the orthographic projection of the filter on the display panel covers the orthographic projection of the plurality of photoelectric sensing components on the display panel; the filter is used to transmit infrared light and absorb visible light.

13. The wearable display device according to any one of claims 1 to 7, and 9 to 11, characterized in that, The wearable display device further includes: a light-transmitting layer; The light-transmitting layer is located on the side of the plurality of photoelectric sensing components away from the display panel.

14. The wearable display device according to any one of claims 1 to 7 and 9 to 11, characterized in that, The surrounding area includes: a first area extending along a first direction and a second area extending along a second direction, wherein the first direction and the second direction intersect. The plurality of photoelectric sensing components include a plurality of first photoelectric sensing components and a plurality of second photoelectric sensing components; the plurality of first photoelectric sensing components are located in the first region and arranged along the first direction, and the plurality of second photoelectric sensing components are located in the second region and arranged along the second direction.

15. The wearable display device according to any one of claims 1 to 7 and 9 to 11, characterized in that, The wearable display device further includes: a processing circuit; The processing circuit is connected to each of the photoelectric sensing components, and the processing circuit is used to determine the position of the user's gaze point on the display panel based on the magnitude of the signal value of the electrical signal sent by each of the photoelectric sensing components and the position of at least one of the photoelectric sensing components.

Images