Intelligent glasses, image detection method thereof and augmented reality equipment

Abstract

The invention discloses intelligent glasses, an image detection method thereof and augmented reality equipment, and relates to the technical field of augmented reality, and the intelligent glasses comprise waveguide lenses, an image detection module and an optical machine module integrating a light source, a light splitting assembly and a reflection driving part; incident light of the light source is divided into first polarized light and second polarized light through the light splitting assembly, and the first polarized light and the second polarized light enter eyes of a user in the light conduction direction from the reflection driving piece to the waveguide lens. The image detection module is configured to obtain a projection optical image coupled to the eyes of the user by the waveguide lens based on the light conduction direction, determine the optical state of the glasses according to the projection optical image and a preset standard optical image, and enable the reflection driving part to adjust the light conduction direction according to the fact that the optical state of the glasses is an abnormal optical state; and the projection optical image coupled by the waveguide lens based on the adjusted light conduction direction is adjusted to be consistent with the standard optical image. The invention aims at the optical performance of the intelligent glasses when the intelligent glasses are subjected to physical impact.

Description

Technical Field

[0001] The present application relates to the field of extended reality technology, and in particular to a pair of smart glasses and an image detection method thereof, as well as an extended reality device. Background Art

[0002] With the continuous development of XR (eXtended Reality) technology, smart glasses have become an important application carrier of XR technology, and users have put forward higher requirements for the low-power design of smart glasses.

[0003] To avoid the problem of wire dragging caused by the separation of the power supply and the main body of the glasses, most of the current smart glasses adopt an integrated glasses structure and are equipped with a dual optical machine module. This not only significantly increases the power consumption of the smart glasses, but also the smart glasses are inevitably faced with the risk of physical impact such as falling or external force squeezing during daily wear, which may cause the optical components inside the glasses to be displaced, deformed or damaged, and further cause variations in optical performance, such as visual defects such as dark bands, which seriously interfere with the wearer's visual experience.

[0004] Therefore, how to improve the optical performance of smart glasses when subjected to physical impact while ensuring low power consumption of smart glasses is a technical problem that needs to be solved urgently. Summary of the invention

[0005] The main purpose of this application is to provide a pair of smart glasses and an image detection method thereof, as well as an extended reality device, aiming to ensure low power consumption of the smart glasses while improving the optical performance of the smart glasses when subjected to physical impact.

[0006] To achieve the above-mentioned object, the present application provides a smart glasses, which include a waveguide lens, an optical module and an image detection module, wherein the optical module includes a light source, a light splitting component and a reflective driving component;

[0007] The incident light from the light source is split into a first polarized light and a second polarized light by the light splitting component, and then passes through the reflective driving component to the light transmission direction of the waveguide lens and is incident to both eyes of the user;

[0008] The image detection module is configured to obtain a projected optical image coupled out by the waveguide lens to both eyes of the user based on the light conduction direction, determine an optical state of the glasses based on the projected optical image and a preset standard optical image, and enable the reflective driving component to adjust the light conduction direction based on the optical state of the glasses being an abnormal optical state, until the projected optical image coupled out by the waveguide lens based on the adjusted light conduction direction is adjusted to be consistent with the standard optical image.

[0009] In one embodiment, the reflective driving member includes a light reflecting member, and the light reflecting member is a left reflecting module and a right reflecting module that are mirror-symmetrical, the light reflecting surface of the left reflecting module is arranged toward the light splitting surface of the light splitting component, and the light reflecting surface of the right reflecting module is arranged toward the total reflecting surface of the light splitting component, the total reflecting surface is the opposite surface of the light splitting surface, a polarizing light splitting film is attached to the light splitting surface, and an anti-reflection film is plated on the total reflecting surface;

[0010] The light reflecting member is configured to project the first polarized light projected by the beam splitter surface to the left eye area of ​​the waveguide lens through the light reflecting surface of the left reflecting module, and project the second polarized light projected by the beam splitter surface to the right eye area of ​​the waveguide lens through the light reflecting surface of the right reflecting module; wherein,

[0011] The light reflecting surface of the left reflecting module constitutes the left reflecting surface of the light reflecting member, and the light reflecting surface of the right reflecting module constitutes the right reflecting surface of the light reflecting member.

[0012] In one embodiment, the left reflection module and the right reflection module are both the same light reflection module, and the light reflection module includes a reflector, a reflector base, a fixing plate and a reflection driving unit;

[0013] The reflector is fixedly connected to the reflector base, the reflector drive unit is arranged on a side of the reflector base that is not fixedly connected to the reflector, and the reflector drive unit is arranged on the fixed plate on a side away from the reflector base; wherein,

[0014] The side of the reflector in the left reflective module away from the reflector base constitutes the light reflecting surface of the left reflective module; the side of the reflector in the right reflective module away from the reflector base constitutes the light reflecting surface of the right reflective module.

[0015] In one embodiment, the light splitting component includes a first prism and a second prism, and the shape of the first prism and the shape of the second prism are both isosceles right triangles;

[0016] After the right-angled side of the first prism is glued to the right-angled side of the second prism to form a rhombus prism, the hypotenuse of the first prism is arranged opposite to the hypotenuse of the second prism; wherein,

[0017] The hypotenuse of the first prism constitutes the light splitting surface of the light splitting component and is arranged on the side close to the light source; the hypotenuse of the second prism constitutes the total reflection surface of the light splitting component and is arranged on the side far away from the light source.

[0018] In one embodiment, the light splitting component includes a parallelogram prism, a side of the parallelogram prism facing the light source constitutes a light splitting surface of the light splitting component, and a side of the parallelogram prism away from the light source constitutes a total reflection surface of the light splitting component.

[0019] In one embodiment, the optical machine module includes a left reflector, which is arranged on the optical path of the left reflective surface of the optical reflector projecting the first polarized light, and includes a left relay lens, a left polarization beam splitter, a left lens, a left modulation screen and a left exit pupil lens;

[0020] The left polarization beam splitter and the waveguide lens are respectively arranged on both sides of the left exit pupil lens, the left light exit surface of the left exit pupil lens faces the left eye area of ​​the waveguide lens, and the left light exit surface is the side of the left exit pupil lens away from the left polarization beam splitter;

[0021] The left polarized beam splitter is arranged between the left relay lens and the left lens, the left relay lens is arranged toward the left reflective surface of the light reflector, and the left modulation screen is arranged on a side of the left lens away from the left polarized beam splitter.

[0022] In one embodiment, the optical machine module includes a right reflector, which is arranged on the optical path of the second polarized light projected by the right reflective surface of the optical reflector, and includes a right relay lens, a right polarization beam splitter, a right lens, a right modulation screen and a right exit pupil lens;

[0023] The right polarization beam splitter and the waveguide lens are respectively arranged on both sides of the right exit pupil lens, the right light exit surface of the right exit pupil lens faces the right eye area of ​​the waveguide lens, and the right light exit surface is the side of the right exit pupil lens away from the right polarization beam splitter;

[0024] The right polarization beam splitter is arranged between the right relay lens and the right lens, the right relay lens is arranged toward the right reflection surface of the light reflection element, and the right modulation screen is arranged on a side of the right lens away from the right polarization beam splitter.

[0025] In one embodiment, the optical machine module includes a projection optical component, and the projection optical component is arranged between the light source and the light splitting component;

[0026] The projection optical component includes a collimating lens, a light homogenizing lens and a relay lens. The light homogenizing lens is arranged between the collimating lens and the relay lens. The collimating lens is arranged toward the light source, and the relay lens is arranged toward the splitting surface of the splitting component.

[0027] In addition, to achieve the above-mentioned purpose, the present application also provides an image detection method of smart glasses, the image detection method of smart glasses is applied to any of the smart glasses described above, and the image detection method of smart glasses includes:

[0028] When it is determined that the first polarized light and the second polarized light projected by the light splitting component are incident on the user's eyes through the light transmission direction of the reflective driving component to the waveguide lens, the projected optical image coupled out of the waveguide lens to the user's eyes is acquired through the image detection module;

[0029] According to the optical state of the glasses being an abnormal optical state, the reflective driving component is enabled to adjust the light transmission direction until the projected optical image coupled out by the waveguide lens based on the adjusted light transmission direction is adjusted to be consistent with the standard optical image; wherein,

[0030] The light splitting component is configured to split incident light from a light source into the first polarized light and the second polarized light.

[0031] In addition, to achieve the above-mentioned purpose, the present application also provides an extended reality device, wherein the extended reality device includes smart glasses;

[0032] Alternatively, the extended reality device includes a memory, a processor, and an image detection program for smart glasses stored in the memory and executable on the processor, and the image detection program for smart glasses implements the steps of the above-mentioned image detection method for smart glasses when executed by the processor.

[0033] The present application provides a pair of smart glasses and an image detection method thereof, as well as an extended reality device. The smart glasses integrate a waveguide lens, an optical-mechanical module, and an image detection module, and by arranging a splitter component and a reflective driver in the optical-mechanical module of a single light source to work together, the optical performance of the smart glasses when subjected to physical impact is effectively improved while ensuring low power consumption of the smart glasses. Specifically, the incident light of the light source is divided into the first polarized light and the second polarized light by the light splitting component, and is incident on the user's eyes through the light transmission direction of the reflective driving component to the waveguide lens, so that the light splitting of the light splitting component can achieve the visual display requirements of both eyes with only a single light source, effectively avoiding the problem of high power consumption of smart glasses caused by the traditional dual-optical machine module configuration, and significantly reducing the power consumption of smart glasses; next, the projected optical image coupled out of the waveguide lens to the user's eyes based on the light transmission direction is compared with the preset standard optical image through the image detection module, so that the optical state of the smart glasses can be accurately obtained. Once the optical performance variation caused by physical impact (such as visual defects such as dark bands) is found, that is, when the optical state of the glasses is an abnormal optical state, the reflective driving component is immediately triggered to automatically adjust the light transmission direction from the light reflector to the waveguide lens, so that the projected optical image coupled out of the waveguide lens based on the adjusted light transmission direction is quickly restored to be consistent with the standard optical image, avoiding the image dark band phenomenon caused by physical impact of the smart glasses, significantly improving the optical performance of the smart glasses when subjected to physical impact, and effectively ensuring the visual experience of the wearer. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0035] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0036] Figure 1 is a schematic diagram of the overall optical principle of the smart glasses involved in the first embodiment of the present application;

[0037] Figure 2 is a schematic diagram of a light reflection module involved in the first embodiment of the present application;

[0038] Figure 3 It is a schematic diagram of a projected optical image and a standard optical image involved in the embodiment of the present application;

[0039] Figure 4is a schematic diagram of a waveguide lens involved in the first embodiment of the present application;

[0040] Figure 5 is a schematic diagram of a glasses bracket involved in the first embodiment of the present application;

[0041] Figure 6 is a schematic diagram of a light splitting component involved in the first embodiment of the present application;

[0042] Figure 7 is a schematic diagram of a left polarization beam splitter according to the first embodiment of the present application;

[0043] Figure 8 is a schematic diagram of a right polarization beam splitter according to the first embodiment of the present application;

[0044] Fig. 9 is an optical principle diagram of the smart glasses involved in the first embodiment of the present application;

[0045] Fig.10 is another optical principle diagram of the smart glasses involved in the first embodiment of the present application;

[0046] Fig.11 is a packaging schematic diagram of an optical-mechanical module involved in the first embodiment of the present application;

[0047] Fig.12 is a schematic diagram of the structure of the smart glasses involved in the first embodiment of the present application;

[0048] Fig.13 This is a flow chart of a second embodiment of the image detection method for smart glasses of the present application;

[0049] Fig.14 It is a schematic diagram of the structure of the extended reality device involved in the embodiment of the present application.

[0050] Description of Figure Numbers:

[0051] 100, waveguide lens; 11, left coupling-in area; 12, right coupling-in area; 13, left coupling-out area; 14, right coupling-out area; 15, image detection area; 200, optical machine module; 300, image detection module; 10, light source; 20, spectrometer component; 30, reflection driver; 31, light reflection element; 310, light reflection module; 310-L, left reflection module; 310-R, right reflection module; Q1, reflector; Q2, reflector base; Q3, reflection drive unit; Q4, fixing plate; 40, left reflection element; 410, left relay lens; 420, left polarization spectrometer; L1, first polarization spectrometer prism; L2, second polarization spectrometer prism; L3, left reflector; 430, Left lens; 440, left modulation screen; 450, left exit pupil lens; 50, right reflector; 51, right relay lens; 52, right polarization beam splitter; R1, third polarization beam splitter prism; R2, fourth polarization beam splitter prism; R3, right reflector; 53, right lens; 54, right modulation screen; 55, right exit pupil lens; 400, glasses holder; 41, left light hole; 42, right light hole; 43, image detection hole; 44, nose pad hole; 45, hinge hole; 46, temple pin; 500, glasses shell; 600, nose pad; 700, temple; PBS1, polarization beam splitter film; HWP1, phase conversion film; QWP1, phase delay film; S, first polarized light; P, second polarized light.

[0052] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0053] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0054] It should be noted that if the embodiments of the present application involve directional indications (such as up, down, left, right, front, back...), the directional indications are only used to explain the relative position relationship, movement status, etc. between the components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication will also change accordingly.

[0055] In addition, if there are descriptions involving "first", "second", etc. in the embodiments of the present application, the descriptions of "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or suggesting their relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the ability of ordinary technicians in the field to implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0056] Here, exemplary embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application.

[0057] In the field of XR (eXtended Reality) technology, smart glasses are an important carrier of XR technology, and the degree of perfection of their design and functions directly determines the quality of user experience. According to the degree of integration, smart glasses are mainly divided into two categories: split and integrated. Split smart glasses effectively solve the power supply problem by separating functional modules such as power supply and drive from the main body of the glasses. However, the resulting wire dragging phenomenon greatly reduces the convenience and comfort of wearing, and cannot meet the high requirements of users for portable wear. In contrast, integrated smart glasses integrate functional modules with the main body of the glasses, successfully avoiding the problem of wire dragging, but the dual-optical machine module on the glasses consumes huge power and requires large-capacity battery support, which increases the weight of the glasses and increases the burden on the wearer's head, thereby seriously affecting the wearer's wearing experience. In addition, smart glasses are inevitably faced with the risk of physical impact such as falling or external force squeezing during daily wear, which causes the optical components inside the glasses to be displaced, deformed or damaged, and then causes variations in optical performance, such as visual defects such as dark bands, which seriously interfere with the wearer's visual experience.

[0058] In order to solve the technical defects of the above-mentioned traditional smart glasses, the present application provides a pair of smart glasses and an image detection method thereof, as well as an extended reality device.

[0059] The present application embodiment provides a smart glasses, referring to Figure 1 As shown, Figure 1 The figure is a schematic diagram of the optical principle of the smart glasses involved in the first embodiment of the present application. The smart glasses include a waveguide lens 100, an optical machine module 200 and an image detection module 300, and the optical machine module 200 includes a light source 10, a light splitting component 20 and a reflective driving component 30.

[0060] The incident light from the light source 10 is split into a first polarized light S and a second polarized light P by the light splitting component 20 , and then incident to the user's eyes through the light transmission direction of the reflective driving component 30 to the waveguide lens 100 .

[0061] In this embodiment, refer to Figure 1 After the light splitting component 20 splits the incident light (i.e., non-polarized light) from the light source 10 into a first polarized light S and a second polarized light P, the first polarized light S and the second polarized light P are incident to the user's eyes through the light transmission direction of the reflective driving component 30 to the waveguide lens 100, thereby achieving the goal of using only one light source 10 to meet the visual display needs of both eyes, avoiding the technical problem of high power consumption of smart glasses caused by the traditional dual-light machine module 200 configuration, that is, the present application significantly reduces the power consumption of smart glasses by splitting the single light source 10 through the light splitting component 20, thereby reducing the dependence on large-capacity batteries, further reducing the overall weight of the smart glasses, and thus significantly improving the user's wearing experience.

[0062] It should be noted that the light source 10 includes but is not limited to LED (Light Emitting Diode) lamps, and the incident light of the light source 10 can be understood as non-polarized light from the light source 10; the first polarized light S can be understood as S polarized light, which refers to polarized light in which the electric field vibration direction is perpendicular to the light propagation direction of the incident light; the second polarized light P can be understood as P polarized light, which refers to polarized light in which the electric field vibration direction is the same as the light propagation direction of the incident light.

[0063] Smart glasses can be understood as XR glasses, which can be a pair of glasses that combine one or more of the following technologies: AR (Augmented Reality) technology, VR (Virtual Reality) technology, and MR (Mixed Reality) technology.

[0064] The image detection module 300 is configured to obtain the projected optical image coupled out by the waveguide lens 100 to the user's eyes based on the light conduction direction, determine the optical state of the glasses based on the projected optical image and a preset standard optical image, and enable the reflective driving component 30 to adjust the light conduction direction based on the optical state of the glasses being an abnormal optical state, until the projected optical image coupled out by the waveguide lens 100 based on the adjusted light conduction direction is adjusted to be consistent with the standard optical image.

[0065] In this embodiment, refer to Figure 1 to Figure 2 , the reflection driving member 30 includes Figure 2The light reflecting member 31 shown, the first polarized light S and the second polarized light P are projected onto the light reflecting member 31, and when the light transmission direction from the light reflecting member 31 to the waveguide lens 100 is coupled out to the user's eyes, the projected optical image coupled out from the waveguide lens 100 to the user's eyes is captured in real time by the image detection module 300, and the projected optical image is compared and analyzed with the preset standard optical image, so that the current optical state of the smart glasses (i.e., the optical state of the glasses) can be accurately evaluated. Once it is determined that the optical state of the glasses is an abnormal optical state, the reflection driving member 30 is immediately triggered to move the position of the light reflecting mirror surface in the light reflecting member 31 to dynamically adjust the light transmission direction from the light reflecting member 31 to the waveguide lens 100, until the projected optical image coupled out by the waveguide lens 100 based on the adjusted light transmission direction is quickly restored to be consistent with the standard optical image, thereby ensuring that the smart glasses continue to provide high-quality, defect-free visual experience, significantly enhancing the user's wearing comfort and satisfaction.

[0066] It should be noted that the preset standard optical image can be understood as a cross-shaped standard template constructed according to the preset standard template. Figure 3 (a) shows a standard optical image. The light reflecting mirror surface of the light reflecting member 31 can be understood as the left reflecting surface of the light reflecting member 31 and the right reflecting surface of the light reflecting member 31.

[0067] The projected optical image includes a left field of view image and a right field of view image, wherein the left field of view image can be understood as a polarized optical image in which the first polarized light S passes through the left reflective surface of the light reflector 31 to the light transmission direction of the waveguide lens 100 and is coupled to the user's left eye; the right field of view image can be understood as a polarized optical image in which the first polarized light S passes through the right reflective surface of the light reflector 31 to the light transmission direction of the waveguide lens 100 and is coupled to the user's right eye.

[0068] In a specific embodiment, the left / right field of view image formed by the waveguide lens 100 is coupled to the image detection module 300; at this time, after the image detection module 300 receives the left / right field of view image coupled out by the waveguide lens 100, it determines the image center position and the image edge four corner positions corresponding to the cross standard template, and constructs the left / right field of view image with the image center position and the image edge four corner positions. Figure 3(b) shows the left / right cross template image; next, determine whether the left / right cross template image completely overlaps with the standard optical image; if the left / right cross template image completely overlaps with the standard optical image, determine that the optical state of the glasses is a normal optical state; if the left / right cross template image does not completely overlap with the standard optical image, determine that the optical state of the glasses is an abnormal optical state, and in response to the optical state of the glasses being an abnormal optical state, trigger the reflection driving member 30 to move the left / right reflection surface of the light reflecting member 31 to dynamically adjust the light transmission direction from the left / right reflection surface of the light reflecting member 31 to the waveguide lens 100, thereby dynamically adjusting the left / right field of view image coupled out by the waveguide lens 100, until the left / right field of view image coupled out by the waveguide lens 100 based on the adjusted light transmission direction (i.e., the adjusted left / right field of view image) completely overlaps with the standard optical image, thereby ensuring that the smart glasses continue to provide high-quality, defect-free visual experience, avoiding the image dark band phenomenon caused by physical impact on the smart glasses, and significantly enhancing the wearer's visual experience.

[0069] Further, in some feasible embodiments, referring to Figure 4 , Figure 4 It is a schematic diagram of an optical reflector involved in an embodiment of the present application. The reflective driving member 30 includes a light reflecting member 31, which is a mirror-symmetrical left reflecting module 310-L and a right reflecting module 310-R. The light reflecting surface of the left reflecting module 310-L is arranged toward the splitting surface of the splitting component 20, and the light reflecting surface of the right reflecting module 310-R is arranged toward the total reflecting surface of the splitting component 20. The total reflecting surface is the opposite surface of the splitting surface. A polarizing splitting film PBS1 is attached to the splitting surface, and an anti-reflection film is plated on the total reflecting surface. The light reflecting member 31 is arranged to project the first polarized light S projected by the splitting surface to the left eye area of ​​the waveguide lens 100 through the light reflecting surface of the left reflecting module 310-L, and project the second polarized light P projected by the splitting surface to the right eye area of ​​the waveguide lens 100 through the light reflecting surface of the right reflecting module 310-R. Among them, the light reflecting surface of the left reflecting module 310-L constitutes the left reflecting surface of the light reflecting member 31, and the light reflecting surface of the right reflecting module 310-R constitutes the right reflecting surface of the light reflecting member 31.

[0070] In this embodiment, the light reflecting member 31 integrates a left reflecting module 310-L and a right reflecting module 310-R which are mirror-symmetrical. The light reflecting surface of the left reflecting module 310-L is arranged toward the splitting surface of the splitting component 20. After the splitting component 20 splits the incident light of the single light source 10 into the first polarized light S and the second polarized light P, the first polarized light S reflected by the polarization splitting film PBS1 on the splitting surface is accurately guided to the left eye area of ​​the waveguide lens 100 through the light reflecting surface of the left reflecting module 310-L; the light reflecting surface of the right reflecting module 310-R The light reflecting surface of block 310-R is arranged toward the opposite side of the splitting surface (i.e., the total reflection surface of the splitting component 20), so that the second polarized light P is projected onto the total reflection surface after passing through the polarization splitting film PBS1 on the splitting surface, and the light reflection efficiency of the second polarized light P reflected to the light reflecting surface of the right reflection module 310-R is improved by the anti-reflection film coated on the total reflection surface. Then, the second polarized light P reflected by the total reflection surface can be accurately guided to the right eye area of ​​the waveguide lens 100 through the light reflecting surface of the right reflection module 310-R.

[0071] It should be noted that the polarizing beam splitter film PBS1 is a PBS (Polarizing Beam Splitter) film, that is, when non-polarized light is incident on the PBS film, the incident non-polarized light is split by the PBS film into two perpendicular beams of a first polarized light S (i.e., S polarized light, also called S-state polarized light) and a second polarized light P (i.e., P polarized light, also called P-state polarized light), the first polarized light S is reflected by the PBS film, and the second polarized light P passes through the PBS film.

[0072] The waveguide lens 100 may be Figure 4 As shown in the whole waveguide plate, the left eye area of ​​the waveguide lens 100 includes a left coupling-in area 11 and a left coupling-out area 13, and the right eye area of ​​the waveguide lens 100 includes a right coupling-in area 12 and a right coupling-out area 14; the waveguide lens 100 is also provided with an image detection area 15 for coupling out the projection optical head image to the image detection module 300.

[0073] In a specific embodiment, refer to Figure 5 , Figure 5 It is a schematic diagram of the glasses stand 400 involved in the first embodiment of the present application. Figure 5 The left light hole 41 on the glasses holder 400 is arranged toward the left coupling region 11. Figure 5 The right light hole 42 on the glasses holder 400 is arranged toward the right coupling region 12. Figure 5 The image detection hole 43 on the glasses stand 400 is arranged toward the image detection area 15. In addition, hinge holes 45 are arranged on the left and right sides of the glasses stand 400. The hinge holes 45 are hingedly connected to the left and right temples 700 of the smart glasses through the temple 700 pins 46. The glasses stand 400 is also provided with a nose pad 600 hole 44 for snap-fitting the nose pad 600 of the smart glasses.

[0074] Further, in some other feasible embodiments, referring to Figure 2 The left reflection module 310-L and the right reflection module 310-R are both the same light reflection module 310, and the light reflection module 310 includes a reflector Q1, a reflector base Q2, a fixing plate Q4 and a reflection drive unit Q3; the reflector Q1 is fixedly connected to the reflector base Q2, and a reflection drive unit Q3 is provided on the side of the reflector base Q2 that is not fixedly connected to the reflector Q1, and the side of the reflection drive unit Q3 away from the reflector base Q2 is provided on the fixing plate Q4; wherein, the side of the reflector Q1 in the left reflection module 310-L away from the reflector base Q2 constitutes a light reflection surface of the left reflection module 310-L; and the side of the reflector Q1 in the right reflection module 310-R away from the reflector base Q2 constitutes a light reflection surface of the right reflection module 310-R.

[0075] In this embodiment, refer to Figure 2 The light reflection module 310 (i.e., the left reflection module 310-LL or the right reflection module 310-RR) includes a reflection mirror Q1, a reflection mirror base Q2, a fixing plate Q4, and a reflection drive unit Q3. The reflection mirror Q1 is fixedly connected to the reflection mirror base Q2. The reflection drive unit Q3 is disposed on the side of the reflection mirror base Q2 that is not fixedly connected to the reflection mirror Q1. The side of the reflection drive unit Q3 that is away from the reflection mirror base Q2 is disposed on the fixing plate Q4. Specifically, the reflection drive unit Q3 may be Figure 2 The three driving hinges shown are respectively fixed on the side of the reflector base Q2 away from the reflector Q1, and the side of the three driving hinges not fixedly connected to the reflector base Q2 is hingedly connected to the fixed plate Q4; alternatively, the reflection drive unit Q3 may have two driving hinges and one fixing part, the two driving hinges are fixed on the side of the reflector base Q2 away from the reflector Q1, the side of the two driving hinges not fixedly connected to the reflector base Q2 is hingedly connected to the fixed plate Q4, and the fixing part fixes the reflector base Q2 and the fixed plate Q4.

[0076] It should be noted that the driving hinge includes a telescopic shaft, a spherical hinge and a driving housing on which the spherical hinge is provided. Specifically, the driving housing is fixed to the side of the reflector base Q2 away from the reflector Q1, the spherical hinge is fixedly connected to the telescopic shaft, and the side of the telescopic shaft not connected to the spherical hinge is connected to the fixed plate Q4. The telescopic shaft can drive the spherical hinge on the telescopic shaft to move forward and backward and rotate to achieve the posture change of the reflector Q1. The telescopic shaft material can be magnetostrictive material, thermocouple material or memory metal material. In addition, the spherical hinge can be integrated with a driving unit or not provided with a driving unit. This application does not impose any restrictions here, and the driving unit can be a linear motor or a voice coil motor.

[0077] Further, in some feasible embodiments, referring to Figure 6 As shown in (a), the spectroscopic component 20 includes a first prism and a second prism, and the shapes of the first prism and the second prism are both isosceles right triangles; after the right-angled side of the first prism is glued to the right-angled side of the second prism to form a rhombus prism, the hypotenuse of the first prism and the hypotenuse of the second prism are arranged opposite to each other; wherein, the hypotenuse of the first prism constitutes the spectroscopic surface of the spectroscopic component 20 and is arranged on the side close to the light source 10; the hypotenuse of the second prism constitutes the total reflection surface of the spectroscopic component 20 and is arranged on the side away from the light source 10.

[0078] In this embodiment, the light splitting component 20 may be Figure 6 The rhombus prism shown in (a) is formed by gluing the right-angled side of the first triangular prism to the right-angled side of the second triangular prism, wherein the hypotenuse of the first triangular prism is arranged opposite to the hypotenuse of the second triangular prism, the hypotenuse of the first triangular prism constitutes the splitting surface of the splitting component 20, and the hypotenuse of the second triangular prism constitutes the total reflection surface of the splitting component 20.

[0079] Further, in some other feasible embodiments, referring to Figure 6 As shown in (b), the light splitting component 20 includes a parallelogram prism, the side of the parallelogram prism facing the light source 10 constitutes the light splitting surface of the light splitting component 20, and the side of the parallelogram prism away from the light source 10 constitutes the total reflection surface of the light splitting component 20.

[0080] In this embodiment, the light splitting component 20 can also be Figure 6 (b) shows a parallelogram prism, wherein the side of the parallelogram prism facing the light source 10 constitutes the light splitting surface of the light splitting component 20, and the side of the parallelogram prism away from the light source 10 constitutes the total reflection surface of the light splitting component 20.

[0081] In a specific embodiment, the splitting surface of the splitting component 20 is arranged toward the light source 10, and a projection optical component is arranged between the light source 10 and the splitting surface of the splitting component 20; illustratively, the non-polarized light from the light source 10 is projected to the splitting surface of the splitting component 20 through the projection optical component, so that the non-polarized light projected through the projection optical component can be divided into a first polarized light S and a second polarized light P that are perpendicular to each other through the polarization splitting film PBS1 attached to the splitting surface of the splitting component 20, that is, the polarization separation of the non-polarized light is achieved through the splitting surface of the splitting component 20, so that only one light source 10 is used to meet the visual display needs of both eyes, avoiding the technical problem of high power consumption of smart glasses caused by the traditional dual-light machine module 200 configuration, significantly reducing the power consumption of smart glasses, thereby reducing the dependence on large-capacity batteries, further reducing the overall weight of the smart glasses, and thus significantly improving the user's wearing experience. Next, when the first polarized light S is projected onto the left reflection surface of the light reflecting element 31 through the splitting surface of the splitting component 20, the second polarized light P is projected onto the total reflection surface of the splitting component 20 through the splitting surface of the splitting component 20 through the polarization splitting film PBS1, and the reflection efficiency of the second polarized light P on the total reflection surface is improved by the anti-reflection film plated on the total reflection surface, so that more second polarized light P is reflected to the right reflection surface of the light reflecting element 31, effectively reducing the light loss of the reflected second polarized light P and significantly improving the light transmission efficiency of the second polarized light P.

[0082] Further, in some feasible embodiments, the optical machine module 200 includes a left reflector 40, which is arranged on the optical path of the left reflective surface of the light reflector 31 to project the first polarized light S, and the left reflector 40 includes a left relay lens 410, a left polarization beam splitter 420, a left lens 430, a left modulation screen 440 and a left exit pupil lens 450; the left polarization beam splitter 420 and the waveguide lens 100 are respectively arranged on both sides of the left exit pupil lens 450, the left light-emitting surface of the left exit pupil lens 450 faces the left eye area of ​​the waveguide lens 100, and the left light-emitting surface is the side of the left exit pupil lens 450 away from the left polarization beam splitter 420; the left polarization beam splitter 420 is arranged between the left relay lens 410 and the left lens 430, the left relay lens 410 is arranged toward the left reflective surface of the light reflector 31, and the left modulation screen 440 is arranged on the side of the left lens 430 away from the left polarization beam splitter 420.

[0083] It should be noted that the left polarization beam splitter 420 may be Figure 7 (a) shows the left PBS prism, where Figure 7 The side of the left PBS prism shown in (a) facing the left lens 430 is set as the left splitting surface of the left polarizing beam splitter 420, and the polarizing beam splitting film PBS1 is attached to the left splitting surface; Figure 7The side of the left PBS prism shown in (b) that faces the left relay lens 410 is set as the phase conversion surface of the left polarization splitter 420, and a phase conversion film HWP1 is attached to the phase conversion surface; wherein, the phase conversion film HWP1 is a HWP (half-wave plate) film, and the HWP film makes the phase of the light perpendicular to the HWP film delayed by π / 2 or an odd multiple thereof.

[0084] The left polarization beam splitter 420 may also be integrated with Figure 7 (b) shows a left PBS assembly of the first polarization beam splitter prism L1, the second polarization beam splitter prism L2 and the left reflector L3. Exemplarily, the polarization beam splitter film PBS1 is fixedly connected between the hypotenuse of the first polarization beam splitter prism L1 and the hypotenuse of the second polarization beam splitter prism L2 to form the left beam splitting surface of the left polarization beam splitter 420, the phase conversion film HWP1 is attached to the side of the first polarization beam splitter prism L1 facing the left relay lens 410 to form the phase conversion surface of the left polarization beam splitter 420, and the phase delay film QWP1 is attached to the side of the second polarization beam splitter prism L2 facing the left reflector L3 to form the phase delay surface of the left polarization beam splitter 420; wherein, the phase delay film QWP1 is a QWP (Quarter Wave Plate) film, and the QWP film delays the phase of light perpendicular to the QWP film by π / 4; the first polarization beam splitter prism L1 and the second polarization beam splitter prism L2 are both PBS prisms.

[0085] In a specific embodiment, refer to Fig. 9 Combined with Figure 7In the left PBS prism shown in (a), the first polarized light S is reflected by the polarized beam splitting film PBS1 attached to the beam splitting surface of the beam splitting component 20 to the light reflecting surface of the left reflective module 310-L (i.e., the left reflecting surface of the light reflecting component 31), and after secondary reflection by the light reflecting surface of the left reflective module 310-L (i.e., the left reflecting surface of the light reflecting component 31), enters the left relay lens 410 for convergence. The converged first polarized light S is projected onto the HWP film of the left PBS prism through the left relay lens 410. The first polarized light S is converted into the second polarized light P through the phase conversion of the HWP film and enters the left PBS prism. After passing through the left PBS prism, it enters the left lens 430 and converges through the left lens 430. After being projected onto the left modulation screen 440, the second polarized light P is modulated into a left field of view image (i.e., the first polarized light S carrying image information) by the left modulation screen 440, and then projected onto the polarization splitter film PBS1 of the left PBS prism via the left lens 430. The left field of view image is reflected by the polarization splitter film PBS1 of the left PBS prism, converged by the left exit pupil lens 450, and then projected onto the left coupling-in area 11 of the waveguide lens 100, thereby reducing unnecessary light loss and significantly enhancing the clarity of light imaging; next, when the left field of view image is projected into the user's left eye through the left coupling-out area 13 of the waveguide lens 100, it is simultaneously collected by the image detection module 300 through the image detection area 15 of the waveguide lens 100.

[0086] In another embodiment, referring to Fig.10 Combined with Figure 7(b) shows the left PBS component, the first polarized light S is reflected by the polarization beam splitting film PBS1 attached to the beam splitting surface of the beam splitting component 20 to the light reflecting surface of the left reflective module 310-L, and after secondary reflection by the light reflecting surface of the left reflective module 310-L, enters the left relay lens 410 for convergence, and the converged first polarized light S is projected onto the HWP film of the left PBS component through the left relay lens 410, and the first polarized light S is converted into the second polarized light P through the phase conversion of the HWP film, and sequentially passes through the first polarization beam splitting prism L1, the PBS film, and the second polarization beam splitting prism L2, and then is projected out of the left PBS component into the left lens 430, and after being converged by the left lens 430, it is projected onto the left modulation screen 440, and the second polarized light P is modulated by the left modulation screen 440 into the left field of view image (i.e., the first polarized light S carrying image information), and then is re-entered into the left lens 430, and passes through the left lens 430 and enters the left PBS component The second polarization beam splitter L2 of the component is projected onto the PBS film, and the first polarized light S carrying the image information is reflected by the PBS film and turned to be projected onto the QWP film, and reaches the surface of the left reflector L3 after a phase delay of 1 / 4 wavelength. After being reflected by the left reflector L3, it passes through the QWP film again and is delayed by another 1 / 4 wavelength. At this time, the first polarized light S carrying the image information becomes the second polarized light P carrying the image information, and passes through the PBS film to project out of the left PBS component and then enters the left exit pupil lens 450. The second polarized light P converged by the left exit pupil lens 450 can be more accurately projected to the left coupling-in area 11 of the waveguide lens 100, thereby reducing unnecessary light loss and significantly enhancing the clarity of light imaging; next, when the second polarized light P carrying the image information passes through the left coupling-out area 13 of the waveguide lens 100 and is projected into the left eye of the user, it passes through the image detection area 15 of the waveguide lens 100 and is collected by the image detection module 300.

[0087] Furthermore, in some other feasible embodiments, the optical machine module 200 includes a right reflector 50, which is arranged on the optical path of the second polarized light P projected by the right reflective surface of the light reflector 31, and the right reflector 50 includes a right relay lens 51, a right polarization beam splitter 52, a right lens 53, a right modulation screen 54 and a right exit pupil lens 55; the right polarization beam splitter 52 and the waveguide lens 100 are respectively arranged on both sides of the right exit pupil lens 55, the right light-emitting surface of the right exit pupil lens 55 faces the right eye area of ​​the waveguide lens 100, and the right light-emitting surface is the side of the right exit pupil lens 55 away from the right polarization beam splitter 52; the right polarization beam splitter 52 is arranged between the right relay lens 51 and the right lens 53, the right relay lens 51 is arranged toward the right reflective surface of the light reflector 31, and the right modulation screen 54 is arranged on the side of the right lens 53 away from the right polarization beam splitter 52.

[0088] It should be noted that, refer to Figure 8 , Figure 8Schematic diagram of the right polarization beam splitter 52 according to the first embodiment of the present application. The left polarization beam splitter 420 may be Figure 8 (a) shows the right PBS prism, where Figure 8 The side of the right PBS prism shown in (a) facing the right lens 53 is set as the right splitting surface of the right polarization splitting element 52, and the polarization splitting film PBS1 is attached to the right splitting surface.

[0089] The right polarization beam splitter 52 may also be integrated with Figure 8 (b) shows a right PBS assembly of a third polarization beam splitter prism R1, a fourth polarization beam splitter prism R2 and a right reflector R3. Exemplarily, a polarization beam splitter film PBS1 is fixedly connected between the hypotenuse of the third polarization beam splitter prism R1 and the hypotenuse of the fourth polarization beam splitter prism R2 to form a right beam splitting surface of the right polarization beam splitter 52, and a phase delay film QWP1 is attached to the side of the fourth polarization beam splitter prism R2 facing the right reflector R3 to form a phase delay surface of the right polarization beam splitter 52.

[0090] In a specific embodiment, refer to Fig.10 Combined with Figure 8 (a) shows the right PBS prism, the second polarized light P is reflected by the polarization splitting film PBS1 attached to the splitting surface of the splitting prism to the light reflecting surface of the right reflecting module 310-R (i.e., the right reflecting surface of the light reflecting member 31), and after secondary reflection by the right reflecting surface of the light reflecting member 31, enters the right relay lens 51 for convergence. The converged second polarized light P is projected onto the right PBS prism through the right relay lens 51. The second polarized light P passes through the right PBS prism and enters the right lens 53. After convergence by the right lens 53, it is projected onto the right modulation screen 54. The second polarized light P is modulated by the right modulation screen 54 into The right field of view image (i.e., the first polarized light S carrying image information) is projected onto the polarization splitter film PBS1 of the right PBS prism via the right lens 53. The right field of view image is reflected by the polarization splitter film PBS1 of the right PBS prism, converged by the right exit pupil lens 55, and then projected onto the right coupling-in area 12 of the waveguide lens 100, thereby reducing unnecessary light loss and significantly enhancing the clarity of light imaging; next, when the right field of view image is projected into the user's right eye through the right coupling-out area 14 of the waveguide lens 100, it is simultaneously captured by the image detection module 300 through the image detection area 15 of the waveguide lens 100.

[0091] In another embodiment, referring to Fig.10 Combined with Figure 8In the right PBS component shown in (b), the second polarized light P is reflected by the polarization splitting film PBS1 attached to the splitting surface of the splitting prism to the light reflecting surface of the right reflecting module 310-R (i.e., the right reflecting surface of the light reflecting member 31), and after secondary reflection by the right reflecting surface of the light reflecting member 31, enters the right relay lens 51 for convergence. The converged second polarized light P is projected to the right PBS component through the right relay lens 51, passes through the third polarization splitting prism R1, the PBS film and the fourth polarization splitting prism R2 in sequence, and then projects out of the right PBS component into the right lens 53. After convergence by the right lens 53, it is projected onto the right modulation screen 54. After the second polarized light P is modulated into the right field of view image (i.e., the first polarized light S carrying image information) by the right modulation screen 54, it is re-entered into the right lens 53, and passes through the right lens 53 and enters the fourth polarization splitting prism R2 of the right PBS component. The first polarized light S carrying the image information is projected onto the PBS film, and is reflected by the PBS film and then projected onto the QWP film. After a phase delay of 1 / 4 wavelength, it reaches the surface of the right reflector R3. After being reflected by the right reflector R3, it is re-delayed by 1 / 4 wavelength after passing through the QWP film. At this time, the first polarized light S carrying the image information becomes the second polarized light P carrying the image information, and passes through the PBS film to project out of the right PBS component and then enters the right exit pupil lens 55. After being converged by the right exit pupil lens 55, it passes through the right vision adjustment mirror and is projected onto the right coupling-in area 12 of the waveguide lens 100, thereby reducing unnecessary light loss and significantly enhancing the clarity of light imaging. Next, when the second polarized light P carrying the image information passes through the right coupling-out area 14 of the waveguide lens 100 and is projected into the user's right eye, it simultaneously passes through the image detection area 15 of the waveguide lens 100 and is collected by the image detection module 300.

[0092] In addition, it should be noted that, referring to Fig.11 , Fig.11 2 is a schematic diagram of a package of an optical-mechanical module 200 according to the first embodiment of the present application. Specifically, Fig.11 yes Fig. 9 The packaging diagram of the optical machine module 200 is shown; in addition, Fig.11 The left polarization beam splitter 420 and the right polarization beam splitter 52 shown are replaced by Fig.10 The left polarization beam splitter 420 and the right polarization beam splitter 52 shown in FIG. Fig.10 A packaging schematic diagram of the optical-mechanical module 200 is shown.

[0093] Furthermore, in some feasible embodiments, the optical machine module 200 includes a projection optical component, which is arranged between the light source 10 and the spectroscopic component 20; the projection optical component includes a collimating lens, a uniform light lens and a relay lens, the uniform light lens is arranged between the collimating lens and the relay lens, the collimating lens is arranged toward the light source 10, and the relay lens is arranged toward the spectroscopic surface of the spectroscopic component 20.

[0094] In this embodiment, the non-polarized light (i.e., incident light) from the light source 10 is converged by a collimating lens and then projected onto a uniform light lens, so that the converged incident light is more evenly projected onto the third relay lens for convergence, so as to form a light spot of a suitable size and projected onto the beam splitter surface of the beam splitter component 20, thereby providing the beam splitter surface with high-quality light source 10 input and significantly improving the beam splitting efficiency of the beam splitter surface.

[0095] In another embodiment, referring to Fig.12 , Fig.12 Schematic diagram of the structure of the smart glasses involved in the first embodiment of the present application. The smart glasses also include a glasses stand 400, a temple 700 pin 46, a glasses housing 500, a nose pad 600 and a temple 700. The glasses stand 400 is provided with a left light hole 41, a right light hole 42, an image detection hole 43, a nose pad 600 fixing hole and a hinge hole 45 for light to pass through, and a field of view area for fixing the waveguide lens 100; illustratively, the waveguide lens 100 is arranged between the glasses stand 400 and the glasses housing 500, and is fixed to the field of view area on the glasses stand 400, and an optical machine module 200 and an image detection module 300 (such as a camera module) are arranged on the side of the waveguide lens 100 away from the glasses housing 500, the image detection module 300 is arranged toward the image detection hole 43, and the optical machine module 200 The left light exit hole of the optical machine module 200 is aligned with the left light through hole 41 of the glasses holder 400, the right light exit hole of the optical machine module 200 is aligned with the right light through hole 42 of the glasses holder 400, and the left exit pupil lens 450 of the left polarized beam splitter in the optical machine module 200 is arranged toward the left light exit hole of the optical machine module 200, and the right exit pupil lens 55 of the right polarized beam splitter in the optical machine module 200 is arranged toward the right light exit hole of the optical machine module 200; in addition, after the nose pad positioning hole on the nose pad 600 is aligned with the nose pad fixing hole, the nose pad firmware passes through the nose pad fixing hole aligned with the nose pad positioning hole and is fixed to the glasses holder 400, and the left / right temples 700 are hingedly connected after the pins 46 of the temples 700 on the left and right sides of the glasses holder 400 pass through the corresponding hinge holes 45 respectively.

[0096] Further, based on the first embodiment of the smart glasses of the present application, a second embodiment of the image detection method of the smart glasses of the present application is proposed, referring to Fig.13 , Fig.13 It is a flow chart of the second embodiment of the image detection method for smart glasses of the present application.

[0097] The image detection method of the smart glasses of the present application is applied to any of the smart glasses mentioned above, and the image detection method of the smart glasses of the present application includes the following implementation steps S10 to S20.

[0098] Step S10: when it is determined that the first polarized light and the second polarized light projected by the beam splitting component are incident on the user's eyes through the light transmission direction of the reflective driving component to the waveguide lens, the projected optical image coupled out of the waveguide lens to the user's eyes is obtained through the image detection module.

[0099] In this embodiment, after the light splitting component splits the incident light (i.e., non-polarized light) from the light source into the first polarized light and the second polarized light, the first polarized light and the second polarized light are incident to the user's eyes through the light transmission direction from the reflective driving member to the waveguide lens, thereby achieving the use of only one light source to meet the visual display needs of both eyes, avoiding the technical problem of high power consumption of smart glasses caused by the traditional dual-light machine module configuration, that is, the present application significantly reduces the power consumption of smart glasses through the light splitting component of the single light source, thereby reducing the dependence on large-capacity batteries, further reducing the weight of the entire smart glasses, and thus significantly improving the user's wearing experience. Next, the first polarized light and the second polarized light are projected onto the light reflecting member, and when they are coupled out to the user's eyes through the light transmission direction from the light reflecting member to the waveguide lens, the image detection module captures the projected optical image coupled out to the user's eyes by the waveguide lens in real time, thereby providing accurate and reliable projected optical images for subsequent image detection.

[0100] Step S20: enabling the reflective driving component to adjust the light transmission direction according to the abnormal optical state of the glasses, until the projected optical image coupled out by the waveguide lens based on the adjusted light transmission direction is adjusted to be consistent with the standard optical image; wherein the beam splitting component is configured to split the incident light of the light source into a first polarized light and a second polarized light.

[0101] In this embodiment, the projected optical image is compared and analyzed with a preset standard optical image, so that the current optical state of the smart glasses (i.e., the optical state of the glasses) can be accurately evaluated. Once it is determined that the optical state of the glasses is an abnormal optical state, the reflection driving component is immediately triggered to move the light reflecting mirror position of the light reflecting component to dynamically adjust the light transmission direction from the light reflecting component to the waveguide lens, until the projected optical image coupled out by the waveguide lens based on the adjusted light transmission direction is quickly restored to be consistent with the standard optical image, thereby ensuring that the smart glasses continue to provide high-quality, defect-free visual experience, significantly enhancing the user's wearing comfort and satisfaction.

[0102] In summary, the present application provides a pair of smart glasses and an image detection method thereof, as well as an extended reality device. The smart glasses integrate a waveguide lens, an optical module and an image detection module, and by arranging a splitter component and a reflective driver in the optical module of a single light source, the optical performance of the smart glasses when subjected to physical impact is effectively improved while ensuring low power consumption of the smart glasses. Specifically, the incident light of the light source is divided into the first polarized light and the second polarized light by the light splitting component, and is incident on the user's eyes through the light transmission direction of the reflective driving component to the waveguide lens, so that the light splitting of the light splitting component can achieve the visual display requirements of both eyes with only a single light source, effectively avoiding the problem of high power consumption of smart glasses caused by the traditional dual-optical machine module configuration, and significantly reducing the power consumption of smart glasses; next, the projected optical image coupled out of the waveguide lens to the user's eyes based on the light transmission direction is compared with the preset standard optical image through the image detection module, so that the optical state of the smart glasses can be accurately obtained. Once the optical performance variation caused by physical impact (such as visual defects such as dark bands) is found, that is, when the optical state of the glasses is an abnormal optical state, the reflective driving component is immediately triggered to automatically adjust the light transmission direction from the light reflector to the waveguide lens, so that the projected optical image coupled out of the waveguide lens based on the adjusted light transmission direction is quickly restored to be consistent with the standard optical image, avoiding the image dark band phenomenon caused by physical impact of the smart glasses, significantly improving the optical performance of the smart glasses when subjected to physical impact, and effectively ensuring the visual experience of the wearer.

[0103] In addition, the present application also provides an extended reality device, the extended reality device includes a memory, a processor, and an image detection program for smart glasses stored in the memory and executable on the processor, and the image detection program for smart glasses implements the steps of the above-mentioned image detection method for smart glasses when executed by the processor. Fig.14 , Fig.14 1 is a schematic diagram of the structure of an extended reality device involved in an embodiment of the present application. The extended reality device in the embodiment of the present application may specifically be a device for locally running the image detection method of smart glasses.

[0104] like Fig.14 As shown, the extended reality device of the embodiment of the present application may include: smart glasses; or a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a Wi-Fi interface).

[0105] The memory 1005 is arranged on the main body of the extended reality device, and a program is stored on the memory 1005, and the corresponding operation is realized when the program is executed by the processor 1001. The memory 1005 is also used to store parameters for use by the extended reality device. The memory 1005 can be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 can also be a storage device independent of the aforementioned processor 1001.

[0106] Those skilled in the art will understand that Fig.14 The extended reality device structure shown in the figure does not constitute a limitation of the extended reality device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0107] like Fig.14 As shown, the memory 1005 as a storage medium may include an operating system, a network communication module, a user interface module, and an image detection program for smart glasses.

[0108] exist Fig.14 In the extended reality device shown, the processor 1001 can be used to call the image detection program of the smart glasses stored in the memory 1005 and execute the steps of the image detection method of the smart glasses as described above.

[0109] In addition, to achieve the above-mentioned purpose, the present application also provides a storage medium, which is a computer-readable storage medium, and the computer-readable storage medium stores an image detection program for smart glasses. When the image detection program for smart glasses is executed by a processor, the steps of the above-mentioned image detection method for smart glasses are implemented.

[0110] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0111] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0112] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium such as ROM / RAM, a disk, or an optical disk as described above, and includes a number of instructions for enabling an extended reality device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0113] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A pair of smart glasses, characterized in that: The smart glasses include a waveguide lens, an optical machine module and an image detection module, and the optical machine module includes a light source, a light splitting component and a reflective driving component; The incident light from the light source is split into a first polarized light and a second polarized light by the light splitting component, and then passes through the reflective driving component to the light transmission direction of the waveguide lens and is incident to both eyes of the user; The image detection module is configured to obtain a projected optical image coupled out by the waveguide lens to both eyes of the user based on the light conduction direction, determine an optical state of the glasses based on the projected optical image and a preset standard optical image, and enable the reflective driving component to adjust the light conduction direction based on the optical state of the glasses being an abnormal optical state, until the projected optical image coupled out by the waveguide lens based on the adjusted light conduction direction is adjusted to be consistent with the standard optical image.

2. The smart glasses according to claim 1, wherein: The reflective driving member comprises a light reflecting member, which is a left reflecting module and a right reflecting module which are mirror-symmetrical, the light reflecting surface of the left reflecting module is arranged toward the light splitting surface of the light splitting component, the light reflecting surface of the right reflecting module is arranged toward the total reflecting surface of the light splitting component, the total reflecting surface is the opposite surface of the light splitting surface, a polarizing light splitting film is attached to the light splitting surface, and an anti-reflection film is plated on the total reflecting surface; The light reflecting member is configured to project the first polarized light projected by the beam splitter surface to the left eye area of ​​the waveguide lens through the light reflecting surface of the left reflecting module, and project the second polarized light projected by the beam splitter surface to the right eye area of ​​the waveguide lens through the light reflecting surface of the right reflecting module; wherein, The light reflecting surface of the left reflecting module constitutes the left reflecting surface of the light reflecting member, and the light reflecting surface of the right reflecting module constitutes the right reflecting surface of the light reflecting member.

3. The smart glasses according to claim 2, wherein: The left reflection module and the right reflection module are both the same light reflection modules, and the light reflection module includes a reflector, a reflector base, a fixing plate and a reflection driving unit; The reflector is fixedly connected to the reflector base, the reflector drive unit is arranged on a side of the reflector base that is not fixedly connected to the reflector, and the reflector drive unit is arranged on the fixed plate on a side away from the reflector base; wherein, The side of the reflector in the left reflective module away from the reflector base constitutes the light reflecting surface of the left reflective module; the side of the reflector in the right reflective module away from the reflector base constitutes the light reflecting surface of the right reflective module.

4. The smart glasses according to claim 1, wherein: The light splitting component comprises a first prism and a second prism, wherein the shape of the first prism and the shape of the second prism are both isosceles right triangles; After the right-angled side of the first prism is glued to the right-angled side of the second prism to form a rhombus prism, the hypotenuse of the first prism is arranged opposite to the hypotenuse of the second prism; wherein, The hypotenuse of the first prism constitutes the light splitting surface of the light splitting component and is arranged on the side close to the light source; the hypotenuse of the second prism constitutes the total reflection surface of the light splitting component and is arranged on the side far away from the light source.

5. The smart glasses according to claim 1, wherein: The light splitting component comprises a parallelogram prism, wherein the side of the parallelogram prism facing the light source constitutes a light splitting surface of the light splitting component, and the side of the parallelogram prism away from the light source constitutes a total reflection surface of the light splitting component.

6. The smart glasses according to claim 1, wherein: The optical machine module includes a left reflector, which is arranged on the optical path of the left reflective surface of the optical reflector projecting the first polarized light, and includes a left relay lens, a left polarization beam splitter, a left lens, a left modulation screen and a left exit pupil lens; The left polarization beam splitter and the waveguide lens are respectively arranged on both sides of the left exit pupil lens, the left light exit surface of the left exit pupil lens faces the left eye area of ​​the waveguide lens, and the left light exit surface is the side of the left exit pupil lens away from the left polarization beam splitter; The left polarized beam splitter is arranged between the left relay lens and the left lens, the left relay lens is arranged toward the left reflective surface of the light reflector, and the left modulation screen is arranged on a side of the left lens away from the left polarized beam splitter.

7. The smart glasses according to claim 1, wherein: The optical machine module includes a right reflector, which is arranged on the optical path of the second polarized light projected by the right reflective surface of the optical reflector, and includes a right relay lens, a right polarization beam splitter, a right lens, a right modulation screen and a right exit pupil lens; The right polarization beam splitter and the waveguide lens are respectively arranged on both sides of the right exit pupil lens, the right light exit surface of the right exit pupil lens faces the right eye area of ​​the waveguide lens, and the right light exit surface is the side of the right exit pupil lens away from the right polarization beam splitter; The right polarization beam splitter is arranged between the right relay lens and the right lens, the right relay lens is arranged toward the right reflection surface of the light reflection element, and the right modulation screen is arranged on a side of the right lens away from the right polarization beam splitter.

8. The smart glasses according to claim 1, wherein: The optical machine module includes a projection optical component, and the projection optical component is arranged between the light source and the light splitting component; The projection optical component includes a collimating lens, a light homogenizing lens and a relay lens. The light homogenizing lens is arranged between the collimating lens and the relay lens. The collimating lens is arranged toward the light source, and the relay lens is arranged toward the splitting surface of the splitting component.

9. An image detection method for smart glasses, characterized in that: The image detection method of the smart glasses is applied to the smart glasses according to any one of claims 1 to 8, and the image detection method of the smart glasses comprises: When it is determined that the first polarized light and the second polarized light projected by the light splitting component are incident on the user's eyes through the light transmission direction of the reflective driving component to the waveguide lens, the projected optical image coupled out of the waveguide lens to the user's eyes is acquired through the image detection module; According to the optical state of the glasses being an abnormal optical state, the reflective driving component is enabled to adjust the light transmission direction until the projected optical image coupled out by the waveguide lens based on the adjusted light transmission direction is adjusted to be consistent with the standard optical image; wherein, The light splitting component is configured to split incident light from a light source into the first polarized light and the second polarized light.

10. An extended reality device, characterized in that: The extended reality device comprises the smart glasses according to any one of claims 1 to 8; or, The extended reality device includes a processor, a memory, and an image detection program for smart glasses stored in the memory and executable by the processor, wherein when the image detection program for smart glasses is executed by the processor, the steps of the image detection method for smart glasses as described in claim 9 are implemented.

Images