Smart glasses, image detection method thereof, and extended reality device

Abstract

The present application discloses smart glasses, an image detection method thereof, and an extended reality device, relating to the field of extended reality technology. The smart glasses include a waveguide lens, an image detection module, and an optical module integrating a light source, a spectroscopic component, and a reflective driver. Incident light from the light source is split into a first polarized light and a second polarized light by the spectroscopic component, and then incident on the user's eyes through the light transmission direction of the waveguide lens via the reflective driver. The image detection module is configured to obtain a projected optical image coupled out of the waveguide lens to the user's eyes based on the light transmission direction, determine the optical state of the glasses based on the projected optical image and a preset standard optical image, and enable the reflective driver to adjust the light transmission direction based on the abnormal optical state of the glasses until the projected optical image coupled out of the waveguide lens based on the adjusted light transmission direction is adjusted to be consistent with the standard optical image. The present application is directed to the optical performance of smart glasses when subjected to physical impact.

Description

Technical Field

[0001] The present application relates to the field of extended reality technology, and in particular to smart glasses and an image detection method thereof, as well as an extended reality device. Background Art

[0002] With the continuous development of XR (eXtended Reality) technology, smart glasses have become an important application carrier of XR technology, and users have put forward higher requirements for the low-power design of smart glasses.

[0003] To avoid the problem of wire dragging caused by the separation of the power supply and the main body of the glasses, most current smart glasses adopt an integrated glasses structure and are equipped with dual optical modules. This not only significantly increases the power consumption of smart glasses, but also inevitably faces the risk of physical impact such as falling or external force squeezing during daily wear, which may cause the optical components inside the glasses to shift, deform or be damaged, and then cause variations in optical performance, such as visual defects such as dark bands, which seriously interfere with the wearer's visual experience.

[0004] Therefore, how to improve the optical performance of smart glasses when subjected to physical impact while ensuring low power consumption of smart glasses is a technical problem that needs to be solved urgently. Summary of the Invention

[0005] The main purpose of this application is to provide a pair of smart glasses and an image detection method thereof, as well as an extended reality device, aiming to ensure low power consumption of the smart glasses while improving the optical performance of the smart glasses when subjected to physical impact.

[0006] To achieve the above-mentioned object, the present application provides a pair of smart glasses, which include a waveguide lens, an optical module and an image detection module, wherein the optical module includes a light source, a spectroscopic component and a reflective driving component;

[0007] The incident light from the light source is split into a first polarized light and a second polarized light by the light splitting component, and then passes through the reflective driving component to the light transmission direction of the waveguide lens and is incident on the user's eyes;

[0008] The image detection module is configured to obtain a projected optical image coupled out by the waveguide lens to the user's eyes based on the light conduction direction, determine an optical state of the glasses based on the projected optical image and a preset standard optical image, and enable the reflective driving component to adjust the light conduction direction based on the abnormal optical state of the glasses until the projected optical image coupled out by the waveguide lens based on the adjusted light conduction direction is adjusted to be consistent with the standard optical image.

[0009] In one embodiment, the reflective driving member includes a light reflecting member, which is a mirror-symmetrical left reflective module and a right reflective module. The light reflecting surface of the left reflective module is arranged toward the beam splitting surface of the beam splitting component, and the light reflecting surface of the right reflective module is arranged toward the total reflection surface of the beam splitting component. The total reflection surface is the opposite surface of the beam splitting surface. A polarizing beam splitting film is attached to the beam splitting surface, and an anti-reflection film is coated on the total reflection surface.

[0010] The light reflecting member is configured to project the first polarized light projected by the beam splitting surface to the left eye area of ​​the waveguide lens through the light reflecting surface of the left reflecting module, and project the second polarized light projected by the beam splitting surface to the right eye area of ​​the waveguide lens through the light reflecting surface of the right reflecting module; wherein,

[0011] The light reflecting surface of the left reflecting module constitutes the left reflecting surface of the light reflecting member, and the light reflecting surface of the right reflecting module constitutes the right reflecting surface of the light reflecting member.

[0012] In one embodiment, the left reflective module and the right reflective module are both identical light reflective modules, and the light reflective modules include a reflector, a reflector base, a fixing plate, and a reflective drive unit;

[0013] The reflector is fixedly connected to the reflector base, the reflector drive unit is provided on a side of the reflector base that is not fixedly connected to the reflector, and the reflector drive unit is provided on a side away from the reflector base on the fixing plate; wherein,

[0014] The side of the reflector in the left reflective module away from the reflector base constitutes the light reflecting surface of the left reflective module; the side of the reflector in the right reflective module away from the reflector base constitutes the light reflecting surface of the right reflective module.

[0015] In one embodiment, the light splitting component includes a first prism and a second prism, and the shape of the first prism and the shape of the second prism are both isosceles right triangles;

[0016] After the right-angled side of the first prism is glued to the right-angled side of the second prism to form a rhombus prism, the hypotenuse of the first prism and the hypotenuse of the second prism are arranged opposite to each other; wherein,

[0017] The hypotenuse of the first prism constitutes the splitting surface of the splitting component and is arranged on the side close to the light source; the hypotenuse of the second prism constitutes the total reflection surface of the splitting component and is arranged on the side away from the light source.

[0018] In one embodiment, the light splitting component includes a parallelogram prism, the side of the parallelogram prism facing the light source constitutes a light splitting surface of the light splitting component, and the side of the parallelogram prism away from the light source constitutes a total reflection surface of the light splitting component.

[0019] In one embodiment, the optical machine module includes a left reflector, which is arranged on the optical path of the first polarized light projected by the left reflective surface of the optical reflector, and includes a left relay lens, a left polarization beam splitter, a left lens, a left modulation screen, and a left exit pupil lens;

[0020] The left polarization beam splitter and the waveguide lens are respectively provided on both sides of the left exit pupil lens, the left light exit surface of the left exit pupil lens faces the left eye area of ​​the waveguide lens, and the left light exit surface is the side of the left exit pupil lens away from the left polarization beam splitter;

[0021] The left polarization beam splitter is arranged between the left relay lens and the left lens, the left relay lens is arranged toward the left reflective surface of the light reflector, and the left modulation screen is arranged on a side of the left lens away from the left polarization beam splitter.

[0022] In one embodiment, the optical machine module includes a right reflector, which is arranged on the optical path of the second polarized light projected by the right reflective surface of the optical reflector, and includes a right relay lens, a right polarization beam splitter, a right lens, a right modulation screen, and a right exit pupil lens;

[0023] The right polarization beam splitter and the waveguide lens are respectively provided on both sides of the right exit pupil lens, the right light exit surface of the right exit pupil lens faces the right eye area of ​​the waveguide lens, and the right light exit surface is the side of the right exit pupil lens away from the right polarization beam splitter;

[0024] The right polarization beam splitter is arranged between the right relay lens and the right lens, the right relay lens is arranged toward the right reflective surface of the light reflector, and the right modulation screen is arranged on a side of the right lens away from the right polarization beam splitter.

[0025] In one embodiment, the optical machine module includes a projection optical component, and the projection optical component is arranged between the light source and the light splitting component;

[0026] The projection optical component includes a collimating lens, a light homogenizing lens and a relay lens. The light homogenizing lens is arranged between the collimating lens and the relay lens. The collimating lens is arranged toward the light source, and the relay lens is arranged toward the splitting surface of the splitting component.

[0027] In addition, to achieve the above-mentioned purpose, the present application also provides an image detection method for smart glasses, which is applied to any of the smart glasses described above, and the image detection method for smart glasses includes:

[0028] When it is determined that the first polarized light and the second polarized light projected by the light splitting component pass through the reflective driving component to the light transmission direction of the waveguide lens and are incident on the user's eyes, the image detection module obtains the projected optical images coupled out of the waveguide lens to the user's eyes;

[0029] According to the abnormal optical state of the glasses, the reflective driving component is enabled to adjust the light transmission direction until the projected optical image coupled out by the waveguide lens based on the adjusted light transmission direction is adjusted to be consistent with the standard optical image; wherein,

[0030] The light splitting component is configured to split incident light from a light source into the first polarized light and the second polarized light.

[0031] In addition, to achieve the above-mentioned purpose, the present application also provides an extended reality device, wherein the extended reality device includes smart glasses;

[0032] Alternatively, the extended reality device includes a memory, a processor, and an image detection program for smart glasses stored in the memory and runnable on the processor. When the image detection program for smart glasses is executed by the processor, the steps of the above-mentioned image detection method for smart glasses are implemented.

[0033] The present application provides smart glasses and an image detection method thereof, as well as an extended reality device. The smart glasses integrate a waveguide lens, an optical module, and an image detection module. By arranging a splitter component and a reflective driver in the optical module of a single light source, the optical performance of the smart glasses when subjected to physical impact is effectively improved while ensuring low power consumption of the smart glasses. Specifically, incident light from a light source is split into first polarized light and second polarized light by a beam splitting component, and then transmitted to the waveguide lens in a light transmission direction through a reflective driver. The light is then transmitted to the user's eyes in a direction that is consistent with the light transmission direction of the reflective driver. This allows the use of a single light source to meet the visual display requirements of both eyes, effectively avoiding the high power consumption of the smart glasses caused by traditional dual-optical module configurations, and significantly reducing the power consumption of the smart glasses. Subsequently, the image detection module compares the projected optical image coupled out of the waveguide lens to the user's eyes based on the light transmission direction with a preset standard optical image, thereby accurately determining the optical state of the smart glasses. Upon detecting a variation in optical performance due to physical impact (e.g., a visual defect such as a dark band), that is, when the optical state of the glasses is abnormal, the reflective driver is immediately triggered to automatically adjust the light transmission direction from the reflective driver to the waveguide lens. This allows the projected optical image coupled out of the waveguide lens based on the adjusted light transmission direction to quickly return to consistency with the standard optical image, thereby avoiding the dark band phenomenon in the image of the smart glasses caused by physical impact, significantly improving the optical performance of the smart glasses when subjected to physical impact, and thereby effectively ensuring the wearer's visual experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0035] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0036] Figure 1 1 is a schematic diagram of the optical principle of the smart glasses involved in the first embodiment of the present application;

[0037] Figure 2 is a schematic diagram of a light reflection module involved in the first embodiment of the present application;

[0038] Figure 3 Schematic diagram of the projected optical image and the standard optical image involved in the embodiment of the present application;

[0039] Figure 41 is a schematic diagram of a waveguide lens according to the first embodiment of the present application;

[0040] Figure 5 Schematic diagram of the glasses bracket involved in the first embodiment of the present application;

[0041] Figure 6 Schematic diagram of the light splitting component involved in the first embodiment of the present application;

[0042] Figure 7 Schematic diagram of the left polarization beam splitter according to the first embodiment of the present application;

[0043] Figure 8 Schematic diagram of a right polarization beam splitter according to the first embodiment of the present application;

[0044] Figure 9 This is an optical principle diagram of the smart glasses involved in the first embodiment of the present application;

[0045] Figure 10 is another optical principle diagram of the smart glasses involved in the first embodiment of the present application;

[0046] Figure 11 1 is a schematic diagram of the packaging of an optical-mechanical module according to the first embodiment of the present application;

[0047] Figure 12 1 is a schematic structural diagram of the smart glasses involved in the first embodiment of the present application;

[0048] Figure 13 This is a flow chart of the second embodiment of the image detection method for smart glasses of the present application;

[0049] Figure 14 It is a structural diagram of the extended reality device involved in the embodiment of the present application.

[0050] Description of Figure Numbers:

[0051] 100, waveguide lens; 11, left coupling-in area; 12, right coupling-in area; 13, left coupling-out area; 14, right coupling-out area; 15, image detection area; 200, optical machine module; 300, image detection module; 10, light source; 20, spectrometer assembly; 30, reflector driver; 31, light reflector; 310, light reflector module; 310-L, left reflector module; 310-R, right reflector module; Q1, reflector; Q2, reflector base; Q3, reflector driver unit; Q4, fixing plate; 40, left reflector; 410, left relay lens; 420, left polarization spectrometer; L1, first polarization spectrometer prism; L2, second polarization spectrometer prism; L3, left reflector; 430, Left lens; 440, left modulation screen; 450, left exit pupil lens; 50, right reflector; 51, right relay lens; 52, right polarization beam splitter; R1, third polarization beam splitter prism; R2, fourth polarization beam splitter prism; R3, right reflector; 53, right lens; 54, right modulation screen; 55, right exit pupil lens; 400, glasses bracket; 41, left light hole; 42, right light hole; 43, image detection hole; 44, nose pad hole; 45, hinge hole; 46, temple pin; 500, glasses housing; 600, nose pad; 700, temple; PBS1, polarization beam splitter film; HWP1, phase conversion film; QWP1, phase delay film; S, first polarized light; P, second polarized light.

[0052] The realization of the objectives, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0053] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments of this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0054] It should be noted that if the embodiments of the present application involve directional indications (such as up, down, left, right, front, back, etc.), the directional indications are only used to explain the relative position relationship, movement status, etc. between the various components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indications will also change accordingly.

[0055] In addition, if there are descriptions involving "first", "second", etc. in the embodiments of the present application, the descriptions of "first", "second", etc. are only for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of such features. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the fact that they can be implemented by ordinary technicians in this field. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such a combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0056] Exemplary embodiments are described in detail herein, with examples illustrated in the accompanying drawings. When the following description refers to the drawings, identical numerals in different drawings represent identical or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all embodiments consistent with this application.

[0057] In the field of XR (eXtended Reality) technology, smart glasses, as a key enabler of XR technology, are categorized by their design and functionality. Smart glasses are primarily categorized into two types: split-body and integrated. Split-body smart glasses effectively address power supply issues by separating functional modules like the power supply and driver from the main body of the glasses. However, the resulting dragging of wires significantly reduces wearing convenience and comfort, failing to meet users' high demands for portable wear. In contrast, integrated smart glasses integrate functional modules with the main body of the glasses, successfully eliminating the dragging of wires. However, the dual-optical module consumes significant power and requires a large-capacity battery. This increases the weight of the glasses, placing a heavier burden on the wearer's head and severely impacting the wearing experience. Furthermore, during daily wear, smart glasses are inevitably exposed to the risk of physical impact, such as drops or external pressure, which can cause displacement, deformation, or damage to the optical components within the glasses. This can lead to variations in optical performance, such as visual defects like dark bands, which severely disrupt the wearer's visual experience.

[0058] In order to solve the technical defects of the above-mentioned traditional smart glasses, the present application provides a smart glasses and its image detection method, as well as an extended reality device.

[0059] The present application embodiment provides a smart glasses, referring to Figure 1 As shown, Figure 1 This is a schematic diagram of the optical principle of the smart glasses involved in the first embodiment of the present application. The smart glasses include a waveguide lens 100, an optical engine module 200, and an image detection module 300. The optical engine module 200 includes a light source 10, a spectrometer component 20, and a reflective driver 30.

[0060] The incident light from the light source 10 is split into a first polarized light S and a second polarized light P by the light splitting component 20 , and then passes through the reflective driving component 30 to the light transmission direction of the waveguide lens 100 and is incident on the user's eyes.

[0061] In this embodiment, referring to Figure 1 After the spectroscopic component 20 splits the incident light (i.e., non-polarized light) from the light source 10 into the first polarized light S and the second polarized light P, the first polarized light S and the second polarized light P pass through the reflective driving component 30 to the light transmission direction of the waveguide lens 100 and are incident on the user's eyes, thereby achieving the goal of using only one light source 10 to meet the visual display needs of both eyes, avoiding the technical problem of high power consumption of smart glasses caused by the traditional dual-light machine module 200 configuration, that is, the present application significantly reduces the power consumption of smart glasses by splitting the single light source 10 through the spectroscopic component 20, thereby reducing the dependence on large-capacity batteries, further reducing the overall weight of the smart glasses, and thus significantly improving the user's wearing experience.

[0062] It should be noted that the light source 10 includes but is not limited to LED (Light Emitting Diode) lamps, and the incident light of the light source 10 can be understood as non-polarized light from the light source 10; the first polarized light S can be understood as S-polarized light, which refers to polarized light in which the electric field vibration direction is perpendicular to the light propagation direction of the incident light; the second polarized light P can be understood as P-polarized light, which refers to polarized light in which the electric field vibration direction is the same as the light propagation direction of the incident light.

[0063] Smart glasses can be understood as XR glasses, which can be a glasses structure that combines one or more of the following technologies: AR (Augmented Reality) technology, VR (Virtual Reality) technology, and MR (Mixed Reality) technology.

[0064] The image detection module 300 is configured to obtain a projected optical image coupled out by the waveguide lens 100 to the user's eyes based on the light transmission direction, determine the optical state of the glasses based on the projected optical image and a preset standard optical image, and enable the reflective driver 30 to adjust the light transmission direction based on the abnormal optical state of the glasses until the projected optical image coupled out by the waveguide lens 100 based on the adjusted light transmission direction is adjusted to be consistent with the standard optical image.

[0065] In this embodiment, referring to Figures 1 to 2 , the reflection driving member 30 includes Figure 2The light reflector 31 shown is used to project first polarized light S and second polarized light P onto the light reflector 31. When the light is coupled from the light reflector 31 to the waveguide lens 100 and out to the user's eyes, the image detection module 300 captures the projected optical image coupled from the waveguide lens 100 to the user's eyes in real time. The projected optical image is then compared and analyzed with a preset standard optical image, thereby accurately assessing the current optical state of the smart glasses (i.e., the optical state of the glasses). Once the optical state of the glasses is determined to be abnormal, the reflective driver 30 is immediately triggered to move the position of the light reflective mirror surface in the light reflector 31 to dynamically adjust the light transmission direction from the light reflector 31 to the waveguide lens 100 until the projected optical image coupled from the waveguide lens 100 based on the adjusted light transmission direction quickly returns to consistency with the standard optical image, thereby ensuring that the smart glasses continue to provide a high-quality, defect-free visual experience, significantly enhancing the user's wearing comfort and satisfaction.

[0066] It should be noted that the preset standard optical image can be understood as a cross-shaped image constructed according to a preset standard template. Figure 3 (a) shows a standard optical image. The light reflecting mirror surface of the light reflecting member 31 can be understood as the left reflecting surface of the light reflecting member 31 and the right reflecting surface of the light reflecting member 31.

[0067] The projected optical image includes a left field of view image and a right field of view image, wherein the left field of view image can be understood as a polarized optical image of the first polarized light S passing through the left reflective surface of the light reflector 31 to the light transmission direction of the waveguide lens 100 and coupled out to the user's left eye; the right field of view image can be understood as a polarized optical image of the first polarized light S passing through the right reflective surface of the light reflector 31 to the light transmission direction of the waveguide lens 100 and coupled out to the user's right eye.

[0068] In a specific embodiment, the left / right field of view images formed by the waveguide lens 100 are coupled to the image detection module 300; at this time, after receiving the left / right field of view images coupled out by the waveguide lens 100, the image detection module 300 determines the image center position and the image edge four corner positions corresponding to the cross standard template, and constructs the left / right field of view images with the image center position and the image edge four corner positions. Figure 3(b) shows the left / right cross template image; next, it is determined whether the left / right cross template image completely coincides with the standard optical image; if the left / right cross template image completely coincides with the standard optical image, the optical state of the glasses is determined to be a normal optical state; if the left / right cross template image does not completely coincide with the standard optical image, the optical state of the glasses is determined to be an abnormal optical state, and in response to the optical state of the glasses being the abnormal optical state, the reflection driving member 30 is triggered to move the left / right reflection surface of the light reflecting member 31 to dynamically adjust the light transmission direction of the left / right reflection surface of the light reflecting member 31 to the waveguide lens 100, thereby dynamically adjusting the left / right field of view images coupled out by the waveguide lens 100 until the left / right field of view images coupled out by the waveguide lens 100 based on the adjusted light transmission direction (i.e., the adjusted left / right field of view images) completely coincide with the standard optical image, thereby ensuring that the smart glasses continue to provide a high-quality, defect-free visual experience, avoiding the image dark band phenomenon caused by physical impact on the smart glasses, and significantly enhancing the wearer's visual experience.

[0069] Further, in some feasible embodiments, referring to Figure 4 , Figure 4 It is a schematic diagram of the optical reflector involved in the embodiment of the present application. The reflective driving component 30 includes a light reflecting component 31, which is a mirror-symmetrical left reflecting module 310-L and a right reflecting module 310-R. The light reflecting surface of the left reflecting module 310-L is set toward the splitting surface of the splitting component 20, and the light reflecting surface of the right reflecting module 310-R is set toward the total reflection surface of the splitting component 20. The total reflection surface is opposite to the splitting surface. A polarizing splitting film PBS1 is attached to the splitting surface, and an anti-reflection film is coated on the total reflection surface. The light reflecting component 31 is configured to project the first polarized light S projected by the splitting surface to the left eye area of ​​the waveguide lens 100 through the light reflecting surface of the left reflecting module 310-L, and project the second polarized light P projected by the splitting surface to the right eye area of ​​the waveguide lens 100 through the light reflecting surface of the right reflecting module 310-R. Among them, the light reflecting surface of the left reflecting module 310-L constitutes the left reflecting surface of the light reflecting component 31, and the light reflecting surface of the right reflecting module 310-R constitutes the right reflecting surface of the light reflecting component 31.

[0070] In this embodiment, the light reflecting member 31 integrates a mirror-symmetrical left reflecting module 310-L and a right reflecting module 310-R. The light reflecting surface of the left reflecting module 310-L is arranged toward the splitting surface of the splitting component 20. After the splitting component 20 splits the incident light of the single light source 10 into the first polarized light S and the second polarized light P, the light reflecting surface of the left reflecting module 310-L accurately guides the first polarized light S reflected by the polarization splitting film PBS1 on the splitting surface to the left eye area of ​​the waveguide lens 100; the right reflecting module 310-R is arranged to face the splitting surface of the waveguide lens 100. The light reflecting surface of block 310-R is set toward the opposite side of the splitting surface (i.e., the total reflection surface of the splitting component 20), so that the second polarized light P passes through the polarization splitting film PBS1 on the splitting surface and is projected onto the total reflection surface. The reflection efficiency of the second polarized light P reflected to the light reflecting surface of the right reflection module 310-R is improved by the anti-reflection film coated on the total reflection surface. After that, the second polarized light P reflected by the total reflection surface can be accurately guided to the right eye area of ​​the waveguide lens 100 through the light reflecting surface of the right reflection module 310-R.

[0071] It should be noted that the polarizing beam splitter film PBS1 is a PBS (Polarizing Beam Splitter) film. That is, when non-polarized light is incident on the PBS film, the incident non-polarized light is split by the PBS film into two perpendicular beams of first polarized light S (i.e., S-polarized light, also called S-state polarized light) and second polarized light P (i.e., P-polarized light, also called P-state polarized light). The first polarized light S is reflected by the PBS film, and the second polarized light P passes through the PBS film.

[0072] The waveguide lens 100 may be Figure 4 As shown in the entire waveguide lens, the left eye area of ​​the waveguide lens 100 includes a left coupling area 11 and a left coupling area 13, and the right eye area of ​​the waveguide lens 100 includes a right coupling area 12 and a right coupling area 14; the waveguide lens 100 is also provided with an image detection area 15 for coupling out the projected optical head image to the image detection module 300.

[0073] In a specific embodiment, referring to Figure 5 , Figure 5 It is a schematic diagram of the glasses stand 400 involved in the first embodiment of the present application. Figure 5 The left light hole 41 on the glasses holder 400 is arranged toward the left coupling area 11. Figure 5 The right light hole 42 on the glasses holder 400 is arranged toward the right coupling area 12. Figure 5 The image detection hole 43 on the glasses bracket 400 shown is set toward the image detection area 15. In addition, hinge holes 45 are provided on the left and right sides of the glasses bracket 400. The hinge holes 45 are hingedly connected to the left and right temples 700 of the smart glasses through the temple 700 pins 46. The glasses bracket 400 is also provided with a nose pad 600 hole 44 for snap-fitting the nose pad 600 of the smart glasses.

[0074] Furthermore, in some other feasible embodiments, referring to Figure 2 The left reflection module 310-L and the right reflection module 310-R are both the same light reflection module 310, and the light reflection module 310 includes a reflector Q1, a reflector base Q2, a fixed plate Q4 and a reflection drive unit Q3; the reflector Q1 is fixedly connected to the reflector base Q2, and a reflection drive unit Q3 is provided on the side of the reflector base Q2 that is not fixedly connected to the reflector Q1, and the side of the reflection drive unit Q3 away from the reflector base Q2 is provided on the fixed plate Q4; wherein, the side of the reflector Q1 in the left reflection module 310-L away from the reflector base Q2 constitutes the light reflection surface of the left reflection module 310-L; the side of the reflector Q1 in the right reflection module 310-R away from the reflector base Q2 constitutes the light reflection surface of the right reflection module 310-R.

[0075] In this embodiment, referring to Figure 2 The light reflection module 310 (i.e., the left reflection module 310-LL or the right reflection module 310-RR) includes a reflector Q1, a reflector base Q2, a fixing plate Q4, and a reflector drive unit Q3. The reflector Q1 is fixedly connected to the reflector base Q2. The reflector drive unit Q3 is provided on the side of the reflector base Q2 that is not fixedly connected to the reflector Q1. The side of the reflector drive unit Q3 that is away from the reflector base Q2 is provided on the fixing plate Q4. Specifically, the reflector drive unit Q3 can be Figure 2 The three driving hinges shown are respectively fixed on the side of the reflector base Q2 away from the reflector Q1, and the sides of the three driving hinges that are not fixedly connected to the reflector base Q2 are hingedly connected to the fixed plate Q4; alternatively, the reflection driving unit Q3 may have two driving hinges and one fixed part, and the two driving hinges are fixed on the side of the reflector base Q2 away from the reflector Q1, and the sides of the two driving hinges that are not fixedly connected to the reflector base Q2 are hingedly connected to the fixed plate Q4, and the fixed part fixedly connects the reflector base Q2 and the fixed plate Q4.

[0076] It should be noted that the drive hinge includes a telescopic shaft, a spherical hinge, and a drive housing on which the spherical hinge is provided. Specifically, the drive housing is fixed to the side of the reflector base Q2 away from the reflector Q1. The spherical hinge is fixedly connected to the telescopic shaft, and the side of the telescopic shaft not connected to the spherical hinge is connected to the fixed plate Q4. The telescopic shaft can drive the spherical hinge on the telescopic shaft to move back and forth and rotate to achieve a posture change of the reflector Q1. The telescopic shaft material can be magnetostrictive material, thermocouple material, or memory metal material. In addition, a drive unit can be integrated into the spherical hinge or no drive unit can be provided. This application does not impose any restrictions on this, and the drive unit can be a linear motor or a voice coil motor.

[0077] Further, in some feasible embodiments, referring to Figure 6 As shown in (a), the spectroscopic component 20 includes a first prism and a second prism, and the shapes of the first prism and the second prism are both isosceles right triangles; after the right-angled side of the first prism is glued to the right-angled side of the second prism to form a rhombus prism, the hypotenuse of the first prism and the hypotenuse of the second prism are arranged opposite to each other; wherein, the hypotenuse of the first prism constitutes the spectroscopic surface of the spectroscopic component 20 and is arranged on the side close to the light source 10; the hypotenuse of the second prism constitutes the total reflection surface of the spectroscopic component 20 and is arranged on the side away from the light source 10.

[0078] In this embodiment, the light splitting component 20 can be Figure 6 The rhombus prism shown in (a) is formed by gluing the right-angled side of the first triangular prism to the right-angled side of the second triangular prism, wherein the hypotenuse of the first triangular prism is arranged opposite to the hypotenuse of the second triangular prism, the hypotenuse of the first triangular prism constitutes the splitting surface of the splitting component 20, and the hypotenuse of the second triangular prism constitutes the total reflection surface of the splitting component 20.

[0079] Furthermore, in some other feasible embodiments, referring to Figure 6 As shown in (b), the light splitting component 20 includes a parallelogram prism. The side of the parallelogram prism facing the light source 10 constitutes the light splitting surface of the light splitting component 20, and the side of the parallelogram prism away from the light source 10 constitutes the total reflection surface of the light splitting component 20.

[0080] In this embodiment, the light splitting component 20 can also be Figure 6 (b) shows a parallelogram prism, wherein the side of the parallelogram prism facing the light source 10 constitutes the light splitting surface of the light splitting component 20, and the side of the parallelogram prism away from the light source 10 constitutes the total reflection surface of the light splitting component 20.

[0081] In a specific embodiment, the splitting surface of the splitting component 20 is arranged toward the light source 10, and a projection optical component is arranged between the light source 10 and the splitting surface of the splitting component 20; illustratively, the non-polarized light from the light source 10 is projected onto the splitting surface of the splitting component 20 through the projection optical component, so that the non-polarized light projected through the projection optical component can be divided into a first polarized light S and a second polarized light P that are perpendicular to each other through the polarization splitting film PBS1 attached to the splitting surface of the splitting component 20, that is, the polarization separation of the non-polarized light is achieved through the splitting surface of the splitting component 20, so that the visual display requirements of both eyes can be met by using only one light source 10, avoiding the technical problem of high power consumption of smart glasses caused by the traditional dual-light machine module 200 configuration, significantly reducing the power consumption of smart glasses, thereby reducing the dependence on large-capacity batteries, further reducing the overall weight of the smart glasses, and thus significantly improving the user's wearing experience. Next, when the first polarized light S is projected onto the left reflective surface of the light reflecting element 31 through the splitting surface of the splitting component 20, the second polarized light P passes through the splitting surface of the splitting component 20 and the polarization splitting film PBS1 and is projected onto the total reflection surface of the splitting component 20. The reflection efficiency of the second polarized light P on the total reflection surface is improved by the anti-reflection film coated on the total reflection surface, so that more second polarized light P is reflected to the right reflective surface of the light reflecting element 31, effectively reducing the light loss of the reflected second polarized light P and significantly improving the light transmission efficiency of the second polarized light P.

[0082] Furthermore, in some feasible embodiments, the optical machine module 200 includes a left reflector 40, which is arranged on the optical path of the first polarized light S projected by the left reflective surface of the light reflector 31. The left reflector 40 includes a left relay lens 410, a left polarization beam splitter 420, a left lens 430, a left modulation screen 440 and a left exit pupil lens 450; the left polarization beam splitter 420 and the waveguide lens 100 are respectively arranged on both sides of the left exit pupil lens 450, the left light-emitting surface of the left exit pupil lens 450 faces the left eye area of ​​the waveguide lens 100, and the left light-emitting surface is the side of the left exit pupil lens 450 away from the left polarization beam splitter 420; the left polarization beam splitter 420 is arranged between the left relay lens 410 and the left lens 430, the left relay lens 410 is arranged toward the left reflective surface of the light reflector 31, and the left modulation screen 440 is arranged on the side of the left lens 430 away from the left polarization beam splitter 420.

[0083] It should be noted that the left polarization beam splitter 420 can be Figure 7 (a) The left PBS prism shown, where Figure 7 The side of the left PBS prism shown in (a) facing the left lens 430 is set as the left splitting surface of the left polarizing beam splitter 420, and the polarizing beam splitting film PBS1 is attached to the left splitting surface; Figure 7The side of the left PBS prism shown in (b) that faces the left relay lens 410 is set as the phase conversion surface of the left polarization beam splitter 420, and a phase conversion film HWP1 is attached to the phase conversion surface; wherein, the phase conversion film HWP1 is an HWP (half-wave plate) film, and the HWP film causes the phase of light perpendicular to the HWP film to be delayed by π / 2 or an odd multiple thereof.

[0084] The left polarization beam splitter 420 may also be integrated with Figure 7 (b) shows a left PBS assembly comprising a first polarization beam splitter prism L1, a second polarization beam splitter prism L2, and a left reflector L3. Exemplarily, a polarization beam splitter film PBS1 is fixedly connected between the hypotenuse of the first polarization beam splitter prism L1 and the hypotenuse of the second polarization beam splitter prism L2, forming the left beam splitting surface of the left polarization beam splitter element 420. A phase conversion film HWP1 is attached to the side of the first polarization beam splitter prism L1 facing the left relay lens 410, forming the phase conversion surface of the left polarization beam splitter element 420. A phase delay film QWP1 is attached to the side of the second polarization beam splitter prism L2 facing the left reflector L3, forming the phase delay surface of the left polarization beam splitter element 420. The phase delay film QWP1 is a QWP (Quarter Wave Plate) film that delays the phase of light perpendicular to the QWP film by π / 4. Both the first polarization beam splitter prism L1 and the second polarization beam splitter prism L2 are PBS prisms.

[0085] In a specific embodiment, referring to Figure 9 Combined with Figure 7In the left PBS prism shown in (a), the first polarized light S is reflected by the polarization splitting film PBS1 attached to the splitting surface of the splitting component 20 to the light reflecting surface of the left reflective module 310-L (i.e., the left reflecting surface of the light reflecting component 31). After secondary reflection by the light reflecting surface of the left reflective module 310-L (i.e., the left reflecting surface of the light reflecting component 31), it enters the left relay lens 410 for convergence. The converged first polarized light S is projected onto the HWP film of the left PBS prism through the left relay lens 410. The first polarized light S is converted into the second polarized light P through the phase conversion of the HWP film and enters the left PBS prism. After passing through the left PBS prism, it enters the left lens 430 and is converged by the left lens 430. After being projected onto the left modulation screen 440, the second polarized light P is modulated by the left modulation screen 440 into a left field of view image (i.e., the first polarized light S carrying image information), and then projected onto the polarization splitter film PBS1 of the left PBS prism through the left lens 430. The left field of view image is reflected by the polarization splitter film PBS1 of the left PBS prism and converged by the left exit pupil lens 450 before being projected onto the left coupling-in area 11 of the waveguide lens 100, thereby reducing unnecessary light loss and significantly enhancing the clarity of light imaging. Next, when the left field of view image passes through the left coupling-out area 13 of the waveguide lens 100 and is projected into the user's left eye, it simultaneously passes through the image detection area 15 of the waveguide lens 100 and is captured by the image detection module 300.

[0086] In another embodiment, referring to Figure 10 Combined with Figure 7In the left PBS component shown in (b), the first polarized light S is reflected by the polarization splitting film PBS1 attached to the splitting surface of the splitting component 20 onto the light reflecting surface of the left reflecting module 310-L, and after secondary reflection by the light reflecting surface of the left reflecting module 310-L, enters the left relay lens 410 for convergence. The converged first polarized light S is projected onto the HWP film of the left PBS component through the left relay lens 410. The first polarized light S is converted into the second polarized light P through the phase conversion of the HWP film, and then passes through the first polarization splitting prism L1, the PBS film, and the second polarization splitting prism L2 in sequence, and then is projected out of the left PBS component into the left lens 430. After being converged by the left lens 430, it is projected onto the left modulation screen 440. The second polarized light P is modulated into the left field of view image (i.e., the first polarized light S carrying image information) by the left modulation screen 440, and then is re-entered into the left lens 430 and passes through the left lens 430 to enter the left PBS component. The second polarization beam splitter L2 of the component is projected onto the PBS film. The first polarized light S carrying the image information is reflected by the PBS film and then projected onto the QWP film. After being phase-delayed by 1 / 4 wavelength, it reaches the surface of the left reflector L3. After being reflected by the left reflector L3, it is phase-delayed by another 1 / 4 wavelength by the QWP film. At this time, the first polarized light S carrying the image information becomes the second polarized light P carrying the image information. After passing through the PBS film and projecting out of the left PBS component, it is incident on the left exit pupil lens 450. After being converged by the left exit pupil lens 450, the second polarized light P can be more accurately projected onto the left coupling-in area 11 of the waveguide lens 100, thereby reducing unnecessary light loss and significantly enhancing the clarity of light imaging. Next, when the second polarized light P carrying the image information passes through the left coupling-out area 13 of the waveguide lens 100 and is projected into the user's left eye, it simultaneously passes through the image detection area 15 of the waveguide lens 100 and is collected by the image detection module 300.

[0087] Furthermore, in other feasible embodiments, the optical machine module 200 includes a right reflector 50, which is arranged on the optical path of the second polarized light P projected by the right reflective surface of the light reflector 31, and the right reflector 50 includes a right relay lens 51, a right polarization beam splitter 52, a right lens 53, a right modulation screen 54 and a right exit pupil lens 55; the right polarization beam splitter 52 and the waveguide lens 100 are respectively arranged on both sides of the right exit pupil lens 55, the right light-emitting surface of the right exit pupil lens 55 faces the right eye area of ​​the waveguide lens 100, and the right light-emitting surface is the side of the right exit pupil lens 55 away from the right polarization beam splitter 52; the right polarization beam splitter 52 is arranged between the right relay lens 51 and the right lens 53, the right relay lens 51 is arranged toward the right reflective surface of the light reflector 31, and the right modulation screen 54 is arranged on the side of the right lens 53 away from the right polarization beam splitter 52.

[0088] It should be noted that, referring to Figure 8 , Figure 8Schematic diagram of the right polarization beam splitter 52 according to the first embodiment of the present application. The left polarization beam splitter 420 may be Figure 8 (a) The right PBS prism shown, where Figure 8 The side of the right PBS prism shown in (a) facing the right lens 53 is set as the right splitting surface of the right polarization beam splitter 52, and the polarization beam splitting film PBS1 is attached to the right splitting surface.

[0089] The right polarization beam splitter 52 may also be integrated with Figure 8 (b) shows a right PBS assembly of a third polarization beam splitter prism R1, a fourth polarization beam splitter prism R2, and a right reflector R3. For example, a polarization beam splitter film PBS1 is fixedly connected between the hypotenuse of the third polarization beam splitter prism R1 and the hypotenuse of the fourth polarization beam splitter prism R2 to form the right beam splitting surface of the right polarization beam splitter 52. A phase delay film QWP1 is attached to the side of the fourth polarization beam splitter prism R2 facing the right reflector R3 to form the phase delay surface of the right polarization beam splitter 52.

[0090] In a specific embodiment, referring to Figure 10 Combined with Figure 8 (a) shows the right PBS prism, the second polarized light P is reflected by the polarization splitting film PBS1 attached to the splitting surface of the splitting prism to the light reflecting surface of the right reflecting module 310-R (i.e., the right reflecting surface of the light reflecting member 31), and after secondary reflection by the right reflecting surface of the light reflecting member 31, enters the right relay lens 51 for convergence. The converged second polarized light P is projected onto the right PBS prism through the right relay lens 51, and the second polarized light P passes through the right PBS prism and enters the right lens 53. After convergence by the right lens 53, it is projected onto the right modulation screen 54. The second polarized light P is modulated by the right modulation screen 54 into The right field of view image (i.e., the first polarized light S carrying image information) is projected onto the polarization splitter film PBS1 of the right PBS prism through the right lens 53. The right field of view image is reflected by the polarization splitter film PBS1 of the right PBS prism, converged by the right exit pupil lens 55, and then projected onto the right coupling area 12 of the waveguide lens 100, thereby reducing unnecessary light loss and significantly enhancing the clarity of light imaging; next, when the right field of view image is projected into the user's right eye through the right coupling area 14 of the waveguide lens 100, it simultaneously passes through the image detection area 15 of the waveguide lens 100 and is captured by the image detection module 300.

[0091] In another embodiment, referring to Figure 10 Combined with Figure 8In the right PBS component shown in (b), the second polarized light P is reflected by the polarization splitting film PBS1 attached to the splitting surface of the splitting prism to the light reflecting surface of the right reflecting module 310-R (i.e., the right reflecting surface of the light reflecting element 31). After secondary reflection by the right reflecting surface of the light reflecting element 31, it enters the right relay lens 51 for convergence. The converged second polarized light P is projected onto the right PBS component through the right relay lens 51, passes through the third polarization splitting prism R1, the PBS film and the fourth polarization splitting prism R2 in sequence, and then projects out of the right PBS component into the right lens 53. After convergence by the right lens 53, it is projected onto the right modulation screen 54. After being modulated into the right field of view image (i.e., the first polarized light S carrying image information) by the right modulation screen 54, the second polarized light P is re-entered into the right lens 53, and passes through the right lens 53 and enters the fourth polarization splitting prism R2 of the right PBS component. The first polarized light S carrying the image information is projected onto the PBS film, and is reflected by the PBS film and then projected onto the QWP film. After being phase-delayed by 1 / 4 wavelength, it reaches the surface of the right reflector R3. After being reflected by the right reflector R3, it is phase-delayed by another 1 / 4 wavelength by the QWP film. At this time, the first polarized light S carrying the image information becomes the second polarized light P carrying the image information. After passing through the PBS film and projecting out of the right PBS component, it is incident on the right exit pupil lens 55. After being converged by the right exit pupil lens 55, it passes through the right vision accommodation mirror and is projected onto the right coupling area 12 of the waveguide lens 100, thereby reducing unnecessary light loss and significantly enhancing the clarity of light imaging. Next, the second polarized light P carrying the image information passes through the right coupling area 14 of the waveguide lens 100 and is projected into the user's right eye. At the same time, it passes through the image detection area 15 of the waveguide lens 100 and is collected by the image detection module 300.

[0092] In addition, it should be noted that, referring to Figure 11 , Figure 11 : is a schematic diagram of the packaging of an optical engine module 200 involved in the first embodiment of the present application. Specifically, Figure 11 yes Figure 9 The packaging diagram of the optical engine module 200 is shown; Figure 11 The left polarization beam splitter 420 and the right polarization beam splitter 52 shown are replaced by Figure 10 The left polarization beam splitter 420 and the right polarization beam splitter 52 shown in FIG. Figure 10 Schematic diagram of the packaging of the optical engine module 200 is shown.

[0093] Furthermore, in some feasible embodiments, the optical machine module 200 includes a projection optical component, which is arranged between the light source 10 and the spectroscopic component 20; the projection optical component includes a collimating lens, a uniform light lens and a relay lens, and the uniform light lens is arranged between the collimating lens and the relay lens, the collimating lens is arranged toward the light source 10, and the relay lens is arranged toward the spectroscopic surface of the spectroscopic component 20.

[0094] In this embodiment, the non-polarized light (i.e., incident light) from the light source 10 is converged by the collimating lens and then projected onto the uniform light lens, so that the converged incident light is more evenly projected onto the third relay lens for convergence, so as to form a light spot of appropriate size and projected onto the spectroscopic mirror of the spectroscopic component 20, thereby providing the spectroscopic mirror with high-quality light source 10 input, significantly improving the spectroscopic efficiency of the spectroscopic mirror.

[0095] In another embodiment, referring to Figure 12 , Figure 12 Schematic diagram of the structure of the smart glasses involved in the first embodiment of the present application. The smart glasses also include a glasses bracket 400, a temple 700 pin 46, a glasses housing 500, a nose pad 600 and a temple 700. The glasses bracket 400 is provided with a left light hole 41, a right light hole 42, an image detection hole 43, a nose pad 600 fixing hole and a hinge hole 45 for light to pass through, and a field of view area for fixing the waveguide lens 100; illustratively, the waveguide lens 100 is arranged between the glasses bracket 400 and the glasses housing 500 and fixed to the field of view area on the glasses bracket 400, and an optical machine module 200 and an image detection module 300 (such as a camera module) are provided on the side of the waveguide lens 100 away from the glasses housing 500, the image detection module 300 is arranged toward the image detection hole 43, and the optical machine module 200 The left light exit hole of the optical machine module 200 is aligned with the left light through hole 41 of the glasses holder 400, the right light exit hole of the optical machine module 200 is aligned with the right light through hole 42 of the glasses holder 400, and the left exit pupil lens 450 of the left polarized beam splitter in the optical machine module 200 is arranged toward the left light exit hole of the optical machine module 200, and the right exit pupil lens 55 of the right polarized beam splitter in the optical machine module 200 is arranged toward the right light exit hole of the optical machine module 200; in addition, after the nose pad positioning hole on the nose pad 600 is aligned with the nose pad fixing hole, the nose pad fastener is passed through the nose pad fixing hole aligned with the nose pad positioning hole and then fixed to the glasses holder 400, and the pins 46 of the temples 700 on the left and right sides of the glasses holder 400 respectively pass through the corresponding hinge holes 45 to form a hinged connection between the left / right temples 700.

[0096] Furthermore, based on the first embodiment of the smart glasses of the present application, a second embodiment of the image detection method of the smart glasses of the present application is proposed, referring to Figure 13 , Figure 13 This is a flow chart of the second embodiment of the image detection method for smart glasses of the present application.

[0097] The image detection method for the smart glasses of the present application is applied to any of the above-mentioned smart glasses, and the image detection method for the smart glasses of the present application includes the following implementation steps S10 to S20.

[0098] Step S10: When it is determined that the first polarized light and the second polarized light projected by the beam splitting component pass through the reflective driving component to the waveguide lens and are incident on the user's eyes, the image detection module obtains the projected optical image coupled out of the waveguide lens to the user's eyes.

[0099] In this embodiment, after the light splitting component splits the incident light from the light source (i.e., unpolarized light) into a first polarized light and a second polarized light, the first polarized light and the second polarized light are incident on the user's eyes through the light transmission direction of the reflective driver to the waveguide lens, thereby achieving the goal of using only one light source to meet the visual display needs of both eyes, avoiding the technical problem of high power consumption of smart glasses caused by the traditional dual-light machine module configuration. That is, the present application significantly reduces the power consumption of smart glasses by splitting the single light source by the light splitting component, thereby reducing the dependence on large-capacity batteries, further reducing the overall weight of the smart glasses, and significantly improving the user's wearing experience. Next, the first polarized light and the second polarized light are projected onto the light reflecting element, and when they are coupled out to the user's eyes through the light transmission direction of the light reflecting element to the waveguide lens, the image detection module captures the projected optical image coupled out to the user's eyes by the waveguide lens in real time, thereby providing accurate and reliable projected optical images for subsequent image detection.

[0100] Step S20: enabling the reflective driver to adjust the light transmission direction according to the abnormal optical state of the glasses, until the projected optical image coupled out by the waveguide lens based on the adjusted light transmission direction is adjusted to be consistent with the standard optical image; wherein the light splitting component is configured to split the incident light from the light source into a first polarized light and a second polarized light.

[0101] In this embodiment, the projected optical image is compared and analyzed with a preset standard optical image, so that the current optical state of the smart glasses (i.e., the optical state of the glasses) can be accurately evaluated. Once the optical state of the glasses is determined to be an abnormal optical state, the reflective driving component is immediately triggered to move the position of the light reflecting mirror surface of the light reflecting component to dynamically adjust the light transmission direction of the light reflecting component to the waveguide lens until the projected optical image coupled out by the waveguide lens based on the adjusted light transmission direction is quickly restored to be consistent with the standard optical image, thereby ensuring that the smart glasses continue to provide a high-quality, defect-free visual experience, significantly enhancing the user's wearing comfort and satisfaction.

[0102] In summary, the present application provides a pair of smart glasses and an image detection method thereof, as well as an extended reality device. The smart glasses integrate a waveguide lens, an optical module and an image detection module, and by setting a splitter component and a reflective driver in the optical module of a single light source, the optical performance of the smart glasses when subjected to physical impact is effectively improved while ensuring low power consumption of the smart glasses. Specifically, incident light from a light source is split into first polarized light and second polarized light by a beam splitting component, and then transmitted to the waveguide lens in a light transmission direction through a reflective driver. The light is then transmitted to the user's eyes in a direction that is consistent with the light transmission direction of the reflective driver. This allows the use of a single light source to meet the visual display requirements of both eyes, effectively avoiding the high power consumption of the smart glasses caused by traditional dual-optical module configurations, and significantly reducing the power consumption of the smart glasses. Subsequently, the image detection module compares the projected optical image coupled out of the waveguide lens to the user's eyes based on the light transmission direction with a preset standard optical image, thereby accurately determining the optical state of the smart glasses. Upon detecting a variation in optical performance due to physical impact (e.g., a visual defect such as a dark band), that is, when the optical state of the glasses is abnormal, the reflective driver is immediately triggered to automatically adjust the light transmission direction from the reflective driver to the waveguide lens. This allows the projected optical image coupled out of the waveguide lens based on the adjusted light transmission direction to quickly return to consistency with the standard optical image, thereby avoiding the dark band phenomenon in the image of the smart glasses caused by physical impact, significantly improving the optical performance of the smart glasses when subjected to physical impact, and thereby effectively ensuring the wearer's visual experience.

[0103] In addition, the present application also provides an extended reality device, which includes a memory, a processor, and an image detection program for smart glasses stored in the memory and capable of running on the processor. When the image detection program for smart glasses is executed by the processor, the steps of the above-mentioned image detection method for smart glasses are implemented. Figure 14 , Figure 14 1 is a schematic diagram of the structure of an extended reality device involved in an embodiment of the present application. The extended reality device of the embodiment of the present application can specifically be a device for locally running the image detection method of smart glasses.

[0104] like Figure 14 As shown, the extended reality device of the embodiment of the present application may include: smart glasses; or a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a Wi-Fi interface).

[0105] Memory 1005 is provided on the main body of the extended reality device. Memory 1005 stores a program that, when executed by processor 1001, implements the corresponding operation. Memory 1005 is also used to store parameters used by the extended reality device. Memory 1005 can be a high-speed RAM memory or a non-volatile memory, such as a disk drive. Memory 1005 can also optionally be a storage device independent of the aforementioned processor 1001.

[0106] Those skilled in the art will understand that Figure 14 The extended reality device structure shown in the figure does not constitute a limitation to the extended reality device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0107] like Figure 14 As shown, the memory 1005 as a storage medium may include an operating system, a network communication module, a user interface module, and an image detection program for smart glasses.

[0108] exist Figure 14 In the extended reality device shown, the processor 1001 can be used to call the image detection program of the smart glasses stored in the memory 1005 and execute the steps of the image detection method of the smart glasses as described above.

[0109] In addition, to achieve the above-mentioned purpose, the present application also provides a storage medium, which is a computer-readable storage medium. The computer-readable storage medium stores an image detection program for smart glasses, and when the image detection program for smart glasses is executed by a processor, the steps of the above-mentioned image detection method for smart glasses are implemented.

[0110] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or system comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or system. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or system comprising the element.

[0111] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0112] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course, by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium such as ROM / RAM, magnetic disk, or optical disk as mentioned above, and includes several instructions for enabling an extended reality device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0113] The above are only preferred embodiments of the present application and do not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A pair of smart glasses, characterized in that: The smart glasses include a waveguide lens, an optical module and an image detection module, wherein the optical module includes a light source, a light splitting component and a reflective driving component; The incident light from the light source is split into a first polarized light and a second polarized light by the light splitting component, and then passes through the reflective driving component to the light transmission direction of the waveguide lens and is incident on the user's eyes; The image detection module is configured to obtain a projected optical image coupled out by the waveguide lens to the user's eyes based on the light conduction direction, determine an optical state of the glasses based on the projected optical image and a preset standard optical image, and enable the reflective driving component to adjust the light conduction direction based on the abnormal optical state of the glasses until the projected optical image coupled out by the waveguide lens based on the adjusted light conduction direction is adjusted to be consistent with the standard optical image.

2. The smart glasses according to claim 1, wherein: The reflective driving component includes a light reflecting component, which is a left reflective module and a right reflective module that are mirror-symmetrical. The light reflecting surface of the left reflective module is arranged toward the beam splitting surface of the beam splitting component, and the light reflecting surface of the right reflective module is arranged toward the total reflection surface of the beam splitting component. The total reflection surface is the opposite surface of the beam splitting surface. A polarizing beam splitting film is attached to the beam splitting surface, and an anti-reflection film is coated on the total reflection surface. The light reflecting member is configured to project the first polarized light projected by the beam splitting surface to the left eye area of ​​the waveguide lens through the light reflecting surface of the left reflecting module, and project the second polarized light projected by the beam splitting surface to the right eye area of ​​the waveguide lens through the light reflecting surface of the right reflecting module; wherein, The light reflecting surface of the left reflecting module constitutes the left reflecting surface of the light reflecting member, and the light reflecting surface of the right reflecting module constitutes the right reflecting surface of the light reflecting member.

3. The smart glasses according to claim 2, wherein: The left reflective module and the right reflective module are both identical light reflective modules, each light reflective module comprising a reflector, a reflector base, a fixing plate, and a reflective drive unit; The reflector is fixedly connected to the reflector base, the reflector drive unit is provided on a side of the reflector base that is not fixedly connected to the reflector, and the reflector drive unit is provided on a side away from the reflector base on the fixing plate; wherein, The side of the reflector in the left reflective module away from the reflector base constitutes the light reflecting surface of the left reflective module; the side of the reflector in the right reflective module away from the reflector base constitutes the light reflecting surface of the right reflective module.

4. The smart glasses according to claim 1, wherein: The light splitting component includes a first prism and a second prism, wherein the shape of the first prism and the shape of the second prism are both isosceles right triangles; After the right-angled side of the first prism is glued to the right-angled side of the second prism to form a rhombus prism, the hypotenuse of the first prism and the hypotenuse of the second prism are arranged opposite to each other; wherein, The hypotenuse of the first prism constitutes the splitting surface of the splitting component and is arranged on the side close to the light source; the hypotenuse of the second prism constitutes the total reflection surface of the splitting component and is arranged on the side away from the light source.

5. The smart glasses according to claim 1, wherein: The light splitting component includes a parallelogram prism, the side of the parallelogram prism facing the light source constitutes a light splitting surface of the light splitting component, and the side of the parallelogram prism away from the light source constitutes a total reflection surface of the light splitting component.

6. The smart glasses according to claim 1, wherein: The optical machine module includes a left reflector, which is arranged on the optical path of the first polarized light projected by the left reflective surface of the optical reflector, and includes a left relay lens, a left polarization beam splitter, a left lens, a left modulation screen and a left exit pupil lens; The left polarization beam splitter and the waveguide lens are respectively provided on both sides of the left exit pupil lens, the left light exit surface of the left exit pupil lens faces the left eye area of ​​the waveguide lens, and the left light exit surface is the side of the left exit pupil lens away from the left polarization beam splitter; The left polarization beam splitter is arranged between the left relay lens and the left lens, the left relay lens is arranged toward the left reflective surface of the light reflector, and the left modulation screen is arranged on a side of the left lens away from the left polarization beam splitter.

7. The smart glasses according to claim 1, wherein: The optical machine module includes a right reflector, which is arranged on the optical path of the second polarized light projected by the right reflective surface of the optical reflector, and includes a right relay lens, a right polarization beam splitter, a right lens, a right modulation screen and a right exit pupil lens; The right polarization beam splitter and the waveguide lens are respectively provided on both sides of the right exit pupil lens, the right light exit surface of the right exit pupil lens faces the right eye area of ​​the waveguide lens, and the right light exit surface is the side of the right exit pupil lens away from the right polarization beam splitter; The right polarization beam splitter is arranged between the right relay lens and the right lens, the right relay lens is arranged toward the right reflective surface of the light reflector, and the right modulation screen is arranged on a side of the right lens away from the right polarization beam splitter.

8. The smart glasses according to claim 1, wherein: The optical machine module includes a projection optical component, and the projection optical component is arranged between the light source and the light splitting component; The projection optical component includes a collimating lens, a light homogenizing lens and a relay lens. The light homogenizing lens is arranged between the collimating lens and the relay lens. The collimating lens is arranged toward the light source, and the relay lens is arranged toward the splitting surface of the splitting component.

9. An image detection method for smart glasses, characterized in that: The image detection method for smart glasses is applied to the smart glasses according to any one of claims 1 to 8, and the image detection method for smart glasses comprises: When it is determined that the first polarized light and the second polarized light projected by the light splitting component pass through the reflective driving component to the light transmission direction of the waveguide lens and are incident on the user's eyes, the image detection module obtains the projected optical images coupled out of the waveguide lens to the user's eyes; According to the abnormal optical state of the glasses, the reflective driving component is enabled to adjust the light transmission direction until the projected optical image coupled out by the waveguide lens based on the adjusted light transmission direction is adjusted to be consistent with the standard optical image; wherein, The light splitting component is configured to split incident light from a light source into the first polarized light and the second polarized light.

10. An extended reality device, characterized in that: The extended reality device comprises the smart glasses according to any one of claims 1 to 8; or The extended reality device includes a processor, a memory, and an image detection program for smart glasses stored in the memory and executable by the processor, wherein when the image detection program for smart glasses is executed by the processor, the steps of the image detection method for smart glasses as described in claim 9 are implemented.

Images