XR glasses and control method thereof
By integrating an adjustable diopter lens and an iris information acquisition unit in XR glasses, and automatically adjusting the diopter using deep learning processing, the problem that XR glasses in the prior art are difficult to adapt to users of different diopters, improving user experience and convenience of use.
Patent Information
- Application Number
- CN202411053112.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-02
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2044-08-02
AI Technical Summary
Existing XR glasses are difficult to adapt to the needs of users with different diopters, and require manual adjustment of diopters, and the structure is complex, which affects the user experience.
An XR glasses including an adjustable diopter lens, a diopter adjustment unit, an iris information acquisition unit and a microprocessing unit are designed. Through iris information acquisition and deep learning processing, the diopter of the lens is automatically adjusted to achieve adaptive diopter adjustment.
It improves the user experience, simplifies the diopter adjustment process, and avoids the complexity and high cost of manual operations.
Smart Images

Figure CN118567111B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of extended display devices, and in particular to XR glasses and a control method thereof. Background Art
[0002] With the development of computer technology, technologies related to virtual reality (VR), augmented reality (AR) and mixed reality (MR) display are developing rapidly. These three technologies are collectively referred to as extended reality (XR), which meet people's needs for interaction with the virtual and real worlds and bring users a strong immersive reality experience. Now such technology products are gradually entering people's lives.
[0003] However, in the real world, many people are nearsighted or farsighted, which means that if users want to use ordinary XR glasses, they must wear nearsighted or farsighted glasses at the same time. This may make it difficult to fix the XR glasses, and wearing two glasses at the same time will cause additional pressure on the bridge of the nose and ears, which is very inconvenient. If users do not wear glasses to watch XR movies, the images seen by users with incorrect refractive power are blurred, which greatly affects the user experience.
[0004] The current diopter calculation and acquisition scheme requires users to customize lenses with specified diopter degrees before purchase and set them in XR glasses. The procedure is complicated and costly, and it cannot adapt to people with different diopter degrees. When adjusting the diopter, it is necessary to add a complex XR glasses mechanical device to change the diopter. The structure is complicated, and after different users use it, the diopter adjustment knob needs to be manually adjusted each time, which is very inconvenient. Therefore, providing an XR glasses that can adaptively adjust the diopter has become a problem that needs to be solved urgently. Summary of the invention
[0005] The present invention provides an XR glasses and a control method thereof, which can realize automatic diopter adjustment of the XR glasses according to different users, thereby improving the user experience.
[0006] According to one aspect of the present invention, there is provided an XR glasses, comprising: an XR glasses body, and an adjustable diopter lens, a diopter adjustment unit, an iris information collection unit and a microprocessing unit integrated on the XR glasses body, wherein the microprocessing unit is electrically connected to the diopter adjustment unit and the iris information collection unit respectively;
[0007] The diopter adjustment unit at least comprises a diopter adjustment knob, an adjustable diopter lens pressure control arm and an adjustable lens moving guide rail, wherein the diopter adjustment knob is connected to the adjustable diopter lens; the adjustable diopter lens pressure control arm is respectively connected to the adjustable diopter lens and the adjustable lens moving guide rail, and the adjustable diopter lens rotates according to the adjustable lens moving guide rail and the adjustable diopter lens pressure control arm;
[0008] The iris information collection unit is used to collect the user's eye iris image information;
[0009] The microprocessing unit is used to obtain user identification information and diopter information according to the eye iris image information, and determine diopter adjustment information according to the user identification information and the diopter information;
[0010] The diopter adjustment knob or the adjustable diopter lens pressure control arm is used to adjust the diopter of the adjustable diopter lens according to the diopter adjustment information.
[0011] Optionally, the adjustable diopter lens includes an adjustable diopter left lens and an adjustable diopter right lens, the diopter adjustment knob includes a left eye diopter adjustment knob and a right eye diopter adjustment knob, the adjustable diopter lens pressure control arm includes an adjustable diopter left lens pressure control arm and an adjustable diopter right lens pressure control arm, and the adjustable lens moving guide rail includes an adjustable lens moving left guide rail and an adjustable lens moving right guide rail,
[0012] The adjustable diopter left lens and the adjustable diopter right lens are connected by a fixed cross bar;
[0013] The adjustable diopter left lens is connected to the adjustable lens moving left guide rail via the adjustable diopter left lens pressure control arm, and the adjustable diopter right lens is connected to the adjustable lens moving right guide rail via the adjustable diopter right lens pressure control arm.
[0014] Optionally, the XR glasses further include a display unit and a light adjustment unit.
[0015] The display unit is used to display preset image information and emit image light;
[0016] The light adjustment unit includes a wave plate polarizer and curved mirror integration, a polarization beam splitter lens and a magnifying zoom lens;
[0017] The magnifying zoom lens receives the image light and performs magnification and zoom processing to form a magnified zoom image light. The polarizing beam splitter lens receives the magnified zoom image light and reflects it to generate a first reflected image light. The wave plate polarizer and curved mirror integration body receives the first reflected image light and reflects it to generate a second reflected image light. The polarizing beam splitter lens receives the second reflected image light again and transmits it to generate a transmitted image light. The transmitted image light is incident on the user's eyes, or the transmitted image light is incident on the user's eyes after passing through the adjustable diopter lens.
[0018] Optionally, the XR glasses further include a front environment monitoring unit, and the front environment monitoring unit is connected to the display unit and the microprocessing unit respectively;
[0019] The front environment monitoring unit is used to collect real-time environment image information;
[0020] The display unit is also used to display the real-time environment image information.
[0021] Optionally, the XR glasses further include a power start button, and the power start button includes a first gear position, a second gear position, and a third gear position;
[0022] The first gear is used to control the XR glasses to be in a power-on state; the first gear includes a first sub-gear and a second sub-gear, the first sub-gear is used to start a first preset time to enter a non-myopia operation mode, the second sub-gear is used to start a second preset time to enter a myopia operation mode, and the first preset time is greater than the second preset time;
[0023] The second gear is used to control the XR glasses to be in sleep mode;
[0024] The third gear is used to control the XR glasses to be in shutdown mode.
[0025] According to another aspect of the present invention, a method for controlling XR glasses is provided, including the XR glasses according to any one of the above aspects, and the method for controlling the XR glasses includes:
[0026] Activate the power start button;
[0027] Acquire the user's eye iris image information collected by the iris information collection unit;
[0028] Acquiring user identification information according to the eye iris image information;
[0029] Acquiring diopter information according to the user identification information;
[0030] The diopter adjustment information is acquired according to the diopter information, and the diopter of the adjustable diopter lens is adjusted.
[0031] Optionally, the refractive information includes first refractive information and second refractive information; before acquiring the refractive information according to the user identification information, the method further includes:
[0032] Get historical user information;
[0033] Acquiring diopter information according to the user identification information includes:
[0034] Determining whether the user identification information is included in the historical user information;
[0035] If yes, directly obtain the first diopter information;
[0036] If not, the second refractive power information is obtained according to the user identification information.
[0037] Optionally, after directly acquiring the first diopter information, the method further includes:
[0038] determining whether the user is myopic according to the first refractive power information;
[0039] If yes, obtaining diopter adjustment information according to the first diopter information, rotating the adjustable diopter lens by using the adjustable diopter lens pressure control arm and the adjustable lens moving guide rail according to the diopter adjustment information, and adjusting the diopter of the adjustable diopter lens;
[0040] If not, use the XR glasses normally.
[0041] Optionally, after acquiring the second diopter information according to the user identification information, the method further includes:
[0042] Determine whether the user selects the myopia operation mode;
[0043] If yes, obtaining diopter adjustment information according to the second diopter information, rotating the adjustable diopter lens by using the adjustable diopter lens pressure control arm and the adjustable lens moving guide rail according to the diopter adjustment information, and adjusting the diopter of the adjustable diopter lens;
[0044] If not, stop the rotation of the adjustable diopter lens and use the XR glasses normally.
[0045] Optionally, after obtaining diopter adjustment information according to the second diopter information, rotating the adjustable diopter lens by using the adjustable diopter lens pressure control arm and the adjustable lens moving guide rail according to the diopter adjustment information, and adjusting the diopter of the adjustable diopter lens, the method further includes:
[0046] Determine whether the XR glasses display screen meets the preset display requirements;
[0047] If yes, use the XR glasses normally;
[0048] If not, the diopter adjustment knob is used to adjust the diopter of the adjustable diopter lens until the preset display requirement is met.
[0049] The technical solution of the embodiment of the present invention provides an XR glasses, wherein the XR glasses include: an XR glasses body and an adjustable diopter lens, a diopter adjustment unit, an iris information collection unit and a microprocessing unit integrated on the XR glasses body, wherein the microprocessing unit is electrically connected to the diopter adjustment unit and the iris information collection unit respectively; the diopter adjustment unit includes at least a diopter adjustment knob, an adjustable diopter lens pressure control arm and an adjustable lens moving guide rail, wherein the diopter adjustment knob is connected to the adjustable diopter lens; the adjustable diopter lens pressure control arm is connected to the adjustable diopter lens and the adjustable lens moving guide rail respectively, and the adjustable diopter lens is adjusted according to the movement of the adjustable lens The guide rail and the adjustable diopter lens pressure control arm rotate; the iris information acquisition unit is used to acquire the user's eye iris image information; the microprocessing unit is used to obtain the user identification information and the diopter information according to the eye iris image information, and determine the diopter adjustment information according to the user identification information and the diopter information; the diopter adjustment knob is used to adjust the diopter of the adjustable diopter lens according to the diopter adjustment information, so as to achieve fine adjustment of the diopter of the XR glasses, and the adjustable diopter lens pressure control arm is used to adjust the diopter of the adjustable diopter lens according to the diopter adjustment information, so as to achieve automatic diopter adjustment of the XR glasses according to different users, thereby improving the user's sense of experience.
[0050] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0051] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0052] Figure 1 A schematic diagram of the structure of an XR glasses in a myopia operation mode provided by an embodiment of the present invention;
[0053] Figure 2 A schematic diagram of the structure of another XR glasses provided by an embodiment of the present invention;
[0054] Figure 3A schematic diagram of the structure of an eccentric light source LED array provided by an embodiment of the present invention;
[0055] Figure 4 A schematic diagram of the side view structure of an XR glasses provided by an embodiment of the present invention;
[0056] Figure 5 A schematic diagram of a top view structure of an XR glasses in a myopia operation mode provided by an embodiment of the present invention;
[0057] Figure 6 A schematic diagram of the side-view structure of an XR glasses in a non-myopic operating mode provided by an embodiment of the present invention;
[0058] Figure 7 A schematic diagram of an optical path of XR glasses in a non-myopic operating mode when the user is myopic, provided by an embodiment of the present invention;
[0059] Figure 8 A schematic diagram of the optical path of XR glasses in a myopia operation mode when the user is myopic, provided by an embodiment of the present invention;
[0060] Fig. 9 A schematic flow chart of a control method for XR glasses provided in an embodiment of the present invention;
[0061] Fig.10 A schematic diagram of the relationship between a refractive index, a propagation direction of light, and a vibration direction provided by an embodiment of the present invention;
[0062] Fig.11 A schematic flow chart of another method for controlling XR glasses provided in an embodiment of the present invention;
[0063] Fig.12 A schematic flow chart of another method for controlling XR glasses provided in an embodiment of the present invention;
[0064] Fig.13 A schematic flow chart of another method for controlling XR glasses provided in an embodiment of the present invention;
[0065] Fig.14 A schematic flow chart of another method for controlling XR glasses provided in an embodiment of the present invention. DETAILED DESCRIPTION
[0066] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.
[0067] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0068] Figure 1 A schematic diagram of the structure of an XR glasses in a myopia operation mode provided by an embodiment of the present invention, Figure 2 A schematic diagram of the structure of another XR glasses provided by an embodiment of the present invention, Figure 3 A schematic diagram of the structure of an eccentric light source LED array provided by an embodiment of the present invention, Figure 4 A schematic diagram of a side view structure of XR glasses provided by an embodiment of the present invention, Figure 5 A schematic diagram of a top view structure of an XR glasses in a myopia operation mode provided by an embodiment of the present invention, Figure 6 A schematic diagram of a side view structure of an XR glasses in a non-myopic operating mode provided by an embodiment of the present invention, such as Figure 1 , Figure 2 , Figure 3 , Figure 4 , Figure 5 and Figure 6As shown, the XR glasses 100 include: an XR glasses body and an adjustable diopter lens 101, a diopter adjustment unit 102, an iris information collection unit 103 and a microprocessing unit 104 integrated on the XR glasses body, the microprocessing unit 104 being electrically connected to the diopter adjustment unit 102 and the iris information collection unit 103 respectively; the diopter adjustment unit 102 at least includes a diopter adjustment knob 105, an adjustable diopter lens pressure control arm 106 and an adjustable lens moving guide rail 107, the diopter adjustment knob 105 being connected to the adjustable diopter lens 101; the adjustable diopter lens pressure control arm 106 being electrically connected to the iris information collection unit 103 respectively; the diopter adjustment unit 102 at least includes a diopter adjustment knob 105, an adjustable diopter lens pressure control arm 106 and an adjustable lens moving guide rail 107 The adjustable diopter lens 101 is connected to the adjustable lens moving guide rail 107, and the adjustable diopter lens 101 rotates according to the adjustable lens moving guide rail 107 and the adjustable diopter lens pressure control arm 106; the iris information acquisition unit 103 is used to acquire the user's eye iris image information; the microprocessing unit 104 is used to obtain the user identification information and the diopter information according to the eye iris image information, and determine the diopter adjustment information according to the user identification information and the diopter information; the diopter adjustment knob 105 or the adjustable diopter lens pressure control arm 106 is used to adjust the diopter of the adjustable diopter lens 101 according to the diopter adjustment information.
[0069] Among them, the adjustable diopter lens 101, the diopter adjustment unit 102, the iris information collection unit 103 and the microprocessing unit 104 are all arranged on the XR glasses body, and the microprocessing unit 104 is electrically connected to the diopter adjustment unit 102 and the iris information collection unit 103 respectively. The adjustable diopter lens 101 can be adaptively adjusted according to the user's diopter, and can be made of lithium niobate crystal with electro-optical effect, and the shape is a concave lens. When the adjustable diopter lens 101 is in a working state, different voltages can be applied to the lens to make the angle of the light emitted through the lens different, thereby showing different diopters. The iris information collection unit 103 includes a left eye iris information collection unit 1031 corresponding to the user's left eye and a right eye iris information collection unit 1032 corresponding to the user's right eye. The iris information collection unit 103 is used to collect the user's eye iris image information, and the eye iris image information includes images of the user's eye and eye iris at different angles. The iris information acquisition unit 103 may be composed of a light source module and an image acquisition system. The light source module is composed of an eccentric light source LED array and a light source circuit board for controlling the LED array. For example, Figure 3As shown, the eccentric light source LED array 30 is composed of 25 850nm near-infrared LEDs, including a concentric near-infrared LED 31 located in the center and 6 eccentric near-infrared LED units 32. Each eccentric near-infrared LED unit 32 includes 4 near-infrared LED subunits 33 arranged in a straight line and at equal intervals. The angle between adjacent eccentric near-infrared LED units 32 is 60°. The light source circuit board controls and drives the eccentric light source LED array to light up and down in sequence. The image acquisition system is used to receive and collect the light emitted by the light source module and reflected back by the human eye refractive system. The iris information acquisition unit 103 can be an infrared camera. The specific structure of the iris information acquisition unit 103 can be selected according to actual design requirements, and the embodiment of the present invention does not make specific limitations. Figure 2As shown, the microprocessing unit 104 may include a microcontroller processing unit 1041, a storage unit 1042, a communication unit 1043 and a deep learning processing unit 1044. The microcontroller processing unit 1041, the storage unit 1042, the communication unit 1043 and the deep learning processing unit 1044 are connected via a bus. The microcontroller processing unit 1041 may perform device initialization on the XR glasses 100 to ensure the selection, judgment, execution and exit of the four states of the XR glasses 100, namely, a non-myopic state, a myopic state, a sleep mode and a shutdown mode. At the same time, the iris image information of the user collected by the iris information collection unit 103 may be processed, and the user identification information and the refractive power information may be obtained by using the deep learning processing unit 1044. The microcontroller processing unit 1041 determines the refractive power adjustment information according to the user identification information and the refractive power information. The storage unit 1042 can be used to store the user's eye iris image information collected by the iris information collection unit 103, and can store the user identification information and diopter information obtained after processing the eye iris image information. The user identification information may include the human eye iris image, the human eye pupil distance, etc. The communication unit 1043 can perform wired communication between each unit and the microcontroller processing unit 1041, as well as wired communication between each unit, and can also obtain the video source information of the XR glasses 100 through wireless communication. The deep learning processing unit 1044 is used to receive the user's eye iris image information collected by the iris information collection unit 103. The deep learning processing unit 1044 can calculate the diopter information based on the eye iris image information, the historical user's diopter information stored in the storage unit 1042, and the pre-trained built-in deep learning neural network model. The diopter adjustment unit 102 at least includes a diopter adjustment knob 105, an adjustable diopter lens pressure control arm 106 and an adjustable lens moving guide rail 107. The diopter adjustment knob 105 is arranged at the temple of the XR glasses 100. The diopter adjustment knob 105 is connected to the adjustable diopter lens 101. The rotation angle of the diopter adjustment knob 105 is the input electrical signal of the microcontroller processing unit 1041. After receiving the electrical signal, the microcontroller processing unit 1041 changes the output adjustable diopter according to a predetermined algorithm. The specific voltage of the diopter lens 101 can realize continuous fine adjustment of the diopter within a certain range, realize more detailed diopter adjustment, and enhance user experience; the adjustable diopter lens pressure control arm 106 is respectively connected to the adjustable diopter lens 101 and the adjustable lens moving guide rail 107, and the adjustable diopter lens 101 rotates according to the adjustable lens moving guide rail 107 and the adjustable diopter lens pressure control arm 106, and the adjustable diopter lens 101 can realize a rotation between 0 and 90 degrees, such as Figure 4 and Figure 5As shown, when the user is myopic, the plane where the adjustable diopter lens 101 is located intersects with the extension direction X1 of the temples of the XR glasses 100; Figure 6 As shown, when the user is non-myopic, the plane where the adjustable diopter lens 101 is located is parallel to the extension direction X1 of the temples of the XR glasses 100. The specific process of the adjustable diopter lens 101 rotating from 0° to 90° includes the adjustable diopter lens pressure control arm 106 and the adjustable diopter lens 101 moving a preset distance along the adjustable lens moving guide rail 107 toward the user's eyes, which can be moved to the end of the adjustable lens moving guide rail 107 close to the user's eyes to avoid damage to the structural components in the XR glasses 100 during the rotation of the adjustable diopter lens 101, and then the adjustable diopter lens 101 is rotated 90° counterclockwise to unfold. The specific process of rotating the adjustable diopter lens 101 from 90° to 0° includes adjusting the adjustable diopter lens 101 to rotate 90° clockwise and retract it, and then the adjustable diopter lens pressure control arm 106 and the adjustable diopter lens 101 move along the adjustable lens moving guide rail 107 away from the user's eyes, or the adjustable diopter lens 101 can be adjusted to rotate and retract in the clockwise direction and the adjustable diopter lens pressure control arm 106 and the adjustable diopter lens 101 move along the adjustable lens moving guide rail 107 away from the user's eyes at the same time to ensure that the adjustable diopter lens 101 is in a retracted state.
[0070] The embodiment of the present invention provides an XR glasses body and an adjustable diopter lens, a diopter adjustment unit, an iris information collection unit and a microprocessing unit integrated on the XR glasses body through XR glasses, the microprocessing unit is electrically connected to the diopter adjustment unit and the iris information collection unit respectively; the diopter adjustment unit at least includes a diopter adjustment knob, an adjustable diopter lens pressure control arm and an adjustable lens moving guide rail, and the iris information collection unit is used to collect the user's eye iris image information; the microprocessing unit is used to obtain user identification information and diopter information according to the eye iris image information, and determine the diopter adjustment information according to the user identification information and the diopter information; the diopter adjustment knob or the adjustable diopter lens pressure control arm is used to adjust the diopter of the adjustable diopter lens according to the diopter adjustment information, so as to realize automatic diopter adjustment of the glasses according to different users and improve the user experience.
[0071] Optional, continue to refer to Figure 1 and Figure 5As shown, the adjustable diopter lens 101 includes an adjustable diopter left lens 1011 and an adjustable diopter right lens 1012, the diopter adjustment knob 105 includes a left eye diopter adjustment knob 1051 and a right eye diopter adjustment knob 1052, the adjustable diopter lens pressure control arm 106 includes an adjustable diopter left lens pressure control arm 1061 and an adjustable diopter right lens pressure control arm 1062, and the adjustable lens moving guide rail 107 includes an adjustable lens moving guide rail 108. The movable left guide rail 1071 and the adjustable lens moving right guide rail 1072, the adjustable diopter left lens 1011 and the adjustable diopter right lens 1012 are connected through the fixed cross bar 10; the adjustable diopter left lens 1011 is connected to the adjustable lens moving left guide rail 1071 via the adjustable diopter left lens pressure control arm 1061, and the adjustable diopter right lens 1012 is connected to the adjustable lens moving right guide rail 1072 via the adjustable diopter right lens pressure control arm 1062.
[0072] Among them, the adjustable diopter left lens 1011 and the adjustable diopter right lens 1012 are symmetrically arranged through the fixed cross bar 10, corresponding to the left eye and right eye of the user respectively. The adjustable diopter left lens 1011 and the adjustable diopter right lens 1012 are also provided with a frame structure on the periphery. The frame structure is made of insulating material to avoid mutual interference during diopter adjustment. The diopter adjustment knob 105 includes a left eye diopter adjustment knob 1051 corresponding to the adjustable diopter left lens 1011 and a right eye diopter adjustment knob 1052 corresponding to the adjustable diopter right lens 1012. The left eye diopter adjustment knob 1051 is mounted on the left temple 11, and the right eye diopter adjustment knob 1052 is mounted on the right temple 12. The left eye diopter adjustment knob 1051 and the right eye diopter adjustment knob 1052 are symmetrically designed. The shape of the diopter adjustment knob 105 can be circular, cylindrical, etc. The embodiment of the present invention can be selected according to actual design requirements, and the embodiment of the present invention does not make specific restrictions. The left eye diopter adjustment knob 1051 is used to adjust the diopter of the adjustable diopter left lens 1011, and the right eye diopter adjustment knob 1052 is used to adjust the diopter of the adjustable diopter right lens 1012. In order to protect the user and isolate the human body from the voltage, the surface of the adjustable diopter lens pressure control arm 106 has an insulating material layer to prevent the human body from direct contact with it. The adjustable diopter lens pressure control arm 106 can fix the adjustable diopter lens 101, and a voltage can be applied to the adjustable diopter lens 101 through the adjustable diopter lens pressure control arm 106 to adjust the diopter of the adjustable diopter lens 101. The adjustable diopter lens pressure control arm 106 includes an adjustable diopter left lens pressure control arm 1061 and an adjustable The diopter right lens pressure control arm 1062, the adjustable diopter left lens pressure control arm 1061 and the adjustable diopter right lens pressure control arm 1062 are symmetrically designed and insulated, the adjustable diopter left lens pressure control arm 1061 is connected to the adjustable diopter left lens 1011, the adjustable diopter right lens pressure control arm 1062 is connected to the adjustable diopter right lens 1012, and the adjustable diopter lens pressure control arm 106 drives the adjustable diopter left lens 1011, the fixed cross bar 10 and the adjustable diopter right lens 1012 to move at the same time. When the user is myopic, the adjustable diopter lens pressure control arm 106 fixes the adjustable diopter lens 101 in a Figure 4 When the user is not myopic, the adjustable diopter lens 101 is in the position shown in Figure 5 The position shown in FIG. 1 is perpendicular to the position of the adjustable diopter lens 101 in the myopia operation mode. When the non-myopia operation mode is switched to the myopia operation mode, Figure 5 The adjustable diopter lens pressure control arm 106 needs to be rotated 90° counterclockwise to rotate the adjustable diopter lens 101 to the position as shown in FIG. Figure 4The target position of the myopia operation mode is shown. Conversely, when switching from the myopia operation mode to the non-myopia operation mode, the adjustable diopter lens pressure control arm 106 needs to drive the adjustable diopter lens 101 to rotate 90 degrees clockwise.
[0073] Optional, Figure 7 A schematic diagram of the optical path of XR glasses in a non-myopic operating mode when the user is myopic provided by an embodiment of the present invention, Figure 8 A schematic diagram of the optical path of XR glasses in a myopia operation mode when the user is myopic is provided in an embodiment of the present invention, such as Figure 1 , Figure 7 and Figure 8 As shown, the XR glasses 100 also include a display unit 108 and a light adjustment unit 109. The display unit 108 is used to display preset image information and emit image light; the light adjustment unit 109 includes a wave plate polarizer and curved mirror integrated body 1091, a polarization beam splitter lens 1092 and a magnifying zoom lens 1093; the magnifying zoom lens 1093 receives the image light and performs magnification and zoom processing to form a magnified zoom image light, the polarization beam splitter lens 1092 receives the magnified zoom image light and reflects it to generate a first reflected image light, the wave plate polarizer and curved mirror integrated body 1091 receives the first reflected image light and reflects it to generate a second reflected image light, the polarization beam splitter lens 1092 receives the second reflected image light again and transmits it to generate a transmitted image light, and the transmitted image light is incident on the user's eyes, or the transmitted image light is incident on the user's eyes after passing through the adjustable diopter lens 101.
[0074] Among them, the XR glasses 100 are also provided with a display unit 108 and a light adjustment unit 109. The display unit 108 is used to display preset image information and emit image light; the display unit 108 may include a left display unit 1081 corresponding to the left eye and a right display unit 1082 corresponding to the right eye. The display unit 108 is connected to the microprocessing unit 104, and can display the preset image information output by the video source connected to the XR glasses 100, and can also display the real-time environmental image information collected by the front environmental monitoring unit 110, and the display unit 108 emits image light to the light adjustment unit 109, so as to facilitate imaging to the user's eyes. The light adjustment unit 109 includes a wave plate polarizer and curved mirror integrated body 1091, a polarization beam splitter lens 1092 and a magnifying zoom lens 1093; the magnifying zoom lens 1093 receives the image light and performs magnification and zoom processing to form a magnified zoom image light, so that the user's glasses finally observe a larger image; the wave plate polarizer and curved mirror integrated body 1091 includes at least a first quarter wave plate, a curved mirror, a second quarter wave plate, a polarizer and a protective shell, the first quarter wave plate and the second quarter wave plate are used for conversion between linear polarized light and circular polarized light, the curved mirror is a concave mirror with 60% light transmittance and 40% reflectivity, the polarizer is used to isolate most of the external light from entering the interior of the XR glasses 100, and the transparent outer protective shell is used to protect the first quarter wave plate, the curved mirror, the second quarter wave plate and the polarizer, while not affecting the user's eyes from observing the outside world through the wave plate polarizer and curved mirror integrated body 1091. The completed optical path of the image light emitted by the display unit 108 and incident on the human eye is as follows: the image light first passes through the magnifying zoom lens 1093 to magnify and zoom the image light, and then enters the polarization beam splitter lens 1092, and is reflected to generate a first reflected image light to the wave plate polarizer and curved mirror integrated body 1091, and the phase of the first quarter wave plate and the second quarter wave plate in the wave plate polarizer and curved mirror integrated body 1091 is rotated 90 degrees, 60% of the light passing through the curved mirror is transmitted, and 40% is reflected, and the second reflected image light is generated after the phase is rotated 90 degrees, and starts to propagate in the direction opposite to the propagation direction of the first reflected image light. At this time, the second reflected image light The image light is incident on the polarization beam splitter lens 1092 again for transmission, generating a transmitted image light. When the user is not myopic, the transmitted image light is incident on the user's eye. Alternatively, when the user is myopic, the electro-optical effect causes the refractive index of the adjustable diopter left lens 1011 to change, and the exit angle of the transmitted image light changes relative to the exit angle without the adjustable diopter lens 101. Ultimately, the preset image information displayed on the display unit 108 enters the user's eye lens and completely falls on the retinal area of the human eye. The diopter of the adjustable diopter left lens 1011 and the adjustable diopter right lens 1012 can be adjusted in a range of 150° to 650°.The XR glasses 100 also include a lower left shell 21 of the XR glasses and a lower right shell 22 of the XR glasses, which may be made of plastic and play a role in protecting and partially supporting the XR glasses.
[0075] Optional, continue to refer to Figure 1 The XR glasses 100 also include a front environment monitoring unit 110, which is connected to the display unit 108 and the microprocessing unit 104 respectively; the front environment monitoring unit 110 is used to collect real-time environment image information; the display unit 108 is also used to display real-time environment image information.
[0076] Among them, when the XR glasses 100 are used to realize the function of AR glasses, the user can see the real world in front of the eyes through the XR glasses 100. Usually, when the user wears the XR glasses 100 and needs to see the real world in front, all the lenses in front of the eyes will become transparent or translucent, or the front environment monitoring unit 110 is used to collect real-time environmental image information, and the display unit 108 is used to display it, so that the user can see the real-time video image of the real world. The XR glasses 100 are usually also provided with a switch button, which can arbitrarily switch the display or non-display of the real-time environmental image information collected by the front environment monitoring unit 110, so as to realize the XR glasses 100 to realize the AR glasses function or VR glasses function.
[0077] Optional, continue to refer to Figure 1 The XR glasses 100 also include a power start button 111, which includes a first gear, a second gear and a third gear; the first gear is used to control the XR glasses 100 to be in a power-on state; the first gear includes a first sub-gear and a second sub-gear, the first sub-gear is used to start a first preset time to enter a non-myopia operation mode, and the second sub-gear is used to start a second preset time to enter a myopia operation mode, the first preset time is greater than the second preset time; the second gear is used to control the XR glasses 100 to be in a sleep mode; the third gear is used to control the XR glasses 100 to be in a shutdown mode.
[0078] Among them, the XR glasses 100 also include a power start button 111, which can power all mechanical structures and functional units in the XR glasses 100. The power start button 111 includes multiple gears, which may include a first gear, a second gear and a third gear. The first gear is used to control the XR glasses 100 to be in a power-on state. The first gear includes a first sub-gear and a second sub-gear. The first sub-gear is used to start the first preset time to enter the non-myopic operation mode, that is, to start by long pressing the power start button 111. After powering on, the default formal mode is the non-myopic operation mode; the second sub-gear is used to start the second preset time to enter the myopia operation mode. The first sub-gear position and the second sub-gear position can be switched by a third preset time, and the third preset time is greater than the second preset time; the second gear position is used to control the XR glasses 100 to be in sleep mode, that is, the power start button 111 can be pressed twice in succession to put the XR glasses 100 in sleep mode; the third gear position is used to control the XR glasses 100 to be in shutdown mode, that is, no matter whether the XR glasses 100 are in non-myopic operation mode or myopia operation mode, the power start button 111 can be long pressed to shut down and put the XR glasses 100 in shutdown mode.
[0079] Fig. 9 A flow chart of a control method for XR glasses provided in an embodiment of the present invention is provided. This embodiment is applicable to the control of XR glasses, such as Fig. 9 As shown, the control method of XR glasses includes:
[0080] S101, start the power start button.
[0081] Among them, press the power start button, turn on the power to start the XR glasses, and after turning on, the microprocessor unit in the XR glasses initializes the device. If the user is not myopic, he can wear the XR glasses directly. If the user is myopic, he needs to take off the glasses and then wear the XR glasses.
[0082] S102, obtaining the user's eye iris image information collected by the iris information collection unit.
[0083] Among them, after the user wears the XR glasses, the iris information collection unit collects the iris image information of the user's left and right eyes, and the microprocessing unit receives the iris image information.
[0084] S103, obtaining user identification information according to the iris image information.
[0085] The microprocessing unit receives the eye iris image information and processes the eye iris image information to obtain user identification information.
[0086] S104, obtaining diopter information according to the user identification information.
[0087] Among them, the deep learning processing unit in the microprocessor unit obtains the user's refractive information based on the user identification information combined with the principle of eccentric photography. The principle of eccentric photography is a method of using the pupil image obtained by photography to determine the refractive state of the user's pupil. The light reflected by the retina is photographed to show different light and shadow in the pupil area due to different refractive states, thereby detecting the user's refractive state. The specific calculation process of the refractive information includes using an image acquisition system and a light source module to realize eccentric photography of the human eye pupil. The light source module uses a near-infrared LED light source composed of an eccentric light source LED array, which can emit light at multiple angles to assist in obtaining eccentric, multi-angle, multi-frame eye iris images. The image angle obtained by photography depends on the arrangement of the eccentric light source LED array and the eccentric distance between the position of the eccentric light source LED array and the optical axis of the eye iris information acquisition unit. The eye iris images obtained under different eccentric distances react differently to the degree of refractive state. By controlling the lighting mode composed of different LED combinations in the eccentric light source LED array, an eccentric photographic image that can reflect different orientations and refractive degrees of the measured eye is obtained; secondly, the left and right pupil images and the relative position information of the left and right pupils in the image, that is, the pupil distance, are respectively extracted from the user's face, eyes and eye iris images obtained by eccentric photography. The collected left and right pupil images are marked as the first human eye iris image, as well as the human eye historical refractive information stored in the storage unit. The human eye historical refractive information includes the left eye historical refractive information Q1 and the right eye historical refractive information Q2. The initial values are all set to 0, where The historical refractive information of the human eye and the pupil distance are used as basic information data, and the left and right pupil images are used as image information data. The basic information data and the image information data are used together as input data and input into the pre-trained deep learning neural network model built into the deep learning processing unit. Then the deep learning processing unit processes the received basic information data and image information data through perception, convolution, synthesis, function construction and other calculation processing processes to obtain the user target left eye refractive information D1 and the user target right eye refractive information D2. At this time, the user target left eye refractive information D1 and the user target right eye refractive information D2 are also stored in the storage unit, and the stored user target left eye refractive information D1 and the user target right eye refractive information D2 are the first human eye iris image bound to the user, which is convenient for subsequent users to use the XR glasses again and can quickly extract user historical information.
[0088] S105, obtaining diopter adjustment information according to the diopter information, and adjusting the diopter of the adjustable diopter lens.
[0089] Among them, the refractive information output by the deep learning processing unit is received by the microcontroller processing unit, and the refractive adjustment information is output after logical judgment and calculation by the microcontroller processing unit, and then the refractive adjustment information is applied to the diopter adjustment unit, thereby modulating the electro-optical effect of the lens. The electro-optical effect refers to the effect that the refractive index of the crystal changes under the action of the electric field, where the refractive index is equal to the square root of the dielectric constant of the crystal. The specific calculation process is as follows, assuming that the refractive index of the diopter adjustment unit is n0 when no electric field is applied, and the refractive index of the material after the voltage is applied causes the refractive index to change is n, and the relationship between the refractive index and the electric field can be expressed as: ; where E is the electric field strength when the electric field is applied, and a and b are constants corresponding to the refractive index when the light is incident along the main axis of the crystal. Because the primary electro-optic effect aE is stronger than the secondary electro-optic effect bE 2 The present invention selects the primary electro-optic effect, i.e., the linear electro-optic effect, as the principle of adjusting the diopter of the present invention, and the relationship between the refractive index and the electric field becomes: In anisotropic media, the refractive index in each direction is different, so the light propagation speed in each polarization state is also different. In anisotropic media, birefringence occurs. The refractive index ellipsoid is usually used to describe the relationship between the refractive index and the propagation direction and vibration direction of light. Fig.10 A schematic diagram of the relationship between a refractive index, a propagation direction of light, and a vibration direction provided in an embodiment of the present invention. Lithium niobate crystal is selected as the material of the adjustable diopter lens of the present invention, and the electro-optical effect of lithium niobate crystal is used as an example. Fig.10 As shown, the adjustable diopter left lens and the adjustable diopter right lens of the present invention use lithium niobate crystal as the electro-optical effect adjustment medium, and use the birefringence phenomenon and the refractive index ellipsoid to describe the relationship between the refractive index and the propagation direction and vibration direction of light, and set the electric field direction to be parallel to the Z axis, and the electric field intensity in the Z axis direction is E z , the electric field strength E of the X-axis and Y-axis x = E y =0, after applying an electric field to the crystal, the shape, size, orientation, etc. of the refractive index ellipsoid change, among which: ; In the formula , and is the principal refractive index in the X, Y and Z principal axis directions of the ellipsoid, and is also the refractive index along the propagation direction, is the electro-optic coefficient, which is a non-zero constant and is a third-order tensor A certain component of the X, Y and Z axes is basically unchanged, and the refractive index in the three axis directions has the same change. The corresponding refractive index difference is proportional to the electric field strength E. Assuming that the image light emitted by the display unit of the XR glasses propagates along the X axis, so that the light propagation direction is perpendicular to the crystal plane, an electric field perpendicular to the Z axis is applied at this time. Therefore, the change in the refractive index of the corresponding material can be achieved by applying the changed electric field on the adjustable diopter left lens and the adjustable diopter right lens. The adjustable diopter left lens and the adjustable diopter right lens made of crystal materials that meet similar conditions are used. However, according to the following refractive index formula, the relationship between the material refractive index and the refractive angle is calculated: The relationship between the material refractive index and the refractive angle is: ; n1 is the refractive index of the adjustable diopter lens material, n2 is the refractive index of air, θ is the incident angle, θ1 is the refraction angle after refraction of light, so the refraction angle θ1 satisfies: ; Among them, θ and n2 are fixed values, and the refraction angle θ1 will change according to the change of the refractive index n1 of the adjustable diopter lens. According to the linear change of the refractive index n1 of the adjustable diopter lens following the electric field or voltage intensity, θ1 will eventually change in a positive correlation with the electric field or voltage intensity. Then, according to the change of the electric field or voltage applied to the crystal, the change of the angle between the outgoing light and the incident light after the light passes through the adjustable diopter left lens and the adjustable diopter right lens can be adjusted, and finally the same function of the myopic glasses can be achieved, so that the image of the display unit is finally clearly presented in the retinal area of the human eyeball. The diopter of the adjustable diopter lens is automatically adjusted by the adjustable diopter lens pressure control arm. The diopter after the electro-optical effect is controlled is approximately equal to or equal to the diopter information calculated and obtained by the deep learning processing unit. The final adjusted diopter changes the light entering the user's eyes, so that the user can see a clear image. At the same time, the subtle diopter changes produced by adjusting the diopter adjustment knob can compensate for the poor user perception caused by the inaccurate diopter calculation of the automatic diopter adjustment.
[0090] The embodiment of the present invention starts a power start button; obtains eye iris image information of the user collected by an iris information collection unit; obtains user identification information based on the eye iris image information; obtains diopter information based on the user identification information; obtains diopter adjustment information based on the diopter information, and adjusts the diopter of an adjustable diopter lens, thereby automatically adjusting the diopter of the adjustable diopter lens in the XR glasses according to different users, thereby improving the user experience.
[0091] Optional, Fig.11 A flow chart of another method for controlling XR glasses provided by an embodiment of the present invention is shown as follows: Fig.11 As shown, the control method of XR glasses includes:
[0092] S201, start the power start button.
[0093] S202, obtaining the user's eye iris image information collected by the iris information collection unit.
[0094] S203, obtaining user identification information according to the iris image information.
[0095] S204, obtaining historical user information.
[0096] Among them, user history information may include historical users' iris images, XR glasses working mode selection records, historical users' refractive information, historical users' electric field or voltage adjustment information, etc.
[0097] S205, determine whether the user identification information is in the historical user information; if so, execute step S206; if not, execute step S207.
[0098] Among them, the user identification information of the current user can be compared with the historical user information to achieve identity recognition and determine whether the current user is a new user. If it is a historical user, information can be directly extracted. If it is a new user, it is necessary to further combine the user identification information for calculation to obtain the refractive power information.
[0099] S206: directly obtain first diopter information.
[0100] Among them, when the user identification information of the current user is located in the historical user information, it can be understood that the user is matched in the historically saved image library, and the system directly reads the user's historical refraction and the electric field or voltage intensity corresponding to the refraction, and there is no need to recalculate these values. At this time, the XR glasses will not issue any voice reminders, and the XR glasses automatically load the user's historical refraction record, that is, the first refraction information, and then when the user is myopic, the first refraction information is used to adjust the refraction of the adjustable refraction lens. Then directly extract information to obtain the first refraction information of the current user. The first refraction information may include the user's historical refraction and the electric field or voltage intensity corresponding to the refraction. Then when the user is myopic, the first refraction information is used to adjust the refraction of the adjustable refraction lens.
[0101] S207: Acquire second diopter information according to the user identification information.
[0102] If the user is using it for the first time, the deep learning processing unit is used to calculate the user's second diopter information in combination with the user identification information, namely, the user's target left eye diopter information D1 and the user's target right eye diopter information D2, and the corresponding target electric field intensities are E land Er, and then bound with the eye iris image information collected by the iris information collection unit as a set of data, which is saved in the storage unit as the iris data of the current user, and can be called at any time by the myopic user's adaptive diopter adjustment.
[0103] S208, obtaining diopter adjustment information according to the first diopter information or the second diopter information, and adjusting the diopter of the adjustable diopter lens.
[0104] The embodiment of the present invention starts a power start button; obtains eye iris image information of the user collected by an iris information collection unit; obtains user identification information based on the eye iris image information; obtains historical user information; determines whether the user identification information is in the historical user information; and then directly obtains the first refractive power information, or obtains the second refractive power information based on the user identification information; obtains the refractive power adjustment information based on the first refractive power information or the second refractive power information, and adjusts the refractive power of the adjustable refractive power lens, thereby realizing automatic adjustment of the refractive power of the adjustable refractive power lens in the XR glasses according to different users, thereby improving the user experience.
[0105] Optional, Fig.12 A flow chart of another method for controlling XR glasses provided by an embodiment of the present invention is shown as follows: Fig.12 As shown, the control method of XR glasses includes:
[0106] S301, start the power start button.
[0107] S302, obtaining the user's eye iris image information collected by the iris information collection unit.
[0108] S303: Obtain user identification information according to the iris image information.
[0109] S304, obtaining historical user information.
[0110] S305, determine whether the user identification information is in the historical user information; if so, execute step S306; if not, execute step S310.
[0111] S306: directly obtain first diopter information.
[0112] S307, judging whether the user is myopic according to the first refractive power information, if so, executing step S308; if not, executing step S309.
[0113] S308, obtaining diopter adjustment information according to the first diopter information, rotating the adjustable diopter lens by using the adjustable diopter lens pressure control arm and the adjustable lens moving guide rail according to the diopter adjustment information, and adjusting the diopter of the adjustable diopter lens.
[0114] S309, use the XR glasses normally.
[0115] Among them, whether the user is myopic is determined based on the first refractive power information. When the user is myopic, the first refractive power information is used to obtain refractive power adjustment information, and the adjustable refractive power lens is rotated according to the refractive power adjustment information using the adjustable refractive power lens pressure control arm and the adjustable lens moving guide rail, and the refractive power of the adjustable refractive power lens is adjusted to adaptively complete the refractive power adjustment to meet the user's usage needs; when the user is not myopic, there is no need to use the adjustable refractive power lens, and the user can use the XR glasses normally.
[0116] S310: Acquire second diopter information according to user identification information.
[0117] S311, obtaining diopter adjustment information according to the second diopter information, and adjusting the diopter of the adjustable diopter lens.
[0118] The embodiment of the present invention starts a power start button; obtains eye iris image information of the user collected by an iris information collection unit; obtains user identification information based on the eye iris image information; obtains historical user information; when the user identification information is in the historical user information, directly obtains first refractive power information, determines whether the user is myopic based on the first refractive power information, obtains refractive power adjustment information based on the first refractive power information, rotates the adjustable refractive power lens using an adjustable refractive power lens pressure control arm and an adjustable lens moving guide rail based on the refractive power adjustment information, and adjusts the refractive power of the adjustable refractive power lens; or, uses the XR glasses normally to automatically adjust the refractive power of the adjustable refractive power lens in the XR glasses according to different users, thereby improving the user experience.
[0119] Optional, Fig.13 A flow chart of another method for controlling XR glasses provided by an embodiment of the present invention is shown as follows: Fig.13 As shown, the control method of XR glasses includes:
[0120] S401, start the power start button.
[0121] S402, obtaining the user's eye iris image information collected by the iris information collection unit.
[0122] S403, obtaining user identification information according to the iris image information.
[0123] S404, obtaining historical user information.
[0124] S405, determine whether the user identification information is in the historical user information; if so, execute step S406; if not, execute step S410.
[0125] S406: directly obtain first diopter information.
[0126] S407, judging whether the user is myopic according to the first refractive power information, if so, executing step S408; if not, executing step S409.
[0127] S408, obtaining diopter adjustment information according to the first diopter information, rotating the adjustable diopter lens by using the adjustable diopter lens pressure control arm and the adjustable lens moving guide rail according to the diopter adjustment information, and adjusting the diopter of the adjustable diopter lens.
[0128] S409, use the XR glasses normally.
[0129] S410: Acquire second diopter information according to user identification information.
[0130] S411, determine whether the user selects the myopia operation mode; if so, execute step S412; if not, execute step S413.
[0131] S412, obtaining diopter adjustment information according to the second diopter information, rotating the adjustable diopter lens by using the adjustable diopter lens pressure control arm and the adjustable lens moving guide rail according to the diopter adjustment information, and adjusting the diopter of the adjustable diopter lens.
[0132] S413, stop the rotation of the adjustable diopter lens, and use the XR glasses normally.
[0133] Among them, the XR glasses have a voice reminder function, which sends out a voice to remind the user whether to choose the myopia operation mode. If the user chooses the myopia operation mode, he only needs to press the power start button lightly. If the user chooses the non-myopia operation mode, the waiting time is executed. For example, the preset time can be 8 seconds, and no operation is required to enter the normal mode. When the user hears the voice prompt, one mode selection is that if the user does not make any action within the preset time, that is, the user chooses to make the XR glasses work in the non-myopia operation mode. At this time, from the user's perspective, there is no need to adjust the diopter, stop the rotation of the adjustable diopter lens, and thus skip the diopter adaptive adjustment and use the XR glasses directly; another mode selection is that if the user presses the power start button within the preset time for a second preset time, the myopia operation mode is successfully entered, and the adjustable diopter lens pressure control arm can drive the adjustable diopter left lens and the adjustable diopter right lens to move. When the adjustable diopter lens pressure control arm Before being moved, it is at the end of the adjustable lens moving guide rail away from the user's eye, and after moving, it stops at the end of the adjustable lens moving guide rail close to the user's eye; in the myopia operation mode, the adjustable diopter lens pressure control arm, the adjustable diopter left lens and the adjustable diopter right lens can be rotated 90° at a uniform speed in the counterclockwise direction to unfold, to ensure that the rotation and movement are carried out simultaneously or move first and then rotate, so as to avoid causing the adjustable diopter left lens and the adjustable diopter right lens to touch the XR glasses structure, so that the adjustable diopter left lens and the adjustable diopter right lens are rotated to the target position, at this point, the initialization work of the diopter adjustment unit is completed. After the initialization work is completed, in the myopia operation mode, it is necessary to complete the electro-optical modulation of the target diopter of the adjustable diopter left lens and the adjustable diopter right lens according to the diopter adjustment information, and obtain the user's target left eye diopter information D1 and the user's target right eye diopter information D2. The corresponding target electric field strengths are E respectively. l The microcontroller processing unit outputs the user's target left eye diopter information D1, the user's target right eye diopter information D2, and the corresponding target electric field strength E l And Er to the diopter adjustment unit, the electric field / voltage finally acts on the adjustable diopter left lens and the adjustable diopter right lens made of lithium niobate crystal material, the electric field direction is parallel to the Z axis, driving the adjustable diopter left lens and the adjustable diopter right lens to perform electro-optical modulation, so that the diopter of the adjustable diopter left lens and the adjustable diopter right lens achieves the target value change, so as to achieve the role of the adjustable diopter left lens and the adjustable diopter right lens being equivalent to replacing myopia glasses.
[0134] The embodiment of the present invention starts a power start button; obtains eye iris image information of the user collected by an iris information collection unit; obtains user identification information based on the eye iris image information; obtains historical user information; when the user identification information is not in the historical user information, obtains second diopter information based on the user identification information, determines whether the user selects the myopia operation mode, obtains diopter adjustment information based on the second diopter information, rotates the adjustable diopter lens using an adjustable diopter lens pressure control arm and an adjustable lens moving guide rail based on the diopter adjustment information, adjusts the diopter of the adjustable diopter lens, or stops the rotation of the adjustable diopter lens, and uses the XR glasses normally, thereby realizing automatic adjustment of the diopter of the adjustable diopter lens in the XR glasses according to different users, thereby improving the user experience.
[0135] Optional, Fig.14 A flow chart of another method for controlling XR glasses provided by an embodiment of the present invention is shown as follows: Fig.14 As shown, the control method of XR glasses includes:
[0136] S501, start the power start button.
[0137] S502: Acquire the user's eye iris image information collected by the iris information collection unit.
[0138] S503: Obtain user identification information according to the iris image information.
[0139] S504, obtaining historical user information.
[0140] S505, determine whether the user identification information is in the historical user information; if so, execute step S506; if not, execute step S510.
[0141] S506: directly obtain first diopter information.
[0142] S507, judging whether the user is myopic according to the first refractive power information, if so, executing step S508; if not, executing step S509.
[0143] S508, obtaining diopter adjustment information according to the first diopter information, rotating the adjustable diopter lens by using the adjustable diopter lens pressure control arm and the adjustable lens moving guide rail according to the diopter adjustment information, and adjusting the diopter of the adjustable diopter lens.
[0144] S509, use the XR glasses normally.
[0145] S510: Acquire second diopter information according to user identification information.
[0146] S511, determine whether the user selects the myopia operation mode; if so, execute step S512; if not, execute step S516.
[0147] S512, obtaining diopter adjustment information according to the second diopter information, rotating the adjustable diopter lens by using the adjustable diopter lens pressure control arm and the adjustable lens moving guide rail according to the diopter adjustment information, and adjusting the diopter of the adjustable diopter lens.
[0148] S513, determine whether the XR glasses display screen meets the preset display requirements; if so, execute step S514; if not, execute step S515.
[0149] S514, use the XR glasses normally.
[0150] S515, using the diopter adjustment knob to adjust the diopter of the adjustable diopter lens until the preset display requirement is met.
[0151] S516, stop the rotation of the adjustable diopter lens, and use the XR glasses normally.
[0152] Among them, after completing the automatic adjustment of the diopter of the XR glasses, it is also necessary to determine whether the current XR display screen meets the preset display requirements, that is, the user determines whether the image displayed by the display unit of the XR glasses seen by the user is clear enough. When the display screen of the display unit viewed by the user is clear, there is no need to adjust the diopter adjustment knob; when the display screen of the display unit viewed by the user is not clear enough, it is necessary to start the diopter adjustment knob to adjust the diopter. The display screen of the display unit is not clear enough, including the left eye picture is clear and the right eye picture is not clear, the right eye picture is clear and the left eye picture is not clear, and the left and right eye pictures are not clear. The diopter adjustment knob includes a left eye diopter adjustment knob and a right eye diopter adjustment knob. The left eye diopter adjustment knob and the right eye diopter adjustment knob can be adjusted accordingly according to the unclear situation of the left and right eye pictures. The maximum rotatable angle of the diopter adjustment knob is 360°, and the diopter fine-tuning range is fixed at no more than 60°, so the rotation angle step is fixed at 6°. The rotation change of the diopter adjustment knob can control the diopter adjustment, so that the electric field or voltage or electric field applied to the adjustable diopter left lens and the adjustable diopter right lens changes. If the interval between two adjustments of the diopter adjustment knob exceeds 5 seconds, it is considered that the action of adjusting the diopter by the diopter adjustment knob stops. The diopter adjustment unit can apply a changing electric field or voltage to the adjustable diopter left lens and the adjustable diopter right lens, and the refractive index of the material changes, and then the angle of the emitted light changes accordingly, so that myopic users can see clear images.
[0153] In addition, whether the user is myopic or not, whether the user is a first-time user or not, they will all enjoy a comfortable XR viewing experience due to the adaptive diopter control system of the XR glasses. When the user has finished experiencing the XR glasses and wants to exit the use state, if the user is a myopic user, he only needs to press the power start button again, and the adjustable diopter lens and the adjustable diopter lens pressure control arm can move toward the user's eye and rotate clockwise at the same time until they move to the end of the adjustable lens moving guide close to the user's eye, and then the adjustable diopter lens and the adjustable diopter lens pressure control arm have been rotated to a position parallel to the XR temple, and then the adjustable diopter lens and the adjustable diopter lens pressure control arm are moved as a whole along the adjustable lens moving guide in the direction away from the user's eye, and moved to the end of the adjustable lens moving guide away from the user's eye, to ensure that the edges of the adjustable diopter left lens and the adjustable diopter right lens moved to the end do not exceed the boundary of the protective shell of the wave plate polarizer and curved mirror integration of the XR glasses, such as Figure 5 and Figure 6 At this point, after the myopic user finishes using the XR glasses, its various structural components are returned to the default position, which is exactly the same as the position of the XR glasses when used by non-myopic users, and the default position of the XR glasses when not working, to ensure normal use by the next user.
[0154] The embodiment of the present invention starts a power start button; obtains eye iris image information of the user collected by an iris information collection unit; obtains user identification information based on the eye iris image information; obtains first refractive power information or second refractive power information based on the user identification information, and after adjusting the refractive power of the adjustable refractive power lens according to the first refractive power information or the second refractive power information, determines whether the XR glasses display screen meets the preset display requirements. If not, adjusts the refractive power of the adjustable refractive power lens using the refractive power adjustment knob accordingly until the preset display requirements are met. If satisfied, the XR glasses are used normally to achieve refractive power adjustment according to different users in the XR glasses, thereby improving the user experience.
[0155] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims
1. A pair of XR glasses, characterized in that: include: An XR glasses body and an adjustable diopter lens, a diopter adjustment unit, an iris information collection unit and a microprocessing unit integrated on the XR glasses body, wherein the microprocessing unit is electrically connected to the diopter adjustment unit and the iris information collection unit respectively; The diopter adjustment unit at least comprises a diopter adjustment knob, an adjustable diopter lens pressure control arm and an adjustable lens moving guide rail, wherein the diopter adjustment knob is connected to the adjustable diopter lens; the adjustable diopter lens pressure control arm is respectively connected to the adjustable diopter lens and the adjustable lens moving guide rail, and the adjustable diopter lens rotates according to the adjustable lens moving guide rail and the adjustable diopter lens pressure control arm; and the adjustable diopter lens pressure control arm and the adjustable diopter lens move toward a direction close to a user's eye or move away from a user's eye along the adjustable lens moving guide rail; The iris information collection unit is used to collect the user's eye iris image information; The microprocessing unit includes a microcontroller processing unit, a storage unit and a deep learning processing unit; the storage unit is used to store the eye iris image information and the historical user's diopter information; The deep learning processing unit is used to obtain user identification information and refractive information according to the eye iris image information and the refractive information of the historical user; The microcontroller processing unit is used to determine the diopter adjustment information according to the user identification information and the diopter information; The diopter adjustment knob or the adjustable diopter lens pressure control arm is used to adjust the diopter of the adjustable diopter lens according to the diopter adjustment information.
2. The XR glasses according to claim 1, characterized in that: The adjustable diopter lens comprises an adjustable diopter left lens and an adjustable diopter right lens, the diopter adjustment knob comprises a left eye diopter adjustment knob and a right eye diopter adjustment knob, the adjustable diopter lens pressure control arm comprises an adjustable diopter left lens pressure control arm and an adjustable diopter right lens pressure control arm, the adjustable lens moving guide rail comprises an adjustable lens moving left guide rail and an adjustable lens moving right guide rail, The adjustable diopter left lens and the adjustable diopter right lens are connected by a fixed cross bar; The adjustable diopter left lens is connected to the adjustable lens moving left guide rail via the adjustable diopter left lens pressure control arm, and the adjustable diopter right lens is connected to the adjustable lens moving right guide rail via the adjustable diopter right lens pressure control arm.
3. The XR glasses according to claim 1, characterized in that: The XR glasses also include a display unit and a light adjustment unit. The display unit is used to display preset image information and emit image light; The light adjustment unit includes a wave plate polarizer and curved mirror integration, a polarization beam splitter lens and a magnifying zoom lens; The magnifying zoom lens receives the image light and performs magnification and zoom processing to form a magnified zoom image light. The polarizing beam splitter lens receives the magnified zoom image light and reflects it to generate a first reflected image light. The wave plate polarizer and curved mirror integration body receives the first reflected image light and reflects it to generate a second reflected image light. The polarizing beam splitter lens receives the second reflected image light again and transmits it to generate a transmitted image light. The transmitted image light is incident on the user's eyes, or the transmitted image light is incident on the user's eyes after passing through the adjustable diopter lens.
4. The XR glasses according to claim 3, characterized in that: The XR glasses further include a front environment monitoring unit, which is connected to the display unit and the microprocessing unit respectively; The front environment monitoring unit is used to collect real-time environment image information; The display unit is also used to display the real-time environment image information.
5. The XR glasses according to claim 1, characterized in that: The XR glasses further include a power start button, wherein the power start button includes a first gear position, a second gear position, and a third gear position; The first gear is used to control the XR glasses to be in a power-on state; the first gear includes a first sub-gear and a second sub-gear, the first sub-gear is used to start a first preset time to enter a non-myopia operation mode, the second sub-gear is used to start a second preset time to enter a myopia operation mode, and the first preset time is greater than the second preset time; The second gear is used to control the XR glasses to be in sleep mode; The third gear is used to control the XR glasses to be in shutdown mode.
6. A method for controlling XR glasses, characterized in that: The XR glasses according to any one of claims 1 to 5, wherein the control method of the XR glasses comprises: Activate the power start button; Acquire the user's eye iris image information collected by the iris information collection unit; Acquiring user identification information according to the eye iris image information; Acquiring diopter information according to the user identification information; The diopter adjustment information is acquired according to the diopter information, and the diopter of the adjustable diopter lens is adjusted.
7. The control method of XR glasses according to claim 6, characterized in that: The refractive information includes first refractive information and second refractive information; Before obtaining the diopter information according to the user identification information, the method further includes: Get historical user information; Acquiring diopter information according to the user identification information includes: Determining whether the user identification information is included in the historical user information; If yes, directly obtain the first diopter information; If not, the second refractive power information is obtained according to the user identification information.
8. The method for controlling XR glasses according to claim 7, characterized in that: After directly obtaining the first diopter information, including: determining whether the user is myopic according to the first refractive power information; If yes, obtaining diopter adjustment information according to the first diopter information, rotating the adjustable diopter lens by using the adjustable diopter lens pressure control arm and the adjustable lens moving guide rail according to the diopter adjustment information, and adjusting the diopter of the adjustable diopter lens; If not, use the XR glasses normally.
9. The control method of XR glasses according to claim 7, characterized in that: After acquiring the second diopter information according to the user identification information, the method includes: Determine whether the user selects the myopia operation mode; If yes, obtaining diopter adjustment information according to the second diopter information, rotating the adjustable diopter lens by using the adjustable diopter lens pressure control arm and the adjustable lens moving guide rail according to the diopter adjustment information, and adjusting the diopter of the adjustable diopter lens; If not, stop the rotation of the adjustable diopter lens and use the XR glasses normally.
10. The control method of XR glasses according to claim 9, characterized in that: After obtaining diopter adjustment information according to the second diopter information, rotating the adjustable diopter lens by using the adjustable diopter lens pressure control arm and the adjustable lens moving guide rail according to the diopter adjustment information, and adjusting the diopter of the adjustable diopter lens, the method further includes: Determine whether the image displayed by the XR glasses meets the target clarity; If yes, use the XR glasses normally; If not, the diopter of the adjustable diopter lens is adjusted using a diopter adjustment knob until the target clarity is met.
Citation Information
Patent Citations
Head-mounted display device and diopter adaptive adjustment method
CN108513627A
Intelligent wearable glasses and control method thereof
CN116755252A
Method for suspending glasses and glasses structure
CN1713024A
Overturn-type bifocals primary-secondary rack
CN201569802U
Combined turnover primary-secondary spectacle frame and spectacles
CN209215766U
