Adjustment method and device of augmented reality glasses, terminal equipment and storage medium

Abstract

The invention relates to an adjustment method and device of augmented reality glasses, terminal equipment and a storage medium, the augmented reality glasses at least comprise a dimming assembly, a lens and a display assembly located in the lens, and in a wearing state, the dimming assembly is located on the side, away from human eyes, of the lens; the method comprises the following steps: determining a working mode of the augmented reality glasses; wherein the working mode at least comprises an augmented reality mode and a virtual reality mode; detecting ambient brightness; and adjusting the display brightness of the display assembly and / or the light transmittance of the dimming assembly according to the ambient brightness and the working mode. Eye health of a user can be protected, and user experience is improved.

Description

Technical Field

[0001] The present disclosure relates to the technical field of smart glasses, and in particular to an adjustment method, device, terminal equipment and storage medium for augmented reality glasses. Background Art

[0002] Augmented Reality (AR) technology is a technology that cleverly integrates virtual information with the real world. It widely uses multimedia, three-dimensional modeling, real-time tracking and registration, intelligent interaction, sensing and other technical means to simulate computer-generated text, images, three-dimensional models, music, video and other virtual information and apply them to the real world. The two types of information complement each other. By adding digital images and information to the user's real vision, the real world is enhanced, realizing the combination of the virtual world and reality. Summary of the invention

[0003] The present invention provides an adjustment method, an apparatus, a terminal device and a storage medium for augmented reality glasses.

[0004] According to a first aspect of an embodiment of the present disclosure, there is provided an adjustment method for augmented reality glasses, wherein the augmented reality glasses include at least a dimming component, a lens, and a display component located in the lens, wherein the dimming component is located on a side of the lens away from a human eye when worn; the method includes: determining an operating mode of the augmented reality glasses; wherein the operating modes include at least an augmented reality mode and a virtual reality mode; detecting ambient brightness; and adjusting the display brightness of the display component and / or the transmittance of the dimming component according to the ambient brightness and the operating mode.

[0005] In one embodiment, the working mode is the augmented reality mode; adjusting the brightness of the display component and / or the transmittance of the dimming component according to the ambient brightness and the working mode includes: when the ambient brightness decreases, reducing the display brightness of the display component; when the ambient brightness increases, increasing the display brightness of the display component; wherein the change in the display brightness is positively correlated with the change in the ambient brightness.

[0006] In one embodiment, the light transmittance is greater than a preset threshold.

[0007] In one embodiment, the working mode is the virtual reality mode; adjusting the brightness of the display component and / or the transmittance of the dimming component according to the ambient brightness and the working mode includes: increasing the transmittance when the ambient brightness decreases; reducing the transmittance when the ambient brightness increases; wherein the difference in ambient brightness irradiated to the human eye before and after the transmittance changes is within a preset range.

[0008] In one embodiment, the method further comprises: after increasing the light transmittance, if the difference is outside the preset range, reducing the display brightness.

[0009] In one embodiment, the method further comprises: after reducing the transmittance, if the difference is outside the preset range, increasing the display brightness.

[0010] In one embodiment, the dimming component includes: an electrochromic sheet or an electrochromic film.

[0011] In one embodiment, the detecting the ambient brightness includes: detecting the ambient brightness by an ambient light sensor in augmented reality glasses.

[0012] According to a second aspect of an embodiment of the present disclosure, there is provided an adjustment device for augmented reality glasses, wherein the augmented reality glasses include at least a dimming component, a lens, and a display component located in the lens, wherein the dimming component is located on a side of the lens away from a human eye when worn; the device includes: a determination module for determining an operating mode of the augmented reality glasses; wherein the operating modes include at least an augmented reality mode and a virtual reality mode; a detection module for detecting ambient brightness; and an adjustment module for adjusting the display brightness of the display component and / or the transmittance of the dimming component according to the ambient brightness and the operating mode.

[0013] According to a third aspect of the embodiments of the present disclosure, a terminal device is provided, including:

[0014] A processor and a memory for storing executable instructions that can be run on the processor, wherein: when the processor is used to run the executable instructions, the executable instructions execute the method described in any one of the above embodiments.

[0015] According to a fourth aspect of the embodiments of the present disclosure, a non-temporary computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by a processor, the method described in any of the above embodiments is implemented.

[0016] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0017] Augmented reality glasses can be used in two different application scenarios, and different working modes are used in different application scenarios. Augmented reality glasses can be used in augmented reality scenarios, i.e., augmented reality mode, and can also be used in virtual reality scenarios, i.e., virtual reality mode. After determining the working mode of the augmented reality glasses, the display brightness of the display component and / or the transmittance of the dimming component are adjusted in combination with the detected ambient brightness. By adjusting in this way, the user's eye health can be protected and the user experience can be improved.

[0018] For example, in augmented reality mode, since real objects need to be combined with virtual information displayed by the display component of the augmented reality glasses, the dimming component needs to have good light transmittance to facilitate users to see real-world information. After the ambient brightness changes, the display brightness of the display component is adaptively adjusted to reduce the damage to the user's eyes caused by the dark ambient brightness of the real world and the bright display brightness of the display component, or reduce the situation where the user cannot see the content displayed by the display component due to the bright ambient brightness of the real world and the dim display brightness of the display component.

[0019] In virtual reality mode, since augmented reality glasses can display virtual information through the display component to achieve an effect similar to screen projection, the content displayed by the display component is no longer related to the information in the real world. In the case where the dimming component has a certain transmittance, if the ambient brightness changes, it will also affect the content displayed by the display component, thereby affecting the user's viewing effect. By adjusting the display brightness and / or transmittance, the difference between the display brightness and the ambient brightness can be reduced, thereby reducing damage to the user's eyes and improving the user's experience.

[0020] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0022] Figure 1 is a schematic diagram of an adjustment method of augmented reality glasses according to an exemplary embodiment;

[0023] Figure 2 is a schematic diagram showing an adjustment method according to an exemplary embodiment;

[0024] Figure 3 is a schematic diagram showing another adjustment method according to an exemplary embodiment;

[0025] Figure 4is a schematic diagram showing another adjustment method according to an exemplary embodiment;

[0026] Figure 5 is a schematic diagram showing another adjustment method according to an exemplary embodiment;

[0027] Figure 6 is a schematic diagram of an adjustment device for augmented reality glasses according to an exemplary embodiment;

[0028] Figure 7 is a schematic diagram of AR glasses according to an exemplary embodiment;

[0029] Figure 8 is a schematic diagram showing the effect of an electrochromic lens on light according to an exemplary embodiment;

[0030] Fig. 9 The present invention is a block diagram of a terminal device according to an exemplary embodiment. DETAILED DESCRIPTION

[0031] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices consistent with some aspects of the present disclosure as detailed in the appended claims.

[0032] refer to Figure 1 , is a schematic diagram of an adjustment method for augmented reality glasses, which can be performed at least in augmented reality glasses (AR glasses), wherein the augmented reality glasses at least include a dimming component, a lens, and a display component located in the lens, and when worn, the dimming component is located on the side of the lens away from the human eye. The method includes:

[0033] S100: Determine a working mode of the augmented reality glasses; wherein the working modes include at least: an augmented reality mode and a virtual reality mode.

[0034] S200: Detects ambient brightness.

[0035] S300: adjusting the display brightness of the display component and / or the light transmittance of the dimming component according to the ambient brightness and the working mode.

[0036] Augmented reality glasses (AR glasses) have lenses, and the lenses have display components. The size and material of the lenses can be determined according to actual needs, and the display component can be a component with display function, including various display units, for example, display units based on silicon-based liquid crystal (LCOS), digital micromirror device (DMD), micro light emitting diode (Micro LED), laser beam scanning (LBS), etc.

[0037] The display component can be used to display information generated by the augmented reality glasses based on real objects, and can also display images and videos in associated devices.

[0038] The augmented reality glasses also have a dimming component, which is used to adjust the amount of light entering the lens, thereby adjusting the brightness of the light that will enter the human eye.

[0039] The dimming component can be any component having the above functions, including an electrochromic dimming component, which can be an electrochromic dimming sheet or electrochromic film that changes color based on the electrochromic principle. The electrochromic film and the electrochromic sheet can adjust the transmittance by adjusting the voltage, and the transmittance can be between 0 and 100%.

[0040] The augmented reality glasses can also detect the ambient brightness. The augmented reality glasses have a component for detecting the ambient brightness, such as an ambient light sensor, and the ambient brightness can be detected by the ambient light sensor in the augmented reality glasses. The ambient light sensor detects the ambient brightness, generates a detection signal, and sends the detection signal to the processor in the augmented reality glasses.

[0041] The augmented reality glasses may have controls, such as buttons, for adjusting the working mode. The augmented reality glasses may also have a processor, and the controls may be electrically connected to the processor, and the processor may determine the working mode based on the signal generated by the controls. For example, the controls generate a first signal, and the processor determines that the augmented reality glasses are in augmented reality mode based on the first signal; the controls generate a second signal, and the processor determines that the augmented reality glasses are in virtual reality mode based on the second signal.

[0042] Augmented reality glasses can be used in two different application scenarios, and different application scenarios use different working modes. The working modes may include augmented reality mode and virtual reality mode. In augmented reality mode, augmented reality glasses can generate information related to real objects based on real objects, and display this information at relevant locations through display components, thereby realizing the combination of virtual information and real objects.

[0043] In virtual reality mode, augmented reality glasses will not generate corresponding virtual information based on objects in reality, and the virtual information displayed by the display component has nothing to do with the real information. In virtual reality mode, augmented reality glasses can display the virtual information to be displayed through the display component, and the displayed information has no necessary association with the objects in the real scene, similar to the display effect of virtual reality glasses. For example, videos or pictures can be displayed through the display component, and the videos and pictures can be videos and pictures in the device associated with the augmented reality glasses, so as to achieve the effect of watching through the augmented reality glasses.

[0044] In augmented reality mode, since users need to obtain information in the real world through lenses, and in order to reduce the impact of dimming components on users' acquisition of information in the real world, there are certain requirements for the light transmittance of dimming components. For example, if the light transmittance is 100%, the dimming components will not block the light. When the ambient brightness changes, the display effect is adjusted by adjusting the brightness of the display component, so that the brightness of the content displayed by the display component matches the ambient brightness in the real world, making it easier for users to view the displayed content.

[0045] In the virtual reality mode, since the content displayed by the display component does not need to be combined with objects in the real world, the user's requirements for obtaining various information in the real world through the augmented reality glasses when using the augmented reality glasses are lower than the requirements for obtaining various information in the real world through the augmented reality glasses in the augmented reality mode. By adjusting the dimming component, the transmittance of the dimming component can be increased and decreased, so that the brightness of the ambient light irradiated to the lens and the human eye can be achieved, thereby improving the display effect. The display effect can also be further improved by combining the adjustment of the display component.

[0046] Since the dimming requirements for the display component and the dimming component are different in different working modes, after detecting the ambient brightness, the display component and / or the dimming component can be adjusted according to the working mode and the ambient brightness, so as to achieve a better adjustment effect, improve the display effect and reduce damage to the human eye.

[0047] After determining the working mode of the augmented reality glasses, the display brightness of the display component and / or the light transmittance of the dimming component are adjusted in combination with the detected ambient brightness. By adjusting in this way, the user's eye health can be protected and the user experience can be improved.

[0048] For example, in augmented reality mode, since real objects need to be combined with virtual information displayed by the display component in the augmented reality glasses, the dimming component needs to have good light transmittance to facilitate users to see information in the real world. After the ambient brightness changes, the display brightness of the display component can be adaptively adjusted to reduce the large brightness difference caused by the ambient brightness being darker after the ambient brightness of the real world decreases while the display brightness of the display component does not decrease, thereby reducing the occurrence of glare and reducing damage to the user's eyes. Alternatively, the large brightness difference caused by the ambient brightness being brighter after the ambient brightness of the real world becomes brighter while the display brightness of the display component does not decrease can be reduced, thereby reducing the situation where users cannot clearly see the virtual information displayed by the display component.

[0049] In virtual reality mode, since augmented reality glasses can display virtual information through the display component, the virtual information is no longer related to the information in reality, for example, it is no longer combined with the information in the real world, achieving an effect similar to screen projection. When the dimming component has a certain transmittance (for example, the transmittance is greater than 5%), the user can see the virtual information displayed by the display component, and can also see the information in the real world. If the ambient brightness changes, it will affect the display effect of the display component, thereby affecting the user's viewing effect. Therefore, by adjusting the display brightness and / or transmittance, the brightness difference between the display brightness and the ambient brightness can be reduced, and the occurrence of glare caused by the ambient brightness dropping below the display brightness can be reduced, reducing damage to the user's eyes and improving the user experience. It can also reduce the situation where the user cannot see the displayed information clearly due to the ambient brightness being higher than the display brightness, thereby improving the user experience.

[0050] In one embodiment, the working mode is an augmented reality mode.

[0051] refer to Figure 2 , which is a schematic diagram of an adjustment method, refer to Figure 3 , is a schematic diagram of another adjustment method, combined with Figure 2 and Figure 3 , S300, adjusting the brightness of the display component and / or the transmittance of the dimming component according to the ambient brightness and the working mode, including:

[0052] S301, when the ambient brightness decreases, reducing the display brightness of the display component.

[0053] S302: when the ambient brightness increases, increase the display brightness of the display component.

[0054] The change in display brightness is positively correlated with the change in ambient brightness.

[0055] In augmented reality mode, since users need to obtain real information about the real world, there is no need to adjust the light entering the human eye through the dimming component. The light transmittance of the dimming component is 100%, that is, the transparent state, which is equivalent to no dimming component blocking the ambient light. This can improve the consistency between the information seen by the human eye and the information in the real world, and reduce color difference and brightness difference.

[0056] When a change in ambient brightness is detected, if the ambient brightness decreases, the display brightness of the display component is reduced. In this way, the display brightness of the display component can be reduced as the ambient brightness decreases, thereby reducing the situation where the brightness of real-world objects seen by the user is inconsistent with the brightness of virtual information displayed by the display component when the ambient brightness is low and the display brightness is high. This reduces the situation where the brightness of virtual information displayed by the display component is too high and glare occurs, reduces damage to the user's eyes, and improves the user's experience.

[0057] Exemplarily, the amount of reduction in ambient brightness is positively correlated with the amount of reduction in display brightness.

[0058] Exemplarily, the amount of reduction in ambient brightness is the same as the amount of reduction in display brightness, so that the reduced ambient brightness can match the reduced display brightness, maintaining the brightness difference between the ambient brightness and the display brightness before the ambient brightness is reduced, reducing irritation and damage to the eyes, and improving the user experience.

[0059] Exemplarily, the changed ambient brightness is the same as the changed display brightness, thereby reducing the inconsistency between the brightness of real-world objects seen by the user and the brightness of virtual information displayed by the display component, thereby improving the user experience.

[0060] If the ambient brightness increases, the display brightness of the display component is increased, so that the display brightness of the display component increases with the increase of the ambient brightness, reducing the situation where the user cannot see the virtual information displayed by the display component clearly when the ambient brightness is high and the display brightness is low, thereby improving the user experience.

[0061] Exemplarily, the amount of reduction in ambient brightness is positively correlated with the amount of reduction in display brightness.

[0062] Exemplarily, the increase in ambient brightness is the same as the increase in display brightness, so that the increased ambient brightness can match the increased display brightness, maintaining the brightness difference between the ambient brightness and the display brightness before the ambient brightness increases, reducing irritation and damage to the eyes, and improving the user experience.

[0063] In one embodiment, in the augmented reality mode, the light transmittance of the dimming component is greater than a preset threshold value, which can be determined according to actual usage requirements, for example, 60%, 70%, 80% or 90%, etc. Preferably, the light transmittance is 100%.

[0064] In one embodiment, the working mode is a virtual reality mode. In the virtual reality mode, the dimming component has a preset light transmittance range, and light from the real world enters the human eye through the dimming component, so that the user can obtain information from the real world while obtaining virtual information. In the virtual reality mode, the light transmittance is greater than 0.

[0065] refer to Figure 4 , which is a schematic diagram of an adjustment method, refer to Figure 5 A schematic diagram of another adjustment method, combined with Figure 4 and Figure 5 , S300, adjusting the brightness of the display component and / or the transmittance of the dimming component according to the ambient brightness and the working mode, including:

[0066] S303: when the ambient brightness decreases, increase the light transmittance.

[0067] S304, when the ambient brightness increases, reducing the light transmittance, wherein the difference in ambient brightness irradiated to the human eye before and after the light transmittance changes is within a preset range.

[0068] In the virtual reality mode, the information displayed by the display component will be displayed in the display component in the form of a projection screen, and the dimming component adjusts the amount of light entering the lens in the real environment, thereby reducing the impact of the ambient light brightness on the display effect and improving the display effect.

[0069] In this case, if it is detected that the ambient brightness is reduced, the transmittance of the dimming component is increased. For example, in a first environment where the ambient brightness is a first brightness, a movie is watched in a virtual display mode through augmented reality glasses. At this time, the first brightness of the first environment and the brightness of the virtual information displayed by the display component are certain, for example, the brightness difference is within a preset range, and the transmittance of the dimming component is the first transmittance. If you move from the first environment to a second environment with a second brightness, and the second brightness is less than the first brightness, the ambient brightness is reduced. If the brightness of the virtual information displayed by the display component does not change at this time, the brightness of the virtual information displayed by the display component will be too bright, causing glare.

[0070] By increasing the transmittance of the dimming component, the amount of outdoor ambient light entering the lens is increased, and the first transmittance is increased to the second transmittance. The difference in the brightness of the ambient light entering the human eye at the first transmittance and the ambient light entering the human eye at the second transmittance is within a preset range, that is, the ambient brightness of the ambient light passing through the dimming component and entering the lens before and after adjustment is within a preset range. In this way, the brightness of the ambient light entering the human eye can be limited by adjusting the dimming component, that is, with the dimming component as the display background, the background brightness of the virtual information displayed by the display component is also limited. This reduces the impact of changes in ambient brightness on the display effect and improves the user experience.

[0071] Exemplarily, the difference in ambient brightness irradiating the human eye before and after the transmittance changes is 0, that is, the ambient brightness irradiating the human eye before and after the transmittance changes is the same, and the brightness of the ambient light entering the human eye at the first transmittance is the same as the brightness of the ambient light entering the human eye at the second transmittance. In this way, the display brightness can be maintained unchanged, and the background brightness where the display information is located remains unchanged.

[0072] If it is detected that the ambient brightness increases, the transmittance of the dimming component is reduced. For example, in a first environment where the ambient brightness is a first brightness, a movie is watched in a virtual display mode through augmented reality glasses. At this time, the first brightness of the first environment and the brightness of the virtual information displayed by the display component are certain, for example, the brightness difference is within a preset range, and the transmittance of the dimming component is the first transmittance. If you move from the first environment to a second environment with a second brightness, and the second brightness is greater than the first brightness, the ambient brightness increases. If the brightness of the virtual information displayed by the display component does not change at this time, the brightness of the virtual information displayed by the display component may be too low for the user to see.

[0073] By reducing the transmittance of the dimming component, the amount of light entering the lens from the outdoor ambient light is reduced, and the first transmittance is reduced to the second transmittance. The difference in the brightness of the ambient light entering the human eye at the first transmittance and the ambient light entering the human eye at the second transmittance is within a preset range, that is, the ambient brightness of the ambient light entering the lens through the dimming component before and after adjustment is within a preset range. In this way, the brightness of the ambient light entering the human eye can be limited by adjusting the dimming component, that is, with the dimming component as the display background, the background brightness of the virtual information displayed by the display component is also limited. This reduces the impact of changes in ambient brightness on the display effect and improves the user experience.

[0074] Exemplarily, the difference in ambient brightness irradiating the human eye before and after the transmittance changes is 0, that is, the ambient brightness irradiating the human eye before and after the transmittance changes is the same, and the brightness of the ambient light entering the human eye at the first transmittance is the same as the brightness of the ambient light entering the human eye at the second transmittance. In this way, the display brightness can be maintained unchanged, and the background brightness where the display information is located remains unchanged.

[0075] In one embodiment, the reduced transmittance is greater than 0, which makes it easier for users to obtain information in the real world through AR glasses.

[0076] In one embodiment, the method further comprises:

[0077] In S303, when the ambient brightness decreases, the transmittance is increased. If the difference in ambient brightness before and after the transmittance changes and the ambient brightness irradiated to the human eye is outside the preset range, the display brightness of the virtual information displayed by the display component is reduced, thereby adjusting the display effect by combining the adjustment of the transmittance and the display brightness.

[0078] If the decrease in ambient brightness is greater than the increase in light transmittance after increasing the transmittance, the ambient brightness will still be lower than the display brightness, and glare will also occur. By lowering the display brightness and making the brightness difference between the display brightness and the ambient brightness the same as the brightness difference between the display brightness and the ambient brightness before increasing the transmittance, glare can be reduced.

[0079] In one embodiment, the method further comprises:

[0080] S304, when the ambient brightness increases, reduce the light transmittance. If the difference in ambient brightness before and after the light transmittance changes and the brightness of the environment irradiated to the human eye is outside the preset range, the display brightness of the virtual information displayed by the display component is increased, thereby adjusting the display effect by combining the adjustment of the light transmittance and the display brightness.

[0081] If the increase in ambient brightness is greater than the decrease in light transmittance after reducing the transmittance, the ambient brightness will still be higher than the display brightness, and the virtual information on the display will not be clearly visible. By increasing the display brightness and making the brightness difference between the display brightness and the ambient brightness the same as the brightness difference between the display brightness and the ambient brightness before reducing the transmittance, the situation of virtual information on the display not being clearly visible can be reduced.

[0082] In one embodiment, reference Figure 6 , an adjustment device for augmented reality glasses, the augmented reality glasses at least comprising a dimming component, a lens and a display component located in the lens, the dimming component being located on a side of the lens away from the human eye when worn; the device comprising:

[0083] Determination module 1, used to determine the working mode of the augmented reality glasses; wherein the working mode at least includes: augmented reality mode and virtual reality mode;

[0084] Detection module 2, used to detect ambient brightness;

[0085] The adjustment module 3 is used to adjust the display brightness of the display component and / or the transmittance of the dimming component according to the ambient brightness and the working mode.

[0086] In one embodiment, the working mode is the augmented reality mode;

[0087] The adjustment module 3 includes:

[0088] A first reduction submodule, configured to reduce the display brightness of the display component when the ambient brightness is reduced;

[0089] A first increasing submodule, used for increasing the display brightness of the display component when the ambient brightness increases;

[0090] The change in display brightness is positively correlated with the change in ambient brightness.

[0091] In one embodiment, the light transmittance is greater than a preset threshold.

[0092] In one embodiment, the working mode is the virtual reality mode;

[0093] The adjustment module 3 includes:

[0094] A second increasing submodule, used for increasing the light transmittance when the ambient brightness decreases;

[0095] The second reduction submodule is used to reduce the transmittance when the ambient brightness increases; wherein the difference in ambient brightness irradiated to the human eye before and after the transmittance changes is within a preset range.

[0096] In one embodiment, the adjustment module 3 further includes:

[0097] The third reducing submodule is used to reduce the display brightness when the difference is outside the preset range after increasing the transmittance.

[0098] In one embodiment, the adjustment module 3 further includes:

[0099] The third increasing submodule is used to increase the display brightness when the difference is outside the preset range after reducing the transmittance.

[0100] In one embodiment, the dimming component includes: an electrochromic sheet or an electrochromic film.

[0101] In one embodiment, the detection module 2 is used to:

[0102] The ambient brightness is detected by an ambient light sensor in the augmented reality glasses.

[0103] In another embodiment, another embodiment is provided.

[0104] AR glasses are a technology that superimposes virtual information on the real world. It enhances the real world by adding digital images and information to the user's real field of view, achieving a combination of the virtual world and reality. AR glasses can provide information corresponding to real objects in the context of the real world, and have broad application prospects in education, medical care, design and other fields. In the future, with the continuous popularization of new technologies such as 5G and 6G and the continuous development of artificial intelligence technology, AR glasses will achieve more efficient network connections and smarter scene applications, providing users with smarter services.

[0105] The adjustment scheme in this embodiment can improve the experience of using AR glasses. For example, when the working mode of AR glasses is virtual display mode, when the user uses AR glasses for immersive experience, such as audio and video, screen projection scene. If the ambient brightness changes at this time, for example, the user's use location changes from bedroom to living room, or from indoor to outdoor environment, the external ambient light changes at this time, which will affect the user experience. This embodiment can improve the impact of environmental changes on user experience.

[0106] The details are as follows:

[0107] 1. A dimming component, such as an electrochromic lens, is installed at the front lens position of the glasses. The electrochromic lens is a lens made of a special material. The lens can be colored and faded by the pressurization time / direction. Different pressurization time and / or direction can achieve different lens transmittances. When the electrochromic lens is colored, the transparency of the electrochromic lens decreases, which is more suitable for an immersive experience similar to VR. When the lens fades, the transparency of the lens increases, which is more suitable for AR scene experience.

[0108] 2. If Figure 7 As shown in FIG. 1 , a schematic diagram of an AR glasses is shown. An ambient light sensor A is installed at the middle front end of the AR glasses to detect the brightness of the external environment in real time. Figure 7 shown.

[0109] 3. When using AR glasses, if the external ambient brightness becomes high, the display brightness of the display components in the glasses needs to be appropriately increased to maintain the user's comfortable experience. Conversely, if the ambient brightness becomes low, the display brightness of the display components in the glasses should be reduced to avoid glare caused by excessive brightness.

[0110] 4. By adjusting the light transmittance of the electrochromic lens, that is, the transmittance, the brightness of the ambient light after the ambient light passes through the electrochromic lens, that is, the brightness of the light in the environment entering the eye, can be reduced or increased, avoiding the impact of changes in ambient light on user use.

[0111] 5. Reference Figure 4When the working mode of AR glasses is augmented reality mode, users have high requirements for the external environment. At this time, the transmittance of the electrochromic lens is adjusted to the transparent mode. If the external ambient light becomes brighter at this time, the display brightness of the AR glasses display component is increased, including the screen brightness. If the external ambient light becomes darker at this time, the glasses screen brightness is reduced.

[0112] 6. When the AR glasses are in virtual reality mode, users need to block the interference of external ambient light as much as possible and keep the screen brightness unchanged to ensure the best user experience. At this time, the light transmittance of the electrochromic lens can be adjusted to effectively improve the brightness of the ambient light entering the eye, thereby reducing the impact of changes in ambient light brightness on user use.

[0113] refer to Figure 8 , is a schematic diagram of the effect of an electrochromic lens on light. The vertical bar in the middle is a schematic diagram of the cross-section of the electrochromic lens. The left side is sunlight and the right side is the human eye. After the light passes through the electrochromic lens with a certain transmittance, the amount of light transmitted changes, such as Figure 8 Assume that the lens transmittance is x and the ambient light intensity is a, then the actual light brightness b entering the eye is: b = a*x.

[0114] refer to Figure 6 , the method of automatically adjusting the light transmittance of the electrochromic lens includes:

[0115] When the working mode of the AR glasses is virtual reality mode, that is, the user is in a virtual reality scene, if the user scene changes or the ambient light brightness changes, causing the eye brightness to change, the transmittance of the electrochromic lens is adjusted while giving priority to keeping the screen brightness unchanged.

[0116] When the ambient light brightness becomes higher, it is necessary to reduce the eye brightness and the transmittance of the electrochromic lens. The electrochromic lens is in the tinting mode. If the difference in ambient brightness irradiated to the human eye before and after the transmittance change is outside the preset range, for example, when the transmittance of the electrochromic lens is reduced to the minimum and the expected eye brightness cannot be achieved, the display brightness of the display component is increased, that is, the screen brightness is increased.

[0117] When the ambient light becomes low, the eye brightness needs to be increased, the lens transmittance increases, and the lens is in faded mode. If the difference in ambient brightness irradiated to the human eye before and after the transmittance change is outside the preset range, for example, when the lens transmittance is increased to the transparent mode and the expected eye brightness cannot be achieved, the screen brightness is reduced.

[0118] The solution of this embodiment can detect the ambient brightness by adding an adjustable electrochromic lens and an ambient light sensor, and avoid the interference of the environment on the display effect of AR glasses by adjusting the transmittance of the electrochromic lens, thereby improving the user experience. By changing the transmittance of the electrochromic lens to replace the screen brightness adjustment, the power consumption data brought by the lens adjustment is lower than that of the traditional screen brightness adjustment. Increasing the transmittance of the electrochromic lens can effectively enhance the virtual reality experience compared to traditional AR glasses. The brightness adjustment function can improve the glare problem caused by switching between light and dark, and protect the user's eyesight.

[0119] This embodiment combines ambient light and electrochromic lenses. By detecting the ambient brightness and adjusting the transmittance of the electrochromic lenses, the brightness of the light entering the eye can be dynamically adjusted to ensure the consistency of the brightness entering the eye. At the same time, the electrochromic lenses with adjustable transmittance can effectively enhance the virtual reality experience of AR glasses. In scenes where brightness changes occur due to environment switching, the impact of external ambient light brightness on the human eye can be effectively improved, thereby improving the user experience.

[0120] It should be noted that the “first” and “second” in the embodiments of the present disclosure are only for the convenience of description and distinction and have no other specific meanings.

[0121] Fig. 9 1 is a block diagram of a terminal device according to an exemplary embodiment. For example, the terminal device may be smart glasses, including augmented reality glasses.

[0122] Reference Fig. 9 The terminal device may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output (I / O) interface 812 , a sensor component 814 , and a communication component 816 .

[0123] The processing component 802 generally controls the overall operation of the terminal device, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0124] The memory 804 is configured to store various types of data to support operations on the terminal device. Examples of such data include instructions for any application or method operating on the terminal device, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0125] The power component 806 provides power to various components of the terminal device. The power component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the terminal device.

[0126] The multimedia component 808 includes a screen that provides an output interface between the terminal device and the user, and the display component may include a screen, which may be located on the lens. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the terminal device is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0127] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the terminal device is in an operation mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0128] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, volume buttons, start buttons, and lock buttons.

[0129] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the terminal device. For example, the sensor assembly 814 can detect the open / closed state of the terminal device, the relative positioning of components, such as the display and keypad of the terminal device, and the sensor assembly 814 can also detect the position change of the terminal device or a component of the terminal device, the presence or absence of user contact with the terminal device, the orientation or acceleration / deceleration of the terminal device, and the temperature change of the terminal device. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0130] The communication component 816 is configured to facilitate wired or wireless communication between the terminal device and other devices. The terminal device can access a wireless network based on a communication standard, such as Wi-Fi, 4G or 5G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0131] In an exemplary embodiment, the terminal device may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above method.

[0132] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0133] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A method for adjusting augmented reality glasses, characterized in that: The augmented reality glasses at least include a dimming component, a lens, and a display component located in the lens, and the dimming component is located on a side of the lens away from the human eye when in a wearing state; the method includes: Determining the working mode of the augmented reality glasses; wherein the working mode includes at least: augmented reality mode and virtual reality mode; Detect ambient brightness; According to the ambient brightness and the working mode, the display brightness of the display component and / or the transmittance of the dimming component are adjusted.

2. The method according to claim 1, characterized in that: The working mode is the augmented reality mode; The adjusting the brightness of the display component and / or the transmittance of the dimming component according to the ambient brightness and the working mode includes: When the ambient brightness decreases, reducing the display brightness of the display component; When the ambient brightness increases, increasing the display brightness of the display component; The change in display brightness is positively correlated with the change in ambient brightness.

3. The method according to claim 2, characterized in that The light transmittance is greater than a preset threshold.

4. The method according to claim 1, characterized in that The working mode is the virtual reality mode; The adjusting the brightness of the display component and / or the transmittance of the dimming component according to the ambient brightness and the working mode includes: When the ambient brightness decreases, increasing the light transmittance; When the ambient brightness increases, the transmittance is reduced; wherein the difference in ambient brightness irradiated to the human eye before and after the transmittance change is within a preset range.

5. The method according to claim 4, characterized in that The method further comprises: After the light transmittance is increased, the difference is outside the preset range, and the display brightness is reduced.

6. The method according to claim 4, characterized in that The method further comprises: After reducing the transmittance, the difference is outside the preset range, and the display brightness is increased.

7. The method according to claim 1, characterized in that The dimming component includes: an electrochromic sheet or an electrochromic film.

8. The method according to claim 1, characterized in that The detecting of the ambient brightness comprises: The ambient brightness is detected by an ambient light sensor in the augmented reality glasses.

9. An adjustment device for augmented reality glasses, characterized in that: The augmented reality glasses at least include a dimming component, a lens, and a display component located in the lens, and the dimming component is located on a side of the lens away from the human eye when in a worn state; The device comprises: A determination module, used to determine the working mode of the augmented reality glasses; wherein the working mode at least includes: an augmented reality mode and a virtual reality mode; A detection module, used to detect ambient brightness; An adjustment module is used to adjust the display brightness of the display component and / or the transmittance of the dimming component according to the ambient brightness and the working mode.

10. A terminal device, characterized in that: include: A processor and a memory for storing executable instructions capable of running on the processor, wherein: When the processor is used to run the executable instructions, the executable instructions execute the method described in any one of claims 1 to 8.

11. A non-transitory computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, implement the method according to any one of claims 1 to 8.

Images