Glasses equipment, electrochromism control method and device thereof and storage medium

By integrating eye tracking cameras and ambient light sensors on the glasses equipment, identifying the user's eye adaptation situation and adjusting the light transmittance of the electrochromic lenses, the problem of inability to meet the user's comfort needs in the prior art is solved and the user experience is improved.

CN119065169APending Publication Date: 2024-12-03GOERTEK INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310644440.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-31
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

Electrochromic lenses on existing glasses devices cannot automatically adjust the light transmittance to meet the user's comfort needs, resulting in poor user experience.

Method used

By integrating eye tracking cameras and ambient light sensors on glasses devices, we can obtain eye characteristic images and ambient light illumination data, identify the user's eye adaptation, and automatically adjust the light transmittance of the electrochromic lens to adapt to strong, low light or Adaptable.

Benefits of technology

It realizes the automatic adjustment of the light transmittance of the electrochromic lens according to the user's eye adaptation, and improves the user's comfort and user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119065169A_ABST
    Figure CN119065169A_ABST
Patent Text Reader

Abstract

The invention discloses glasses equipment, an electrochromism control method and device thereof and a storage medium, and relates to the technical field of glasses equipment.The method comprises the steps that after the light transmittance of an electrochromism lens changes, an eyeball feature image collected by an eyeball tracking camera is obtained; according to the eyeball feature image, determining an eyeball adaptation condition of a wearer of the glasses equipment; according to the eyeball adaptation condition, the light transmittance of the electrochromic lens is controlled and adjusted; according to the eyeball feature image, the eyeball adaptation condition of the wearer of the glasses equipment is determined, and after the light transmittance of the electrochromic lens of the glasses equipment is changed, the adaptation condition of the user to the electrochromic lens after the light transmittance is changed can be detected; therefore, when a user does not adapt to the changed light transmittance of the electrochromic lens, the light transmittance of the electrochromic lens can be automatically and finely adjusted, so that the user can comfortably use the glasses equipment, and the user experience of the glasses equipment is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of eyewear devices, and in particular to an electrochromic control method and device for eyewear devices, the eyewear devices, and a computer-readable storage medium. Background Art

[0002] Electrochromic materials can achieve optical performance switching between different transmittances. Applying electrochromic materials to the lenses of eyewear devices (such as smart glasses) can adjust the intensity of external light entering the human eye through the lenses, giving users a more comfortable user experience.

[0003] Currently, while electrochromic lenses, used in eyewear, can adjust their transmittance based on ambient light intensity, this adjustment often fails to meet user needs, resulting in a poor user experience. Therefore, how to automatically adjust the transmittance of electrochromic lenses to a comfortable level for the user and enhance the user experience of eyewear is an urgent problem. Summary of the Invention

[0004] The purpose of the present invention is to provide an electrochromic control method and device for eyewear equipment, eyewear equipment, and computer-readable storage medium to automatically adjust the transmittance of electrochromic lenses to a state comfortable for the user, thereby improving the user experience of the eyewear equipment.

[0005] To solve the above technical problems, the present invention provides an electrochromic control method for eyewear equipment, comprising:

[0006] After the transmittance of the electrochromic lens changes, an eye feature image captured by an eye-tracking camera is obtained; wherein the electrochromic lens and the eye-tracking camera are provided on the eyewear device;

[0007] determining an eye adaptation condition of a wearer of the eyewear device according to the eye feature image;

[0008] The light transmittance of the electrochromic lens is controlled and adjusted according to the adaptation of the eyeball.

[0009] In some embodiments, determining the eye adaptation of the wearer of the eyewear device based on the eye feature image includes:

[0010] Identifying eye features of a wearer of the eyewear device based on the eye feature image; wherein the eye features include pupil size information, eye opening size information, and / or blink count information;

[0011] The eyeball adaptation condition is determined according to the eyeball characteristics.

[0012] In some embodiments, when the eye characteristics include pupil size information and eye opening size information, determining the eye adaptation status based on the eye characteristics includes:

[0013] If the pupil size information is within the pupil constriction range or the eye opening size information is within the squinting range, determining that the eyeball adaptation condition is a strong light maladaptation state;

[0014] If the pupil size information is within the pupil dilation range or the eye opening size information is within the eye widening range, determining that the eyeball adaptation condition is a low-light maladaptation state;

[0015] If the pupil size information is within the normal pupil range and the eye opening size information is within the normal eye opening range, it is determined that the eyeball adaptation condition is an adaptation state; wherein the eyeball adaptation condition includes the strong light maladaptation state, the weak light maladaptation state and the adaptation state.

[0016] In some embodiments, before acquiring the eye feature image captured by the eye tracking camera, the method further includes:

[0017] The transmittance of the electrochromic lens is controlled and adjusted according to the ambient light illumination data collected by the ambient light sensor; wherein the ambient light sensor is arranged on the eyeglass device.

[0018] In some embodiments, controlling and adjusting the transmittance of the electrochromic lens according to ambient light illumination data collected by an ambient light sensor includes:

[0019] Determining a light transmittance level range corresponding to the ambient light illumination data;

[0020] The transmittance level of the electrochromic lens is adjusted to a target transmittance level within the transmittance level range; wherein the target transmittance level is any transmittance level within the transmittance level range.

[0021] In some embodiments, when the eyeball adaptation condition includes a strong light maladaptation state, a weak light maladaptation state, and an adaptation state, controlling and adjusting the light transmittance of the electrochromic lens according to the eyeball adaptation condition includes:

[0022] If the eyeball adaptation condition is the strong light maladaptation state, then reducing the light transmittance of the electrochromic lens and executing the step of acquiring the eyeball feature image captured by the eye tracking camera;

[0023] If the eyeball adaptation condition is the low-light maladaptation state, then increasing the light transmittance of the electrochromic lens and executing the step of acquiring the eyeball feature image captured by the eye-tracking camera;

[0024] If the eyeball adaptation condition is the adaptation state, the light transmittance of the electrochromic lens is maintained.

[0025] In some embodiments, reducing the light transmittance of the electrochromic lens comprises:

[0026] adjusting the transmittance level of the electrochromic lens from a current level to a lowered level; wherein the lowered level is a transmittance level one level lower than the current level within a current transmittance level range, and the current transmittance level range is a transmittance level range corresponding to current ambient light illumination data collected by an ambient light sensor on the eyewear device;

[0027] Correspondingly, the method of increasing the light transmittance of the electrochromic lens includes:

[0028] The transmittance level of the electrochromic lens is adjusted from a current level to an upwardly adjusted level; wherein the upwardly adjusted level is a transmittance level one level higher than the current level within the current transmittance level range.

[0029] The present invention also provides an electrochromic control device for eyewear equipment, comprising:

[0030] an acquisition module, configured to acquire an eye feature image captured by an eye-tracking camera after the transmittance of the electrochromic lens changes; wherein the electrochromic lens and the eye-tracking camera are provided on the eyewear device;

[0031] a determination module, configured to determine an eye adaptation condition of a wearer of the eyewear device based on the eye feature image;

[0032] An adjustment module is used to control and adjust the light transmittance of the electrochromic lens according to the adaptation of the eyeball.

[0033] The present invention also provides a pair of glasses comprising:

[0034] memory for storing computer programs;

[0035] The processor is configured to implement the steps of the electrochromic control method for eyewear equipment as described above when executing the computer program.

[0036] In addition, the present invention also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the electrochromic control method for eyewear equipment as described above are implemented.

[0037] The present invention provides an electrochromic control method for eyewear, comprising: obtaining an eye feature image captured by an eye-tracking camera after the transmittance of an electrochromic lens changes; wherein the electrochromic lens and the eye-tracking camera are disposed on the eyewear; determining the eye adaptation of a wearer of the eyewear based on the eye feature image; and controlling and adjusting the transmittance of the electrochromic lens based on the eye adaptation;

[0038] As can be seen, the present invention determines the wearer's eye adaptation based on the eyeball feature image. This allows the wearer to detect the wearer's adaptation to the electrochromic lens after the transmittance of the lens changes. By controlling and adjusting the transmittance of the electrochromic lens based on the wearer's eye adaptation, the wearer can automatically fine-tune the transmittance of the electrochromic lens if the wearer is not adapting to the change in transmittance, allowing the wearer to use the eyewear comfortably and improving the user experience. Furthermore, the present invention provides an electrochromic control device for eyewear, the eyewear, and a computer-readable storage medium, all of which also have the aforementioned beneficial effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are merely embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0040] Figure 1 A flow chart of an electrochromic control method for eyewear equipment provided by an embodiment of the present invention;

[0041] Figure 2 A flow chart of another electrochromic control method for eyewear equipment provided by an embodiment of the present invention;

[0042] Figure 3 A system block diagram of an eyewear device provided by an embodiment of the present invention;

[0043] Figure 4 A structural block diagram of an electrochromic control device for eyewear equipment provided by an embodiment of the present invention;

[0044] Figure 5 This is a structural schematic diagram of an eyewear device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0045] To make the objectives, technical solutions, and advantages of the embodiments of the present invention more clear, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the present invention.

[0046] Please refer to Figure 1 , Figure 1 This is a flow chart of a method for controlling electrochromic change in eyewear provided by an embodiment of the present invention. The method may include:

[0047] Step 101: After the transmittance of the electrochromic lens changes, an eye feature image captured by an eye-tracking camera is obtained; wherein the electrochromic lens and the eye-tracking camera are set on the eyewear device.

[0048] It is understood that the electrochromic lens in this embodiment can be a spectacle lens using an electrochromic material. The eyewear device in this embodiment can be provided with an electrochromic lens, and the eyewear device can control and adjust the transmittance of the electrochromic lens to adjust the intensity of external light that passes through the electrochromic lens and enters the wearer's glasses, thereby providing the wearer (i.e., the user) with a comfortable wearing experience. In other words, the processor provided on the eyewear device in this embodiment can control and adjust the transmittance of the electrochromic lens. This embodiment does not limit the specific type of eyewear device; for example, the eyewear device can be smart glasses, such as AR (Augmented Reality) glasses, XR (Extended-Reality) glasses, and MR (Mixed Reality) glasses. Similarly, this embodiment does not limit the specific material type of the electrochromic lens; for example, the electrochromic lens can be made of solid electrochromic materials and / or liquid electrochromic materials.

[0049] Correspondingly, the eye-tracking camera in this embodiment can be a camera provided on the eyewear device for capturing characteristic images of the eyeballs of the wearer of the eyewear device. The specific camera type of the eye-tracking camera provided on the eyewear device in this embodiment can be determined by the designer based on practical scenarios and user needs. For example, the eye-tracking camera can be an infrared camera or other cameras. As long as the eye-tracking camera can use characteristic images of the user's eyeballs to perceive characteristics and changes in the user's eyes, such as pupil dilation, blinking frequency, and / or squinting, the embodiment does not impose any restrictions on this.

[0050] It should be noted that in this step, the processor can obtain the eye feature image captured by the eye tracking camera after the transmittance of the electrochromic lens changes, and use the eye feature image to detect the user's eye adaptation. Therefore, when the user is not adapted to the changed transmittance of the electrochromic lens, the processor can automatically fine-tune the transmittance of the electrochromic lens, so that the user can use the eyewear device comfortably, thereby improving the user experience of the eyewear device.

[0051] Correspondingly, in this embodiment, the step of detecting or controlling changes in the transmittance of the electrochromic lens may be included before this step. For example, the processor may control and adjust the transmittance of the electrochromic lens based on ambient light illumination data collected by the ambient light sensor. After the transmittance of the electrochromic lens changes, the process proceeds to step 101 to further fine-tune the transmittance of the electrochromic lens. The ambient light sensor is disposed on the eyewear device. The processor may also control and adjust the transmittance of the electrochromic lens based on a received transmittance adjustment instruction. After the transmittance of the electrochromic lens changes, the process proceeds to step 101 to further fine-tune the transmittance of the electrochromic lens. For example, a user may control the processor to generate a transmittance adjustment instruction using a button or touch panel on the eyewear device to adjust the transmittance of the electrochromic lens. Alternatively, the user may send a transmittance adjustment instruction to the eyewear device via a terminal device (e.g., a smartphone) that is communicatively connected to the eyewear device to adjust the transmittance of the electrochromic lens.

[0052] Among them, the specific method for the above-mentioned processor to control and adjust the transmittance of the electrochromic lens based on the ambient light illumination data collected by the ambient light sensor can be set by the designer according to the practical scenario and user needs. For example, the processor can determine the transmittance level range corresponding to the ambient light illumination data; adjust the transmittance level of the electrochromic lens to the target transmittance level within the transmittance level range; wherein the target transmittance level is any transmittance level within the transmittance level range; that is, the processor can control the change of the transmittance of the electrochromic lens after the transmittance level range corresponding to the ambient light illumination data changes, otherwise only using the ambient light illumination data will not change the transmittance of the electrochromic lens. The processor can also determine the transmittance level corresponding to the ambient light illumination data; determine whether the difference between the transmittance level corresponding to the ambient light illumination data and the current transmittance level reaches a threshold; if so, adjust the transmittance level of the electrochromic lens to the transmittance level corresponding to the ambient light illumination data; that is, the processor can control the change of the transmittance of the electrochromic lens after the difference between the transmittance level corresponding to the ambient light illumination data and the current transmittance of the electrochromic lens (i.e., the current transmittance level) reaches a threshold, otherwise only the ambient light illumination data is used without changing the transmittance of the electrochromic lens.

[0053] Correspondingly, the specific manner in which the processor acquires the eye feature image captured by the eye-tracking camera after the transmittance of the electrochromic lens changes in this step can be configured by the designer. For example, the processor can acquire one or more eye feature images captured by the eye-tracking camera after the transmittance of the electrochromic lens changes; for example, the processor can acquire eye feature images captured by the eye-tracking camera within a preset time period after the transmittance of the electrochromic lens changes; or for example, the processor can acquire multiple eye feature images continuously or intermittently within a preset time period. This embodiment does not impose any limitations on this.

[0054] Step 102: Determine the eye adaptation of the wearer of the eyewear device based on the eye feature image.

[0055] It can be understood that in this step, the processor can detect the eye adaptation of the wearer of the eyewear device based on the eye feature image captured by the eye tracking camera, and then use the detected eye adaptation to further fine-tune the transmittance of the electrochromic lens. The transmittance state of the electrochromic lens can better meet user needs and enhance the user experience of the eyewear device.

[0056] Correspondingly, the eye adaptation condition in this embodiment can be the adaptation of the wearer's eyes to the changes in the electrochromic lens. The specific classification of the eye adaptation conditions in this embodiment can be set by the designer based on practical scenarios and user needs. For example, the eye adaptation condition can include an adaptation state and a non-adaptation state; the non-adaptation state can include a strong light non-adaptation state and / or a weak light non-adaptation state. For example, if the non-adaptation state includes a strong light non-adaptation state and a weak light non-adaptation state, the eye adaptation condition can include an adaptation state, a strong light non-adaptation state, and a weak light non-adaptation state.

[0057] It should be noted that the specific manner in which the processor determines the eye adaptation of the wearer of the eyewear device based on the eye feature image in this step can be set by the designer based on practical scenarios and user needs. For example, the processor can directly determine the eye adaptation of the wearer of the eyewear device based on the eye feature image. For example, the processor can determine that the wearer's eye adaptation is a strong light maladaptation state upon detecting the eye feature image of the wearer squinting. The processor can also identify the wearer's eye features based on the eye feature image and determine the eye adaptation based on the eye features. The eye features include pupil size information, eye opening size information, and / or blink count information. This embodiment does not impose any limitations on this.

[0058] Correspondingly, the specific manner in which the processor determines the eye adaptation state based on eye characteristics can be set by the designer. For example, the eye adaptation state can include an adaptation state, a strong light maladaptation state, and a weak light maladaptation state. If the eye characteristics include pupil size information, the processor can determine that the eye adaptation state is a strong light maladaptation state when the pupil size information is within the pupil constriction range; determine that the eye adaptation state is a weak light maladaptation state when the pupil size information is within the pupil dilation range; and determine that the eye adaptation state is an adaptation state when the pupil size information is within the normal pupil range. Eye adaptation states can include an adaptation state, a strong light maladaptation state, and a weak light maladaptation state. If the eye characteristics include eye size information, the processor can determine that the eye adaptation state is a strong light maladaptation state when the eye size information is within the squinting range; determine that the eye adaptation state is a weak light maladaptation state when the eye size information is within the wide-open range; and determine that the eye adaptation state is an adaptation state when the eye size information is within the normal open range. The eye adaptation status may include an adaptation state and a strong light maladaptation state. When the eye characteristics include blink count information, the processor may determine that the eye adaptation status is a strong light maladaptation state when the blink count information is greater than a threshold value; and determine that the eye adaptation status is an adaptation state when the blink count information is not greater than a threshold value.

[0059] Accordingly, the eye adaptation status may include an adaptation state, a strong light maladaptation state, and a weak light maladaptation state. When the eye characteristics include pupil size information and eye opening size information, if the pupil size information is within the pupil constriction range or the eye opening size information is within the squinting range, then the eye adaptation status is determined to be a strong light maladaptation state; if the pupil size information is within the pupil dilation range or the eye opening size information is within the wide-eyed range, then the eye adaptation status is determined to be a weak light maladaptation state; if the pupil size information is within the normal pupil range and the eye opening size information is within the normal eye opening range, then the eye adaptation status is determined to be an adaptation state.

[0060] Step 103: Control and adjust the light transmittance of the electrochromic lens according to the adaptation of the eyeball.

[0061] It is understandable that in this step, the processor can fine-tune the transmittance of the electrochromic lens based on the eye adaptation of the wearer of the eyewear device detected and identified, so that the transmittance state of the electrochromic lens can better meet user needs and improve user experience.

[0062] Correspondingly, the specific manner in which the processor controls and adjusts the transmittance of the electrochromic lens according to the eyeball adaptation in this step can be set by the designer according to practical scenarios and user needs. For example, the processor can control to reduce the transmittance of the electrochromic lens when the eyeball adaptation is in a strong light maladaptation state; control to increase the transmittance of the electrochromic lens when the eyeball adaptation is in a weak light maladaptation state; and maintain the transmittance of the electrochromic lens when the eyeball adaptation is in an adaptation state.

[0063] For example, when multiple transmittance level ranges are pre-set, if the current transmittance level of the electrochromic lens (i.e., the current level) is any level within the current transmittance level range, the processor can reduce the transmittance of the electrochromic lens by adjusting the transmittance level of the electrochromic lens from the current level to a downward adjustment level; wherein the downward adjustment level is a transmittance level one level lower than the current level within the current transmittance level range, and the current transmittance level range is a transmittance level range corresponding to the current ambient light illumination data collected by the ambient light sensor on the eyewear device. Correspondingly, the processor can increase the transmittance of the electrochromic lens by adjusting the transmittance level of the electrochromic lens from the current level to an upward adjustment level; wherein the upward adjustment level is a transmittance level one level higher than the current level within the current transmittance level range.

[0064] Correspondingly, when multiple transmittance levels are directly set, the processor can reduce the transmittance of the electrochromic lens by adjusting the transmittance level of the electrochromic lens from the current transmittance level of the electrochromic lens (i.e., the current level) to a downward adjustment level; and increase the transmittance of the electrochromic lens by adjusting the transmittance level of the electrochromic lens from the current level to an upward adjustment level; wherein the downward adjustment level and the upward adjustment level can be transmittance levels one level lower and one level higher than the current level, respectively.

[0065] Furthermore, in this embodiment, the processor in this step may also return to execute step 101 after controlling to reduce the transmittance of the electrochromic lens or controlling to increase the transmittance of the electrochromic lens, so as to continue to adjust the transmittance of the electrochromic lens until the wearer's eyeball adapts to the adapted state.

[0066] Furthermore, in this embodiment, the processor can, as shown above, default the downward adjustment level and the upward adjustment level to transmittance levels one level lower and one level higher than the current level; the processor can also determine the specific levels of the downward adjustment level lower than the current level and the upward adjustment level higher than the current level in real time based on the identified eye characteristics of the wearer of the eyewear device. For example, the higher the degree of squinting of the wearer, the greater the level difference between the downward adjustment level and the current level, so that the transmittance state of the electrochromic lens can better meet user needs and improve the adjustment rate of the transmittance of the electrochromic lens.

[0067] In this embodiment, the embodiment of the present invention determines the eye adaptation of the wearer of the eyeglass device based on the eyeball feature image, and can detect the user's adaptation to the electrochromic lens after the transmittance of the electrochromic lens of the eyeglass device changes after the transmittance changes; by controlling and adjusting the transmittance of the electrochromic lens according to the eyeball adaptation, the transmittance of the electrochromic lens can be automatically fine-tuned when the user is not adapted to the changed transmittance of the electrochromic lens, so that the user can use the eyeglass device comfortably, thereby improving the user experience of the eyeglass device.

[0068] Based on the above embodiment, the present invention also provides another electrochromic control method for eyewear equipment, so that the adjustment of the transmittance of the electrochromic lens can better meet the needs of users, so that users can use the eyewear equipment comfortably. Figure 2 , Figure 2 This is a flow chart of another electrochromic control method for eyewear provided by an embodiment of the present invention. The method may include:

[0069] Step 201: Acquire ambient light illumination data collected by an ambient light sensor; wherein the ambient light sensor is provided on the eyewear device.

[0070] It is understandable that the ambient light sensor in this embodiment can be an optical sensor provided on the eyewear device for collecting illumination data of the external ambient light (ie, ambient light illumination data), such as Figure 3 The optical sensor in the

[0071] Step 202: Determine the transmittance level range corresponding to the ambient light illumination data.

[0072] Among them, the transmittance level range in this embodiment can be a range of a set consisting of multiple pre-set transmittance levels with similar transmittances, that is, multiple transmittance level ranges are pre-set in this embodiment, and each transmittance level range can include multiple transmittance levels with similar transmittances.

[0073] Correspondingly, in this step, the processor can determine a transmittance level range corresponding to the current ambient light illumination data collected by the ambient light sensor. That is, based on the ambient light illumination ranges corresponding to the respective transmittance level ranges, the processor can determine the transmittance level range corresponding to the ambient light illumination range in which the current ambient light illumination data falls as the transmittance level range corresponding to the ambient light illumination data.

[0074] Step 203: Adjusting the transmittance level of the electrochromic lens to a target transmittance level within the transmittance level range; wherein the target transmittance level is any transmittance level within the transmittance level range.

[0075] It can be understood that in this step, the processor can adjust the transmittance level of the electrochromic lens to the target transmittance level within the transmittance level range when the transmittance level range corresponding to the current ambient light illumination data is different from the current transmittance level range; wherein, the current transmittance level range can be the transmittance level range in which the transmittance level of the current electrochromic lens is located.

[0076] Accordingly, before this step, the processor can determine whether the transmittance level range corresponding to the ambient light illumination data is the current transmittance level range; if not, it proceeds to step 203; if so, it can end this process or return to step 201 to maintain the current transmittance of the electrochromic lens. Figure 3 As shown, when the ambient light changes, the application processor of the eyewear device learns through the optical sensor that the ambient light illumination data changes from A to B, and then controls the electrochromic control component to gradually adjust the transmittance level of the electrochromic lens from level A in the original transmittance level range A to level B in the transmittance level range B.

[0077] The target transmittance level in this step may be a transmittance level within the transmittance level range corresponding to the ambient light illumination data. The specific selection of the target transmittance level may be set by the designer. For example, the target transmittance level may be a transmittance level in the middle of the transmittance level range. The target transmittance level may also be the last transmittance level used within the stored transmittance level range. This embodiment does not impose any limitation on this.

[0078] Step 204: Obtain an eye feature image captured by an eye-tracking camera; wherein the electrochromic lens and the eye-tracking camera are set on the eyewear device.

[0079] Among them, in this step, the processor can obtain the eye feature image captured by the eye tracking camera after the transmittance of the electrochromic lens changes, and use the eye feature image to identify the user's eye features, thereby detecting the user's eye adaptation, so as to automatically fine-tune the transmittance of the electrochromic lens when the user is not adapted to the changed transmittance of the electrochromic lens.

[0080] Step 205: Identify eye features of the wearer of the eyewear device based on the eye feature image; wherein the eye features include pupil size information, eye opening size information and / or blink count information.

[0081] It is understood that the eye features in this step may be the eye features of the wearer of the eyewear device. The specific content of the eye features can be set by the designer. For example, the eye features may include at least one of pupil size information, eye opening size information, and blink count information. This embodiment does not impose any restrictions as long as the processor can identify the user's eye features after the transmittance of the electrochromic lens changes based on the eye feature images captured by the eye tracking camera to identify the user's eye adaptation status.

[0082] Step 206: determining the eye adaptation of the wearer of the eyewear device according to the eyeball characteristics; wherein the eye adaptation includes a strong light maladaptation state, a weak light maladaptation state, and an adaptation state.

[0083] It should be noted that the specific manner in which the processor determines the eye adaptation state based on the eye characteristics in this step can be set by the designer. For example, if the eye characteristics include pupil size information, the processor may determine the eye adaptation state as a strong light maladaptation state when the pupil size information is within the pupil constriction range; determine the eye adaptation state as a weak light maladaptation state when the pupil size information is within the pupil dilation range; and determine the eye adaptation state as an adaptation state when the pupil size information is within the normal pupil range. If the eye characteristics include eye size information, the processor may determine the eye adaptation state as a strong light maladaptation state when the eye size information is within the squinting range; determine the eye adaptation state as a weak light maladaptation state when the eye size information is within the wide-open range; and determine the eye adaptation state as an adaptation state when the eye size information is within the normal open range.

[0084] Correspondingly, when the eyeball characteristics include pupil size information and eye opening size information, if the pupil size information is within the pupil constriction range or the eye opening size information is within the squinting range, the eyeball adaptation is determined to be a strong light maladaptation state; if the pupil size information is within the pupil dilation range or the eye opening size information is within the wide-eyes range, the eyeball adaptation is determined to be a low light maladaptation state; if the pupil size information is within the normal pupil range and the eye opening size information is within the normal wide-eyes range, the eyeball adaptation is determined to be an adaptation state.

[0085] For example, if Figure 3As shown, the eye tracking component of the eyewear device may include an eye tracking camera and a processing unit. The processing unit may use the eye feature image captured by the eye tracking camera to determine that the user's eye adaptation is a strong light maladaptation state when detecting eye features such as pupil constriction or squinting of the user, and report the strong light maladaptation state to the application processor; when detecting eye features such as pupil dilation or widening of the eyes, it may determine that the user's eye adaptation is a weak light maladaptation state, and report the weak light maladaptation state to the application processor; when detecting that the pupil size returns to a normal level and the eyes are open normally, it may determine that the user's eye adaptation is an adaptation state, and report the adaptation state to the application processor or end the current process.

[0086] Step 207 : If the eyeball adaptation condition is a strong light maladaptation state, the transmittance level of the electrochromic lens is adjusted from the current level to a lower level, and the process proceeds to step 204 .

[0087] Among them, the downward adjustment level is a transmittance level one level lower than the current level within the current transmittance level range, and the current transmittance level range is the transmittance level range corresponding to the current ambient light illumination data collected by the ambient light sensor on the eyewear device, such as the transmittance level range determined in step 202.

[0088] It is understood that the level adjusted downward in this step can be a transmittance level one level lower than the current transmittance level of the electrochromic lens (i.e., the current level) within the current transmittance level range; accordingly, when the current level is the lowest transmittance level within the current transmittance level range, the processor can directly terminate this process or return to step 201 to maintain the transmittance of the electrochromic lens. The level adjusted downward in this step can also be a transmittance level one level lower than the current level; accordingly, when the current level is the lowest transmittance level, the processor will directly terminate this process or return to step 201 to maintain the transmittance of the electrochromic lens.

[0089] For example, if Figure 3 As shown, upon receiving the strong light maladaptation status reported by the processing unit of the eye tracking component, the application processor of the eyewear device can further adjust the transmittance level of the electrochromic lens from the original level B to level B-1, level B-2, ..., until the processing unit detects that the user's eyes have adapted to the strong light.

[0090] Step 208 : If the eyeball adaptation condition is a weak light maladaptation state, the transmittance level of the electrochromic lens is adjusted from the current level to an upward level, and the process proceeds to step 204 .

[0091] The upward adjustment level is a transmittance level one level higher than the current level within the current transmittance level range. The upward adjustment level may also be a transmittance level one level higher than the current level. This embodiment does not impose any limitation on this.

[0092] For example, if Figure 3 As shown, upon receiving the low-light maladaptation status reported by the processing unit of the eye tracking component, the application processor of the eyewear device can continue to adjust the transmittance level of the electrochromic lens from the original level B to level B+1, level B+2, ..., until the processing unit detects that the user's eyes have adapted to the state of adaptation.

[0093] Step 209: If the eyeball adaptation condition is in the adaptation state, the transmittance of the electrochromic lens is maintained.

[0094] In this embodiment, when the wearer's eyes are in a strong light maladaptation state or a weak light maladaptation state, the embodiment of the present invention lowers or increases the transmittance level of the electrochromic lens accordingly until the wearer's eyes are in an adapted state. This enables the adjustment of the transmittance of the electrochromic lens to better meet user needs and further enhance the user experience.

[0095] Corresponding to the above method embodiment, an embodiment of the present invention further provides an electrochromic control device for eyeglasses. The electrochromic control device for eyeglasses described below and the electrochromic control method for eyeglasses described above can refer to each other.

[0096] Please refer to Figure 4 , Figure 4 This is a block diagram of the structure of an electrochromic control device for eyewear provided by an embodiment of the present invention. The electrochromic control device may include:

[0097] An acquisition module 10 is configured to acquire an eye feature image captured by an eye-tracking camera after the transmittance of the electrochromic lens changes; wherein the electrochromic lens and the eye-tracking camera are provided on the eyewear device;

[0098] a determination module 20 for determining an eye adaptation condition of a wearer of the eyewear device based on the eye feature image;

[0099] The adjustment module 30 is used to control and adjust the light transmittance of the electrochromic lens according to the adaptation of the eyeball.

[0100] In some embodiments, the determination module 20 may include:

[0101] A feature recognition submodule, configured to recognize eye features of the wearer of the eyewear device based on the eye feature image; wherein the eye features include pupil size information, eye opening size information, and / or blink count information;

[0102] The adaptation determination submodule is used to determine the eye adaptation status based on the eye characteristics.

[0103] In some embodiments, when the eyeball characteristics include pupil size information and eye opening size information, the adaptation determination submodule can be specifically used to determine that the eyeball adaptation situation is a strong light maladaptation state if the pupil size information is within the pupil constriction range or the eye opening size information is within the squinting range; if the pupil size information is within the pupil dilation range or the eye opening size information is within the wide-eyes range, then the eyeball adaptation situation is determined to be a low light maladaptation state; if the pupil size information is within the normal pupil range and the eye opening size information is within the normal eye opening range, then the eyeball adaptation situation is determined to be an adaptation state; wherein, the eyeball adaptation situations include a strong light maladaptation state, a low light maladaptation state and an adaptation state.

[0104] In some embodiments, the apparatus may further include:

[0105] The illumination adjustment module is used to control and adjust the transmittance of the electrochromic lens according to the ambient light illumination data collected by the ambient light sensor; wherein the ambient light sensor is set on the eyeglass device.

[0106] In some embodiments, the illumination adjustment module may include:

[0107] A range determination submodule is used to determine the light transmittance level range corresponding to the ambient light illumination data;

[0108] The illumination adjustment submodule is used to adjust the transmittance level of the electrochromic lens to a target transmittance level within the transmittance level range; wherein the target transmittance level is any transmittance level within the transmittance level range.

[0109] In some embodiments, when the eyeball adaptation conditions include a strong light maladaptation state, a weak light maladaptation state, and an adaptation state, the adjustment module 30 may include:

[0110] The reducing submodule is used to reduce the light transmittance of the electrochromic lens and send a start signal to the acquisition module 10 if the eyeball adaptation condition is a strong light maladaptation state;

[0111] The improving submodule is used to improve the light transmittance of the electrochromic lens if the eyeball adapts to the weak light and sends a start signal to the acquisition module 10;

[0112] The maintaining submodule is used to maintain the transmittance of the electrochromic lens if the eyeball adaptation condition is in the adaptation state.

[0113] In some embodiments, the reduction submodule may be specifically configured to adjust the transmittance level of the electrochromic lens from a current level to a lowered level; wherein the lowered level is a transmittance level one level lower than the current level within a current transmittance level range, and the current transmittance level range is a transmittance level range corresponding to current ambient light illumination data collected by an ambient light sensor on the eyewear device;

[0114] Correspondingly, the improving submodule can be specifically used to adjust the transmittance level of the electrochromic lens from the current level to an upward level; wherein the upward level is a transmittance level one level higher than the current level within the current transmittance level range.

[0115] In this embodiment, the embodiment of the present invention determines the eye adaptation of the wearer of the eyeglass device based on the eyeball feature image through the determination module 20, and can detect the user's adaptation to the electrochromic lens after the transmittance of the electrochromic lens of the eyeglass device changes after the transmittance changes; through the adjustment module 30, the transmittance of the electrochromic lens is controlled and adjusted according to the eyeball adaptation, and can automatically fine-tune the transmittance of the electrochromic lens when the user is not adapted to the changed transmittance of the electrochromic lens, so that the user can use the eyeglass device comfortably, thereby improving the user experience of the eyeglass device.

[0116] Corresponding to the above method embodiment, an embodiment of the present invention further provides a glasses device. The glasses device described below and the electrochromic control method of the glasses device described above can refer to each other.

[0117] Please refer to Figure 5 , Figure 5 This is a schematic diagram of the structure of a pair of glasses provided by an embodiment of the present invention. The pair of glasses may include:

[0118] Memory D1, for storing computer programs;

[0119] The processor D2 is configured to implement the steps of the electrochromic control method for the eyewear device provided in the above method embodiment when executing the computer program.

[0120] The eyewear device in this embodiment may further include an eye tracking camera. The eyewear device provided in this embodiment may specifically be smart glasses such as AR glasses, XR glasses, and MR glasses.

[0121] It is understandable that the processor D2 in the eyewear device in this embodiment can be a single processing device, such as an application processor; the processor D2 can also be a combination of multiple processing devices, such as Figure 3 The application processor in the NVIDIA GeForce GTX 1060 and the processing unit in the eye tracking component.

[0122] Corresponding to the above method embodiment, an embodiment of the present invention further provides a computer-readable storage medium. The computer-readable storage medium described below and the electrochromic control method of the eyewear device described above can refer to each other.

[0123] An embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the electrochromic control method for eyewear devices provided in the above method embodiment are implemented.

[0124] The computer-readable storage medium may be a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, which may store program codes.

[0125] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from the other embodiments. Reference can be made to the descriptions of the devices, eyewear devices, and computer-readable storage media disclosed in the embodiments for similarities and differences. Since these devices, eyewear devices, and computer-readable storage media, correspond to the methods disclosed in the embodiments, their descriptions are relatively brief. For relevant details, refer to the descriptions of the methods.

[0126] The above describes in detail the electrochromic control method, device, eyewear device, and computer-readable storage medium provided by the present invention. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is intended only to facilitate understanding of the method and core concepts of the present invention. It should be noted that those skilled in the art will be able to make various improvements and modifications to the present invention without departing from the principles of the present invention, and such improvements and modifications fall within the scope of protection of the claims.

Claims

1. An electrochromic control method for eyewear equipment, characterized in that: include: After the light transmittance of the electrochromic lens changes, an eye feature image collected by an eye tracking camera is obtained; wherein the electrochromic lens and the eye tracking camera are arranged on the eyewear device; determining the eye adaptation of the wearer of the eyewear device according to the eye feature image; The light transmittance of the electrochromic lens is controlled and adjusted according to the adaptation of the eyeball.

2. The electrochromic control method of eyewear equipment according to claim 1, characterized in that: The step of determining the eye adaptation of the wearer of the eyewear device according to the eye feature image includes: According to the eyeball feature image, identifying the eyeball features of the wearer of the eyewear device; wherein the eyeball features include pupil size information, eye opening size information and / or blink count information; The adaptation status of the eyeball is determined according to the eyeball characteristics.

3. The electrochromic control method of eyewear equipment according to claim 2, characterized in that: When the eyeball feature includes pupil size information and eye opening size information, determining the eyeball adaptation status according to the eyeball feature includes: If the pupil size information is within the pupil reduction range or the eye opening size information is within the squinting range, it is determined that the eyeball adaptation condition is a strong light maladaptation state; If the pupil size information is within the pupil dilation range or the eye opening size information is within the eye opening range, it is determined that the eyeball adaptation condition is a weak light maladaptation state; If the pupil size information is within the normal pupil range and the eye opening size information is within the normal eye opening range, the eyeball adaptation condition is determined to be an adaptation state; wherein the eyeball adaptation condition includes the strong light maladaptation state, the weak light maladaptation state and the adaptation state.

4. The electrochromic control method of eyewear equipment according to claim 1, characterized in that: Before acquiring the eye feature image collected by the eye tracking camera, the method further includes: The transmittance of the electrochromic lens is controlled and adjusted according to the ambient light illumination data collected by the ambient light sensor; wherein the ambient light sensor is arranged on the eyeglass device.

5. The electrochromic control method of eyewear equipment according to claim 4, characterized in that: The controlling and adjusting the light transmittance of the electrochromic lens according to the ambient light illumination data collected by the ambient light sensor comprises: Determine a light transmittance level range corresponding to the ambient light illumination data; The transmittance level of the electrochromic lens is adjusted to a target transmittance level within the transmittance level range; wherein the target transmittance level is any transmittance level within the transmittance level range.

6. The electrochromic control method of eyewear equipment according to any one of claims 1 to 5, characterized in that: When the eyeball adaptation state includes a strong light maladaptation state, a weak light maladaptation state, and an adaptation state, controlling and adjusting the light transmittance of the electrochromic lens according to the eyeball adaptation state includes: If the eyeball adaptation condition is the strong light maladaptation state, then reducing the light transmittance of the electrochromic lens, and executing the step of acquiring the eyeball feature image collected by the eyeball tracking camera; If the eyeball adaptation condition is the weak light maladaptation state, then the light transmittance of the electrochromic lens is increased, and the step of acquiring the eyeball feature image collected by the eyeball tracking camera is performed; If the eyeball adaptation condition is the adaptation state, the light transmittance of the electrochromic lens is maintained.

7. The electrochromic control method of eyewear equipment according to claim 6, characterized in that: The step of reducing the light transmittance of the electrochromic lens comprises: Adjusting the transmittance level of the electrochromic lens from the current level to a lower level; wherein the lower level is a transmittance level within the current transmittance level range that is one level lower than the current level, and the current transmittance level range is a transmittance level range corresponding to the current ambient light illumination data collected by the ambient light sensor on the eyewear device; Correspondingly, the method of improving the light transmittance of the electrochromic lens includes: The light transmittance level of the electrochromic lens is adjusted from a current level to an upwardly adjusted level; wherein the upwardly adjusted level is a light transmittance level one level higher than the current level within the current light transmittance level range.

8. An electrochromic control device for eyewear equipment, characterized in that: include: An acquisition module, used to acquire an eye feature image collected by an eye tracking camera after the transmittance of the electrochromic lens changes; wherein the electrochromic lens and the eye tracking camera are arranged on the eyewear device; A determination module, used for determining the eye adaptation of the wearer of the eyewear device according to the eye feature image; The adjustment module is used to control and adjust the light transmittance of the electrochromic lens according to the adaptation of the eyeball.

9. An eyewear device, characterized in that: include: Memory for storing computer programs; A processor, configured to implement the steps of the electrochromic control method for eyewear equipment according to any one of claims 1 to 7 when executing the computer program.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the electrochromic control method for eyewear equipment according to any one of claims 1 to 7 are implemented.