Photoinduction adjusting method and system for intelligent contact lenses

Abstract

The invention discloses a light induction adjusting method and system for intelligent contact lenses, and belongs to the technical field of intelligent contact lenses, and the method comprises the steps: firstly, obtaining an ambient light intensity value, an eye image and contact lens working information, determining an eye stimulation value and an eye light intensity value through a target detection model according to the eye image, and obtaining an eye stimulation value and an eye light intensity value; and fusing the ambient light intensity value to obtain a light variation value, associating the light variation value with the working information to obtain an adjustment parameter, substituting the adjustment parameter into a preset relation model to calculate an adjustment amount, and generating a control instruction to control the contact lens to work. The processing of the pupil in the eye image during the determination of the eye stimulation value comprises ellipse fitting, Euclidean distance calculation and the like, so as to obtain the target diameter and expansion and contraction data of the pupil. According to the invention, automatic, personalized and accurate light induction adjustment of the intelligent contact lens is realized, the visual experience of a user is improved, and an innovative thought and technical means are provided for optimization of the user.

Description

Technical Field

[0001] The present invention relates to the technical field of smart contact lenses, and more particularly to a light-sensing adjustment method and system for smart contact lenses. Background Art

[0002] With the development of modern society, people have higher and higher requirements for vision correction and visual experience. As a convenient vision correction tool, contact lenses are widely used in the correction of vision problems such as myopia, hyperopia, and astigmatism. However, traditional contact lenses have some limitations during use. Especially when facing different lighting environments, they cannot automatically adjust the light transmittance, bringing a lot of inconvenience to the wearers.

[0003] In daily life, people are in various lighting environments, such as indoor lighting, natural sunlight, cloudy days, and nights. When suddenly entering a strong light environment from a darker environment, such as walking from indoors to outdoor sunlight, the eyes will feel uncomfortable due to the sudden increase in light, showing phenomena such as glare, tearing, and squinting. Staying in such a strong light environment for a long time may also cause eye fatigue, dryness, and even cause certain damage to the eyes. On the contrary, when entering a darker environment from a strong light environment, the eyes need some time to adapt to the change of light, and the vision will be affected during this period, and it is easy to have the situation of not being able to see clearly.

[0004] At present, although there are some contact lenses with ultraviolet protection functions on the market, they can only block ultraviolet rays to a certain extent and cannot automatically adjust the light transmittance according to the change of environmental light intensity. In addition, although some photochromic glasses can automatically change color according to the change of light intensity, they are mainly applied to frame glasses, and the color change speed is slow, which cannot meet the needs of contact lens wearers for rapid and accurate adjustment of light transmittance.

[0005] Therefore, how to provide a light-sensing adjustment method and system for smart contact lenses that can automatically adjust the light transmittance according to the environmental light intensity is an urgent problem to be solved by those skilled in the art. Summary of the Invention

[0006] In view of this, the present invention provides a light-sensing adjustment method and system for smart contact lenses. By obtaining the ambient light intensity value, the eye image of the wearer, and the working information of the contact lenses, a control instruction is determined through a series of analysis and processing to achieve precise control of the operation of the smart contact lenses, so as to automatically adjust to adapt to different ambient light intensities and eye conditions and meet the visual needs of the wearer.

[0007] To achieve the above object, the present invention adopts the following technical solutions:

[0008] On the one hand, the present invention provides a light-sensing adjustment method for smart contact lenses, including:

[0009] Obtain the ambient light intensity value, the eye image of the wearer, and the working information of the contact lens respectively;

[0010] Determine the light change value according to the ambient light intensity value and the eye image;

[0011] Determine the control instruction based on the light change value and the working information;

[0012] Control the operation of the contact lens according to the control instruction.

[0013] Preferably, determining the light change value according to the ambient light intensity value and the eye image includes:

[0014] Determine the eye irritation value according to the eye image;

[0015] Determine the eye light intensity value based on the eye irritation value;

[0016] Fuse the ambient light intensity and the eye light intensity value to determine the light change value.

[0017] Preferably, determining the control instruction based on the light change value and the working information includes:

[0018] Associate the light change value and the working information to obtain an adjustment parameter;

[0019] Substitute the light change value into the relationship model between the preset light change value and the adjustment parameter to calculate the adjustment amount of the adjustment parameter;

[0020] Generate a control instruction according to the adjustment amount and the working information.

[0021] Preferably, determining the eye irritation value according to the eye image includes:

[0022] Input the eye image into the trained target detection model to obtain the center point and each boundary point of the pupil in the eye image;

[0023] For two adjacent eye images, determine the target diameter data of the pupil in the eye image according to the center point and each boundary point of the pupil in the eye image;

[0024] Determine the dilation and constriction data of the pupil according to the target diameter data;

[0025] Determine the eye irritation value according to the dilation and constriction data.

[0026] Preferably, for two adjacent eye images, determining the target diameter data of the pupil in the eye image according to the center point and each boundary point of the pupil in the eye image includes:

[0027] Perform elliptical fitting on each boundary point of the pupil in the eye image to obtain the boundary of the pupil in the eye image, and determine the first diameter data of the pupil in the eye image according to the boundary;

[0028] According to the center point and each boundary point of the pupil, calculate the Euclidean distance from the center point to each boundary point, and determine the second diameter data of the pupil in the eye image according to the average value of the Euclidean distances from the center point to each boundary point;

[0029] According to the first diameter data and the second diameter data, determine the target diameter data of the pupil in the eye image.

[0030] Preferably, generating a control instruction according to the adjustment amount and the working information includes:

[0031] Determine the working parameters of the contact lens based on the working information;

[0032] Determine to generate a control instruction based on the adjustment amount and the working parameters.

[0033] On the other hand, the present invention provides a light induction adjustment system for a smart contact lens, and the system is used to implement the above-mentioned light induction adjustment method for a smart contact lens, including:

[0034] A data acquisition module for acquiring the ambient light intensity value, the eye image of the wearer, and the working information of the contact lens;

[0035] A variable extraction module for determining the light change value according to the ambient light intensity value and the eye image;

[0036] An instruction generation module for determining a control instruction based on the light change value and the working information;

[0037] A control module for controlling the operation of the contact lens according to the control instruction.

[0038] It can be seen from the above technical solutions that, compared with the prior art, the present invention discloses a light induction adjustment method and system for a smart contact lens. By determining the eye stimulation value according to the eye image, further determining the eye light intensity value, and then fusing the ambient light intensity value to determine the light change value, it comprehensively considers the ambient light and the actual reaction of the eyes to light, can more accurately reflect the light change situation, and provides an accurate basis for the subsequent adjustment of the contact lens.

[0039] Eye image information is considered. By inputting the eye image into a trained object detection model, the center point, boundary points, diameter data, scaling data, etc. of the pupil are analyzed, and then the eye stimulation value is determined. Finally, the light change value is determined, making the adjustment process more personalized. Since the eyes of different people may be sensitive to light to different degrees, the invention can make corresponding adjustments according to the eye characteristics of the wearer, avoiding the discomfort or uneasiness that may be caused by the adjustment of a unified standard.

[0040] The first diameter data is obtained by performing an ellipse fitting on the pupil boundary points, and the second diameter data is determined according to the average Euclidean distance from the center point to the boundary points. Finally, the target diameter data is determined by combining the two. This multi-dimensional method for determining the target diameter data makes the obtained pupil diameter data more accurate and further improves the accuracy of determining the eye stimulation value.

[0041] The light change value is associated with the working information to obtain an adjustment parameter, and the change amount of the adjustment parameter is calculated by substituting it into a preset relationship model. Then, a control instruction is generated. Combining multiple factors and using a preset model to generate the control instruction makes the control instruction more reasonable and helps to achieve the precise adjustment of the smart contact lens. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only the embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained according to the provided drawings without creative efforts.

[0043] Figure 1 It is a schematic flowchart of the light induction adjustment method provided by the present invention;

[0044] Figure 2 It is a schematic structural diagram of the light induction adjustment system provided by the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0045] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts belong to the scope of protection of the present invention.

[0046] An embodiment of the present invention discloses a light induction adjustment method for a smart contact lens, as Figure 1 shown including:

[0047] Obtain the ambient light intensity value, the eye image of the wearer, and the working information of the contact lens respectively; measure the intensity of the ambient light through a light sensor integrated in the contact lens, with the unit of lux (lx); use a miniature camera or image sensor integrated on the contact lens to capture the eye image of the wearer, and the image data can reflect the physiological response and pupil state of the eyes under specific light conditions.

[0048] Determine the light change value based on the ambient light intensity value and the eye image; comprehensively consider the ambient light intensity value and the eye light intensity value, and adopt an intelligent fusion algorithm to effectively combine the two to more comprehensively reflect the actual lighting situation of the environment where the wearer is located and the adaptation state of the eyes to it. This fusion not only considers the direct influence of external light sources but also incorporates the eye's own adjustment mechanism, so as to more accurately determine the light change value.

[0049] Determine the control instruction based on the light change value and the working information;

[0050] Control the operation of the contact lens according to the control instruction.

[0051] Specifically, determining the light change value based on the ambient light intensity value and the eye image includes:

[0052] Determine the eye stimulation value according to the eye image;

[0053] Determine the eye light intensity value based on the eye stimulation value;

[0054] Fuse the ambient light intensity and the eye light intensity value to determine the light change value.

[0055] In another embodiment, determining the control instruction based on the light change value and the working information includes:

[0056] Associate the light change value with the working information to obtain an adjustment parameter;

[0057] Substitute the light change value into the relationship model between the preset light change value and the adjustment parameter to calculate the adjustment amount of the adjustment parameter;

[0058] Generate a control instruction according to the adjustment amount and the working information.

[0059] Specifically, determining the eye stimulation value according to the eye image includes:

[0060] Input the eye image into the trained target detection model to obtain the center point and each boundary point of the pupil in the eye image; among them, the target detection model can be an active shape model (ASM), a convolutional neural network (CNN), Hough circle transform, a recurrent neural network (RNN), a generative adversarial network (GAN), etc.

[0061] For two adjacent eye images, according to the center point and each boundary point of the pupil in the eye image, determine the target diameter data of the pupil in the eye image;

[0062] Determine the expansion and contraction data of the pupil according to the target diameter data;

[0063] Determine the eye stimulation value according to the expansion and contraction data.

[0064] In another embodiment, for two adjacent eye images, according to the center point and each boundary point of the pupil in the eye image, determining the target diameter data of the pupil in the eye image includes:

[0065] Perform ellipse fitting on each boundary point of the pupil in the eye image to obtain the boundary of the pupil in the eye image, and determine the first diameter data of the pupil in the eye image according to the boundary; The ellipse fitting uses the least squares method or other optimization algorithms to find the ellipse shape that best represents a set of points (here are the pupil boundary points). Through this step, an accurate description of the pupil boundary is obtained, and this boundary can reflect the actual shape of the pupil in the image. Subsequently, according to this fitted ellipse boundary, the first diameter data of the pupil is calculated.

[0066] According to the center point and each boundary point of the pupil, calculate the Euclidean distance from the center point to each boundary point, and determine the second diameter data of the pupil in the eye image according to the average value of the Euclidean distances from the center point to each boundary point; The Euclidean distance formula is where (x 1 , y 1 ) is the center point coordinate, and (x 2 , y 2 ) is the boundary point coordinate.

[0067] Determine the target diameter data of the pupil in the eye image according to the first diameter data and the second diameter data.

[0068] In another embodiment, generating a control instruction according to the adjustment amount and the working information includes:

[0069] Determine the working parameters of the contact lens based on the working information;

[0070] Determine to generate a control instruction based on the adjustment amount and the working parameters.

[0071] On the other hand, the present invention provides a light sensing adjustment system for an intelligent contact lens, and this system is used to implement the above-mentioned light sensing adjustment method for an intelligent contact lens, as Figure 2 shown, including:

[0072] A data acquisition module, used to obtain the ambient light intensity value, the eye image of the wearer, and the working information of the contact lens;

[0073] A variable extraction module, configured to determine a light change value according to an ambient light intensity value and an eye image;

[0074] An instruction generation module, configured to determine a control instruction based on the light change value and working information;

[0075] A control module, configured to control the contact lens to work according to the control instruction.

[0076] In the present specification, the various embodiments are described in a progressive manner. Each embodiment focuses on the differences from other embodiments. The same or similar parts among the various embodiments can be referred to each other. For the devices disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the description is relatively simple. For the relevant parts, reference can be made to the description in the method part.

[0077] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present invention. Various modifications to these embodiments will be obvious to those skilled in the art. The general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but will be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A light sensing adjustment method for smart contact lenses, characterized in that: include: respectively obtaining the ambient light intensity value, the eye image of the wearer and the working information of the contact lens; determining a light change magnitude according to the ambient light intensity magnitude and the eye image; Determine a control instruction based on the light change value and the working information; The contact lens is controlled to operate according to the control instruction.

2. The light sensing adjustment method of the smart contact lens according to claim 1, characterized in that: Determining a light change value according to the ambient light intensity value and the eye image includes: determining an eye stimulation value according to the eye image; determining an eye light intensity value based on the eye stimulation value; The ambient light intensity and the eye light intensity are combined to determine the light change value.

3. The light sensing adjustment method of the smart contact lens according to claim 1, characterized in that: Determining a control instruction based on the light variation value and the working information includes: Associating the light variation value with the working information to obtain an adjustment parameter; Substituting the light variation value into a preset relationship model between the light variation value and the adjustment parameter to calculate the adjustment amount of the adjustment parameter; A control instruction is generated according to the adjustment amount and the working information.

4. The light sensing adjustment method of the smart contact lens according to claim 2, characterized in that: Determining an eye stimulation value according to the eye image includes: Inputting the eye image into a trained object detection model to obtain the center point and boundary points of the pupil in the eye image; For two adjacent eye images, determining target diameter data of the pupil in the eye image according to the center point and each boundary point of the pupil in the eye image; Determining pupil expansion and contraction data according to the target diameter data; An eye stimulation value is determined based on the scaled data.

5. The light sensing adjustment method of the smart contact lens according to claim 4, characterized in that: For two adjacent eye images, determining target diameter data of the pupil in the eye image according to the center point and each boundary point of the pupil in the eye image, including: Performing ellipse fitting on each boundary point of the pupil in the eye image to obtain the boundary of the pupil in the eye image, and determining first diameter data of the pupil in the eye image according to the boundary; Calculate the Euclidean distance from the center point to each boundary point according to the center point and each boundary point of the pupil, and determine the second diameter data of the pupil of the eye image according to the average value of the Euclidean distance from the center point to each boundary point; Target diameter data of the pupil in the eye image is determined according to the first diameter data and the second diameter data.

6. The light sensing adjustment method of a smart contact lens according to claim 1, characterized in that: Generating a control instruction according to the adjustment amount and the working information includes: determining an operating parameter of the contact lens based on the operating information; A control instruction is generated based on the adjustment amount and the operating parameter.

7. A light sensing adjustment system for smart contact lenses, characterized in that: The system is used to implement a light sensing adjustment method for a smart contact lens as claimed in any one of claims 1 to 6, comprising: A data acquisition module is used to obtain the ambient light intensity value, the eye image of the wearer and the working information of the contact lens; A variable extraction module, used for determining a light change value according to the ambient light intensity value and the eye image; An instruction generating module, used for determining a control instruction based on the light variation value and the working information; A control module is used to control the contact lens to work according to the control instruction.

Images