Adaptive smart glasses for visual function assistance and control method thereof

Abstract

The present invention provides adaptive smart glasses comprising a light sensor for detecting light intensity, a lens whose light absorption rate varies based on an electrical signal input from the outside, and a control module that generates an electrical signal to vary the light absorption rate of the lens based on the light intensity, wherein the control module adjusts the electrical signal by considering the light intensity and a predetermined light sensitivity for the user based on a predetermined absorption rate adjustment model, and varies the light absorption rate of the lens based on a user command input from the user, and wherein the absorption rate adjustment model is learned using learning data constructed based on the user command input over a specific period.

Description

Technology Field

[0001] The present invention relates to adaptive smart glasses for visual function assistance and a method for controlling the same. Background Technology

[0002] People with cataracts or those suffering from photosensitivity are sensitive to light and wear glasses, such as sunglasses, that have a lower transmittance and higher absorption rate for light received by both eyes. These glasses are produced by adding coloring agents to the lenses or by coating or depositing a separate material to reduce transmittance.

[0003] However, conventional eyeglasses, such as sunglasses, have a fixed light absorption rate (or light transmittance), which often forces users to switch to eyeglasses with different light absorption rates depending on the surrounding environment. Accordingly, a material capable of controlling the light absorption rate of a lens based on electrical signals has been proposed. The problem to be solved

[0004] The present invention relates to adaptive smart glasses for visual function assistance and a method for controlling the same, which reduce eye fatigue caused by various environmental changes, such as indoors or outdoors, and improve visual clarity in various environments.

[0005] In addition, the present invention relates to adaptive smart glasses for visual function assistance that adjust the amount of light in the lens to an appropriate level according to the degree of individual sensitivity to light for people with diseases such as cataracts or people with photosensitivity, and a method for controlling the same. means of solving the problem

[0006] To solve the problem described above, the adaptive smart glasses according to the present invention include: a light sensor that detects light intensity; a lens whose light absorption rate varies based on an electrical signal input from the outside; and a control module that generates the electrical signal to vary the light absorption rate of the lens based on the light intensity. The control module adjusts the electrical signal based on a predetermined absorption rate adjustment model, taking into account the light intensity and a predetermined light sensitivity for the user, and varies the light absorption rate of the lens based on a user command input from the user. The absorption rate adjustment model can be learned using learning data constructed based on the user command input over a specific period.

[0007] In addition, the control method for adaptive smart glasses according to the present invention comprises: a step of detecting a light intensity through a light sensor; a step in which a control module generates an electrical signal to vary the light absorption rate of a lens based on the light intensity, and adjusts the electrical signal based on a predefined absorption rate adjustment model, taking into account the light intensity and the user's light sensitivity; a step in which the control module transmits the electrical signal to the lens to vary the light absorption rate of the lens; and a step in which the control module varies the light absorption rate of the lens based on a user command input by the user, wherein the absorption rate adjustment model may be learned using learning data constructed based on the user command input during a specific period.

[0008] In addition, a program stored on a computer-readable recording medium according to the present invention is executed by one or more processes in an electronic device and is a program stored on a computer-readable recording medium, wherein the program comprises instructions for a control method of adaptive smart glasses, wherein the program includes the step of detecting a light intensity through a light sensor; the step of a control module generating an electrical signal to vary the light absorption rate of a lens based on the light intensity, and adjusting the electrical signal based on a predefined absorption rate adjustment model, taking into account the light intensity and the user's light sensitivity; the step of the control module transmitting the electrical signal to the lens to vary the light absorption rate of the lens; and the step of varying the light absorption rate of the lens based on a user command input by the user, wherein the absorption rate adjustment model may be learned using learning data constructed based on the user command input during a specific period. Effects of the invention

[0009] According to various embodiments of the present invention, adaptive smart glasses for visual function assistance and a method for controlling the same can reduce eye fatigue caused by various environmental fluctuations, such as indoors or outdoors, and improve visual clarity in various environments by adjusting the light absorption rate of the glasses lenses based on the amount of ambient light.

[0010] In addition, according to various embodiments of the present invention, adaptive smart glasses for visual function assistance and a control method thereof can adjust the amount of light of the lenses to an appropriate level according to the degree of individual sensitivity to light for people with diseases such as cataracts or people with photosensitivity by learning user input that adjusts the light absorption rate of the lenses and adjusting the light absorption rate of the glasses lenses based on the light sensitivity personalized to the user. Brief explanation of the drawing

[0011] FIG. 1 illustrates adaptive smart glasses according to the present invention. FIG. 2 illustrates an embodiment in which the light absorption rate of a lens is adjusted based on a light sensor. Figure 3 is a graph showing an example of the change in light absorption rate according to nonlinear response parameters. FIG. 4 illustrates an embodiment in which the light absorption rate of a lens is adjusted based on a user command. FIG. 5 illustrates an example of training an absorption rate adjustment model. Figure 6 is a graph showing an example of Bayesian inference used in the learning process of an absorption rate adjustment model. Figure 7 illustrates a control module of adaptive smart glasses. FIG. 8 is a flowchart illustrating a control method for adaptive smart glasses according to the present invention. Specific details for implementing the invention

[0012] Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings. Identical or similar components are assigned the same reference number regardless of the drawing symbols, and redundant descriptions thereof will be omitted. The suffixes "module" and "part" used for components in the following description are assigned or used interchangeably solely for the ease of drafting the specification and do not have distinct meanings or roles in themselves. Furthermore, in describing the embodiments disclosed in this specification, if it is determined that a detailed description of related prior art could obscure the essence of the embodiments disclosed in this specification, such detailed description will be omitted. Additionally, the attached drawings are intended only to facilitate understanding of the embodiments disclosed in this specification; the technical concept disclosed in this specification is not limited by the attached drawings, and it should be understood that they include all modifications, equivalents, and substitutions that fall within the spirit and technical scope of the present invention.

[0013] Terms including ordinal numbers, such as first, second, etc., may be used to describe various components, but said components are not limited by said terms. These terms are used solely for the purpose of distinguishing one component from another.

[0014] When it is stated that one component is "connected" or "connected" to another component, it should be understood that while it may be directly connected or connected to that other component, there may also be other components in between. On the other hand, when it is stated that one component is "directly connected" or "directly connected" to another component, it should be understood that there are no other components in between.

[0015] Singular expressions include plural expressions unless the context clearly indicates otherwise.

[0016] In this application, terms such as “comprising” or “having” are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0017] FIG. 1 illustrates an adaptive smart glasses according to the present invention. FIG. 2 illustrates an embodiment in which the light absorption rate of a lens is adjusted based on a light sensor. FIG. 3 is a graph showing an embodiment of a change in light absorption rate according to a non-linear response parameter. FIG. 4 illustrates an embodiment in which the light absorption rate of a lens is adjusted based on a user command. FIG. 5 illustrates an embodiment of training an absorption rate adjustment model. FIG. 6 is a graph showing an embodiment of Bayesian inference used in the training process of the absorption rate adjustment model. FIG. 7 illustrates a control module of the adaptive smart glasses.

[0018] Referring to FIG. 1, the adaptive smart glasses (100) according to the present invention may be provided in the form of glasses that can be worn on the face of a user.

[0019] That is, the adaptive smart glasses (100) may be provided with a plurality of glasses temples (101) to be worn over both ears of the user, and may be provided with a lens frame (102) to be fitted with a lens (120) for absorbing or refracting light received by both eyes of the user.

[0020] At this time, each of the plurality of eyeglass temples (101) can be mounted on both sides of the lens frame (102), and if hinges are provided on both sides of the lens frame (102), the eyeglass temples (101) can be mounted to the lens frame (102) through the hinges so as to be folded or unfolded.

[0021] Meanwhile, according to an embodiment, the adaptive smart glasses (100) may be provided in various forms such as goggles or a head-mounted display (HMD).

[0022] Accordingly, the adaptive smart glasses (100) may include only a lens frame (102) according to the embodiment, or may include one or more additional components together with the lens frame (102).

[0023] Furthermore, as shown in FIG. 2, the adaptive smart glasses (100) according to the present invention can detect the amount of ambient light using a light sensor (110) and vary the light absorption rate of the lens (120) based on the detected amount of light.

[0024] To this end, the adaptive smart glasses (100) may include a light sensor (110), a lens (120), and a control module (130). Additionally, according to an embodiment, the adaptive smart glasses (100) may further include a power module that supplies power to the light sensor (110) and the control module (130), a charging module for charging the power module, such as solar charging and wireless charging, and a communication module that provides a connection to another device to perform additional control over the control module, such as Bluetooth.

[0025] The light sensor (110) can detect the amount of light (or light intensity) incident on the light sensor (110). To this end, the light sensor (110) may be provided on the front of the adaptive smart glasses (100) to measure the amount of light directed toward the user's eyes, or, according to an embodiment, provided on the rear of the adaptive smart glasses (100) to measure the amount of light reflected from the user's face. Additionally, the light sensor (110) may be provided on one side of the adaptive smart glasses (100) to detect the amount of ambient light.

[0026] This light sensor (110) is electrically connected to a control module (130) and can transmit the amount of light detected by the light sensor (110) to the control module (130).

[0027] Additionally, in one embodiment, the adaptive smart glasses (100) may be equipped with a plurality of light sensors (110) at different points, thereby enabling the detection of light levels in multiple different directions. In this case, the adaptive smart glasses (100) may vary the light absorption rate of the lens (120) based on the average value of the light levels measured by the plurality of light sensors (110), or vary the light absorption rate of the lens (120) based on the light level that meets a predetermined condition (e.g., the highest light level, or the lowest light level, etc.) among the light levels measured by the plurality of light sensors (110).

[0028] Additionally, according to an embodiment, the adaptive smart glasses (100) may assign weights to the amount of light measured from each light sensor (110) based on a point equipped with a plurality of light sensors (110), and thereby may vary the light absorption rate of the lens (120) based on the weighted amount of light.

[0029] The lens (120) can vary its light absorption rate based on an electrical signal input from the outside. To this end, the lens (120) can be mounted on one side of the lens frame (102) and electrically connected to the control module (130).

[0030] Accordingly, the lens (120) receives an electrical signal from the control module (130), and the light absorption rate can be varied based on the received electrical signal.

[0031] In one embodiment, the lens (120) may include a photochromic lens or a liquid crystal lens, and may be configured so that when an electrical signal is input from the control module (130), the color or transparency or the refractive index is varied according to the electrical signal.

[0032] That is, the light absorption rate indicates the degree to which light is absorbed by the lens (120). Based on the electrical signal input to the lens (120), as the light absorption rate increases, the amount of light (or light intensity) received by the eyes of the user wearing the adaptive smart glasses (100) (or transmitted through the lens) decreases, and as the light absorption rate decreases, the amount of light received by the eyes of the user wearing the adaptive smart glasses (100) can increase.

[0033] Meanwhile, according to an embodiment, the lens (120) may be provided to have a variable light transmittance, wherein the light transmittance indicates the degree to which light passes through the lens (120), and as the light transmittance increases based on an electrical signal input to the lens (120), the amount of light (or light intensity) received by the eyes of a user wearing the adaptive smart glasses (100) (or transmitted through the lens) increases, and as the light transmittance decreases, the amount of light received by the eyes of a user wearing the adaptive smart glasses (100) decreases.

[0034] The control module (130) can be electrically connected to the light sensor (110) and the lens (120). Accordingly, the control module (130) can check the amount of light detected by the light sensor (110) and generate an electrical signal to vary the light absorption rate of the lens (120) based on the checked amount of light. Through this, the control module (130) can transmit the generated electrical signal to the lens (120) to vary the light absorption rate.

[0035] To this end, the control module (130) can adjust the electrical signal based on a predetermined absorption rate adjustment model, taking into account the amount of light detected through the light sensor (110) and the light sensitivity of the user.

[0036] Here, the absorption rate adjustment model can be implemented to calculate the light absorption rate according to the previously determined amount of light based on predetermined light sensitivity and non-linear response parameters when the amount of light is detected through the light sensor (110).

[0037] That is, the absorption rate adjustment model can represent a relationship based on light intensity, light sensitivity, and nonlinear response parameters, and in one embodiment, the absorption rate adjustment model can be represented as Equation 1 below.

[0038]

[0039] Here, Absorption represents the light absorption rate, Light Intensity represents the amount of light detected by the light sensor (110), a represents light sensitivity, and b may represent a non-linear response parameter.

[0040] In this regard, light sensitivity is a variable that indicates the degree to which the light absorption rate of the lens (120) varies in response to a change in the amount of light detected by the light sensor (110). As light sensitivity increases, the degree of variation in the light absorption rate according to the change in the amount of light increases, and as light sensitivity decreases, the degree of variation in the light absorption rate according to the change in the amount of light decreases.

[0041] This light sensitivity can be set to a predetermined specific value, and, depending on the embodiment, may be implemented to set the light sensitivity based on a command input by a user.

[0042] In addition, the nonlinear response parameter can be a variable that changes the degree of variability of the light absorption rate according to changes in light intensity. That is, as shown in Figure 3, the light absorption rate varies relatively significantly with changes in light intensity as the nonlinear response parameter increases, and varies relatively small with changes in light intensity as the nonlinear response parameter decreases.

[0043] That is, the nonlinear response parameter can prevent the phenomenon where the light absorption rate of the lens (120) becomes excessively high in high-intensity lighting environments or does not become sufficiently low in low-intensity lighting environments based on an adjustable range for the light absorption rate of the lens (120).

[0044] Through this, the control module (130) can automatically adjust the light absorption rate of the lens (120) according to changes in indoor and outdoor illumination, and can automatically adjust the light absorption rate of the lens (120) according to changes in illumination due to changes in weather or changes in time such as day and night.

[0045] Meanwhile, as shown in FIG. 4, the control module (130) can vary the light absorption rate based on a user command (10) input from the user. That is, the control module (130) can adjust the electrical signal generated based on the amount of light detected by the light sensor based on the user command (10).

[0046] For example, when a user command (10) to decrease or increase the light absorption rate is recognized by the user, the control module (130) can convert an electrical signal generated based on the amount of light to vary the light absorption rate of the lens (120).

[0047] As another example, the control module (130) is connected via a wireless network to a microcontroller equipped to detect user commands, and can receive user commands from the microcontroller.

[0048] At this time, the microcontroller may be equipped with a mobile application that provides a user interface for inputting user commands from a user, and according to the embodiment, the microcontroller may include a desktop, a smartphone, a smartwatch, and other physical control devices.

[0049] Furthermore, as shown in FIG. 5, the control module (130) can learn an absorption rate adjustment model (30) based on a user command (10) that adjusts the light absorption rate.

[0050] Specifically, the control module (130) recognizes a user command (10) for adjusting the light absorption rate (21), checks the light amount (20) and the light absorption rate (11) adjusted according to the user command (10), and can correct the light sensitivity and non-linear response parameters of the absorption rate adjustment model (30) based on the checked light amount (20) and the adjusted light absorption rate (11).

[0051] For example, the control module (130) can determine the amount of light (20) (or light absorption rate) at the time when the user command (10) is recognized, and the light absorption rate (11) adjusted based on the user command (10). Accordingly, the control module (130) can correct the light sensitivity and non-linear response parameters based on the absorption rate adjustment model (30) so that the previously adjusted light absorption rate (11) is calculated from the previously determined amount of light (20).

[0052] At this time, the light sensitivity and nonlinear response parameters can be adjusted according to a predetermined ratio, and in one embodiment, the light sensitivity and nonlinear response parameters can be corrected so that the value obtained by multiplying the light sensitivity and the nonlinear response parameters satisfies a predetermined reference value.

[0053] In this regard, the control module (130) can collect information on the amount of light (20) and the adjusted light absorption rate (11) confirmed according to the user command (10), and train an absorption rate adjustment model (30) based on the collected information.

[0054] That is, the control module (130) can train the absorption rate adjustment model (30) based on information regarding the amount of light (20) and the adjusted light absorption rate (11) that has been confirmed for a predetermined period or a predetermined number of times, or train the absorption rate adjustment model (30) based on information regarding the amount of light (20) and the adjusted light absorption rate (11) that has been continuously accumulated.

[0055] In this regard, the control module (130) can continuously train the already learned absorption rate adjustment model (30) based on user commands (10), and to this end, the control module (130) can continuously collect information on the amount of light (20) and the adjusted light absorption rate (11) according to the user commands (10).

[0056] Referring to FIG. 6, as another example, the control module (130) can train the absorption rate adjustment model (30) through Machine Learning Human Feedback (MLHF) based on Bayesian inference.

[0057] Specifically, the control module (130) can specify each of the predetermined light sensitivity and nonlinear response parameters for the absorption rate adjustment model (30) as a prior distribution (e.g., Prior, P(Polarization)).

[0058] In one embodiment, the prior distribution for each of the light sensitivity and nonlinear response parameters can be expressed as shown in Equation 2 below.

[0059]

[0060] That is, the control module (130) can specify a first prior distribution having a predetermined variance and a predetermined average of light sensitivity, and a second prior distribution having a predetermined variance and a predetermined average of non-linear response parameters.

[0061] At this time, the variance of the first prior distribution and the variance of the second prior distribution may be the same value or different values, and each variance may be determined such that a sufficiently large deviation is reflected for the light sensitivity and nonlinear response parameters.

[0062] Accordingly, the control module (130) can calculate a likelihood function (e.g., P(Data | Polarization)) for light sensitivity and non-linear response parameters based on the amount of light (20) identified (or collected) and the adjusted light absorption rate (11) based on the user command (10).

[0063] At this time, the distribution according to the amount of light (20) and the adjusted light absorption rate (11) confirmed (or collected) based on the user command (10) may be a distribution having a predetermined variance with the adjusted light absorption rate (11) as the mean, or it may be a distribution for each of the light sensitivity and non-linear response parameters for deriving the adjusted light absorption rate (11) from the previously confirmed amount of light (20) in the absorption rate adjustment model (30).

[0064] Accordingly, the likelihood function may be a likelihood function of the distribution according to the previously identified (or collected) amount of light (20) and the adjusted light absorption rate (11) for the first prior distribution and the second prior distribution.

[0065] In one embodiment, the likelihood function can be expressed as shown in Equation 3 below.

[0066]

[0067] Here, f(LightIntensity, a, b) can represent a function that takes light intensity, light sensitivity, and nonlinear response parameters as inputs and outputs the light absorption rate.

[0068] Next, the control module (130) can calculate a posterior distribution (e.g., Posterior, P(Polarization | Data) for light sensitivity and non-linear response parameters using a first prior distribution, a second prior distribution, a likelihood function, and a distribution based on the previously identified (or collected) light amount (20) and the adjusted light absorption rate (11).

[0069] Through this, the control module (130) can implement an absorption rate adjustment model (30) adapted to the user's preference by correcting light sensitivity and non-linear response parameters based on the previously calculated posterior distribution.

[0070] In one embodiment, the posterior distribution can be expressed as shown in Equation 4 below.

[0071]

[0072] Here, User data represents information (e.g., distribution) related to the amount of light (20) and the adjusted light absorption rate (11) identified (or collected) based on the user command (10), a represents light sensitivity, and b may represent a non-linear response parameter.

[0073] In this regard, the absorption rate adjustment model may be learned in the control module, but depending on the embodiment, it may be learned on a microcontroller or a separate learning server.

[0074] To this end, the adaptive smart glasses (100) can record information related to the amount of light and the varied light absorption rate at the point when the light absorption rate is varied based on user commands, and transmit the recorded information to a pre-equipped microcontroller.

[0075] At this time, the adaptive smart glasses (100) may record information related to the amount of light and the variable light absorption rate, along with information related to the time when the light absorption rate was varied based on user commands.

[0076] Through this, the adaptive smart glasses (100) can transmit previously recorded information to the microcontroller at predetermined time intervals, or transmit previously recorded information when a wireless network with the microcontroller is detected. Additionally, the adaptive smart glasses (100) can remove the transmitted information from the control module.

[0077] Accordingly, the microcontroller can train an absorption rate adjustment model based on information transmitted from the adaptive smart glasses (100), or provide information transmitted from the adaptive smart glasses (100) to a pre-equipped learning server.

[0078] At this time, the learning server may store an absorption rate adjustment model corresponding to different adaptive smart glasses (100), and in this case, the learning server may receive identification information (e.g., identification number, etc.) related to the adaptive smart glasses (100) (or microcontroller) along with information recorded from the adaptive smart glasses (100) from the microcontroller, and learn the absorption rate adjustment model based on this.

[0079] Alternatively, the learning server may receive an absorption rate adjustment model along with information recorded in the adaptive smart glasses (100) from the microcontroller, and in this case, the learning server may train the previously received absorption rate adjustment model using the information received together.

[0080] In this regard, if there is information (e.g., prior distribution or posterior distribution) related to an absorption rate adjustment model that has been previously trained for a specific adaptive smart glasses (100), the learning server can update the absorption rate adjustment model by performing training on new data based on said information.

[0081] That is, when the learning server receives information recorded according to a user command from a specific adaptive smart glasses (100) in which an absorption rate adjustment model was previously learned, it can update the previously learned absorption rate adjustment model based on the previously received information.

[0082] For example, the learning server can update the absorption rate adjustment model by replacing the posterior distribution (or prior distribution) of the previously learned absorption rate adjustment model with the prior distribution for the previously received information, and by calculating the likelihood function and the posterior distribution based on the previously received information along with the replaced prior distribution.

[0083] Accordingly, the microcontroller receives an absorption rate adjustment model learned based on information transmitted from the adaptive smart glasses (100) from the learning server, and can transmit information about the learned absorption rate adjustment model to the adaptive smart glasses (100).

[0084] Through the above configurations, the adaptive smart glasses (100) can adaptively adjust the light absorption rate of the lens according to the user's sensitivity to light through an absorption rate adjustment model (30) personalized for each user. Accordingly, the adaptive smart glasses (100) may be named as Adaptive Vision Enhancement (AVE) smart glasses according to the embodiment.

[0085] To this end, referring to FIG. 7, the control module may include an input unit (131), a storage unit (132), and a control unit (133).

[0086] The input unit (131) can receive information related to the amount of light from a light sensor (110) provided in the adaptive smart glasses (100). Additionally, the input unit (131) can receive a user command to adjust the light absorption rate.

[0087] To this end, the adaptive smart glasses (100) may be equipped with various types of input modules (105), such as buttons, dials, touchpads, and motion detection sensors, so that the control module (130) can recognize input from the user through the input section (131).

[0088] For example, the input unit (131) may include a plurality of buttons or a touch pad to detect commands to increase and decrease the light absorption rate. As another example, the input unit (131) may include a dial rotatable in multiple directions to detect commands to increase and decrease the light absorption rate. As yet another example, the input unit (131) may include a motion detection sensor to detect user actions corresponding to commands to increase and decrease the light absorption rate.

[0089] The storage unit (132) may contain data and commands necessary for the operation of a control module included in the adaptive smart glasses (100) according to the present invention.

[0090] For example, the storage unit (132) may store information related to the amount of light detected by the light sensor (110) and information configured to adjust the light absorption rate of the lens. Additionally, the storage unit (132) may store an absorption rate adjustment model and information related to the absorption rate adjustment model (e.g., light sensitivity and non-linear response parameters).

[0091] The control unit (133) can control the overall operation of the adaptive smart glasses (100) according to the present invention.

[0092] For example, the control unit (133) can detect the amount of light through the light sensor (110) and generate an electrical signal based on the detected amount of light to vary the light absorption rate of the lens. At this time, the control unit (133) can calculate the light absorption rate corresponding to the amount of light using a predetermined absorption rate adjustment model.

[0093] Additionally, the control unit (133) can vary the light absorption rate of the lens based on user commands, and can learn an absorption rate adjustment model based on the amount of light for the user command and the light absorption rate adjusted according to the user command.

[0094] Based on the configuration of the adaptive smart glasses (100) described above, the control method of the adaptive smart glasses will be explained in more detail below.

[0095] FIG. 8 is a flowchart illustrating a control method for adaptive smart glasses according to the present invention.

[0096] Referring to FIG. 8, the control module of the adaptive smart glasses (100) detects the amount of light through a light sensor (S100) and can generate an electrical signal to vary the light absorption rate of the lens based on the amount of light (S200).

[0097] Through this, the control module of the adaptive smart glasses (100) can transmit the electrical signal to the lens to vary the light absorption rate of the lens (S300).

[0098] Specifically, the control module can adjust the electrical signal based on a predetermined absorption rate adjustment model, taking into account the light intensity and the predetermined light sensitivity for the user.

[0099] In addition, the control module can vary the light absorption rate based on user commands input by the user. That is, based on user commands, the control module can adjust the electrical signal generated based on the amount of light detected by the light sensor.

[0100] Furthermore, the control module can train an absorption rate adjustment model based on user commands that adjust the light absorption rate.

[0101] Specifically, the control module recognizes a user command to adjust the light absorption rate, verifies the light amount and the light absorption rate adjusted according to the user command, and can correct the light sensitivity and non-linear response parameters of the absorption rate adjustment model based on the verified light amount and the adjusted light absorption rate.

[0102] Through the above configurations, the adaptive smart glasses (100) according to the present invention can reduce eye fatigue caused by various environmental fluctuations, such as indoors or outdoors, and improve visual clarity in various environments by adjusting the light absorption rate of the glasses lenses based on the amount of ambient light.

[0103] In addition, the adaptive smart glasses (100) according to the present invention learns user input for adjusting the light absorption rate of the lenses and adjusts the light absorption rate of the glasses lenses based on the light sensitivity personalized to the user, thereby allowing the amount of light in the lenses to be adjusted to an appropriate level according to the degree of individual sensitivity to light for people with diseases such as cataracts or people with photophobia.

[0104] Furthermore, the present invention described above can be implemented as a program that is executed by one or more processes in an electronic device and stored on a computer-readable recording medium.

[0105] Accordingly, the present invention can be implemented as computer-readable code or instructions on a medium on which a program is recorded. That is, various control methods according to the present invention can be provided in the form of integrated or individual programs.

[0106] Meanwhile, computer-readable media include all types of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable media include HDD (Hard Disk Drive), SSD (Solid State Disk), SSD (Silicon Disk Drive), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

[0107] Furthermore, the computer-readable medium may be a server or cloud storage that includes a storage and is accessible to an electronic device via communication. In this case, the computer may download the program according to the present invention from the server or cloud storage via wired or wireless communication.

[0108] Furthermore, in the present invention, the computer described above is an electronic device equipped with a processor, namely a CPU (Central Processing Unit), and no special limitations are placed on its type.

[0109] Meanwhile, the above detailed description should not be interpreted restrictively in all respects but should be considered exemplary. The scope of the invention shall be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the invention are included within the scope of the invention.

Claims

Claim 1 A light sensor that detects light intensity; a lens whose light absorption rate varies based on an electrical signal input from the outside; Adaptive smart glasses comprising a control module that generates an electrical signal to vary the light absorption rate of the lens based on the light amount, wherein the control module calculates the light absorption rate of the lens based on a predetermined absorption rate adjustment model, considering the light amount and a predetermined light sensitivity for the user, generates an electrical signal corresponding to the calculated light absorption rate to adjust the light absorption rate of the lens, and when a user command regarding the adjustment of the light absorption rate of the lens is recognized while the light absorption rate of the lens is adjusted, generates the electrical signal to change the light absorption rate of the lens according to the user command to vary the light absorption rate of the lens, confirms the light amount at the time when the user command is recognized and the light absorption rate changed according to the user command, corrects the non-linear response parameters of the absorption rate adjustment model based on the relationship between the confirmed light amount and the changed light absorption rate, and trains the absorption rate adjustment model reflecting the corrected non-linear response parameters using training data including the confirmed light amount and the changed light absorption rate. Claim 2 In claim 1, the adaptive smart glasses, wherein the absorption rate adjustment model is implemented to calculate a light absorption rate according to the amount of light based on the light sensitivity and the non-linear response parameter when the amount of light is detected through the light sensor. Claim 3 In claim 2, the light sensitivity is a variable representing the degree to which the light absorption rate of the lens varies in response to a change in the amount of light detected by the light sensor, and the non-linear response parameter is a variable that changes the degree of variation of the light absorption rate according to the change in the amount of light, adaptive smart glasses. Claim 4 Adaptive smart glasses according to claim 1, wherein the control module is connected via a wireless network to a microcontroller configured to detect the user command, and receives the user command from the microcontroller, and the microcontroller is equipped with a mobile application that provides a user interface for inputting the user command from the user. Claim 5 In claim 4, the control module records information related to the amount of light and the varied light absorption rate at the point in time when the light absorption rate is varied based on the user command so that the absorption rate adjustment model is learned, and transmits the recorded information to the microcontroller, adaptive smart glasses. Claim 6 In claim 1, the absorption rate adjustment model is an adaptive smart glasses that is learned through Machine Learning Human Feedback (MLHF) based on Bayesian inference. Claim 7 delete Claim 8 Adaptive smart glasses according to claim 1, wherein the correction for the light sensitivity and the nonlinear response parameter is performed such that the product of the light sensitivity and the nonlinear response parameter satisfies a predetermined reference value. Claim 9 A method for controlling adaptive smart glasses comprises: a step of detecting light intensity through a light sensor; a step in which a control module generates an electrical signal to vary the light absorption rate of a lens based on the light intensity, and calculates the light absorption rate of the lens and adjusts the electrical signal based on a predefined absorption rate adjustment model, taking into account the user's light sensitivity along with the light intensity; a step in which the control module transmits the electrical signal to the lens to adjust the light absorption rate of the lens; a step in which, when the light absorption rate of the lens is adjusted, a user command regarding the adjustment of the light absorption rate of the lens is recognized, the electrical signal is generated to vary the light absorption rate of the lens by changing the light absorption rate of the lens according to the user command; a step of verifying the light intensity at the time when the user command is recognized and the light absorption rate changed according to the user command, and correcting the non-linear response parameters of the absorption rate adjustment model based on the relationship between the verified light intensity and the changed light absorption rate. A method for controlling adaptive smart glasses, characterized by including the step of training the absorption rate adjustment model, which reflects the corrected non-linear response parameters, using training data including the identified light amount and the changed light absorption rate. Claim 10 A program that is executed by one or more processes in an electronic device and stored on a computer-readable recording medium, wherein the program comprises, in a method for controlling adaptive smart glasses, a step of detecting a light intensity through a light sensor; a step in which a control module generates an electrical signal to vary the light absorption rate of a lens based on the light intensity, and calculates the light absorption rate of the lens and adjusts the electrical signal based on a predefined absorption rate adjustment model, taking into account the user's light sensitivity along with the light intensity; a step in which the control module transmits the electrical signal to the lens to adjust the light absorption rate of the lens; a step in which, when the light absorption rate of the lens is adjusted, a user command regarding the adjustment of the light absorption rate of the lens is recognized, the light absorption rate of the lens is varied by generating the electrical signal to change the light absorption rate of the lens according to the user command; a step of verifying the light intensity at the time when the user command is recognized and the light absorption rate changed according to the user command, and correcting the non-linear response parameters of the absorption rate adjustment model based on the relationship between the verified light intensity and the changed light absorption rate. A program stored on a computer-readable recording medium, characterized by including instructions for performing the step of training the absorption rate adjustment model, which reflects the corrected non-linear response parameters, using training data including the identified light quantity and the changed light absorption rate.

Images