Control method and device of smart glasses, smart glasses and medium

Abstract

The application provides a control method and device of smart glasses, smart glasses and a medium. The optical sensor for collecting light entering the eyes is arranged on the front surface of the frame of the smart glasses to face the visual field area of the wearer, and the optical sensor for sensing the change of the surrounding environment is arranged on the side surface of the frame, so that the information related to the actual received light of the wearer and the external environment illumination is obtained respectively. Based on the above information, the use of the eyes of the wearer is determined. When the corresponding abnormal behavior is detected, the health reminding message matched with the scene is output. The method sets two optical sensors on different surfaces of the frame to form a double-dimensional sensing mechanism facing the actual entering eye light and the external environment light, improves the accuracy of the judgment of the real eye use state, enhances the adaptability to the complex environment change, and prompts the wearer to timely adjust the illumination condition or the continuous eye use time length, so that the effect of the continuous eye use health monitoring and reminding for the daily life scene is achieved.

Description

Technical Field

[0001] This application relates to the field of smart glasses technology, and in particular to a control method, device, smart glasses and medium for smart glasses. Background Technology

[0002] With the widespread use of electronic devices (such as mobile phones, tablets, and computers), the phenomenon of modern people spending long periods of time using screens in low-light environments is becoming increasingly common, leading to a continuous rise in myopia rates. This is particularly prominent among teenagers, who experience insufficient outdoor activity time, excessive screen time, excessively close viewing distances, and dim ambient light. For example, users may continue to look down at their mobile phone screens for extended periods even after the lights are off, or read for long periods under non-continuous spectrum light sources such as energy-saving lamps indoors; both of these scenarios can potentially damage their visual health.

[0003] In related technologies, solutions for monitoring eye health often rely on a single sensor or functional module. For example, some electronic devices use ambient light sensors to detect surrounding brightness. However, this solution can only determine whether the environment in which the electronic device is located is too dark, and cannot distinguish the user's actual eye-use environment.

[0004] Because existing technologies cannot accurately determine a user's specific eye-use scenario, the health reminders they issue lack specificity and generally suffer from inaccurate alerts, failing to effectively meet users' eye health monitoring needs. Therefore, there is an urgent need for a technical solution that can accurately identify eye-use scenarios and improve the accuracy of health reminders to address these shortcomings. Summary of the Invention

[0005] This application provides a control method, device, smart glasses, and medium for smart glasses, in order to solve the problem that the existing technology cannot accurately know the user's current specific eye use scenario, resulting in the lack of targeted health reminders issued to the user and the common existence of reminder deviations, and thus cannot effectively meet the user's eye health monitoring needs.

[0006] In a first aspect, this application provides a control method for smart glasses. The smart glasses have a first optical sensor disposed on the front of the frame for collecting light information entering the wearer's eyes, and a second optical sensor disposed on the side of the frame for collecting ambient light information. The method includes:

[0007] Acquire light information and ambient light information;

[0008] Based on light information and / or ambient light information, determine the wearer's eye usage scenario;

[0009] If abnormal behavior corresponding to the eye-use scenario is detected, a corresponding health reminder message is generated to remind the wearer to adjust their eye-use behavior.

[0010] In one possible implementation, the light information includes: spectral information and first brightness information; the ambient light information includes: second brightness information. Based on the light information and / or ambient light information, the wearer's eye-use scenario is determined, including:

[0011] If the first brightness information is greater than the preset brightness, the wearer's first visual environment is determined based on the spectral information. The first visual environment includes: outdoor lighting environment and non-outdoor lighting environment.

[0012] When the first visual environment is a non-outdoor lighting environment, the wearer's second visual environment is determined based on the second brightness information. The second visual environment includes: a lit environment and a dark environment.

[0013] Based on the first and / or second visual environment, determine the visual scenario.

[0014] In one possible implementation, the wearer's primary visual environment is determined based on spectral information, including:

[0015] Spectral composition analysis is performed on the spectral information to obtain the analysis results;

[0016] If the analysis results indicate that the spectral information meets the first condition, the first visual environment is determined to be an outdoor lighting environment. The first condition includes: the light is a continuous spectrum, and the proportion of infrared light in the continuous spectrum is less than the preset proportion.

[0017] If the analysis results indicate that the spectral information meets the second condition, the first visual environment is determined to be a non-outdoor lighting environment. The second condition includes: the light is a continuous spectrum, and the proportion of infrared light in the continuous spectrum is not less than a preset proportion, or the light is a non-continuous spectrum.

[0018] In one possible implementation, the visual scenario is determined based on a first visual environment and / or a second visual environment, including:

[0019] Given that the primary visual environment is an outdoor lighting environment, the visual scenario is determined to be an outdoor lighting scenario.

[0020] When the first visual environment is a non-outdoor lighting environment and the second visual environment is a lit environment, the visual scenario is determined to be a lit scenario; the lit scenario includes: a lit screen viewing scenario and a lit non-screen viewing scenario.

[0021] Given that the first visual environment is a non-outdoor lighting environment and the second visual environment is a dark environment, the visual scenario is defined as a dark scenario: the dark scenario includes: a dark scenario of viewing a screen and a dark scenario of not viewing a screen.

[0022] In one possible implementation, the method further includes:

[0023] Determine the duration of time spent in an eye-use scenario;

[0024] If the duration of screen viewing in the dark reaches the first preset duration, abnormal behavior corresponding to the dark screen viewing scenario is detected.

[0025] If the duration of visual activity is less than the second preset duration, abnormal behavior corresponding to the outdoor lighting scenario is detected.

[0026] In one possible implementation, a distance sensor is also provided on the front of the smart glasses frame, and the method further includes:

[0027] The distance sensor determines the wearer's viewing distance;

[0028] Determine if the viewing distance is less than the preset distance;

[0029] When the viewing distance is less than a preset distance, a corresponding health reminder message is generated.

[0030] Secondly, this application provides a control device for smart glasses. A first optical sensor is disposed on the front of the frame of the smart glasses for collecting light information entering the wearer's eyes, and a second optical sensor is disposed on the side of the frame of the smart glasses for collecting ambient light information. The device includes:

[0031] The acquisition module is used to acquire light information and ambient light information;

[0032] The processing module is used to determine the wearer's eye-use scenario based on light information and / or ambient light information; and if abnormal behavior corresponding to the eye-use scenario is detected, it generates a corresponding health reminder message to remind the wearer to adjust their eye-use behavior.

[0033] In one possible implementation, the light information includes spectral information and first brightness information, and the ambient light information includes second brightness information. The processing module is used to determine the wearer's first visual environment based on the spectral information when the first brightness information is greater than a preset brightness. The first visual environment includes an outdoor lighting environment and a non-outdoor lighting environment. When the first visual environment is a non-outdoor lighting environment, the module is used to determine the wearer's second visual environment based on the second brightness information. The second visual environment includes an environment with lights on and an environment with lights off. The module is also used to determine the visual scene based on the first visual environment and / or the second visual environment.

[0034] In one possible implementation, a processing module is used to perform spectral composition analysis on the spectral information to obtain analysis results;

[0035] If the analysis results indicate that the spectral information meets the first condition, the first visual environment is determined to be an outdoor lighting environment. The first condition includes: the light is a continuous spectrum, and the proportion of infrared light in the continuous spectrum is less than the preset proportion.

[0036] If the analysis results indicate that the spectral information meets the second condition, the first visual environment is determined to be a non-outdoor lighting environment. The second condition includes: the light is a continuous spectrum, and the proportion of infrared light in the continuous spectrum is not less than a preset proportion, or the light is a non-continuous spectrum.

[0037] In one possible implementation, the processing module is configured to: determine the viewing scenario as an outdoor lighting scenario when the first viewing environment is an outdoor lighting environment; determine the viewing scenario as a lit-up scenario when the first viewing environment is a non-outdoor lighting environment and the second viewing environment is a lit-up environment, wherein the lit-up scenario includes: a lit-up screen viewing scenario and a lit-up non-screen viewing scenario; and determine the viewing scenario as a lit-up scenario when the first viewing environment is a non-outdoor lighting environment and the second viewing environment is a lit-up environment, wherein the lit-up scenario includes: a lit-up screen viewing scenario and a lit-up non-screen viewing scenario.

[0038] In one possible implementation, the processing module is further configured to determine the duration of the eye-use scenario; if the duration of the eye-use scenario is viewing the screen with the lights off, and the duration reaches a first preset duration, it is determined that abnormal behavior corresponding to the screen-viewing-with-lights scenario is detected; and if the duration of the eye-use scenario is outdoor lighting scenario, and the duration does not reach a second preset duration, it is determined that abnormal behavior corresponding to the outdoor lighting scenario is detected.

[0039] In one possible implementation, a distance sensor is also provided on the front of the frame of the smart glasses, and the acquisition module is also used to determine the wearer's viewing distance through the distance sensor;

[0040] The processing module is also used to determine whether the viewing distance is less than a preset distance; and to generate a corresponding health reminder message when the viewing distance is less than the preset distance.

[0041] Thirdly, this application provides a smart glasses, including: a frame, temples, lenses and a processor, wherein a first optical sensor is provided on the front of the frame and a second optical sensor is provided on the side of the frame;

[0042] The first optical sensor is used to collect information about the light entering the wearer's eyes;

[0043] The second optical sensor is used to collect ambient light information;

[0044] The processor is used to implement the methods shown in the first aspect and / or various possible implementations of the first aspect above.

[0045] In one possible implementation, a distance sensor is also provided on the front of the frame; the normal of the distance sensor and the normal of the lens are at an angle in a first direction, and the angle is any angle between 0 degrees and 20 degrees.

[0046] Fourthly, this application provides a smart glasses, including: a memory and a processor;

[0047] The memory stores the instructions executed by the computer.

[0048] The processor executes computer execution instructions stored in the memory to implement the method shown in the first aspect and / or various possible implementations of the first aspect above.

[0049] Fifthly, this application provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, are used to implement the methods shown in the first aspect and / or various possible implementations of the first aspect.

[0050] Sixthly, this application provides a computer program product, including a computer program that, when executed by a processor, implements the methods shown in the first aspect and / or various possible implementations of the first aspect.

[0051] The control method, device, smart glasses, and medium provided in this application for smart glasses utilize optical sensors arranged on the front of the frame facing the wearer's line of sight to collect light entering the eyes, and optical sensors arranged on the side of the frame to sense changes in the surrounding environment. This allows for the acquisition of information related to the actual light received by the wearer and ambient lighting, respectively. Based on this information, the wearer's eye usage is determined. When abnormal behavior is detected, a health reminder message matching the scene is output. This method, by setting two optical sensors on different surfaces of the frame, forms a dual-dimensional perception mechanism for both actual incoming light and ambient light, improving the accuracy of judging the actual eye usage state, enhancing adaptability to complex environmental changes, and prompting the wearer to adjust lighting conditions or continuous eye usage time in a timely manner. This achieves the effect of continuous eye health monitoring and reminders for everyday life scenarios. Attached Figure Description

[0052] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0053] Figure 1 A schematic diagram of the structure of smart glasses provided in this application embodiment. Figure 1 ;

[0054] Figure 2 A schematic diagram showing an angle between the distance sensor and the normal of a lens, provided for an embodiment of this application;

[0055] Figure 3 A schematic diagram illustrating the calculation of eye distance using a distance sensor, provided as an embodiment of this application;

[0056] Figure 4 A flowchart illustrating a control method for smart glasses provided in an embodiment of this application;

[0057] Figure 5 This is a schematic diagram of the structure of a control device for smart glasses provided in an embodiment of this application;

[0058] Figure 6 A schematic diagram of the structure of smart glasses provided in this application embodiment. Figure 2 .

[0059] The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concept of this application to those skilled in the art through reference to particular embodiments. Detailed Implementation

[0060] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0061] The terms "first," "second," "third," "fourth," etc. (if present) in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of the invention described herein can be implemented, for example, in orders other than those illustrated or described herein.

[0062] In this application, the terms "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in this application should not be construed as being more preferred or advantageous than other embodiments or designs. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0063] With the widespread use of electronic devices such as mobile phones, tablets, and computers, digital lifestyles have become deeply integrated into modern people's daily work and entertainment. The phenomenon of users spending extended periods using screens in low-light environments is becoming increasingly common, leading to a continuous rise in myopia rates. This is particularly prominent among teenagers, who are experiencing insufficient outdoor activity time, excessive screen time, excessively close viewing distances, and dim ambient light. For example, users may continue to look at their mobile phone screens for extended periods even after the lights are off, or read for long periods under non-continuous spectrum light sources such as energy-saving lamps indoors; both of these scenarios can potentially damage their visual health.

[0064] In daily life, poor eye use is characterized by its diversity and insidious nature. For example, users often look at their mobile phone screens for a long time after the lights are off. At this time, the contrast between the screen light and the ambient light is extremely high, which can easily lead to continuous spasm of the ciliary muscle and accelerated tear evaporation, thereby causing eye fatigue and increased myopia. The vision damage in the above scenarios is often overlooked by users because the process is slow.

[0065] In the context of eye health monitoring, related technologies typically rely on a single sensor or functional module. These solutions often suffer from limitations such as limited monitoring dimensions and poor scene recognition capabilities.

[0066] For example, some electronic devices use ambient light sensors to detect the brightness of the surrounding environment in order to determine whether there is a risk of low-light eye strain. However, this solution can only make a simple judgment on ambient brightness and cannot distinguish whether the user is viewing the screen indoors, the user's actual eye environment, or other complex eye-use scenarios. Furthermore, traditional ambient light sensors are easily affected by screen backlight interference and have a limited field of view, which further reduces the accuracy of scene recognition.

[0067] Because existing technologies cannot accurately determine a user's specific eye-use scenario, the health reminders they issue lack specificity and generally suffer from inaccurate alerts, failing to effectively meet users' eye health monitoring needs. Therefore, there is an urgent need for a technical solution that can accurately identify eye-use scenarios and improve the accuracy of health reminders to address these shortcomings.

[0068] To address the shortcomings of related technologies, this application provides a control method for smart glasses. This method involves arranging optical sensors on the front of the glasses frame facing the wearer's line of sight to collect light entering the eyes, and arranging optical sensors on the sides of the frame to sense changes in the surrounding environment. This allows for the acquisition of information related to the actual light received by the wearer and ambient lighting. Based on this information, the wearer's visual environment is determined. When abnormal behavior is detected, a health reminder message matching the scene is output. By placing two optical sensors on different surfaces of the frame, this method forms a dual-dimensional perception mechanism for both actual incoming light and ambient light, improving the accuracy of judging the actual visual state, enhancing adaptability to complex environmental changes, and prompting the wearer to adjust lighting conditions or continuous visual usage time in a timely manner. This achieves the effect of continuous visual health monitoring and reminders for everyday life scenarios.

[0069] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of this application will now be described with reference to the accompanying drawings.

[0070] First, the structure of the smart glasses provided in the embodiments of this application will be explained. Figure 1 A schematic diagram of the structure of smart glasses provided in this application embodiment. Figure 1 .like Figure 1 As shown, the smart glasses include: a frame 106, a left temple 105, a right temple 104, and lenses 107. A first optical sensor 101 is provided on the front of the frame 106, and a second optical sensor 102 is provided on the side of the frame 106.

[0071] Among them, the frame 106 refers to the frame component that serves as the main supporting structure of the smart glasses, which is used to support the lenses 107 and maintain the stability of the smart glasses wearing posture.

[0072] The frame 106 can be a full-rimmed, semi-rimless, or rimless design, or it can be designed as a modular, detachable frame. The frame 106 can be made of metal, engineering plastic, or composite materials, or it can use a combination of aluminum alloy and polymer coating to balance structural strength, lightweight, and wearing comfort.

[0073] The first optical sensor 101 can be arranged on the front of the frame 106 facing the wearer's eyes to collect light information entering the wearer's eyes. Its collection direction is adapted to the wearer's field of vision area. The collected light information can characterize the actual light intensity, light change amplitude, brightness fluctuation frequency, and light distribution state entering the eye at different time periods.

[0074] The number of first optical sensors 101 can be one or more. In the case of one sensor, the first optical sensor 101 can be positioned near the left temple 105 or near the right temple 104. In the case of two sensors, the two first optical sensors 101 can be positioned on the front of the frame 106, near the left temple 105 and near the right temple 104, respectively.

[0075] The first optical sensor 101 can be, for example, a spectral sensor or other sensor with spectral detection capabilities. This application does not limit the specific model, structure, or type of the first optical sensor 101.

[0076] The second optical sensor 102 can be arranged on the side of the frame 106 facing the external environment to collect ambient light information. Its collection direction is towards the space around the wearer, and it is used to reflect the overall lighting conditions, the trend of ambient brightness change, and the existence of surrounding light sources in the external environment.

[0077] The number of the second optical sensor 102 can be one or more. In the case of one sensor, the second optical sensor 102 can be positioned near the left temple 105 or near the right temple 104. In the case of two sensors, the two second optical sensors 102 can be respectively positioned on the side of the frame 106, near the left temple 105 and near the right temple 104.

[0078] The smart glasses provided in this embodiment form a dual-channel sensing structure by setting two optical sensors on different surfaces of the frame, which perceives both incident light to the wearer's eyes and external ambient light. The data collected by this dual-channel sensing structure can accurately reflect the light information of the wearer's current environment.

[0079] The right temple 104 and the left temple 105 are extension members that connect to both sides of the frame 106 and are used to support and fix the frame 106 near the wearer's ears. They are used to stably hold the frame 106 on the wearer's head and provide extended installation space for the battery, processor or communication unit during the overall wearing process.

[0080] The right temple 104 and the left temple 105 are connected to the frame 106 by hinges, connectors or a one-piece structure. When worn, they move synchronously with the head, so that the first optical sensor on the front of the frame and the second optical sensor on the side always maintain their relative detection positions with the eyes and the environment.

[0081] Lens 107 refers to a light-transmitting or functional optical component installed at the front of the frame 106 and located in front of the wearer's line of sight. It is used to provide the wearer with a visual pathway and work with sensors to collect light entering the eye.

[0082] The lens 107 is usually fixed in the lens slot or snap-fit ​​structure inside the frame 106, forming a stable fit with the front frame of the frame 106. When the first optical sensor is set on the front of the frame 106, it can obtain light information entering the eye through the reserved area on the edge of the lens, the light-transmitting window, or the area adjacent to the outer side of the field of vision, without significantly affecting normal vision.

[0083] In one possible implementation, a distance sensor 103 may also be provided on the front of the frame 106 of the smart glasses.

[0084] The distance sensor 103 is used to measure the distance information between the wearer and the target object. The function of the distance sensor 103 is to acquire the wearer's viewing distance changes in close-range vision scenarios, so that the smart glasses can determine whether the wearer is reading too closely, looking at a screen at close range, or in other vision-related states that may affect vision health.

[0085] The distance sensor 103 can be, for example, any one of an infrared rangefinder, a ToF (Time of Flight) ranging module, or a miniature ultrasonic ranging device.

[0086] Understandably, the distance sensor 103 is located on the front of the frame 106, preferably near the outer edge of the lens 107, in the area above the bridge of the nose, or in the middle area between the left and right lenses, so that it can measure distances in front of the wearer or in the direction of the target object.

[0087] The normal of the distance sensor 103 and the normal of the lens 107 form an angle in a first direction. Figure 2 This is a schematic diagram showing an angle between the distance sensor and the normal of a lens, as provided in an embodiment of this application. Figure 3 This is a schematic diagram illustrating the calculation of eye distance using a distance sensor, as provided in an embodiment of this application.

[0088] like Figure 2 and Figure 3 As shown, dashed line a is the normal to distance sensor 103, and dashed line b is the normal to lens 107 or frame 106. The first direction is the angle between the normal of the distance sensor 103 and the normal of the lens 107 or the frame 106. Figure 2In the X direction shown, D is the distance between the center point of the distance sensor 103 and the center point of the bridge of the glasses 106, L is the perpendicular distance between the center point of the bridge of the glasses 106 and the observed object in the first direction, and M is the distance from the distance sensor 103 to the observed object, which is also the measurement distance of the distance sensor 103.

[0089] This is understandable, based on the tangent / arctangent formula:

[0090]

[0091] The distance D between the center point of the distance sensor 103 and the center point of the bridge of the nose of the eyeglass frame 106 is typically between 5 centimeters (cm) and 7.5 cm. It is usually set between 0 and 20 degrees.

[0092] Since the comfortable viewing distance for the human eye at close range is usually greater than 30cm, if L=30 and D=5, then If L=30 and D=7.5, then, Angle Typically set between 0 and 20 degrees, this allows the ranging axis to be moderately deflected relative to the vertical direction of the lens 107, thereby reducing interference from lens reflection, lens thickness, and changes in wearing posture on the ranging results, and reducing obstruction of the wearer's vision when mounted on the front.

[0093] In scenarios where smart glasses detect the wearer's viewing distance based on the distance sensor 103, due to the angle... For a fixed value, the distance sensor 103 measures the straight-line distance M between itself and the observed object. Then, based on the cosine relationship of a right triangle, the wearer's actual viewing distance L is calculated.

[0094] .

[0095] Figure 4 This is a flowchart illustrating a control method for smart glasses provided in an embodiment of this application. This embodiment can be applied, for example, to the smart glasses shown in the above embodiments. Figure 4 As shown, the control method for smart glasses provided in this embodiment includes:

[0096] S401, Acquire light information and ambient light information.

[0097] The light information can characterize the actual light intensity, light variation amplitude, brightness fluctuation frequency, and light distribution state of the light entering the eye at different times, as received by the wearer's glasses. This light information may include, for example, one or more of the following: spectral information, brightness information, and fluctuation information of the light entering the wearer's eye.

[0098] Ambient light information can reflect the overall lighting conditions in the external environment, the trend of ambient brightness changes, and the presence of surrounding light sources. This ambient light information may include, for example, the brightness information of the ambient light in the wearer's current environment.

[0099] In this step, acquiring light and ambient light information can be accomplished, for example, through a synchronous acquisition mechanism. This involves controlling two optical sensors to output corresponding data at the same sampling time, so that the correspondence between the light entering the eye and the ambient brightness can be directly compared later.

[0100] It can also be accomplished by continuously acquiring data at preset time intervals, such as periodic sampling every 100 milliseconds, 200 milliseconds, or 500 milliseconds, and constructing a time series from multiple consecutive sampling points to support the distinction between short-term fluctuations and persistent trends.

[0101] It can also trigger acquisition when it detects changes in the wearer's eye use status. For example, when the accelerometer, posture sensor, or glasses opening and closing detection unit recognizes wearing actions, changes in head posture, the formation of reading posture, or the lighting of the terminal device, it can immediately increase the sampling frequency or execute an event to trigger acquisition.

[0102] Understandably, one could first acquire light information through the first optical sensor, and then acquire ambient light information through the second optical sensor if the light information meets preset conditions.

[0103] Understandably, before acquiring light and ambient light information, the two optical sensors can be initialized and calibrated. This includes reading zero-point bias, ambient temperature drift compensation parameters, and gain coefficients, removing the influence of sensor dark current, and suppressing transient noise through moving average, low-pass filtering, or median filtering.

[0104] In one possible embodiment, if the light information collected by the first optical sensor exhibits high-frequency flickering within a short period of time while the corresponding change in the second optical sensor is not significant, it can be determined that the fluctuation mainly originates from screen image switching or changes in reflection in the near-eye area, and this feature can be retained for subsequent eye usage scenario determination.

[0105] If the second optical sensor detects a continuous decrease in ambient brightness while the first optical sensor decreases synchronously, it indicates that the wearer is in a process of overall ambient darkening.

[0106] This step involves data collection using two optical sensors placed on different sides of the frame. This improves the real-time performance and stability of data input in dynamic environments and avoids the problem of incomplete perception of the actual eye-use environment caused by relying solely on single illumination detection. This lays the foundation for accurate identification of eye-use scenarios in the future.

[0107] S402. Determine the wearer's eye usage scenario based on light information and / or ambient light information.

[0108] Among them, the eye-use scenario refers to the type of scenario that can characterize the wearer's current visual environment and eye-use status. It can be an environmental scenario related to lighting conditions, a behavioral scenario related to eye-use methods, or a composite scenario formed by the combination of the two.

[0109] These scenarios can include, for example, viewing a screen in a lit environment, viewing a screen in a dark environment, reading in low indoor lighting conditions, and using the eyes continuously in environments with sudden changes in brightness.

[0110] In this step, the average brightness, peak value, fluctuation amplitude, slope of change, periodicity and duration characteristics of light information and ambient light information can be calculated separately. Comparison parameters reflecting the relationship between the two types of signals can be established, such as the difference, ratio, degree of synchronous change and temporal matching degree between light entering the eye and ambient light.

[0111] When the output of the first optical sensor is significantly higher than that of the second optical sensor and fluctuates periodically, it can be determined that the wearer may be looking at a light-emitting screen at close range. When both the first and second optical sensors are in a low brightness range and the duration reaches a preset threshold, it can be determined that the wearer is using their eyes in a dim environment. When the second optical sensor maintains a high brightness while the first optical sensor is relatively low and stable, it can be inferred that the wearer may be reading paper books, on a desktop, or in a partially obscured area.

[0112] In one possible implementation, the light information includes, for example, spectral information and first brightness information, and the ambient light information includes, for example, second brightness information.

[0113] Among them, spectral information is used to characterize the spectral characteristics of light entering the wearer's eyes, first brightness information is used to characterize the brightness entering the wearer's eyes, and second brightness information is used to characterize the brightness of ambient light around the wearer.

[0114] In determining the visual usage scenario, we can first determine whether the initial brightness information is greater than the preset brightness. If the initial brightness information is greater than the preset brightness, it indicates that light is currently entering the wearer's eyes. The wearer may be in a relatively bright scene or watching a screen, etc. At this time, the wearer's primary visual environment can be determined based on the spectral information.

[0115] The first visual environment is used to classify whether the wearer is in outdoor lighting conditions.

[0116] Understandably, since the spectral information of sunlight is different from that of lamplight, spectral composition analysis can be performed to determine whether the light entering the wearer's eyes is sunlight or lamplight, and thus determine whether the wearer is currently in an outdoor lighting environment.

[0117] In one possible implementation, the specific implementation of determining the wearer's primary visual environment includes: performing spectral component analysis on spectral information to obtain analysis results;

[0118] If the analysis results indicate that the spectral information meets the first condition, the first visual environment is determined to be the outdoor lighting environment;

[0119] If the analysis results indicate that the spectral information meets the second condition, the first visual environment is determined to be a non-outdoor lighting environment.

[0120] Among them, spectral composition analysis is used to identify the continuity, infrared component ratio and energy distribution characteristics in spectral information, and output analysis results for environmental assessment.

[0121] The first condition includes, for example, that the light is a continuous spectrum and that the proportion of infrared light in the continuous spectrum is less than a preset proportion.

[0122] The second condition may include, for example, that the light is a continuous spectrum and the proportion of infrared light in the continuous spectrum is not less than a preset proportion, or that the light is a non-continuous spectrum.

[0123] It is understandable that sunlight is a continuous spectrum, with the following spectral composition: ultraviolet light accounts for about 8%, visible light accounts for about 43%, and infrared light accounts for about 51%.

[0124] Incandescent lamps have a continuous spectrum, with the following spectral composition: visible light accounts for approximately 10%, and infrared light accounts for approximately 85%.

[0125] Energy-saving lamps have a discontinuous spectrum, with the following spectral components: ultraviolet light accounts for less than 1%, visible light accounts for about 95% to 98%, and infrared light accounts for about 2% to 5%. Furthermore, their visible light spectrum has three sharp peaks (corresponding to red, green, and blue, respectively), with lower energy in the middle band, and is discontinuous.

[0126] LED lights have a semi-continuous spectrum, with the following spectral composition: ultraviolet light accounts for less than 1%, visible light accounts for approximately 95% to 99%, and infrared light accounts for approximately 1% to 5%.

[0127] After the first optical sensor collects the light entering the wearer's eyes, the smart glasses can first generate spectral data containing energy distributions of different wavelengths, and then perform discrete sampling and fitting processing on the spectral data to determine whether the visible light band exhibits a continuous distribution.

[0128] If a continuous distribution is established, the ratio of infrared band energy to total energy is further calculated and compared with a preset percentage. The preset percentage can be calibrated based on different lens transmittance, sensor response curves, and application scenarios. For example, it can be set to 55%, 60%, or 70%. This application does not limit this, as long as it can distinguish between sunlight and artificial light.

[0129] When the proportion of infrared light is less than the preset proportion, the light entering the wearer's eyes is determined to be sunlight, the analysis results that meet the first condition are output, and the first eye-use environment is determined to be the outdoor lighting environment.

[0130] When the proportion of infrared light is not less than the preset proportion, the light entering the wearer's eyes is determined to be artificial light, the analysis results that meet the second condition are output, and the first visual environment is determined to be a non-outdoor lighting environment.

[0131] If multiple troughs or obvious discontinuities are detected in the visible light range, the spectrum is identified as a discontinuous spectrum (such as a non-continuous or semi-continuous spectrum), the light entering the wearer's eyes is determined to be lamp light, the analysis results that meet the second condition are output, and the first eye-use environment is determined to be a non-indoor / outdoor lighting environment.

[0132] Understandably, the outdoor and non-outdoor lighting environments determined in this step are only used to characterize whether the light entering the wearer's eyes is sunlight or artificial light, and do not indicate the wearer's current location.

[0133] For example, if the wearer is on a balcony and sunlight shines into the wearer's glasses, then the primary visual environment is determined to be the outdoor lighting environment.

[0134] Spectral composition analysis can simultaneously cover natural sunlight, strong infrared radiation environments, and other outdoor light sources with obvious discontinuities, so that the primary visual environment can still be stably identified as the outdoor lighting environment under conditions of direct sunlight, shadow shading, or complex reflection.

[0135] Since outdoor environments typically have higher natural light levels and spectral distribution characteristics different from indoor lighting, using a combination of continuous spectrum and infrared proportions can reduce the probability of misjudgment caused by relying solely on brightness thresholds. This makes subsequent eye-use scenario identification more accurate and provides a reliable basis for health reminders.

[0136] After obtaining the first visual environment, if the first visual environment is an outdoor lighting environment, it indicates that the wearer is currently under natural lighting conditions, and therefore the corresponding visual scenario is determined to be an outdoor lighting scenario.

[0137] Since it is now determined that the wearer is under natural lighting conditions, there is no need to determine the wearer's secondary visual environment through ambient light information.

[0138] If the first visual environment is a non-outdoor lighting environment, then the wearer's second visual environment needs to be determined based on the second brightness information.

[0139] The second visual environment may include, for example, a lit environment and a dark environment.

[0140] In this step, the second brightness information can be compared with the environmental threshold. If the second brightness information is higher than the environmental threshold, it indicates that the wearer is currently in a bright scene and is determined to be in a lit environment.

[0141] If the second brightness information is not higher than the environmental threshold, it indicates that the wearer is currently in a dimly lit scene, and is determined to be in a dark environment.

[0142] After obtaining the wearer's secondary visual environment indoors, the wearer's visual scenarios can be determined based on this secondary visual environment.

[0143] This scheme first uses the first brightness information to define the triggering conditions for spectral judgment, then distinguishes between outdoor and non-outdoor lighting based on the spectral information, and then uses the second brightness information to distinguish between lit and unlit environments in non-outdoor lighting environments, making scene recognition more hierarchical and accurate.

[0144] Since the eye-use scenario is determined based on the first and / or second eye-use environments, it can effectively distinguish typical situations such as outdoor lighting, looking at the screen with the lights on, and looking at the screen with the lights off, providing reliable input for subsequent identification of abnormal eye-use behaviors and generation of health reminders.

[0145] In one possible implementation, when the first visual environment indicator is a non-outdoor lighting environment and the second visual environment indicator is a lit environment, it indicates that the wearer is in an artificial lighting environment. At this time, the visual scenario can be determined to be a lit scenario, which can be further subdivided into a lit screen viewing scenario and a lit non-screen viewing scenario.

[0146] When the first visual environment indicator is a non-outdoor lighting environment and the second visual environment indicator is a dark environment, it means that the wearer is in an indoor dark environment. At this time, the visual scenario can be determined to be a dark scenario, which can be further subdivided into dark screen viewing scenario and dark screen viewing scenario.

[0147] It is understandable that the distinction between screen-viewing scenarios and non-screen-viewing scenarios can be made, for example, by using the light information collected by the first and second optical sensors, by using the camera device deployed on the smart glasses, or by using the distance sensor to detect the distance between the glasses and the object in front. This application does not limit this.

[0148] This step can form a stable scene classification result based on the first and second eye use environments, so that eye use behavior under different lighting conditions can obtain corresponding scene labels. This provides a basis for subsequent identification of abnormal behavior, generation of health reminder messages and implementation of personalized eye use intervention. At the same time, this step can reduce the probability of scene misjudgment and improve the ability to distinguish typical eye use states such as outdoor lighting, looking at the screen with the lights on and looking at the screen with the lights off, thereby improving the accuracy and practicality of eye health monitoring.

[0149] S403. If abnormal behavior corresponding to the eye-use scenario is detected, a corresponding health reminder message is generated.

[0150] Abnormal behavior refers to poor eye use conditions or behavioral patterns that do not conform to preset health rules, corresponding to a defined eye use scenario.

[0151] The health reminder message is a reminder message generated by the smart glasses based on the abnormal behavior and output to the wearer. It is used to prompt the wearer to adjust the current eye use behavior, improve lighting conditions, or interrupt the continuous eye use process.

[0152] After obtaining the corresponding eye-use scenario, abnormal behavior detection can be performed to determine whether the wearer has a condition that requires intervention.

[0153] Different visual use scenarios correspond to different abnormal behaviors. For example, in a dimly lit environment, abnormal behaviors may include: detecting continuous reading or continuous screen viewing (abnormal visual use in low light).

[0154] In screen viewing scenarios with excessively strong and frequently changing light, abnormal behaviors may include: prolonged staring (continuous eye use under bright light stimulation).

[0155] In scenarios with moderate ambient light, abnormal behaviors may include: prolonged exposure to the same scene (abnormal screen time).

[0156] In scenarios with significant changes in ambient brightness, abnormal behaviors may include: the wearer maintaining a continuous gaze (an abnormal behavior of not adapting to changes in the environment in a timely manner), etc.

[0157] Abnormal behavior detection can be performed using a threshold accumulation method, that is, when a certain eye-use scenario continues for a preset duration, a preset number of times, or the comprehensive risk score reaches a threshold, an alert is triggered to avoid frequent false alarms caused by short-term head-down, momentary dim light, or short-term screen illumination.

[0158] For example, after identifying a screen-viewing scenario in a dark environment, if the scenario lasts for more than 3 minutes, 5 minutes or other set durations, it is considered an abnormal behavior; after identifying a continuous screen-viewing scenario, if the cumulative duration exceeds 20 minutes, 30 minutes or the corresponding health policy set duration, a rest reminder will be triggered.

[0159] In one possible implementation, the process of detecting abnormal behavior includes, for example, determining the duration of the visual activity and then, based on that duration, determining whether abnormal behavior exists.

[0160] For example, in the scenario of looking at a screen with the lights off, if the duration reaches a first preset duration, it is determined that abnormal behavior corresponding to the scenario of looking at a screen with the lights off has been detected.

[0161] If the duration of visual activity is less than the second preset duration, abnormal behavior corresponding to the outdoor lighting scenario is detected.

[0162] Among them, the duration is used to characterize the continuous length of time the wearer is in a certain eye use scenario. The first preset duration is the abnormal judgment standard for the scenario of looking at the screen with the lights off, and the second preset duration is the normal exposure duration threshold for the outdoor lighting scenario. The first preset duration and the second preset duration can be stored in the memory in advance, and can also be configured according to the wearer's age, vision status or health management strategy. The first preset duration can be less than the second preset duration.

[0163] In this step, the smart glasses can start a timer based on the aforementioned scene recognition results to accumulate the time spent in the current eye-use scene and obtain the duration.

[0164] This step quantifies the duration of eye-use scenarios, enabling sustained poor eye-use behaviors such as looking at screens in the dark to be identified promptly once they exceed a set threshold. It also reverses the judgment for insufficient outdoor light exposure, thus avoiding misjudgments based solely on instantaneous environmental changes.

[0165] The generation of health reminder messages can include three processing steps: determining the reminder type, determining the reminder content, and determining the reminder output method.

[0166] The types of reminders can be divided into warning, suggestion, and rest guidance. The reminder content can be specific text or voice commands such as turning on the lights, reducing the screen brightness, adjusting the reading distance, resting the eyes temporarily, and reducing the duration of continuous gaze. The reminder output method can be completed by the vibration unit, speaker, display module built into the smart glasses, or a mobile terminal that communicates with them. For example, the first layer of reminder can be given by the vibration of the temples, and a more specific health reminder message can be given by voice broadcast if the abnormality persists.

[0167] To improve the targeting of reminders, the eye-use scenarios identified in step S102 can be used as message generation parameters, so that the reminder content corresponds one-to-one with the scenario. For example, in a dimly lit reading scenario, the message "The current environment is dark. Please add lighting before continuing to read" can be output. In a continuous screen-viewing scenario, the message "The continuous viewing time is relatively long. Please take a break and look into the distance" can be output. In a brightly lit stimulation scenario, the message "The light entering the eyes is strong. Please reduce the screen brightness or adjust the direction of your gaze" can be output.

[0168] In one possible implementation, if the same abnormal behavior occurs repeatedly within a short period of time, the alert level can be increased and the waiting time for the next alert can be shortened; if the ambient light and light entering the eyes return to normal after the alert, the alert is terminated and the result of this abnormal behavior handling is recorded for subsequent personalized threshold adjustment.

[0169] This step generates a health reminder message only after abnormal behavior continuously meets the set conditions, which can balance the timeliness of reminders with the control of accidental triggering, improve the actual wearing experience, and promote the wearer to form more reasonable eye use habits.

[0170] In one possible implementation, a distance sensor can also be provided on the front of the frame of the smart glasses. This distance sensor is used to detect the wearer's viewing distance. The specific detection process can be found in the description of the above embodiments, and will not be repeated here.

[0171] In scenarios where the wearer is reading or viewing a screen, a distance sensor can be used to determine the wearer's viewing distance; then, it can be determined whether the viewing distance is less than a preset distance.

[0172] When the viewing distance is less than a preset distance, a corresponding health reminder message is generated.

[0173] Among them, eye distance is used to indicate the distance between the wearer's eyes and the screen or reading target.

[0174] The preset distance can be set to the nearest safe distance, and its value can be set according to the wearer's age group or usage scenario, for example, it can be 30cm.

[0175] The health reminder messages in this step can be used to prompt the wearer to raise their head, move their body back, or adjust their viewing position in a timely manner to reduce the visual burden caused by prolonged close-range use of the eyes.

[0176] By placing a distance sensor on the front of the glasses frame, the device can directly obtain the wearer's eye distance and determine near-field eye use based on a preset distance. This allows for timely generation of health alerts when the distance is detected to be too close. Because the distance measurement process is close to the target area in front of the eyes, it can accurately reflect reading, screen viewing, or other near-field fixation behaviors, improving the timeliness and relevance of alert triggers.

[0177] This step helps wearers maintain a reasonable viewing distance, reduces the risk of eye strain caused by excessively close proximity, and enhances the practicality and continuous monitoring capabilities of smart glasses in eye health management.

[0178] The control method for smart glasses provided in this application involves arranging an optical sensor on the front of the frame facing the wearer's line of sight to collect light entering the eyes, and arranging an optical sensor on the side of the frame to sense changes in the surrounding environment. This allows the acquisition of information related to the actual light received by the wearer and the ambient lighting, respectively. Based on this information, the wearer's eye usage is determined. When abnormal behavior is detected, a health reminder message matching the scene is output. By setting two optical sensors on different surfaces of the frame, this method forms a dual-dimensional perception mechanism for both actual light entering the eyes and ambient light, improving the accuracy of judging the actual eye usage status, enhancing the adaptability to complex environmental changes, and prompting the wearer to adjust lighting conditions or continuous eye usage time in a timely manner. This achieves the effect of continuous eye health monitoring and reminders for everyday life scenarios.

[0179] Figure 5 This is a schematic diagram of the structure of a control device for smart glasses provided in an embodiment of this application. The executing entity in this embodiment can be, for example, the smart glasses shown in the above embodiment. A first optical sensor is provided on the front of the frame of the smart glasses for collecting light information entering the wearer's eyes, and a second optical sensor is provided on the side of the frame for collecting ambient light information. Figure 5 As shown, the control device 500 for the smart glasses includes:

[0180] Acquisition module 501 is used to acquire light information and ambient light information;

[0181] The processing module 502 is used to determine the wearer's eye-use scenario based on light information and / or ambient light information; and if abnormal behavior corresponding to the eye-use scenario is detected, it generates a corresponding health reminder message to remind the wearer to adjust their eye-use behavior.

[0182] In one possible implementation, the light information includes spectral information and first brightness information, and the ambient light information includes second brightness information. The processing module 502 is used to determine the wearer's first visual environment based on the spectral information when the first brightness information is greater than a preset brightness. The first visual environment includes an outdoor lighting environment and a non-outdoor lighting environment. When the first visual environment is a non-outdoor lighting environment, the processor determines the wearer's second visual environment based on the second brightness information. The second visual environment includes an on-light environment and an off-light environment. The processor determines the visual scene based on the first visual environment and / or the second visual environment.

[0183] In one possible implementation, the processing module 502 is used to perform spectral composition analysis on the spectral information to obtain the analysis results;

[0184] If the analysis results indicate that the spectral information meets the first condition, the first visual environment is determined to be an outdoor lighting environment. The first condition includes: the light is a continuous spectrum, and the proportion of infrared light in the continuous spectrum is less than the preset proportion.

[0185] If the analysis results indicate that the spectral information meets the second condition, the first visual environment is determined to be a non-outdoor lighting environment. The second condition includes: the light is a continuous spectrum, and the proportion of infrared light in the continuous spectrum is not less than a preset proportion, or the light is a non-continuous spectrum.

[0186] In one possible implementation, the processing module 502 is configured to: determine the viewing scenario as an outdoor lighting scenario when the first viewing environment is an outdoor lighting environment; determine the viewing scenario as a lit-up scenario when the first viewing environment is a non-outdoor lighting environment and the second viewing environment is a lit-up environment, wherein the lit-up scenario includes: viewing the screen with the lights on and not viewing the screen with the lights on; and determine the viewing scenario as a lit-up scenario when the first viewing environment is a non-outdoor lighting environment and the second viewing environment is a lit-up environment, wherein the lit-up scenario includes: viewing the screen with the lights off and not viewing the screen with the lights off.

[0187] In one possible implementation, the processing module 502 is further configured to determine the duration of the eye-use scenario; if the duration of the eye-use scenario is viewing the screen with the lights off, it is determined that abnormal behavior corresponding to the screen-viewing-with-lights scenario is detected if the duration reaches a first preset duration; and if the duration of the eye-use scenario is outdoor lighting scenario, it is determined that abnormal behavior corresponding to the outdoor lighting scenario is detected if the duration of the eye-use scenario does not reach a second preset duration.

[0188] In one possible implementation, a distance sensor is also provided on the front of the frame of the smart glasses, and the acquisition module 501 is also used to determine the wearer's viewing distance through the distance sensor;

[0189] The processing module 502 is also used to determine whether the viewing distance is less than a preset distance; and to generate a corresponding health reminder message when the viewing distance is less than the preset distance.

[0190] The control device for smart glasses provided in this embodiment can execute the control method for smart glasses provided in the above method embodiment. Its implementation principle and technical effect are similar, and will not be described in detail here.

[0191] Figure 6 This is a schematic diagram of the structure of smart glasses provided in an embodiment of this application. Figure 6As shown, the smart glasses 600 provided in this embodiment includes at least one processor 601 and a memory 602. Optionally, the clothing processing device 600 also includes a communication interface 603. The processor 601, memory 602, and communication interface 603 are connected via a bus 604.

[0192] In the specific implementation process, at least one processor 601 executes computer execution instructions stored in memory 602, causing at least one processor 601 to execute the above-described control method for smart glasses.

[0193] The specific implementation process of processor 601 can be found in the above method embodiments, and its implementation principle and technical effect are similar. It will not be repeated here.

[0194] In the above embodiments, it should be understood that the processor can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), etc. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in this invention can be directly implemented by a hardware processor, or implemented by a combination of hardware and software modules within the processor.

[0195] The memory may include random access memory (RAM) and may also include non-volatile memory (NVM), such as at least one disk storage device.

[0196] The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc. For ease of illustration, the buses shown in the accompanying drawings are not limited to a single bus or a single type of bus.

[0197] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the above-described method.

[0198] This application also provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the above-described method.

[0199] The aforementioned readable storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk. The readable storage medium can be any available medium accessible to a general-purpose or special-purpose computer.

[0200] An exemplary readable storage medium is coupled to a processor, enabling the processor to read information from and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can reside in an Application Specific Integrated Circuit (ASIC). Alternatively, the processor and the readable storage medium can exist as discrete components in the device.

[0201] The division of units is merely a logical functional division; in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be indirect coupling or communication connection through some interfaces, devices, or units, and may be electrical, mechanical, or other forms.

[0202] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0203] In addition, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0204] If a function is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this invention, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0205] Those skilled in the art will understand that all or part of the steps of the above-described method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When executed, the program performs the steps of the above-described method embodiments; and the aforementioned storage medium includes various media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.

[0206] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily essential to this application.

[0207] It should be further noted that although the steps in the flowchart are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowchart may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the sub-steps or stages of other steps.

[0208] It should be understood that the above-described device embodiments are merely illustrative, and the device of this application can also be implemented in other ways. For example, the division of units / modules in the above embodiments is only a logical functional division, and there may be other division methods in actual implementation. For example, multiple units, modules, or components may be combined, or integrated into another system, or some features may be ignored or not executed.

[0209] Furthermore, unless otherwise specified, the functional units / modules in the various embodiments of this application can be integrated into one unit / module, or each unit / module can exist physically separately, or two or more units / modules can be integrated together. The integrated units / modules described above can be implemented in hardware or as software program modules.

[0210] When integrated units / modules are implemented in hardware, the hardware can be digital circuits, analog circuits, etc. The physical implementation of the hardware structure includes, but is not limited to, transistors, memristors, etc. Unless otherwise specified, the processor can be any suitable hardware processor, such as a CPU, GPU, FPGA, DSP, and ASIC, etc. Unless otherwise specified, the storage unit can be any suitable magnetic or magneto-optical storage medium, such as Resistive Random Access Memory (RRAM), Dynamic Random Access Memory (DRAM), Static Random Access Memory (SRAM), Enhanced Dynamic Random Access Memory (EDRAM), High-Bandwidth Memory (HBM), Hybrid Memory Cube (HMC), etc.

[0211] If the integrated unit / module is implemented as a software program module and sold or used as an independent product, it can be stored in a computer-readable storage device (CMD). Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned memory includes various media capable of storing program code, such as a USB flash drive, read-only memory (ROM), random access memory (RAM), portable hard drive, magnetic disk, or optical disk.

[0212] In the above embodiments, the descriptions of each embodiment have their own emphasis. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments. The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as the combination of these technical features does not contradict each other, it should be considered within the scope of this specification.

[0213] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this application are indicated by the following claims.

[0214] It should be understood that this application is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this application is limited only by the appended claims.

Claims

1. A control method of smart glasses, characterized by, The smart glasses have a first optical sensor on the front of the frame for collecting light information entering the wearer's eyes, and a second optical sensor on the side of the frame for collecting ambient light information. The method includes: Acquire the light information and the ambient light information; Based on the light information and / or the ambient light information, the wearer's eye usage scenario is determined; If abnormal behavior corresponding to the eye-use scenario is detected, a corresponding health reminder message is generated to remind the wearer to adjust their eye-use behavior.

2. The method according to claim 1, characterized in that, The light information includes: spectral information and first brightness information; the ambient light information includes: second brightness information; determining the wearer's eye usage scenario based on the light information and / or the ambient light information includes: When the first brightness information is greater than the preset brightness, the first visual environment of the wearer is determined according to the spectral information. The first visual environment includes: outdoor lighting environment and non-outdoor lighting environment. When the first visual environment is a non-outdoor lighting environment, the second visual environment of the wearer is determined based on the second brightness information. The second visual environment includes: a light-on environment and a light-off environment. The eye-use scenario is determined based on the first eye-use environment and / or the second eye-use environment.

3. The method according to claim 2, characterized in that, Determining the wearer's first visual environment based on the spectral information includes: The spectral information was subjected to spectral component analysis to obtain the analysis results; If the analysis results indicate that the spectral information meets the first condition, the first visual environment is determined to be an outdoor lighting environment. The first condition includes: the light is a continuous spectrum, and the proportion of infrared light in the continuous spectrum is less than a preset proportion. If the analysis results indicate that the spectral information meets the second condition, the first visual environment is determined to be a non-outdoor lighting environment. The second condition includes: the light is a continuous spectrum, and the proportion of infrared light in the continuous spectrum is not less than a preset proportion, or the light is a non-continuous spectrum.

4. The method according to claim 2, characterized in that, Determining the eye-use scenario based on the first eye-use environment and / or the second eye-use environment includes: When the first visual environment is an outdoor lighting environment, the visual scenario is determined to be an outdoor lighting scenario; When the first visual environment is a non-outdoor lighting environment and the second visual environment is a lit environment, the visual scenario is determined to be a lit scenario; the lit scenario includes: a lit screen viewing scenario and a lit non-screen viewing scenario. When the first visual environment is a non-outdoor lighting environment and the second visual environment is a dark environment, the visual scenario is determined to be a dark scenario; the dark scenario includes: a dark scenario of looking at a screen and a dark scenario of not looking at a screen.

5. The method according to claim 4, characterized in that, The method further includes: Determine the duration of the visual activity in the described scenario; In the scenario of viewing the screen with the lights off, if the duration reaches a first preset duration, it is determined that abnormal behavior corresponding to the scenario of viewing the screen with the lights off has been detected. If the duration of the visual activity is not the second preset duration, it is determined that abnormal behavior corresponding to the outdoor lighting scenario has been detected.

6. The method according to claim 1, characterized in that, The smart glasses also have a distance sensor on the front of the frame, and the method further includes: The distance sensor is used to determine the wearer's viewing distance; Determine whether the viewing distance is less than a preset distance; When the viewing distance is less than a preset distance, a corresponding health reminder message is generated.

7. A control device for smart glasses, characterized in that, The smart glasses have a first optical sensor on the front of the frame for collecting light information entering the wearer's eyes, and a second optical sensor on the side of the frame for collecting ambient light information. The device includes: The acquisition module is used to acquire the light information and ambient light information; The processing module is used to determine the wearer's eye-use scenario based on the light information and / or the ambient light information; and if abnormal behavior corresponding to the eye-use scenario is detected, generate a corresponding health reminder message, which is used to remind the wearer to adjust their eye-use behavior.

8. A type of smart glasses, characterized in that, include: The glasses include a frame, temples, lenses, and a processor. A first optical sensor is provided on the front of the frame, and a second optical sensor is provided on the side of the frame. The first optical sensor is used to collect information about the light entering the wearer's eyes; The second optical sensor is used to collect ambient light information; The processor is used to implement the control method for the smart glasses according to any one of claims 1-6.

9. The smart glasses according to claim 8, characterized in that, A distance sensor is also provided on the front of the eyeglass frame; The normal of the distance sensor and the normal of the lens are at an angle in a first direction, and the angle is any angle between 0 degrees and 20 degrees.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, are used to implement the method as described in any one of claims 1 to 6.

Images