A method, apparatus, and device for protecting the eyes of electronic devices with cameras.

Abstract

This application provides a method, apparatus, and device for eye protection in electronic devices with cameras. The method includes: acquiring real-time facial images captured by the camera; determining corresponding user behavior information based on the facial images, including user head movements and eye postures; calculating user screen time based on the user behavior information; and activating the near-infrared module to emit near-infrared light when the infrared activation conditions are met based on the user screen time. This solution solves the problem of insufficient intelligence and inability to reasonably determine whether to perform eye protection in related technologies by analyzing user behavior to determine whether to activate the near-infrared module. It can intelligently activate the near-infrared eye protection function and reasonably protect the user's eye health.

Description

Technical Field

[0001] This application relates to the field of artificial intelligence technology, and in particular to a method, apparatus, and device for protecting the eyes of electronic devices with cameras. Background Technology

[0002] With the rapid development of technology, people are spending increasingly more time on electronic devices with screens, such as laptops, mobile phones, tablets, televisions, digital displays, and self-service terminals. Prolonged screen time can easily lead to decreased vision, dry eyes, and even serious consequences such as worsening myopia, astigmatism, and retinal detachment. Research has found that near-infrared light can penetrate deep into eye tissues, producing beneficial substances such as nitric oxide. These substances help dilate blood vessels, improve blood circulation in the eyes, and thus relieve eye fatigue. At the same time, near-infrared light can also promote the metabolism of eye cells, helping to maintain healthy eyes.

[0003] In most related technologies, near-infrared light devices are configured on electronic devices, and near-infrared light eye protection is performed by setting an alarm clock. This method of eye protection requires users to set the eye protection time themselves, and cannot reasonably and autonomously determine whether to perform eye protection, resulting in low intelligence. Summary of the Invention

[0004] This application provides a method, device, and equipment for protecting the eyes of electronic devices with cameras, which solves the problems of related technologies that cannot reasonably determine whether to protect the eyes and have low intelligence. It can intelligently activate the near-infrared eye protection function to reasonably protect the user's eye health.

[0005] In a first aspect, embodiments of this application provide a method for protecting the eyes of an electronic device with a camera, the electronic device integrating a near-infrared module, the method comprising:

[0006] Acquire real-time facial images captured by a camera, and determine corresponding user behavior information based on the facial images. The user behavior information includes user head movements and eye postures.

[0007] The duration of user screen time is calculated based on the user behavior information.

[0008] If the infrared activation conditions are met based on the user's eye usage time, the near-infrared module is activated to emit near-infrared light.

[0009] Optionally, the user's head movements include the user's head rotation angle, the eye posture includes the pupil center coordinates, and the step of calculating the user's eye usage time based on the user behavior information includes:

[0010] Based on the real-time captured facial images, the user's focus duration and corresponding focus weight are determined by multiple head deflection angles and pupil center coordinates.

[0011] The user's screen time is calculated based on the user's focus duration and the corresponding focus weight.

[0012] Optionally, the step of determining the user's focus duration and corresponding focus weight based on multiple user head deflection angles determined from real-time acquired facial images and the pupil center coordinates includes:

[0013] The rate of change of the user's head deflection angle is determined based on multiple head deflection angles determined from real-time acquired facial images.

[0014] Multiple user focus duration segments are determined based on the rate of change in the user's head deflection angle.

[0015] In each user focus duration segment, the focus weight corresponding to the user focus duration segment is determined based on the pupil center coordinates determined by the corresponding face image.

[0016] Optionally, satisfying the infrared activation condition includes:

[0017] The user's screen time exceeds the preset infrared activation time, and any one or more of the following settings—screen size, screen brightness, screen viewing distance, and near-infrared activation frequency—meet the corresponding values.

[0018] Optionally, after activating the near-infrared module, the method further includes:

[0019] The infrared irradiation time is calculated based on the user's head movements and eye posture determined from the collected facial images after the near-infrared module is turned on.

[0020] If the infrared shutdown condition is met based on the infrared irradiation time, the near-infrared module is turned off.

[0021] Optionally, satisfying the infrared off condition includes:

[0022] The infrared irradiation time is greater than the preset infrared off time, and any one or more of the power, wavelength range, irradiation distance, and number of times the near-infrared module is turned on meet the corresponding set values.

[0023] Optionally, the eye protection method for the electronic device with a camera further includes:

[0024] With the camera turned on, and the device confirmed to be being used for the first time that day and with eye protection settings enabled, the near-infrared module will be activated to emit near-infrared light.

[0025] Optionally, before acquiring the real-time facial images captured by the camera, the following steps are also included:

[0026] If a face is detected in an image captured by a camera and the distance to the face is less than a preset distance, personal identity information is verified.

[0027] If the verification result of the personal identity information is that the user has registered, the associated eye protection information is obtained from the cloud server for use in turning the near-infrared module on and / or off.

[0028] Secondly, embodiments of this application also provide an eye protection device for an electronic device with a camera. The electronic device integrates a near-infrared module and a camera. The near-infrared module is a near-infrared lamp and / or a display screen with near-infrared light output and control functions. The device includes:

[0029] The acquisition module is used to acquire real-time facial images captured by the camera;

[0030] The information determination module is used to determine corresponding user behavior information based on the face image, wherein the user behavior information includes user head movements and eye postures;

[0031] The statistics module is used to calculate the user's screen time based on the user behavior information;

[0032] The near-infrared activation module is used to activate the near-infrared module to emit near-infrared light when the infrared activation conditions are met based on the user's eye usage time.

[0033] Thirdly, embodiments of this application also provide an eye protection device for electronic devices with cameras, the device comprising:

[0034] One or more processors;

[0035] Storage device for storing one or more programs.

[0036] When the one or more programs are executed by the one or more processors, the one or more processors implement the eye protection method for electronic devices with cameras described in the embodiments of this application.

[0037] Fourthly, embodiments of this application also provide a storage medium for storing computer-executable instructions, which, when executed by a computer processor, are used to perform the eye protection method for an electronic device with a camera described in embodiments of this application.

[0038] In this embodiment, after acquiring real-time facial images from the camera, corresponding user behavior information is determined based on these images. This information includes the user's head movements and eye posture. The user's screen time is calculated based on this behavior information. If the screen time meets the conditions for activating the near-infrared module, the module is activated to emit near-infrared light. This solution analyzes user behavior to determine whether to activate the near-infrared module, solving the problem of insufficient intelligence and inability to reasonably determine whether eye protection is needed in related technologies. It intelligently activates the near-infrared eye protection function, reasonably ensuring the user's eye health. Attached Figure Description

[0039] Figure 1 A flowchart illustrating an eye protection method for an electronic device with a camera, provided as an embodiment of this application;

[0040] Figure 2 A flowchart illustrating an eye protection method for electronic devices that includes statistical analysis of screen time, provided as an embodiment of this application;

[0041] Figure 3 A flowchart illustrating an eye protection method for an electronic device including activating a near-infrared module, provided in this application embodiment;

[0042] Figure 4 A flowchart illustrating an eye protection method for an electronic device, including disabling a near-infrared module, is provided as an embodiment of this application.

[0043] Figure 5 A flowchart illustrating another eye protection method for an electronic device including activating a near-infrared module, provided in an embodiment of this application;

[0044] Figure 6 A flowchart illustrating an eye protection method for an electronic device that includes acquiring eye protection information, provided in an embodiment of this application;

[0045] Figure 7 A module structure block diagram of an eye protection device for an electronic device with a camera, provided for an embodiment of this application;

[0046] Figure 8 This is a schematic diagram of the structure of an eye protection device with a camera provided in an embodiment of this application. Detailed Implementation

[0047] The embodiments of this application will be further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are merely illustrative of the embodiments of this application and are not intended to limit the scope of the embodiments. Furthermore, it should be noted that, for ease of description, only the parts relevant to the embodiments of this application are shown in the accompanying drawings, not the entire structure.

[0048] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and or or" indicates at least one of the connected objects, and the character "or" generally indicates that the preceding and following related objects have an "or" relationship.

[0049] This application provides a method for protecting the eyes of electronic devices with cameras. This method can be applied to scenarios involving screen-equipped devices such as personal computers, laptops, mobile phones, tablets, televisions, digital displays, game consoles, VR glasses, smart helmets, smart speakers, and self-service terminals. It can also be applied to independent external devices such as smart cameras and smart USB tokens with cameras. In this method, the execution entity for each step can be a computer device. This computer device refers to any electronic device with data computing, processing, and storage capabilities, such as personal computers, laptops, mobile phones, tablets, televisions, digital displays, game consoles, VR glasses, smart helmets, smart speakers, self-service terminals, smart cameras, and smart USB tokens with cameras.

[0050] Figure 1 A flowchart illustrating an eye protection method for an electronic device with a camera, as provided in this application embodiment, is shown below. Figure 1 As shown, it specifically includes:

[0051] Step S101: Acquire the face image captured in real time by the camera, and determine the corresponding user behavior information based on the face image captured in real time. The user behavior information includes the user's head movements and eye posture.

[0052] Here, a facial image refers to an image containing the user's face, captured by a camera; of course, this image may also include any background content. Subsequent analysis of these multiple real-time captured facial images is then used to determine the corresponding user's behavioral information.

[0053] Among them, user behavior information represents data related to the user's behavior corresponding to the facial image, such as the user's head movements and eye postures. For example, user head movements can be head tilting angles, looking down, looking up, turning the head, etc. Eye postures can be the postures of the user's eyes, such as closing the eyes, blinking, and the position of the pupil center.

[0054] In one embodiment, a method for determining user behavior information may be to analyze real-time captured facial images based on image analysis algorithms to obtain the corresponding user head movements and eye postures.

[0055] In another embodiment, a method for determining user behavior information may be to analyze each face image based on an image analysis algorithm when multiple face images are captured in real time by a camera to obtain the corresponding user head movements and eye postures.

[0056] Optionally, when the captured face image contains multiple faces, the method to determine user behavior information can be to analyze the face image of the user closest to the device screen based on the image analysis algorithm when multiple face images are captured in real time by the camera to obtain the corresponding user head movements and eye postures.

[0057] Step S102: Calculate the user's screen time based on the user behavior information corresponding to the real-time collected face images.

[0058] The user's eye usage time can be the actual length of time the user gazes at the screen of an electronic device. In one embodiment, the user's head movements include the angle of head rotation, and the eye posture includes the pupil center coordinates. One method for calculating the user's eye usage time is to start a first timer to record the total time when the camera is automatically turned on and captures a facial image, and start a second timer to record the interruption time when the user's head rotation angle exceeds a preset threshold or the pupil center coordinates exceed a preset boundary range. The difference between the total time and the interruption time is then calculated to obtain the user's eye usage time.

[0059] The user's head rotation angle can be the angle of rotation of the user's head in a vertical plane, horizontal plane, or forward / backward direction. The pupil center coordinates refer to the precise coordinate position of the pupil center in the image coordinate system. The preset boundary range can be the coordinate range of the pre-set electronic device screen boundary. By combining user head movements and eye postures to statistically analyze user eye usage time, the rationality and accuracy of eye usage time can be improved.

[0060] Step S103: If the infrared activation conditions are met based on the statistical data of user eye usage time, activate the near-infrared module to emit near-infrared light.

[0061] The infrared activation conditions characterize the conditions required to activate the near-infrared module. The near-infrared module can be installed in a camera or configured independently. This module can be a near-infrared lamp and / or a display screen with near-infrared light output and control functions.

[0062] In one embodiment, one way to activate the near-infrared module is to compare the user's eye usage time with a preset activation time after calculating the user's eye usage duration. If the user's eye usage time reaches the preset activation time, the near-infrared module is activated to emit near-infrared light. The preset activation time can be a pre-set duration based on actual conditions and is not subject to a fixed value. By determining whether to activate the near-infrared module based on the calculated user eye usage time, it is possible to reasonably determine whether the user's eyes are fatigued, and thus activate the near-infrared module for eye protection.

[0063] In another embodiment, one way to activate the near-infrared module is to look up a preset standard eye-use duration table based on the screen size, screen brightness, screen viewing distance, and the number of times the near-infrared module is activated to obtain the corresponding standard eye-use duration. If the user's total eye-use duration exceeds the standard eye-use duration, the near-infrared module is activated to emit near-infrared light.

[0064] Optionally, when the camera captures multiple facial images in real time, the infrared activation condition is determined based on the longest statistically recorded user eye usage time among the multiple facial images. Alternatively, the user closest to the device screen can be identified, and the infrared activation condition can be determined based on the statistically recorded user eye usage time corresponding to that user.

[0065] As described above, after acquiring real-time facial images from the camera, the corresponding user behavior information, including head movements and eye postures, is determined based on these images. The user's screen time is then calculated based on this behavior information. If the screen time meets the conditions for activating the near-infrared module, the module is activated to emit near-infrared light. This solution analyzes user behavior to determine whether to activate the near-infrared module, solving the problem of insufficient intelligence and inability to reasonably determine whether eye protection is needed in related technologies. It intelligently activates the near-infrared eye protection function, reasonably ensuring the user's eye health.

[0066] Figure 2 The flowchart provided in this application embodiment illustrates a method for protecting the eyes of electronic devices by statistically analyzing screen time. It outlines an optional method for statistically analyzing user screen time, such as... Figure 2 As shown, it specifically includes:

[0067] Step S201: Obtain the face image captured in real time by the camera, and determine the corresponding user behavior information based on the face image captured in real time. The user behavior information includes the user's head movements and eye postures. The user's head movements include the angle of the user's head rotation, and the eye postures include the coordinates of the pupil center.

[0068] Step S202: Determine the user's focus duration and corresponding focus weight based on the multiple user head deflection angles and pupil center coordinates determined from the real-time collected face images, and calculate the user's eye usage time based on the user's focus duration and corresponding focus weight.

[0069] The user's head rotation angle can be the angle of rotation of the user's head in the vertical plane, horizontal plane, or forward / backward direction. The pupil center coordinates refer to the precise coordinates of the pupil center in the image coordinate system. Using the user's head rotation angle and pupil center coordinates, the user's focus period and corresponding focus weight can be determined. The user's focus duration segment represents the time period during which the user gazes at the electronic device screen. The focus weight represents the degree of focus the user has while gazing at the electronic device screen. Using the user's focus duration segment and corresponding focus weight, the user's eye usage time can be calculated.

[0070] Optionally, one way to determine the user's focus duration and corresponding focus weight is to determine the change rate of the user's head deflection angle based on multiple user head deflection angles determined from real-time collected facial images, determine multiple user focus durations based on the change rate of the user's head deflection angle, and determine the focus weight corresponding to each user focus duration based on the pupil center coordinates determined from the corresponding facial image within each user focus duration.

[0071] In one embodiment, the method for determining the user's focus duration and focus weight can be as follows: based on multiple user head deflection angles determined from real-time captured facial images, determine the rate of change of user head deflection angles; determine the time period corresponding to the user head deflection angle change rate that is less than a preset rate of change as the user focus duration; within each user focus duration, calculate the pupil center movement rate based on the pupil center coordinates determined from the corresponding facial image; query the corresponding weight adjustment value based on the pupil center movement rate; and adjust the initial weight of the corresponding user focus duration based on the weight adjustment value to obtain the focus weight.

[0072] The pupil center movement rate can be defined as the percentage of time the pupil center coordinates move within a user's focus duration. A higher pupil center movement rate corresponds to a lower focus weight. The initial weights for each user focus duration are the same. For example, with a preset change rate of 5° / s, the calculated change rates of the user's head deflection angle for durations 1, 2, 3, and 4 are 10° / s, 0, 3° / s, and 4° / s, respectively. The change rates of the user's head deflection angle for durations 2, 3, and 4 are less than the preset change rate; therefore, durations 2, 3, and 4 are considered the user's focus durations. The initial weight for each user's focus duration is 1. In duration 2, the pupil center movement rate is calculated to be 8% based on the pupil center coordinates determined by the corresponding face image, and the corresponding weight adjustment value is +0.3, so the focus weight for duration 2 is 1.3. In duration 3, the pupil center movement rate is calculated to be 25% based on the pupil center coordinates determined by the corresponding face image, and the corresponding weight adjustment value is 0, so the focus weight for duration 3 is still 1. In duration 4, the pupil center movement rate is calculated to be 55% based on the pupil center coordinates determined by the corresponding face image, and the corresponding weight adjustment value is -0.4, so the focus weight for duration 4 is 0.6.

[0073] In another embodiment, the method for determining the user's focus duration and focus weight can also be as follows: Based on multiple user head deflection angles determined from real-time collected facial images, the change rate of the user's head deflection angle is determined. The time period corresponding to the change rate of the user's head deflection angle within a preset change rate range is determined as the user's focus duration. In each user focus duration, the pupil center movement rate is calculated based on the pupil center coordinates determined from the corresponding facial image. The pupil center movement rate is substituted into a preset weight calculation formula to obtain the focus weight of the corresponding user focus duration. The preset weight calculation formula is 1 + (a - pupil center movement rate), where a is a value preset according to the actual situation.

[0074] In one embodiment, a method for calculating user eye usage time based on user focus duration segments and corresponding focus weights can be to multiply each user focus duration segment by its corresponding focus weight and then sum them up to obtain the user eye usage time. For example, user focus duration segment 1, user focus duration segment 2, and user focus duration segment 3 are determined, with corresponding focus weights of 1.2, 0.8, and 1 respectively, and corresponding durations of 20 minutes, 10 minutes, and 15 minutes respectively. Multiplying each user focus duration segment by its corresponding focus weight and summing them up yields a user eye usage time of 47 minutes.

[0075] Step S203: If the infrared activation conditions are met based on the statistical data of user eye usage time, activate the near-infrared module to emit near-infrared light.

[0076] As described above, after determining the user's head rotation angle and pupil center coordinates based on real-time captured facial images, the system uses multiple head rotation angles and pupil center coordinates determined from these real-time captured facial images to identify user focus duration segments and corresponding focus weights. Based on these focus duration segments and corresponding focus weights, the system calculates the user's eye usage time. This solution, by combining user head rotation angles and pupil center coordinates to statistically analyze user eye usage time, can improve the rationality and accuracy of eye usage time statistics.

[0077] Figure 3 A flowchart illustrating an eye protection method for an electronic device including activating a near-infrared module, provided in this application embodiment, shows an optional specific method for activating the near-infrared module, such as... Figure 3 As shown, it specifically includes:

[0078] Step S301: Acquire the face image captured in real time by the camera, and determine the corresponding user behavior information based on the face image captured in real time. The user behavior information includes the user's head movements and eye posture.

[0079] Step S302: Calculate the user's screen time based on the user behavior information corresponding to the real-time collected face images.

[0080] Step S303: When the user's screen time exceeds the preset infrared activation time, and one or more of the following settings—screen size, screen brightness, screen viewing distance, and near-infrared activation frequency—are met, activate the near-infrared module to emit near-infrared light.

[0081] The preset infrared activation duration is a pre-set standard screen time used to determine whether the near-infrared module should be activated. This preset infrared activation duration can be set according to actual conditions. Screen size refers to the size of the electronic device's display screen. Screen brightness refers to the brightness of the electronic device's screen. Screen viewing distance refers to the distance at which the user views the electronic device's screen. Near-infrared activation count refers to the total number of times the near-infrared module has been activated. By comparing the preset infrared activation duration with the corresponding settings for screen size, screen brightness, screen viewing distance, and near-infrared activation count, it can be determined whether the near-infrared module is activated. For example, if the preset infrared activation duration is 1 hour, the screen size is 11 inches, the screen brightness is 60%, the screen viewing distance is 20cm, and the near-infrared activation count is 2, and the current user screen time is 1.5 hours, the current screen size is 13 inches, the screen brightness is 40%, the screen viewing distance is 20cm, and the near-infrared activation count is 1, the current user screen time exceeds the preset infrared activation duration, and the screen viewing distance meets the corresponding settings, then the near-infrared module is activated to emit near-infrared light. Another example could be: the preset infrared activation time is 1 hour, the screen size is set to 11 inches, the screen brightness is set to 60%, the screen viewing distance is set to 20cm, and the near-infrared activation count is set to 2 times. The current user screen time is 1.5 hours, and the current screen size is 11 inches, the screen brightness is 60%, the screen viewing distance is 20cm, and the near-infrared activation count is 2 times. The user screen time exceeds the preset infrared activation time, and the screen size, screen brightness, screen viewing distance, and near-infrared activation count all meet the corresponding settings. In this case, the near-infrared module is activated to emit near-infrared light.

[0082] As described above, after calculating the user's screen time, the near-infrared module is activated to emit near-infrared light if the calculated screen time exceeds the preset infrared activation time, and if any one or more of the following parameters—screen size, screen brightness, screen viewing distance, and near-infrared activation frequency—meet their respective settings. This solution introduces other parameters based on user screen time to determine the activation of the near-infrared module, thereby improving the rationality of its activation.

[0083] Figure 4 A flowchart illustrating an eye-protection method for an electronic device including disabling a near-infrared module, provided in this application embodiment, illustrates an optional specific method for disabling the near-infrared module, such as... Figure 4 As shown, it specifically includes:

[0084] Step S401: Acquire the face image captured in real time by the camera, and determine the corresponding user behavior information based on the face image captured in real time. The user behavior information includes the user's head movements and eye posture.

[0085] Step S402: Calculate the user's screen time based on the user behavior information corresponding to the real-time collected face images.

[0086] Step S403: If the infrared activation conditions are met based on the statistical data of user eye usage time, activate the near-infrared module to emit near-infrared light.

[0087] Step S404: Based on the user's head movements and eye posture determined from the collected face images after the near-infrared module is turned on, calculate the infrared irradiation time. If the infrared irradiation time determines that the infrared shutdown condition is met, turn off the near-infrared module.

[0088] The infrared irradiation time refers to the duration for which near-infrared light emitted by the near-infrared module reaches the user's eyes. Based on this irradiation time, if the infrared shutdown conditions are met, the near-infrared module is turned off. These infrared shutdown conditions are pre-set conditions that must be met to shut down the near-infrared module.

[0089] In one embodiment, user head movements include head rotation angle, and eye posture includes pupil center coordinates. One method for calculating infrared irradiation time is to determine the rate of change of user head rotation angle based on multiple user head rotation angles determined from real-time facial images acquired after the near-infrared module is turned on; to determine multiple user focus periods based on the rate of change of user head rotation angle; to determine the focus weight corresponding to each user focus period based on the pupil center coordinates determined from the corresponding facial image; and to calculate the infrared irradiation time based on the user focus duration and the corresponding focus weight.

[0090] Optionally, one way to shut down the near-infrared module is to shut it down when the infrared irradiation time exceeds a preset infrared shutdown duration, and one or more of the near-infrared module's power, wavelength range, irradiation distance, and number of on / off cycles meet the corresponding set values. The preset infrared shutdown duration can be a pre-set standard irradiation time used to determine whether to shut down the near-infrared module. This preset infrared shutdown duration is not a fixed value and is set according to actual conditions. For example, if the preset infrared shutdown duration is 30 minutes, the near-infrared module's power is set to 500 milliwatts, the wavelength range is set to (750 nm, 850 nm), the irradiation distance is set to 20 cm, and the current measured infrared irradiation time is 45 minutes, and the current near-infrared module's power is 450 milliwatts, the wavelength range is (750 nm, 850 nm), the irradiation distance is 20 cm, and the number of on / off cycles is 1, then the near-infrared module is shut down if the current measured infrared irradiation time exceeds the preset infrared shutdown duration, and the near-infrared module's wavelength range and irradiation distance meet the corresponding set values.

[0091] In another embodiment, one way to turn off the near-infrared module is to look up a preset standard irradiation duration table based on the current power, wavelength range, irradiation distance, and number of times the near-infrared module is turned on to obtain the corresponding standard irradiation duration. If the statistical user's eye usage time exceeds the standard irradiation duration, the near-infrared module is turned off.

[0092] As described above, after the near-infrared module is activated, the infrared irradiation time is calculated based on the user's head movements and eye posture determined from the collected facial images. If the infrared irradiation time meets the conditions for shutting down, the near-infrared module is then deactivated. This solution improves the accuracy of the calculated infrared irradiation time by calculating the user's head movements and eye posture, and determines whether to deactivate the near-infrared module based on this time, ensuring the reasonable deactivation of the near-infrared module and guaranteeing the effectiveness of the eye protection function.

[0093] Figure 5 The flowchart of another eye protection method for an electronic device including activating a near-infrared module provided in the embodiments of this application illustrates another optional method for activating the near-infrared module, such as... Figure 5 As shown, it specifically includes:

[0094] Step S501: Acquire the face image captured in real time by the camera, and determine the corresponding user behavior information based on the face image captured in real time. The user behavior information includes the user's head movements and eye posture.

[0095] Step S502: Calculate the user's screen time based on the user behavior information corresponding to the real-time collected face images.

[0096] Step S503: If the infrared activation conditions are met based on the statistical data of user eye usage time, activate the near-infrared module to emit near-infrared light.

[0097] Step S504: With the camera turned on and the device confirmed to be being used for the first time that day and with eye protection tasks set, turn on the near-infrared module to emit near-infrared light.

[0098] The eye protection task can be a pre-set duration of near-infrared light exposure that the user needs to complete. In one embodiment, when the camera is turned on, it is determined whether the user corresponding to the captured facial image has logged in on the current device and other associated eye protection electronic devices that day, and whether a corresponding eye protection task has been set. If it is determined that the device is being used for the first time that day and an eye protection task has been set, the near-infrared module is turned on to emit near-infrared light. In another embodiment, when the camera is turned on, if the identity of the user corresponding to the captured facial image cannot be confirmed, a temporary account is created for the user, and it is determined whether an eye protection task for the temporary user is set on the device. If an eye protection task for the temporary user is set, the near-infrared module is turned on to emit near-infrared light.

[0099] As described above, when the camera is turned on, the device is confirmed to be being used for the first time that day, and an eye protection task is set, the near-infrared module is activated to emit near-infrared light. This solution automatically executes the eye protection task when the device is being used for the first time that day and an eye protection task is set, requiring no manual intervention.

[0100] Figure 6 The flowchart provided in this application embodiment illustrates a method for obtaining eye protection information in an electronic device, including a method for acquiring eye protection information, such as... Figure 6 As shown, it specifically includes:

[0101] Step S601: If a face is detected in the image captured by the camera and the distance to the face is less than a preset distance, verify the personal identity information. If the verification result of the personal identity information is that the person is registered, obtain the associated eye protection information from the cloud server for subsequent activation and / or deactivation of the near-infrared module.

[0102] The eye protection information can be data uploaded by the user to the cloud server during the eye protection process. Examples include the infrared irradiation time uploaded when performing an eye protection task, task completion information uploaded after completing the task for the day, and screen time uploaded if the user continues to use the device after completing eye protection. This eye protection information can be used to determine the user's current eye protection status, which can then be used to subsequently enable and disable the near-infrared module. Examples of status information include initial login status, eye protection task execution status, eye usage tracking status, and eye health maintenance status.

[0103] In one embodiment, if the eye protection status corresponding to the eye protection information is the first login status of the day, then the system will proceed to the first login and check whether the user has set up an eye protection task. If the eye protection status corresponding to the eye protection information is the eye protection task execution status, then the eye protection task will continue. If the eye protection status corresponding to the eye protection information is the eye use tracking status, then the system will continue to track the user's eye use status and determine whether the near-infrared module needs to be turned on. If the eye protection status corresponding to the eye protection information is the eye health care status, then the near-infrared module will continue to be turned on, and it will determine whether the near-infrared module should be turned off.

[0104] In one embodiment, obtaining eye protection information can be achieved by extracting features from the captured facial image when a face is detected in an image captured by a camera and the distance to the face is less than a preset distance. The extracted facial features are then compared with registered user information on a cloud server. If the comparison is successful, the user's identity verification result is confirmed as registered, and the associated eye protection information is retrieved from the cloud server for subsequent activation and / or deactivation of the near-infrared module. Through the collaboration of cloud services, users can switch between multiple devices without affecting their eye protection efforts.

[0105] In another embodiment, one way to obtain eye protection information is to verify personal identity information when a face is detected in an image captured by a camera and the distance between the face and the face is less than a preset distance. If the verification result of the personal identity information is that the account is not registered or is a temporary account, the eye protection information corresponding to the personal identity information is obtained on the local device for subsequent activation and / or deactivation of the near-infrared module.

[0106] In another embodiment, if a face is detected in an image captured by a camera and the distance to the face is less than a preset distance, personal identity information is verified. If the user's identity cannot be confirmed, a temporary account is created for the user.

[0107] Step S602: Obtain the face image captured in real time by the camera, and determine the corresponding user behavior information based on the face image captured in real time. The user behavior information includes the user's head movements and eye posture.

[0108] Step S603: Calculate the user's screen time based on the user behavior information corresponding to the real-time collected face images.

[0109] Step S604: If the infrared activation conditions are met based on the statistical data of user eye usage time, activate the near-infrared module to emit near-infrared light.

[0110] As described above, when a face is detected in the image captured by the camera and the distance to the face is less than a preset distance, personal identity information is verified. If the verification result indicates that the user is registered, the associated eye protection information is retrieved from the cloud server for subsequent activation and / or deactivation of the near-infrared module. This solution, through the collaboration of cloud services, allows users to switch between multiple devices without affecting their eye protection work.

[0111] Figure 7 This application provides a module structure block diagram of an eye protection device for an electronic device with a camera, which is used to execute the eye protection method for an electronic device with a camera provided in the above embodiment. It has corresponding functional modules and beneficial effects for executing the method. Figure 7 As shown, the device specifically includes:

[0112] The acquisition module 101 is used to acquire face images captured in real time by the camera;

[0113] The information determination module 102 is used to determine corresponding user behavior information based on the face image, wherein the user behavior information includes user head movements and eye postures.

[0114] The statistics module 103 is used to count the user's screen time based on the user behavior information;

[0115] The near-infrared activation module 104 is used to activate the near-infrared module to emit near-infrared light when the infrared activation conditions are met based on the user's eye usage time.

[0116] As described above, after acquiring real-time facial images from the camera, the corresponding user behavior information, including head movements and eye postures, is determined based on these images. The user's screen time is then calculated based on this behavior information. If the screen time meets the conditions for activating the near-infrared module, the module is activated to emit near-infrared light. This solution, by analyzing user behavior to determine whether to activate the near-infrared module, solves the problem of insufficient intelligence and inability to reasonably determine whether eye protection is needed in related technologies. It intelligently activates the near-infrared eye protection function, reasonably ensuring the user's eye health.

[0117] In one possible embodiment, the statistics module 103 is specifically used for:

[0118] Based on the real-time captured facial images, the user's focus duration and corresponding focus weight are determined by multiple head deflection angles and pupil center coordinates.

[0119] The user's screen time is calculated based on the user's focus duration and the corresponding focus weight.

[0120] In one possible embodiment, the statistics module 103 is further configured to:

[0121] The rate of change of the user's head deflection angle is determined based on multiple head deflection angles determined from real-time acquired facial images.

[0122] Multiple user focus duration segments are determined based on the rate of change in the user's head deflection angle.

[0123] In each user focus duration segment, the focus weight corresponding to the user focus duration segment is determined based on the pupil center coordinates determined by the corresponding face image.

[0124] In one possible embodiment, the near-infrared activation module 104 is specifically used for:

[0125] The user's screen time exceeds the preset infrared activation time, and any one or more of the following settings—screen size, screen brightness, screen viewing distance, and near-infrared activation frequency—meet the corresponding values.

[0126] In one possible embodiment, a near-infrared shutdown module is also included, specifically for:

[0127] The infrared irradiation time is calculated based on the user's head movements and eye posture determined from the collected facial images after the near-infrared module is turned on.

[0128] If the infrared shutdown condition is met based on the infrared irradiation time, the near-infrared module is turned off.

[0129] In one possible embodiment, the near-infrared shut-off module is further configured to:

[0130] The infrared irradiation time is greater than the preset infrared off time, and any one or more of the power, wavelength range, irradiation distance, and number of times the near-infrared module is turned on meet the corresponding set values.

[0131] In one possible embodiment, the near-infrared activation module 104 is further configured to:

[0132] With the camera turned on, and the device confirmed to be being used for the first time that day and with eye protection settings enabled, the near-infrared module will be activated to emit near-infrared light.

[0133] In one possible embodiment, an authentication module is also included, specifically for:

[0134] If a face is detected in an image captured by a camera and the distance to the face is less than a preset distance, personal identity information is verified.

[0135] The acquisition module 101 is specifically used for:

[0136] If the verification result of the personal identity information is that the user has registered, the associated eye protection information is obtained from the cloud server for use in turning the near-infrared module on and / or off.

[0137] Figure 8 This application provides a schematic diagram of the structure of an eye protection device for an electronic device with a camera, as shown in the embodiment of the present application. Figure 8 As shown, the device includes a processor 201, a memory 202, an input device 203, and an output device 204; the number of processors 201 in the device can be one or more. Figure 8 Taking a processor 201 as an example; the processor 201, memory 202, input device 203, and output device 204 in the device can be connected via a bus or other means. Figure 8 Taking a bus connection as an example, the memory 202, as a computer-readable storage medium, can be used to store software programs, computer-executable programs, and modules, such as the program instructions or modules corresponding to the eye protection method for an electronic device with a camera in this embodiment. The processor 201 executes various functional applications and data processing of the device by running the software programs, instructions, and modules stored in the memory 202, thereby realizing the aforementioned eye protection method for an electronic device with a camera. The input device 203 can be used to receive input digital or character information and generate key signal inputs related to user settings and function control of the device. The output device 204 may include a display screen or other display device.

[0138] This application also provides a storage medium containing computer-executable instructions, which, when executed by a computer processor, are used to perform an eye protection method for an electronic device with a camera, the method comprising:

[0139] Acquire real-time facial images captured by a camera, and determine corresponding user behavior information based on the facial images. The user behavior information includes user head movements and eye postures.

[0140] The duration of user screen time is calculated based on the user behavior information.

[0141] If the infrared activation conditions are met based on the user's eye usage time, the near-infrared module is activated to emit near-infrared light.

[0142] It is worth noting that in the embodiments of the above-mentioned eye protection method system for electronic devices with cameras, the various units and modules included are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be achieved; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the protection scope of the embodiments of this application.

[0143] Note that the above are merely preferred embodiments and the technical principles applied in this application. Those skilled in the art will understand that the embodiments of this application are not limited to the specific embodiments described herein, and various obvious changes, readjustments, and substitutions can be made by those skilled in the art without departing from the protection scope of the embodiments of this application. Therefore, although the embodiments of this application have been described in detail through the above embodiments, the embodiments of this application are not limited to the above embodiments. More other equivalent embodiments may be included without departing from the concept of the embodiments of this application, and the scope of the embodiments of this application is determined by the scope of the appended claims.

Claims

1. A method for protecting the eyes of an electronic device with a camera, wherein the electronic device integrates a near-infrared module, characterized in that, The method includes: Acquire real-time facial images captured by a camera, and determine corresponding user behavior information based on the facial images. The user behavior information includes user head movements and eye postures. The user head movements include the angle of user head rotation, and the eye postures include the coordinates of the pupil center. The user's head deflection angle change rate is determined based on multiple user head deflection angles determined from real-time acquired facial images. Multiple user focus duration segments are determined based on the user's head deflection angle change rate. In each user focus duration segment, the focus weight corresponding to the user focus duration segment is determined based on the pupil center coordinates determined from the corresponding facial image. The user's eye usage time is calculated based on the user focus duration segment and the corresponding focus weight. If the infrared activation conditions are met based on the user's eye usage time, the near-infrared module is activated to emit near-infrared light. The conditions for activating the infrared module include: the user's eye usage time is greater than the preset infrared activation time, and the number of near-infrared activations meets the corresponding set value.

2. The eye protection method for electronic devices with cameras according to claim 1, characterized in that, The conditions for satisfying the infrared activation include: The user's screen time exceeds the preset infrared activation time, and any one or more of the following settings—screen size, screen brightness, and screen viewing distance—meet the corresponding values.

3. The eye protection method for electronic devices with cameras according to claim 1, characterized in that, After activating the near-infrared module, the following is also included: The infrared irradiation time is calculated based on the user's head movements and eye posture determined from the collected facial images after the near-infrared module is turned on. If the infrared shutdown condition is met based on the infrared irradiation time, the near-infrared module is turned off.

4. The eye protection method for electronic devices with cameras according to claim 3, characterized in that, The conditions for satisfying the infrared shutdown include: The infrared irradiation time is greater than the preset infrared off time, and any one or more of the power, wavelength range, irradiation distance, and number of times the near-infrared module is turned on meet the corresponding set values.

5. The eye protection method for electronic devices with cameras according to claim 1, characterized in that, The method for protecting the eyes of electronic devices with cameras also includes: With the camera turned on, and the device confirmed to be being used for the first time that day and with eye protection settings enabled, the near-infrared module will be activated to emit near-infrared light.

6. The eye protection method for electronic devices with cameras according to claim 1, characterized in that, Before acquiring real-time facial images from the camera, the process also includes: If a face is detected in an image captured by a camera and the distance to the face is less than a preset distance, personal identity information is verified. If the verification result of the personal identity information is that the user has registered, the associated eye protection information is obtained from the cloud server for use in turning the near-infrared module on and / or off.

7. An eye protection device for an electronic device with a camera, wherein the electronic device integrates a near-infrared module and a camera, the near-infrared module being a near-infrared lamp and / or a display screen with near-infrared light output and control functions, characterized in that... The device includes: The acquisition module is used to acquire real-time facial images captured by the camera; The information determination module is used to determine corresponding user behavior information based on the face image. The user behavior information includes user head movements and eye postures. The user head movements include the user head turning angle, and the eye postures include the pupil center coordinates. The statistics module is used to determine the rate of change of the user's head deflection angle based on multiple user head deflection angles determined from real-time acquired facial images, determine multiple user focus duration segments based on the rate of change of the user's head deflection angle, determine the focus weight corresponding to the user focus duration segment based on the pupil center coordinates determined from the corresponding facial image in each user focus duration segment, and calculate the user's eye use time based on the user focus duration segment and the corresponding focus weight. The near-infrared activation module is used to activate the near-infrared module to emit near-infrared light when the infrared activation conditions are met based on the user's eye usage time. The conditions for meeting the infrared activation include: the user's eye usage time is greater than the preset infrared activation time, and the number of near-infrared activations meets the corresponding set value.

8. An eye protection device for an electronic device with a camera, the device comprising: One or more processors; A storage device for storing one or more programs, which, when executed by one or more processors, cause the one or more processors to implement the eye protection method for an electronic device with a camera as described in any one of claims 1-6.

9. A storage medium storing computer-executable instructions, which, when executed by a computer processor, are used to perform the eye protection method for an electronic device with a camera as described in any one of claims 1-6.

Images