Screen adjustment method and device, equipment and storage medium

Abstract

The embodiment of the invention relates to the field of terminal display, and discloses a screen adjustment method and device, equipment and a storage medium, and the method comprises the steps: recognizing the current screen display content, and determining different types of light source regions; acquiring a plurality of physiological feature parameters; determining an eye fatigue value according to the first physiological feature parameter; determining a correlation degree value of the operation behavior and eye fatigue according to the second physiological feature parameter; and when a preset eye fatigue threshold value and / or a preset association degree threshold value are / is exceeded, analyzing an eye fatigue degree, and generating a screen adjustment strategy based on the eye fatigue degree and the light source area. According to the screen adjustment method disclosed by the invention, the problems that the brightness adjustment is inaccurate and the brightness of different light source areas cannot be automatically adjusted in combination with user eye reaction are solved, the brightness is accurately and automatically adjusted in different areas in combination with physiological features, and the stimulation of different types of strong light sources on the screen to eyes is reduced.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of terminal display, and in particular to a screen adjustment method, device, equipment and storage medium. Background Art

[0002] As users become more and more attached to smart devices, people use electronic devices in various environments. It is common to use electronic devices in dark environments (taking mobile phones as an example below). The damage to the eyes caused by the light emitted by mobile phone screens in dark environments is an issue that cannot be ignored. Traditional mobile phone screen brightness adjustment is often an overall adjustment, which cannot accurately adjust the brightness for different types of light sources on the screen (such as surface light sources, point light sources, irregular light sources, etc.), and does not monitor the user's eye response, and cannot be adaptively adjusted automatically, which can easily cause eye irritation and affect eye health. Summary of the invention

[0003] The purpose of the present invention is to at least provide a screen adjustment method, device, equipment and storage medium, which can at least solve the problem that the brightness of different light source areas cannot be automatically adjusted in combination with the user's eye response, and at least can achieve accurate automatic adjustment of the brightness in different areas in combination with physiological characteristics, thereby reducing the stimulation to the eyes by different types of strong light sources on the screen.

[0004] To solve the above technical problems, at least one embodiment of the present application provides a screen adjustment method, including:

[0005] Identify the current screen display content based on an image recognition algorithm to determine different types of light source areas on the screen;

[0006] Acquiring several physiological characteristic parameters of the screen operator; the physiological characteristic parameters include several first physiological characteristic parameters associated with eye fatigue and second physiological characteristic parameters associated with the screen operator's screen operation behavior;

[0007] determining the eye fatigue value of the screen operator according to the first physiological characteristic parameter;

[0008] Determining a correlation degree value between the operation behavior of the screen operator and eye fatigue according to the second physiological characteristic parameter;

[0009] When the eye fatigue value exceeds a preset eye fatigue threshold and / or the association degree value exceeds a preset association degree threshold, the eye fatigue degree is analyzed according to the eye fatigue value and / or the association degree value, and a screen adjustment strategy for adjusting each light source area is generated based on the eye fatigue degree and the different types of light source areas on the screen.

[0010] At least one embodiment of the present application further provides a screen adjustment device, comprising:

[0011] A light source recognition module, used to recognize the current screen display content based on an image recognition algorithm and determine different types of light source areas on the screen;

[0012] A data acquisition module, used for acquiring several physiological characteristic parameters of the screen operator; the physiological characteristic parameters include several first physiological characteristic parameters associated with eye fatigue and second physiological characteristic parameters associated with the screen operator's screen operation behavior;

[0013] An eye fatigue analysis module, used for determining the eye fatigue value of the screen operator according to the first physiological characteristic parameter;

[0014] A behavior association analysis module, used to determine the association degree value between the operation behavior of the screen operator and eye fatigue according to the second physiological characteristic parameter;

[0015] A processing module is used to analyze the degree of eye fatigue according to the eye fatigue value and / or the association degree value when the eye fatigue value exceeds a preset eye fatigue threshold and / or the association degree value exceeds a preset association degree threshold, and generate a screen adjustment strategy for adjusting each light source area based on the eye fatigue degree and each different type of light source area on the screen.

[0016] At least one embodiment of the present application also provides an electronic device, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the above-mentioned screen adjustment method.

[0017] At least one embodiment of the present application further provides a computer-readable storage medium storing a computer program, wherein the computer program implements the above-mentioned screen adjustment method when executed by a processor.

[0018] The screen adjustment method, device, equipment and storage medium provided in the embodiments of the present application can automatically identify different light source areas of the screen, and can perform targeted brightness adjustment in combination with different light source areas to improve the accuracy of adjustment, thereby analyzing the degree of eye fatigue through multiple first physiological characteristics and second physiological characteristics, combining user manual operation and user eye reaction for automatic adjustment, protecting the eyes in all directions, making the eye protection effect more significant, further improving the accuracy of automatic brightness adjustment, and reducing the damage of light sources to the eyes.

[0019] In some optional embodiments, the first physiological characteristic includes at least one of an eye-related direct parameter and an eye-related indirect parameter; the eye-related direct parameter includes at least one of an intraocular pressure parameter, a tear film breakup time parameter, an eye movement speed parameter, and a blinking frequency parameter; the eye-related indirect parameter includes at least one of a heart rate parameter and a skin conductivity parameter;

[0020] The step of determining the eye fatigue value of the screen operator according to the first physiological characteristic parameter includes:

[0021] Compare the plurality of first physiological characteristic parameters with the corresponding preset physiological characteristic reference values ​​respectively, and determine the comparison results corresponding to the plurality of first physiological characteristic parameters respectively;

[0022] The eye fatigue value of the screen operator is determined according to the comparison results respectively corresponding to the multiple first physiological characteristic parameters.

[0023] In some optional embodiments, the calculation formula of the eye fatigue value includes:

[0024]

[0025] In the formula, B min is the lower limit of normal blinking frequency; B is the actual blinking frequency; IOP max is the upper limit of normal intraocular pressure; IOP is the actual intraocular pressure; TBUT is min is the normal lower limit of tear film breakup time; TBUT is the actual tear film breakup time; HR0 is the average heart rate; HR is the actual heart rate; G0 is the initial value of skin conductivity; G is the actual skin conductivity.

[0026] In some optional embodiments, the second physiological characteristic parameter includes the user operation frequency and the operation interval time; the calculation formula of the association degree value includes:

[0027]

[0028] Wherein, F0 is the initial operation frequency (times / minute); F is the current operation frequency (times / minute); T0 is the initial operation interval (seconds); T is the current operation interval (seconds).

[0029] In some optional embodiments, the light source area type includes at least one of a strong light source area, a point light source area, an irregular light source area, and a gradual light source area; and the method further includes:

[0030] Get the current environment optical parameters;

[0031] The display brightness corresponding to the different light source areas of the screen is determined according to the ambient optical parameters and the various light source areas of the screen.

[0032] In some optional embodiments, it also includes:

[0033] In response to a screen operator's request for an adjustment operation on a target light source area on the screen, a first adjustment strategy for a light source type corresponding to the target light source area is matched from a preset light source type adjustment strategy library, and based on the first adjustment strategy and the screen operator's adjustment parameters for the target light source area, a second adjustment strategy for adjusting the display parameters of the target light source area is generated, so that the display parameters of the target light source area are adjusted through the second adjustment strategy.

[0034] In some optional embodiments, it also includes:

[0035] Obtain the content of the next display page of the current screen and the display parameter setting values ​​preset by the screen operator for different light source areas;

[0036] Identifying the light source area of ​​the next display page content, determining each light source area corresponding to the next display page content, and matching a third adjustment strategy corresponding to each light source area from a preset light source type adjustment strategy library;

[0037] According to the third adjustment strategy combined with the display parameter setting value, a fourth adjustment strategy for adjusting the display parameters of each light source area of ​​the next display page content is generated, and the next display page content is adjusted and displayed using the fourth adjustment strategy.

[0038] In some optional embodiments, it also includes:

[0039] When the screen adjustment strategy is executed, the screen optical parameters when the screen operator operates the current screen and the current environment optical parameters are obtained;

[0040] A device adjustment strategy for adjusting the ambient optical parameters is determined according to the screen optical parameters and the current ambient optical parameters, and the device adjustment strategy is sent to a corresponding target device for execution.

[0041] In some optional embodiments, it also includes:

[0042] Get the ambient humidity value of the current environment used by the screen operator;

[0043] determining whether the eyes of the screen operator are dry according to the first physiological characteristic parameter and the ambient humidity value;

[0044] If so, an environmental humidification adjustment instruction is generated and sent to the humidification device for execution. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] One or more embodiments are exemplarily described by the pictures in the corresponding drawings, and these exemplary descriptions do not constitute limitations on the embodiments.

[0046] Figure 1 This is a flow chart of a screen adjustment method provided by an embodiment of the present application. Figure 1 ;

[0047] Figure 2 This is a flow chart of a screen adjustment method provided by an embodiment of the present application. Figure 2 ;

[0048] Figure 3 This is a flow chart of a screen adjustment method provided by an embodiment of the present application. Figure 3 ;

[0049] Figure 4 This is a flow chart of a screen adjustment method provided by an embodiment of the present application. Figure 4 ;

[0050] Figure 5 This is a flow chart of a screen adjustment method provided by an embodiment of the present application. Figure 5 ;

[0051] Figure 6 This is a flow chart of a screen adjustment method provided by an embodiment of the present application. Figure 6 ;

[0052] Figure 7 is a schematic diagram of a screen adjustment device provided by another embodiment of the present application;

[0053] Figure 8 is a structural schematic diagram of an electronic device provided by another embodiment of the present application;

[0054] Fig. 9 It is a schematic diagram of the structure of a computer-readable storage medium provided by another embodiment of the present application. DETAILED DESCRIPTION

[0055] To make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the embodiments of the present application will be described in detail below in conjunction with the accompanying drawings. However, it will be appreciated by those skilled in the art that in the present application, many technical details are proposed in order to enable the reader to better understand the present application. However, even without these technical details and various changes and modifications based on the following embodiments, the technical scheme claimed in the present application can also be implemented. The division of the following embodiments is for the convenience of description, and the specific implementation of the present application should not be construed as any limitation, and the various embodiments can be combined and referenced with each other under the premise of no contradiction.

[0056] In order to facilitate understanding of the embodiments of the present application, relevant content about automatic screen adjustment is first introduced here.

[0057] As users become more and more attached to smart devices, people use electronic devices in various environments. It is common to use electronic devices in dark environments (taking mobile phones as an example below). The damage to the eyes caused by the light emitted by mobile phone screens in dark environments is an issue that cannot be ignored. Traditional mobile phone screen brightness adjustment is often an overall adjustment, and it is impossible to accurately adjust the brightness for different types of light sources on the screen (such as surface light sources, point light sources, irregular light sources, etc.). In addition, there is a lack of predictive adjustment of upcoming light sources and a dual protection mechanism combined with user eye reactions.

[0058] Today, the existing screen display solutions mainly include night mode. Mobile phone night mode (Night Mode) is a display mode designed for low-light environments, which aims to reduce the stimulation of bright light emitted by the screen to the user's eyes while providing a more comfortable visual experience. The following are some key features and functions of mobile phone night mode: 1. Reduce blue light emission: Night mode usually reduces the amount of blue light emitted by the screen. Blue light has a shorter wavelength and higher energy, and is believed to have a greater impact on sleep patterns because it inhibits the production of melatonin, a hormone that regulates the sleep-wake cycle; 2. Warm color temperature adjustment: Night mode adjusts the screen color temperature to warmer tones, usually yellow or orange tones, which helps reduce eye fatigue and create a more relaxing environment; 3. Automatic brightness adjustment: Many night modes automatically adjust the screen brightness according to the ambient light to ensure that the screen is not too bright, thereby reducing eye stimulation.

[0059] Although the above solutions have achieved good results in global display and are also applied in multiple systems and multiple devices, for some specific usage screens of mobile phones, such as multiple pictures, videos, games and other scenes, there are still glaring light sources such as surface light sources, point light sources, irregular light sources, etc., which pose a potential threat to the user's eyes.

[0060] In order to solve the above-mentioned technical problem of being unable to automatically adjust the brightness of different light source areas in combination with the user's eye response, the present invention proposes a screen adjustment method. The implementation details of the screen adjustment method of this embodiment are described in detail below. The following content is only the implementation details provided for easy understanding and is not necessary for implementing this solution.

[0061] Embodiment 1:

[0062] The screen adjustment method of this embodiment can be applied to electronic devices with communication, computing and data storage capabilities. The specific process can be as follows: Figure 1 As shown, steps 101-105 are included, specifically including:

[0063] Step 101 : identifying the current screen display content based on an image recognition algorithm, and determining different types of light source areas on the screen.

[0064] Specifically, the image recognition algorithm can accurately identify the various light source areas in the current screen, so as to accurately adjust different areas respectively and improve the accuracy of brightness adjustment of different light source areas. Among them, the types of light source areas include at least one of strong light source areas, point light source areas, irregular light source areas and gradual light source areas. In this embodiment, the light source areas are divided into strong light source areas, point light source areas, irregular light source areas and gradual light source areas, and different adjustment coefficients can be provided respectively to improve the accuracy of overall screen display adjustment.

[0065] In some embodiments, the system determines the surface light source based on the brightness distribution characteristics of the pixels. For example, if the brightness difference of pixels in a larger area is within a certain range and the overall brightness is high, it is determined to be a surface light source.

[0066] For point light source recognition, the system detects bright spots with extremely high brightness concentrated in a small area (such as a few pixels).

[0067] For the identification of irregular and gradual light sources, the system analyzes the gradient changes in pixel brightness. For example, the area where the brightness gradually decreases from the center of the light source to the periphery is determined as a gradual light source. The system determines the adjustment amplitude based on the rate of change of the brightness gradient.

[0068] Step 102, obtaining several physiological characteristic parameters of the screen operator; the physiological characteristic parameters include several first physiological characteristic parameters associated with eye fatigue and second physiological characteristic parameters associated with the screen operator's screen operation behavior.

[0069] Specifically, the sensor collects various physiological characteristic parameters of the screen operator, so that the system obtains relevant physiological characteristic parameters, which is convenient for analyzing the brightness adjustment needs of the screen operator based on multiple different types of physiological characteristic parameters, thereby improving the accuracy of automatic adjustment.

[0070] In some examples, the first physiological characteristic includes at least one of a direct eye-related parameter and an indirect eye-related parameter; the direct eye-related parameter includes at least one of an intraocular pressure parameter, a tear film breakup time parameter, an eye movement speed parameter and a blinking frequency parameter; the indirect eye-related parameter includes at least one of a heart rate parameter and a skin conductivity parameter.

[0071] In this embodiment, by combining the direct eye-related parameters and other indirect related parameters that can reflect eye fatigue, the degree of eye fatigue can be comprehensively predicted, and then adjustments can be made for different situations to improve the accuracy of screen adjustment.

[0072] Among them, the correlation management relationship between different first physiological characteristics, such as a sudden increase in heart rate may be related to increased intraocular pressure or abnormal eye movement, which may be a manifestation of overuse of the eyes. Abnormal changes in skin conductivity and heart rate at the same time may more accurately reflect the user's nervous state, which may affect vision. Eye movement speed, blinking frequency, etc. may also be associated with eye indicators such as tear film breakup time and intraocular pressure, which together reflect the degree of eye fatigue or discomfort.

[0073] In some examples, in terms of behavior prediction, changes in the frequency and time interval of user operations not only reflect the user's behavior state, but may also be related to the state of eye fatigue. For example, a decrease in operation frequency and an increase in operation interval may be due to inattention caused by visual fatigue. Based on this, the second physiological characteristic parameter associated with the screen operation behavior of the screen operator in this embodiment is combined with fatigue analysis to further accurately adjust the screen.

[0074] Furthermore, based on the first physiological characteristic and the second physiological characteristic, for situations such as too low blinking frequency, too high intraocular pressure, abnormally increased heart rate, abnormal changes in skin conductivity, etc., the screen brightness is reduced, and the color temperature may be adjusted (such as gradually reducing it from 6500K to 4000K), and the screen refresh rate may be increased (such as gradually increasing it from 60Hz to 90Hz), etc.; for tear film rupture time that is too short, the humidity around the screen is increased (humidifiers and other air conditioning equipment are linked to increase the relative humidity of the environment by 5%-10%) and the brightness and contrast are adjusted; when the user's operation frequency and interval show a state of visual fatigue, the screen brightness is reduced in advance (20%-30%) and the user is prompted to rest.

[0075] Step 103: determining the eye fatigue value of the screen operator according to the first physiological characteristic parameter.

[0076] Specifically, the system determines the eye fatigue value of the screen operator by combining one or more physiological characteristic parameters, and usually gives priority to the first physiological characteristic parameter that best reflects the user's eye fatigue.

[0077] In this embodiment, the first physiological characteristics of the eye direct related parameters and the eye indirect related parameters are used to determine the eye fatigue value of the screen operator, thereby improving the accuracy of eye fatigue assessment and further improving the accuracy of screen adjustment.

[0078] In some embodiments, Figure 2 As shown, step 103 includes:

[0079] Step 1031, comparing the plurality of first physiological characteristic parameters with the corresponding preset physiological characteristic reference values, and determining the comparison results corresponding to the plurality of first physiological characteristic parameters;

[0080] Step 1032: determine the eye fatigue value of the screen operator according to the comparison results corresponding to the multiple first physiological characteristic parameters.

[0081] Specifically, the first physiological characteristic parameters of different items are respectively preset with corresponding preset physiological characteristic reference values, so that the eye fatigue value can be evaluated by comparing the preset physiological characteristic reference values.

[0082] In some examples, the eye fatigue value calculation formula includes:

[0083]

[0084] In the formula, B min is the lower limit of normal blinking frequency; B is the actual blinking frequency; IOP max is the upper limit of normal intraocular pressure; IOP is the actual intraocular pressure; TBUT is min is the normal lower limit of tear film breakup time; TBUT is the actual tear film breakup time; HR0 is the average heart rate; HR is the actual heart rate; G0 is the initial value of skin conductivity; G is the actual skin conductivity.

[0085] Through the above formula, the eye fatigue situation can be expressed by the eye fatigue value, so as to analyze the user's fatigue level and accurately adjust the screen.

[0086] Step 104: determining the correlation degree between the screen operator's operation behavior and eye fatigue according to the second physiological characteristic parameter.

[0087] Specifically, the operating behaviors related to eye fatigue are usually the operating frequency and operation time interval of the screen operator. By analyzing the reduction in operation frequency and the increase in operation interval, it is possible to identify whether the user's attention is focused, and then analyze the inattention that may be caused by visual fatigue.

[0088] In some embodiments, the second physiological characteristic parameter includes the user operation frequency and the operation interval time; the calculation formula of the correlation degree value includes:

[0089]

[0090] Wherein, F0 is the initial operation frequency (times / minute); F is the current operation frequency (times / minute); T0 is the initial operation interval (seconds); T is the current operation interval (seconds).

[0091] By calculating the correlation degree value, it is convenient to evaluate whether the user has eye fatigue that causes behavioral changes, thereby improving the accuracy of automatic screen adjustment.

[0092] Step 105, when the eye fatigue value exceeds a preset eye fatigue threshold and / or the association degree value exceeds a preset association degree threshold, the eye fatigue degree is analyzed according to the eye fatigue value and / or the association degree value, and a screen adjustment strategy for adjusting each light source area is generated based on the eye fatigue degree and each different type of light source area of ​​the screen.

[0093] Specifically, the degree of eye fatigue is analyzed by the eye fatigue value and / or the correlation degree value, so as to generate a corresponding screen adjustment strategy, realize accurate automatic adjustment of the screen, and adjust the different types of light source areas separately to accurately adjust the screen, protect the eyes in all directions, make the eye protection effect more significant, further improve the accuracy of automatic brightness adjustment, and reduce the damage of light sources to the eyes.

[0094] In some examples, corresponding thresholds are preset for the eye fatigue value and the association degree value. When EFI exceeds a certain threshold (such as EFI>1), it is determined to be an eye fatigue state, and a corresponding screen adjustment strategy is executed; when BEI exceeds a certain threshold (such as BEI>0.5), it is determined that the user may have behavioral changes due to eye fatigue, and a strategy of adjusting the screen brightness in advance and prompting rest is executed.

[0095] The screen adjustment method provided in this embodiment can automatically identify different light source areas of the screen and perform targeted brightness adjustment in combination with different light source areas to improve the accuracy of adjustment, thereby analyzing the degree of eye fatigue through multiple first physiological characteristics and second physiological characteristics, combining user manual operations and user eye reactions for automatic adjustment, and protecting the eyes in all directions, making the eye protection effect more significant, further improving the accuracy of automatic brightness adjustment, and reducing the damage of light sources to the eyes.

[0096] In some embodiments, the recognition of various first physiological characteristics of the eye is usually carried out by monitoring the user's eye protective response, such as eye closure or pupil contraction, through an integrated camera.

[0097] Terminal camera intraocular pressure detection: By analyzing the geometric changes of the eyeball or the morphology of the scleral blood vessels, some changes in intraocular pressure can be indirectly inferred (vascular morphology analysis uses image processing technology to extract the morphological parameters of scleral blood vessels, such as blood vessel diameter, blood vessel density, curvature, etc. There is a close relationship between the changes in these parameters and intraocular pressure.

[0098] Terminal camera tear film rupture detection: Image acquisition and processing The camera collects video information of the eyes, and uses image processing technology to analyze the changes in the tear film. The specific steps are as follows: Open and closed eye cycle recognition: The open and closed state of the eyes is judged by calculating the pixel mean of each frame of the image, and the moment of full opening is determined as the reference frame. Reference frame and comparison frame generation: The reference frame and each subsequent frame are subjected to restricted contrast adaptive histogram equalization and mean filtering to obtain a reference pattern and a comparison pattern. Difference map and rupture area recognition: The reference pattern and the comparison pattern are subtracted to obtain a difference map, which is divided into several sub-regions to identify the sub-regions with differences, marked as rupture areas, and the rupture time is recorded.

[0099] In some embodiments, after identifying different types of light source areas on the screen, the light source area types include strong light source areas, point light source areas, irregular light source areas, and gradient light source areas; based on this, Figure 3 As shown, the method also includes:

[0100] Step 201, obtaining current environment optical parameters;

[0101] Step 202: Determine the display brightness corresponding to different light source areas of the screen according to the ambient optical parameters and each light source area of ​​the screen.

[0102] Specifically, for different types of light source areas, the corresponding adjustment coefficient can be adjusted according to the ambient optical parameters. By combining the ambient optical automation to adjust different types of light source areas, the accuracy of adjustment can be improved. Among them, the ambient optical parameters include brightness, color temperature, and color monitoring. Ambient light sensors are installed at different locations in the room to monitor the brightness, color temperature, and color of the ambient light. These sensors are connected to the intelligent control system and transmit the collected data to the control system in real time.

[0103] In some examples, for a surface light source, the system compares the average brightness of the surface light source with the screen brightness value set by the user. Assuming that the user sets the brightness value to L1 and the average brightness of the surface light source to L2, if L2>L1, the system reduces the brightness of the surface light source to L2' according to the formula L2'=L2×(1-k1) (where k1 is an adjustment coefficient determined experimentally, such as k1=0.2). For a point light source, the system reduces its brightness to L3' according to the formula L3'=L3×(1-k2)(k2=0.3) by assuming that its brightness is L3; for irregular and gradually changing light sources, the system determines the adjustment amplitude according to the rate of change of the brightness gradient. If the rate of change of the brightness gradient is r, the brightness is adjusted according to the formula L4'=L4×(1-k3×r), (k3=0.1).

[0104] In some embodiments, it is considered that the screen optical parameters may affect the screen display, such as Figure 4 As shown, the screen adjustment method provided in this embodiment also includes:

[0105] Step 301: after the screen adjustment strategy is executed, the screen optical parameters when the screen operator operates the current screen and the current environment optical parameters are obtained;

[0106] Step 302: Determine a device adjustment strategy for adjusting the ambient optical parameters according to the screen optical parameters and the current ambient optical parameters, and send the device adjustment strategy to the corresponding target device for execution.

[0107] Specifically, by combining the screen optical parameters with the ambient optical parameters, it is possible to determine whether to adjust the ambient optics, and to determine the corresponding adjustment strategy for execution by the corresponding target device, thereby achieving linkage control with home appliances.

[0108] In some examples, the screen optical parameters include blue light intensity. When it is detected that the proportion of blue light intensity on the screen exceeds a set threshold (such as the proportion of blue light intensity in the total visible light intensity exceeds 30%), eye protection strategies such as blue light blocking and screen luminescence ratio adjustment will be triggered.

[0109] In some examples, the screen is adjusted according to the combination of ambient optical parameters and eye fatigue as follows:

[0110] a. Brightness adjustment: When the screen brightness is high and the ambient light is dark, the ambient light brightness is appropriately increased; conversely, when the screen brightness is low and the ambient light is too bright, the ambient light brightness is reduced. The adjustment process follows the preset brightness matching algorithm to ensure that the contrast between the screen and the ambient light is within a comfortable range for the eyes. For example, let the screen brightness be Lscreen and the ambient light brightness be Lenvironment. The adjusted ambient light brightness L_environment' is calculated according to the formula Lenvironment'=f(Lscreen) (f is a function determined based on experiments and user comfort).

[0111] b. Color temperature adjustment: adjust the color temperature of the ambient light according to the color temperature of the screen light and the degree of eye fatigue. If the screen color temperature is cold and the eyes are tired, adjust the color temperature of the ambient light to a warmer level to reduce the frequent adaptation of the eyes to light of different color temperatures and reduce visual fatigue.

[0112] c. Color adjustment: If the screen color has an obvious color bias (such as blue or red), adjust the color of the ambient light to achieve visual balance. For example, if the screen color is blue, add appropriate yellow components to the ambient light to make the overall visual environment more harmonious.

[0113] d. Control mode duration: Set different ambient light control mode durations based on the user's screen device usage habits and eye health. For example, for users who use the screen for a long time, the system can remind the user to take a break after a certain period of time and adjust the ambient light to a state more suitable for rest (such as reducing brightness, adjusting to a warmer color temperature, etc.).

[0114] In some embodiments, the combination of screen optical parameters and current ambient optical parameters is essentially a combination of screen usage, eye symptoms, and ambient light conditions to determine whether the curtain opening needs to be adjusted. When the screen brightness is high and the outdoor light is not too strong, if the eyes feel tired or uncomfortable, open the curtains appropriately to increase the amount of light entering to balance the contrast between the screen and the ambient light; if the outdoor light is too strong, it may cause glare or increase the burden on the eyes, then close the curtains or adjust the curtain opening to reduce the entry of strong light.

[0115] In some embodiments, in order to further alleviate the eye fatigue problem of the screen operator, such as Figure 5 As shown, the screen adjustment method also includes:

[0116] Step 401, obtaining the ambient humidity value of the current environment used by the screen operator;

[0117] Step 402: determining whether the eyes of the screen operator are dry according to the first physiological characteristic parameter and the ambient humidity value;

[0118] If so, an environmental humidification adjustment instruction is generated and sent to the humidification device for execution.

[0119] Specifically, by monitoring the first physiological characteristic parameter and the ambient humidity value, the humidification equipment can be linked to perform humidification in time, increase the humidity around the screen, thereby relieving eye fatigue and quickly alleviating the user's visual fatigue problem.

[0120] In some examples, when the tear film breakup time in the first physiological characteristic parameter is too short, it is determined whether the eyes of the screen operator are dry, and the humidity around the screen is increased (humidifiers and other air conditioning equipment are linked to increase the relative humidity of the environment by 5%-10%) and the brightness and contrast are adjusted to effectively relieve the user's visual fatigue and improve the screen adjustment effect;

[0121] When the blinking frequency in the first physiological characteristic parameter is monitored to be lower than the normal range, indicating that the eyes may be dry, if the ambient humidity is lower than the preset comfortable humidity threshold (such as relative humidity below 40%), the intelligent control system automatically turns on the humidifier to add moisture to the air to relieve dry eyes. When the ambient humidity reaches the appropriate range (such as relative humidity above 50%) and the symptoms of dry eyes are relieved (blinking frequency returns to normal), the humidifier is turned off.

[0122] In some embodiments, the screen adjustment method further includes:

[0123] In response to a screen operator's request for an adjustment operation on a target light source area on the screen, a first adjustment strategy for a light source type corresponding to the target light source area is matched from a preset light source type adjustment strategy library, and based on the first adjustment strategy and the screen operator's adjustment parameters for the target light source area, a second adjustment strategy for adjusting the display parameters of the target light source area is generated, so that the display parameters of the target light source area are adjusted through the second adjustment strategy.

[0124] Specifically, the screen operator can manually adjust different light source areas. Usually, when the user wants to adjust a specific continuous or regular light-emitting area, he or she can circle and adjust the area by sliding a finger on the screen. By matching the first adjustment strategy to the target light source area and combining the adjustment parameters of the screen operator's operation, a second adjustment strategy can be formed to accurately adjust the display parameters of the target light source area according to the screen operator's operation requirements.

[0125] In some examples, the system obtains the coordinate range of the area circled by the user and the pixel information therein. Assuming that the average brightness in the circled area is L5, the user sets the brightness ratio to be reduced to p (for example, p=0.4), the system adjusts the brightness of the area to L5′=L5×(1-p). At the same time, the color temperature can also be adjusted accordingly according to the adjustment value set by the user.

[0126] In some embodiments, in order to facilitate the continuous relief of the screen operator's eye fatigue, the screen adjustment method also predictively and automatically adjusts the content to be displayed, so that when the content is displayed, the display parameter setting values ​​that meet the screen operator's preset for different light areas are directly presented. Figure 6 As shown, the method also includes:

[0127] Step 501, obtaining the content of the next display page of the current screen and the display parameter setting values ​​preset by the screen operator for different light source areas;

[0128] Step 502: Identify the light source area of ​​the next display page content, determine each light source area corresponding to the next display page content, and match a third adjustment strategy corresponding to each light source area from a preset light source type adjustment strategy library;

[0129] Step 503: Generate a fourth adjustment strategy for adjusting display parameters of each light source area of ​​the next display page content according to the third adjustment strategy combined with the display parameter setting value, and use the fourth adjustment strategy to adjust the next display page content before display.

[0130] Specifically, by predicting the bright light content that will be emitted, such as video or page loading, users are prompted to set the brightness in advance to reduce damage to the eyes from the light source.

[0131] In this embodiment, the preset display parameter setting value can be the setting value after the screen operator adjusts the brightness of different areas of the current display content on the screen, or it can be set by the user's feedback when the system automatically adjusts each display area of ​​the screen. Specifically, the system will record the type of light source, brightness value, adjustment factors (such as user manual adjustment, eye feedback adjustment, etc.) and other information adjusted each time. For example, when a surface light source similar to the previous one appears in a specific area (judged according to the brightness distribution characteristics and the brightness value range), the brightness of the surface light source was previously adjusted because the eye closure degree decreased and the brightness was reduced according to a certain proportion. The system will automatically adjust the brightness of the area according to the previous adjustment ratio and the current eye state, user settings and other factors. Assuming that the previous adjustment ratio is m, the system determines that it is necessary to make fine adjustments on this basis according to the current situation, and the fine adjustment coefficient is n (for example, n=0.1), then the new adjustment ratio is m′=m×(1+n), and the brightness of the surface light source is adjusted according to this ratio.

[0132] In addition, the system has a preset adjustment strategy library corresponding to each light source area. After different display contents are identified by the image recognition algorithm, the corresponding light source area type can be accurately analyzed, and then the corresponding third adjustment strategy can be matched. Then, the fourth adjustment strategy for the final adjustment is determined in combination with the display parameter setting value, thereby improving the accuracy of the predicted adjustment, prompting the user to set the brightness in advance, and reducing the damage of the light source to the eyes.

[0133] In some embodiments, the method also provides a protection mechanism after the brightness adjustment reaches the limit. Specifically, the system sets a lower brightness limit Lmin. When the overall brightness of the screen or the brightness of a certain area is adjusted to close to Lmin, for example, it reaches Lmin+ΔL (ΔL is a very small value, such as 0.1). The system will stop the operation of further reducing the brightness and increase the frequency of rest reminders. For example, it changes from a rest reminder every 30 minutes to a reminder every 15 minutes. And the system will limit some high-brightness display functions of the screen, such as limiting the display of highlight special effects in video playback, to ensure that the screen brightness does not exceed the brightness that has been adjusted to the limit, and further protect the user's eyes.

[0134] Embodiment 2:

[0135] Another embodiment of the present application relates to a screen adjustment device. The implementation details of the screen adjustment device of this embodiment are described in detail below. The following content is only for the convenience of understanding the implementation details, and is not necessary for implementing this solution. The schematic diagram of the screen adjustment device of this embodiment can be as follows Figure 7As shown, it includes a light source recognition module 801, a data acquisition module 802, an eye fatigue analysis module 803, a behavior association analysis module 804 and a processing module 805.

[0136] The light source recognition module 801 is used to recognize the current screen display content based on the image recognition algorithm and determine the different types of light source areas of the screen;

[0137] The data acquisition module 802 is used to obtain several physiological characteristic parameters of the screen operator; the physiological characteristic parameters include several first physiological characteristic parameters associated with eye fatigue and second physiological characteristic parameters associated with the screen operator's screen operation behavior;

[0138] An eye fatigue analysis module 803, used to determine the eye fatigue value of the screen operator according to the first physiological characteristic parameter;

[0139] A behavior association analysis module 804, used to determine the association degree value between the operation behavior of the screen operator and eye fatigue according to the second physiological characteristic parameter;

[0140] Processing module 805 is used to analyze the degree of eye fatigue according to the eye fatigue value and / or the association degree value when the eye fatigue value exceeds a preset eye fatigue threshold and / or the association degree value exceeds a preset association degree threshold, and generate a screen adjustment strategy for adjusting each light source area based on the eye fatigue degree and each different type of light source area on the screen.

[0141] In some embodiments, the first physiological characteristic includes at least one of a direct eye-related parameter and an indirect eye-related parameter; the direct eye-related parameter includes at least one of an intraocular pressure parameter, a tear film breakup time parameter, an eye movement speed parameter and a blinking frequency parameter; the indirect eye-related parameter includes at least one of a heart rate parameter and a skin conductivity parameter.

[0142] The eye fatigue analysis module 803 is also used to compare multiple first physiological characteristic parameters with corresponding preset physiological characteristic reference values ​​to determine the comparison results corresponding to the multiple first physiological characteristic parameters; and determine the eye fatigue value of the screen operator based on the comparison results corresponding to the multiple first physiological characteristic parameters.

[0143] In some embodiments, the calculation formula of the eye fatigue value includes:

[0144]

[0145] In the formula, B min is the lower limit of normal blinking frequency; B is the actual blinking frequency; IOP maxis the upper limit of normal intraocular pressure; IOP is the actual intraocular pressure; TBUT is min is the normal lower limit of tear film breakup time; TBUT is the actual tear film breakup time; HR0 is the average heart rate; HR is the actual heart rate; G0 is the initial value of skin conductivity; G is the actual skin conductivity.

[0146] In some embodiments, the second physiological characteristic parameter includes the user operation frequency and the operation interval time; the calculation formula of the correlation degree value includes:

[0147]

[0148] Wherein, F0 is the initial operation frequency (times / minute); F is the current operation frequency (times / minute); T0 is the initial operation interval (seconds); T is the current operation interval (seconds).

[0149] In some embodiments, the data acquisition module 802 is further used to obtain current ambient optical parameters; the processing module 805 is further used to determine the display brightness corresponding to different light source areas of the screen according to the ambient optical parameters and the various light source areas of the screen.

[0150] In some embodiments, the processing module 805 is also used to respond to a screen operator's request for an adjustment operation on the target light source area on the screen, match a first adjustment strategy for the light source type corresponding to the target light source area from a preset light source type adjustment strategy library, and generate a second adjustment strategy for adjusting the display parameters of the target light source area based on the first adjustment strategy and the adjustment parameters of the target light source area by the screen operator, so as to adjust the display parameters of the target light source area through the second adjustment strategy.

[0151] In some embodiments, the data acquisition module 802 is also used to obtain the content of the next display page of the current screen and the display parameter setting values ​​preset by the screen operator for different light source areas;

[0152] The processing module 805 is also used to identify the light source area of ​​the next display page content, determine the various light source areas corresponding to the next display page content, and match the third adjustment strategy corresponding to each light source area from the preset light source type adjustment strategy library; according to the third adjustment strategy combined with the display parameter setting value, generate a fourth adjustment strategy for adjusting the display parameters of each light source area of ​​the next display page content, and use the fourth adjustment strategy to adjust the next display page content and then display it.

[0153] In some embodiments, the data acquisition module 802 is further used to obtain the screen optical parameters when the screen operator operates the current screen and the current environment optical parameters after the screen adjustment strategy is executed;

[0154] The processing module 805 is further used to determine a device adjustment strategy for adjusting the ambient optical parameters according to the screen optical parameters and the current ambient optical parameters, and send the device adjustment strategy to the corresponding target device for execution.

[0155] In some embodiments, the data acquisition module 802 is also used to obtain the ambient humidity value of the current use environment of the screen operator;

[0156] The processing module 805 is also used to determine whether the eyes of the screen operator are dry according to the first physiological characteristic parameter and the ambient humidity value; if so, generate an ambient humidification adjustment instruction and send the ambient humidification adjustment instruction to the humidification device for execution.

[0157] It is worth mentioning that all modules involved in this embodiment are logic modules. In practical applications, a logic unit can be a physical unit, a part of a physical unit, or a combination of multiple physical units. In addition, in order to highlight the innovative part of this application, this embodiment does not introduce units that are not closely related to solving the technical problems proposed by this application, but this does not mean that there are no other units in this embodiment.

[0158] Embodiment three:

[0159] Another embodiment of the present application relates to an electronic device, such as Figure 8 As shown, it includes: at least one processor 901; and a memory 902 that is communicatively connected to the at least one processor 901; wherein the memory 902 stores instructions that can be executed by the at least one processor 901, and the instructions are executed by the at least one processor 901 so that the at least one processor 901 can execute the screen adjustment method in the above-mentioned embodiments.

[0160] Among them, the memory and the processor are connected in a bus manner, and the bus may include any number of interconnected buses and bridges, and the bus connects various circuits of one or more processors and memories together. The bus can also connect various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art and are therefore not further described herein. The bus interface provides an interface between the bus and the transceiver. The transceiver can be one element or multiple elements, such as multiple receivers and transmitters, providing a unit for communicating with various other devices on a transmission medium. The data processed by the processor is transmitted on a wireless medium via an antenna, and further, the antenna also receives data and transmits the data to the processor.

[0161] The processor is responsible for managing the bus and general processing, and can also provide various functions, including timing, peripheral interfaces, voltage regulation, power management, and other control functions. Memory can be used to store data used by the processor when performing operations.

[0162] Embodiment 4:

[0163] Another embodiment of the present application relates to a computer-readable storage medium, such as Fig. 9 As shown, a computer program 31 is stored. When the computer program 31 is executed by a processor, the above method embodiment is implemented.

[0164] That is, those skilled in the art can understand that all or part of the steps in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a program, and the program is stored in a storage medium, including a number of instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, referred to as: ROM), random access memory (Random Access Memory, referred to as: RAM), disk or optical disk and other media that can store program codes.

[0165] Those skilled in the art will appreciate that the above embodiments are specific embodiments for implementing the present application, and in actual applications, various changes may be made thereto in form and detail without departing from the spirit and scope of the present application.

Claims

1. A screen adjustment method, characterized in that: include: Identify the current screen display content based on an image recognition algorithm to determine different types of light source areas on the screen; Acquire several physiological characteristic parameters of the screen operator; The physiological characteristic parameters include a plurality of first physiological characteristic parameters associated with eye fatigue and a second physiological characteristic parameter associated with the screen operation behavior of the screen operator; determining the eye fatigue value of the screen operator according to the first physiological characteristic parameter; Determining a correlation degree value between the operation behavior of the screen operator and eye fatigue according to the second physiological characteristic parameter; When the eye fatigue value exceeds a preset eye fatigue threshold and / or the association degree value exceeds a preset association degree threshold, the eye fatigue degree is analyzed according to the eye fatigue value and / or the association degree value, and a screen adjustment strategy for adjusting each light source area is generated based on the eye fatigue degree and the different types of light source areas on the screen.

2. A screen adjustment method according to claim 1, characterized in that: The first physiological characteristic includes at least one of an eye-direct related parameter and an eye-indirect related parameter; the eye-direct related parameter includes at least one of an intraocular pressure parameter, a tear film breakup time parameter, an eye movement speed parameter, and a blinking frequency parameter; the eye-indirect related parameter includes at least one of a heart rate parameter and a skin conductivity parameter; The step of determining the eye fatigue value of the screen operator according to the first physiological characteristic parameter includes: Compare the plurality of first physiological characteristic parameters with the corresponding preset physiological characteristic reference values ​​respectively, and determine the comparison results corresponding to the plurality of first physiological characteristic parameters respectively; The eye fatigue value of the screen operator is determined according to the comparison results respectively corresponding to the multiple first physiological characteristic parameters.

3. A screen adjustment method according to claim 2, characterized in that: The calculation formula of the eye fatigue value includes: In the formula, B min is the lower limit of normal blinking frequency; B is the actual blinking frequency; IOP max is the upper limit of normal intraocular pressure; IOP is the actual intraocular pressure; TBUT is min is the normal lower limit of tear film breakup time; TBUT is the actual tear film breakup time; HR0 is the average heart rate; HR is the actual heart rate; G0 is the initial value of skin conductivity; G is the actual skin conductivity.

4. A screen adjustment method according to claim 1, characterized in that: The second physiological characteristic parameter includes the user's operation frequency and the operation interval time; The calculation formula of the association degree value includes: Wherein, F0 is the initial operation frequency (times / minute); F is the current operation frequency (times / minute); T0 is the initial operation interval (seconds); T is the current operation interval (seconds).

5. A screen adjustment method according to claim 1, characterized in that: The light source area type includes at least one of a strong light source area, a point light source area, an irregular light source area, and a gradual light source area; the method further includes: Get the current environment optical parameters; The display brightness corresponding to the different light source areas of the screen is determined according to the ambient optical parameters and the various light source areas of the screen.

6. A screen adjustment method according to claim 1, characterized in that: Also includes: In response to a screen operator's request for an adjustment operation on a target light source area on the screen, a first adjustment strategy for a light source type corresponding to the target light source area is matched from a preset light source type adjustment strategy library, and based on the first adjustment strategy and the screen operator's adjustment parameters for the target light source area, a second adjustment strategy for adjusting the display parameters of the target light source area is generated, so that the display parameters of the target light source area are adjusted through the second adjustment strategy.

7. A screen adjustment method according to claim 1, characterized in that: Also includes: Obtain the content of the next display page of the current screen and the display parameter setting values ​​preset by the screen operator for different light source areas; Identifying the light source area of ​​the next display page content, determining each light source area corresponding to the next display page content, and matching a third adjustment strategy corresponding to each light source area from a preset light source type adjustment strategy library; According to the third adjustment strategy combined with the display parameter setting value, a fourth adjustment strategy for adjusting the display parameters of each light source area of ​​the next display page content is generated, and the next display page content is adjusted and displayed using the fourth adjustment strategy.

8. A screen adjustment method according to claim 1, characterized in that: Also includes: When the screen adjustment strategy is executed, the screen optical parameters when the screen operator operates the current screen and the current environment optical parameters are obtained; A device adjustment strategy for adjusting the ambient optical parameters is determined according to the screen optical parameters and the current ambient optical parameters, and the device adjustment strategy is sent to a corresponding target device for execution.

9. A screen adjustment method according to claim 1, characterized in that: Also includes: Get the ambient humidity value of the current environment used by the screen operator; determining whether the eyes of the screen operator are dry according to the first physiological characteristic parameter and the ambient humidity value; If so, an environmental humidification adjustment instruction is generated and sent to the humidification device for execution.

10. A screen adjustment device, characterized in that: include: A light source recognition module, used to recognize the current screen display content based on an image recognition algorithm and determine different types of light source areas on the screen; A data acquisition module, used for acquiring several physiological characteristic parameters of the screen operator; the physiological characteristic parameters include several first physiological characteristic parameters associated with eye fatigue and second physiological characteristic parameters associated with the screen operator's screen operation behavior; An eye fatigue analysis module, used for determining the eye fatigue value of the screen operator according to the first physiological characteristic parameter; A behavior association analysis module, used to determine the association degree value between the operation behavior of the screen operator and eye fatigue according to the second physiological characteristic parameter; A processing module is used to analyze the degree of eye fatigue according to the eye fatigue value and / or the association degree value when the eye fatigue value exceeds a preset eye fatigue threshold and / or the association degree value exceeds a preset association degree threshold, and generate a screen adjustment strategy for adjusting each light source area based on the eye fatigue degree and each different type of light source area on the screen.

11. An electronic device, characterized in that: include: at least one processor; as well as, a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the screen adjustment method according to any one of claims 1 to 9.

12. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the screen adjustment method according to any one of claims 1 to 9 is implemented.

Images