Display adjustment method and device

Abstract

The present application relates to the field of terminal technology, and in particular to a display adjustment method and device. The method includes: determining a first fatigue level of a first user who is using an electronic device based on a facial image of the first user; determining a display adjustment parameter based on detected fatigue influence parameters and the first fatigue level; and adjusting the display of the electronic device based on the display adjustment parameters. The display adjustment method and device of the embodiment of the present application adjust the display of the electronic device based on the user's fatigue level and related fatigue influence parameters to further meet the user's eye protection needs and achieve the effect of non-perceiving eye protection for the user.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a display adjustment method and device. Background Art

[0002] With the popularity of consumer electronic products, people use electronic products more and more frequently in their daily lives, and the usage time is getting longer and longer. Mobile phones, tablets, computers and other terminals have become the devices that people use most frequently in daily life. A survey shows that more than half of smartphone users use their phones for more than 5 hours a day. Long-term use of electronic products such as mobile phones will inevitably affect visual health, such as causing eye discomfort such as dry eyes, swelling and pain, and tears, causing a certain degree of visual impairment, and even causing fatigue, headaches, memory loss and other systemic symptoms. Adding eye protection solutions to electronic products to create a comfortable and healthy terminal use experience has become one of the rigid demands of terminal manufacturers and consumer users.

[0003] At present, some electronic products have also added certain eye protection solutions. For example, some mobile phones support adjusting the screen brightness according to the ambient light illumination. For example, some mobile phones support issuing eye protection prompts, automatically disabling devices, or automatically adjusting screen brightness according to the length of time the user uses the phone. The eye protection solutions proposed in the prior art all adjust the display of electronic products based on a single influencing factor, which is difficult to meet the actual eye protection needs of users when using electronic products. Summary of the invention

[0004] The present application provides a display adjustment method and device to further meet the actual eye protection needs of users when using electronic products.

[0005] In a first aspect, the present technical solution provides a display adjustment method, which is applied to an electronic device having a display screen (for example, a touch screen, a flexible screen, a curved screen, etc.), a camera, and a light sensor, including: determining a first fatigue level of a first user based on a facial image of the first user who is using the electronic device; determining a display adjustment parameter based on detected fatigue influence parameters and the first fatigue level; and adjusting the display of the electronic device based on the display adjustment parameter.

[0006] In the present application, the first fatigue degree of the first user is determined based on the facial image of the first user who is currently using the electronic device. After determining the first fatigue degree of the first user, a fatigue influencing parameter is further obtained. The fatigue influencing parameter refers to a parameter that can affect the fatigue degree of the first user during the process of the first user using the electronic device. Thereafter, a display adjustment parameter is determined based on the fatigue influencing parameter and the first fatigue degree of the first user, and the display of the electronic device is adjusted based on the display adjustment parameter. In the present application, the display of the electronic device is adjusted based on the fatigue degree of the user and the related fatigue influencing parameters to further meet the eye protection needs of the user and achieve the effect of non-perceiving eye protection for the user. Optionally, the first fatigue degree can represent the fatigue degree of the user. In a specific implementation, the first fatigue degree can be brain fatigue, visual fatigue, or the overall fatigue degree of the user obtained by combining brain fatigue and visual fatigue.

[0007] In combination with the first aspect, in certain implementations of the first aspect, the fatigue influencing parameters may include a combination of one or more of the following parameters: environmental parameters of the environment in which the electronic device is located; display device parameters of the electronic device; content display parameters of the electronic device. Among them, the environmental parameters of the environment in which the electronic device is located may include: ambient light illumination, color temperature, etc.; the display device parameters of the electronic device may include the pulse width modulation (PWM) duty cycle of the display screen, the pixel density (Pixels Per Inch, PPI) of the display screen, etc.; the content display parameters of the electronic device may include: the content scene currently being played on the display screen (such as game scene, e-book scene, instant messaging scene, video playback scene, etc.), screen on time, screen brightness, clarity, contrast, grayscale, etc.

[0008] The fatigue-affecting parameters detected in the present application may be one of environmental parameters, display device parameters, and content display parameters, a combination of two or all three types of parameters, and the specific parameters contained in each type can be determined according to actual needs. In addition, the combination of the three types of parameters may be fixed. In an optional scheme, the combination of the three types of parameters may be dynamically combined according to the user's fatigue level, usage time, etc. In the scheme of the present application, on the basis of detecting the user's fatigue level, environmental parameters, display device parameters, and content display parameters are further used as constraints to adjust the display of the electronic device, thereby realizing personalized display adjustment based on the user's specific usage scenario and meeting the user's actual eye protection needs.

[0009] In combination with the first aspect, in certain implementations of the first aspect, a method for determining a first fatigue level of a first user based on a facial image of the first user who is using an electronic device may be: obtaining a facial image of a user who is using an electronic device, extracting an eye area sub-map from the facial image; identifying an eye closure state of the first user based on the eye area sub-map; and determining a first fatigue level of the first user based on the eye closure state of the first user.

[0010] In the present application, methods such as template matching and convolutional neural network recognition can be used to identify the eye closure state of the first user from the eye region sub-map. For example, when it is determined according to the template matching method that the degree of eye opening exceeds the first threshold, the eyes are considered to be in an open state; when the degree of eye opening does not exceed the first threshold, the eyes are considered to be in a closed state. The eye closure state of a user in the process of using an electronic device can represent the user's fatigue state to a certain extent. Therefore, in the present application, the fatigue degree of the first user is determined based on the eye closure state of the first user.

[0011] In combination with the first aspect, in certain implementations of the first aspect, a first fatigue level of the first user is determined based on the eye closure state of the first user, including: determining a blinking frequency and an eye closure duration of the first user in a detection cycle based on the eye closure state within the detection cycle; determining the first fatigue level based on the blinking frequency and eye closure duration of the first user in the detection cycle.

[0012] In the present application, the fatigue degree of the user is calculated periodically. In a detection cycle, the face image of the first user is obtained at a certain frequency, and the eye closure state is identified based on the eye area sub-image in the face image. Afterwards, the blinking frequency and eye closure duration of the first user in the detection cycle are calculated based on the eye closure state in the detection cycle, and then the first fatigue degree of the first user is determined according to the blinking frequency and eye closure duration. Among them, the first fatigue degree is positively correlated with the blinking frequency and eye closure duration, that is, the higher the blinking frequency in a detection cycle, the longer the eye closure time is, and the larger the value of the corresponding first fatigue degree is. Specifically, the eye closure duration can be the total eye closure duration of the first user in a detection cycle, or it can be the average duration of a single eye closure in a detection cycle. Assuming that in a detection cycle T, the first user is detected to have closed his eyes m times, then the blinking frequency of the first user in the detection cycle T is T / m. The duration of each eye closure can be determined according to the image sampling frequency and the number of image frames corresponding to each eye closure. For example, within a detection period T, W frames of facial images are captured. Assuming that one eye closure is determined based on k frames of images, the duration of this eye closure can be calculated as T / W*k. Similarly, the total duration of multiple eye closures within the detection period T and the average duration of each eye closure can be calculated. In specific implementation, the frame rate of facial images can be set according to actual needs. For example, in one example, the frame rate of facial images is greater than 30Hz to ensure that the user's eye closure state can be captured.

[0013] In combination with the first aspect, in certain implementations of the first aspect, the first fatigue level is determined based on the blinking frequency and the length of time the eyes are closed of the first user in the detection period, including: determining the first fatigue coefficient of the first user in the detection period based on the blinking frequency and the length of time the eyes are closed of the first user in the detection period; determining the first fatigue level based on the first fatigue coefficient and the fatigue coefficients of N detection periods before the detection period, where N is a positive integer.

[0014] In this application, a functional relationship α=f(freq, t_interval) is established between the fatigue coefficient α and the blinking frequency freq and the eye closing duration t_interval. In each detection cycle, ∝ t=f(freq, t_interval), (t=1,…,X), X is the Xth detection cycle. Furthermore, a functional relationship between the fatigue coefficient α and the fatigue degree is established in the present application. In an optional design, the fatigue degree of the first user in the current detection cycle (such as the current detection cycle is the Xth detection cycle) is related to the fatigue coefficients of the N detection cycles before the current detection cycle, and N is a positive integer less than X. In a specific implementation, N can take the value of X-1, that is, the fatigue degree of the current cycle is related to the fatigue coefficient of each detection cycle in the X detection cycles. Of course, the value of N can be set according to actual needs. For example, if N is 1, the fatigue degree of the Xth detection cycle is related to the fatigue coefficient of the Xth detection cycle and the fatigue coefficient of one of the detection cycles in the previous X-1 detection cycles. Which detection cycle it is related to can be set according to actual needs. In addition to taking the value of 1, N can also take the value of 2, 3...(X-1), etc., which will not be expanded one by one.

[0015] In combination with the first aspect, in certain implementations of the first aspect, the first fatigue degree is determined based on the first fatigue coefficient and the fatigue coefficients of N detection cycles before the detection cycle, including: determining the first fatigue degree based on the first fatigue coefficient and the fatigue coefficient obtained in the initial detection cycle.

[0016] In combination with the first aspect, in certain implementations of the first aspect, display adjustment parameters are determined based on the detected fatigue influence parameters and the first fatigue level, including: determining the second fatigue level of the first user under the detected fatigue influence parameters; and determining the display adjustment parameters based on the second fatigue level and the first fatigue level.

[0017] In combination with the first aspect, in certain implementations of the first aspect, determining the second fatigue level of the first user under the detected fatigue influence parameter includes: querying the second fatigue level from an established fatigue level query table based on the fatigue influence parameter.

[0018] In combination with the first aspect, in some implementations of the first aspect, adjusting the display of the electronic device according to the display adjustment parameters includes: adjusting content display parameters and / or device parameters supported by the electronic device according to the display adjustment parameters.

[0019] In a second aspect, the present technical solution provides a display adjustment device, including: a processing unit, used to determine a first fatigue level of a first user based on a facial image of the first user who is using an electronic device; and also used to determine a display adjustment parameter based on the detected fatigue impact parameter and the first fatigue level; an adjustment unit, used to adjust the display of the electronic device according to the display adjustment parameter.

[0020] In combination with the second aspect, in some implementations of the second aspect, the fatigue influencing parameters include one or more combinations of the following: environmental parameters of the environment in which the electronic device is located; display device parameters of the electronic device; display content parameters of the electronic device.

[0021] In combination with the second aspect, in certain implementations of the second aspect, the processing unit is specifically used to extract an eye area sub-map from the face image; identify the eye closure state of the first user based on the eye area sub-map; and determine the first fatigue level of the first user based on the eye closure state of the first user.

[0022] In combination with the second aspect, in certain implementations of the second aspect, the processing unit is specifically used to determine the blinking frequency and eye closure duration of the first user within a detection period based on the eye closure state of the human eye within the detection period; and determine the first fatigue level based on the blinking frequency and eye closure duration of the first user within the detection period.

[0023] In combination with the second aspect, in certain implementations of the second aspect, the processing unit is specifically used to determine a first fatigue coefficient of the first user in the detection period based on the blinking frequency and eye closure duration of the first user in the detection period; and determine the first fatigue degree based on the first fatigue coefficient and the fatigue coefficients of N detection periods before the detection period, where N is a positive integer.

[0024] In combination with the second aspect, in some implementations of the second aspect, the processing unit is specifically used to determine the first fatigue degree according to the first fatigue coefficient and the fatigue coefficient obtained in an initial detection cycle.

[0025] In combination with the second aspect, in certain implementations of the second aspect, the processing unit is specifically used to determine a second fatigue degree of the first user under the detected fatigue influence parameter; and determine a display adjustment parameter based on the second fatigue degree and the first fatigue degree.

[0026] In combination with the second aspect, in some implementations of the second aspect, the processing unit is specifically configured to query the second fatigue degree from an established fatigue degree query table based on the fatigue influencing parameter.

[0027] In combination with the second aspect, in some implementations of the second aspect, the display unit is specifically configured to adjust content display parameters and / or device parameters supported by the electronic device according to the display adjustment parameters.

[0028] In a third aspect, the present technical solution provides a display adjustment device, comprising: a display screen; a camera; a light sensor; one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, which, when executed by the device, cause the device to perform the following steps: determine a first fatigue level of a first user who is using the electronic device based on a facial image of the first user; determine a display adjustment parameter based on the detected fatigue influence parameter and the first fatigue level; and adjust the display of the electronic device based on the display adjustment parameter.

[0029] In a fourth aspect, the present technical solution provides a display adjustment device, which includes a storage medium and a central processing unit. The storage medium may be a non-volatile storage medium, in which a computer executable program is stored. The central processing unit is connected to the non-volatile storage medium and executes the computer executable program to implement the method in the first aspect or any possible implementation method of the first aspect.

[0030] In a fifth aspect, the present technical solution provides a chip, comprising a processor and a data interface, wherein the processor reads instructions stored in a memory through the data interface to execute the method in the first aspect or any possible implementation of the first aspect.

[0031] Optionally, as an implementation method, the chip may also include a memory, in which instructions are stored, and the processor is used to execute the instructions stored in the memory. When the instructions are executed, the processor is used to execute the method in the first aspect or any possible implementation method of the first aspect.

[0032] In a sixth aspect, the present technical solution provides a computer-readable storage medium, wherein the computer-readable medium stores a program code for execution by a device, wherein the program code includes instructions for executing the method in the first aspect or any possible implementation of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 is a structural schematic diagram of an electronic device provided in an embodiment of the present application;

[0034] Figure 2 It is a software structure block diagram of the electronic device provided in the embodiment of the present application;

[0035] Figure 3 is a schematic flow chart of a display adjustment method provided in an embodiment of the present application;

[0036] Figure 4is a schematic framework diagram of a display adjustment method provided in an embodiment of the present application;

[0037] Figure 5 is a schematic diagram of offline modeling of a display adjustment method provided in an embodiment of the present application;

[0038] Figure 6 is another schematic flow chart of the display adjustment method provided in an embodiment of the present application;

[0039] Figure 7 It is a structural schematic diagram of a display adjustment device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0040] The technical solution in this application will be described below in conjunction with the accompanying drawings.

[0041] As introduced in the background technology section, the eye protection solutions currently supported by electronic products are mostly determined based on a single influencing factor, while the scenarios in which users use electronic devices are relatively complex, and the user's own state will also affect the user experience of the electronic device. Therefore, in the absence of overall system considerations, the eye protection solutions developed in the prior art are difficult to achieve the expected results in specific usage scenarios, and for this reason, an eye protection solution that conforms to the user's own state and usage scenarios is needed.

[0042] The embodiment of the present application provides a display adjustment method, which is applied to the scene where the user uses an electronic device. In the process of the user using the electronic device, the display of the electronic device can be automatically adjusted based on the user's own state (such as the user's fatigue level) and fatigue influencing parameters, so that the display effect of the electronic device can better meet the user's usage needs and eye protection needs, and achieve the effect of eye protection without the user's perception.

[0043] The display adjustment method of the embodiment of the present application can be applied to electronic devices such as mobile phones, tablet computers, computers, wearable devices, vehicle-mounted devices, smart home devices, augmented reality (AR) / virtual reality (VR) devices, etc. with display screens. The embodiment of the present application does not impose any restrictions on the specific type of electronic devices.

[0044] For example, Figure 1A schematic diagram of the structure of an electronic device 100 provided in an embodiment of the present application is shown. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. Optionally, the number of the above-mentioned microphone 170C is multiple. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0045] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0046] In the electronic device 100, the processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated in one or more processors.

[0047] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0048] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0049] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0050] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0051] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0052] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.

[0053] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0054] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0055] For example, in the present application, the facial image of the first user who is using the electronic device can be captured by the camera 193, and the ISP converts the electrical signal of the facial image fed back by the camera 193 into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP can convert the digital image signal into an image signal in a standard RGB, YUV or other format.

[0056] The above-mentioned image signal about the first user's face generated based on DSP processing can be sent to the NPU for face recognition, such as identifying the facial features based on the face image. In the embodiment of the present application, the fatigue of the first user can be calculated based on the recognition of the facial features. In a specific example, the eye area can be identified based on the face image, and the closed state of the eye can be judged based on the eye area, and then the fatigue of the first user can be calculated according to the closed state of the eye. Among them, the calculation and judgment process of calculating the fatigue of the first user based on the facial features, judging the closed state of the eye based on the eye area, and calculating the fatigue of the first user according to the closed state of the eye can be performed by the controller or AP.

[0057] In the above electronic device, the ambient light sensor 180L is used to sense the ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touch.

[0058] For example, in an embodiment of the present application, the light brightness of the environment in which the electronic device is located can be collected based on the ambient light sensor 180L, wherein the light brightness of the environment in which the electronic device is located can be used as one of the fatigue influencing parameters to participate in determining the display adjustment parameters.

[0059] Other parameters that may be included in the fatigue impact parameters can be obtained based on the corresponding devices included in the electronic device 100. For example, when the fatigue impact parameters include the content scene currently playing on the display screen and the usage time of the current application, the corresponding parameters can be obtained from the AP. For example, when the fatigue impact parameters include screen brightness, clarity, contrast, grayscale and other parameters, the corresponding parameters can be obtained from the GPU.

[0060] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121, and / or instructions stored in a memory provided in the processor.

[0061] In the embodiment of the present application, instructions for executing the display adjustment method are stored in the internal memory 121 , and the processor 110 executes the corresponding display adjustment method by running the instructions stored in the internal memory 121 .

[0062] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present invention, the Android system of the layered architecture is taken as an example to exemplify the software structure of the electronic device 100.

[0063] Figure 2 It is a software structure diagram of the electronic device 100 provided in an embodiment of the present application. The layered architecture divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer. The application layer can include a series of application packages.

[0064] like Figure 2 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc. In one possible design, an eye protection application may be set in the electronic device.

[0065] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0066] For example, the application framework layer can provide an API and a programming framework for the set eye protection application, and the functions or algorithms for implementing the display adjustment in this application can be included in the application framework layer.

[0067] like Figure 2 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0068] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0069] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0070] For example, in the embodiment of the present application, the data required to execute the display adjustment method, such as face images, fatigue impact parameters, etc., can be stored or obtained through a content provider.

[0071] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0072] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0073] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0074] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0075] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0076] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0077] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0078] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0079] For ease of understanding, the following embodiments of the present application will be described in detail with Figure 1 and Figure 2 Taking the electronic device with the structure shown as an example, the display adjustment provided in the embodiment of the present application is specifically explained in combination with the accompanying drawings and application scenarios.

[0080] When a user uses an electronic device, the user experience is affected by multiple factors such as the user's fatigue state, the environment, and the content displayed on the electronic device. In the embodiment of the present application, multiple factors that may affect the user experience, such as the environment and the content displayed on the electronic device, are used as fatigue influencing parameters together with the user's fatigue level to jointly determine the display adjustment parameters of the electronic device, thereby achieving adaptive adjustment of the electronic device display, improving the user's eye comfort when using the electronic device, and achieving the effect of eye protection.

[0081] Figure 3 This is a schematic flow chart of the display adjustment method provided by the embodiment of the present application. This application will use a mobile phone as an electronic device to introduce the display adjustment method provided by the present application in detail.

[0082] 101, obtain a face image.

[0083] In the embodiment of the present application, the purpose of obtaining a facial image is to determine the user's fatigue level based on the facial image. The facial image can be obtained by obtaining a facial image of a first user who is using the electronic device through a front camera on the electronic device. Optionally, the facial image can include the facial features of the first user, and the fatigue level of the first user can be determined based on the state of the facial features. Specifically, the fatigue level of the first user can be determined based on the state of the eyes among the facial features.

[0084] In addition, the above-mentioned face image may also include only the eye area, that is, the front camera only captures the eye area of ​​the first user for shooting. Among them, the above-mentioned image including only the eye area can be used to independently determine the fatigue degree of the first user, and of course, it can also be used together with the image including the facial features to jointly determine the fatigue degree of the first user.

[0085] 102. Determine the user's fatigue level according to the face image.

[0086] In an embodiment of the present application, after acquiring a facial image of the first user based on the front camera of the electronic device, the first fatigue level of the user is determined based on the facial image of the first user. Wherein, the method of determining the first fatigue level based on the facial image includes: extracting a human eye region sub-image from the facial image; identifying the human eye closure state of the first user based on the human eye region sub-image; and determining the first fatigue level of the first user based on the human eye closure state of the first user. In an embodiment of the present application, a functional relationship between the human eye closure state and the user fatigue level. Based on this functional relationship, after acquiring the human eye closure state of the first user, the first fatigue level of the first user can be calculated based on the human eye closure state.

[0087] In the present application, template matching, convolutional neural network recognition and other methods can be used to identify the closed state of the eyes of the first user from the eye area sub-map. For example, when the degree of openness of the human eyes exceeds the first threshold value according to the template matching method, the eyes are determined to be in an open state; when the degree of openness of the human eyes does not exceed the first threshold value, the eyes are determined to be in a closed state. In a specific implementation, when the degree of openness of the human eyes exceeds 70%, the eyes are determined to be in an open state, otherwise they are in a closed state. When the above-mentioned methods such as template matching and convolutional neural network recognition are used to identify the closed state of the human eyes, images containing only the eye area can be identified, images containing the facial features of the first user can be identified, or images containing only the eye area and images containing the facial features of the first user can be combined for identification.

[0088] The closed state of the user's eyes during the use of an electronic device can, to a certain extent, characterize the user's fatigue level. In the embodiment of the present application, calculating the first fatigue level of the first user may include: determining the blinking frequency and eye closure duration of the first user in a detection cycle according to the closed state of the human eyes in the detection cycle; determining the first fatigue level according to the blinking frequency and eye closure duration of the first user in the detection cycle.

[0089] In the present application, the user's fatigue degree is calculated periodically. In a detection cycle, the facial image of the first user is obtained at a certain frequency, and the eye closure state is identified based on the eye area sub-image in the facial image. Afterwards, the blinking frequency and eye closure duration of the first user in the detection cycle are calculated based on the eye closure state in the detection cycle, and then the first fatigue degree of the first user is determined according to the blinking frequency and eye closure duration. Among them, the first fatigue degree can be positively correlated with both the blinking frequency and the eye closure duration, that is, the higher the blinking frequency in a detection cycle, the longer the eye closure time is, and the larger the value of the corresponding first fatigue degree is. Specifically, the eye closure duration can be the total eye closure duration of the first user in a detection cycle, or it can be the average duration of a single eye closure in a detection cycle. Assume that in a detection cycle T, the first user is detected to have closed his eyes m times, then the blinking frequency of the first user in the detection cycle T is T / m. The duration of each eye closure can be determined based on the image sampling frequency and the number of image frames corresponding to each eye closure. For example, within a detection period T, W frames of facial images are taken. Assuming that one eye closure is determined based on k frames of images, the duration of this eye closure can be calculated as T / W*k. Similarly, the total duration of multiple eye closures within the detection period T and the average duration of each eye closure can be calculated.

[0090] In a specific implementation, the first fatigue level is determined based on the blinking frequency and the eye closure duration of the first user in the detection period, including: determining the first fatigue coefficient of the first user in the detection period according to the blinking frequency and the eye closure duration of the first user in the detection period; determining the first fatigue level based on the first fatigue coefficient and the fatigue coefficients of N detection periods before the detection period, where N is a positive integer.

[0091] In this application, a functional relationship α=f(freq, t_interval) is established between the fatigue coefficient α and the blinking frequency freq and the eye closing duration t_interval. In each detection cycle, ∝ t=f(freq, t_interval), (t=1,…,X), X is the Xth detection cycle. Furthermore, a functional relationship between the fatigue coefficient α and the fatigue degree is established in the present application. In an optional design, the fatigue degree of the first user in the current detection cycle (such as the current detection cycle is the Xth detection cycle) is related to the fatigue coefficients of the N detection cycles before the current detection cycle, and N is a positive integer less than X. In a specific implementation, N can take the value of X-1, that is, the fatigue degree of the current cycle is related to the fatigue coefficient of each detection cycle in the X detection cycles. Of course, the value of N can be set according to actual needs. For example, if N is 1, the fatigue degree of the Xth detection cycle is related to the fatigue coefficient of the Xth detection cycle and the fatigue coefficient of one of the detection cycles in the previous X-1 detection cycles. Which detection cycle it is related to can be set according to actual needs.

[0092] In a specific example, the fatigue level of the Xth detection cycle is related to the fatigue coefficient of the Xth detection cycle and the fatigue coefficient of the X-1th detection cycle. For another example, the fatigue level of the Xth detection cycle is related to the fatigue coefficients of the Xth detection cycle and the first detection cycle, that is, the first fatigue level of the first user is determined based on the first fatigue coefficient and the fatigue coefficient of the initial detection cycle. The above values ​​of N are only examples. Based on the above examples, it can be clearly seen that in addition to the value of 1, N can also take values ​​of 2, 3...(X-1), etc., which will not be expanded one by one.

[0093] 103 : Determine a display adjustment parameter according to the detected fatigue influence parameter and the first fatigue degree.

[0094] In an embodiment of the present application, the fatigue impact parameter may include a combination of one or more of the following parameters: environmental parameters of the environment in which the electronic device is located; display device parameters of the electronic device; and content display parameters of the electronic device.

[0095] Among them, the environmental parameters of the environment in which the electronic device is located may include: ambient light illumination, color temperature, etc.; the display device parameters of the electronic device may include the pulse width modulation (PWM) duty cycle of the display screen, the pixel density (Pixels Per Inch, PPI) of the display screen, etc.; the content display parameters of the electronic device may include: the content scene currently being played on the display screen (such as a game scene, an e-book scene, an instant messaging scene, a video playback scene, etc.), the screen-on time, screen brightness, clarity, contrast, grayscale, etc.

[0096] The fatigue-affecting parameters detected in the present application may be one of environmental parameters, display device parameters, and content display parameters, a combination of two or all three types of parameters, and the specific parameters contained in each type can be determined according to actual needs. In addition, the combination of the three types of parameters may be fixed. In an optional scheme, the combination of the three types of parameters may be dynamically combined according to the user's fatigue level, usage time, etc. In the scheme of the present application, on the basis of detecting the user's fatigue level, environmental parameters, display device parameters, and content display parameters are further used as constraints to adjust the display of the electronic device, thereby realizing personalized display adjustment based on the user's specific usage scenario and meeting the user's actual eye protection needs.

[0097] In an embodiment of the present application, display adjustment parameters are determined based on the detected fatigue influence parameters and the first fatigue level, including: determining the second fatigue level of the first user under the detected fatigue influence parameters; and determining the display adjustment parameters based on the second fatigue level and the first fatigue level.

[0098] Wherein, under the detected fatigue influence parameter, calculating the second fatigue degree of the first user may be: based on the detected fatigue influence parameter, querying the second fatigue degree from an established fatigue degree query table. In a specific implementation, querying the maximum fatigue degree under the fatigue influence parameter from the established fatigue degree query table.

[0099] 104 , adjusting the display of the electronic device according to the display adjustment parameter.

[0100] Among them, adjusting the display of the electronic device includes adjusting the content display parameters and / or device parameters supported by the electronic device. For example, adjusting the brightness, contrast, clarity, color temperature and other post-processing parameters of the electronic device, and / or adjusting the PWM duty cycle of the display screen. If the electronic device is a foldable screen device, the folding angle of the electronic device display screen can also be adjusted.

[0101] It can be seen that in the embodiment of the present application, the electronic device is adjusted based on the user's fatigue level and related fatigue influencing parameters to further meet the user's eye protection needs and achieve the effect of user-unaware eye protection.

[0102] Figure 4 is a schematic framework diagram of the display adjustment method provided in the embodiment of the present application. Figure 4As shown, the core functional module of the embodiment of the present application is the eye protection module, and the input includes: (1) environmental parameters collected by sensors, such as illuminance, color temperature, etc.; (2) display content parameters obtained by the display engine. Specifically, the display content parameters may include the current content scene (such as game scene, e-book scene, instant messaging scene, video scene, etc.), screen on time, screen brightness, clarity, contrast, grayscale, etc.; (3) display device parameters, such as PWM duty cycle, PPI, etc.; (4) user fatigue, where the calculation of user fatigue can refer to Figure 1 Description in the illustrated embodiment. The eye protection module calculates the display adjustment parameters based on the above inputs and adjusts the display of the electronic device. In the embodiment of the present application, by establishing a multi-input and multi-output system eye protection solution, the display of the electronic device is intervened in real time and dynamically according to the user's fatigue in different environments, different display contents, and different display device parameters. For example, the display of the electronic device in different dimensions such as brightness, clarity, contrast, color, and PWM can be adjusted, ultimately achieving the effect of user-unaware eye protection.

[0103] like Figure 5 As shown, in the embodiment of the present application, the correlation relationship between environmental parameters, display content parameters, display device parameters and user fatigue can be established through human factors experiments. For the convenience of description, the correlation relationship between environmental parameters, display content parameters, display device parameters and user fatigue is called a visual health model.

[0104] 1. Build a visual health model offline

[0105] like Figure 5 As shown in the figure, under different environmental parameters, display content parameters, and display device parameters, the blinking frequency and average blinking duration in each detection cycle T that changes with time t are counted, and the human eye fatigue coefficient ∝ in the same cycle T is counted based on the blinking frequency and average blinking duration in each cycle T. t (t=1,…,N), where N is the Nth detection cycle and the duration of each detection cycle is T. Visual fatigue coefficient ∝=a*freq+b*t_interval, where freq is the blinking frequency and the average eye closing duration t_interval in a cycle T. The user's visual fatigue degree in the current detection cycle β=∝ N -∝0, ∝0 is the user's visual fatigue coefficient during the initial detection period.

[0106] As shown in Table 1, in each detection period T, by changing the environmental parameters, display content parameters, and display device parameters, the maximum visual fatigue degree β in each detection period T is obtained. max =∝ N-∝0. In an application scenario, after detecting specific environmental parameters, display content parameters and display device parameters, the maximum visual fatigue degree β of the user in the corresponding specific scenario can be determined by looking up the table. max .

[0107] APL Ambient Light Sensor Panel PWM ratio <![CDATA[β max =∝ N -∝0]]> 50％ 500lux 50％ XX

[0108] Table 1 Visual health model

[0109] 2. Adjust the display of electronic devices online

[0110] like Figure 6 As shown, in the scenario where a user uses an electronic device, the environmental parameters, display content parameters, display device parameters of the electronic device can be detected, and the user fatigue can be calculated, and the display of the electronic device can be dynamically adjusted accordingly. Figure 6 As shown, including:

[0111] 201, using the front camera of the electronic device to obtain a face image of the current frame.

[0112] 202: Determine the eye closure state of the user according to the current frame face image.

[0113] The eye closure state of the user in the current frame may be obtained through template matching or machine learning algorithms. For example, when it is determined that the user's eyes are open to a degree exceeding 70%, the eyes are determined to be open, otherwise the eyes are determined to be closed.

[0114] 203 , whether the current image frame number reaches the statistical cycle T1 , if not, return to step 201 to continue collecting face images; if reaching the statistical cycle T1 , execute step 204 .

[0115] 204, the blinking frequency and average blinking duration in the statistical period T1, and the calculation of the visual fatigue coefficient ∝ t .

[0116] In this embodiment, the calculation method of the blink frequency and average blink duration in the period T1 can be referred to Figure 3 The corresponding instruction manual section.

[0117] Visual fatigue coefficient ∝ t It can be calculated according to the formula ∝=a*freq+b*t_interval.

[0118] 205, calculate the human eye fatigue degree β based on the visual fatigue coefficient t .

[0119] In the embodiment of the present application, the visual fatigue coefficient ∝ t The relative change of human eye fatigue degree βt , that is, β t =(∝ t -∝0), or β t =f(∝ t -∝0), f is a function of other forms.

[0120] 206, obtaining environmental parameters, display content parameters, and display device parameters.

[0121] In a specific example, the environmental parameter is a light brightness value collected by an ambient light sensor, and the display content parameter is a display scene (such as a game scene) and an average grayscale value.

[0122] 207, input the acquired environmental parameters, display content parameters and display device parameters into the visual health model to obtain the maximum visual fatigue degree β max .

[0123] 208, according to β max and β t Calculate and display the intervention coefficient number.

[0124] In one example, the intervention coefficient is shown as w = β t / β max .

[0125] 209 , calculating a display adjustment parameter using the obtained display intervention coefficient, and performing display adjustment on the electronic device.

[0126] In an embodiment of the present application, the display adjustment parameters are calculated using the calculated display intervention coefficient w. For example, the blue light ratio is adjusted from the current P to w*P, and the PWM ratio is adjusted from the current L to w*L, where w*P and w*L are display adjustment parameters calculated based on the intervention coefficient.

[0127] It is understandable that, in order to implement the above functions, the electronic device includes hardware and / or software modules corresponding to the execution of each function. In combination with the steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments.

[0128] In this embodiment, the electronic device can be divided into functional modules according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0129] In the case of dividing each functional module into corresponding functional modules, Figure 7 A possible schematic diagram of the display adjustment device involved in the above embodiment is shown. Figure 7 As shown, the display adjustment device 700 may be integrated with an eye protection module, and the eye protection module functionally includes a processing unit 701 and an adjustment unit 702, wherein:

[0130] The processing unit 701 is configured to determine a first fatigue degree of a first user who is using an electronic device according to a face image of the first user; and to determine a display adjustment parameter according to the detected fatigue influence parameter and the first fatigue degree;

[0131] The adjustment unit 702 is configured to perform display adjustment on the electronic device according to the display adjustment parameter.

[0132] In a possible implementation, the fatigue impact parameter includes one or more combinations of the following: environmental parameters of the environment in which the electronic device is located; display device parameters of the electronic device; and display content parameters of the electronic device.

[0133] In a possible implementation, the processing unit 701 is specifically used to extract an eye area sub-image from the face image; identify the eye closure state of the first user according to the eye area sub-image; and determine the first fatigue level of the first user according to the eye closure state of the first user.

[0134] In a possible implementation, the processing unit 701 is specifically used to determine the blinking frequency and eye closure duration of the first user within a detection period based on the eye closure state of the human eye within the detection period; and determine the first fatigue level based on the blinking frequency and eye closure duration of the first user within the detection period.

[0135] In a possible implementation, the processing unit 701 is specifically used to determine a first fatigue coefficient of the first user in the detection period according to the blinking frequency and eye closure duration of the first user in the detection period; and determine the first fatigue degree according to the first fatigue coefficient and the fatigue coefficients of N detection periods before the detection period, where N is a positive integer.

[0136] In a possible implementation, the processing unit 701 is specifically configured to determine the first fatigue degree according to the first fatigue coefficient and the fatigue coefficient obtained in an initial detection period.

[0137] In a possible implementation, the processing unit 701 is specifically configured to determine a second fatigue degree of the first user under the detected fatigue influence parameter; and determine a display adjustment parameter based on the second fatigue degree and the first fatigue degree.

[0138] In a possible implementation, the processing unit 701 is specifically configured to query the second fatigue degree from an established fatigue degree query table based on the fatigue influencing parameter.

[0139] In a possible implementation manner, the display unit 702 is specifically configured to adjust content display parameters and / or device parameters supported by the electronic device according to the display adjustment parameters.

[0140] It should be understood that the electronic device here is embodied in the form of a functional unit. The term "unit" here can be implemented in the form of software and / or hardware, and is not specifically limited to this. For example, a "unit" can be a software program, a hardware circuit, or a combination of the two that implements the above functions. The hardware circuit may include an application specific integrated circuit (ASIC), an electronic circuit, a processor (such as a shared processor, a proprietary processor, or a group processor, etc.) and a memory for executing one or more software or firmware programs, a merged logic circuit, and / or other suitable components that support the described functions.

[0141] The present application also provides a display adjustment device, comprising: a display screen; a camera; a light sensor; one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, which, when executed by the device, cause the device to perform the following steps: determine a first fatigue level of a first user who is using an electronic device based on a facial image of the first user; determine a display adjustment parameter based on the detected fatigue influence parameter and the first fatigue level; and adjust the display of the electronic device based on the display adjustment parameter.

[0142] The present application also provides a display adjustment device, the device comprising a storage medium and a central processing unit, the storage medium may be a non-volatile storage medium, the storage medium stores a computer executable program, the central processing unit is connected to the non-volatile storage medium, and executes the computer executable program to implement the above Figures 3 to 6Display adjustment method shown in .

[0143] The present application also provides a chip, the chip includes a processor and a data interface, the processor reads instructions stored in the memory through the data interface, and executes the above Figures 3 to 6 Display adjustment method shown in .

[0144] Optionally, as an implementation manner, the chip may further include a memory, in which instructions are stored, and the processor is used to execute the instructions stored in the memory. When the instructions are executed, the processor is used to execute the display adjustment method in the above-mentioned embodiments.

[0145] In a sixth aspect, the present technical solution provides a computer-readable storage medium, wherein the computer-readable medium stores a program code for execution by a device, wherein the program code includes instructions for executing a method in a possible implementation of the above-mentioned display adjustment method.

[0146] The memory can be a read-only memory (ROM), other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), a magnetic disk storage medium or other magnetic storage device, or it can also be any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer.

[0147] In the embodiments of the present application, "at least one" refers to one or more, and "plurality" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent the existence of A alone, the existence of A and B at the same time, and the existence of B alone. Among them, A and B can be singular or plural. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can be represented by: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple.

[0148] Those of ordinary skill in the art will appreciate that the various units and algorithm steps described in the embodiments disclosed herein can be implemented in a combination of electronic hardware, computer software, and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0149] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0150] In several embodiments provided in the present application, any function can be stored in a computer-readable storage medium if it is implemented in the form of a software functional unit and sold or used as an independent product. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence or in other words, the part that contributes to the prior art or the part of the technical solution. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0151] The above is only a specific implementation of the present application. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. The protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A display adjustment method, applied to an electronic device, characterized in that: The electronic device includes a display screen, and the method includes the electronic device detecting a facial image of a user, and determining a first fatigue level of the user based on the facial image; determining a display adjustment parameter of the display screen based on a fatigue influence parameter and the first fatigue degree; The display screen is adjusted according to the display adjustment parameters.

2. The method according to claim 1, characterized in that The fatigue impact parameter includes at least one of the following parameters: Environmental parameters of the environment in which the electronic device is located; Display device parameters of the electronic device; Content display parameters of the electronic device.

3. The method according to claim 1, characterized in that Determining the first fatigue level of the user based on the face image includes: Extracting a human eye region sub-image from the face image; identifying the eye closure state of the first user according to the eye region sub-image; A first fatigue level of the first user is determined according to the eye closure state of the first user.

4. The method according to claim 3, characterized in that Determining a first fatigue level of the user according to a human eye closure state of the user includes: Determine the blinking frequency and eye closure duration of the user in a detection period according to the eye closure state of the user in the detection period; The first fatigue level is determined according to the blinking frequency and the eye closing duration of the user in the detection period.

5. The method according to claim 4, characterized in that Determining the first fatigue level according to the blinking frequency and the eye closing duration of the user in the detection period includes: Determine a first fatigue coefficient of the user in the detection period according to the blinking frequency and the eye closing duration of the user in the detection period; The first fatigue degree is determined according to the first fatigue coefficient and fatigue coefficients of N detection cycles before the detection cycle, where N is a positive integer.

6. The method according to claim 5, characterized in that Determining the first fatigue degree according to the first fatigue coefficient and fatigue coefficients of N detection cycles before the detection cycle includes: The first fatigue degree is determined according to the first fatigue coefficient and the fatigue coefficient obtained in an initial detection period.

7. The method according to any one of claims 1 to 6, characterized in that Determining display adjustment parameters according to the detected fatigue impact parameter and the first fatigue degree includes: determining a second fatigue degree of the user under the detected fatigue influence parameter; A display adjustment parameter is determined based on the second fatigue level and the first fatigue level.

8. The method according to claim 7, characterized in that Determining a second fatigue degree of the user under the detected fatigue influence parameter comprises: Based on the fatigue influencing parameter, the second fatigue degree is queried from an established fatigue degree query table.

9. The method according to claim 1, characterized in that: Performing display adjustment on the electronic device according to the display adjustment parameter includes: The content display parameters and / or device parameters supported by the electronic device are adjusted according to the display adjustment parameters.

10. A display adjustment device, characterized in that: include: Display screen; Camera; Light sensor; one or more processors; Memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, which, when executed by the device, cause the device to perform the following steps: detecting a facial image of a user, and determining a first fatigue level of the user based on the facial image; determining a display adjustment parameter based on the fatigue impact parameter and the first fatigue degree; The display screen is adjusted according to the display adjustment parameters.

11. The device according to claim 10, characterized in that The fatigue impact parameter includes at least one of the following parameters: Environmental parameters of the environment in which the electronic device is located; Display device parameters of the electronic device; Display content parameters of the electronic device.

12. The device according to claim 10, characterized in that When the instruction is executed by the device, the device specifically performs the following steps: Extracting a human eye region sub-image from the face image; identifying the eye closure state of the user according to the eye region sub-image; A first fatigue level of the user is determined according to the eye closure state of the user.

13. The device according to claim 12, characterized in that When the instruction is executed by the device, the device specifically performs the following steps: Determine the blinking frequency and eye closure duration of the user in a detection period according to the eye closure state of the user in the detection period; The first fatigue level is determined according to the blinking frequency and the eye closing duration of the user in the detection period.

14. The device according to claim 13, characterized in that When the instruction is executed by the device, the device specifically performs the following steps: Determine a first fatigue coefficient of the user in the detection period according to the blinking frequency and the eye closing duration of the user in the detection period; The first fatigue degree is determined according to the first fatigue coefficient and fatigue coefficients of N detection cycles before the detection cycle, where N is a positive integer.

15. The device according to claim 14, characterized in that When the instruction is executed by the device, the device specifically performs the following steps: The first fatigue degree is determined according to the first fatigue coefficient and the fatigue coefficient obtained in an initial detection period.

16. The device according to any one of claims 10 to 15, characterized in that When the instruction is executed by the device, the device specifically performs the following steps: determining a second fatigue degree of the user under the detected fatigue influence parameter; A display adjustment parameter is determined based on the second fatigue level and the first fatigue level.

17. The device according to claim 16, characterized in that When the instruction is executed by the device, the device specifically performs the following steps: Based on the fatigue influencing parameter, the second fatigue degree is queried from an established fatigue degree query table.

18. The device according to claim 10, characterized in that When the instruction is executed by the device, the device specifically performs the following steps: The content display parameters and / or device parameters supported by the electronic device are adjusted according to the display adjustment parameters.

19. A computer storage medium, characterized in that: The method comprises computer instructions, and when the computer instructions are executed on an electronic device, the electronic device executes the display adjustment method according to any one of claims 1 to 9.

Images