Display equipment intelligent adjusting method, medium and device

Abstract

The invention discloses a display equipment intelligent adjusting method, a medium and a device. The method comprises the following steps: acquiring an eye image of a user; identifying the eye image to extract eye action characteristics of the eye image, and determining a current eye state of the user according to the eye action characteristics; and adjusting the brightness of the display equipment according to the eye state. The display device can be intelligently adjusted based on the eye movement of the user, and the energy consumption of the display device is effectively saved; and meanwhile, the comfort of the user in the process of using the display equipment is improved.

Description

Technical Field

[0001] The present application relates to the field of display device control technology, and in particular to a display device intelligent adjustment method, medium and device. Background Art

[0002] In daily life, people blink an average of 15 to 20 times per minute, which is a natural physiological phenomenon that helps lubricate and protect the eyes. Blinking is usually short, with each eye closure lasting about 0.1 to 0.4 seconds. In addition, people close their eyes for longer periods of time when thinking, resting, or being distracted for a moment.

[0003] In the related art, when controlling the display device, the user's blinking action is not taken into account. In other words, the existing display device is in a constant light state when the user blinks. This will cause a waste of energy. At the same time, in this display mode, when the user opens his eyes again, the user's eyes may be suddenly stimulated by light. Summary of the invention

[0004] The present invention aims to solve at least one of the technical problems in the related art to a certain extent. To this end, one purpose of the present invention is to propose a display device intelligent adjustment method, which can intelligently adjust the display device based on the user's eye movements, effectively save the energy consumption of the display device; at the same time, improve the user's comfort when using the display device.

[0005] In a first aspect, an embodiment of the present invention proposes a method for intelligently adjusting a display device, comprising the following steps: acquiring an eye image of a user; identifying the eye image to extract eye movement features of the eye image, and determining the user's current eye state based on the eye movement features; and adjusting the brightness of the display device based on the eye state.

[0006] According to the intelligent adjustment method of the display device of the embodiment of the present invention, first, the user's eye image is obtained; then, the eye image is recognized to extract the eye movement features of the eye image, and the user's current eye state is determined according to the eye movement features; then, the brightness of the display device is adjusted according to the eye state. In this way, the display device is intelligently adjusted based on the user's eye movement, effectively saving the energy consumption of the display device; at the same time, the user's comfort in using the display device is improved.

[0007] Optionally, the eye state includes an eyes closed process state and an eyes open process state, wherein the brightness of the display device is adjusted according to the eye state, including: if the eye state is an eyes closed process state, gradually reducing the brightness of the display device; if the eye state is an eyes open process state, gradually increasing the brightness of the display device.

[0008] Optionally, the eye states include a state of beginning to close eyes, a half-closed state, a fully closed state, a state of beginning to open eyes, a half-opened state and a fully opened state.

[0009] Optionally, the brightness of the display device is adjusted according to the eye state, including: if the eye state is the beginning of eye closing, reducing the brightness of the display device at a first preset rate; if the eye state is a semi-closed state, reducing the brightness of the display device at a second preset rate; if the eye state is a fully closed state, adjusting the brightness of the display device to a first preset value.

[0010] Optionally, the brightness of the display device is adjusted according to the eye state, including: if the eye state is in the beginning to open state, increasing the brightness of the display device at a third preset rate; if the eye state is in the half-open state, increasing the brightness of the display device at a fourth preset rate; if the eye state is in the fully open state, adjusting the brightness of the display device to the second preset value.

[0011] In a second aspect, an embodiment of the present invention provides a computer-readable storage medium on which a display device intelligent adjustment program is stored. When the display device intelligent adjustment program is executed by a processor, the display device intelligent adjustment method described above is implemented.

[0012] In a third aspect, an embodiment of the present invention proposes a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the intelligent adjustment method of the display device as described above is implemented.

[0013] In a fourth aspect, an embodiment of the present invention proposes an intelligent adjustment device for a display device, comprising: an acquisition module, which is used to acquire an eye image of a user; a recognition module, which is used to recognize the eye image to extract eye movement features of the eye image, and determine the user's current eye state based on the eye movement features; and an adjustment module, which is used to adjust the brightness of the display device based on the eye state.

[0014] According to the intelligent adjustment device of the display device of the embodiment of the present invention, the acquisition module is used to acquire the user's eye image; the recognition module is used to recognize the eye image to extract the eye movement characteristics of the eye image, and determine the user's current eye state according to the eye movement characteristics; the adjustment module is used to adjust the brightness of the display device according to the eye state. In this way, the display device can be intelligently adjusted based on the user's eye movement, effectively saving the energy consumption of the display device; at the same time, the comfort of the user in using the display device is improved.

[0015] Optionally, the eye state includes an eyes closed process state and an eyes open process state, wherein the brightness of the display device is adjusted according to the eye state, including: if the eye state is an eyes closed process state, gradually reducing the brightness of the display device; if the eye state is an eyes open process state, gradually increasing the brightness of the display device.

[0016] Optionally, the eye states include a state of beginning to close eyes, a half-closed state, a fully closed state, a state of beginning to open eyes, a half-opened state and a fully opened state.

[0017] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 is a schematic flow chart of a method for intelligently adjusting a display device according to an embodiment of the present invention;

[0019] Figure 2 is a schematic diagram of a brightness adjustment process corresponding to a user's eye movement cycle according to an embodiment of the present invention;

[0020] Figure 3 is a schematic diagram of a brightness adjustment process corresponding to a user's eye movement cycle according to another embodiment of the present invention;

[0021] Figure 4 4 is a block diagram of an intelligent adjustment device for a display device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0022] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present invention, and should not be construed as limiting the present invention.

[0023] The following describes a display device intelligent adjustment method according to an embodiment of the present invention with reference to the accompanying drawings.

[0024] See also Figure 1 , Figure 1 FIG. 1 is a flow chart of a method for intelligently adjusting a display device according to an embodiment of the present invention; Figure 1 As shown, the display device intelligent adjustment method includes the following steps:

[0025] S101, obtaining an eye image of a user.

[0026] That is to say, the user's eye image is obtained in real time.

[0027] As an example, after the user turns on the computer, a specially designed eye tracking sensor module is used to capture the user's eye images in real time.

[0028] Among them, the eye tracking sensor module can be from an image capture device, an infrared sensor or other suitable eye tracking sensors.

[0029] S102, identifying the eye image to extract eye movement features of the eye image, and determining the current eye state of the user according to the eye movement features.

[0030] S103, adjusting the brightness of the display device according to the eye state.

[0031] In some embodiments, the eye state includes an eye closing process state and an eye opening process state, wherein the brightness of the display device is adjusted according to the eye state, including: if the eye state is an eye closing process state, gradually reducing the brightness of the display device; if the eye state is an eye opening process state, gradually increasing the brightness of the display device.

[0032] That is to say, the eye movement features are classified; then, the association between the eye movement features and the eye state is established based on the classification results. Then, after the eye image is acquired, the eye movement features corresponding to the eye image are extracted, and the corresponding eye state is determined based on the eye movement features; at this time, if the eye state is in the process of closing the eyes, the brightness of the display device is gradually reduced; if the eye state is in the process of opening the eyes, the brightness of the display device is gradually increased.

[0033] As an example, Figure 2 As shown, in Figure 2 In the process, the user's eye image is acquired at time t1, and after the eye image is identified, the corresponding eye movement feature is obtained, and according to the eye movement feature, it is determined that the user's current eye state is in the process of closing eyes; at this time, the brightness of the display device is gradually reduced until time t2, at which time the brightness of the display device reaches the preset minimum value, and the adjustment is stopped. Then, the user's eye image is acquired again at time t3, and after the eye image is identified, the corresponding eye movement feature is obtained, and according to the eye movement feature, it is determined that the user's current eye state is in the process of opening eyes; at this time, the brightness of the display device is gradually increased until time t4, at which time the brightness of the display device reaches the brightness value at time t1. This is the intelligent adjustment process of the brightness of the display device in a user's eye movement cycle.

[0034] In some embodiments, the eye state includes a beginning eye closing state, a half-closed state, a fully closed state, a beginning eye opening state, a half-open state, and a fully open state.

[0035] In some embodiments, the brightness of the display device is adjusted according to the eye state, including: if the eye state is the beginning of closing the eyes, reducing the brightness of the display device at a first preset rate; if the eye state is a semi-closed state, reducing the brightness of the display device at a second preset rate; if the eye state is a fully closed state, adjusting the brightness of the display device to a first preset value.

[0036] In some embodiments, the brightness of the display device is adjusted according to the eye state, including: if the eye state is beginning to open, increasing the brightness of the display device at a third preset rate; if the eye state is half-open, increasing the brightness of the display device at a fourth preset rate; if the eye state is fully open, adjusting the brightness of the display device to a second preset value.

[0037] That is to say, the eye state is decomposed into the beginning of eye closure state, half-closed state, fully closed state, beginning of eye opening state, half-open state and fully open state. When the eye state is the beginning of eye closure state, at this time, the user has just started to close his eyes, and the degree of eye closure is low. If the brightness adjustment speed of the display device is too fast, it will bring an abrupt user experience to the user. Therefore, the first preset rate (slower rate) is used to reduce the brightness of the display device at this stage. When the eye state is the half-closed state, it indicates that the user is already in a deeper eye closure stage. Therefore, the second preset rate (faster rate) is used to reduce the brightness of the display device at this stage. In this way, the brightness of the display device is adjusted according to the second preset rate, so that when the eye state is the fully closed state, the brightness of the display device reaches the first preset value (i.e., the preset minimum display brightness); then, when the eye state is the beginning of eye opening state, at this time, the user's eyes are only slightly open, and the brightness is adjusted at a faster rate, and the user will not feel abrupt. Therefore, the brightness of the display device is increased at the third preset rate in the next stage. Then, when the eye state is half-open, it means that the user's eyes have been opened to a certain extent. If the brightness adjustment rate is too high, it will make the user feel abrupt and affect the user's experience. Therefore, the fourth preset rate is used to increase the brightness of the display device. In this way, the brightness of the display device is adjusted according to the fourth preset rate so that when the eye state is fully open, the brightness of the display device reaches the second preset value (the second preset value can be a preset display brightness maximum value, or it can be a brightness value corresponding to the start of the closed eye state in the cycle).

[0038] As an example, Figure 3As shown, at time t1, the eye state corresponding to the acquired eye image is the beginning of the eye closing state; the display device reduces the brightness of the display device at a first preset rate to prevent the user from feeling abrupt and improve the user experience; then, between time t1 and time t2, the eye state corresponding to the acquired eye image is the beginning of the eye closing state, without change. At time t2, the eye state corresponding to the acquired eye image is a semi-closed state, indicating that the user's eyes are deeply closed. At this time, the display device brightness is reduced at a second preset rate; until the eye state corresponding to the acquired eye image is a completely closed state at time t3, at which time, the display device brightness is set to the first preset value. Then, between time t3 and time t4, the eye state corresponding to the acquired eye image is a completely closed state, and no further adjustment is performed. Then, at time t4, the eye state corresponding to the acquired eye image is the beginning of the eye opening state. At this time, the user's eyes have just opened slightly, and a faster adjustment of the display device brightness will not be noticed by the user, so the third preset rate is used to increase the display and device brightness. If the eye state corresponding to the eye image obtained at time t5 is a half-open state, the brightness of the display device is increased at a fourth preset rate; if the eye state corresponding to the eye image obtained at time t6 is a fully open state, the brightness of the display device is set to a second preset value.

[0039] It should be noted that the preset rate (including the first preset rate, the second preset rate, the third preset rate and the fourth preset rate) refers to a predetermined speed or time function followed by the system when reducing the brightness of the display device. This rate can be linear, nonlinear, or determined according to a specific algorithm. The preset rate can be fixed or variable. For example, the system can be designed to reduce the brightness at a slower rate in the early stage of eye closure to prevent the user from suddenly feeling the change; and after confirming that the user has half-closed his eyes or completely closed his eyes, the rate of reducing the brightness can be accelerated.

[0040] In addition, the display device is adjusted, including but not limited to adjusting the backlight PWM duty cycle and the like.

[0041] In summary, according to the intelligent adjustment method of the display device of the embodiment of the present invention, first, the user's eye image is obtained; then, the eye image is recognized to extract the eye movement features of the eye image, and the user's current eye state is determined according to the eye movement features; then, the brightness of the display device is adjusted according to the eye state. In this way, the display device can be intelligently adjusted based on the user's eye movement, effectively saving the energy consumption of the display device; at the same time, the user's comfort in using the display device is improved.

[0042] In a second aspect, an embodiment of the present invention provides a computer-readable storage medium on which a display device intelligent adjustment program is stored. When the display device intelligent adjustment program is executed by a processor, the display device intelligent adjustment method described above is implemented.

[0043] In a third aspect, an embodiment of the present invention proposes a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the intelligent adjustment method of the display device as described above is implemented.

[0044] In a fourth aspect, an embodiment of the present invention provides an intelligent adjustment device for a display device, such as Figure 4 As shown, the intelligent adjustment device for display equipment includes: an acquisition module 10, an identification module 20 and an adjustment module 30.

[0045] The acquisition module 10 is used to acquire the user's eye image;

[0046] The recognition module 20 is used to recognize the eye image to extract the eye movement features of the eye image, and determine the current eye state of the user according to the eye movement features;

[0047] The adjustment module 30 is used to adjust the brightness of the display device according to the eye state.

[0048] In some embodiments, the eye state includes an eye closing process state and an eye opening process state, wherein the brightness of the display device is adjusted according to the eye state, including: if the eye state is an eye closing process state, gradually reducing the brightness of the display device; if the eye state is an eye opening process state, gradually increasing the brightness of the display device.

[0049] In some embodiments, the eye state includes a beginning eye closing state, a half-closed state, a fully closed state, a beginning eye opening state, a half-open state, and a fully open state.

[0050] It should be noted that the above description of the intelligent adjustment method for a display device is also applicable to the intelligent adjustment device for a display device, and will not be elaborated here.

[0051] In summary, according to the intelligent adjustment device of the display device of the embodiment of the present invention, an acquisition module is set to acquire the user's eye image; a recognition module is used to recognize the eye image to extract the eye movement features of the eye image, and determine the user's current eye state according to the eye movement features; and an adjustment module is used to adjust the brightness of the display device according to the eye state. In this way, the display device can be intelligently adjusted based on the user's eye movement, effectively saving the energy consumption of the display device; at the same time, the user's comfort in using the display device is improved.

[0052] It should be noted that the logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be specifically implemented in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purposes of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection portion with one or more wirings (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.

[0053] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, a plurality of steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0054] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0055] In the description of the present invention, it is to be understood that the terms “center”, “longitudinal”, “lateral”, “length”, “width”, “thickness”, “up”, “down”, “front”, “back”, “left”, “right”, “vertical”, “horizontal”, “top”, “bottom”, “inside”, “outside”, “clockwise”, “counterclockwise”, “axial”, “radial”, “circumferential”, etc., indicating orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as limiting the present invention.

[0056] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of the present invention, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0057] In the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements, unless otherwise clearly defined. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0058] In the present invention, unless otherwise clearly specified and limited, a first feature being "above" or "below" a second feature may mean that the first and second features are in direct contact, or the first and second features are in indirect contact through an intermediate medium. Moreover, a first feature being "above", "above" or "above" a second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is higher in level than the second feature. A first feature being "below", "below" or "below" a second feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature is lower in level than the second feature.

[0059] Although the embodiments of the present invention have been shown and described above, it is to be understood that the above embodiments are exemplary and are not to be construed as limitations of the present invention. A person skilled in the art may change, modify, replace and vary the above embodiments within the scope of the present invention.

Claims

1. A method for intelligently adjusting a display device, characterized in that: The following steps are involved: Obtaining an eye image of the user; Recognizing the eye image to extract eye movement features of the eye image, and determining the current eye state of the user according to the eye movement features; The brightness of the display device is adjusted according to the eye state.

2. The display device intelligent adjustment method according to claim 1, characterized in that: The eye state includes an eye closing process state and an eye opening process state, wherein adjusting the brightness of the display device according to the eye state includes: If the eye state is in the eye closing process state, gradually reducing the brightness of the display device; If the eye state is in the eye-opening process state, the brightness of the display device is gradually increased.

3. The display device intelligent adjustment method according to claim 1, characterized in that: The eye states include a beginning eye closing state, a half-closed state, a fully closed state, a beginning eye opening state, a half-opened state, and a fully opened state.

4. The display device intelligent adjustment method according to claim 3, characterized in that: Adjusting the brightness of a display device according to the eye state includes: If the eye state is the eye-closing state, reducing the brightness of the display device at a first preset rate; If the eye state is a semi-closed state, reducing the brightness of the display device at a second preset rate; If the eye state is a completely closed state, the brightness of the display device is adjusted to a first preset value.

5. The display device intelligent adjustment method according to claim 3, characterized in that: Adjusting the brightness of a display device according to the eye state includes: If the eye state is the beginning eye opening state, increasing the brightness of the display device at a third preset rate; If the eye state is a half-open state, increasing the brightness of the display device at a fourth preset rate; If the eye state is a fully open state, the brightness of the display device is adjusted to a second preset value.

6. A computer-readable storage medium, characterized in that: A display device intelligent adjustment program is stored thereon, and when the display device intelligent adjustment program is executed by a processor, the display device intelligent adjustment method according to any one of claims 1 to 5 is implemented.

7. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the display device intelligent adjustment method according to any one of claims 1 to 5 is implemented.

8. An intelligent adjustment device for a display device, characterized in that: include: An acquisition module, the acquisition module is used to acquire an eye image of a user; a recognition module, the recognition module being used to recognize the eye image to extract eye movement features of the eye image, and determine the current eye state of the user according to the eye movement features; An adjustment module is used to adjust the brightness of the display device according to the eye state.

9. The intelligent adjustment device for display equipment according to claim 8, characterized in that: The eye state includes an eye closing process state and an eye opening process state, wherein adjusting the brightness of the display device according to the eye state includes: If the eye state is in the eye closing process state, gradually reducing the brightness of the display device; If the eye state is in the eye-opening process state, the brightness of the display device is gradually increased.

10. The intelligent adjustment device for display equipment according to claim 8, characterized in that: The eye states include a beginning eye closing state, a half-closed state, a fully closed state, a beginning eye opening state, a half-opened state, and a fully opened state.

Images