Display method, device, equipment and storage medium for preventing eye fatigue
By installing a camera on the display screen, identifying the user's facial and limb characteristics, detecting eye fatigue in advance, and taking intervention measures, the problem that the existing technology cannot detect and prevent eye fatigue in advance, and achieving effective eye health for users Protect.
Patent Information
- Application Number
- CN202310786166.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-06-29
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2043-06-29
AI Technical Summary
The prior art cannot detect and prevent eye fatigue in advance, and only prompts after fatigue occurs, so it cannot effectively intervene in the user's fatigue state.
By installing a camera on the display, obtaining person images, extracting facial and limb features, identifying fatigue types, and conducting interventions based on recognition results, such as adaptively enlarging the line of sight target content and switching to eye protection mode.
It realizes the prevention of eye fatigue, protects the user's eye health, and avoids blurred vision and other eye diseases caused by long-term use of display devices.
Smart Images

Figure CN116844219B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of fatigue state detection, and in particular to a display method, device, equipment and storage medium for preventing eye fatigue. Background Art
[0002] Eye fatigue is a common eye disease. It can cause dry eyes, sore eyes, blurred vision and even decreased vision, which directly affects people's work and life. Eye fatigue can also cause and aggravate other eye diseases. In daily life, when people focus on the display screen of electronic products for a long time, their eyes will always focus on a fixed position. Maintaining this for a long time will cause the eyes to be in a state of tension for a long time. When the eyes are in a state of fatigue, their vision will be blurred, and they will move closer to the screen, entering a vicious cycle of eye use.
[0003] In the existing fatigue detection methods, fatigue prompts are given after a person has become tired. The implementation logic is to remind a person of the fact of current physical fatigue when the fact of fatigue has been confirmed. It is not possible to judge a person's fatigue state in advance and intervene in the person's fatigue state.
[0004] The above contents are only used to assist in understanding the technical solution of the present invention and do not constitute an admission that the above contents are prior art. Summary of the invention
[0005] The main purpose of the present invention is to provide a display method, device, equipment and storage medium for preventing eye fatigue, aiming to solve the technical problem that the prior art cannot detect and intervene in the fatigue state of a person.
[0006] To achieve the above object, the present invention provides a display method for preventing eye fatigue, the method is applied to a display screen, the display screen is equipped with a camera; the display method for preventing eye fatigue comprises the following steps:
[0007] Acquire a person image captured by the camera, and extract person features of the person image located in a detection area;
[0008] Performing feature recognition on the facial features or body features of the character, and determining the fatigue type of the user according to the facial features or body features;
[0009] Intervention measures are determined according to the fatigue type to prevent the user from overstraining their eyes.
[0010] Optionally, before the step of performing feature recognition on the facial features or limb features of the character and determining the fatigue type of the user according to the facial features or limb features, the step further includes:
[0011] Determining the identity of the user according to the facial features, recording the facial features of the user, and storing the facial features in a local database;
[0012] generating an identity tag based on the facial features of the user;
[0013] The facial features stored in the local database are processed to obtain normal facial features, and the identity tags are associated with the normal facial features and then stored in the local database.
[0014] Optionally, the identifying the character features and determining the fatigue type of the user according to the character features includes:
[0015] Identifying the facial features, and extracting normal facial data of the user after the facial features are successfully matched with facial data in a local database;
[0016] Extracting the eye opening degree, mouth opening degree and fundus bloodshot data from the facial data;
[0017] Compare the eye opening degree, mouth opening degree, and fundus bloodshot data with the normal facial data to obtain a difference value from the normal facial data;
[0018] When the difference value is greater than a preset difference value, determining the fatigue type of the user as eye fatigue;
[0019] Performing feature recognition on the limb features to obtain limb movement types;
[0020] classifying the limb movement, and when the limb movement is a first limb movement, determining the fatigue type as a first body fatigue;
[0021] When the limb movement is the second limb movement, the fatigue type is determined to be the second body fatigue, and the first body fatigue, the second body fatigue and the eye fatigue are matched.
[0022] Optionally, extracting the eye opening degree, mouth opening degree and fundus bloodshot data from the facial data includes:
[0023] Performing image grayscale and sharpening processing on the facial data to obtain a processed image;
[0024] Determine the areas where the eyes and the mouth are located on the processed image according to the eye features and the mouth features;
[0025] Determine edge contours of the eyes and the mouth according to the areas where the eyes and the mouth are located;
[0026] Determining the eye opening and mouth opening degrees according to the edge contour;
[0027] Determining an eye image corresponding to the facial data according to the area where the eye is located;
[0028] Performing color extraction on the eye image to obtain fundus bloodshot distribution;
[0029] The fundus bloodshot data is obtained according to the distribution of the fundus bloodshot and the proportion of the eye image.
[0030] Optionally, the identifying the character features and determining the fatigue type of the user according to the character features includes:
[0031] Determining the equivalent position of human eyes according to the characteristics of the person;
[0032] Determining the viewing distance between the eye and the display screen according to the equivalent position of the human eye;
[0033] When the viewing distance is less than a preset viewing distance, the fatigue type is updated to eye fatigue.
[0034] Optionally, determining intervention measures according to the fatigue type includes:
[0035] When the fatigue type is eye fatigue, obtaining the current sight focus position of the user;
[0036] Performing content recognition on the content displayed at the sight focus position to determine the sight target content;
[0037] Adaptively enlarging the sight target content, and placing the enlarged sight target content at the center of the display screen;
[0038] The display mode of the display screen is switched to an eye protection mode.
[0039] Optionally, the performing content recognition on the content displayed at the sight focus position to determine the sight target content includes:
[0040] Constructing a coordinate system based on the display area of the display screen;
[0041] Determining corresponding sight line focusing coordinates according to the sight line focusing position;
[0042] The display content of the sight focus coordinates is acquired, and edge detection is performed according to the display content to obtain the sight target content.
[0043] In addition, to achieve the above-mentioned purpose, the present invention further provides a display device for preventing eye fatigue, the display device for preventing eye fatigue comprising:
[0044] An image processing module, used to obtain the person image captured by the camera and extract the person features of the person image located in the detection area;
[0045] A feature recognition module, used to recognize the character features and determine the user's fatigue type according to the character features;
[0046] The fatigue intervention module is used to determine intervention measures according to the fatigue type to prevent the user from overusing his eyes.
[0047] In addition, to achieve the above-mentioned purpose, the present invention also proposes a display device for preventing eyestrain, wherein the display device for preventing eyestrain comprises: a memory, a processor, and a display program for preventing eyestrain stored in the memory and executable on the processor, wherein the display program for preventing eyestrain is configured to implement the steps of the display method for preventing eyestrain as described above.
[0048] In addition, to achieve the above-mentioned purpose, the present invention also proposes a storage medium, on which a display program for preventing eyestrain is stored. When the display program for preventing eyestrain is executed by a processor, the steps of the display method for preventing eyestrain are implemented as described above.
[0049] The present invention obtains the person image captured by the camera and extracts the person features of the person image located in the detection area; identifies the person features and determines the user's fatigue type according to the person features; determines intervention measures according to the fatigue type to prevent the user from overusing the eyes. The fatigue type is determined based on the user's person features and different intervention measures are taken according to different fatigue types. Compared with the prior art that gives reminders when fatigue occurs, the present invention can prevent eye fatigue and protect the user's eye health. BRIEF DESCRIPTION OF THE DRAWINGS
[0050] Figure 1 It is a structural schematic diagram of a display device for preventing eye fatigue in a hardware operating environment involved in an embodiment of the present invention;
[0051] Figure 2 It is a flow chart of a first embodiment of a display method for preventing eye fatigue according to the present invention;
[0052] Figure 3 A schematic diagram of a display screen coordinate system of an embodiment of a display method for preventing eye fatigue according to the present invention;
[0053] Figure 4 It is a flow chart of a second embodiment of a display method for preventing eye fatigue according to the present invention;
[0054] Figure 5 FIG. 1 is a structural block diagram of a first embodiment of a display device for preventing eye fatigue according to the present invention.
[0055] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0056] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.
[0057] Reference Figure 1 , Figure 1 The present invention is a schematic diagram of the structure of a display device for preventing eye fatigue in a hardware operating environment according to an embodiment of the present invention.
[0058] like Figure 1 As shown, the display device for preventing eye fatigue may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a wireless fidelity (Wireless-Fidelity, Wi-Fi) interface). The memory 1005 may be a high-speed random access memory (Random Access Memory, RAM) memory, or a stable non-volatile memory (Non-Volatile Memory, NVM), such as a disk memory. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.
[0059] Those skilled in the art will understand that Figure 1 The structure shown in the figure does not constitute a limitation on the display device for preventing eye fatigue, and may include more or less components than those shown in the figure, or combine certain components, or arrange the components differently.
[0060] like Figure 1 As shown, the memory 1005 as a storage medium may include an operating system, a network communication module, a user interface module, and a display program for preventing eye fatigue.
[0061] exist Figure 1In the display device for preventing eyestrain shown, the network interface 1004 is mainly used for data communication with a network server; the user interface 1003 is mainly used for data interaction with a user; the processor 1001 and the memory 1005 in the display device for preventing eyestrain of the present invention can be arranged in the display device for preventing eyestrain, and the display device for preventing eyestrain calls the display program for preventing eyestrain stored in the memory 1005 through the processor 1001, and executes the display method for preventing eyestrain provided in an embodiment of the present invention.
[0062] The embodiment of the present invention provides a display method for preventing eye fatigue, referring to Figure 2 , Figure 2 FIG. 4 is a flow chart of a first embodiment of a display method for preventing eye fatigue according to the present invention.
[0063] In this embodiment, the display method for preventing eye fatigue includes the following steps:
[0064] Step S10: obtaining a person image captured by the camera, and extracting person features of the person image within a detection area.
[0065] It should be noted that the executor of this embodiment is a display device for preventing eyestrain, wherein the display device for preventing eyestrain has functions such as data processing, data communication and program running. The display device for preventing eyestrain can be an integrated controller, a control computer and other devices, and of course can also be other devices with similar functions, which is not limited in this embodiment.
[0066] It can be understood that the display method for preventing eyestrain is applied to a display screen, wherein the display screen can be a display screen for a mobile phone, a computer, or the like used for display purposes, and the display screen is equipped with a camera either built-in or externally, which can be used to obtain images of the area in front of the display screen, and the display screen also has at least data processing and data transmission functions, which is used to analyze and process the image of the person obtained by the display screen camera.
[0067] It should be understood that the character image is a frontal image of the character, including the character's head, upper limbs and other parts; the detection area is the main position of the character in the shooting area of the display camera; the character features can be the character's eye movements, mouth movements and body movements, such as blinking, closing eyes, opening mouth, stretching, etc.
[0068] In a specific implementation, a camera installed on a display screen can periodically capture images of people in front of the screen. Since the position of the camera is fixed relative to the position of the camera, the position of the person using the display screen and the display screen are also relatively fixed. Therefore, within the area shot by the camera, a part of the area can be demarcated according to the usage habits of the display screen to detect the person features in the person image within the detection area, extract the person features in the picture, and temporarily store the extracted person features in a readable and writable storage medium.
[0069] Step S20: performing feature recognition on the facial features or body features of the character, and determining the fatigue type of the user according to the facial features or body features.
[0070] It should be noted that the fatigue type can be divided into eye fatigue and body fatigue, wherein the eye fatigue can also be divided into established eye fatigue and potential eye fatigue, wherein the established eye fatigue indicates that the user in front of the current display screen has developed symptoms related to eye fatigue, such as dry eyes, sore eyes, and congestion of the fundus, etc., and potential eye fatigue indicates that the current eye state is normal, but due to the existence of behaviors that are prone to cause eye fatigue, continuing the current behavior will cause eye fatigue, and the behaviors include shortening the distance from the display screen, or the body is already tired, which leads to eye fatigue, such as body movements like rubbing eyes with hands, supporting cheeks with hands, stretching hands backwards, etc. This embodiment does not limit the symptoms of eye fatigue and behaviors that can cause eye fatigue.
[0071] In a specific implementation, the display device for preventing eyestrain can identify the character features stored in a readable and writable storage medium based on the image captured by the camera and extracted by the display device for preventing eyestrain. The display device for preventing eyestrain stores a trained feature library for comparison with the character features to match the character features with the fatigue features, obtain the matching probability with each fatigue type, and compare the matching probabilities of each fatigue type, output the fatigue type with the highest probability, and obtain the fatigue type corresponding to the current character feature. When determining the fatigue type, the fatigue type can be determined separately for facial features and limb features. It can be known that physical fatigue can also cause eye fatigue. Therefore, when determining the fatigue type, it is necessary to combine the limb features and facial features of the current character to determine it together. According to the fatigue degree, the fatigue degree corresponding to the corresponding feature can be obtained, such as the fatigue degree increases according to the degree of physical fatigue, eye fatigue, and physical fatigue plus eye fatigue.
[0072] Furthermore, identifying the character features and determining the fatigue type of the user according to the character features includes:
[0073] Determining the equivalent position of human eyes according to the characteristics of the person;
[0074] Determining the viewing distance between the eye and the display screen according to the equivalent position of the human eye;
[0075] When the viewing distance is less than a preset viewing distance, the fatigue type is updated to eye fatigue.
[0076] It should be noted that when using the display screen, the user's sitting posture is not a standard sitting posture. Therefore, the human eyes need to be repositioned when positioning the human eyes. The human eye equivalent position is a point that can be used to represent the position of the human eyes after the repositioning. The viewing distance refers to the distance between the human eyes and the display screen. The preset viewing distance is the user's habitual viewing distance. If the user is a first-time user, the preset viewing distance is the viewing distance between the person and the display under normal circumstances.
[0077] In a specific implementation, the display device for preventing eyestrain can equate the human eye position according to the human eye position in the character image. The specific implementation operation is to determine the human eye position in the character image, judge the positional relationship of the human eyes, if the angle between the straight line where the human eyes are located and the horizontal reference line of the detection area is within a preset range, it can be considered that the current human eye position is in the correct direction, and detect the size of the human eyes. If the sizes of the two detected eyes are the same, the viewing distance is obtained according to the preset length correspondence. If the sizes of the two detected eyes are inconsistent, the average value is calculated according to the sizes of the two eyes, and the average value is used as the eye size and the viewing distance is obtained. If the user has certain physical defects, the viewing distance between the user's eyes and the display screen can be calculated through a special viewing distance calculation method. After obtaining the viewing distance, the identity of the user can be determined. If the user has used the device before, the user's habitual viewing distance can be obtained and compared with the habitual viewing distance. When the viewing distance is smaller than the habitual data, it means that the user's eyes are close to the display screen, and the user's fatigue type can be determined as potential eye fatigue. When the user is a first-time user, the viewing distance can be compared with the viewing distance between a person and the display under normal circumstances. When the display device for preventing eyestrain is detected, the usage habits of the first-time user can be summarized and stored based on the detection data.
[0078] In the specific fatigue type judgment process, first, the display device for preventing eyestrain can extract the eye data and mouth data from the character characteristics. If the blinking frequency of the eyes is higher than the fatigue frequency or the eye opening degree is lower than the fatigue eye opening degree, the character is continuously detected, and the eye blinking data and eye opening degree data are extracted. After the blinking frequency, eye opening degree or fundus congestion ratio exceeds the corresponding critical range value for a certain period of time, the current character fatigue state can be determined as established eye fatigue. If the display device for preventing eyestrain does not detect the corresponding character characteristics of established visual fatigue, but detects that the distance between the current screen user and the display screen becomes smaller, the current character fatigue state can be determined as potential eye fatigue.
[0079] If the user's character features of the display screen detect that the eye area is blocked by a hand, it can be identified based on the features before the currently detected character features. Since multiple images can restore the movement trajectory of the object, the hand movements can be restored in this way, and the hand behavior movements can be determined based on the hand movements. If the hand movements are rubbing the eyes or opening the eyelids, it means that the eyes are currently in a certain state of eye fatigue; if the current hand features are identified as movement features to relax the body, such as stretching, the current fatigue state is determined to be physical fatigue. Since there is a certain connection between physical fatigue and eye fatigue, when physical fatigue is detected, the display device for preventing eye fatigue should also perform corresponding operations.
[0080] Step S30: Determine intervention measures according to the fatigue type to prevent the user from overusing his eyes.
[0081] It should be noted that the intervention measures are corresponding measures to relieve the user's eye fatigue or corresponding measures to reduce eye fatigue after eye fatigue has occurred.
[0082] In a specific implementation, when the user is determined to be fatigued, a fatigue label is defined for the user, wherein the fatigue label may include no fatigue, established eye fatigue, potential eye fatigue, and physical fatigue. Since physical fatigue may lead to eye fatigue, physical fatigue needs to be intervened. When the user's fatigue type is no fatigue, there is no need to adjust the display mode of the display screen; when the user's fatigue type is established eye fatigue and potential eye fatigue, the symptoms of eye fatigue can be alleviated by changing the display mode of the display screen; if the user's fatigue type is physical fatigue, the display screen can display a rest reminder message to inform the user that the body is already in a state of fatigue and needs to rest. It can be understood that the display method can set the duration and the on state according to the user's subjective consciousness, and the corresponding time limit threshold can be set according to the user.
[0083] Furthermore, intervention measures are determined according to the fatigue type, including:
[0084] When the fatigue type is eye fatigue, obtaining the current sight focus position of the user;
[0085] Performing content recognition on the content displayed at the sight focus position to determine the sight target content;
[0086] Adaptively enlarging the sight target content, and placing the enlarged sight target content at the center of the display screen;
[0087] The display mode of the display screen is switched to an eye protection mode.
[0088] In a specific implementation, when the fatigue type is eye fatigue, that is, when the user is currently in a state of established eye fatigue and potential eye fatigue, the focus position of the user's line of sight can be obtained by using eye tracking technology to obtain the current eye gaze position, and map the position to the picture displayed on the current display screen to determine the focus position of the user's current line of sight. At this time, the content that the current user is processing can be determined based on the line of sight focus position, and the content that the user is paying attention to can be adaptively magnified, and the magnified display content can be moved to the center of the display screen for display. At the same time, the display mode of the display screen can be switched to eye protection mode to reduce the stimulation of light to the eyes.
[0089] Further, the content displayed at the sight focus position is determined to include:
[0090] Constructing a coordinate system based on the display area of the display screen;
[0091] Determining corresponding sight line focusing coordinates according to the sight line focusing position;
[0092] The display content of the sight focus coordinates is acquired, and edge detection is performed according to the display content to obtain the sight target content.
[0093] In the specific implementation, refer to Figure 3 , Figure 3 The coordinate system is constructed with the display area of the display screen, the resolution of the display screen is obtained, and the coordinate system is constructed with 1 pixel as the unit length, so that the coordinate distribution of the display area of the display screen can be determined, wherein the content displayed in the display area can be represented by coordinates or by coordinate ranges, for example, Figure 3In the figure, the black area represents a display content in the current display area. If the current sight is focused in the black area, it means that the coordinates of the current user's gaze can be determined. The sight focus position is combined with the coordinate system to obtain the sight focus coordinates. Based on the sight focus coordinates, the display content currently focused by the sight is obtained through edge detection technology, and the display content is extracted and enlarged. The enlargement ratio is determined according to the size of the display content and the display area. After the display content is enlarged, it is displayed in the center of the display area.
[0094] This embodiment obtains the person image captured by the camera and extracts the person features of the person image located in the detection area; identifies the person features and determines the user's fatigue type based on the person features; determines intervention measures based on the fatigue type to prevent the user from overusing the eyes. The fatigue type is determined based on the user's person features and different intervention measures are taken according to different fatigue types. Compared with the prior art that provides reminders when fatigue occurs, the present invention can prevent eye fatigue and protect the user's eye health.
[0095] refer to Figure 4 , Figure 4 FIG. 4 is a flow chart of a second embodiment of a display method for preventing eye fatigue according to the present invention.
[0096] Based on the first embodiment, the display method for preventing eye fatigue in this embodiment further includes, before step S10:
[0097] Step S201: Determine the identity of the user according to the facial features, record the facial features of the user, and store the facial features in a local database.
[0098] Step S202: Generate an identity tag based on the facial features of the user.
[0099] Step S203: Process the facial features stored in the local database to obtain normal facial features, associate the identity tag with the normal facial features, and store them in the local database.
[0100] It should be noted that the identity tag is used to distinguish the identities of different users, and the identity tag also corresponds to the user's facial data, usage habits and other data.
[0101] In a specific implementation, when the facial data of the user is obtained, the feature data in the facial data can be judged to determine the identity of the current user. After the identity of the user is confirmed, the identity tag of the user can be obtained. If the user is using it for the first time, a corresponding identity tag can be generated based on the facial data, and the obtained facial data can be processed. The facial data at this time will be used as the normal facial data of the user for subsequent use, wherein the normal facial data can increase according to the frequency of use of the user. With repeated use, the anti-eye fatigue display device can self-learn the facial data, continuously optimize the normal facial data, and store the facial data in a local database. The anti-eye fatigue display device has a networking function and can perform update operations with the cloud.
[0102] Furthermore, the identifying of the character features and determining the fatigue type of the user according to the character features includes:
[0103] Identifying the facial features, and extracting normal facial data of the user after the facial features are successfully matched with facial data in a local database;
[0104] Extracting the eye opening degree, mouth opening degree and fundus bloodshot data from the facial data;
[0105] Compare the eye opening degree, mouth opening degree, and fundus bloodshot data with the normal facial data to obtain a difference value from the normal facial data;
[0106] When the difference value is greater than a preset difference value, determining the fatigue type of the user as eye fatigue;
[0107] Performing feature recognition on the limb features to obtain limb movement types;
[0108] classifying the limb movement, and when the limb movement is a first limb movement, determining the fatigue type as a first body fatigue;
[0109] When the limb movement is the second limb movement, the fatigue type is determined to be the second body fatigue, and the first body fatigue, the second body fatigue and the eye fatigue are matched.
[0110] In a specific implementation, when performing facial recognition, the facial features need to be identified. If the facial features are data existing in the local database, the corresponding normal facial data is extracted. By identifying the facial features, the data of the degree of opening and closing of the eyes, the degree of opening and closing of the mouth, and the bloodshot eyes in the facial data are obtained, and the data of the degree of opening and closing of the eyes, the degree of opening and closing of the mouth, and the bloodshot eyes are compared with the normal facial data to obtain the difference between the two. Considering the physiological state of the user, a threshold value can be set for the difference value. The threshold value is set according to the actual situation. This embodiment does not limit this. If the difference value is greater than the preset difference value, the fatigue type is determined to be eye fatigue. When the camera detects that the person's limbs have large movements, fatigue can be judged based on the amplitude, range, and end point of the limb movement. For example, when the end point of the hand movement reaches the position corresponding to the eye and lasts for a period of time, it means that the person is rubbing his eyes, which corresponds to the first limb movement. This indicates that the person is currently in a state of eye fatigue, that is, the first body fatigue. If the hand supports the chin, it means that the body is feeling a little tired, which corresponds to the second body fatigue. In addition, if the hand opens its arms and pushes or draws a circle, it can be considered that the body needs to relax and the degree of fatigue is relatively weak. In the matching relationship between the first body fatigue, the second body fatigue and the eye fatigue, the degree of fatigue of the first body fatigue relative to the second body fatigue is that physical fatigue can cause eye fatigue. Therefore, when the characteristics corresponding to the first body fatigue and the second body fatigue appear, eye fatigue is likely to occur.
[0111] Furthermore, the extracting of the eye opening degree, mouth opening degree and fundus bloodshot data from the facial data includes:
[0112] Performing image grayscale and sharpening processing on the facial data to obtain a processed image;
[0113] Determine the areas where the eyes and the mouth are located on the processed image according to the eye features and the mouth features;
[0114] Determine edge contours of the eyes and the mouth according to the areas where the eyes and the mouth are located;
[0115] Determining the eye opening and mouth opening degrees according to the edge contour;
[0116] Determining an eye image corresponding to the facial data according to the area where the eye is located;
[0117] Performing color extraction on the eye image to obtain fundus bloodshot distribution;
[0118] The fundus bloodshot data is obtained according to the distribution of the fundus bloodshot and the proportion of the eye image.
[0119] In a specific implementation, the image of the facial data is grayscaled and sharpened so that the facial data image can reflect the contours of the facial features. The approximate areas where the eyes and mouth are located are determined based on the position distribution of the eyes and mouth. The contours of the eyes are depicted based on the characteristics of the eyes. The degree of opening and closing of the eyes is determined based on the distance between the upper edge and the lower edge of the eye contour. Since there are differences between the two eyes, the degree of opening and closing of the eyes is obtained based on the average value of the two eyes. Similarly, the degree of opening and closing of the mouth is obtained at the same time as the degree of opening and closing of the eyes. When determining the degree of opening and closing of the eyes and the mouth, the abnormal maintenance time also needs to be counted. For example, the mouth needs to remain open for a certain period of time to be considered as yawning. When the degree of opening and closing and the maintenance time are both within the fatigue determination interval, the fatigue state of the user is determined as fatigue state. When extracting fundus bloodshot, it is necessary to perform HSV transformation on the eye image, convert the RGB in the image into hue, saturation and hue, wherein the hue, saturation and hue are taken as 0≤H≤360, 0≤S≤1, 0≤V≤1. By performing color extraction on the eye image, the red bloodshot in the eye area is extracted, and the proportion of the fundus bloodshot in the fundus is calculated to obtain the fundus bloodshot data. The fur coat type is judged based on the eye opening degree, the mouth opening degree and the fundus bloodshot data.
[0120] This embodiment identifies the degree of eye opening, mouth opening, and bloodshot eyes of the user, and can also reflect the user's physical state based on the user's body movements, thereby determining the user's fatigue state from multiple dimensions. When the user is in a state of eye fatigue, the display screen can adaptively amplify the display content focused on the eyes, thereby alleviating the eye burden and achieving the purpose of preventing eye fatigue.
[0121] In addition, an embodiment of the present invention further proposes a storage medium, on which a display program for preventing eyestrain is stored. When the display program for preventing eyestrain is executed by a processor, the steps of the display method for preventing eyestrain are implemented as described above.
[0122] Reference Figure 5 , Figure 5 FIG. 1 is a structural block diagram of a first embodiment of a display device for preventing eye fatigue according to the present invention.
[0123] like Figure 5 As shown, the display device for preventing eye fatigue proposed in an embodiment of the present invention includes:
[0124] An image processing module 10 is used to obtain a person image captured by the camera and extract person features of the person image located in a detection area;
[0125] A feature recognition module 20, for performing feature recognition on the facial features or body features of the character, and determining the fatigue type of the user according to the facial features or body features;
[0126] The fatigue intervention module 30 is used to determine intervention measures according to the fatigue type to prevent the user from overusing his eyes.
[0127] This embodiment obtains the person image captured by the camera and extracts the person features of the person image located in the detection area; identifies the person features and determines the user's fatigue type based on the person features; determines intervention measures based on the fatigue type to prevent the user from overusing the eyes. The fatigue type is determined based on the user's person features and different intervention measures are taken according to different fatigue types. Compared with the prior art that provides reminders when fatigue occurs, the present invention can prevent eye fatigue and protect the user's eye health.
[0128] In one embodiment, the feature recognition module 20 is also used to determine the identity of the user based on the facial features, record the facial features of the user, and store the facial features in a local database; generate an identity tag based on the facial features of the user; process the facial features stored in the local database to obtain normal facial features, and associate the identity tag with the normal facial features before storing it in the local database.
[0129] In one embodiment, the feature recognition module 20 is also used to identify the facial features, and after the facial features are successfully matched with the facial data in the local database, extract the normal facial data of the user; extract the eye opening, mouth opening and fundus bloodshot data in the facial data; compare the eye opening, mouth opening and fundus bloodshot data with the normal facial data to obtain a difference value with the normal facial data; when the difference value is greater than a preset difference value, determine the user's fatigue type as eye fatigue.
[0130] In one embodiment, the feature recognition module 20 is further used to perform image grayscale and sharpening processing on the facial data to obtain a processed image; determine the areas where the eyes and the mouth are located on the processed image according to the eye features and the mouth features; determine the edge contours of the eyes and the mouth according to the areas where the eyes and the mouth are located; determine the eye opening and closing degrees and the mouth opening and closing degrees according to the edge contours; determine the eye image corresponding to the facial data according to the area where the eyes are located; perform color extraction on the eye image to obtain fundus bloodshot distribution; obtain fundus bloodshot data according to the ratio of the fundus bloodshot distribution to the eye image.
[0131] In one embodiment, the feature recognition module 20 is further used to determine the equivalent position of a human eye based on the character features; determine the viewing distance between the eye and the display screen based on the equivalent position of the human eye; and update the fatigue type to eye fatigue when the viewing distance is less than a preset viewing distance.
[0132] In one embodiment, the fatigue intervention module 30 is further used to obtain the user's current line of sight focus position when the fatigue type is eye fatigue; perform content recognition on the content displayed at the line of sight focus position to determine the line of sight target content; adaptively enlarge the line of sight target content and place the enlarged line of sight target content in the center of the display screen; and switch the display mode of the display screen to the eye protection mode.
[0133] In one embodiment, the fatigue intervention module 30 is further used to construct a coordinate system with the display area of the display screen; determine the corresponding line of sight focus coordinates according to the line of sight focus position; obtain the display content of the line of sight focus coordinates, and perform edge detection based on the display content to obtain the line of sight target content.
[0134] It should be understood that the above is only an example and does not constitute any limitation on the technical solution of the present invention. In specific applications, technicians in this field can make settings as needed, and the present invention does not limit this.
[0135] It should be noted that the workflow described above is merely illustrative and does not limit the scope of protection of the present invention. In practical applications, technicians in this field can select part or all of them according to actual needs to achieve the purpose of the present embodiment, and no limitation is made here.
[0136] In addition, it should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.
[0137] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.
[0138] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as a read-only memory (ROM) / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention.
[0139] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.
Claims
1. A display method for preventing eye fatigue, characterized in that: The display method for preventing eye fatigue is applied to a display screen, and the display screen is equipped with a camera; the display method for preventing eye fatigue includes: Acquire a person image captured by the camera, and extract person features of the person image located in a detection area; Performing feature recognition on the facial features or body features of the character, and determining the fatigue type of the user according to the facial features or body features; The identifying of the character features and determining the fatigue type of the user according to the character features includes: Determining the equivalent position of human eyes according to the characteristics of the person; Determining the viewing distance between the eye and the display screen according to the equivalent position of the human eye; When the viewing distance is less than a preset viewing distance, updating the fatigue type to eye fatigue; Wherein, the step of determining the viewing distance between the eye and the display screen according to the equivalent position of the human eye comprises: Determining the position of human eyes in the person image, and judging the positional relationship of the human eyes; If the angle between the straight line where the human eye is located and the horizontal reference line of the detection area is within a preset range, the current position of the human eye can be considered to be in the correct direction, and the size of the human eye is detected; If the sizes of the two detected eyes are the same, the viewing distance is obtained according to the preset length correspondence; If it is detected that the sizes of the two eyes are inconsistent, an average value is calculated according to the sizes of the two eyes, and the average value is used as the eye size and the viewing distance is obtained; If the user has certain physical defects, the viewing distance between the user's eyes and the display screen can be calculated through a special viewing distance calculation method; Wherein, after the step of determining the visual distance between the eye and the display screen according to the equivalent position of the human eye, the method further includes: After obtaining the sight distance, the identity of the user can be determined; If the user has used it before, the user's habitual viewing distance can be obtained, and the viewing distance can be compared with the habitual viewing distance. When the viewing distance is smaller than the habitual viewing distance, it means that the user's eyes are close to the display screen, and the user's fatigue type can be determined as potential eye fatigue; When the user is a first-time user, the viewing distance can be compared with the viewing distance between a person and a display under normal circumstances, and during the display device detection for preventing eye fatigue, the usage habits of the first-time user can be summarized and stored based on the detection data; Determining intervention measures according to the fatigue type to prevent the user from overusing eyes; The step of performing feature recognition on the facial features or body features of the character and determining the fatigue type of the user according to the facial features or body features includes: Identifying the facial features, and extracting normal facial data of the user after the facial features are successfully matched with facial data in a local database; Extracting the eye opening degree, mouth opening degree and fundus bloodshot data from the facial data; Compare the eye opening degree, mouth opening degree, and fundus bloodshot data with the normal facial data to obtain a difference value from the normal facial data; When the difference value is greater than a preset difference value, determining the fatigue type of the user as eye fatigue; Performing feature recognition on the limb features to obtain limb movement types; classifying the limb movement, and when the limb movement is a first limb movement, determining the fatigue type as a first body fatigue; When the limb movement is the second limb movement, the fatigue type is determined to be the second body fatigue, and a matching relationship among the first body fatigue, the second body fatigue and the eye fatigue is determined.
2. The method according to claim 1, characterized in that Before the facial features or body features of the character are recognized and the fatigue type of the user is determined according to the facial features or body features, the method further includes: Determining the identity of the user according to the facial features, recording the facial features of the user, and storing the facial features in a local database; generating an identity tag based on the facial features of the user; The facial features stored in the local database are processed to obtain normal facial features, and the identity tags are associated with the normal facial features and then stored in the local database.
3. The method according to claim 1, characterized in that The extracting of the eye opening degree, mouth opening degree and fundus bloodshot data from the facial data includes: Performing image grayscale and sharpening processing on the facial data to obtain a processed image; Determine the areas where the eyes and the mouth are located on the processed image according to the eye features and the mouth features; Determine edge contours of the eyes and the mouth according to the areas where the eyes and the mouth are located; Determining the eye opening and mouth opening degrees according to the edge contour; Determining an eye image corresponding to the facial data according to the area where the eye is located; Performing color extraction on the eye image to obtain fundus bloodshot distribution; The fundus bloodshot data is obtained according to the distribution of the fundus bloodshot and the proportion of the eye image.
4. The method according to claim 1, characterized in that The step of determining intervention measures according to the fatigue type comprises: When the fatigue type is eye fatigue, obtaining the current sight focus position of the user; Performing content recognition on the content displayed at the sight focus position to determine the sight target content; Adaptively enlarging the sight target content, and placing the enlarged sight target content at the center of the display screen; The display mode of the display screen is switched to an eye protection mode.
5. The method according to claim 4, characterized in that The performing content recognition on the content displayed at the sight focus position to determine the sight target content includes: Constructing a coordinate system based on the display area of the display screen; Determining corresponding sight line focusing coordinates according to the sight line focusing position; The display content of the sight focus coordinates is acquired, and edge detection is performed according to the display content to obtain the sight target content.
6. A display device for preventing eye fatigue, wherein the display device for preventing eye fatigue is applied to the display method for preventing eye fatigue as claimed in claim 1, characterized in that: The display device for preventing eye fatigue comprises: An image processing module, used to obtain the person image captured by the camera and extract the person features of the person image located in the detection area; A feature recognition module, used to perform feature recognition on the facial features or body features of the character, and determine the fatigue type of the user according to the facial features or body features; A fatigue intervention module, used to determine intervention measures according to the fatigue type to prevent the user from overusing his eyes; The fatigue intervention module is further used to determine the equivalent position of human eyes according to the character features; determine the visual distance between the eyes and the display screen according to the equivalent position of the human eyes; and update the fatigue type to eye fatigue when the visual distance is less than a preset visual distance; The fatigue intervention module is further used to determine the position of the human eyes in the character image and determine the positional relationship of the human eyes; If the angle between the straight line where the human eye is located and the horizontal reference line of the detection area is within a preset range, the current position of the human eye can be considered to be in the correct direction, and the size of the human eye is detected; If the sizes of the two detected eyes are the same, the viewing distance is obtained according to the preset length correspondence; If it is detected that the sizes of the two eyes are inconsistent, an average value is calculated according to the sizes of the two eyes, and the average value is used as the eye size and the viewing distance is obtained; If the user has certain physical defects, the viewing distance between the user's eyes and the display screen can be calculated through a special viewing distance calculation method; The fatigue intervention module is further used to determine the identity of the user after obtaining the visual distance; If the user has used it before, the user's habitual viewing distance can be obtained, and the viewing distance can be compared with the habitual viewing distance. When the viewing distance is smaller than the habitual viewing distance, it means that the user's eyes are close to the display screen, and the user's fatigue type can be determined as potential eye fatigue; When the user is a first-time user, the viewing distance can be compared with the viewing distance between a person and a display under normal circumstances, and during the display device detection for preventing eye fatigue, the usage habits of the first-time user can be summarized and stored based on the detection data; The feature recognition module is further used to recognize the facial features and extract the normal facial data of the user after the facial features are successfully matched with the facial data in the local database; Extracting the eye opening degree, mouth opening degree and fundus bloodshot data from the facial data; Compare the eye opening degree, mouth opening degree, and fundus bloodshot data with the normal facial data to obtain a difference value from the normal facial data; When the difference value is greater than a preset difference value, determining the fatigue type of the user as eye fatigue; Performing feature recognition on the limb features to obtain limb movement types; classifying the limb movement, and when the limb movement is a first limb movement, determining the fatigue type as a first body fatigue; When the limb movement is the second limb movement, the fatigue type is determined to be the second body fatigue, and a matching relationship among the first body fatigue, the second body fatigue and the eye fatigue is determined.
7. A display device for preventing eye fatigue, characterized in that: The device includes: a memory, a processor, and a display program for preventing eyestrain stored in the memory and executable on the processor, wherein the display program for preventing eyestrain is configured to implement the steps of the display method for preventing eyestrain as described in any one of claims 1 to 5.
8. A storage medium, characterized in that: The storage medium stores a display program for preventing eyestrain. When the display program for preventing eyestrain is executed by a processor, the steps of the display method for preventing eyestrain are implemented as described in any one of claims 1 to 5.
