Information display method and related device

Abstract

The embodiment of the invention relates to the field of data processing, and provides an information display method and related device.The method comprises the steps that watching duration information of a target user watching information displayed by a display module is obtained, user images of the target user during watching are obtained, and a first image set is obtained; determining a first eye fatigue degree of the target user according to the watching duration information; determining a second eye fatigue degree of the target user according to the first image set; fusing the first eye fatigue degree and the second eye fatigue degree to obtain a target eye fatigue degree; determining display information corresponding to the target user according to the target eye fatigue degree; the display information is displayed through the display module, so that the information for prompting eye fatigue can be displayed according to the determined eye fatigue degree of the target user, and the accuracy of the user during eye adjustment is improved.

Description

Technical Field

[0001] This application relates to the technical field of data processing, and particularly relates to an information display method and related device. Background Art

[0002] With the continuous development of technology, in the existing learning and working scenarios, electronic drawing walls are often used for display in many cases. For example, in online learning and online working, electronic drawing walls can be used to display content and so on.

[0003] When users are learning, usually due to the high degree of concentration, the fatigue degree of their eyes will increase sharply. Since users are concentrating on learning, their perception of learning time will decrease, and they often unconsciously study for a long time, causing great fatigue to their eyes. In the existing solutions, usually users set alarms according to the learning duration for reminders. However, this reminder method often results in a long learning duration, leading to extremely fatigued eyes, and the accuracy of eye adjustment is relatively low. Summary of the Invention

[0004] Embodiments of this application provide an information display method and related device, which can display information for eye fatigue reminder according to the determined eye fatigue degree of the target user, improving the accuracy of users' eye adjustment.

[0005] In a first aspect of the embodiments of this application, an information display method is provided. The method is applied to an electronic wall painting display device, which includes a display module, a collection module, and a processing module. The method includes:

[0006] Obtain the viewing duration information of the target user watching the information displayed by the display module, and obtain the user image of the target user during viewing to obtain a first image set;

[0007] Determine the first eye fatigue degree of the target user according to the viewing duration information;

[0008] Determine the second eye fatigue degree of the target user according to the first image set;

[0009] Fuse the first eye fatigue degree and the second eye fatigue degree to obtain the target eye fatigue degree;

[0010] Determine the display information corresponding to the target user according to the target eye fatigue degree;

[0011] Perform display processing on the display information through the display module.

[0012] In a possible implementation, determining the second eye fatigue degree of the target user according to the first image set includes:

[0013] Extract the facial image of the target user from the first target image to obtain the first facial image, where the first target image is any one of the first image set;

[0014] Determine the eye information and facial expression information of the target user from the first facial image;

[0015] Determine the first reference eye fatigue degree according to the eye information;

[0016] Determine the fatigue degree correction value according to the facial expression information;

[0017] Adjust the first reference eye fatigue degree by using the fatigue degree correction value to obtain the second reference eye fatigue degree;

[0018] Repeat the above method of extracting the facial image of the target user from the first target image to obtain the first facial image, until adjusting the first reference eye fatigue degree by using the fatigue degree correction value to obtain the second reference eye fatigue degree, until the second reference eye fatigue degrees corresponding to each first image in the first image set are obtained, and a second reference eye fatigue degree set is obtained;

[0019] Perform a fusion process on the second reference eye fatigue degrees in the second reference eye fatigue degree set to obtain the second eye fatigue degree.

[0020] In a possible implementation, determining the first reference eye fatigue degree according to the eye information includes:

[0021] Determine the first sub-eye fatigue degree according to the eye opening degree in the eye information;

[0022] Determine the second sub-eye fatigue degree according to the wrinkle contour of the lower eyelid in the eye information;

[0023] Determine the third sub-eye fatigue degree according to the wrinkle information in the bulbar conjunctiva in the eye information;

[0024] Perform a fusion process on the first sub-eye fatigue degree, the second sub-eye fatigue degree, and the third sub-eye fatigue degree to obtain the first reference eye fatigue degree.

[0025] In a possible implementation, determining the second eye fatigue degree of the target user according to the first image set includes:

[0026] Extract the facial images of the target user in each first image in the first image set to obtain a second facial image set;

[0027] Extract the eye information and facial expression information of the target user from the second facial images in the second facial image set, to obtain an eye information set and a facial expression information set;

[0028] Construct an eye feature change curve according to the eye information set;

[0029] Determine a first sub-eye fatigue degree according to the eye feature change curve;

[0030] Construct facial expression change trend information according to the facial expression information set;

[0031] Determine a second sub-eye fatigue degree according to the facial expression change trend information;

[0032] Perform a weighted operation on the first sub-eye fatigue degree and the second sub-eye fatigue degree to obtain the second eye fatigue degree.

[0033] In a possible implementation manner, the determining the display information corresponding to the target user according to the target eye fatigue degree includes:

[0034] Determine the eye fatigue level of the target user according to the target eye fatigue degree;

[0035] Determine the display information corresponding to the target user according to the eye fatigue level.

[0036] A second aspect of the embodiments of the present application provides an information display device, which is applied to an electronic wall painting display device. The electronic wall painting display device includes a display module, a collection module, and a processing module. The device includes:

[0037] An acquisition unit, configured to acquire the viewing duration information of the target user for viewing the information displayed by the display module, and acquire the user image of the target user during viewing, to obtain a first image set;

[0038] A first determination unit, configured to determine a first eye fatigue degree of the target user according to the viewing duration information;

[0039] A second determination unit, configured to determine a second eye fatigue degree of the target user according to the first image set;

[0040] A fusion unit, configured to fuse the first eye fatigue degree and the second eye fatigue degree to obtain a target eye fatigue degree;

[0041] A third determination unit, configured to determine the display information corresponding to the target user according to the target eye fatigue degree;

[0042] A display unit for performing display processing on the display information through the display module.

[0043] In a possible implementation, the second determination unit is configured to:

[0044] Extract the facial image of the target user from the first target image to obtain a first facial image, where the first target image is any one of the first image set;

[0045] Determine the eye information and facial expression information of the target user from the first facial image;

[0046] Determine a first reference eye fatigue degree according to the eye information;

[0047] Determine a fatigue degree correction value according to the facial expression information;

[0048] Adjust the first reference eye fatigue degree by using the fatigue degree correction value to obtain a second reference eye fatigue degree;

[0049] Repeat the method of extracting the facial image of the target user from the first target image to obtain a first facial image, to adjusting the first reference eye fatigue degree by using the fatigue degree correction value to obtain a second reference eye fatigue degree until the second reference eye fatigue degree corresponding to each first image in the first image set is obtained, and obtain a second reference eye fatigue degree set;

[0050] Perform fusion processing on the second reference eye fatigue degrees in the second reference eye fatigue degree set to obtain the second eye fatigue degree.

[0051] In a possible implementation, in terms of determining the first reference eye fatigue degree according to the eye information, the second determination unit is specifically configured to:

[0052] Determine a first sub-eye fatigue degree according to the eye opening degree in the eye information;

[0053] Determine a second sub-eye fatigue degree according to the wrinkle contour of the lower eyelid in the eye information;

[0054] Determine a third sub-eye fatigue degree according to the wrinkle information in the bulbar conjunctiva in the eye information;

[0055] Perform fusion processing on the first sub-eye fatigue degree, the second sub-eye fatigue degree, and the third sub-eye fatigue degree to obtain a first reference eye fatigue degree.

[0056] In a possible implementation, the second determination unit is configured to:

[0057] Extract the facial images of the target user in each first image in the first image set to obtain a second facial image set;

[0058] Extract the eye information and facial expression information of the target user from the second facial images in the second facial image set to obtain an eye information set and a facial expression information set;

[0059] Construct an eye feature change curve according to the eye information set;

[0060] Determine the first sub-eye fatigue degree according to the eye feature change curve;

[0061] Construct facial expression change trend information according to the facial expression information set;

[0062] Determine the second sub-eye fatigue degree according to the facial expression change trend information;

[0063] Perform a weighted operation on the first sub-eye fatigue degree and the second sub-eye fatigue degree to obtain the second eye fatigue degree.

[0064] In a possible implementation, the third determination unit is configured to:

[0065] Determine the eye fatigue level of the target user according to the target eye fatigue degree;

[0066] Determine the display information corresponding to the target user according to the eye fatigue level.

[0067] A third aspect of the embodiments of the present application provides a terminal, including a processor, an input device, an output device, and a memory. The processor, the input device, the output device, and the memory are interconnected. Among them, the memory is used to store a computer program, and the computer program includes program instructions. The processor is configured to call the program instructions to execute the step instructions in the first aspect of the embodiments of the present application.

[0068] A fourth aspect of the embodiments of the present application provides a computer-readable storage medium. The computer-readable storage medium stores a computer program for electronic data exchange. The computer program enables a computer to execute some or all of the steps described in the first aspect of the embodiments of the present application.

[0069] A fifth aspect of the embodiments of the present application provides a computer program product. The computer program product includes a non-transitory computer-readable storage medium storing a computer program. The computer program is operable to enable a computer to execute some or all of the steps described in the first aspect of the embodiments of the present application. The computer program product can be a software installation package.

[0070] The implementation of the embodiments of the present application has the following beneficial effects:

[0071] By obtaining the viewing duration information of the target user watching the information displayed by the display module, and obtaining the user image of the target user during viewing, a first image set is obtained; the first eye fatigue degree of the target user is determined according to the viewing duration information; the second eye fatigue degree of the target user is determined according to the first image set; the first eye fatigue degree and the second eye fatigue degree are fused to obtain the target eye fatigue degree; the display information corresponding to the target user is determined according to the target eye fatigue degree; the display information is displayed and processed by the display module. Therefore, the display information can be determined by combining the viewing duration information of the target user and the target eye fatigue degree, so as to adjust the eye fatigue of the target user and improve the accuracy of eye fatigue adjustment. BRIEF DESCRIPTION OF THE DRAWINGS

[0072] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0073] Figure 1 FIG. is a schematic diagram of an electronic wall painting display device provided by an embodiment of the present application;

[0074] Figure 2 FIG. is a schematic flowchart of an information display method provided by an embodiment of the present application;

[0075] Figure 3 FIG. is a schematic structural diagram of a terminal provided by an embodiment of the present application;

[0076] Figure 4 FIG. is a schematic structural diagram of an information display device provided by an embodiment of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0077] The following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some embodiments of the present application, rather than all embodiments. Based on the embodiments of the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

[0078] In the description and claims of this application and the above-mentioned drawings, terms such as "first" and "second" are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally further include steps or units not listed, or may optionally further include other steps or units inherent to these processes, methods, products, or devices.

[0079] Reference to "embodiment" in this application means that a specific feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of this application. The phrase appearing in various positions in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art will explicitly and implicitly understand that the embodiments described in this application can be combined with other embodiments.

[0080] To better understand an information display method provided by an embodiment of this application, first, a method for giving eye prompts to users in the existing solution will be briefly introduced. In the existing solution, since users usually have a high degree of concentration when learning, their eye fatigue will increase sharply when using their eyes. When users study seriously, their perception of learning time will decrease, and they often study for a long time unconsciously, causing greater fatigue to their eyes. Usually, some users set an alarm according to the learning duration for prompting. This prompting method usually has a long learning duration and cannot be adjusted according to the user's real-time eye usage situation. For example, in different states, the user's eye fatigue degree will be different. Specifically, for example, when a user is ill, their eyes may be more prone to fatigue, and the prompting time should be earlier than that set when the user is in a normal state. Therefore, when using the method of setting an alarm, accurate eye fatigue prompting cannot be achieved in real time.

[0081] Aiming at solving the above problems, an embodiment of this application provides an information display method, which can display information for eye fatigue prompting according to the determined eye fatigue degree of the target user, improving the accuracy of the user's eye adjustment.

[0082] Please refer to Figure 1 , Figure 1 which is a schematic diagram of an electronic wall painting display device provided by an embodiment of this application. As Figure 1As shown in the figure, the electronic wall painting display device includes a display module 1, a collection module 2, and a processing module 3. The display module is used for content display, for example, video display, picture display, text display, etc. The collection module is used to collect user images of the target user, etc. The processing module is used to analyze the eye fatigue degree of the user image, etc. after the user image is collected, control the display module to perform information display, and control the collection module to perform information collection, etc.

[0083] The electronic wall painting display device can be adjusted to different models such as desktop type, wall type, outdoor type, etc. according to the actual application scenario.

[0084] The main application scenario of the desktop type is the personal office area. Through this product, pictures that are helpful for eyesight protection, such as green plants and forests, can be set, and at the same time, it also has functions such as calendar, time, and enterprise logo information display; the main application scenarios of the wall type can be areas such as meeting rooms and exhibition rooms. Through this product, some theme contents such as background wall paintings, art works, publicity contents, and enterprise logo information can be displayed; the main application scenario of the outdoor type can be used for outdoor advertising, public welfare publicity, slogan display, and other related functions. Of course, it can also be used in online learning scenarios, etc.

[0085] Please refer to Figure 2 , Figure 2 which is a schematic flowchart of an information display method provided by an embodiment of this application. As Figure 2 shown, this method is applied to an electronic wall painting display device, and the electronic wall painting display device includes a display module, a collection module, and a processing module. This method includes:

[0086] 201. Obtain the viewing duration information of the target user viewing the information displayed by the display module, and obtain the user image of the target user during viewing to obtain a first image set.

[0087] The display module can display online learning videos, learning materials, etc. The target user can be a user who is conducting online learning, etc., and no specific limitation is made here. When obtaining the viewing duration, the duration of the information displayed by the display module can be determined as the viewing duration, or the duration between the start display moment of the information displayed by the display module and the current moment of the information displayed by the display module can be determined as the viewing duration indicated by the viewing duration information, etc. Of course, the viewing duration can also be obtained by other means. The viewing duration here can be used as a reference factor for subsequent adjustment to improve accuracy.

[0088] The user image can be obtained through the camera in the acquisition module to obtain the first image set. The user image can include user images collected periodically at a preset time interval, and these user images form the first image set. The preset time interval is set based on empirical values or historical data. The user image can also be multiple images collected when evaluating eye fatigue to extract the accurate target eye fatigue degree.

[0089] 202. Determine the first eye fatigue degree of the target user according to the viewing duration information.

[0090] Among them, the first eye fatigue degree can be determined according to the mapping relationship between the viewing duration interval where the viewing duration corresponding to the preset viewing duration information is located and the eye fatigue degree. Different viewing duration intervals have their corresponding eye fatigue degrees. Therefore, the viewing duration interval where the viewing duration information is located can be determined first, and then the first eye fatigue degree can be determined according to this viewing duration interval. This can improve the efficiency when determining the first eye fatigue degree.

[0091] 203. Determine the second eye fatigue degree of the target user according to the first image set.

[0092] Among them, the images in the first image set can be images within a short time period during image acquisition. The facial images in each first image can be extracted from the first image set to obtain the facial images, and then the eye information and facial expression information can be determined from the facial images. Based on this eye information and facial expression information, the reference eye fatigue degree can be determined. Finally, the reference eye fatigue degrees corresponding to each first facial image are fused to obtain the second eye fatigue degree. Therefore, the features in multiple first images can be fused to accurately determine the eye fatigue degree of the target user within the time period of image acquisition.

[0093] If the images in the first image set are images within a relatively long time acquisition period, the eye information and facial expression information can be extracted from the facial images. The sub-eye fatigue degree can be determined according to the eye feature change curve constructed based on the eye information, and another sub-eye fatigue degree can be determined according to the facial expression change trend. Finally, the two sub-eye fatigue degrees are fused to obtain the second eye fatigue degree. Therefore, the eye fatigue degree of the target user can be comprehensively evaluated overall during the online learning time period, and the accuracy when determining the eye fatigue degree can be improved.

[0094] 204. Fuse the first eye fatigue degree and the second eye fatigue degree to obtain the target eye fatigue degree.

[0095] The first eye fatigue degree and the second eye fatigue degree can be fused by using weight operation to obtain the target eye fatigue degree. Specifically, the weights corresponding to the first eye fatigue degree and the second eye fatigue degree can be extracted respectively, and the weight operation is performed using these weights to obtain the target eye fatigue degree. The weight of the first eye fatigue degree is lower than the weight of the second eye fatigue degree. This weight can be determined by a pre-set method or by methods such as look-up table, etc., and no specific limitation is made here.

[0096] 205. Determine the display information corresponding to the target user according to the target eye fatigue degree.

[0097] Among them, the eye fatigue level can be determined according to the target eye fatigue degree, and then the display information can be determined according to this eye fatigue level. Specifically, the eye fatigue level corresponding to the target eye fatigue degree can be determined according to the mapping relationship between the eye fatigue degree and the eye fatigue level, and then the display information corresponding to the eye fatigue level of the target user can be determined according to the mapping relationship between the eye fatigue level and the display information.

[0098] The display information can be a video for relieving eye fatigue, etc., and the video for relieving eye fatigue is a pre-stored video. Of course, the display information can also be information for reminding the eye fatigue degree. For example, it can be a picture, text information, etc.

[0099] 206. Perform display processing on the display information through the display module.

[0100] The display processing of the display information can be performed at a pre-set display position in the reality module. This pre-set display position can be a pre-set area with a certain area in the upper left corner of the display module, or a pre-set area in other display corners. It can be set according to the user's preference.

[0101] In this example, by obtaining the viewing duration information of the target user watching the information displayed by the display module, and obtaining the user image of the target user during viewing, a first image set is obtained; the first eye fatigue degree of the target user is determined according to the viewing duration information; the second eye fatigue degree of the target user is determined according to the first image set; the first eye fatigue degree and the second eye fatigue degree are fused to obtain the target eye fatigue degree; the display information corresponding to the target user is determined according to the target eye fatigue degree; and the display information is subjected to display processing through the display module. Therefore, it is possible to determine the display information by combining the viewing duration information of the target user and the target eye fatigue degree to adjust the eye fatigue of the target user, improving the accuracy during eye fatigue adjustment.

[0102] In a possible implementation, the images in the first image set may be images within a time period (short time period) of image acquisition, and the real-time second eye fatigue degree is determined through the first image set. Compared with determining the second eye fatigue degree by collecting a single image, the accuracy of the obtained second eye fatigue degree can be greatly improved. Specifically, a method for determining the second eye fatigue degree of the target user according to the first image set includes:

[0103] A1. Extract the facial image of the target user from the first target image to obtain the first facial image, where the first target image is any one of the first image set;

[0104] A2. Determine the eye information and facial expression information of the target user from the first facial image;

[0105] A3. Determine the first reference eye fatigue degree according to the eye information;

[0106] A4. Determine the fatigue degree correction value according to the facial expression information;

[0107] A5. Adjust the first reference eye fatigue degree by using the fatigue degree correction value to obtain the second reference eye fatigue degree;

[0108] A6. Repeat the method of extracting the facial image of the target user from the first target image to obtain the first facial image until adjusting the first reference eye fatigue degree by using the fatigue degree correction value to obtain the second reference eye fatigue degree until the second reference eye fatigue degree corresponding to each first image in the first image set is obtained, and a second reference eye fatigue degree set is obtained;

[0109] A7. Perform a fusion process on the second reference eye fatigue degrees in the second reference eye fatigue degree set to obtain the second eye fatigue degree.

[0110] Among them, a general facial image extraction method can be used to extract the facial image of the target user from the first target image to obtain the first facial image.

[0111] The eye information and facial expression information of the target user can be extracted from the first facial image. The eye information includes the eye opening degree, the texture contour of the lower eyelid, the texture information in the bulbar conjunctiva, etc. The first reference eye fatigue degree can be determined by combining the above eye opening degree, the texture contour of the lower eyelid, the texture information in the bulbar conjunctiva, etc.

[0112] Facial expression information can show the characteristics of the fatigue level of the target user. Specifically, since when a user is studying, their learning fatigue level will be characterized to a certain extent through facial expressions. For example, the facial expressions of a user when studying seriously and not being fatigued are different from those of a user when studying seriously and being fatigued. After the target user is fatigued, their facial expression usually shows relatively calm, and the changes in facial expressions also tend to be slow. However, although the facial expressions of the target user can characterize a part of the fatigue level, they cannot accurately reflect the fatigue level mainly. Therefore, facial expression information can be used to determine a fatigue level correction value, and this fatigue level correction value is used to adjust the first reference eye fatigue level to obtain the second reference eye fatigue level.

[0113] When determining the fatigue level correction value through facial expression information, specifically, it can be to input the facial expression information into a preset fatigue level correction value determination model through the preset fatigue level correction value determination model for calculation to obtain the fatigue level correction value. Or, a fatigue level correction value corresponding to the facial expression information of the target user is determined through the mapping relationship between the preset facial expression information and the fatigue level correction value.

[0114] The product of the first reference eye fatigue level and the fatigue level correction value can be determined as the second reference eye fatigue level.

[0115] After determining the second reference eye fatigue level corresponding to each first image, a second reference eye fatigue level set is obtained. The second reference eye fatigue levels in the second reference eye fatigue level set can be subjected to mean fusion processing to obtain the second eye fatigue level. Specifically, the mean of the second reference eye fatigue levels in the second reference eye fatigue level set can be determined as the second eye fatigue level.

[0116] Therefore, the second reference eye fatigue level corresponding to each first image can be determined by combining the eye information and facial expression information of the target user, and finally all the second reference eye fatigue levels are subjected to fusion processing to obtain the second eye fatigue level, improving the accuracy when determining the second eye fatigue level.

[0117] In a possible implementation manner, a method for determining the first reference eye fatigue level according to the eye information includes:

[0118] B1. Determine the first sub-eye fatigue level according to the eye opening degree in the eye information;

[0119] B2. Determine the second sub-eye fatigue level according to the texture contour of the lower eyelid in the eye information;

[0120] B3. Determine the third sub-eye fatigue level according to the texture information in the bulbar conjunctiva in the eye information;

[0121] B4. Perform a fusion process on the first sub-eye fatigue degree, the second sub-eye fatigue degree, and the third sub-eye fatigue degree to obtain the first reference eye fatigue degree.

[0122] Among them, the eye opening degree can be understood as the degree of eye opening. When the eye opening degree is below the preset eye opening degree, the higher the eye opening degree, the smaller the eye fatigue; the lower the eye opening degree, the greater the eye fatigue. When the eye opening degree is above the preset eye opening degree, the greater the eye opening degree, the greater the eye fatigue degree; the smaller the eye opening degree, the smaller the eye fatigue degree.

[0123] The contour type corresponding to the texture contour can be determined, and the second sub-eye fatigue degree can be determined according to the contour type. Different contour types have their corresponding eye fatigue degrees, so the second sub-eye fatigue degree can be determined according to the contour type corresponding to the texture contour. The contour features can be extracted from the texture contour, and the contour type can be determined according to the contour features. The contour features can include the contour shape and the contour tightness. The contour tightness can be understood as the distance between the contour lines within the contour. The smaller the distance, the greater the contour tightness; the greater the distance, the smaller the contour tightness.

[0124] The texture information in the bulbar conjunctiva can reflect the degree of eye congestion. The higher the degree of congestion, the higher the eye fatigue degree, and the target user needs to adjust eye use for eye protection. Specifically, the texture size and the texture quantity can be extracted from the texture information, and the third sub-eye fatigue degree can be determined according to the texture size and the texture quantity. The larger the texture size, the higher the third sub-eye fatigue degree; the smaller the texture size, the lower the third sub-eye fatigue degree. The more the texture quantity, the higher the third sub-eye fatigue degree; the smaller the texture quantity, the lower the third sub-eye fatigue degree.

[0125] The weights corresponding to the first sub-eye fatigue degree, the second sub-eye fatigue degree, and the third sub-eye fatigue degree can be obtained respectively, and the weights are used to perform a weighted operation on the first sub-eye fatigue degree, the second sub-eye fatigue degree, and the third sub-eye fatigue degree to obtain the first reference eye fatigue degree. The weights corresponding to the first sub-eye fatigue degree, the second sub-eye fatigue degree, and the third sub-eye fatigue degree obtained can be the pre-set corresponding weights extracted from the database, so as to obtain the weights corresponding to the first sub-eye fatigue degree, the second sub-eye fatigue degree, and the third sub-eye fatigue degree.

[0126] In this example, by combining the eye opening degree, the texture contour of the lower eyelid, and the texture information in the bulbar conjunctiva, the first reference eye fatigue degree is determined, which improves the accuracy in determining the first reference eye fatigue degree.

[0127] In a possible implementation, the images in the first image set may be images within a relatively long time acquisition period. Then, the second eye fatigue degree can be analyzed and determined from the perspective of overall eye use. Specifically, a method for determining the second eye fatigue degree of the target user according to the first image set includes:

[0128] C1. Extract the facial images of the target user in each first image in the first image set to obtain a second facial image set;

[0129] C2. Extract the eye information and facial expression information of the target user from the second facial images in the second facial image set to obtain an eye information set and a facial expression information set;

[0130] C3. Construct an eye feature change curve according to the eye information set;

[0131] C4. Determine the first sub-eye fatigue degree according to the eye feature change curve;

[0132] C5. Construct facial expression change trend information according to the facial expression information set;

[0133] C6. Determine the second sub-eye fatigue degree according to the facial expression change trend information;

[0134] C7. Perform a weighted operation on the first sub-eye fatigue degree and the second sub-eye fatigue degree to obtain the second eye fatigue degree.

[0135] For the specific implementation manners of steps C1 - C2, reference may be made to the specific implementation manners of steps A1 - A2 in the foregoing embodiments, which will not be elaborated herein.

[0136] The eye feature information includes the eye opening degree and the texture information in the bulbar conjunctiva. Then, an eye opening degree change curve and a texture information change curve in the bulbar conjunctiva can be constructed respectively.

[0137] The change trend of the eye opening degree can be determined according to the eye opening degree change curve, and an eye fatigue degree can be determined according to this change trend; and the change trend of the texture information can be determined according to the texture information change curve in the bulbar conjunctiva, and another eye fatigue degree can be determined according to this texture information change trend; the above two eye fatigue degrees are fused to obtain the first sub-eye fatigue degree.

[0138] Among them, the change trend of the eye opening degree can be determined according to the slope of the eye opening degree change curve. The larger the slope, the more obvious the change trend, and the higher the eye fatigue degree; the smaller the slope, the flatter the change trend, and the smaller the fatigue degree. It can also be combined with the change degree of the slope. In each slope change degree interval, there is its corresponding eye fatigue degree.

[0139] The change trend of the texture information determined from the change curve of the texture information in the bulbar conjunctiva may include the change trend of the number of textures and the change trend of the size of the textures. The eye fatigue degrees corresponding to the change trend of the number of textures and the change trend of the size of the textures may be determined with reference to the method for determining the eye fatigue degree according to the slope of the change curve of the eye opening degree described above.

[0140] Therefore, the second eye fatigue degree may be determined by combining the change curves of the eye features, so that the second eye fatigue degree can be determined from the perspective of overall eye use, improving the accuracy of determining the second eye fatigue degree.

[0141] In a possible implementation manner, a method for determining display information corresponding to a target user according to the target eye fatigue degree includes:

[0142] D1. Determine the eye fatigue level of the target user according to the target eye fatigue degree;

[0143] D2. Determine the display information corresponding to the target user according to the eye fatigue level.

[0144] Among them, the eye fatigue level may be determined according to the target eye fatigue degree, and then the display information may be determined according to the eye fatigue level. Specifically, the eye fatigue level corresponding to the target eye fatigue degree may be determined according to the mapping relationship between the eye fatigue degree and the eye fatigue level, and then the display information corresponding to the eye fatigue level of the target user may be determined according to the mapping relationship between the eye fatigue level and the display information.

[0145] The display information may be a video for relieving eye fatigue, etc. The video for relieving eye fatigue is a pre-stored video. Of course, the display information may also be information for reminding the eye fatigue degree. For example, it may be a picture, text information, etc.

[0146] Consistent with the above embodiments, please refer to Figure 3 , Figure 3 which is a schematic structural diagram of a terminal provided by an embodiment of the present application. As Figure 3 shown, it includes a processor, an input device, an output device, and a memory. The processor, the input device, the output device, and the memory are interconnected. Among them, the memory is used to store a computer program, the computer program includes program instructions, and the processor is configured to call the program instructions. The above program includes instructions for performing the following steps;

[0147] Obtain the viewing duration information of the target user watching the information displayed by the display module, and obtain the user image of the target user during viewing to obtain a first image set;

[0148] Determine the first eye fatigue degree of the target user according to the viewing duration information;

[0149] Determine the second eye fatigue degree of the target user according to the first image set;

[0150] Fuse the first eye fatigue degree and the second eye fatigue degree to obtain the target eye fatigue degree;

[0151] Determine the display information corresponding to the target user according to the target eye fatigue degree;

[0152] Perform display processing on the display information through the display module.

[0153] The above mainly introduces the solution of the embodiment of the present application from the perspective of the execution process on the method side. It can be understood that in order for the terminal to implement the above functions, it includes the corresponding hardware structure and / or software module for executing each function. Those skilled in the art should easily realize that, combining the units and algorithm steps of each example described in the embodiments provided in this article, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed in the way of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present application.

[0154] The embodiment of the present application can divide the functions of the terminal according to the above method examples. For example, each function unit can be divided corresponding to each function, or two or more functions can be integrated into one processing unit. The above integrated unit can be implemented in the form of hardware or in the form of a software function unit. It should be noted that the division of units in the embodiment of the present application is illustrative, only a logical function division, and there can be other division methods in actual implementation.

[0155] Consistent with the above, please refer to Figure 4 , Figure 4 This is a schematic structural diagram of an information display device provided by an embodiment of the present application. As Figure 4 shown, the device is applied to an electronic wall painting display device, and the electronic wall painting display device includes a display module, a collection module, and a processing module. The device includes:

[0156] An obtaining unit 401, configured to obtain the viewing duration information of the target user viewing the information displayed by the display module, and obtain the user image of the target user during viewing to obtain a first image set;

[0157] A first determining unit 402, configured to determine the first eye fatigue degree of the target user according to the viewing duration information;

[0158] A second determination unit 403, configured to determine a second eye fatigue degree of the target user according to the first image set;

[0159] A fusion unit 404, configured to fuse the first eye fatigue degree and the second eye fatigue degree to obtain a target eye fatigue degree;

[0160] A third determination unit 405, configured to determine display information corresponding to the target user according to the target eye fatigue degree;

[0161] A display unit 406, configured to perform display processing on the display information through the display module.

[0162] In a possible implementation manner, the second determination unit 403 is configured to:

[0163] Extract a facial image of the target user from a first target image to obtain a first facial image, where the first target image is any one of the first image set;

[0164] Determine eye information and facial expression information of the target user from the first facial image;

[0165] Determine a first reference eye fatigue degree according to the eye information;

[0166] Determine a fatigue degree correction value according to the facial expression information;

[0167] Adjust the first reference eye fatigue degree by using the fatigue degree correction value to obtain a second reference eye fatigue degree;

[0168] Repeat the method of extracting a facial image of the target user from the first target image to obtain a first facial image until adjusting the first reference eye fatigue degree by using the fatigue degree correction value to obtain a second reference eye fatigue degree, until the second reference eye fatigue degrees corresponding to each first image in the first image set are obtained, so as to obtain a second reference eye fatigue degree set;

[0169] Perform a fusion process on the second reference eye fatigue degrees in the second reference eye fatigue degree set to obtain the second eye fatigue degree.

[0170] In a possible implementation manner, in terms of determining the first reference eye fatigue degree according to the eye information, the second determination unit 403 is specifically configured to:

[0171] Determine a first sub-eye fatigue degree according to the eye opening degree in the eye information;

[0172] Determine a second sub-eye fatigue degree according to the wrinkle contour of the lower eyelid in the eye information;

[0173] Determine the third sub-eye fatigue degree according to the vein information in the bulbar conjunctiva in the eye information;

[0174] Perform fusion processing on the first sub-eye fatigue degree, the second sub-eye fatigue degree, and the third sub-eye fatigue degree to obtain the first reference eye fatigue degree.

[0175] In a possible implementation manner, the second determination unit 403 is configured to:

[0176] Extract the facial image of the target user in each first image in the first image set to obtain a second facial image set;

[0177] Extract the eye information and facial expression information of the target user from the second facial images in the second facial image set to obtain an eye information set and a facial expression information set;

[0178] Construct an eye feature change curve according to the eye information set;

[0179] Determine the first sub-eye fatigue degree according to the eye feature change curve;

[0180] Construct facial expression change trend information according to the facial expression information set;

[0181] Determine the second sub-eye fatigue degree according to the facial expression change trend information;

[0182] Perform a weighted operation on the first sub-eye fatigue degree and the second sub-eye fatigue degree to obtain the second eye fatigue degree.

[0183] In a possible implementation manner, the third determination unit 405 is configured to:

[0184] Determine the eye fatigue level of the target user according to the target eye fatigue degree;

[0185] Determine the display information corresponding to the target user according to the eye fatigue level.

[0186] The embodiment of the present application further provides a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program enables a computer to execute some or all of the steps of any one of the information display methods recorded in the above method embodiments.

[0187] The embodiment of the present application further provides a computer program product, where the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program enables a computer to execute some or all of the steps of any one of the information display methods recorded in the above method embodiments.

[0188] It should be noted that, for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations. However, those skilled in the art should be aware that this application is not limited by the described action sequence, because according to this application, certain steps can be carried out in other sequences or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily essential to this application.

[0189] In the above embodiments, the descriptions of the respective embodiments have their own emphases. For the parts not detailed in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0190] In the several embodiments provided by this application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there can be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed coupling or direct coupling or communication connection to each other can be through some interfaces. The indirect coupling or communication connection of the device or unit can be in an electrical or other form.

[0191] The unit described as a separated component can be or can not be physically separated. The component displayed as a unit can be or can not be a physical unit, that is, it can be located in one place, or can be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0192] In addition, in each embodiment of the application, the functional units can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software program module.

[0193] If the integrated unit is implemented in the form of a software program module and sold or used as an independent product, it can be stored in a computer-readable memory. Based on such understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of this application. The aforementioned memory includes various media that can store program codes, such as USB flash drives, read-only memories (ROM), random access memories (RAM), mobile hard disks, magnetic disks, or optical discs.

[0194] Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program. This program can be stored in a computer-readable memory, and the memory can include: flash drives, read-only memories, random access memories, magnetic disks, or optical discs, etc.

[0195] The above has introduced the embodiments of this application in detail. Specific examples are used in this article to elaborate on the principle and implementation manner of this application. The description of the above embodiments is only used to help understand the method and its core idea of this application; at the same time, for those of ordinary skill in the art, according to the idea of this application, there will be changes in the specific implementation manner and application scope. In summary, the content of this specification should not be construed as a limitation to this application.

Claims

1. An information display method, characterized in that The method is applied to an electronic wall painting display device, which includes a display module, a collection module, and a processing module. The method includes: Obtaining the viewing duration information of a target user viewing the information displayed by the display module, and obtaining the user image of the target user during viewing to obtain a first image set; Determining the first eye fatigue degree of the target user according to the viewing duration information; Determining the second eye fatigue degree of the target user according to the first image set; Fusing the first eye fatigue degree and the second eye fatigue degree to obtain the target eye fatigue degree; Determining the display information corresponding to the target user according to the target eye fatigue degree; Performing display processing on the display information through the display module.

2. The information display method according to claim 1, wherein The determining the second eye fatigue degree of the target user according to the first image set includes: Extracting the facial image of the target user from a first target image to obtain a first facial image, where the first target image is any one in the first image set; Determining the eye information and facial expression information of the target user from the first facial image; Determining the first reference eye fatigue degree according to the eye information; Determining the fatigue degree correction value according to the facial expression information; Adjusting the first reference eye fatigue degree by using the fatigue degree correction value to obtain a second reference eye fatigue degree; Repeating the above method of extracting the facial image of the target user from the first target image to obtain a first facial image, to adjusting the first reference eye fatigue degree by using the fatigue degree correction value to obtain a second reference eye fatigue degree until the second reference eye fatigue degrees corresponding to each first image in the first image set are obtained to obtain a second reference eye fatigue degree set; Performing a fusion process on the second reference eye fatigue degrees in the second reference eye fatigue degree set to obtain the second eye fatigue degree.

3. The information display method according to claim 2, wherein The determining the first reference eye fatigue degree according to the eye information includes: Determining a first sub-eye fatigue degree according to the eye opening degree in the eye information; Determining a second sub-eye fatigue degree according to the wrinkle contour of the lower eyelid in the eye information; Determining a third sub-eye fatigue degree according to the wrinkle information in the bulbar conjunctiva in the eye information; Performing a fusion process on the first sub-eye fatigue degree, the second sub-eye fatigue degree, and the third sub-eye fatigue degree to obtain the first reference eye fatigue degree.

4. The information display method according to claim 1, wherein The determining the second eye fatigue degree of the target user according to the first image set includes: Extracting the facial images of the target user in each first image in the first image set to obtain a second facial image set; Extracting the eye information and facial expression information of the target user from the second facial images in the second facial image set to obtain an eye information set and a facial expression information set; Constructing an eye feature change curve according to the eye information set; Determining a first sub-eye fatigue degree according to the eye feature change curve; Constructing facial expression change trend information according to the facial expression information set; Determining a second sub-eye fatigue degree according to the facial expression change trend information; Perform a weighted operation on the first sub-eye fatigue degree and the second sub-eye fatigue degree to obtain the second eye fatigue degree.

5. The information display method according to any one of claims 1-4, characterized in that, The determining the display information corresponding to the target user according to the target eye fatigue degree includes: Determine the eye fatigue level of the target user according to the target eye fatigue degree; Determine the display information corresponding to the target user according to the eye fatigue level.

6. An information display device, characterized in that, The device is applied to an electronic wall painting display device, and the electronic wall painting display device includes a display module, a collection module, and a processing module. The device includes: An acquisition unit, configured to acquire the viewing duration information of the target user viewing the information displayed by the display module, and acquire the user image of the target user during viewing to obtain a first image set; A first determination unit, configured to determine the first eye fatigue degree of the target user according to the viewing duration information; A second determination unit, configured to determine the second eye fatigue degree of the target user according to the first image set; A fusion unit, configured to fuse the first eye fatigue degree and the second eye fatigue degree to obtain a target eye fatigue degree; A third determination unit, configured to determine the display information corresponding to the target user according to the target eye fatigue degree; A display unit, configured to perform display processing on the display information through the display module.

7. The information display device according to claim 6, characterized in that The second determination unit is configured to: Extract the facial image of the target user from the first target image to obtain a first facial image, where the first target image is any one of the first image set; Determine the eye information and facial expression information of the target user from the first facial image; Determine a first reference eye fatigue degree according to the eye information; Determine a fatigue degree correction value according to the facial expression information; Adjust the first reference eye fatigue degree by using the fatigue degree correction value to obtain a second reference eye fatigue degree; Repeat the method of extracting the facial image of the target user from the first target image to obtain a first facial image, to adjusting the first reference eye fatigue degree by using the fatigue degree correction value to obtain a second reference eye fatigue degree until the second reference eye fatigue degree corresponding to each first image in the first image set is obtained, to obtain a second reference eye fatigue degree set; Perform a fusion process on the second reference eye fatigue degrees in the second reference eye fatigue degree set to obtain the second eye fatigue degree.

8. The information display device according to claim 7, characterized in that In terms of determining the first reference eye fatigue degree according to the eye information, the second determination unit is specifically configured to: Determine a first sub-eye fatigue degree according to the eye opening degree in the eye information; Determine a second sub-eye fatigue degree according to the wrinkle contour of the lower eyelid in the eye information; Determine a third sub-eye fatigue degree according to the wrinkle information in the bulbar conjunctiva in the eye information; Perform a fusion process on the first sub-eye fatigue degree, the second sub-eye fatigue degree, and the third sub-eye fatigue degree to obtain a first reference eye fatigue degree.

9. A terminal, characterized in that, It includes a processor, an input device, an output device and a memory, and the processor, the input device, the output device and the memory are interconnected. Among them, the memory is used to store a computer program, the computer program includes program instructions, and the processor is configured to call the program instructions to execute the method according to any one of claims 1-5.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, the computer program includes program instructions, and the program instructions, when executed by the processor, cause the processor to execute the method according to any one of claims 1-5.

Images