Display method and device, electronic equipment and medium

Abstract

The invention relates to a display method and device, electronic equipment and a medium, and is applied to the electronic equipment. The display method in the invention determines a visual state of a user based on eye information of the user; based on the visual state, the contrast ratio of the first content is adjusted through an adjusting mode corresponding to the visual state, and the first content refers to the content displayed in other partial areas or all areas except the area for displaying the target content. While the detail effect that the user can browse the target content is ensured, the situation that the visual feeling of the user is influenced by dazzling light emitted by the first content can be avoided, the visual fatigue of the user is avoided, and the visual experience of the user is improved.

Description

Technical Field

[0001] The present disclosure relates to the technical field of electronic devices, and in particular to a display method, device, electronic device and medium. Background Art

[0002] With the rapid development of electronic technology, electronic devices with display functions, such as smart phones, tablet computers, and laptops, have been widely used in daily life. Users can use electronic devices to shoot and view images, videos, and other content.

[0003] When users use applications such as photos to browse captured images or videos, the middle area of ​​the screen of the electronic device is used to display the image or video, and some edge areas of the screen will have blank areas. For some images with high detail clarity, higher brightness is required to display them clearly. However, when the screen brightness is high, the light emitted by the blank area of ​​the screen will shine into the user's eyes, causing fatigue and discomfort to the user's eyes. Summary of the invention

[0004] In order to overcome the problems existing in the related art, the present disclosure provides a display method, device, electronic device and medium.

[0005] According to a first aspect of an embodiment of the present disclosure, a display method is provided, which is applied to an electronic device, wherein a first area of ​​a screen of the electronic device is used to display target content, and a second area of ​​the screen of the electronic device is used to display first content, and the first area is different from the second area. The display method includes:

[0006] Determining the user's visual state based on the user's eye information, wherein the visual state is used to indicate whether the user has eye fatigue;

[0007] Based on the visual state, the contrast of the first content is adjusted in an adjustment manner corresponding to the visual state.

[0008] In some exemplary embodiments of the present disclosure, adjusting the contrast of the first content based on the visual state in an adjustment manner corresponding to the visual state includes:

[0009] Based on the visual state being a fatigue state, the contrast of the first content is adjusted by a first adjustment method, wherein the first adjustment method represents that the number of frames in the screen refresh process and the adjustment parameter of the contrast of the first content are in an exponential relationship.

[0010] In some exemplary embodiments of the present disclosure, adjusting the contrast of the first content based on the visual state in an adjustment manner corresponding to the visual state includes:

[0011] Based on the visual state being a non-fatigue state, the contrast of the first content is adjusted by a second adjustment method, wherein the second adjustment method represents that the number of frames in the screen refresh process is linearly related to an adjustment parameter of the contrast of the first content.

[0012] In some exemplary embodiments of the present disclosure, determining the visual state of the user based on the eye information of the user includes:

[0013] Determining a blinking frequency of the user within a preset period based on the eye image of the user;

[0014] Determine a reference frequency based on pre-stored configuration information and environmental information, wherein the environmental information is used to characterize the ambient light illumination in the current environment, the configuration information is used to characterize the corresponding relationship between the ambient light illumination and the reference frequency, and the reference frequency is a reference value for judging whether the user has visual fatigue under a preset ambient light illumination;

[0015] The visual state is determined based on a relationship between the blink frequency and the reference frequency.

[0016] In some exemplary embodiments of the present disclosure, determining the blinking frequency of the user within a preset period based on the eye image of the user includes:

[0017] Collecting a plurality of eye images within the preset period;

[0018] Based on the eye image, determining pupil position and pupil area;

[0019] Determining the number of times the user's eyes are opened and closed based on changes in the pupil area in the plurality of eye images;

[0020] Based on the opening and closing times, the blinking frequency is determined.

[0021] In some exemplary embodiments of the present disclosure, after adjusting the contrast of the first content, the display method further includes:

[0022] Determining, according to environmental information, that the current environment is a preset environment, wherein the environmental information is used to characterize the ambient light illumination in the current environment, and the ambient light illumination of the preset environment is lower than the preset illumination;

[0023] Based on the current color temperature of the screen, a color temperature parameter of the screen is adjusted.

[0024] In some exemplary embodiments of the present disclosure, adjusting the color temperature parameter of the screen based on the current color temperature of the screen includes:

[0025] The current color temperature of the screen is a cold color temperature, and the color temperature parameter of the screen is reduced;

[0026] The current color temperature of the screen is a warm color temperature, and the color temperature parameter of the screen is increased.

[0027] According to a second aspect of an embodiment of the present disclosure, a display device is provided, which is applied to an electronic device, wherein a first area of ​​a screen of the electronic device is used to display target content, and a second area of ​​the screen of the electronic device is used to display first content, and the first area is different from the second area, and the display device includes:

[0028] A determination module, used to determine the user's visual state based on the user's eye information, wherein the visual state is used to indicate whether the user has eye fatigue;

[0029] An adjustment module is used to adjust the contrast of the first content based on the visual state by an adjustment method corresponding to the visual state.

[0030] According to a third aspect of an embodiment of the present disclosure, an electronic device is provided, the electronic device comprising:

[0031] Screen;

[0032] processor;

[0033] a memory for storing processor-executable instructions;

[0034] Among them, the processor is configured to execute executable instructions in the memory to implement the display method provided in the first aspect of the present disclosure.

[0035] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided, on which executable instructions are stored. When the executable instructions are executed by a processor, the display method provided by the first aspect of the present disclosure is implemented.

[0036] The above method of the present disclosure has the following beneficial effects: the electronic device in the present disclosure adjusts the contrast of the first content in an adjustment manner corresponding to the visual state of the user, while ensuring that the user can browse the details of the target content, it can also avoid the first content emitting glare light that affects the user's visual perception, avoid causing visual fatigue to the user, and improve the user's visual experience.

[0037] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0039] Figure 1 It is a schematic diagram of an application scenario according to an exemplary embodiment.

[0040] Figure 2 The figure is a flowchart of a display method according to an exemplary embodiment.

[0041] Figure 3 The figure is a flowchart of a display method according to an exemplary embodiment.

[0042] Figure 4 The figure is a flowchart of a display method according to an exemplary embodiment.

[0043] Figure 5 The figure is a flowchart of a display method according to an exemplary embodiment.

[0044] Figure 6 is a block diagram of a display device according to an exemplary embodiment.

[0045] Figure 7 is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0046] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0047] At present, electronic devices generally have a shooting function. The effect of the image captured by the general method will be affected by the photosensitivity range of the photosensitive element of the electronic device. In the actual shooting process, if the exposure is based on the area with stronger light intensity at the shooting scene as a reference, the low-light area of ​​the captured image will appear black and no layers can be seen; if the exposure is based on the area with weaker light intensity at the shooting scene as a reference, the strong light area of ​​the image will appear white and no content can be seen.

[0048] In order to further improve the shooting effect, images shot using HDR (High-Dynamic Range) technology are increasingly recognized by customers. HDR technology uses LDR (Low-Dynamic Range) images with the best details corresponding to each exposure time to synthesize the final HDR image, which can better reflect the visual effects in the real environment. Images shot using HDR technology can not only prevent the bright areas in the shooting scene from being overexposed, but also improve the display effect of the weak light areas, giving them a certain sense of layering. Therefore, compared with ordinary images shot in general ways, HDR images can provide more dynamic range and image details.

[0049] In order to enable users to see the details of the HDR image, it is necessary to increase the brightness to highlight more grayscale content in the image. When an electronic device displays an image, the non-image display area on the screen is usually a white background. Since white corresponds to the highest grayscale value, if the brightness of all display areas of the screen is increased together, although the details of the HDR image will be enhanced, the non-image display area will become extremely dazzling, which can easily cause visual fatigue to the user. Of course, it is understandable that when a general image is displayed in a brighter state, the non-image display area on the screen will also cause visual fatigue to the user due to excessive brightness.

[0050] In order to solve the above problems, the present disclosure provides a display method, which takes into account that the human eye's pupils dilate in a dark environment and contract in a bright environment, and therefore the human eye is easily fatigued in a dark environment, and is more sensitive to the brightness and color temperature of the screen than in a bright environment. The electronic device determines the user's visual state based on the user's eye information. If the user's eyes are in a fatigued state, the contrast of the content displayed in the non-image display area is adjusted more quickly to avoid stimulation to the user's eyes caused by the display of the non-image display area during the brightening process, thereby aggravating eye fatigue. If the user's eyes are not in a fatigued state, the contrast of the content displayed in the non-image display area is adjusted at a slower speed to improve the user's visual experience and ensure that the user has the same visual experience when viewing images in different environments and under different visual states.

[0051] The exemplary embodiments of the present disclosure provide a display method, which is applied to an electronic device, which may be a smart electronic device having a screen and a camera device, such as a mobile phone, a tablet computer, or a smart wearable device. Figure 1As shown, it is an application scenario of the display method in the present disclosure, the first area 10 of the screen is used to display the target content, the target content can be a static image or a dynamic video, wherein the first area 10 can be used to display images taken in a general manner, and can also be used to display HDR images. The other areas of the screen except the first area 10 are the second area 11 (that is, the non-image display area), which is used to display the first content. The first content can be a solid color background, or it can be the background content set by the user. Generally speaking, the second area 11 mostly displays a white background. Among them, the second area can be all areas except the first area, and can be a local area except the first area. For example, if only the first area on the screen displays the target content, and other areas are not used to display other content, then the second area can be all areas on the screen except the first area; if in addition to the first area on the screen displaying the target content, there are also some areas used to display small windows of other applications, then the second area is the area on the screen except the first area and the area where the small window is located.

[0052] like Figure 2 As shown, the display method shown in the present disclosure includes:

[0053] S201, determining the visual state of the user based on the user's eye information;

[0054] S202: Based on the visual state, adjust the contrast of the first content in an adjustment manner corresponding to the visual state.

[0055] In step S201, the eye information may include a numerical value of the user's blinking frequency or an eye image of the user, etc. The electronic device determines the user's visual state based on the numerical value of the blinking frequency or the eye image, and the user's visual state is divided into a fatigue state and a non-fatigue state. In one example, the electronic device determines the user's visual state based on the user's blinking frequency. When the user's blinking frequency exceeds 17 times / minute, it is determined that the user's eyes are in a fatigue state. Conversely, if the user's blinking frequency is less than 17 times / minute, it is determined that the user's eyes are in a non-fatigue state. In another example, the electronic device determines the user's visual state based on the user's eye image. When the electronic device recognizes that the user rubs his eyes, it determines that the user's eyes are in a fatigue state. If the electronic device does not recognize that the user rubs his eyes, it determines that the user's eyes are in a non-fatigue state. In another example, the electronic device can also determine the user's visual state based on the user's blinking frequency and eye image to avoid the user rubbing his eyes due to changes in ambient light and being misjudged as having eyes in a state of fatigue. When the electronic device recognizes the user rubbing his eyes, it must also determine whether the user's blinking frequency exceeds 17 times / minute. If the user rubs his eyes and the blinking frequency exceeds this value, it is determined that the user's eyes are in a state of fatigue; if the user rubs his eyes but the blinking frequency does not exceed this value, it is determined that the user's eyes are not in a state of fatigue.

[0056] The above-mentioned eye information can be obtained by the electronic device through the sensors, cameras and other components set by the electronic device, for example, the front camera captures the user rubbing his eyes; it can also be obtained by the electronic device through a communication connection with a third-party device, for example, the monitoring device at home captures the user rubbing his eyes, and then sends the message of the user rubbing his eyes to the electronic device through the local area network; the eye information can also be determined directly by the user's input to the electronic device, for example, the user feels that his eyes are uncomfortable, and then inputs information such as "eye fatigue" through an App installed on the electronic device, or the user sends a voice command of "eye discomfort" to the electronic device.

[0057] In step S202, refer to Figure 1 As shown in the figure, since the first content displayed in the second area 11 is mostly white background, the gray value of white is very high. When the brightness is increased to display the specific details of the target content in the first area 10, the first content will emit a dazzling white light. Therefore, it is necessary to reduce the contrast of the first content to reduce the stimulation to the user's eyes. It should be noted that the contrast adjustment of the first content in the second area 11 does not affect the overall display brightness of the screen. The brightness of the screen is still based on the brightness of the details of the HDR image. Figure 1 The contrast of the second area 11 is adjusted.

[0058] Among them, contrast refers to the measurement of different brightness levels between the brightest white and the darkest black in the light and dark areas of an image. The larger the difference range, the greater the contrast, and the smaller the difference range, the smaller the contrast. A contrast ratio of 120:1 can easily display vivid and rich colors. When the contrast ratio is as high as 300:1, it can support colors of all levels. To be more precise, contrast is the value obtained by subtracting the saturation of the white signal at 100% and 0%, and then dividing it by the 0% white value (0% white signal is actually black) measured in Lux (illuminance, i.e. lux). In other words, contrast is the division value of the whitest and blackest brightness units. Therefore, the brighter the white and the darker the black, the higher the contrast. Generally, contrast is the ratio of the brightness of the same point on the screen when it is brightest (white) to the darkest (black) for the entire screen. When the contrast ratio increases, there are more levels between white and black, the white is brighter, the black is darker, and it is more likely to cause visual fatigue to users. When the contrast is reduced, the level between white and black is reduced, and the difference in brightness between the two is smaller, which can relieve the user's visual fatigue.

[0059] When the user's eyes are in a fatigued state, the electronic device reduces the contrast of the first content in a faster adjustment manner to reduce it to a target value that is compatible with the current scene, so that the user's eyes will not be further fatigued due to the display of the first content, and the details of the target content can be viewed. When the user's eyes are not in a fatigued state, the electronic device reduces the contrast of the first content in a slower adjustment manner to reduce it to a target value that is compatible with the current scene, so that the user's eyes will not feel uncomfortable due to the sudden change in the contrast of the first content, and the details of the target content can be viewed.

[0060] The above is explained with the main application scenarios of the method in the present disclosure. In order to avoid the first content being too bright and affecting the user's experience of browsing the target content, and to avoid visual fatigue of the user during the browsing process, it is necessary to reduce the contrast of the first content. Of course, it is understandable that in some application scenarios, the contrast of the first content can also be increased. For example, in some game applications or some video playback applications or text browsing applications, the video or game interface or text content that the user wants to watch will be displayed in the middle area of ​​the screen (i.e., the first area), and the upper and lower parts of the screen that are not used to display the target content are used as the second area. Advertisements are placed in the second area. In order to attract the user's attention to the advertisement, the contrast of the first content (i.e., the advertisement) displayed in the second area can be increased to attract the user's attention and make the user pay attention to the advertisement.

[0061] In the present disclosure, the electronic device adjusts the contrast of the first content in an adjustment method corresponding to the user's visual state. While ensuring that the user can browse the details of the target content, it can also prevent the first content from emitting glaring light that affects the user's visual experience and causes visual fatigue to the user, so that the user can have the same visual feeling in different scenarios, thereby improving the user's visual experience.

[0062] According to an exemplary embodiment, Figure 3 As shown, the display method in this embodiment includes:

[0063] S301, determining the visual state of the user based on the user's eye information;

[0064] S302, determining whether the visual state is a fatigue state, if the visual state is a fatigue state, executing step S303; if the visual state is a non-fatigue state, executing step S304;

[0065] S303, adjusting the contrast of the first content by using a first adjustment method;

[0066] S304: Adjust the contrast of the first content by using a second adjustment method.

[0067] Among them, step S301 is the same as the implementation in the above embodiment and will not be repeated here.

[0068] In step S302, the electronic device determines the visual state of the user. If the visual state of the user is in a fatigue state, it is necessary to accelerate the reduction of the contrast of the first content to reduce the stimulation to the user's eyes and help the user relieve visual fatigue. Therefore, step S303 is executed to reduce the contrast of the first content in a first adjustment manner. If the visual state of the user is in a non-fatigue state, the contrast of the first content can be reduced at a slower speed to avoid discomfort to the user's eyes due to sudden changes in contrast. Therefore, step S304 is executed to reduce the contrast of the first content in a second adjustment manner.

[0069] In step S303, the first adjustment mode indicates that the number of frames in the screen refresh process and the adjustment parameter of the contrast of the first content are in an exponential relationship, and the exponential relationship can be expressed by the formula Y=b*e a*x Indicates, where x represents the number of frames, Y represents the contrast adjustment multiple, a and b are coefficients involved in the adjustment process, and the specific values ​​of a and b are set based on the hardware performance of the electronic device. The better the hardware performance, the larger the values ​​that a and b can be set to. a and b are subject to the maximum brightness that the screen can display, that is, when the maximum brightness that the screen can display is determined, the maximum values ​​of a and b can also be determined. Among them, a and b are written into the chip of the electronic device when it leaves the factory.

[0070] For example, the screen of an electronic device refreshes 60 frames of images per second. Based on the hardware performance, a is set to 1 and b is set to 0.03, so Y = 0.03e x When refreshing the first frame, the contrast of the first content is reduced by 0.03e times, and when refreshing the second frame, the contrast of the first content is reduced by 0.03e times. 2 times, and so on. When refreshing the last frame, the contrast of the first content is reduced by 0.03e. 60 After the contrast adjustment parameter is determined, the contrast value of the current display frame is multiplied by the contrast adjustment parameter to obtain the contrast value of the next frame. For example, if the contrast value before adjustment is M, the first contrast parameter calculated by the above exponential relationship is 0.03e, then Figure 1 The contrast value of the second area 11 in the second frame is reduced by 0.03eM, and the contrast value of the second area 11 in the second frame after adjustment is reduced by 0.03eM. 2 M, and so on, until a suitable preset contrast value is adjusted. The contrast value is a value pre-stored in the electronic device, and the value is determined based on the current environmental information. The electronic device stores a contrast value corresponding to the ambient light illumination, which can help the user adjust the contrast value in the second area 11 to the most comfortable state and avoid eye discomfort for the user.

[0071] In step S304, the second adjustment method represents that the number of frames in the screen refresh process and the adjustment parameter of the contrast of the first content are in a linear relationship, and the linear relationship can be expressed by the formula Y=c*x, where x represents the number of frames, Y represents the adjustment multiple of the contrast, and c is a coefficient involved in the adjustment process. The specific value of c is set based on the hardware performance of the electronic device. The better the hardware performance, the larger the value that c can be set to. c is subject to the maximum brightness that the screen can display, that is, when the maximum brightness that the screen can display is determined, the maximum value of c can also be determined. For example, the screen of the electronic device refreshes 60 frames of images per second, and c is set to 0.2 based on the hardware performance, so Y=0.2x, when refreshing the first frame, the adjustment parameter of the contrast of the first content is 0.2, that is, based on the current brightness value N, the contrast of the first content is reduced by 0.2N, and when refreshing the second frame, the contrast of the first content is reduced by 0.4N, and so on, until it is reduced to the target contrast value. Among them, the target contrast value can be determined based on a pre-stored contrast curve, and the contrast curve is used to characterize the correspondence between the contrast value and the ambient light illumination, so as to help the user adjust the contrast value in the second area 11 to a state that can best avoid user visual fatigue in the current scenario where the user uses the electronic device, so as to ensure that the user can obtain the most comfortable visual experience regardless of the ambient light scenario.

[0072] In the present disclosure, when the user's eyes are in a fatigued state, the electronic device adjusts the contrast of the first content in an exponential form, and when the user's eyes are in a non-fatigued state, the electronic device adjusts the contrast of the first content in a linear form, thereby avoiding glare on the screen, slowing down the occurrence of visual fatigue of the user, and allowing the user to have the same visual experience in different scenarios.

[0073] According to an exemplary embodiment, Figure 4 As shown, the display method in this embodiment includes:

[0074] S401, determining a blinking frequency of the user within a preset period based on an eye image of the user;

[0075] S402, determining a reference frequency based on pre-stored configuration information and environment information;

[0076] S403, determining the visual state based on the relationship between the blinking frequency and the reference frequency;

[0077] S404, determining whether the visual state is a fatigue state, if the visual state is a fatigue state, executing step S405; if the visual state is a non-fatigue state, executing step S406;

[0078] S405, adjusting the contrast of the first content by using a first adjustment method;

[0079] S406: Adjust the contrast of the first content by using a second adjustment method.

[0080] Among them, steps S404, S405, and S406 are the same as those in the above embodiment and will not be repeated here.

[0081] In step S401, when the user opens the photo album to view images, the electronic device can use the camera to obtain the user's eye images at preset intervals, and the preset time can be set based on the time the user views the images. The longer the user views the images, the shorter the interval at which the electronic device uses the camera to capture the user's eye images. For example, when the user opens the photo album to view images for 5 minutes, the electronic device uses the camera to obtain the user's eye images at an interval of 10 seconds. When the user opens the photo album to view images for 20 minutes, the probability of visual fatigue in the user increases. Therefore, the frequency of obtaining the user's eye images can be increased. The electronic device uses the camera to obtain the user's eye images at an interval of 5 seconds, so as to promptly detect whether the user has eye fatigue, so as to help the user relieve eye fatigue as soon as possible.

[0082] The electronic device determines the opening and closing state of the user's eyes based on the eye image, determines the number of times the user blinks, and calculates the blinking frequency within a preset period. The preset period can be set to a value such as 60s or 120s. In addition, the electronic device can also obtain eye images taken by a third-party device, analyze the received eye images, and determine the user's blinking frequency within the preset period. Determining the visual state based on the eye image can effectively improve the accuracy of determining the user's visual state.

[0083] In some embodiments, step S401 determines the blinking frequency of the user within a preset period based on the eye image of the user, including:

[0084] S1. Collect multiple eye images within a preset period;

[0085] S2. determining pupil position and pupil area based on the eye image;

[0086] S3, determining the number of times the user's eyes are opened and closed based on changes in pupil areas in the multiple eye images;

[0087] S4. Determine the blinking frequency based on the opening and closing times.

[0088] In step S1, the electronic device uses a camera to collect an eye image once every preset time interval, so as to collect a fixed number of eye images within a preset period to ensure the accuracy of the blink frequency finally calculated. For example, the preset time is set to 5s and the preset period is 60s, so the electronic device obtains an eye image every 2s, and within the preset period of 60s, the electronic device collects a total of 30 eye images.

[0089] In step S2, the electronic device performs image segmentation on the multiple eye images, determines the pupil position based on the corner point detection method, and marks the pupil position, and the pupil area can be calculated through the coordinate information of the pupil position. Among them, the corner point detection uses a fixed window to slide in any direction on the image, and compares the degree of change of the pixel grayscale in the window before and after the sliding. If there is a large grayscale change in any direction of sliding, it can be considered that there is a corner point in the window, and the position of the window can be confirmed to be the pupil position.

[0090] Because when the user opens his eyes, the pupil occupies a larger area of ​​the eye image, and when the user closes his eyes, the pupil occupies a smaller area of ​​the eye image, in step S3, the electronic device can determine the number of times the user's eyes are opened and closed based on the change in the pupil area in the eye image. When the pupil area changes from large to small or from small to large, it can be determined that the user has completed a blink.

[0091] In step S4, the electronic device can determine the blinking frequency based on the ratio of the number of opening and closing times to the preset period. For example, if the preset period is set to 60 seconds, and the electronic device collects 30 eye images in total, based on the pupil area, it can be determined that 18 of the user's eyes are in an open state and 12 of the user's eyes are in a closed state, that is, the user's eyes complete 12 blinks within 60 seconds, so it can be determined that the blinking frequency is 12 times / minute.

[0092] In step S402, the electronic device uses an ambient light intensity sensor to collect environmental information, and the environmental information represents the ambient light illumination in the current environment, and the unit is lux. The electronic device pre-stores configuration information representing the corresponding relationship between the ambient light illumination and the reference frequency, wherein the reference frequency is a reference value for judging whether the user has visual fatigue under a preset ambient light illumination. For example, the configuration information is a set of numerical values ​​with a corresponding relationship between the ambient light illumination and the reference frequency. When the ambient light illumination is 100 lux, the reference frequency for judging whether the user has visual fatigue is 20 times / minute; when the ambient light illumination is 500 lux, the corresponding reference frequency is 17 times / minute; when the ambient light illumination is 1000 lux, the corresponding reference frequency is 17 times / minute; when the ambient light illumination is 10000 lux, the corresponding reference frequency is 20 times / minute. So that the set reference frequency can better match the ambient light illumination in the environment where the user is located, so as to more accurately judge whether the user has visual fatigue.

[0093] The electronic device determines a reference frequency for judging visual fatigue of the user based on the pre-stored configuration information and the current ambient light illuminance. For example, when the current ambient light illuminance is determined to be 100 lux based on the ambient information, the reference frequency can be determined to be 17 times / minute based on the configuration information; when the current ambient light illuminance is determined to be 10000 lux based on the ambient information, the reference frequency can be determined to be 20 times / minute based on the configuration information.

[0094] In step S403, the electronic device determines the visual state based on the relationship between the blinking frequency and the reference frequency. When the blinking frequency is greater than the reference frequency, the user's visual state is determined to be a fatigued state; when the blinking frequency is less than or equal to the reference frequency, the user's visual state is determined to be a non-fatigued state. For example, the current ambient light illumination is 100 lux, the reference frequency is 17 times / minute, and the blinking frequency is determined to be 16 times / minute based on the eye image. The electronic device determines that the user's visual state is in a non-fatigued state; the current ambient light illumination is 10,000 lux, the reference frequency is 20 times / minute, and the blinking frequency is determined to be 25 times / minute based on the eye image. The electronic device determines that the user's visual state is in a fatigued state.

[0095] According to an exemplary embodiment, Figure 5As shown, the display method in this embodiment includes:

[0096] S501, determining the visual state of the user based on the user's eye information;

[0097] S502, determining whether the visual state is a fatigue state, if the visual state is a fatigue state, executing step S503; if the visual state is a non-fatigue state, executing step S504;

[0098] S503, adjusting the contrast of the first content by using a first adjustment method;

[0099] S504, adjusting the contrast of the first content by a second adjustment method;

[0100] S505, judging whether the current environment is a preset environment according to the environment information, if the current environment is a preset environment, executing step S506; if the current environment is not a preset environment, executing step S507;

[0101] S506, adjusting the color temperature parameters of the screen based on the current color temperature of the screen;

[0102] S507: Maintain the current color temperature of the screen.

[0103] Among them, steps S501-S504 are the same as those in the above embodiment and will not be described again.

[0104] Before describing the display method provided by this embodiment, the concept of color temperature involved is first described.

[0105] In blackbody radiation, the color of light varies with temperature, and the blackbody presents a gradual process from red-orange-red-yellow-yellow-white-white-blue-white. When the color of light emitted by a light source looks the same as the color of light emitted by a blackbody at a certain temperature, the temperature of the blackbody is called the color temperature of the light source (unit: Kelvin K). The higher the temperature of the blackbody, that is, the higher the color temperature, the more blue components in the spectrum and the less red components. Different color temperatures of light sources emit different colors of light, which also give people different feelings. High color temperature will make people feel a cold atmosphere, that is, high color temperature corresponds to cold color temperature, and low color temperature will make people feel a warm atmosphere, that is, low color temperature corresponds to warm color temperature. Color temperature can be converted from ambient light intensity calculation, that is, the color temperature sensor directly detects the ambient light intensity and calculates the ambient light intensity to obtain color temperature. When the color temperature exceeds 9300K, the screen appears cold; when the color temperature is lower than 6500K, the screen appears warm.

[0106] When the user is in a dark environment, the eyes are more sensitive to the brightness and color temperature of the screen, and it is easy to feel fatigued due to the screen display that is not compatible with the ambient light. Therefore, when the user is in a dark environment, adjusting the color temperature of the screen can effectively relieve the user's visual fatigue. In step S505, the preset environment is a dark environment. When the environmental information is lower than the preset illumination, the current environment is determined to be the preset environment. If the current environment is the preset environment, step S506 is executed to adjust the color temperature parameters of the screen based on the current color temperature of the screen so that the screen display meets the illumination under the preset environment. If the current environment is not the preset environment, step S507 is executed to maintain the current color temperature of the screen without adjustment. For example, the preset illuminance is set to 500 lux. If the ambient light illuminance in the current environment is 100 lux, it is determined that the current environment is the preset environment and is a dark environment. Therefore, it is necessary to adjust the color temperature parameters of the screen based on the current color temperature of the screen. If the ambient light illuminance in the current environment is 1000 lux, it is determined that the current environment is not the preset environment and is a bright environment. Therefore, there is no need to adjust the current color temperature of the screen and the current color temperature can be maintained.

[0107] In some embodiments, step S506 adjusts the color temperature parameters of the screen based on the current color temperature of the screen, including:

[0108] The current color temperature of the screen is cold, lower the color temperature parameters of the screen;

[0109] The current color temperature of the screen is warm. Increase the color temperature parameters of the screen.

[0110] If the current color temperature of the screen is cold, that is, the screen emits a cold light source, the display is a bluish color temperature effect, and the user will feel that the image is brighter in a dark environment. Therefore, the color temperature parameters of the screen need to be lowered so that the user can view the image in a softer display effect and avoid visual fatigue. If the current color temperature of the screen is warm, that is, the screen emits a warm light source, the display is a yellowish color temperature effect, and the user will feel that the image is darker in a dark environment. Therefore, the color temperature parameters of the screen need to be increased so that the user can view the details of the image without excessive eye strain.

[0111] In the present disclosure, if the user is in a dark environment, the electronic device reduces the contrast of the first content and adjusts the color temperature parameters of the screen based on the current color temperature of the screen, so that the color temperature display effect of the screen can adapt to the dark environment, thereby improving the visual comfort of the user in the dark environment.

[0112] An exemplary embodiment of the present disclosure provides a display device, which is applied to an electronic device, wherein a first area of ​​a screen of the electronic device is used to display target content, and a second area of ​​the screen of the electronic device is used to display first content, and the first area is different from the second area. Figure 6As shown, a block diagram of a display device shown in the present disclosure.

[0113] The block diagram includes: a determination module 61 and an adjustment module 62. The determination module 61 is used to determine the user's visual state based on the user's eye information, wherein the visual state is used to indicate whether the user has eye fatigue; the adjustment module 62 is used to adjust the contrast of the first content based on the visual state by an adjustment method corresponding to the visual state.

[0114] In an exemplary embodiment of the present disclosure, the adjustment module 62 is also used to: based on the visual state being a fatigue state, adjust the contrast of the first content through a first adjustment method, wherein the first adjustment method characterizes that the number of frames in the screen refresh process and the adjustment parameter of the contrast of the first content are exponentially related.

[0115] In an exemplary embodiment of the present disclosure, the adjustment module 62 is also used to: based on the visual state being a non-fatigue state, adjust the contrast of the first content through a second adjustment method, wherein the second adjustment method characterizes that the number of frames in the screen refresh process is linearly related to the adjustment parameter of the contrast of the first content.

[0116] In an exemplary embodiment of the present disclosure, the determination module 61 is also used to: determine the blinking frequency of the user within a preset period based on the user's eye image; determine the reference frequency based on pre-stored configuration information and environmental information, wherein the configuration information is used to characterize the correspondence between the ambient light illumination and the reference frequency, and the reference frequency is a reference value for judging whether the user has visual fatigue under the preset ambient light illumination; determine the visual state based on the relationship between the blinking frequency and the reference frequency.

[0117] In an exemplary embodiment of the present disclosure, the determination module 61 is also used to: collect multiple eye images within a preset period; determine the pupil position and pupil area based on the eye images; determine the number of times the user's eyes are opened and closed based on the changes in pupil area in the multiple eye images; and determine the blinking frequency based on the number of opening and closing times.

[0118] In an exemplary embodiment of the present disclosure, the adjustment module 62 is also used to: determine, based on environmental information, that the current environment is a preset environment, wherein the environmental information is used to characterize the ambient light illumination in the current environment, and the ambient light illumination of the preset environment is lower than the preset illumination; and adjust the color temperature parameters of the screen based on the current color temperature of the screen.

[0119] In an exemplary embodiment of the present disclosure, the adjustment module 62 is further used to: when the current color temperature of the screen is a cold color temperature, reduce the color temperature parameters of the screen; when the current color temperature of the screen is a warm color temperature, increase the color temperature parameters of the screen.

[0120] Regarding the display device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0121] Figure 7 is a block diagram of an electronic device 700 according to an exemplary embodiment. For example, the electronic device 700 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0122] Reference Figure 7 , the electronic device 700 may include one or more of the following components: a processing component 702 , a memory 704 , a power component 706 , a multimedia component 708 , an audio component 710 , an input / output (I / O) interface 712 , a sensor component 714 , and a communication component 716 .

[0123] The processing component 702 generally controls the overall operation of the electronic device 700, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 702 may include one or more processors 720 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 702 may include one or more modules to facilitate the interaction between the processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate the interaction between the multimedia component 708 and the processing component 702.

[0124] The memory 704 is configured to store various types of data to support operations on the electronic device 700. Examples of such data include instructions for any application or method operating on the electronic device 700, contact data, phone book data, messages, pictures, videos, etc. The memory 704 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0125] The power supply component 706 provides power to the various components of the electronic device 700. The power supply component 706 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 700.

[0126] The multimedia component 708 includes a screen that provides an output interface between the electronic device 700 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 708 includes a front camera and / or a rear camera. When the electronic device 700 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0127] The audio component 710 is configured to output and / or input audio signals. For example, the audio component 710 includes a microphone (MIC), and when the electronic device 700 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 704 or sent via the communication component 716. In some embodiments, the audio component 710 also includes a speaker for outputting audio signals.

[0128] I / O interface 712 provides an interface between processing component 702 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0129] The sensor assembly 714 includes one or more sensors for providing various aspects of status assessment for the electronic device 700. For example, the sensor assembly 714 can detect the open / closed state of the electronic device 700, the relative positioning of components, such as the display and keypad of the electronic device 700, and the sensor assembly 714 can also detect the position change of the electronic device 700 or a component of the electronic device 700, the presence or absence of user contact with the electronic device 700, the orientation or acceleration / deceleration of the electronic device 700, and the temperature change of the electronic device 700. The sensor assembly 714 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 714 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 714 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0130] The communication component 716 is configured to facilitate wired or wireless communication between the electronic device 700 and other devices. The electronic device 700 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 716 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0131] In an exemplary embodiment, the electronic device 700 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0132] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 704 including instructions, and the instructions can be executed by a processor 720 of an electronic device 700 to perform the above display method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0133] A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of an electronic device, enables a processing device of the electronic device to execute a display method provided by an exemplary embodiment of the present disclosure.

[0134] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0135] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A display method, characterized in that: Applied to an electronic device, a first area of ​​a screen of the electronic device is used to display target content, a second area of ​​the screen of the electronic device is used to display first content, the first area is different from the second area, and the display method includes: Determining the user's visual state based on the user's eye information, wherein the visual state is used to indicate whether the user has eye fatigue; Based on the visual state, the contrast of the first content is adjusted in an adjustment manner corresponding to the visual state.

2. The display method according to claim 1, characterized in that: The adjusting the contrast of the first content based on the visual state by an adjustment method corresponding to the visual state includes: Based on the visual state being a fatigue state, the contrast of the first content is adjusted by a first adjustment method, wherein the first adjustment method represents that the number of frames in the screen refresh process and the adjustment parameter of the contrast of the first content are in an exponential relationship.

3. The display method according to claim 1, characterized in that: The adjusting the contrast of the first content based on the visual state by an adjustment method corresponding to the visual state includes: Based on the visual state being a non-fatigue state, the contrast of the first content is adjusted by a second adjustment method, wherein the second adjustment method represents that the number of frames in the screen refresh process is linearly related to an adjustment parameter of the contrast of the first content.

4. The display method according to any one of claims 1 to 3, characterized in that: The determining the user's visual state based on the user's eye information includes: Determining a blinking frequency of the user within a preset period based on the eye image of the user; Determine a reference frequency based on pre-stored configuration information and environmental information, wherein the environmental information is used to characterize the ambient light illumination in the current environment, the configuration information is used to characterize the corresponding relationship between the ambient light illumination and the reference frequency, and the reference frequency is a reference value for judging whether the user has visual fatigue under a preset ambient light illumination; The visual state is determined based on a relationship between the blink frequency and the reference frequency.

5. The display method according to claim 4, characterized in that: The step of determining the blinking frequency of the user within a preset period based on the eye image of the user includes: Collecting a plurality of eye images within the preset period; Based on the eye image, determining pupil position and pupil area; Determining the number of times the user's eyes are opened and closed based on changes in the pupil area in the plurality of eye images; Based on the opening and closing times, the blinking frequency is determined.

6. The display method according to any one of claims 1 to 3, characterized in that: After adjusting the contrast of the first content, the display method further includes: Determining, according to environmental information, that the current environment is a preset environment, wherein the environmental information is used to characterize the ambient light illumination in the current environment, and the ambient light illumination of the preset environment is lower than the preset illumination; Based on the current color temperature of the screen, a color temperature parameter of the screen is adjusted.

7. The display method according to claim 6, characterized in that: Adjusting the color temperature parameters of the screen based on the current color temperature of the screen includes: The current color temperature of the screen is a cold color temperature, and the color temperature parameter of the screen is reduced; The current color temperature of the screen is a warm color temperature, and the color temperature parameter of the screen is increased.

8. A display device, characterized in that: Applied to an electronic device, a first area of ​​a screen of the electronic device is used to display target content, a second area of ​​the screen of the electronic device is used to display first content, the first area is different from the second area, and the display device includes: A determination module, used to determine the user's visual state based on the user's eye information, wherein the visual state is used to indicate whether the user has eye fatigue; An adjustment module is used to adjust the contrast of the first content based on the visual state by an adjustment method corresponding to the visual state.

9. An electronic device, characterized in that: The electronic device comprises: Screen; processor; a memory for storing processor-executable instructions; The processor is configured to execute executable instructions in the memory to implement the display method according to any one of claims 1 to 7.

10. A non-transitory computer-readable storage medium having executable instructions stored thereon, characterized in that: When the executable instruction is executed by a processor, the display method according to any one of claims 1 to 7 is implemented.

Images