Display method, device and storage medium of display device

Abstract

The present application discloses a display method, device and storage medium for a display device, the method comprising: in response to determining that the display device is in an environment affected by natural light based on a video captured by a camera device, adjusting the display characteristics of the display device based on the brightness change law of the environment and the current ambient brightness of the display device; displaying a picture based on the adjusted display characteristics; wherein the camera device and the display device are in the same environment. In the above manner, the present application can adjust the display characteristics of the display device according to the brightness change of the ambient natural light, realize the optimized display of the picture under different lighting conditions, and enhance the user's digital life experience.

Description

Technical Field

[0001] The present application relates to the field of electronic technology, and in particular to a display method, device and storage medium of a display device. Background Art

[0002] With the advent of globalization and digitalization, people are increasingly dependent on electronic products with display screens, such as smartphones, tablets, computer monitors, and televisions. These devices have greatly enriched our lives and work, but they have also brought a series of health problems, especially the impact on eyes and sleep quality. Long-term use of screens, especially at night, may cause eye fatigue and dryness, reduce the user experience, and affect the body's biological rhythm, leading to sleep disorders, which may cause a series of health problems. Summary of the invention

[0003] In order to solve the above technical problems, the technical solution adopted in this application is: to provide a display method, device and storage medium for a display device, so as to at least solve the problems in the related technology of reduced user experience and impact on human health caused by long-term use of electronic devices.

[0004] According to one embodiment of the present invention, there is provided a display method for a display device, comprising: in response to determining that the display device is in an environment affected by natural light based on a video captured by a camera device, adjusting the display characteristics of the display device based on a brightness variation pattern of the environment and the current ambient brightness of the display device; displaying a picture based on the adjusted display characteristics; wherein the camera device and the display device are in the same environment.

[0005] In order to solve the above technical problems, a technical solution adopted by the present application is: to provide a display characteristic adjustment device, comprising:

[0006] A data acquisition module, used to collect ambient brightness data of the environment in which the display device is located;

[0007] A data fitting module, used for fitting an environment fitting curve based on the environment brightness data;

[0008] A data comparison module is used to compare the environmental fitting curve with the experimental fitting curve in the database to determine whether the display device is in an environment affected by natural light;

[0009] The screen display linkage module is used to adjust the display characteristics of the display device based on the brightness change law of the environment and the current ambient brightness of the display device.

[0010] To solve the above technical problems, a technical solution adopted in the present application is: to provide an electronic device, including a memory and a processor, wherein the memory is used to store a computer program, and when the computer program is executed by the processor, it is used to implement the display method of the display device in the above technical solution.

[0011] In order to solve the above technical problems, a technical solution adopted in the present application is: to provide a storage medium, which is used to store a computer program, and when the computer program is executed by a processor, it is used to implement the display method of the display device in the above technical solution.

[0012] Through the above scheme, the beneficial effects of the present application are: the display method of the display device provided by the present application determines whether the display device is in an environment affected by natural light based on the video collected by the camera device in the same environment as the display device. If it is in an environment affected by natural light, the display characteristics of the display device are adjusted based on the brightness change law of the environment and the current ambient brightness of the display device, and the picture is displayed based on the adjusted display characteristics; thereby, the display characteristics of the display device can be adjusted according to the brightness change of the ambient natural light, and the display effect of the display picture on the user under different lighting conditions can be optimized, which can further improve the impact of the display device on the user's biorhythm. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. Among them:

[0014] Figure 1 This is a schematic diagram of screen spectrum distribution of a common display device provided by this application;

[0015] Figure 2 This is a schematic diagram of the secretion curve of melatonin in one day provided by the present application;

[0016] Figure 3 It is a flow chart of an embodiment of a display method of a display device provided by the present application;

[0017] Figure 4 is a flow chart of an embodiment of a method for determining whether a display device is in an environment affected by natural light provided by the present application;

[0018] Figure 5 This is a schematic diagram of image segmentation provided by the present application;

[0019] Figure 6 It is a schematic diagram of an environmental fitting curve provided by this application;

[0020] Figure 7 This is a statistical diagram of ambient brightness data at any time provided by this application;

[0021] Figure 8 This is a schematic diagram of the brightness change law of an environment provided by this application;

[0022] Fig. 9 A schematic diagram of the relationship between color temperature statistics and white balance points provided in this application;

[0023] Fig.10 is a flow chart of another embodiment of a display method for a display device provided by the present application;

[0024] Fig.11 is a schematic diagram of an embodiment of a display characteristic adjustment device provided by the present application;

[0025] Fig.12 It is a structural schematic diagram of an embodiment of an electronic device provided by the present application;

[0026] Fig.13 It is a structural schematic diagram of an embodiment of a computer-readable storage medium provided by the present application. DETAILED DESCRIPTION

[0027] The present application is further described in detail below in conjunction with the accompanying drawings and examples. It is particularly noted that the following examples are only used to illustrate the present application, but are not intended to limit the scope of the present application. Similarly, the following examples are only some embodiments of the present application rather than all embodiments, and all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.

[0028] Reference to "embodiments" in this application means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0029] It should be noted that the terms "first", "second", etc. in this application are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Thus, the features defined as "first", "second", etc. can explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "multiple" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units that are not listed, or optionally also includes other steps or units inherent to these processes, methods, products or devices.

[0030] With the development of science and technology and the advent of the digital age, electronic products with display screens are indispensable in our lives. However, long-term exposure to display devices will bring a series of health problems, especially the impact on human biorhythms. Figure 1 As shown, the harmful blue light component in the 415-445nm band is very prominent, and its peak is significantly higher than the peak values ​​of other spectral wavelengths. Long-term exposure to this blue light will affect the human body's biological rhythm, inhibit melatonin and cause sleep quality problems, and cause damage to the human eyes.

[0031] The intensity of natural light changes with the time of day, such as from morning to evening. The human body's biological rhythm is also affected by the change of natural light. The biological rhythm refers to the change of life activities in a cycle of about 24 hours. The suprachiasmatic nucleus located in the hypothalamus controls the biological rhythm. Generally, a large amount of stress hormone cortisol (Cortisol) is secreted between 6 and 8 in the morning to wake up, and melatonin (Melatonin) is secreted around 9 in the evening to promote sleep. Figure 2 As shown, Figure 2 This is a schematic diagram of the melatonin secretion curve in one day provided by the present application. It can be seen that the secretion of melatonin is less during the daytime, and the secretion begins to increase after 20 o'clock at night.

[0032] The rhythm-friendly technology in the prior art mainly determines whether it is day or night by obtaining the system time of the device, and adjusts the display parameters of the screen accordingly. However, this method has some limitations. First, there are differences in day and night time in different regions, and relying solely on the system time may not accurately reflect the actual lighting conditions. Secondly, if the device is not connected to the Internet or the time is set incorrectly, the rhythm adjustment may fail and accurate screen display adjustment cannot be provided.

[0033] In view of the above limitations, the present application proposes a display method for a display device, which determines whether the display device is in an environment affected by natural light based on a video captured by a camera device in the same environment as the display device. If the display device is in an environment affected by natural light, the display characteristics of the display device are adjusted based on the brightness change law of the environment and the current ambient brightness of the display device, and the screen is displayed based on the adjusted display characteristics. In this way, the present application can adjust the display characteristics of the display device according to the brightness change of the ambient natural light, optimize the display effect of the display screen on the user under different lighting conditions, and further improve the impact of the display device on the user's biorhythm.

[0034] See also Figure 3 , Figure 3 1 is a flow chart of an embodiment of a display method for a display device provided by the present application. It should be noted that if there are substantially the same results, this embodiment is not limited to Figure 3 The process sequence shown is limited. Figure 3 As shown, this embodiment includes:

[0035] S110: In response to determining that the display device is in an environment affected by natural light based on the video captured by the camera device, adjusting the display characteristics of the display device based on a brightness variation rule of the environment and the current environment brightness of the display device.

[0036] The screen visibility of the display device is affected by the natural light in the environment in which it is used, so that the visual experience and physiological health of the user are constantly changing. The same display characteristics will produce different visual effects under the influence of ever-changing natural light. Using the display device under inappropriate lighting conditions for a long time may cause eye fatigue. Adjusting the display characteristics to adapt to the natural light in the environment can alleviate this fatigue. Using a camera device in the same environment as the display device to collect video or image data of the environment in which the display device is located can be used to determine whether the display device is in an environment affected by natural light.

[0037] See also Figure 4 , Figure 4 It is a flowchart of an embodiment of a method for determining whether a display device is in an environment affected by natural light provided in the present application.

[0038] S111: Acquire brightness data of the environment in which the display device is located.

[0039] The brightness data of the environment in which the display device is located can be obtained through the ambient light sensor carried by the display device itself or in the environment in which it is located. In addition, the detection of ambient brightness can also be achieved through the combination of software and hardware. For example, based on the image acquisition device, the ambient video or image data is obtained, and the brightness information in the image is analyzed through image processing technology, so as to obtain the brightness data of the environment in which the display device is located.

[0040] In one embodiment, ambient light data is collected based on an ambient light sensor carried by the display device itself or in the environment where the display device is located, so as to obtain brightness data of the environment where the display device is located.

[0041] In one embodiment, the ambient brightness data of the display device is obtained based on the video image frame information of the environment in which the display device is located, which is collected by the camera device. The video image frame information collected by the camera device includes pixel color information, image brightness, contrast and / or gamma value, etc. The ambient brightness data of the display device can be obtained by real-time analysis of the image frame information. Exemplarily, by calculating the brightness value of each pixel in the image, and summarizing and averaging all the pixels, the brightness information of the environment reflected by the image frame is counted to obtain the ambient brightness data.

[0042] Preferably, if you want to obtain more accurate ambient brightness data, compared to the brightness measurement based on pixels, you can also process the image frame captured by the camera device in blocks, so that you can get brightness data closer to the real environment. In one example, the image is divided into Row rows and Col columns, and then divided into Row*Col blocks of the same size, where the width of the Row row and the Col column can be set to different values ​​according to the resolution of the camera. The schematic diagram of the block division can be as follows: Figure 5 As shown. In each image block, the red chromaticity information R[i][j], green chromaticity information G[i][j], blue chromaticity information B[i][j] and brightness information Y[i][j] are counted respectively. Where i represents the row, the maximum value is Row, j represents the column, the maximum value is Col; the brightness Y[i][j] is calculated by the RGB value according to a specific weight, such as the following formula (1), and the weight is determined according to the user's eye sensitivity to different colors.

[0043] Y[i][j]= 0.299 R[i][j]+ 0.587 G[i][j]+ 0.144 B[i][j](1)

[0044] To further improve the accuracy of statistical data, the image block data can be preprocessed to filter out atypical image blocks that may be caused by environmental factors. In this way, when counting the average RGB and brightness information of the image, only those image blocks that represent the natural lighting conditions of the environment are considered, thereby improving the accuracy of the ambient brightness estimation and making the final statistical data more reliable.

[0045] For example, remove overly bright and dark image blocks, and only retain image blocks with brightness within a certain range, such as between Y_min and Y_max. In addition, since the display device may be located in an environment where there may be abnormal conditions caused by environmental factors such as uneven lighting or reflection, some image blocks that do not meet specific conditions may also be removed as needed, such as retaining only image blocks that meet the conditions defined by the following formula (2).

[0046] Temp_min<(Y[i][j]- B[i][j])*Ration1 + (Y[i][j]- R[i][j]) * Ration2 <Temp_max(2)

[0047] Among them, Ration1 and Ration2 are preset proportional coefficients used to adjust the judgment criteria of color blocks, which are used to help determine how to balance between brightness and chromaticity to identify color blocks; Temp_min and Temp_max are thresholds for the combination of brightness and chromaticity, Temp_min is the lower threshold, and Temp_max is the upper threshold, which together define the range that the brightness and chromaticity of a "normal" color block should be in. The purpose of formula (2) is to calculate a temporary variable Temp by multiplying the difference between brightness and chromaticity by the corresponding proportional coefficient, and determine whether this temporary variable is within the preset threshold range. If it is not within this range, it is considered to be an abnormal color block and the corresponding image block is removed.

[0048] In one embodiment, the gain value (Gain) and / or shutter speed corresponding to the image frame captured by the camera device can also be obtained, and the ambient brightness data of the display device can be obtained based on the image frame information, the gain value (Gain) and / or the shutter speed (Shutter). Exemplarily, the gain (Gain) and shutter speed (Shutter) that affect the exposure and brightness of the image when the currently processed image frame is captured are recorded, and the ambient brightness value (Env) of the environment in which the display device is located is calculated based on the average brightness (Yavg) of the image frame, the gain (Gain) and the shutter speed (Shutter), and the ambient brightness data of the image frame is obtained.

[0049] In one example, the image frame captured by the camera device is processed in blocks, and after all the image blocks of the image frame are preprocessed, the statistical values ​​of the RGB and Y values ​​of all valid image blocks are counted, including but not limited to the average value, median or standard deviation, etc. Taking the average value as an example, the average value of the RGB and Y values ​​of all valid image blocks is counted to obtain Ravg, Gavg, Bavg and Yavg.

[0050] Record the gain Gain and shutter speed Shutter that affect the exposure and brightness of the image when the currently processed image frame is captured, and calculate the ambient brightness value Env using the following formula (3) based on the average brightness Yavg, the gain Gain and the shutter speed Shutter to obtain the ambient brightness data of the current image frame. Exemplarily, the ambient brightness value of the display device is calculated based on the ratio of the average brightness to the acquisition information value to determine the ambient brightness data of the current display device. The acquisition information value is the ratio of the logarithm of the gain value with base 2 to the shutter speed.

[0051] Env= Yavg / (pow(2, Gain) / (Shutter) ) (3)

[0052] Preferably, in order to prevent storage pressure caused by excessive data volume, the collected ambient brightness data can be processed by mean filtering according to a certain time period (such as every 1 minute), and the average value of all ambient brightness data in each period can be calculated; the mean envLuma[i] calculated for each period is stored, where i is the serial number of the time period; and finally N arrays envLuma[N] of ambient brightness data are recorded. In this way, by using mean filtering, the amount of data that needs to be stored can be significantly reduced, and the efficiency of data processing can be improved. In addition, other data processing methods that can reduce storage pressure without affecting data quality, such as median filtering, can also be used, which are not limited here.

[0053] S112: Obtaining a brightness variation pattern of the environment based on the environment brightness data analysis.

[0054] The ambient brightness data corresponding to all image frames in the video of the environment in which the display device is located is collected by the camera device, and the brightness change pattern of the environment is obtained based on the ambient brightness data analysis. By continuously collecting the brightness data of the environment through the camera device, a time series can be formed, so that the trend of brightness change over time can be observed. As time goes by, when the accumulated data volume is large enough, the pattern and law of brightness change can be identified through statistical analysis methods, such as moving average, regression analysis, etc.

[0055] In one embodiment, the ambient brightness data within a preset period is continuously collected, and the ambient brightness data is connected once according to the time series to obtain an ambient brightness curve. Based on the ambient brightness curve, the brightness variation law of the environment can be analyzed.

[0056] In one embodiment, the mean and standard deviation of the environment brightness data envLuma[N] are calculated to fit a basic Gaussian curve Gaus[N], that is, the environment fitting curve, see Figure 6 , Figure 6 This is a schematic diagram of an environment fitting curve provided by the present application, which can intuitively represent the brightness change law of the environment.

[0057] For example, an environment fitting curve is constructed based on the environment brightness data within a preset period, and the environment fitting curve can be used to understand and predict the brightness change law of the environment. According to actual use requirements, the environment brightness data within a preset period can be counted, such as 8 hours, 12 hours, 24 hours, etc., and the environment fitting curve can be constructed based on the counted environment brightness data. Due to the uncertainty of the starting statistical time, such as Figure 7 As shown, Figure 7 This is a statistical diagram of ambient brightness data at any time provided by the present application. The ambient brightness data statistical diagram may have data offset, unclear periodicity or difficulty in determining extreme values. To facilitate analysis, the ambient brightness data statistical diagram can be optimized.

[0058] Exemplarily, during data processing, extreme points can be determined in the data set, and the extreme points can be moved to the center of the data set for further analysis and processing. In one example, the extreme point is usually located at the center of the maximum value area segment, and the entire data set is divided into M continuous segments, each of which contains approximately the same number of data points; the ambient brightness data in each area segment is accumulated to obtain the cumulative sum of the ambient brightness data in each area segment; the cumulative sums of all segments are traversed to find the area segment maxSum with the maximum cumulative sum; assuming that the extreme point is located at the center of the maximum cumulative sum area segment, the center point mid of the area segment is calculated. If the starting point of the maxSum area segment is maxStart, and the area segment contains M data points, then the center point mid = maxStart + M / 2. Compare the center point mid value with the total number of data sets or the array length N: If mid < N, it means that the center point is already within the valid range of the array and no special processing is required. Start translation directly and the center point after translation is at maxStart + (N / M) / 2. If mid ≥ N, it means that the center point exceeds the range of the array and the starting point of translation needs to be adjusted. The center point after translation is at maxStart + (N / M) - N and the center point is moved back to the beginning of the array for retrieval.

[0059] like Figure 6As shown, the extreme point is located at the mid position, and the extreme point position is used as the center point of the entire data, that is, the extreme point is translated to the position of N / 2, where N is the number of all data. Other data processing can be based on the data of this array for loop calculation. For example, the starting point of the loop is set to mid. During the loop calculation, if the calculated index exceeds the end of the array, the loop is used to return to the starting position of the array (that is, the index is 0). If in the loop, the starting point mid plus a certain step size N / M (where M is the number or size of a segment) exceeds the index range of the array (that is, greater than or equal to N), the loop returns to the starting position of the array to continue the calculation. In this way, regardless of the starting statistical time of the data, the extreme point can be accurately located at the center of the data set, so that subsequent analysis and processing can be more standardized.

[0060] S113: Determine whether the display device is in an environment affected by natural light based on the brightness variation rule.

[0061] By obtaining the brightness variation rule of the environment based on the ambient brightness data, it is determined whether the display device is in an environment affected by natural light. In one embodiment, by comparing the average brightness value with a preset brightness threshold, multiple brightness intervals are formed to determine whether the ambient brightness meets the condition of being affected by natural light.

[0062] In one embodiment, since the change of natural light is affected by factors such as the rotation of the earth, seasonal changes, and weather conditions, different brightness change patterns are exhibited even in an environment affected by natural light. Preferably, if the Gaussian fitting method is used to construct an environmental fitting curve to obtain the brightness change pattern of the environment, an experimental fitting curve established based on experimental data or a theoretical model can be stored in a database in advance, indicating the brightness change pattern in an environment affected by natural light at different times and locations, so as to capture the change pattern of natural light in different scenes within a day. By comparing the real-time collected environmental brightness data with the experimental fitting curve, it can be determined whether the current environment is affected by natural light: if the matching degree is high, it indicates that the brightness change of the current environment conforms to the change pattern of natural light; if the matching degree is low, it may indicate that the current environment is mainly affected by artificial light sources.

[0063] In one example, the environment fitting curve is matched with the experimental fitting curve in the database, for example, a similarity matching algorithm such as Euclidean distance and cosine similarity is used to determine the matching fitting curve with the highest similarity. The degree of fit between the environment fitting curve and the matching fitting curve is calculated, preferably, the degree of fit between the environment fitting curve and the matching fitting curve is calculated using R-square, and the R-square value is between 0 and 1, and the closer to 1, the higher the degree of fit.

[0064] A preset threshold is set to determine whether the display device is in an environment affected by natural light. If the degree of fitting is less than the preset threshold, it indicates that the environmental fitting curve and the experimental fitting curve are very matched, and it can be determined that the display device is in an environment affected by natural light; if the degree of fitting is greater than the preset threshold, it indicates that the environmental fitting curve and the experimental fitting curve do not match, and it can be determined that the display device is not in an environment affected by natural light.

[0065] In response to determining that the display device is currently in an environment affected by natural light, the display characteristics of the display device are adjusted based on the brightness change pattern of the environment and the current ambient brightness of the display device, thereby reducing the difference between the screen and ambient brightness and reducing the damage to human physiological health caused by long-term use of the display device.

[0066] In one embodiment, different methods for adjusting display characteristics may be set for different brightness intervals and / or human physiological rhythms. Figure 8 , Figure 8 This is a schematic diagram of the brightness change law of an environment provided by the present application. The maximum value of the environment fitting curve can be considered as the time of the highest brightness in a day, some areas can be considered as around 12 noon, and both sides can be considered as night. The environment fitting curve is segmented, for example, it can be divided into 10 intervals, and a different adjustment coefficient is set for each interval, where the adjustment coefficient can be linearly changed, that is, as the brightness decreases, the adjustment coefficient gradually increases.

[0067] In one example, a display characteristic adjustment range is set based on a first preset value and a second preset value. The current ambient brightness X of the display device is obtained, where X is a percentage of the maximum value, assuming that the first preset value is a% of the maximum value and the second preset value is b% of the maximum value. If the current ambient brightness is between the first preset value and the second preset value, a linear adjustment coefficient is calculated, wherein the linear adjustment coefficient is negatively correlated with the current ambient brightness. Exemplarily, the linear adjustment coefficient may be a ratio of a first value to a second value, wherein the first value is the difference between the current ambient brightness and the first preset value, and the second value is the difference between the second preset value and the first preset value, and the first preset value is greater than the second preset value.

[0068] (1) If the current ambient brightness is greater than a%, the display device will not be adjusted to prevent color gamut loss;

[0069] (2) If the current ambient brightness is lower than a%, start adjusting the display characteristics of the display device. When the ambient brightness is between a% and b%, set the linear adjustment coefficient antiBlue based on the following formula (4).

[0070] antiBlue = (Xa) / (b - a) (4)

[0071] Where X is the percentage of the maximum value, indicating the current ambient brightness. When X=a, antiBlue=0; when X=b, antiBlue=1.

[0072] (3) If the current ambient brightness is lower than b%, the linear adjustment coefficient is set to the maximum value, that is, antiBlue = 1, to adjust the display characteristics of the display device.

[0073] The display characteristics of the display device are adjusted based on the linear adjustment coefficient and the current ambient brightness of the display device. In one embodiment, the display characteristics include color temperature, gamma value and / or refresh rate, etc. The color temperature, gamma value and / or refresh rate are dynamically adjusted based on the change law of the ambient brightness and the current ambient brightness of the display device to improve visual comfort.

[0074] (1) The color temperature of the display device is adjusted based on the linear adjustment coefficient and the current ambient brightness of the display device. The linear adjustment coefficient and the color temperature are negatively correlated. As the linear adjustment coefficient antiBlue increases, the color temperature gradually decreases and tends to be warmer.

[0075] If the screen backlight of the display device supports color temperature adjustment, the color temperature of the backlight can be adjusted directly, for example, increasing the linear adjustment coefficient to reduce the color temperature, thereby reducing the proportion of blue light. If the screen backlight of the display device does not support color temperature adjustment, the RGB value of the screen can be adjusted by software to simulate the change of color temperature. For example, the blue component (B) can be reduced by the following formula (5) to reduce the color temperature, and the product of the linear adjustment coefficient and the first coefficient is subtracted from the blue component of the display device to adjust the color temperature through the blue component.

[0076] B=B – antiblue*T (5)

[0077] Wherein, antiBlue is a linear adjustment coefficient; T is the first coefficient, which is used to balance or adjust the proportional relationship in the entire color adjustment process and is set according to experience and actual needs.

[0078] (2) The gamma value of the display device is adjusted based on the linear adjustment coefficient and the current ambient brightness of the display device. The linear adjustment coefficient and the gamma value are negatively correlated. As the linear adjustment coefficient increases, the selected gamma value gamma gradually decreases.

[0079] Under different ambient brightness, a preset first gamma value and a second gamma value are obtained. According to the preset two gamma values ​​(gamma1 and gamma2), a gamma value adapted to the current ambient brightness can be obtained through interpolation calculation, which is used for adjusting the brightness and contrast of the display screen of the display device. Exemplarily, the calculation of the gamma value gamma is shown in formula (6), and the linear interpolation of the gamma value within the preset range of the linear adjustment coefficient (for example, in the process of changing from 0 to 1) is calculated, and the first gamma value and the second gamma value are weighted to obtain the gamma value of the display device; wherein the weighted coefficient of the second gamma value is the ratio of the linear adjustment coefficient to the second coefficient, and the sum of the weighted coefficient of the first gamma value and the weighted coefficient of the second gamma value is 1.

[0080] gamma = ((G-antiBlue)* gamma1+antiBlue* gamma2) / G(6)

[0081] Among them, antiBlue is a linear adjustment coefficient; gamma1 and gamma2 are two preset gamma values, for example, gamma1 can be the gamma value when antiBlue is 0, and gamma2 can be the gamma value when antiBlue is 1; G is the second coefficient, which is used to adjust the weight of interpolation, representing a specific brightness or contrast level, and is set according to experience and actual needs.

[0082] (3) The refresh frequency of the display device is adjusted based on the linear adjustment coefficient and the current ambient brightness of the display device. The linear adjustment coefficient and the refresh frequency are positively correlated. As the linear adjustment coefficient increases, the refresh frequency of the display device is gradually increased.

[0083] The screen refresh frequency is calculated according to the basic refresh frequency and the linear adjustment coefficient antiBlue, as shown in the following formula (7). The screen refresh frequency is the product of the basic refresh frequency, the linear adjustment coefficient and the third coefficient.

[0084] Screen refresh rate = basic refresh rate * antiblue * S (7)

[0085] Among them, antiBlue is the linear adjustment coefficient; S is the third coefficient, which is used to adjust the change range of the refresh frequency according to actual conditions or experimental data to obtain better display performance or user experience.

[0086] Through the above method, the present application can intelligently respond to changes in the brightness of the environment and realize dynamic optimization of the color temperature, gamma value and refresh rate of the display device. This adjustment mechanism not only improves visual comfort and reduces eye fatigue, but also helps to protect the user's biorhythm. At the same time, while ensuring the display effect, it achieves energy saving and consumption reduction, enhances the user's personalized experience, enables the display device to adapt to various environmental conditions, and provides a healthier, more comfortable and energy-saving viewing experience.

[0087] In addition, the present application also provides a method for adjusting display characteristics of a display device when the display device is not under the influence of a natural light environment. In one embodiment, if the display device is not under the influence of a natural light environment, the color temperature of the display device can be adjusted based on the current display image of the display device and the white balance algorithm, thereby ensuring color accuracy and visual comfort.

[0088] For example, see Fig. 9 , Fig. 9 A schematic diagram of the relationship between color temperature statistics and white balance points provided by this application. Since the white balance algorithm can neutralize the color cast that may exist in non-natural light environments, making the colors look more natural, the white balance algorithm can be used to adjust the color temperature according to the content of the current display.

[0089] The color temperature is calculated by counting the red, green and blue components of Ravg, Gavg and Bavg in the image frame information and the ambient brightness value Env. The color temperature is usually expressed in Kelvin (K). The calculated color temperature is mapped to the landing point in the white balance algorithm (i.e. the desired color temperature balance point) to generate a relationship diagram. The relationship diagram can show the ideal color temperature setting under different ambient brightness.

[0090] Preferably, the blue light output of the display device is adjusted by the following formula (8), and the display characteristics of the display device are adjusted based on the current ambient brightness and the law of ambient brightness change to adapt to different lighting conditions and protect the user's biorhythm. The preset fourth coefficient A and fifth coefficient B are obtained, and the blue light level adjustment level of the display device is calculated. The blue light level adjustment level is the product of the addition value and the ambient brightness ratio coefficient. The addition value is the sum of the product value and the fifth coefficient. The product value is the ratio of the average value of the blue component to the average value of the green component of the current display screen multiplied by the fourth coefficient. The blue light level adjustment level is used to adjust the color temperature of the display device.

[0091] Blue_Level = ((Bavg / Gavg)*A +B)*Env_Ration(8)

[0092] Among them, Blue_Level is the calculated blue light level adjustment level, which is used to control the amount of blue light output by the screen. The higher the blue light level adjustment level, the more blue light the screen outputs, the higher the color temperature of the display device, and the displayed picture is colder. The lower the blue light level adjustment level, the less blue light the screen outputs, the lower the color temperature of the display device, and the displayed picture is warmer. Bavg / Gavg is the ratio of the average blue component to the average green component calculated by the camera device. Since the human eye is more sensitive to green light, this ratio helps to determine how much blue light is needed to maintain color balance under different lighting conditions. A and B are two proportional coefficients, which are two constants of the linear equation. For example, if y=2x+1, then A and B are 2 and 1. These two proportional coefficients are used to adjust the blue light level and can be set according to the basic characteristics of the display device and the user's preferences. Env_Ration is the ambient brightness proportional coefficient. When the ambient brightness decreases, Env_Ration will adjust to reduce blue light output and increase the warm light of the screen.

[0093] The gamma value and / or refresh rate of the display device can be further adjusted based on the adjusted color temperature and current ambient brightness of the display device. The gamma value is dynamically adjusted according to the adjusted color temperature and current ambient brightness. The gamma value affects the contrast and brightness response of the screen. By adjusting the gamma value, the light and dark details of the image can be improved, making the image clearer under specific lighting conditions. In combination with the current color temperature and ambient brightness, the refresh rate of the display device can also be adjusted. The refresh rate affects the smoothness of the screen image. An appropriate refresh rate can reduce visual fatigue and provide a smoother viewing experience.

[0094] S120: Displaying a picture based on the adjusted display characteristics.

[0095] Taking into account the brightness change law of the environment in which the display device is located, and referring to factors such as user preferences, the color temperature, gamma value and / or refresh rate of the display device can be dynamically adjusted, and the image can be displayed based on the adjusted display characteristics. In this way, the use needs in diverse environments can be met, the image quality and viewing experience can be improved, visual fatigue can be reduced, and visual comfort can be improved.

[0096] To better explain the display method of the display device of this application, please refer to Fig.10 , Fig.10 FIG. 1 is a flow chart of another embodiment of the display method of the display device provided by the present application. It should be noted that if there are substantially the same results, this embodiment is not limited to the above embodiment. Fig.10 The process sequence shown is limited.

[0097] The camera device collects video or image data of the current environment of the display device; obtains RGB component data of the environment and photographic parameters of the camera device during collection, including gain Gain and shutter speed Shutter; calculates the average brightness value of the image frame based on the RGB component data using formula (2), and calculates the current environment brightness value Env based on the average brightness value, gain Gain and shutter speed Shutter using formula (3).

[0098] The calculated ambient brightness value Env is processed by mean or median filtering every minute to reduce noise and obtain smoother data. The mean value envLuma[i] calculated in each period is stored, where i is the serial number of the time period. Finally, N arrays envLuma[N] of ambient brightness data are recorded.

[0099] The filtered data is translated to facilitate analysis and further processing.

[0100] The environment fitting curve is obtained by using the data processed by Gaussian curve fitting to simulate the brightness change law of the environment. Please refer to the method of step S112 above, which will not be repeated here.

[0101] Based on the experimental data, two standard Gaussian fitting curves GausLow[N] and GausHig[N] are obtained. A grid search is performed to find the standard Gaussian curve that best matches the two standard Gaussian fitting curves, namely the matching fitting curve EnvGaus[N].

[0102] R-square is used to evaluate the similarity between the environment fitting curve and the matching fitting curve. For example, the R-square value of the environment fitting curve is calculated using the following formula (9): ,in, Indicates the average value of real-time collected data. Represents the mean value of the ambient brightness data calculated in each cycle in the ambient fitting curve. Represents the mean value of the ambient brightness data for each period in the matching fitting curve.

[0103] (9)

[0104] The preset threshold R is set to distinguish whether the data conforms to a specific brightness change rule, so as to indicate whether the display device is currently in an environment affected by natural light:

[0105] when When it is greater than or equal to R, it is considered that the currently collected ambient brightness data reflects the brightness variation law of the sun rising in the east and setting in the west. That is, the matching degree between the ambient fitting curve obtained based on the current ambient brightness data and the matching fitting curve is high, indicating that the current device is in an environment affected by natural light.

[0106] when When it is less than or equal to R, it is considered that the currently collected ambient brightness data does not conform to the brightness change law of the sun rising in the east and setting in the west, and may be collected in a purely indoor environment and is not or less affected by the natural light environment.

[0107] If it is determined based on step 6 that the display device is in an environment affected by natural light: compare the current environment brightness with the peak data of the environment fitting curve to determine the adjustment interval; determine the adjustment coefficient based on the adjustment interval to adjust the display characteristics of the display device to adapt to the current environment brightness law. The specific setting method and adjustment method are described in detail in the aforementioned step S110, which will not be repeated here.

[0108] If it is determined based on step 6 that the display device is not in an environment affected by natural light: simulate the white balance algorithm to determine the color temperature; confirm the color temperature coefficient to adjust the color temperature of the display device; determine the brightness coefficient according to the current ambient brightness, which is used to adjust the brightness level of the display device to ensure that a clear visual effect can be provided under different lighting conditions. The specific setting and adjustment method is described in detail in the aforementioned step S110, which will not be repeated here.

[0109] According to the adjustment coefficient and / or brightness coefficient determined in step 7 or 8 above, the blue light intensity of the screen is further adjusted to reduce the impact on the user's biorhythm.

[0110] It can also adjust the gamma value of the display device to optimize the contrast and brightness of the screen while maintaining image quality.

[0111] Adjusts the screen's refresh rate based on factors such as ambient brightness and / or user preference to provide a smooth viewing experience and reduce eyestrain.

[0112] See also Fig.11 , Fig.11 is a schematic diagram of an embodiment of a display characteristic adjustment device provided by the present application, comprising:

[0113] A data acquisition module, used to collect ambient brightness data of the environment in which the display device is located;

[0114] A data fitting module, used for fitting an environment fitting curve based on the environment brightness data;

[0115] A data comparison module is used to compare the environmental fitting curve with the experimental fitting curve in the database to determine whether the display device is in an environment affected by natural light;

[0116] The screen display linkage module is used to adjust the display characteristics of the display device based on the brightness change law of the environment and the current ambient brightness of the display device.

[0117] See also Fig.12 , Fig.12 It is a structural diagram of an embodiment of an electronic device provided in the present application. The electronic device 60 includes a memory 61 and a processor 62 connected to each other. The memory 61 is used to store a computer program. When the computer program is executed by the processor 62, it is used to implement the display method of the display device in the above embodiment.

[0118] The above-mentioned method is an embodiment, which can exist in the form of a computer program. Therefore, the present application proposes a computer-readable storage medium. Fig.13 , Fig.13 It is a structural diagram of an embodiment of a computer-readable storage medium provided in the present application. The computer-readable storage medium 80 is used to store a computer program 81, which can be executed to implement the display method of the display device in the above embodiment.

[0119] The computer-readable storage medium 80 may be a server, a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, etc., which may store program codes.

[0120] The above description is only an embodiment of the present application and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A display method of a display device, characterized in that: include: In response to determining based on a video captured by a camera device that the display device is in an environment affected by natural light; If the current ambient brightness is between the first preset value and the second preset value, calculating a linear adjustment coefficient; adjusting the display characteristics of the display device based on the linear adjustment coefficient and the current ambient brightness of the display device; The linear adjustment coefficient is negatively correlated with the current environment brightness, the first preset value and the second preset value are preset environment brightness values ​​in the brightness change law of the environment, and the first preset value is greater than the second preset value; the linear adjustment coefficient is a ratio of a first value and a second value, the first value is a difference between the current environment brightness and the first preset value, and the second value is a difference between the second preset value and the first preset value; displaying a picture based on the adjusted display characteristics; The camera device and the display device are located in the same environment.

2. The method according to claim 1, characterized in that The method further comprises: Acquiring environmental brightness data of the display device based on image frame information of a video of the environment captured by a camera device; Obtaining a brightness variation rule of the environment based on the environment brightness data; Based on the brightness variation rule, it is determined whether the display device is in an environment affected by natural light.

3. The method according to claim 2, characterized in that The obtaining the brightness change rule of the environment based on the environment brightness data includes: Constructing an environment fitting curve based on the environment brightness data within a preset period, wherein the environment fitting curve represents a brightness variation rule of the environment; The determining whether the display device is in an environment affected by natural light based on the brightness change rule includes: Based on the environment fitting curve, it is determined whether the display device is in an environment affected by natural light.

4. The method according to claim 3, characterized in that The determining, based on the environment fitting curve, whether the display device is in an environment affected by natural light includes: The environmental fitting curve is matched with the experimental fitting curve in the database for similarity, and the experimental fitting curve with the highest similarity is determined as the matching fitting curve; wherein the experimental fitting curve is established in advance based on experimental data or theoretical models to represent the brightness change law in an environment affected by natural light; Calculating the degree of fit between the environment fitting curve and the matching fitting curve; If the degree of fit is greater than a preset threshold, it is determined that the display device is in an environment affected by natural light; If the degree of fitting is less than the preset threshold, it is determined that the display device is not in an environment affected by natural light.

5. The method according to claim 2, characterized in that: The step of acquiring the ambient brightness data of the display device based on the image frame information of the video of the environment captured by the camera device includes: Based on the video captured by the camera device, acquiring image frame information; Based on the image frame information, the gain value and the shutter speed corresponding to when the camera device acquires the image frame, the ambient brightness data of the display device is determined.

6. The method according to claim 5, characterized in that The determining of the ambient brightness data of the display device based on the image frame information, the gain value and the shutter speed corresponding to when the camera device acquires the image frame includes: determining an average brightness of the image frame; The ambient brightness value of the display device is calculated based on the ratio of the average brightness to the acquisition information value, wherein the acquisition information value is the ratio of the logarithm of the gain value with base 2 to the shutter speed.

7. The method according to claim 1, characterized in that The display characteristics include color temperature, gamma value and / or refresh rate, and the adjusting the display characteristics of the display device based on the linear adjustment coefficient and the current ambient brightness of the display device includes: Adjusting the color temperature of the display device based on the linear adjustment coefficient and the current ambient brightness of the display device, wherein the linear adjustment coefficient and the color temperature are negatively correlated; and / or, adjusting the gamma value of the display device based on the linear adjustment coefficient and the current ambient brightness of the display device, wherein the linear adjustment coefficient and the gamma value are negatively correlated; and / or, The refresh frequency of the display device is adjusted based on the linear adjustment coefficient and the current ambient brightness of the display device, and the linear adjustment coefficient and the refresh frequency are positively correlated.

8. The method according to claim 7, characterized in that The step of adjusting the color temperature of the display device based on the linear adjustment coefficient and the current ambient brightness of the display device comprises: The product of the linear adjustment coefficient and the first coefficient is subtracted from the blue component of the display device to adjust the color temperature through the blue component; wherein the first coefficient is a parameter for balancing or adjusting the proportional relationship in the entire color adjustment process.

9. The method according to claim 7, characterized in that: The step of adjusting the gamma value of the display device based on the linear adjustment coefficient and the current ambient brightness of the display device comprises: Obtain a preset first gamma value and a second gamma value, and weight the first gamma value and the second gamma value to obtain a gamma value of the display device; wherein the weighting coefficient of the second gamma value is the ratio of the linear adjustment coefficient to the second coefficient, and the sum of the weighting coefficient of the first gamma value and the weighting coefficient of the second gamma value is 1; wherein the second coefficient is a parameter used to adjust the interpolation weight to affect the brightness or contrast level.

10. The method according to claim 7, characterized in that The step of adjusting the refresh frequency of the display device based on the linear adjustment coefficient and the current ambient brightness of the display device comprises: The product of the basic refresh frequency of the display device, the linear adjustment coefficient and the third coefficient is calculated to adjust the refresh frequency of the display device; wherein the third coefficient is a parameter for adjusting the variation range of the refresh frequency of the display device.

11. The method according to claim 1, characterized in that: The display characteristics include color temperature, gamma value and / or refresh rate, and the method further includes: If the display device is not under the influence of natural light environment, adjusting the color temperature of the display device based on the current display image of the display device and the white balance algorithm; The gamma value and / or refresh rate of the display device is adjusted based on the adjusted color temperature of the display device and the current ambient brightness.

12. The method according to claim 11, characterized in that The adjusting the color temperature of the display device based on the current display image of the display device and a white balance algorithm includes: Obtaining a preset fourth coefficient and a fifth coefficient, wherein the fourth coefficient and the fifth coefficient are used to adjust the blue light level according to the basic characteristics of the display device and the user's preference settings; Calculating a blue light level adjustment level of the display device, the blue light level adjustment level is the product of an added value and an ambient brightness proportional coefficient, the added value is the sum of the product value and the fifth coefficient, the product value is the product of a ratio of an average value of a blue component to an average value of a green component of a current display screen and the fourth coefficient; wherein the ambient brightness proportional coefficient is a parameter for adjusting the blue light output of the display device according to a change in ambient brightness; The color temperature of the display device is adjusted using the blue light level adjustment grade.

13. An electronic device, characterized in that: The electronic device includes a processor and a memory, wherein the processor is coupled to the memory, and the processor is configured to execute one or more steps of the display method of the display device according to any one of claims 1 to 12 based on instructions stored in the memory.

14. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and the computer program is executed by a processor to implement the steps of the display method of the display device according to any one of claims 1 to 12.

Images