Display method applied to display device, display device and electronic equipment
Patent Information
- Application Number
- CN202380008904.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-04-28
- Publication Date
- 2024-12-31
AI Technical Summary
The eye protection modes of existing electronic devices are difficult to make fine-grained and dynamic adjustments based on specific environments and device parameters, resulting in poor eye protection effects.
By determining the functional relationship between the target color temperature and the gain of the basic color components and the color temperature, the gray scale value of the displayed image is adjusted to optimize the display effect, and the eye protection mode of intelligent color temperature adjustment is realized by combining the ambient illumination and human eye comfort indicators.
It can dynamically adjust the display color temperature according to different environments and device parameters, reduce screen blue light, and improve the user's eye comfort and eye protection.
Smart Images

Figure CN119234263A_ABST
Abstract
Description
Display method applied to display device, display device and electronic device Technical Field
[0001] The present disclosure relates to the field of display technology, and in particular to a display method applied to a display device, a display device, and an electronic device. Background Art
[0002] With the prevalence of electronic devices such as mobile phones, tablets, and televisions, people spend more time using them during their daily work and leisure time, staring at screens for extended periods of time and straining their eyes. This prolonged staring can cause eye fatigue and even irreversible eye diseases.
[0003] In the related technology, some manufacturers have already provided eye protection mode functions for electronic devices, which generally focus on hardware adjustment technology, including adjusting the screen backlight brightness, using a matte screen with diffuse reflection and anti-glare, and reducing the harmful blue light band through wavelength mapping. Eye protection functions also include statistics on eye usage time and rest reminders, sitting posture detection and reminders. Eye protection modes based on hardware condition technology are easily constrained by hardware and cannot adapt to various environments to achieve more fine-grained and dynamic adjustment of eye protection modes. How to adapt the parameters of various electronic devices to provide targeted algorithm-based soft adjustment eye protection modes is one of the topics of concern to display product developers.
[0004] The above information disclosed in this section is only for understanding the background of the inventive concept of the present disclosure and therefore the above information may contain information that does not constitute prior art.
[0005] Summary of the Invention
[0006] In view of the above problems, the present disclosure provides a display method applied to a display device, a display device, and an electronic device.
[0007] In one aspect, a display method for a display device is provided, wherein the display device is capable of displaying according to image data of an image to be displayed, the image data including grayscale values corresponding to various basic color components in a color gamut of a display screen of the display device, wherein the method includes: determining a target color temperature; determining gains of the various basic color components of the display device based on a functional relationship between the gains of the various basic color components of the display device and the color temperature, wherein the gains of the various basic color components of the display device correspond to the target color temperature, and the functional relationship between the gains of the various basic color components of the display device and the color temperature is predetermined based on parameters of the display device; obtaining initial image data of the image to be displayed, wherein the initial image data includes initial grayscale values corresponding to the various basic color components; determining adjusted image data of the image to be displayed based on the determined gains of the various basic color components of the display device and the obtained initial image data of the image to be displayed, wherein the adjusted image data of the image to be displayed includes adjusted grayscale values corresponding to the various basic color components; and displaying the image to be displayed based on the adjusted image data of the image to be displayed.
[0008] According to an embodiment of the present disclosure, determining the target color temperature includes: obtaining the ambient illuminance of the environment in which the display screen is located; and determining the target color temperature corresponding to the ambient illuminance based on a mapping relationship between the ambient illuminance and the color temperature, wherein the mapping relationship between the ambient illuminance and the color temperature is predetermined based on a human eye comfort index.
[0009] According to an embodiment of the present disclosure, predetermining the functional relationship between the gains and color temperature of various basic color components of the display device based on the parameters of the display device includes: determining the color gamut of the display screen of the display device; determining a conversion matrix based on the determined color gamut of the display screen, wherein the conversion matrix is used to realize the conversion of colors between the color gamut space of the display screen and the standard color space; and determining the functional relationship between the gains and color temperature of various basic color components of the display device based on the conversion matrix.
[0010] According to an embodiment of the present disclosure, the functional relationship between the gains of various basic color components of the display device and the color temperature is determined based on the conversion matrix, specifically including: obtaining a mapping table between color temperature and color coordinates in a standard color space; determining the color coordinates of white points at multiple color temperatures in the color gamut space of the display screen based on the mapping table between color temperature and color coordinates in the standard color space and the conversion matrix; determining the gains of various basic color components at each color temperature based on the color coordinates of the white points at the determined multiple color temperatures in the color gamut space of the display screen and preset parameters; and fitting the functional relationship between the gains of various basic color components of the display device and the color temperature based on the gains of various basic color components at each color temperature.
[0011] According to an embodiment of the present disclosure, the functional relationship between the gains of various basic color components of the display device and the color temperature is a cubic power function relationship.
[0012] According to an embodiment of the present disclosure, predetermining the mapping relationship between the ambient illuminance and the color temperature based on the human eye comfort index includes: setting multiple ambient illuminances; determining multiple images to be observed and multiple observers; for each set ambient illuminance, determining the color temperature range of the human eye comfort zone according to the Kruthoff curve; traversing the determined color temperature range with a preset step size to determine multiple color temperatures to be observed; controlling the display device to display the multiple images to be observed at the multiple color temperatures to be observed; obtaining multi-dimensional scores for the multiple images to be observed respectively displayed by the multiple observers; determining a comprehensive score according to the multi-dimensional score; and determining the color temperature to be observed with the highest comprehensive score as the color temperature corresponding to the ambient illuminance.
[0013] According to an embodiment of the present disclosure, the various basic color components include a red component, a green component, and a blue component, and the functional relationship between the gain of the various basic color components of the display device and the color temperature includes: a first functional relationship between the gain of the red component and the color temperature; a second functional relationship between the gain of the green component and the color temperature; and a third functional relationship between the gain of the blue component and the color temperature.
[0014] According to an embodiment of the present disclosure, the gains of various basic color components of the display device are determined based on the functional relationship between the gains of various basic color components of the display device and the color temperature, specifically including: determining a first gain of the red component of the display device based on a first functional relationship between the gain of the red component of the display device and the color temperature; determining a second gain of the green component of the display device based on a second functional relationship between the gain of the green component of the display device and the color temperature; and determining a third gain of the blue component of the display device based on a third functional relationship between the gain of the blue component of the display device and the color temperature.
[0015] According to an embodiment of the present disclosure, the initial image data includes a first initial grayscale value corresponding to a red component, a second initial grayscale value corresponding to a green component, and a third initial grayscale value corresponding to a blue component; based on the determined gains of the various basic color components of the display device and the acquired initial image data of the image to be displayed, the adjusted image data of the image to be displayed is determined, specifically including: multiplying the first initial grayscale value by the first gain to obtain a first adjusted grayscale value of the adjusted image data; multiplying the second initial grayscale value by the second gain to obtain a second adjusted grayscale value of the adjusted image data; and multiplying the third initial grayscale value by the third gain to obtain a third adjusted grayscale value of the adjusted image data.
[0016] According to an embodiment of the present disclosure, determining the color gamut of the display screen of the display device includes: respectively measuring the color coordinates of the display screen when displaying a pure red image, a pure green image, a pure blue image, and a pure white image; and determining the color gamut of the display screen based on the color coordinates of the display screen when displaying a pure red image, a pure green image, a pure blue image, and a pure white image.
[0017] According to an embodiment of the present disclosure, the multi-dimensional scoring includes a first dimension scoring, a second dimension scoring, and a third dimension scoring. The first dimension is the comfort of the observer when observing the displayed image, the second dimension is the brightness of the displayed image felt by the observer when observing the displayed image, and the third dimension is the tension of the observer when observing the displayed image. Determining the comprehensive score based on the multi-dimensional scoring includes: using a weighted summation method to calculate the first dimension scoring, the second dimension scoring, and the third dimension scoring to determine the comprehensive score.
[0018] According to an embodiment of the present disclosure, the plurality of images to be observed include natural scene images, close-up images of people, and pure color images.
[0019] According to an embodiment of the present disclosure, the preset parameter is 255.
[0020] In another aspect, a display device is provided, which can display according to image data of an image to be displayed, wherein the image data includes grayscale values corresponding to various basic color components in the color gamut of the display screen of the display device, wherein the display device includes: a target color temperature determination module, which is used to determine the target color temperature; and a gain determination module, which is used to determine the gains of the various basic color components of the display device according to the functional relationship between the gains of the various basic color components of the display device and the color temperature, wherein the gains of the various basic color components of the display device correspond to the target color temperature, and the functional relationship between the gains of the various basic color components of the display device and the color temperature is The relationship is predetermined according to the parameters of the display device; an initial image data acquisition module is used to acquire the initial image data of the image to be displayed, wherein the initial image data includes initial grayscale values corresponding to various basic color components; an adjusted image data determination module is used to: determine the adjusted image data of the image to be displayed based on the determined gains of the various basic color components of the display device and the acquired initial image data of the image to be displayed, wherein the adjusted image data of the image to be displayed includes adjusted grayscale values corresponding to various basic color components; and an image display module is used to display the image to be displayed based on the adjusted image data of the image to be displayed.
[0021] In another aspect, an electronic device is provided, comprising: a display screen; and a controller, wherein the controller is configured to: control the display screen to display an image to be displayed using any of the display methods described above.
[0022] According to an embodiment of the present disclosure, the electronic device further includes a sensor, which is used to obtain the ambient illumination of the environment in which the display screen is located, and the sensor is communicatively connected to the controller. BRIEF DESCRIPTION OF THE DRAWINGS
[0023] Other objects and advantages of the present disclosure will become apparent from the following description of the present disclosure with reference to the accompanying drawings, which will help to provide a comprehensive understanding of the present disclosure.
[0024] FIG1 is a schematic diagram of a chromaticity diagram;
[0025] FIG2 is a schematic diagram showing the three primary colors and white point of each color gamut using the CIE-1931 xy chromaticity diagram coordinates;
[0026] FIG3 is a schematic structural diagram of a display panel according to some exemplary embodiments of the present disclosure;
[0027] FIG4 is a flowchart of a display method applied to a display device according to some exemplary embodiments of the present disclosure;
[0028] FIG5 is a flow chart of a predetermined functional relationship according to some exemplary embodiments of the present disclosure;
[0029] FIG6 is a flow chart of a predetermined functional relationship according to other exemplary embodiments of the present disclosure;
[0030] 7 is a flowchart of determining gains of various basic color components of a display device according to some exemplary embodiments of the present disclosure;
[0031] FIG8 is a flow chart of determining various adjustment grayscale values according to some exemplary embodiments of the present disclosure;
[0032] FIG9 is a flow chart of determining a target color temperature according to some exemplary embodiments of the present disclosure;
[0033] FIG10 is a flow chart of predetermining a mapping relationship between ambient illumination and color temperature according to some exemplary embodiments of the present disclosure;
[0034] FIG11 is a schematic diagram of a plurality of observers determined according to some exemplary embodiments of the present disclosure;
[0035] FIG12 is a diagram of a comfort zone of a Kruithof curve according to some exemplary embodiments of the present disclosure;
[0036] FIG13 is a schematic diagram of a color temperature range determined according to some exemplary embodiments of the present disclosure;
[0037] FIG14 is a diagram of an observation scene according to some exemplary embodiments of the present disclosure;
[0038] FIG15 is a schematic diagram of a human eye comfort curve according to some exemplary embodiments of the present disclosure;
[0039] FIG16 is a flowchart of a display method applied to a display device according to other exemplary embodiments of the present disclosure;
[0040] FIG17 is a schematic diagram of display effects according to some other exemplary embodiments of the present disclosure;
[0041] FIG18 schematically shows a structural block diagram of a display device according to an embodiment of the present disclosure; and
[0042] FIG19 schematically shows a block diagram of an electronic device suitable for implementing the display method according to an embodiment of the present disclosure.
[0043] It should be noted that, for the sake of clarity, in the drawings used to describe the embodiments of the present disclosure, the sizes of layers, structures or regions may be enlarged or reduced, that is, these drawings are not drawn according to the actual scale. DETAILED DESCRIPTION
[0044] In the following description, for the purpose of explanation, many specific details are set forth to provide a comprehensive understanding of the various exemplary embodiments. However, it is apparent that the various exemplary embodiments can be implemented without these specific details or with one or more equivalent arrangements. In other cases, well-known structures and devices are shown in block diagram form to avoid unnecessarily obscuring the various exemplary embodiments. In addition, the various exemplary embodiments can be different, but not necessarily exclusive. For example, the specific shape, configuration, and characteristics of the exemplary embodiment can be used or implemented in another exemplary embodiment without departing from the inventive concept.
[0045] In the accompanying drawings, the sizes and relative sizes of the elements may be exaggerated for clarity and / or descriptive purposes. Thus, the sizes and relative sizes of the individual elements are not necessarily limited to those shown in the drawings. When the exemplary embodiments can be implemented differently, the specific process sequence can be performed differently from the described sequence. For example, two processes described in succession can be performed substantially simultaneously or in an order opposite to the described sequence. In addition, the same reference numerals represent the same elements.
[0046] When an element is described as being "on" another element, "connected to" another element, or "coupled to" another element, the element may be directly on the other element, directly connected to the other element, or directly coupled to the other element, or there may be an intermediate element. However, when an element is described as being "directly on" another element, "directly connected to" another element, or "directly coupled to" another element, there is no intermediate element. Other terms and / or expressions used to describe the relationship between elements should be interpreted in a similar manner, for example, "between..." versus "directly between...", "adjacent" versus "directly adjacent," or "on..." versus "directly on...", etc. In addition, the term "connected" may refer to a physical connection, an electrical connection, a communication connection, and / or a fluid connection. In addition, the X-axis, Y-axis, and Z-axis are not limited to the three axes of a rectangular coordinate system, and may be interpreted in a broader sense. For example, the X-axis, Y-axis, and Z-axis may be perpendicular to each other, or may represent different directions that are not perpendicular to each other. For the purposes of this disclosure, “at least one of X, Y, and Z” and “at least one selected from the group consisting of X, Y, and Z” may be interpreted as only X, only Y, only Z, or any combination of two or more of X, Y, and Z, such as XYZ, XY, YZ, and ZZ. As used herein, the term “and / or” includes any and all combinations of one or more of the associated listed items.
[0047] It should be understood that although the terms first, second, etc. may be used herein to describe different elements, these elements should not be limited by these terms. These terms are merely used to distinguish one element from another. For example, a first element may be named a second element, and similarly, a second element may be named a first element without departing from the scope of the exemplary embodiments.
[0048] To facilitate the description of the technical solutions of the present disclosure, the following first introduces the terms involved in some embodiments of the present disclosure.
[0049] (1) Color temperature
[0050] The light we typically see is composed of a spectrum of seven colors, comprising the three primary colors of light (red, green, and blue, RGB). Color temperature is specifically used to measure the color components of light. As a blackbody continues to heat, the maximum value of its relative spectral power distribution shifts toward shorter wavelengths.
[0051] For example, the color of a light source can be represented by the different colors of light emitted by a black body when heated to different temperatures. Assuming a pure black object can absorb all the heat that falls on it without loss, while also releasing all the energy generated by the heat as "light," it will change color depending on the level of heat it is exposed to. For example, when the heat a black body is exposed to is equivalent to 500-550°C, it will turn dark red, and at 1050-1150°C, it will turn yellow... Therefore, the color component of a light source corresponds to the thermal temperature of the black body. For example, the temperature of a black body at a certain temperature when the color of a light source is exactly the same as the color of a black body is usually called the color temperature of the light source, and its unit is Kelvin (K).
[0052] Figure 1 is a schematic diagram of a chromaticity diagram (based on the chromaticity diagram developed by the International Commission on Luminous Illumination (CIE)). As shown in Figure 1, as temperature increases, the blackbody color shifts on the chromaticity diagram, forming a curved trajectory. This trajectory starts in the red area in the lower right corner, passes through the yellow area, the white area in the center, and reaches the blue area on the left. This curved trajectory is called the Planckian locus or blackbody locus.
[0053] For example, the light emitted by the sun closely resembles a blackbody spectrum. The surface temperature of our sun is approximately 5500K, and the light emitted by a blackbody at this temperature is essentially white. Among the several standard white points defined by the CIE committee, D50, D55, and D65 are commonly used. These are defined based on blackbody radiation at 5000K, 5500K, and 6500K, respectively, simulating lighting under different conditions (such as horizon light, outdoor lighting in the morning and afternoon, and outdoor lighting at noon). The sRGB color space relies on the D65 white point. A D50 illuminant (5000K color temperature) produces a slightly warmer hue. According to ISO 3664:2000, D50 is the true standard color temperature for observing color. A D65 illuminant (6500K color temperature) produces a slightly cooler hue. While D50 is gradually being replaced in Europe and the United States, D65 remains a widely used standard color temperature in China.
[0054] Different color temperatures give people different environmental feelings. According to the color temperature, light sources can be divided into warm light, neutral light and cool light.
[0055] Warm light: Below 3300K, warm light is similar to incandescent light. Around 2000K, it resembles candlelight, with a higher red component. This creates a sense of warmth, well-being, comfort, and sleepiness. Suitable for homes, residences, dormitories, hotels, and other places with lower temperatures. It's best to adjust the light source to warmer colors before bedtime; lower color temperatures are less likely to suppress melatonin production.
[0056] Neutral light: Also known as cool white, its color temperature ranges from 3300K to 5300K. Neutral light is soft and creates a pleasant, comfortable, and peaceful feeling. It is suitable for places such as shops, hospitals, offices, hotels, restaurants, and waiting rooms.
[0057] Cool light, also known as daylight, has a color temperature above 5000K. The light source is close to natural light, creating a bright feeling that helps people focus and prevents them from falling asleep. It is suitable for offices, conference rooms, classrooms, drawing rooms, design studios, library reading rooms, and exhibition windows.
[0058] (2) Screen color gamut
[0059] Different screens have varying color gamuts. Color gamut refers to the total range of colors a color system can produce. In a narrower sense, color gamut refers specifically to the technical capabilities of a color display system (such as a monitor or printer). An actual system supports a subspace of the CIE chromaticity diagram, typically defined by the xy values of three primary colors. These three primary colors form a triangle, defining the maximum range of colors a color system can produce.
[0060] Figure 2 shows the three primary colors and white point of each color gamut using the CIE-1931 xy chromaticity diagram coordinates. A typical color gamut representation is shown in Figure 2, which displays the defined values of three common color gamuts, with RGB representing the three primary colors and W representing the white point. The BT.709 color gamut corresponds to the sRGB color space commonly used in computers, the BT.2020 color gamut is the standard color gamut for ultra-high-definition video production, and the DCI-P3 color gamut is commonly used in film.
[0061] In particular, it should be noted that the embodiments of the present disclosure do not limit the color gamut to only the BT.709 color gamut, the BT.2020 color gamut, and the DCI-P3 color gamut.
[0062] (3) Ambient illumination
[0063] Ambient illumination refers to the brightness of ambient light. Its unit of measurement is "lux", abbreviated as "lux", and the unit symbol is "lx or lux", which represents the luminous flux received per unit area on the surface of the subject.
[0064] (4) Kruthoff curve
[0065] The Kruithof curve, also known as the Kruithof curve, lays the foundation for color vision theory and provides a reference for selecting lighting sources under natural conditions. It describes a range of illuminance levels and color temperatures that are generally considered pleasant or pleasing to observers. The curve was constructed from psychophysical data collected by Dutch physicist Arie Andries Kruithof, although the original experimental data do not appear on the curve. Lighting conditions within the bounded region are empirically evaluated as pleasing or natural, while conditions outside the region are considered uncomfortable, unpleasant, or unnatural. The Kruithof curve is an adequate model for describing sources of pleasing light that are perceived as natural or closely resemble a black body.
[0066] FIG. 3 is a schematic structural diagram of a display panel according to some exemplary embodiments of the present disclosure.
[0067] As shown in FIG3 , the display panel 1 includes a plurality of pixel units PX arranged in an array (as shown in the dotted box in FIG3 ). For example, each pixel unit PX may include a plurality of sub-pixel units, such as the red sub-pixel unit 11, the green sub-pixel unit 12, the blue sub-pixel unit 13, etc. shown in FIG3 , thereby enabling color display. For example, each sub-pixel unit includes a pixel driving circuit and a light-emitting diode (LED), and the pixel driving circuit drives the light-emitting diode to emit light according to the received grayscale voltage signal. For example, the light-emitting diode includes but is not limited to an organic light-emitting diode (OLED), a quantum dot light-emitting diode (QLED), and an inorganic light-emitting diode.
[0068] For example, a frame of an image to be displayed includes multiple pixels, each of which is displayed by a plurality of pixel units PX on the display panel 1. The image data of the image to be displayed includes image data for each pixel, and the image data for each pixel includes a grayscale value corresponding to each of a plurality of basic color components, such as the grayscale value of the red component, the grayscale value of the green component, and the grayscale value of the blue component. Thus, each pixel unit PX on the display panel 1 can display the image data of each pixel of the frame of the image to be displayed, thereby displaying the frame of the image to be displayed on the display panel 1. For example, specifically, the red sub-pixel unit 11 in each pixel unit is displayed according to the grayscale value of the red component in the corresponding image pixel (the luminous brightness is positively correlated with the grayscale value), the green sub-pixel unit 12 in each pixel unit is displayed according to the grayscale value of the green component in the corresponding image pixel (the luminous brightness is positively correlated with the grayscale value), and the blue sub-pixel unit 13 in each pixel unit is displayed according to the grayscale value of the blue component in the corresponding image pixel (the luminous brightness is positively correlated with the grayscale value). As a result, the different colors of light emitted by multiple sub-pixel units in each pixel unit are mixed with each other to produce the required color, so that each pixel unit can display the corresponding image pixel.
[0069] When the display panel 1 is displaying, the red sub-pixel unit 11 can emit red light (R), the green sub-pixel unit 12 can emit green light, and the blue sub-pixel unit 13 can emit blue light (G). Generally speaking, blue light (G) has the shortest spectrum and the strongest penetrating power, and is essential for obtaining clear and bright images. However, because the light emitted by the display panel 1 contains a large amount of blue light, users who look at the screen of smart electronic devices for a long time may suffer significant damage to their eyes.
[0070] In some embodiments, the display panel 1 can be applied to a display device. A display device is a device capable of displaying information such as text, images, or video. For example, the display device may include the display panel 1, an interface circuit, a timing controller TCON, and a data driver integrated circuit. Examples of display devices include liquid crystal displays (LCDs), organic light-emitting diode displays (OLEDs), and plasma displays.
[0071] The display device can be applied to electronic devices, for example. The electronic device according to an embodiment of the present disclosure may be a device including a display function, that is, a device including the above-mentioned display device. For example, the electronic device may be a smart phone, a mobile phone, a video phone, an e-book reader, a desktop computer (PC), a laptop PC, a netbook PC, a personal digital assistant (PDA), a portable multimedia player (PMP), a medical device, a camera, a wearable device (such as a head-mounted device, an electronic clothing, an electronic bracelet, an electronic necklace, an electronic accessory, an electronic tattoo, or a smart watch), etc. The electronic device according to some embodiments may be any combination of the aforementioned devices. In addition, the electronic device according to various embodiments may be a flexible device. In addition, it should be clear to those skilled in the art that the electronic device according to the various embodiments of the present disclosure is not limited to the above-mentioned devices.
[0072] Various electronic devices available on the market have a variety of eye protection modes. For example, the eye protection mode implemented based on hardware adjustment technology includes anti-blue light glasses, anti-blue light films and frosted screens, which reduce the user experience and increase consumer spending. Some software-adjusted eye protection modes can provide different colors and brightness, such as eye protection green, night mode or day mode. The eye protection modes provided in the relevant technologies are relatively fixed. For example, the corresponding hardware is pre-installed on the electronic device, or a fixed software-adjusted eye protection mode is provided. The user may manually set the color temperature of the current color, which makes it difficult to achieve the ideal effect. The operation is inconvenient, and the eye protection effect cannot be achieved in real time according to the parameters of the specific electronic device (such as the parameters of the display device), nor can a more fine-grained and dynamic eye protection adjustment be performed in combination with the parameters of the specific electronic device and the current environmental conditions.
[0073] In view of the above problems, embodiments of the present disclosure provide a display method, a display device, and an electronic device applied to a display device, which are described in detail below with reference to FIG. 4 to FIG. 17 .
[0074] FIG. 4 is a flowchart of a display method applied to a display device according to some exemplary embodiments of the present disclosure.
[0075] As shown in Figure 4, the display method applied to the display device of this embodiment may include operations S410 to S450. The display device can display according to image data of an image to be displayed, and the image data includes grayscale values corresponding to various basic color components in the color gamut of the display screen of the display device.
[0076] In operation S410 , a target color temperature is determined;
[0077] Exemplarily, the target color temperature may be determined according to at least one of user input information, information within the display device, and information outside the display device.
[0078] For example, user input information includes target color temperature settings entered by the user through peripherals, voice, gestures, body posture, and eye movements. Information within the display device can include image data for the image to be displayed, such as different image content with adapted target color temperature values. It can also include real-time performance information such as the current device's battery level, RAM, or internal memory. External information includes information such as ambient illumination or user type. For example, different ambient illumination levels, or users of different age groups, genders, or occupations, may have different preferences for target color temperature.
[0079] For example, in actual applications, a user may select a target color temperature by touching a graphic control on the display device.
[0080] For example, illumination levels may vary in candlelight, tungsten lamps, incandescent lamps, or outdoor environments in the morning or afternoon, or in different weather conditions. This allows the display device to automatically determine the corresponding target color temperature regardless of ambient illumination, improving eye protection and comfort for users while using their phones.
[0081] For example, under different ambient illumination conditions and combined with current real-time performance information, the target color temperature value that needs to be displayed can be determined, so that while maintaining the user's comfort when using the mobile phone, the amount of calculation can be reduced, thereby achieving the effect of reducing power consumption when the automatic color temperature adjustment function is turned on.
[0082] For example, the target color temperature can be determined periodically, for example, every second (for example only). The target color temperature can also be determined dynamically in response to changes in at least one of user input, information within the display device, and information outside the display device, allowing for real-time display of an optimal color temperature and improved eye protection.
[0083] At operation S420, gains of the various basic color components of the display device are determined based on a functional relationship between the gains of the various basic color components of the display device and the color temperature, wherein the gains of the various basic color components of the display device correspond to the target color temperature, and the functional relationship between the gains of the various basic color components of the display device and the color temperature is predetermined based on parameters of the display device;
[0084] For example, the gain value is an adjustment parameter of various basic color components of the display device. It can be determined that various basic color components have the same or different gain values.
[0085] For example, in some examples, the multiple basic color components include three basic color components, such as a red component (red, R), a green component (green, G), and a blue component (blue, B). The embodiments of the present disclosure include but are not limited to this. It should be noted that although the embodiments of the present disclosure are described using the three basic color components of red, green, and blue as examples, this should not be considered a limitation of the present disclosure.
[0086] Exemplarily, the display device parameters include display-related parameters, such as various display screen attributes, such as color gamut, resolution, refresh rate, contrast, and display panel model. The display screen includes a display panel as shown in FIG1 . Because different display devices have different parameters, such as mobile phones, tablets, desktop computers, or other electronic devices of different models or brands, predetermining the functional relationship between the gain and color temperature of various basic color components of each display device based on the parameters of the display device can provide more targeted eye protection.
[0087] In operation S430, initial image data of an image to be displayed is acquired, wherein the initial image data includes initial grayscale values corresponding to various basic color components;
[0088] In operation S440, based on the determined gains of the various basic color components of the display device and the acquired initial image data of the image to be displayed, the adjusted image data of the image to be displayed is determined, wherein the adjusted image data of the image to be displayed includes adjusted grayscale values corresponding to the various basic color components;
[0089] For example, the gain values corresponding to the red, green, and blue colors of some or all of the pixels in the initial image data may be determined, and then the color temperature may be adjusted according to the corresponding gain values.
[0090] In operation S450, the image to be displayed is displayed based on the adjusted image data of the image to be displayed.
[0091] In some embodiments, it can be determined that part or all of the display area of the display screen displays the target color temperature value, and the image data in part or all of the display area is adjusted accordingly. For example, if the entire display area of the display screen is the target adjustment area, the adjusted image data of all pixels of the image to be displayed is obtained. For example, in one-handed mode, the area on the lower half is displayed, and the adjusted image data of the pixels in the lower half area can be determined based on the display content of the image to be displayed. Of course, the entire image content can also be displayed in the lower half area. In other embodiments, it can be determined that part or all of the area on the image to be displayed displays the target color temperature value, and the image data in part or all of the display area on the image is adjusted accordingly.
[0092] According to the embodiments of the present disclosure, after determining the target color temperature, the gains of the various basic color components of the display device can be determined based on the functional relationship between the gains of the various basic color components of the display device and the color temperature. Because the functional relationship is predetermined based on the parameters of the display device, it is possible to implement an eye protection mode that intelligently adjusts the color temperature for various screen terminals, effectively reducing screen blue light and achieving soft adjustment of the screen. For example, in bright environments, the device color temperature is higher and the brightness is greater, while in dim environments, it is not glaring, thus achieving an eye protection effect.
[0093] FIG5 is a flow chart of a predetermined functional relationship according to some exemplary embodiments of the present disclosure.
[0094] As shown in FIG. 5 , in this embodiment, predetermining the functional relationship between the gains of various basic color components of the display device and the color temperature according to the parameters of the display device may include operations S510 to S530 .
[0095] In operation S510, a color gamut of a display screen of a display device is determined;
[0096] In some embodiments, determining the color gamut of a display screen of a display device includes: respectively measuring the color coordinates of the display screen when displaying a pure red image, a pure green image, a pure blue image, and a pure white image; and determining the color gamut of the display screen based on the color coordinates of the display screen when displaying a pure red image, a pure green image, a pure blue image, and a pure white image.
[0097] For example, the color gamut of a screen can be determined by measuring the color coordinates of the screen when displaying pure red (255, 0, 0), pure green (0, 255, 0), pure blue (0, 0, 255), and pure white (255, 255, 255). This allows us to determine the specific color gamut of different screen terminals.
[0098] In operation S520, a conversion matrix is determined according to the determined color gamut of the display screen, wherein the conversion matrix is used to implement color conversion between the color gamut space of the display screen and the standard color space;
[0099] In operation S530, a functional relationship between gains and color temperatures of various basic color components of the display device is determined according to the conversion matrix.
[0100] Referring to Figure 2, after determining the color gamut of the display screen, the (x, y, z) coordinates of the three primary colors (e.g., red, green, and blue) and the white point can be obtained. The sum of x, y, and z equals 1. When an arbitrary color is represented by a linear (r, g, b) value, the r, g, and b values determine the proportional relationship between the three primary colors. At this time, the color conversion between the RGB space (i.e., the color gamut space) and the XYZ space (i.e., the standard color space) can be achieved using matrix transformation, as shown in Equation (1):
[0101] in, It is the color coordinates of the three primary colors of the color gamut defined by different standards. Its values are shown in Figure 2, but are not limited to Figure 2.
[0102] Among them, the left side of formula (1) can be The tristimulus values for the D65 white point are examples only. X, Y, and Z are parameters representing the following: X: The amount of light perceived as red (the stimulus value perceived by humans); Y: The amount of light perceived as green (the stimulus value perceived by humans); Z: The amount of light perceived as blue (the stimulus value perceived by humans). Here, x = X / (X+Y+Z), y = Y / (X+Y+Z), and z = z / (X+Y+Z).
[0103] Referring to Figure 1, the conversion matrix M is obtained as shown in formula (3):
[0104] Referring to formula (1), It is the normalized representation of RGB space.
[0105] For example, in some examples, the grayscale signal of each basic color component may be an 8-bit digital signal. In this case, the grayscale value of each basic color component has a value range of [0, 255] in the RGB space, and a value range of (r, g, b) has a value range of [0, 1]. Where r = (R / 255)^gammaR, g = (G / 255)^gammaG, and b = (B / 255)^gammaB.
[0106] For example, in some other examples, the grayscale signal of each basic color component can be a 12-bit (i.e., 12-bit) digital signal. In this case, the grayscale value of each basic color component has a value range of [0, 4095] in the RGB space, and the (r, g, b) value range is [0, 1]. It should be understood that the embodiments of the present disclosure do not limit the number of bits of the grayscale signal of each basic color component. Wherein, r = (R / 4095)^gammaR, g = (G / 4095)^gammaG, b = (B / 4095)^gammaB. Wherein, gammaR, gammaG, and gammaB are the gamma values of each of the three channels, which are used to convert nonlinear RGB into linear RGB.
[0107] For example, since the color gamuts of different display screens may be different, each will have a specific conversion matrix M as shown in formula (3). Combining formulas (1) to (3), the functional relationship between the gain and color temperature of various basic color components of the display device can be determined, which is further described below with reference to Figure 6.
[0108] According to an embodiment of the present disclosure, based on the above method, the color gamut is measured for each display screen, and a conversion matrix between the XYZ color space and the RGB color space is obtained, thereby improving the adaptability of the functional relationship to the display screen and enhancing the accuracy of the adjusted image data of the image to be displayed, and displaying that the adjusted image to be displayed has a better eye protection effect.
[0109] FIG6 is a flow chart of a predetermined functional relationship according to other exemplary embodiments of the present disclosure.
[0110] As shown in FIG. 6 , in operation S530 , determining the functional relationship between the gains of various basic color components of the display device and the color temperature according to the conversion matrix may include operations S610 to S640 .
[0111] In operation S610, a mapping table between color temperature and color coordinates in a standard color space is obtained;
[0112] For example, a mapping table may include xyz coordinates corresponding to color temperatures given by CIE, such as CIE 1931, CIE 1976, or CIE 1964. By looking up the table, the color coordinates corresponding to each color temperature on the blackbody locus can be determined. Table 1 shows the color coordinate values of some color temperatures at 2 degrees in CIE 1964.
[0113] Table 1
[0114] In operation S620, color coordinates of white points at multiple color temperatures in the color gamut space of the display screen are determined according to a mapping table between color temperatures and color coordinates in a standard color space and a conversion matrix;
[0115] The color coordinates corresponding to the color temperature in the mapping table are traversed, and the (r, g, b) values of the white point at different color temperatures on the screen are converted using the following formula (4).
[0116] In operation S630, based on the color coordinates of the white point at the multiple color temperatures determined in the color gamut space of the display screen and preset parameters, the gains of the various basic color components at the various color temperatures are determined;
[0117] In some embodiments, the default parameter is 255.
[0118] The (r, g, b) values of the white point are divided by 255 to obtain the gain of the (r, g, b) values. The gain calculation is shown in formula (5):
[0119] In operation S640 , a functional relationship between the gains of the various basic color components of the display device and the color temperature is obtained by fitting according to the gains of the various basic color components at the various color temperatures.
[0120] In some embodiments, the functional relationship between the gain of the various basic color components of the display device and the color temperature is a cubic power functional relationship. As shown in the following equations (6), (7), and (8), in some embodiments, the functional relationship between the gain of the various basic color components of the display device and the color temperature includes: a first functional relationship between the gain f(T) of the red component and the color temperature T; a second functional relationship between the gain g(T) of the green component and the color temperature T; and a third functional relationship between the gain h(T) of the blue component and the color temperature T. f(T) = A1*T 3 +B1*T 2 +C1*T (6) g(T)=A2*T 3 +B2*T 2 +C2*T+D2 (7) h(T)=A3*T 3 +B3*T 2 +C3*T+D3 (8)
[0121] Among them, A1, A2, A3, B1, B2, B3, C1, C2, C3, D1, D2, and D3 are fitted constant coefficients, and each has a value between 0 and 100, for example.
[0122] An example is as follows: f(T) = 0.1*T 3 +0.256*T2 +3*T+25 g(T)=2*T 3 +0.56*T 2 +0.7*T+12 h(T)=1.3*T 3 +0.5*T 2 +0.78*T+0.58
[0123] In particular, it should be noted that the above are only examples, and the various constant coefficients are affected by the color gamut, conversion matrix, and mapping table color coordinates of the specific display screen. The present disclosure is not limited to the values of the above constant coefficients.
[0124] In other embodiments, the functional relationship between the gains of various basic color components of the display device and the color temperature may be a linear power function relationship, a quadratic power function relationship, or a power function relationship of more than one order.
[0125] In other embodiments, the functional relationship between the gains of various basic color components of the display device and the color temperature may also be obtained using exponential fitting, Gaussian fitting, or logarithmic fitting.
[0126] According to the embodiments of the present disclosure, it is convenient to obtain the functional relationship between the gain and color temperature of various basic color components of the display device according to the fitting method, and it has good accuracy, and can be combined with the conversion matrix to obtain the functional relationship unique to various screens.
[0127] FIG. 7 is a flowchart of determining gains of various basic color components of a display device according to some exemplary embodiments of the present disclosure.
[0128] As shown in FIG. 7 , in operation S420 , determining the gains of the various basic color components of the display device according to the functional relationship between the gains of the various basic color components of the display device and the color temperature may include operations S710 to S730 .
[0129] In operation S710, a first gain of a red component of a display device is determined according to a first functional relationship between the gain of the red component of the display device and the color temperature;
[0130] In operation S720, a second gain of a green component of the display device is determined according to a second functional relationship between the gain of the green component of the display device and the color temperature;
[0131] In operation S730, a third gain of the blue component of the display device is determined according to a third functional relationship between the gain of the blue component and the color temperature of the display device.
[0132] Referring to equations (6), (7), and (8), the target color temperature value determined in operation S410 is input into equation (6) to obtain the first gain Input the target color temperature value into equation (7) to obtain the second gain Input the target color temperature value into equation (8) to obtain the third gain
[0133] According to the embodiments of the present disclosure, the gains of the red component, the green component, and the blue component are determined separately, which facilitates adaptive adjustment for each basic color cost, has higher flexibility and accuracy, and further improves the eye protection effect.
[0134] FIG. 8 is a flowchart of determining various adjustment grayscale values according to some exemplary embodiments of the present disclosure.
[0135] As shown in FIG8 , in operation S440, based on the determined gains of the various basic color components of the display device and the acquired initial image data of the image to be displayed, determining the adjusted image data of the image to be displayed may include operations S810 to S830. The initial image data includes a first initial grayscale value corresponding to the red component, a second initial grayscale value corresponding to the green component, and a third initial grayscale value corresponding to the blue component.
[0136] In operation S810, a first initial grayscale value and a first gain are multiplied to obtain a first adjusted grayscale value of the adjusted image data;
[0137] In operation S820, the second initial grayscale value and the second gain are multiplied to obtain a second adjusted grayscale value of the adjusted image data;
[0138] In operation S830, the third initial grayscale value and the third gain are multiplied to obtain a third adjusted grayscale value of the adjusted image data.
[0139] In some embodiments, as shown in formula (9):
[0140] R1, G1 and B1 are respectively the first initial grayscale value, the second initial grayscale value and the third initial grayscale value, R2, G2 and B2 are respectively the first adjusted grayscale value, the second adjusted grayscale value and the third adjusted grayscale value.
[0141] In other embodiments, since the gain is the result of dividing the (r, g, b) values by 255, to avoid overflow of the value range, r1, g1, and b1 can be first obtained based on R1, G1, and B1, and then multiplied by the respective gains to obtain r2, g2, and b2. Finally, r2, g2, and b2 are converted to R2, G2, and B2.
[0142] According to the embodiments of the present disclosure, each pixel in the RGB format image data corresponds to its own RGB color component. By obtaining the adjusted grayscale values of the RGB format of the adjusted image data, the image to be displayed can be output after the color temperature is adjusted, achieving better eye protection.
[0143] FIG. 9 is a flowchart of determining a target color temperature according to some exemplary embodiments of the present disclosure.
[0144] As shown in FIG. 9 , the display method applied to the display device of this embodiment may include operations S410 to S490 .
[0145] In operation S910, the ambient illumination of the environment where the display screen is located is obtained;
[0146] For example, when using a mobile phone or other imaging device to capture a scene outside a window indoors, the indoor environment of the mobile phone is the environment of the display screen. When using a mobile phone or tablet to watch a movie outdoors, the outdoor environment is the environment of the display screen. The above-mentioned ambient illumination can be obtained by sensors in the display screen, can be determined by obtaining the ambient illumination of the current area from the network, or can be calculated and determined by obtaining environmental information such as current weather, light sources, or obstructions. This disclosure does not limit the method for obtaining ambient illumination.
[0147] In operation S920, a target color temperature corresponding to the ambient illuminance is determined according to a mapping relationship between the ambient illuminance and the color temperature, wherein the mapping relationship between the ambient illuminance and the color temperature is predetermined based on a human eye comfort index.
[0148] Exemplarily, the display method of this embodiment can be used for electronic devices such as notebooks, funbooks, tablets or mobile phones used in remote office, remote online classes, reading, watching videos or gaming entertainment.
[0149] According to the embodiments of the present disclosure, under different ambient illumination conditions, the color temperature of the screen display is adjusted in real time in combination with the parameters of the display device, which provides a better human eye comfort experience.
[0150] FIG10 is a flowchart of predetermining a mapping relationship between ambient illumination and color temperature according to some exemplary embodiments of the present disclosure.
[0151] As shown in FIG. 10 , the method of predetermining the mapping relationship between ambient illumination and color temperature based on the human eye comfort index in this embodiment may include operations S1010 to S1070 .
[0152] In operation S1010, a plurality of ambient illuminations are set;
[0153] For example, the ambient illumination range is set to start at 20 lux, traverse to 800 lux in steps of 20, and then traverse from 800 lux to 10^4 lux in steps of 300. Here, 10 lux is the dim brightness of a bedside lamp before bed, 800 lux is the brightness of a standard indoor LED light, and 10^4 lux is the brightness of sunlight. Table 2 shows a reference table of illumination under some different environments. The present disclosure is not limited to the ranges and environments shown in Figure 2.
[0154] Table 2
[0155] In operation S1020 , a plurality of images to be observed and a plurality of observers are determined;
[0156] In some embodiments, the plurality of images to be observed include natural scene images, close-up images of people, and solid color images. After determining the total number of images to be observed, the number of each type of image can be random or determined in a ratio, such as 2:2:1.
[0157] Figure 11 is a schematic diagram of multiple observers determined according to some exemplary embodiments of the present disclosure. When selecting observers, taking into account differences in human eye characteristics, the experimental observer requirements were selected as shown in Figure 11. It should be noted that the age ranges and the number and proportion of individuals in each age range shown in Figure 11 are merely examples and are not intended to be limiting.
[0158] In operation S1030, for each set ambient illuminance, a color temperature range of a human eye comfort zone is determined according to the Kruthoff curve; the determined color temperature range is traversed with a preset step size to determine a plurality of color temperatures to be observed;
[0159] Fig. 12 is a diagram of a comfort zone of a Kruithof curve according to some exemplary embodiments of the present disclosure. Fig. 13 is a schematic diagram of a determined color temperature range according to some exemplary embodiments of the present disclosure.
[0160] As shown in Figure 12, the shaded areas are considered uncomfortable, while the white areas are considered the comfort zone for the human eye. The Kruithof curve shown in Figure 12 is plotted to determine the color temperature range of the human eye's comfort zone under various ambient illuminances. This is then traversed with a specific step size to determine one or more color temperatures within this range to be observed. As shown in Figure 13, the color temperature range marked by the line segments corresponds to 100 lux illumination.
[0161] In operation S1040 , controlling the display device to display a plurality of images to be observed at a plurality of color temperatures to be observed;
[0162] Figure 14 illustrates observation scenarios according to some exemplary embodiments of the present disclosure. As shown in Figure 14a, observer A, while seated (or standing), can view multiple images displayed on first screen 1401 at various color temperatures, illuminated by first light source 1402. As shown in Figure 14b, observer B, while holding a hand, can view multiple images displayed on second screen 1404 at various color temperatures, illuminated by second light source 1403. This disclosure does not limit the observer's viewing posture, angle, or distance.
[0163] In operation S1050, multi-dimensional scores of the displayed images to be observed by the multiple observers are obtained;
[0164] Table 3
[0165] Referring to Table 3 above, each evaluation dimension and the degree corresponding to each evaluation dimension are shown, wherein each degree can be assigned a corresponding score, for example, from degree 1 to degree 5, the assigned score starts from 20 points and increases in steps of 20.
[0166] In operation S1060 , a comprehensive score is determined based on the multi-dimensional scores;
[0167] In some embodiments, the multi-dimensional score includes a first dimension score, a second dimension score, and a third dimension score, where the first dimension is the comfort of the observer when observing the displayed image, the second dimension is the brightness of the displayed image felt by the observer when observing the displayed image, and the third dimension is the tension of the observer when observing the displayed image. Determining the comprehensive score based on the multi-dimensional score includes: using a weighted summation method to calculate the first dimension score, the second dimension score, and the third dimension score to determine the comprehensive score.
[0168] Table 4
[0169] Table 4 shows a rating table for multiple observers. At each illumination level and for each color temperature to be observed, each image played receives a score as shown in Table 4. For example, the first dimension is the average score for comfort, with a weight of 0.5. The second dimension is the average score for brightness, with a weight of 0.25. The third dimension is the average score for tension, with a weight of 0.25. Each weight is multiplied by the corresponding dimension score and then summed to obtain a comprehensive score. The final comprehensive score for that color temperature is then calculated based on the comprehensive scores of all images to be observed (e.g., direct addition or weighted summation).
[0170] In operation S1070, the to-be-observed color temperature having the highest comprehensive score is determined as the color temperature corresponding to the ambient illuminance.
[0171] Figure 15 is a schematic diagram of a human eye comfort curve according to some exemplary embodiments of the present disclosure. Referring to Figure 15, corresponding color temperatures are determined for some ambient illuminances, thereby obtaining a human eye comfort curve. Based on the human eye comfort curve, a LUT table between the screen display color temperature and the ambient light illuminance can be generated. In some embodiments, when determining the target color temperature in operation S410, the ambient illuminance of the environment can be obtained using a sensor on the display screen. Then, based on the human eye comfort curve shown in Figure 15 or the generated LUT table between the screen display color temperature and the ambient light illuminance, the corresponding color temperature is determined as the target color temperature. The ambient illuminance of the environment can be obtained in real time, for example, once every 1 second, or the ambient illuminance value can be automatically sensed and determined in response to changes in the environment.
[0172] According to the embodiments of the present disclosure, not only the parameters of the display device are taken into consideration, but also the ambient illumination and human eye comfort are taken into account. An eye protection mode with intelligent color temperature adjustment can be implemented for different display devices to provide a better human eye comfort experience.
[0173] Fig. 16 is a flow chart of a display method applied to a display device according to some other exemplary embodiments of the present disclosure. Fig. 17 is a schematic diagram of display effects according to some other exemplary embodiments of the present disclosure.
[0174] As shown in Figure 16, the display method of this embodiment includes a data acquisition process and an inference process. In the data acquisition process, the color gamut of the display screen is first measured; then the color coordinates and RGB coordinate conversion matrix are obtained; then the CIE1931 standard blackbody locus color coordinates are obtained; then all color temperatures are traversed, and the gains of the RGB values corresponding to the standard color coordinates are calculated, which can also be converted into gains of RGB values; finally, the color temperature and RGB gain curves are fitted to obtain a functional relationship. In addition, the human eye comfort curve shown in Figure 15 can also be determined. In the inference process, the ambient illumination is first obtained using the sensor sensor; then the target color temperature T' is determined according to the color temperature conversion LUT table generated as shown in Figure 15; then the three-channel gain is determined according to the functional relationship. Finally, the gain is applied to the RGB pixels of the input image.
[0175] As shown in Figure 17, the functional relationship between the gain and color temperature of the various basic color components of the display device can be written into the hardware SOC (System-on-Chip). During the inference process as shown in Figure 16, the illuminance sensor can obtain the ambient illuminance and feed it back to the hardware SOC, that is, the hardware SOC reads the ambient illuminance value fed back by the illuminance sensor. The hardware SOC obtains the image to be displayed, determines the three-channel gain, and applies the gain to the RGB value of each pixel in the image to adjust the screen display color temperature. For example, illuminance information is obtained every 1 second, and the image is continuously processed and displayed, as shown in Figure 17, respectively, in low light (<1 lux), indoor light (200 lux), and outdoor light (1000 lux).
[0176] In some embodiments, the present disclosure further provides a display device, which will be described in detail below in conjunction with FIG18 .
[0177] FIG18 schematically shows a structural block diagram of a display device according to an embodiment of the present disclosure.
[0178] As shown in FIG18 , the display device 1800 of this embodiment includes a target color temperature determination module 1810, a gain determination module 1820, an initial image data acquisition module 1830, an adjusted image data determination module 1840, and an image display module 1850. The display device 1800 is capable of displaying an image based on image data to be displayed, where the image data includes grayscale values corresponding to various basic color components in the color gamut of the display screen of the display device.
[0179] The target color temperature determination module 1810 may perform operation S410 for determining a target color temperature;
[0180] In some embodiments, the target color temperature determination module 1810 may perform operations S910 to S920 , which will not be described in detail herein.
[0181] The gain determination module 1820 may perform operation S420 for determining gains of various basic color components of the display device according to a functional relationship between the gains of the various basic color components of the display device and the color temperature, wherein the gains of the various basic color components of the display device correspond to the target color temperature, and the functional relationship between the gains of the various basic color components of the display device and the color temperature is predetermined based on parameters of the display device.
[0182] In some embodiments, the various basic color components include a red component, a green component, and a blue component, and the functional relationship between the gain and color temperature of the various basic color components of the display device includes: a first functional relationship between the gain and color temperature of the red component; a second functional relationship between the gain and color temperature of the green component; and a third functional relationship between the gain and color temperature of the blue component.
[0183] In some embodiments, the gain determination module 1820 may perform operations S710 to S720 and S810 to S830, which will not be described in detail herein.
[0184] The initial image data acquisition module 1830 may perform operation S430 for acquiring initial image data of an image to be displayed, wherein the initial image data includes initial grayscale values corresponding to various basic color components;
[0185] The adjusted image data determining module 1840 may perform operation S440 for: determining adjusted image data of the image to be displayed based on the determined gains of the various basic color components of the display device and the acquired initial image data of the image to be displayed, wherein the adjusted image data of the image to be displayed includes adjusted grayscale values corresponding to the various basic color components; and
[0186] The image display module 1850 may perform operation S450 for displaying the image to be displayed based on the adjusted image data of the image to be displayed.
[0187] In some embodiments, the display device 1800 may further include a functional relationship determination module, which may be used to perform operations S510 to S530 and S610 to S640, and will not be described in detail herein.
[0188] In some embodiments, the functional relationship determination module of the display device 1800 can be used to respectively measure the color coordinates of the display screen when displaying a pure red image, a pure green image, a pure blue image, and a pure white image; and determine the color gamut of the display screen based on the color coordinates of the display screen when displaying a pure red image, a pure green image, a pure blue image, and a pure white image.
[0189] In some embodiments, the functional relationship between the gains of various basic color components of the display device and the color temperature is a cubic power function.
[0190] In some embodiments, the display device 1800 may further include a mapping relationship determination module, which may be used to perform operations S1010 to S1070 and S610 to S640, which will not be described in detail herein.
[0191] In some embodiments, the multi-dimensional score includes a first dimension score, a second dimension score, and a third dimension score, where the first dimension is the comfort of the observer when observing the displayed image, the second dimension is the brightness of the displayed image felt by the observer when observing the displayed image, and the third dimension is the tension of the observer when observing the displayed image. Determining the comprehensive score based on the multi-dimensional score includes: calculating the first dimension score, the second dimension score, and the third dimension score using a weighted summation method to determine the comprehensive score.
[0192] It should be noted that the implementation methods, technical problems solved, functions implemented, and technical effects achieved of each module / unit / sub-unit in the device part embodiment are the same or similar to the implementation methods, technical problems solved, functions implemented, and technical effects achieved of each corresponding step in the method part embodiment, and will not be repeated here.
[0193] According to an embodiment of the present disclosure, any multiple modules among the target color temperature determination module 1810, the gain determination module 1820, the initial image data acquisition module 1830, the adjusted image data determination module 1840, and the image display module 1850 can be combined into a single module, or any one of these modules can be split into multiple modules. Alternatively, at least part of the functionality of one or more of these modules can be combined with at least part of the functionality of other modules and implemented in a single module.
[0194] According to an embodiment of the present disclosure, at least one of the target color temperature determination module 1810, the gain determination module 1820, the initial image data acquisition module 1830, the adjusted image data determination module 1840, and the image display module 1850 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application-specific integrated circuit (ASIC), or can be implemented in hardware or firmware by any other reasonable means of circuit integration or packaging, or can be implemented in any one of the three implementation methods of software, hardware, and firmware, or in any appropriate combination of any of them. Alternatively, at least one of the target color temperature determination module 1810, the gain determination module 1820, the initial image data acquisition module 1830, the adjusted image data determination module 1840, and the image display module 1850 can be at least partially implemented as a computer program module, which can perform the corresponding function when executed.
[0195] In some embodiments, the present disclosure further provides an electronic device, which will be described in detail below in conjunction with FIG19 .
[0196] FIG19 schematically shows a block diagram of an electronic device suitable for implementing the display method according to an embodiment of the present disclosure.
[0197] In some embodiments, the electronic device 1900 includes a display screen and a controller 1901 , and the controller 1901 is configured to control the display screen to display an image to be displayed using the display method described in any one of the embodiments of FIG. 4 to FIG. 17 .
[0198] In some embodiments, the electronic device 1900 further includes a sensor, which is used to obtain the ambient illumination of the environment in which the display screen is located, and the sensor is communicatively connected to the controller.
[0199] Furthermore, as shown in FIG19 , the controller 1901 according to an embodiment of the present disclosure can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1902 or a program loaded from a storage portion 1908 into a random access memory (RAM) 1903. The controller 1901 may, for example, include a general-purpose microcontroller (e.g., a CPU), an instruction set controller and / or a related chipset and / or a dedicated microcontroller (e.g., an application-specific integrated circuit (ASIC)), etc. The controller 1901 may also include onboard memory for caching purposes. The controller 1901 may include a single processing unit or multiple processing units for executing different actions of the method flow according to an embodiment of the present disclosure.
[0200] Various programs and data required for the operation of the electronic device 1900 are stored in the RAM 1903. The controller 1901, the ROM 1902, and the RAM 1903 are connected to each other via a bus 1904. The controller 1901 executes the various operations of the method flow according to the embodiment of the present disclosure by executing the programs in the ROM 1902 and / or the RAM 1903. It should be noted that the programs may also be stored in one or more memories other than the ROM 1902 and the RAM 1903. The controller 1901 may also execute the various operations of the method flow according to the embodiment of the present disclosure by executing the programs stored in the one or more memories.
[0201] According to an embodiment of the present disclosure, electronic device 1900 may further include an input / output (I / O) interface 1905, which is also connected to bus 1904. Electronic device 1900 may further include one or more of the following components connected to I / O interface 1905: an input section 1906 including a keyboard, mouse, etc.; an output section 1907 including devices such as a cathode ray tube (CRT), liquid crystal display (LCD), and speakers; a storage section 1908 including a hard disk; and a communication section 1909 including a network interface card such as a LAN card or modem. Communication section 1909 performs communication processing via a network such as the Internet. A drive 1910 is also connected to I / O interface 1905 as needed. Removable media 1911, such as a magnetic disk, optical disk, magneto-optical disk, semiconductor memory, etc., is installed in drive 1910 as needed, so that computer programs read from the removable media can be installed into storage section 1908 as needed.
[0202] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments, or may exist independently and not be incorporated into the device / apparatus / system. The computer-readable storage medium carries one or more programs, and when executed, implements the method according to the embodiments of the present disclosure.
[0203] According to an embodiment of the present disclosure, a computer-readable storage medium may be a non-volatile computer-readable storage medium, for example, it may include but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, apparatus, or device. For example, according to an embodiment of the present disclosure, a computer-readable storage medium may include the ROM 1902 and / or RAM 1903 described above and / or one or more memories other than ROM 1902 and RAM 1903.
[0204] The embodiments of the present disclosure also include a computer program product, which includes a computer program containing program code for executing the method shown in the flowchart. When the computer program product is run in a computer system, the program code is used to enable the computer system to implement the method provided by the embodiments of the present disclosure.
[0205] The computer program executes the above functions defined in the system / device of the embodiment of the present disclosure when the controller 1901 executes the computer program. According to the embodiment of the present disclosure, the system, device, module, unit, etc. described above can be implemented by a computer program module.
[0206] In one embodiment, the computer program may be stored on a tangible storage medium such as an optical storage device or a magnetic storage device. In another embodiment, the computer program may be transmitted and distributed in the form of a signal over a network medium, downloaded and installed via communication portion 1909, and / or installed from removable media 1911. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to wireless, wired, or any suitable combination thereof.
[0207] In such an embodiment, the computer program can be downloaded and installed from a network via the communication section 1909, and / or installed from a removable medium 1911. When the computer program is executed by the controller 1901, the above-described functions defined in the system of the embodiment of the present disclosure are performed. According to the embodiment of the present disclosure, the systems, devices, means, modules, units, etc. described above can be implemented by computer program modules.
[0208] According to an embodiment of the present disclosure, the program code for executing the computer program provided by the embodiment of the present disclosure can be written in any combination of one or more programming languages. Specifically, these computer programs can be implemented using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages include, but are not limited to, languages such as Java, C++, python, "C" or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, using an Internet service provider to connect via the Internet).
[0209] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the above-mentioned module, program segment, or a part of code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0210] Those skilled in the art will appreciate that the features described in the various embodiments and / or claims of this disclosure may be combined and / or coupled in various ways, even if such combinations and / or couplings are not explicitly described in this disclosure. In particular, the features described in the various embodiments and / or claims of this disclosure may be combined and / or coupled in various ways without departing from the spirit and teachings of this disclosure. All such combinations and / or couplings are intended to fall within the scope of this disclosure.
[0211] As used herein, the terms "substantially," "about," "approximately," and other similar terms are used as terms of approximation rather than as terms of degree, and are intended to account for the inherent deviations in measured or calculated values that would be recognized by one of ordinary skill in the art. To account for factors such as process fluctuations, measurement problems, and errors associated with the measurement of a particular quantity (i.e., limitations of the measurement system), "about" or "approximately," as used herein, are inclusive of the stated value and mean within an acceptable range of deviation for the particular value as determined by one of ordinary skill in the art. For example, "approximately" can mean within one or more standard deviations, or within ±10% or ±5% of the stated value.
[0212] The embodiments of the present disclosure are described above. However, these embodiments are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although each embodiment has been described separately above, this does not mean that the measures in each embodiment cannot be used in combination to advantage. The scope of the present disclosure is defined by the appended claims and their equivalents. Without departing from the scope of the present disclosure, those skilled in the art may make various substitutions and modifications, which should all fall within the scope of the present disclosure.
Claims
1. A display method applied to a display device, wherein the display device is capable of displaying according to image data of an image to be displayed, wherein the image data includes grayscale values corresponding to various basic color components in a color gamut of a display screen of the display device, in, The method comprises: Determine the target color temperature; determining the gains of various basic color components of the display device according to the functional relationship between the gains of various basic color components of the display device and the color temperature, wherein the gains of various basic color components of the display device correspond to the target color temperature, and the functional relationship between the gains of various basic color components of the display device and the color temperature is predetermined according to the parameters of the display device; Acquire initial image data of the image to be displayed, wherein the initial image data includes initial grayscale values corresponding to various basic color components; Determining adjusted image data of the image to be displayed based on the determined gains of various basic color components of the display device and the acquired initial image data of the image to be displayed, wherein the adjusted image data of the image to be displayed includes adjusted grayscale values corresponding to various basic color components; and The image to be displayed is displayed based on the adjusted image data of the image to be displayed.
2. The display method according to claim 1, wherein: Determining the target color temperature includes: Acquiring the ambient illumination of the environment in which the display screen is located; and According to the mapping relationship between the ambient illumination and the color temperature, a target color temperature corresponding to the ambient illumination is determined, wherein the mapping relationship between the ambient illumination and the color temperature is predetermined based on a human eye comfort index.
3. The display method according to claim 1, wherein: Predetermining the functional relationship between the gain and color temperature of various basic color components of the display device according to the parameters of the display device includes: Determining the color gamut of a display screen of the display device; Determining a conversion matrix according to the determined color gamut of the display screen, wherein the conversion matrix is used to realize the conversion of colors between the color gamut space of the display screen and a standard color space; and According to the conversion matrix, a functional relationship between the gain and color temperature of various basic color components of the display device is determined.
4. The display method according to claim 3, wherein: Determining the functional relationship between the gains of various basic color components of the display device and the color temperature according to the conversion matrix specifically includes: Obtain a mapping table between color temperature and color coordinates in a standard color space; Determine the color coordinates of the white point in the color gamut space of the display screen at multiple color temperatures according to a mapping table between the color temperature and the color coordinates in the standard color space and the conversion matrix; Determining the gains of various basic color components at various color temperatures according to the color coordinates of the white point at the determined multiple color temperatures in the color gamut space of the display screen and preset parameters; and According to the gains of various basic color components at various color temperatures, a functional relationship between the gains of various basic color components of the display device and the color temperature is obtained by fitting.
5. The display method according to claim 4, wherein: The functional relationship between the gains of various basic color components of the display device and the color temperature is a cubic power function relationship.
6. The display method according to claim 2, wherein: Predetermining the mapping relationship between the ambient illumination and the color temperature based on the human eye comfort index includes: Set multiple ambient illumination levels; determining a plurality of images to be observed and a plurality of observers; For each set ambient illumination, determine the color temperature range of the human eye comfort zone according to the Kruthoff curve; traverse the determined color temperature range with a preset step size to determine a plurality of color temperatures to be observed; control the display device to display the plurality of images to be observed at the plurality of color temperatures to be observed; obtain multi-dimensional scores of the plurality of images to be observed respectively given by the plurality of observers; determine a comprehensive score according to the multi-dimensional score; and determine the color temperature to be observed with the highest comprehensive score as the color temperature corresponding to the ambient illumination.
7. The display method according to claim 1, wherein: The various basic color components include a red component, a green component and a blue component, and The functional relationship between the gain and color temperature of various basic color components of the display device includes: a first functional relationship between the gain and color temperature of the red component; a second functional relationship between the gain and color temperature of the green component; and a third functional relationship between the gain and color temperature of the blue component.
8. The display method according to claim 7, wherein: Determining the gains of various basic color components of the display device according to the functional relationship between the gains of various basic color components of the display device and the color temperature specifically includes: Determining a first gain of a red component of the display device according to a first functional relationship between the gain of the red component of the display device and the color temperature; determining a second gain of the green component of the display device according to a second functional relationship between the gain of the green component of the display device and the color temperature; A third gain of the blue component of the display device is determined according to a third functional relationship between the gain of the blue component of the display device and the color temperature.
9. The display method according to claim 8, wherein: The initial image data includes a first initial grayscale value corresponding to a red component, a second initial grayscale value corresponding to a green component, and a third initial grayscale value corresponding to a blue component; Determining the adjusted image data of the image to be displayed based on the determined gains of various basic color components of the display device and the acquired initial image data of the image to be displayed specifically includes: multiplying the first initial grayscale value and the first gain to obtain a first adjusted grayscale value of the adjusted image data; multiplying the second initial grayscale value and the second gain to obtain a second adjusted grayscale value of the adjusted image data; and The third initial grayscale value and the third gain are multiplied to obtain a third adjusted grayscale value of the adjusted image data.
10. The display method according to claim 3, wherein: Determining the color gamut of the display screen of the display device includes: Respectively measuring the color coordinates of the display screen when displaying a pure red image, a pure green image, a pure blue image, and a pure white image; and The color gamut of the display screen is determined according to the color coordinates of the display screen when the display screen displays a pure red image, a pure green image, a pure blue image, and a pure white image.
11. The display method according to claim 6, wherein: The multi-dimensional rating includes a first dimension rating, a second dimension rating and a third dimension rating, wherein the first dimension is the comfort level of the observer when observing the displayed image, the second dimension is the brightness of the displayed image felt by the observer when observing the displayed image, and the third dimension is the tension level of the observer when observing the displayed image. Determining the comprehensive score based on the multi-dimensional score includes: calculating the first dimension score, the second dimension score and the third dimension score by weighted summation to determine the comprehensive score.
12. The display method according to claim 6, wherein: The plurality of images to be observed include natural scene images, close-up images of people and pure color images.
13. The display method according to claim 4, wherein: The preset parameter is 255.
14. A display device capable of displaying according to image data of an image to be displayed, wherein the image data comprises grayscale values corresponding to various basic color components in a color gamut of a display screen of the display device, in, The display device comprises: A target color temperature determination module, used to determine the target color temperature; a gain determination module, configured to determine the gains of various basic color components of the display device according to a functional relationship between the gains of various basic color components of the display device and the color temperature, wherein the gains of various basic color components of the display device correspond to the target color temperature, and the functional relationship between the gains of various basic color components of the display device and the color temperature is predetermined according to parameters of the display device; An initial image data acquisition module, used to acquire initial image data of the image to be displayed, wherein the initial image data includes initial grayscale values corresponding to various basic color components; an adjusted image data determining module, configured to determine adjusted image data of the image to be displayed based on the determined gains of various basic color components of the display device and the acquired initial image data of the image to be displayed, wherein the adjusted image data of the image to be displayed includes adjusted grayscale values corresponding to various basic color components; and The image display module is used to display the image to be displayed based on the adjusted image data of the image to be displayed.
15. An electronic device, comprising: Display screen; and A controller, wherein the controller is configured to: use the display method according to any one of claims 1 to 13 to control the display screen to display the image to be displayed.
16. The electronic device according to claim 15, wherein: The electronic device further includes a sensor, which is used to obtain the ambient illumination of the environment where the display screen is located, and the sensor is communicatively connected with the controller.
