Display apparatus and display adjustment method of display apparatus

Abstract

This invention discloses a display device and a display adjustment method for the display device. In the display device, during the power-on process, the control module acquires ambient light information and user behavior-related information; analyzes the data to determine the user type and outputs parameter information corresponding to the user type; when the user type is determined to be a first type, the display-related parameters of the initial image frame are adjusted according to the confidence and sensitivity information corresponding to the RGB three primary colors included in the parameter information to obtain a target image frame; the display module displays the target image frame. By acquiring user behavior-related data during the power-on process, user type determination can be achieved without the user's awareness, protecting user privacy; by adjusting the display-related parameters of the image frame through the parameter information, the displayed image frame is adapted to the current user, without requiring active adjustment by the user, allowing the user to obtain the best viewing experience.

Description

Technical Field

[0001] This invention relates to the field of image display technology, and in particular to a display device and a display adjustment method for the display device. Background Technology

[0002] Color blindness and color weakness are visual disorders caused by abnormalities or deficiencies in the photosensitive pigments in the cone cells of the retina, resulting in a loss of color vision. Generally, color-blind individuals lack the ability to distinguish one or more colors, while color-weak individuals have a diminished ability to distinguish colors. Furthermore, most people are unaware of whether they have color vision deficiencies, and the sensitivity to color varies in different environments for those with color vision deficiencies.

[0003] As display technology continues to develop, display products have become necessities in people's lives, and people typically need to obtain information from color images or videos displayed on display devices. For people with color vision deficiencies, such as color blindness or color weakness, their ability to obtain information from color images or videos is also limited due to their decreased color discrimination ability.

[0004] To improve the visual experience for users with color vision deficiencies, current display devices adjust the image display based on the user's specific color vision deficiency. However, existing solutions adjust the image based on the known color vision deficiency type. This approach not only easily exposes user privacy but also requires customized adjustments for different users on display devices such as televisions and computers, making it extremely inconvenient. Summary of the Invention

[0005] This invention provides a display device and a display adjustment method for the display device, in order to solve the problem that existing display devices, when adjusting the display colors for users with color vision abnormalities, not only easily expose user privacy, but also require users to make active adjustments, making them extremely inconvenient to use.

[0006] In a first aspect, embodiments of the present invention provide a display device, including a control module and a display module, wherein:

[0007] The control module is used for:

[0008] During the power-on process of the display device, ambient light information and user behavior-related information are acquired;

[0009] Data analysis is performed on the ambient light information and the behavior-related information to determine the user type and output parameter information corresponding to the user type. The user type includes a first type for characterizing abnormal color discrimination ability and a second type for characterizing normal color discrimination ability.

[0010] When the user type is determined to be the first type, the display-related parameters of the initial image frame are adjusted according to the confidence information and sensitivity information corresponding to the RGB three primary colors included in the parameter information to obtain the target image frame;

[0011] The display module is used to display the target image frame.

[0012] In the display device provided by this invention, by analyzing ambient light information and user behavior-related data acquired during the power-on process, user type determination can be achieved without the user's awareness or slight awareness, without prior knowledge of the user type, thus protecting user privacy. Furthermore, by determining the sensitivity and confidence information of users with color vision deficiency (i.e., the first type) regarding the RGB three primary colors, and using this determined sensitivity and confidence information to adjust display-related parameters of the initial image frame, a target image frame is obtained. Since the output sensitivity and confidence information are associated with the user's color vision deficiency type—that is, the parameter information output by users with severe color weakness is different from that of users with mild color weakness—the target image frame determined based on this parameter information is adapted to the current user, without requiring active adjustment by the user, allowing the user to obtain the best viewing experience.

[0013] In one optional embodiment, the display-related parameters of the initial image frame include one or more of the following: initial contrast parameters, initial color data, initial hue data, and initial saturation data.

[0014] The control module is specifically used for:

[0015] Based on the sensitivity information corresponding to each of the RGB three primary colors, a target contrast parameter is determined, and the initial contrast parameter included in the initial image is updated using the target contrast parameter, and / or,

[0016] Based on the confidence and sensitivity information corresponding to each of the RGB three primary colors, a color adjustment matrix is ​​constructed, and the initial color data of each pixel in the initial image frame is adjusted using the color adjustment matrix, and / or,

[0017] The initial hue data and / or the initial saturation data are adjusted using the sensitivity information corresponding to each of the RGB three primary colors.

[0018] The above embodiments utilize the sensitivity and confidence information corresponding to the three primary colors of RGB to adjust one or more of the initial contrast parameters, initial color data, initial hue data, and initial saturation data of the initial image frame, thereby achieving adaptive adjustment of the image display effect. This allows the adjusted target image frame to be adapted to the current type of user, bringing a better viewing experience to the user.

[0019] In one optional embodiment, the control module is specifically used for:

[0020] The color adjustment matrix is ​​determined based on the product of the confidence information corresponding to each of the three RGB primary colors, the sensitivity information corresponding to each of the three RGB primary colors, and the preset initial parameter matrix.

[0021] In the color adjustment matrix, multiple elements in the same row correspond to the same primary color. For any element in the color adjustment matrix, the element is determined by the product of the confidence information corresponding to the target primary color, the sensitivity information corresponding to the target primary color, and the target initial parameter. The target primary color is determined by the position of the element in the row. The target initial parameter is the initial parameter in the initial parameter matrix that is at the same position as the element.

[0022] In the above embodiments, the initial color data of each pixel in the initial image frame is adjusted by using an initial parameter matrix and a color adjustment matrix determined by the sensitivity and confidence information of each of the RGB three primary colors. This makes the color display of the target image frame used for display more suitable for the current user and improves the user's visual experience.

[0023] In one optional embodiment, the initial color data includes initial color component data corresponding to each of the RGB three primary colors; the control module is specifically used for:

[0024] For any pixel included in the initial image frame, gamma correction is performed on the initial color component data corresponding to each of the RGB three primary colors included in the pixel to obtain the intermediate color component data corresponding to each of the RGB three primary colors.

[0025] The target color component data corresponding to each of the RGB primary colors is determined by multiplying the color adjustment matrix with the intermediate color component data corresponding to each of the RGB primary colors.

[0026] The target color data includes the target color component data corresponding to each of the RGB three primary colors, and the target image frame is constructed based on the target color data.

[0027] The above embodiments, through gamma correction and color adjustment matrices, adjust the initial color component data corresponding to each of the RGB three primary colors in the initial color data multiple times, so that the final displayed color value is more suitable for the current user and improves the user's visual experience.

[0028] In one optional embodiment, the control module is specifically used for:

[0029] The target sensitivity information is determined based on the average value of the sensitivity information corresponding to each of the three primary colors of RGB.

[0030] The target contrast parameter is determined based on the target sensitivity information and the preset maximum contrast threshold.

[0031] In one optional embodiment, the control module is specifically used for:

[0032] The target sensitivity information is used to perform an exponential calculation to obtain intermediate contrast data;

[0033] The target contrast parameter is determined based on the ratio of the maximum contrast threshold to the intermediate contrast data.

[0034] In the above embodiment, the target contrast parameter is determined by the sensitivity information and maximum contrast threshold corresponding to each of the three primary colors of RGB, and the initial contrast parameter of the initial image frame is replaced with the target contrast parameter, thereby making the contrast performance of the target image frame more suitable for the current user's viewing and improving the user's visual experience.

[0035] In one optional embodiment, the control module is specifically used for:

[0036] Based on the first pair of relationships and the sensitivity information corresponding to each of the RGB three primary colors, the target hue parameters are determined, and the initial hue data is adjusted according to the target hue parameters to obtain the target hue data, and / or,

[0037] Based on the second correspondence and the sensitivity information corresponding to each of the RGB three primary colors, the target saturation parameter is determined, and the initial saturation data is adjusted according to the target saturation parameter to obtain the target saturation data;

[0038] The first correspondence is used to characterize the relationship between the user's sensitivity to different primary colors and the hue parameters corresponding to different primary colors, and the second correspondence is used to characterize the relationship between the user's sensitivity to different primary colors and the saturation parameters corresponding to different primary colors.

[0039] The above embodiments adjust the initial hue data and / or initial saturation data of the initial image frame by using the first correspondence and / or the second correspondence, and combining the sensitivity information corresponding to the three primary colors of RGB, so as to make the effect of the target image frame more suitable for the current user and improve the user's visual experience.

[0040] In one optional embodiment, the control module is specifically used for:

[0041] During the power-on process of the display device, the image acquisition component acquires information related to the user's behavior while watching the power-on animation of the display device, and the light sensor component acquires ambient light information about the environment in which the display device is located.

[0042] The boot animation includes at least one frame of a test image, and the behavior-related information includes one or more of the user's pupil size, interpupillary distance, and user facial expression.

[0043] The above embodiments, by setting the test card in the boot animation and using the image acquisition component to capture behavior-related information and the light sensor component to obtain ambient light information, can seamlessly determine the user type without the user's active intervention, saving the user's testing time and protecting the user's privacy.

[0044] In an optional embodiment, the control module is further configured to:

[0045] When the user type is determined to be the second type, the output parameter information corresponding to the user type is the preset display setting parameter, wherein the preset display setting parameter is the setting parameter when the display device performs normal display;

[0046] The display module is also used to display the initial image frame.

[0047] In the above embodiments, when it is determined that the current user is a user with normal color vision (i.e., the second type), there is no need to adjust the display-related parameters of the initial image frame. The default preset display settings can be used, thereby making the display device more universal.

[0048] In a second aspect, embodiments of the present invention provide a display adjustment method for a display device, comprising:

[0049] During the power-on process of the display device, ambient light information and user behavior-related information are acquired;

[0050] Data analysis is performed on the ambient light information and the behavior-related information to determine the user type and output parameter information corresponding to the user type. The user type includes a first type for characterizing abnormal color discrimination ability and a second type for characterizing normal color discrimination ability.

[0051] When the user type is determined to be the first type, the display-related parameters of the initial image frame are adjusted according to the confidence information and sensitivity information corresponding to the RGB three primary colors included in the parameter information to obtain the target image frame and display the target image frame.

[0052] For the technical effects that the display adjustment method of the display device disclosed in the second aspect above may achieve, please refer to the above description of the technical effects that may be achieved for the first aspect or various possible solutions in the first aspect, and will not be repeated here. Attached Figure Description

[0053] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0054] Figure 1 This is a schematic diagram illustrating an application scenario of a display device provided in an embodiment of the present invention;

[0055] Figure 2 This is a schematic diagram of a module structure of a display device provided in an embodiment of the present invention;

[0056] Figure 3 This is a schematic diagram of the internal structure of a control module in a display device provided by an embodiment of the present invention;

[0057] Figure 4 This is a schematic diagram of the working process of a display device provided in an embodiment of the present invention;

[0058] Figure 5 A schematic diagram of a test chart provided in an embodiment of the present invention;

[0059] Figure 6 This is a schematic diagram of the structure of a data analysis unit in a control module provided by an embodiment of the present invention;

[0060] Figure 7 This is a schematic diagram illustrating the workflow of an image adjustment unit determining target contrast parameters according to an embodiment of the present invention.

[0061] Figure 8This is a schematic diagram illustrating the curve relationship between target contrast parameters and target sensitivity information provided in an embodiment of the present invention.

[0062] Figure 9 This is a schematic diagram illustrating the workflow of an image adjustment unit adjusting initial color data according to an embodiment of the present invention.

[0063] Figure 10 This is a schematic diagram illustrating the complete workflow of a display device provided in an embodiment of the present invention. Detailed Implementation

[0064] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this invention, and not all of them. Based on the embodiments of this invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this invention.

[0065] It should be noted that the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this invention. Rather, they are merely examples of apparatuses and methods consistent with some aspects of the invention as detailed in the appended claims.

[0066] Color blindness and color weakness are visual disorders caused by abnormalities or deficiencies in the photosensitive pigments in the cone cells of the retina, resulting in color vision disturbances. Generally, color-blind individuals lack the ability to distinguish one or more colors. Color-blind individuals can be classified according to the types of colors they cannot distinguish: red-blindness, green-blindness, blue-yellow-blindness, and total color blindness.

[0067] People with color weakness experience a reduced ability to distinguish colors. They don't completely lack color perception; their ability is simply dulled or requires repeated consideration to identify colors. Color weakness also varies in severity. Severe color weakness is equivalent to mild color blindness, while for those with average color weakness, their color perception is close to normal in bright lighting conditions, but approaches color blindness in poor lighting.

[0068] Furthermore, most people are unaware of whether they have color vision deficiency, and the sensitivity to color varies depending on the environment. With the continuous development of display technology, display products have become necessities in people's lives, and people typically need to obtain information from color images or videos displayed on these devices. For users with color vision deficiency, their ability to obtain information from color images or videos is limited due to their decreased color discrimination ability.

[0069] To improve the visual experience for users with color vision deficiencies, current display devices adjust the image display based on the user's specific type of color vision deficiency. However, existing solutions either adjust the image based on known color vision deficiency type or require proactive testing to determine the user's specific type and then adjusting the image accordingly.

[0070] However, regardless of the adjustment method used, on the one hand, it is easy to expose user privacy; on the other hand, for display devices such as TVs and computers used by multiple people, special adjustments need to be made for different users, which is extremely inconvenient to use.

[0071] Based on this, embodiments of the present invention provide a display device and a display adjustment method for the display device. By determining the user type without the user's notice or slight notice, the user's privacy is protected. Based on the user's sensitivity and confidence information to the RGB three primary colors, the display-related parameters of the image frame are adaptively adjusted so that the final displayed image frame is adapted to the current user type without the user having to actively adjust it, thus enabling the user to obtain the best viewing effect.

[0072] The objectives, functional features, and advantages of this invention will be further explained in conjunction with the embodiments and accompanying drawings. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of the invention.

[0073] The application scenarios of the display device provided in the embodiments of the present invention will be described below with reference to the accompanying drawings:

[0074] Figure 1 This is a schematic diagram illustrating an application scenario of an embodiment of the present invention, such as... Figure 1As shown, a user can operate the display device 200 via a mobile terminal 300 and a control device 100. The control device 100 can be a remote control, and communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, wireless or other wired methods to control the display device 200. The user can input user commands through buttons on the remote control, voice input, control panel input, etc., to control the display device 200. In some embodiments, a mobile terminal, tablet computer, computer, laptop computer, and other smart devices can also be used to control the display device 200.

[0075] In some embodiments, the mobile terminal 300 can install software applications with the display device 200 to establish a connection and communication via network communication protocols, enabling one-to-one control operations and data communication. Audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 for synchronized display. The display device 200 also communicates with the server 400 via various communication methods. The display device 200 can communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 can provide various content and interactive features to the display device 200.

[0076] Display device 200 can be any product with display functionality, such as mobile phones, tablets, televisions, laptops, personal computers (PCs), in-vehicle computers, various wearable devices, personal digital assistants (PDAs), etc. Wearable devices include virtual reality (VR) devices and augmented reality (AR) devices. It can also be a component with display functionality, such as liquid crystal displays, organic light-emitting diode (OLED) displays, and projection displays. In addition to providing broadcast television reception functionality, display device 200 can also include smart network television functionality that provides computer support.

[0077] Of course, the methods provided in the embodiments of the present invention are not limited to those described above. Figure 1 The application scenarios shown can also be used in other possible application scenarios, and the embodiments of the present invention do not impose any limitations.

[0078] After introducing the application scenarios of the embodiments of the present invention, the preferred embodiments of the present invention will be further described in detail below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are only for illustration and explanation of the present invention and are not intended to limit the present invention. Furthermore, the embodiments of the present invention and the features in the embodiments can be combined with each other without conflict.

[0079] The display device provided in the embodiments of the present invention will be described in detail below with reference to the accompanying drawings:

[0080] Figure 2 This diagram illustrates a module structure of a display device according to an embodiment of the present invention. Figure 2 As shown, the display device 200 includes a control module 210 and a display module 220, which are electrically connected. In a specific implementation, the control module 210 can be a display chip, specifically a TCON (Timing Controller), SoC (System on Chip), etc.; the display module 220 can be a display panel.

[0081] Figure 3 A schematic diagram of the internal structure of the control module provided in an embodiment of the present invention is shown, as follows: Figure 3 As shown, the control module 210 may include a test chart setting unit 211, a data acquisition unit 212, a data analysis unit 213, and an image adjustment unit 214, which are electrically connected in sequence; wherein, the data acquisition unit 212 may include an image acquisition component 2121 and a light sensor component 2122.

[0082] The following is a detailed introduction to the specific functions of the display device and its internal components:

[0083] Figure 4 A schematic diagram illustrating the workflow of a display device provided in an embodiment of the present invention is shown. Figure 4 As shown, the display device 200 can perform display processing of image frames through the following steps:

[0084] In step S401, the data acquisition module 212 can acquire ambient light information and user behavior-related information during the power-on process of the display device 200.

[0085] In some embodiments, before the display device 200 is powered on, the test pattern card setting unit 211 in the control module 210 can embed the test pattern card into the boot animation, so that the boot animation of the display device 200 includes at least one frame of the test pattern card.

[0086] In specific implementation, the test chart setting unit 211 can insert one or more frames of test charts into the boot animation of the display device 200, or it can use multiple frames of test charts played continuously as the boot animation.

[0087] Figure 5 A schematic diagram of a test chart provided in an embodiment of the present invention is shown. Figure 5 As shown, several feasible test charts are illustrated. Among them, such as... Figure 5 As shown in (a), the test cards can be of a single color, such as red, yellow, green, or blue cards; Figure 5 As shown in (b), the test chart can also be a chart containing high-precision color tiles. For example, a single test chart can include green, red, yellow, and blue tiles simultaneously, or a traffic light image can be used as the test chart; Figure 5 As shown in (c), the test cards can also be the cards specifically designed for color blindness and color weakness testing.

[0088] It should be understood that the above examples are merely illustrative and should not be construed as representing any aspect of the present invention. In practical applications, the test graphics cards are not limited to those described above. Figure 5 Several types of graphics cards.

[0089] In some embodiments, during the power-on process of the display device 200, the data acquisition unit 212 can acquire behavior-related information of the user while watching the power-on animation of the display device 200 through the image acquisition component 2121, and acquire ambient light information of the environment where the display device 200 is located through the light sensor component 2122. The behavior-related information includes one or more of the user's pupil size, interpupillary distance, and user expression.

[0090] In practice, since the test chart is embedded in the boot animation, when the user watches the boot animation of the display device 200, information such as the user's pupil size, interpupillary distance, and facial expression, as well as the current ambient light intensity, can be collected. The collected ambient light information and user behavior-related information are then sent to the data analysis unit 213 to analyze the user type. During this process, the user is unaware of the process.

[0091] Furthermore, in practical applications, the image acquisition component 2121 can be a device such as a camera, and the light sensor component 2122 can be a type of optical sensor. This embodiment of the invention does not impose any restrictions on this.

[0092] By setting the test card in the boot animation and using the image acquisition component 2121 to capture behavior-related information and the light sensor component 2122 to obtain ambient light information, the user type can be determined imperceptibly without the user's active intervention, saving user testing time and protecting user privacy.

[0093] In step S402, the data analysis unit 213 can perform data analysis on ambient light information and behavior-related information to determine the user type and output parameter information corresponding to the user type.

[0094] The user types include a first type, which characterizes abnormal color discrimination ability, and a second type, which characterizes normal color discrimination ability.

[0095] In specific implementation, the data analysis unit 213 can use an AI (Artificial Intelligence) model to analyze behavioral-related information, including pupil size, interpupillary distance, user expression, and ambient light information, to determine whether the current user's user type is the first type or the second type.

[0096] In some embodiments, when the data analysis unit 213 determines that the user type is a first type, the parameter information corresponding to the user type output by it includes the confidence information corresponding to each of the three primary colors of RGB and the sensitivity information corresponding to each of the three primary colors of RGB; when the data analysis unit 213 determines that the user type is a second type, the parameter information corresponding to the user type output by it is a preset display setting parameter, wherein the preset display setting parameter is the setting parameter when the display device performs normal display.

[0097] Figure 6 A schematic diagram of the structure of the data analysis unit provided in an embodiment of the present invention is shown. Figure 6 As shown, the data analysis unit 213 can use a DNN (Deep Neural Networks) model. The DNN model analyzes the pupil size, interpupillary distance, user expression and ambient light information received from the input terminal to output the user type and output information.

[0098] It should be understood that the DNN model used in the data analysis unit 213 described above is only one example. In practical applications, the data analysis unit 213 can also use ResNet (Residual Networks) models, etc. This embodiment of the invention does not impose any restrictions on this.

[0099] In some embodiments, when the data analysis unit 213 determines that the user type is the second type, the image adjustment unit 214 does not adjust the display of the initial image frame, and the display module 220 is used to display the initial image frame.

[0100] Since when the data analysis unit 213 determines that the current user is a user with normal color vision (i.e., the second type), there is no need to adjust the display-related parameters of the initial image frame, and the default preset display settings can be used, the universality of the display device can be improved.

[0101] In step S403, when the user type is determined to be the first type, the image adjustment unit 214 can adjust the display-related parameters of the initial image frame according to the confidence information and sensitivity information corresponding to the RGB three primary colors included in the parameter information, so as to obtain the target image frame.

[0102] The display-related parameters of the initial image frame include one or more of the following: initial contrast parameter, initial color data, initial hue data, and initial saturation data.

[0103] In some embodiments, the image adjustment unit 214 may determine the target contrast parameter based on the sensitivity information corresponding to each of the RGB three primary colors, and use the target contrast parameter to update the initial contrast parameter included in the initial image.

[0104] In a specific implementation, the image adjustment unit 214 can use its own determined target contrast parameters to replace the initial contrast parameters of the initial image. Since the contrast is mainly the contrast of brightness, by increasing the contrast of the image frame, the brightness and darkness of the image frame can be more easily distinguished, and the user's visual experience is better.

[0105] Figure 7 This diagram illustrates the workflow of the image adjustment unit according to an embodiment of the present invention in determining target contrast parameters. Figure 7 As shown, it may include the following steps:

[0106] In step S701, the image adjustment unit 214 can determine the target sensitivity information based on the average value of the sensitivity information corresponding to each of the three primary colors of RGB.

[0107] Specifically, target sensitivity information can be determined in the following ways:

[0108]

[0109] Among them, Y lvl R is used to characterize target sensitivity information. lvl Used to characterize the sensitivity information corresponding to the R primary color, G lvl Used to characterize the sensitivity information corresponding to the G primary color, Blvl Used to characterize the sensitivity information corresponding to the B primary color.

[0110] In practice, for the first type of user, the behavioral information obtained by the data analysis unit 213 is different due to the different types of color vision abnormalities. As a result, the sensitivity information and confidence information of the three primary colors of RGB determined by the data analysis unit 213 based on the behavioral information are also different.

[0111] For example, if the current user is red-blind, the sensitivity information for the R primary color determined by the data analysis unit 213 is far below the normal threshold range, while the sensitivity information for the G primary color and the B primary color are both within their corresponding normal threshold ranges. If the current user is green-blind, the sensitivity information for the C primary color determined by the data analysis unit 213 is far below the normal threshold range, while the sensitivity information for the R primary color and the B primary color are both within their corresponding normal threshold ranges.

[0112] In step S702, the image adjustment unit 214 can determine the target contrast parameters based on the target sensitivity information and the preset maximum contrast threshold.

[0113] In some embodiments, the image adjustment unit 214 may specifically perform an exponential calculation based on the target sensitivity information to obtain intermediate contrast data; and determine the target contrast parameter based on the ratio of the maximum contrast threshold to the intermediate contrast data.

[0114] In practical implementation, the target contrast parameter can be determined in the following ways:

[0115]

[0116] Where Con_ratio is used to characterize the target contrast parameter, Con_max is used to characterize the maximum contrast threshold, and Y... lvl Used to characterize target sensitivity information, Used to characterize intermediate contrast data.

[0117] The maximum contrast threshold Con_max is set according to actual business needs. For example, the maximum contrast threshold Con_max can be set to 4.

[0118] Figure 8 This diagram illustrates the curve relationship between the target contrast parameter and the target sensitivity information provided in an embodiment of the present invention. Figure 8 As shown, the horizontal axis X1 represents the target sensitivity information, and the vertical axis Y1 represents the target contrast parameter, where the maximum contrast threshold Con_max is set to 4. Figure 8It can be seen that the target sensitivity information is directly proportional to the target contrast parameter, that is, the greater the target sensitivity information, the greater the target contrast parameter that needs to be set.

[0119] Therefore, by using the sensitivity information and maximum contrast threshold corresponding to each of the RGB three primary colors, the target contrast parameter is determined, and the initial contrast parameter of the initial image frame is replaced with the target contrast parameter, thereby making the contrast performance of the target image frame more suitable for the current user's viewing and improving the user's visual experience.

[0120] In some embodiments, the image adjustment unit 214 may also construct a color adjustment matrix based on the confidence and sensitivity information corresponding to each of the RGB three primary colors, and use the color adjustment matrix to adjust the initial color data of each pixel included in the initial image frame.

[0121] Each pixel's initial color data can include the initial color component data corresponding to each of the RGB three primary colors, namely: R initial color component data, G initial color component data, and B initial color component data.

[0122] Figure 9 This diagram illustrates the workflow of the image adjustment unit according to an embodiment of the present invention for adjusting initial color data. Figure 9 As shown, it may include the following steps:

[0123] In step S901, for any pixel included in the initial image frame, the image adjustment unit 214 can perform gamma correction processing on the initial color component data corresponding to each of the RGB three primary colors included in the pixel to obtain the intermediate color component data corresponding to each of the RGB three primary colors.

[0124] In practical implementation, taking a pixel Pi in the initial image frame as an example, its corresponding initial pixel data can be represented as: [Ri, Gi, Bi], that is, Ri is the R initial color component data corresponding to pixel Pi, Gi is the G initial color component data corresponding to pixel Pi, and Bi is the B initial color component data corresponding to pixel Pi. Then, gamma correction processing can be performed on each initial color component data in the following way:

[0125]

[0126] Where Ri' represents the intermediate color component data of R corresponding to pixel Pi, Ri represents the initial color component data of R corresponding to pixel Pi, and a is the gamma correction coefficient. This is used to characterize the normalization process performed on the initial color component data of R.

[0127]

[0128] Where Gi' represents the intermediate color component data of G corresponding to pixel Pi, Gi represents the initial color component data of G corresponding to pixel Pi, and a is the gamma correction coefficient. This is used to characterize the normalization process performed on the initial color component data of G.

[0129]

[0130] Where Bi' represents the intermediate B color component data corresponding to pixel Pi, Bi represents the initial B color component data corresponding to pixel Pi, and a is the gamma correction coefficient. This is used to characterize the normalization process performed on the initial color component data of B.

[0131] In practical applications, the gamma correction factor 'a' can be flexibly set according to actual business needs. For example, the gamma correction factor 'a' can be set to 2.2.

[0132] In step S902, the image adjustment unit 214 can determine the target color component data corresponding to each of the RGB three primary colors based on the product of the color adjustment matrix and the intermediate color component data corresponding to each of the RGB three primary colors. The target color data includes the target color component data corresponding to each of the RGB three primary colors, and the target image frame is constructed based on the target color data.

[0133] In some embodiments, the image adjustment unit 214 may determine the color adjustment matrix in the following manner: based on the product of the confidence information corresponding to each of the three RGB primary colors, the sensitivity information corresponding to each of the three RGB primary colors, and the preset initial parameter matrix, the color adjustment matrix is ​​determined.

[0134] In practical implementation, an initial parameter matrix can be set, which can be represented as: Using this initial parameter matrix and the confidence information (Ralpha, Galpha, Balpha) and sensitivity information (Rlvl, Glvl, Blvl) corresponding to each of the RGB primary colors, the determined color adjustment matrix can be expressed as:

[0135]

[0136] In the RGB color adjustment matrix, multiple elements in the same row correspond to the same primary color. For any element in the RGB color adjustment matrix, the element is determined by the product of the confidence information corresponding to the target primary color, the sensitivity information corresponding to the target primary color, and the target initial parameters. The target primary color is determined by the position of the element in the row, and the target initial parameters are the initial parameters in the initial parameter matrix that are at the same position as the element.

[0137] Taking the first element in the RGB color adjustment matrix as an example, the target primary color corresponding to this element is R, and the target initial parameter corresponding to this element is M00. Therefore, this element = Ralpha × Rlvl × M00.

[0138] Having determined the aforementioned RGB color adjustment matrix, multiplying the intermediate color component data [Ri', Gi', Bi'] of each of the three primary colors using this RGB color adjustment matrix yields the target color data [Ro, Go, Bo], including the individual target color component data, as follows:

[0139]

[0140] Wherein, Ro is used to represent the R target color component data corresponding to pixel Pi, Go is used to represent the G target color component data corresponding to pixel Pi, and Bo is used to represent the B target color component data corresponding to pixel Pi.

[0141] Therefore, by using the initial parameter matrix and the color adjustment matrix determined by the sensitivity and confidence information of each of the RGB three primary colors, the initial color data of each pixel in the initial image frame is adjusted, so that the color display of the target image frame used for display is more suitable for the current user and improves the user's visual experience.

[0142] In some embodiments, the image adjustment unit 214 may use the sensitivity information corresponding to each of the RGB three primary colors to adjust the initial hue data and / or the initial saturation data.

[0143] In some embodiments, the image adjustment unit 214 can determine the target hue parameter based on the first pair of relationships and the sensitivity information corresponding to each of the RGB three primary colors, and adjust the initial hue data according to the target hue parameter to obtain the target hue data.

[0144] The first correspondence is used to characterize the relationship between the user's sensitivity to different primary colors and the hue parameters corresponding to different primary colors.

[0145] In one implementation, the hue parameter in the first correspondence can be a hue increment. That is, the image adjustment unit 214 can determine the target hue increment corresponding to the R primary color based on the sensitivity information Ralpha corresponding to the R primary color in the first correspondence, and adjust the initial hue data corresponding to the R primary color according to the target hue increment to determine the target hue data corresponding to the R primary color.

[0146] Based on the sensitivity information Galpha corresponding to the G primary color in the first correspondence, the target hue increment corresponding to the G primary color is determined, and the initial hue data corresponding to the G primary color is adjusted according to the target hue increment corresponding to the G primary color to determine the target hue data corresponding to the G primary color.

[0147] Based on the sensitivity information Balpha corresponding to the B primary color in the first correspondence, the target hue increment corresponding to the B primary color is determined, and the initial hue data corresponding to the B primary color is adjusted according to the target hue increment corresponding to the B primary color to determine the target hue data corresponding to the B primary color.

[0148] Table 1 provides an example of a first type of correspondence:

[0149]

[0150]

[0151] Table 1

[0152] As shown in Table 1, when the sensitivity information Ralpha corresponding to the R primary color falls within the range of c1 to c2, the initial hue data corresponding to the R primary color can be increased by 10% to obtain the target hue data corresponding to the R primary color.

[0153] In another implementation, the hue parameter in the first correspondence can be hue data. That is, the image adjustment unit 214 can directly determine the target hue data corresponding to the R primary color from the first correspondence based on the sensitivity information Ralpha corresponding to the R primary color, and replace the initial hue data corresponding to the R primary color with the target hue data. Since the adjustment method of the initial hue data corresponding to other primary colors is similar to that of the initial hue data corresponding to the R primary color, it will not be described in detail.

[0154] In this approach, the first correspondence can be determined based on a functional relationship, which is used to characterize the relationship between sensitivity information and hue data. The specific functional relationship expression can be flexibly set according to actual business needs, and this embodiment of the invention does not impose any restrictions on it.

[0155] In some embodiments, the image adjustment unit 214 can determine the target saturation parameter based on the second correspondence and the sensitivity information corresponding to each of the RGB three primary colors, and adjust the initial saturation data according to the target saturation parameter to obtain the target saturation data.

[0156] The second correspondence is used to characterize the relationship between the user's sensitivity to different primary colors and the saturation parameters corresponding to different primary colors.

[0157] In one implementation, the saturation parameter in the second correspondence can be a saturation increment. That is, the image adjustment unit 214 can determine the target saturation increment corresponding to the R primary color based on the sensitivity information Ralpha in the second correspondence, and adjust the initial saturation data corresponding to the R primary color according to this target saturation increment to determine the target saturation data corresponding to the R primary color. Furthermore, since the adjustment method for the initial saturation data corresponding to other primary colors is similar to that for the initial saturation data corresponding to the R primary color, it will not be described in detail further.

[0158] In another implementation, the saturation parameter in the second correspondence can be saturation data. That is, the image adjustment unit 214 can directly determine the target saturation data corresponding to the R primary color from the first correspondence based on the sensitivity information Ralpha corresponding to the R primary color, and replace the initial saturation data corresponding to the R primary color with the target saturation data. Since the adjustment method of the initial saturation data corresponding to other primary colors is similar to that of the initial saturation data corresponding to the R primary color, it will not be described in detail.

[0159] In this approach, the second correspondence can be determined based on a functional relationship, which is used to characterize the relationship between sensitivity information and saturation data. The specific functional relationship expression can be flexibly set according to actual business needs, and this embodiment of the invention does not impose any restrictions on it.

[0160] In specific implementation, the image adjustment unit 214 can reserve interfaces for contrast parameters, color data, color manager hue data, and saturation data, for transmitting the corresponding data to the subsequent display module 220.

[0161] Therefore, by utilizing the sensitivity and confidence information corresponding to the three primary colors of RGB, one or more of the initial contrast parameters, initial color data, initial hue data, and initial saturation data of the initial image frame can be adjusted to achieve adaptive adjustment of the image display effect, making the adjusted target image frame suitable for the current type of user and bringing a better viewing experience to the user.

[0162] In step S404, the display module 220 is used to display the target image frame.

[0163] In this embodiment of the invention, by analyzing the ambient light information and user behavior-related data obtained during the power-on process, the user type can be determined without the user's awareness or slight awareness, without needing to know the user type in advance, thus achieving the purpose of protecting user privacy.

[0164] Furthermore, by determining the sensitivity and confidence information of users with different color vision deficiency types (i.e., type 1) regarding the RGB three primary colors, and using this determined sensitivity and confidence information to adjust display-related parameters of the initial image frame, a target image frame is obtained. Since the output sensitivity and confidence information are associated with the user's color vision deficiency type—that is, the parameter information output by users with severe color weakness is different from that of users with mild color weakness—the target image frame determined based on this parameter information is adapted to the current user, requiring no active adjustment from the user, thus allowing the user to obtain the best viewing experience.

[0165] Based on such Figure 3 The structure of the display device shown is as follows: Figure 10 A schematic diagram illustrating the complete workflow of a display device provided in an embodiment of the present invention is shown. Figure 10 As shown, it may include the following steps:

[0166] Step S1001: The test card setting unit 211 integrates the test card into the boot animation.

[0167] In step S1002, when the user is watching the startup animation of the display device 200, the data acquisition unit 212 acquires the user's behavior-related information through the image acquisition component 2121, and acquires the ambient light information of the environment where the display device 200 is located through the light sensor component 2122.

[0168] In step S1003, the data analysis unit 213 can perform data analysis on ambient light information and behavior-related information to determine the user type.

[0169] In step S1004, when the user type is determined to be the first type, the data analysis unit 213 outputs the confidence information corresponding to each of the three RGB primary colors and the sensitivity information corresponding to each of the three RGB primary colors to the image adjustment unit 214.

[0170] In step S1005, the image adjustment unit 214 adjusts the initial contrast parameter, initial color data, initial hue data, and initial saturation data of the initial image frame according to the confidence information and sensitivity information corresponding to the RGB three primary colors respectively, so as to obtain the target image frame.

[0171] In step S1006, the display module 220 displays the target image frame.

[0172] Furthermore, in this embodiment of the invention, other essential components of the display device are those that should be understood by those skilled in the art, and will not be described in detail here, nor should they be construed as limitations on the invention.

[0173] Based on the same concept, this embodiment of the invention also provides a display adjustment method for a display device, which is applied to the display device provided in any of the above embodiments. Since this method is the same method performed by the display device in this embodiment of the invention, and the principle of solving the problem by this method is similar to that of the display device, the implementation of this method can refer to the implementation of the display device, and repeated details will not be described again.

[0174] The method may include the following steps:

[0175] During the power-on process of the display device, ambient light information and user behavior-related information are acquired;

[0176] Data analysis is performed on ambient light information and behavior-related information to determine user type and output parameter information corresponding to the user type. The user type includes a first type for characterizing abnormal color discrimination ability and a second type for characterizing normal color discrimination ability.

[0177] When the user type is determined to be the first type, the display-related parameters of the initial image frame are adjusted according to the confidence and sensitivity information of the RGB three primary colors, which are included in the parameter information, to obtain the target image frame and display it.

[0178] Although preferred embodiments of the invention have been described, those skilled in the art, upon learning the basic inventive concept, can make other changes and modifications to these embodiments. Therefore, the appended claims are intended to be interpreted as including both the preferred embodiments and all changes and modifications falling within the scope of the invention.

[0179] Obviously, those skilled in the art can make various modifications and variations to this invention without departing from its spirit and scope. Therefore, if these modifications and variations fall within the scope of the claims of this invention and their equivalents, this invention also intends to include these modifications and variations.

Claims

1. A display device, characterized in that, It includes a control module and a display module, wherein: The control module is used for: During the power-on process of the display device, ambient light information and user behavior-related information are acquired; Data analysis is performed on the ambient light information and the behavior-related information to determine the user type and output parameter information corresponding to the user type. The user type includes a first type for characterizing abnormal color discrimination ability and a second type for characterizing normal color discrimination ability. When the user type is determined to be the first type, the display-related parameters of the initial image frame are adjusted according to the confidence information and sensitivity information corresponding to the RGB three primary colors included in the parameter information to obtain the target image frame; The display module is used to display the target image frame.

2. The display device as described in claim 1, characterized in that, The display-related parameters of the initial image frame include one or more of the following: initial contrast parameter, initial color data, initial hue data, and initial saturation data; The control module is specifically used for: Based on the sensitivity information corresponding to each of the RGB three primary colors, a target contrast parameter is determined, and the initial contrast parameter included in the initial image is updated using the target contrast parameter, and / or, Based on the confidence and sensitivity information corresponding to each of the RGB three primary colors, a color adjustment matrix is ​​constructed, and the initial color data of each pixel in the initial image frame is adjusted using the color adjustment matrix, and / or, The initial hue data and / or the initial saturation data are adjusted using the sensitivity information corresponding to each of the RGB three primary colors.

3. The display device as described in claim 2, characterized in that, The control module is specifically used for: The color adjustment matrix is ​​determined based on the product of the confidence information corresponding to each of the three RGB primary colors, the sensitivity information corresponding to each of the three RGB primary colors, and the preset initial parameter matrix. In the color adjustment matrix, multiple elements in the same row correspond to the same primary color. For any element in the color adjustment matrix, the element is determined by the product of the confidence information corresponding to the target primary color, the sensitivity information corresponding to the target primary color, and the target initial parameter. The target primary color is determined by the position of the element in the row. The target initial parameter is the initial parameter in the initial parameter matrix that is at the same position as the element.

4. The display device as described in claim 2, characterized in that, The initial color data includes the initial color component data corresponding to each of the RGB three primary colors; the control module is specifically used for: For any pixel included in the initial image frame, gamma correction processing is performed on the initial color component data corresponding to each of the RGB three primary colors included in the pixel to obtain the intermediate color component data corresponding to each of the RGB three primary colors. The target color component data corresponding to each of the RGB primary colors is determined by multiplying the color adjustment matrix with the intermediate color component data corresponding to each of the RGB primary colors. The target color data includes the target color component data corresponding to each of the RGB three primary colors, and the target image frame is constructed based on the target color data.

5. The display device as described in claim 2, characterized in that, The control module is specifically used for: The target sensitivity information is determined based on the average value of the sensitivity information corresponding to each of the three primary colors of RGB. The target contrast parameter is determined based on the target sensitivity information and the preset maximum contrast threshold.

6. The display device as claimed in claim 5, characterized in that, The control module is specifically used for: The target sensitivity information is used to perform an exponential calculation to obtain intermediate contrast data; The target contrast parameter is determined based on the ratio of the maximum contrast threshold to the intermediate contrast data.

7. The display device as claimed in claim 2, characterized in that, The control module is specifically used for: Based on the first pair of relationships and the sensitivity information corresponding to each of the RGB three primary colors, the target hue parameters are determined, and the initial hue data is adjusted according to the target hue parameters to obtain the target hue data, and / or, Based on the second correspondence and the sensitivity information corresponding to each of the RGB three primary colors, the target saturation parameter is determined, and the initial saturation data is adjusted according to the target saturation parameter to obtain the target saturation data; The first correspondence is used to characterize the relationship between the user's sensitivity to different primary colors and the hue parameters corresponding to different primary colors, and the second correspondence is used to characterize the relationship between the user's sensitivity to different primary colors and the saturation parameters corresponding to different primary colors.

8. The display device as claimed in claim 1, characterized in that, The control module is specifically used for: During the power-on process of the display device, the image acquisition component acquires information related to the user's behavior while watching the power-on animation of the display device, and the light sensor component acquires ambient light information about the environment in which the display device is located. The boot animation includes at least one frame of a test image, and the behavior-related information includes one or more of the user's pupil size, interpupillary distance, and user facial expression.

9. The display device as claimed in claim 1, characterized in that, The control module is also used for: When the user type is determined to be the second type, the output parameter information corresponding to the user type is the preset display setting parameter, wherein the preset display setting parameter is the setting parameter when the display device performs normal display; The display module is also used to display the initial image frame.

10. A display adjustment method for a display device, characterized in that, include: During the power-on process of the display device, ambient light information and user behavior-related information are acquired; Data analysis is performed on the ambient light information and the behavior-related information to determine the user type and output parameter information corresponding to the user type. The user type includes a first type for characterizing abnormal color discrimination ability and a second type for characterizing normal color discrimination ability. When the user type is determined to be the first type, the display-related parameters of the initial image frame are adjusted according to the confidence information and sensitivity information corresponding to the RGB three primary colors included in the parameter information to obtain the target image frame and display the target image frame.

Images