Determining method, determining apparatus, driving apparatus, display device and computer medium
By acquiring pixel offset information and performing edge detection in LCD display technology, the target area is determined and then converted to a color contrast space, which solves the problem of low computational efficiency of color separation and achieves efficient color separation suppression and improved display effect.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-01-23
- Publication Date
- 2026-03-27
AI Technical Summary
When using LCD display technology combined with field sequence display technology, the human eye cannot mix the colors of the three RGB subframes, resulting in color separation (CBU). Existing technologies require calculating the degree of color separation of all pixels in each frame of the image, which is slow, inefficient, and time-consuming.
By obtaining pixel offset distance and direction, edge detection is performed to determine the target area. The target pixels of the current image and the offset image are converted to color contrast space, and the degree of color separation is calculated. Only the pixels of the target area need to be processed instead of the entire image, reducing the amount of computation.
It improves the efficiency and accuracy of color separation calculation, effectively suppresses color separation phenomena, and enhances display effects.
Smart Images

Figure CN117912416B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of display devices, and more particularly to a determination method, a determination apparatus, a driving apparatus, a display device, and a computer readable storage medium. BACKGROUND
[0002] Using LCD display technology combined with field sequential display technology, color display can be performed without color filters. However, because the RGB three subframes of the field sequential display technology are given by time-sharing backlight, when the eyeball of a user rotates, the imaging positions of the RGB three subframes of the same target on the retina are inconsistent, so that the human eye vision cannot mix the colors of the RGB three channels, and further, color separation phenomenon (CBU) is generated. The color separation degree can be calculated, the movement of the eyeball is simulated through the offset of the subframes, the color separation effect seen by the human eye is explicitly characterized in an image, and the color separation phenomenon is inhibited through the technology of color gamut compression or color gamut inhibition. In the related art, the color separation degree of all pixels of each frame image needs to be calculated, and the calculation speed is slow, the efficiency is low, and the time is long. SUMMARY
[0003] The present application provides a determination method, a determination apparatus, a driving apparatus, a display device, and a computer readable storage medium.
[0004] The present application provides a determination method for a display device, which can be used in the determination method, including: obtaining a pixel offset distance and a pixel offset direction, the pixel offset distance and the pixel offset direction being used to characterize color separation phenomenon of the display device when displaying a current picture; performing edge detection on the current picture to obtain an edge image; determining a target region according to the edge image, the pixel offset distance, and the pixel offset direction; converting a current target pixel in the target region of the current picture and a reference target pixel in the target region of an offset picture to a color opponent space respectively to obtain a current color opponent information value and an offset color opponent information value, the offset picture being determined according to the current picture, the pixel offset distance, and the pixel offset direction; and determining a color separation degree of the offset picture and the current picture according to the current color opponent information value and the offset color opponent information value.
[0005] In this way, after the current picture is converted into a gray picture, edge detection is performed on the gray picture to obtain an edge image, a target region is determined according to the edge image, the pixel offset distance, and the offset direction, and only the pixels in the target region need to be converted to the color opponent space to determine the color separation degree, without converting all the pixels of the entire picture, so that the calculation amount is greatly reduced, and the calculation efficiency is improved.
[0006] In some embodiments, the determining the target region according to the edge image, the pixel offset distance and the pixel offset direction comprises: determining edges of the current frame according to the edge image; determining a reference edge, the distance between the reference edge and the edge in a positive direction of the pixel offset direction and the distance between the reference edge and the edge in a negative direction of the pixel offset direction are both the pixel offset distance; and determining the target region according to the reference edge.
[0007] In this way, by extending the edges of the edge image to obtain the target region according to the pixel offset distance and the pixel offset direction, the region most affected by color separation can be determined, and in the subsequent process, only the target region needs to be converted to the Lab space to calculate the color separation degree, thereby reducing the calculation amount and improving the calculation efficiency.
[0008] In some embodiments, the edge detection on the current frame to obtain the edge image comprises: converting the current frame to obtain a grayscale frame; and performing edge detection on the grayscale frame to obtain the edge image.
[0009] In this way, the current frame is first converted into a grayscale frame, and then edge detection is performed on the grayscale frame to obtain the edge image, thereby reducing the calculation amount of edge detection and being beneficial to improving the accuracy of edge detection.
[0010] In some embodiments, the edge detection on the grayscale frame to obtain the edge image comprises: performing edge detection on the grayscale frame using a horizontal detection template to obtain a horizontal edge image; performing edge detection on the grayscale frame using a vertical detection template to obtain a vertical edge image; and fusing the horizontal edge image and the vertical edge image to obtain the edge image.
[0011] In this way, the current frame is first subjected to edge detection in the horizontal direction and the vertical direction respectively to obtain a horizontal edge image and a vertical edge image, and then the horizontal edge image and the vertical edge image are fused to obtain a complete edge image.
[0012] In some embodiments, the fusing the horizontal edge image and the vertical edge image to obtain the edge image comprises: fusing the horizontal edge image and the vertical edge image according to a horizontal offset and a vertical offset to obtain the edge image, the horizontal offset being the size of a projection of a pixel offset vector in the horizontal direction, the vertical offset being the size of a projection of the pixel offset vector in the vertical direction, and the pixel offset vector comprising the pixel offset direction and the pixel offset distance.
[0013] Thus, the horizontal offset direction and the vertical offset direction are taken as weights to fuse the horizontal edge image and the vertical edge image to obtain the edge image, complete acquisition of the complete edge image, and determine the edge image based on the pixel offset direction, which can associate the edge image and the pixel offset direction, facilitating subsequent determination of the target region.
[0014] In some embodiments, the fusing the horizontal edge image and the vertical edge image according to the horizontal offset and the vertical offset to obtain the edge image comprises: determining a horizontal weight, the horizontal weight being a proportion of the horizontal offset in a sum of the horizontal offset and the vertical offset; determining a vertical weight, the vertical weight being a proportion of the horizontal offset in the sum of the horizontal offset and the vertical offset; and fusing the horizontal edge image and the vertical edge image according to the horizontal weight and the vertical weight to obtain the edge image.
[0015] Thus, the horizontal weight and the vertical weight are determined according to the horizontal offset and the vertical offset, which can make the fused edge image more consistent with the color separation phenomenon.
[0016] In some embodiments, the current frame and the offset frame each include a plurality of pixels, and the converting the current target pixel in the target region of the current frame and the reference target pixel in the target region of the offset frame to a color-opponent space to obtain a current color-opponent information value and an offset color-opponent information value comprises: converting the current target pixel and the reference target pixel to an XYZ color space to obtain current XYZ information and offset XYZ information; and determining the current color-opponent information value and the offset color-opponent information value according to the current XYZ information and the offset XYZ information.
[0017] Thus, the current target pixel and the reference target pixel are first converted to the XYZ color space and then converted to the current color-opponent information value and the offset color-opponent information value, realizing conversion from the RGB color space to the Lab space.
[0018] In some embodiments, the determining the color separation degree of the offset frame and the current frame according to the current color-opponent information value and the offset color-opponent information value comprises: determining a mean value of distances of the current target pixel and the reference target pixel in the color-opponent space according to the current color-opponent information value and the offset color-opponent information value to determine the color separation degree.
[0019] Thus, according to the current color-opponent information value and the offset color-opponent information value obtained by converting the current target pixel and the reference target pixel to the color-opponent space, the average of the distance between the current target pixel and the reference target pixel in the color-opponent space can be determined, and the average is the color separation degree, i.e., the calculation of the color separation degree is completed.
[0020] In some embodiments, the determining method further comprises: according to the color separation degree, suppressing the color separation phenomenon generated by the display device when displaying the current picture to obtain a processed picture; and driving the display device to display the processed picture.
[0021] Thus, the color separation can be suppressed by combining the determined CBU value, and the display effect can be improved.
[0022] In some embodiments, the suppressing the color separation phenomenon generated by the display device when displaying the current picture according to the color separation degree comprises: determining a color gamut compression ratio according to the color separation degree; and performing color gamut compression on the current picture according to the color gamut compression ratio to suppress the color separation phenomenon generated by the display device when displaying the current picture.
[0023] Thus, the color gamut compression ratio can be determined according to the color separation degree, the dynamic adjustment of the color gamut compression ratio can be realized according to the eye movement speed and the content of the current picture, the accuracy of the color gamut compression result can be improved, and better color separation suppression effect can be achieved.
[0024] The embodiment of the present application provides a determining device for a display device, the determining device comprises an image processing module, the image processing module is used for: acquiring a pixel offset distance and a pixel offset direction, the pixel offset distance and the pixel offset direction are used to reflect a color separation phenomenon of the display device when displaying a current picture; performing edge detection on the current picture to obtain an edge image; determining a target region according to the edge image, the pixel offset distance and the pixel offset direction; converting a current target pixel in the target region of the current picture and a reference target pixel in the target region of an offset picture to a color-opponent space to obtain a current color-opponent information value and an offset color-opponent information value, respectively, the offset picture is determined according to the current picture, the pixel offset distance and the pixel offset direction; and determining a color separation degree of the offset picture and the current picture according to the current color-opponent information value and the offset color-opponent information value.
[0025] Thus, the current picture is converted into a gray picture, the gray picture is subjected to edge detection to obtain an edge image, a target region is determined according to the edge image, the pixel offset distance and the offset direction, and only the pixels of the target region are converted into the color-opponent space to determine the color separation degree, without converting all the pixels of the entire picture, so that the calculation amount is greatly reduced and the calculation efficiency is improved.
[0026] The embodiment of the present application provides a driving device, which comprises a picture rendering module and a driving module, the picture rendering module is used for processing a current picture according to a color separation degree to obtain a processed picture, so as to suppress a color separation phenomenon generated by a display device when displaying the current picture, the color separation degree is determined according to a current color-opponent information value and an offset color-opponent information value, the current color-opponent information value is obtained by converting a current target pixel in a target region of the current picture into a color-opponent space, the offset color-opponent information value is obtained by converting reference target pixels in the target region of the offset picture into the color-opponent space respectively, the target region is determined according to an edge image, a pixel offset distance and a pixel offset direction, and the edge image is obtained by performing edge detection on the current picture; and the driving module is used for driving the display device to display the processed picture.
[0027] Thus, the color separation degree is determined according to the edge of the current picture, and the current picture is processed according to the determined color separation degree, so that the color separation phenomenon of the display device when displaying the current picture can be suppressed, the calculation amount is small, and the calculation speed of the color separation degree is fast.
[0028] The embodiment of the present application provides a display device, which comprises one or more processors and a memory, the memory stores a computer program, and when the computer program is executed by the processor, the steps of the determination method in any of the above embodiments are implemented.
[0029] Thus, the current picture is converted into a gray picture, the gray picture is subjected to edge detection to obtain an edge image, a target region is determined according to the edge image, the pixel offset distance and the offset direction, and only the pixels of the target region are converted into the color-opponent space to determine the color separation degree, without converting all the pixels of the entire picture, so that the calculation amount is greatly reduced and the calculation efficiency is improved.
[0030] The embodiment of the present application provides a computer readable storage medium, which stores a computer program, and when the program is executed by a processor, the steps of the determination method in any of the above embodiments are implemented.
[0031] Thus, the current picture is converted into a gray picture, the edge detection is performed on the gray picture to obtain an edge image, the target region is determined according to the edge image, the pixel offset distance and the offset direction, only the pixels of the target region are converted into the color opposite space to determine the color separation degree, and the calculation amount is greatly reduced, and the calculation efficiency is improved.
[0032] Additional aspects and advantages of the application will be set forth in part in the description which follows, and in part will become apparent to those skilled in the art upon examination of the following and / or can be learned by practice of the application. BRIEF DESCRIPTION OF DRAWINGS
[0033] The above and / or additional aspects and advantages of the present application will become apparent and be readily appreciated from the following description, including the accompanying drawings, wherein:
[0034] Figure 1 is a flowchart of the determination method of the embodiment of the present application;
[0035] Figure 2 is a flowchart of the determination method of the embodiment of the present application;
[0036] Figure 3 is a schematic diagram of the target region of the embodiment of the present application;
[0037] Figure 4 is a flowchart of the determination method of the embodiment of the present application;
[0038] Figure 5 is a flowchart of the determination method of the embodiment of the present application;
[0039] Figure 6 is a schematic diagram of the detection template of the embodiment of the present application;
[0040] Figure 7 is a schematic diagram of the current picture, the edge image and the target region of the embodiment of the present application;
[0041] Figure 8 is a flowchart of the determination method of the embodiment of the present application;
[0042] Figure 9 is a flowchart of the determination method of the embodiment of the present application;
[0043] Figure 10 is a schematic diagram of the pixel offset direction of the embodiment of the present application;
[0044] Figure 11 is a flowchart of the determination method of the embodiment of the present application;
[0045] Figure 12is a flowchart of a determination method of an embodiment of the present application;
[0046] Figure 13 is a flowchart of a determination method of an embodiment of the present application;
[0047] Figure 14 is a schematic diagram of a driving device of an embodiment of the present application;
[0048] Figure 15 is a flowchart of a determination method of an embodiment of the present application;
[0049] Figure 16 is a schematic diagram of a display device of an embodiment of the present application. DETAILED DESCRIPTION
[0050] Embodiments of the present application are described in detail below with reference to the accompanying drawings, in which the same or similar components have the same or similar reference numerals throughout the drawings and have the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are for the purpose of explanation only, and are not to be understood as limiting the present application.
[0051] Using LCD display technology combined with field sequential display technology, color display can be omitted by color filter. However, due to the RGB three sub-frames of the field sequential display technology being given by backlight in time sharing, when the eyeball of the user rotates, the imaging positions of the RGB three sub-frames of the same target on the retina are inconsistent, so that the human eye vision cannot mix the colors of the RGB three channels, and further generates color separation phenomenon (CBU). The degree of color separation can be calculated, the movement of the eyeball is simulated through the offset of the sub-frames, the color separation effect seen by the human eye is explicitly characterized in an image, and the color separation phenomenon is inhibited through the technology of color gamut compression or color gamut inhibition. In the related art, the color separation degree of all pixels of each frame image needs to be calculated, which is slow in calculation speed, low in efficiency, and time-consuming.
[0052] Referring to Figure 1 The embodiment of the present application provides a determination method for a display device, and the determination method comprises the following steps:
[0053] 01: acquiring a pixel offset distance and a pixel offset direction, the pixel offset distance and the pixel offset direction being used to represent a color separation phenomenon of the display device when displaying a current picture;
[0054] 02: performing edge detection on the current picture to obtain an edge image;
[0055] 03: determining a target region according to the edge image, the pixel offset distance and the pixel offset direction;
[0056] 04: converting the current target pixel in the target region of the current picture and the reference target pixel in the target region of the offset picture to a color-opponent space respectively to obtain a current color-opponent information value and an offset color-opponent information value, the offset picture being determined according to the current picture, the pixel offset distance and the pixel offset direction;
[0057] 05: determining the color separation degree of the offset picture and the current picture according to the current color-opponent information value and the offset color-opponent information value.
[0058] Specifically, referring to Figure 2 The determination method of the embodiments of the present application can be implemented by the determination device of the embodiments of the present application, and the determination device comprises an image processing module, which is configured to: acquire a pixel offset distance and a pixel offset direction, the pixel offset distance and the pixel offset direction being used to reflect the color separation phenomenon of the display device when displaying the current picture; perform edge detection on the current picture to obtain an edge image; determine a target region according to the edge image, the pixel offset distance and the pixel offset direction; convert a current target pixel in the target region of the current picture and a reference target pixel in the target region of the offset picture to a color-opponent space respectively to obtain a current color-opponent information value and an offset color-opponent information value, the offset picture being determined according to the current picture, the pixel offset distance and the pixel offset direction; and determine the color separation degree of the offset picture and the current picture according to the current color-opponent information value and the offset color-opponent information value.
[0059] The display device is capable of performing field-sequence display to sequentially display multiple subframes. Any two adjacent subframes can display the same or different colors. The pixel offset distance and pixel offset direction can be preset values or values calculated by the display device's processing module based on eye images captured by the camera. The pixel offset distance is the distance the display device shifts when color separation occurs in the current image compared to when color separation does not occur. The pixel offset direction is the direction the display device shifts when color separation occurs in the current image compared to when color separation does not occur. The image processing module can directly obtain the pixel offset distance and pixel offset direction. Since color separation is most pronounced at the edges of image content, this embodiment of the invention performs edge detection on the current image to extract the edges of the image content, obtaining an edge image containing edge information of the image content. The edge detection method can be direct... Color edge detection is performed on the current color image. Alternatively, the current image can be converted to grayscale first, and edge detection can be performed on the grayscale image. Then, the target region is determined based on the edge image, pixel offset distance, and pixel offset direction. Subsequently, the pixels of the current image and the offset image in the target region only need to be converted to the color contrast space (Lab space) to determine the current color contrast information value and the offset color contrast information value. The current color contrast information value is the L1, a1, b1 value obtained by converting the pixels of the current image in the target region to the color contrast space. The target color contrast information value is the L2, a2, b2 value obtained by converting the pixels of the offset image in the target region to the color contrast space. Here, L1 and L2 represent brightness, a1 and a2 represent red and green intensity, and b1 and b2 represent yellow and blue intensity. Then, the color separation degree (CBU) is calculated based on the current color contrast information value and the offset color contrast information value to complete the CBU calculation. This embodiment of the invention only needs to convert the pixels of the target region to the Lab space, instead of converting all pixels of the image to the Lab space, thus reducing the amount of computation.
[0060] In this way, after converting the current image to grayscale, edge detection is performed on the grayscale image to obtain the edge image. The target area is determined based on the edge image, pixel offset distance, and offset direction. Only the pixels of the target area need to be converted to the color contrast space to determine the degree of color separation, without having to convert all pixels of the entire image, which reduces the amount of computation and improves computational efficiency.
[0061] Please see Figure 2 In some implementations, step 03 (determining the target region based on the edge image, pixel offset distance, and pixel offset direction) includes:
[0062] 031: Determine the edges of the current frame based on the edge image;
[0063] 032: determining a reference edge, the distance between the reference edge and the edge in the positive direction of the pixel shift direction and the distance between the reference edge and the edge in the reverse direction of the pixel shift direction are both the pixel shift distance;
[0064] 033: determining a target region according to the reference edge.
[0065] Specifically, steps 031 to 033 can be implemented by the image processing module, that is, the image processing module can be used to determine the edge of the current frame according to the edge image; determine a reference edge, the distance between the reference edge and the edge in the positive direction of the pixel shift direction and the distance between the reference edge and the edge in the reverse direction of the pixel shift direction are both the pixel shift distance; determine a target region according to the reference edge. Taking the edge determined according to the edge image as the starting point, considering the pixel shift distance of the sub-frame, the reference edge is determined along the positive direction of the pixel shift direction and the reverse direction of the pixel shift direction, the region within the reference edge is the target region of interest, and the region outside the target region is the region of no interest, which can be ignored when calculating the color separation degree. In an embodiment, as shown in the gray part of Figure 3 the edge determined according to the edge image is the solid line in the figure, and since the image content on both sides of the edge has color difference, the image content on both sides of the edge can be regarded as the region of interest. It is known that the pixel shift direction is the lower right corner, and the pixel shift distance is dist, which means that the 1 region on the left side of the edge will shift to the 2 region on the right side of the edge, so taking the actual edge as the center, the reference edge of the dashed line is drawn according to the pixel shift distance along the positive direction and the reverse direction of the pixel shift direction, respectively. The middle region of the reference edge of the two dashed lines is the target region of interest, and then only the pixel conversion of the target region to the Lab space is needed to calculate the color separation degree.
[0066] In this way, by expanding the edge of the edge image according to the pixel shift distance and the pixel shift direction to obtain the target region, the region most affected by the color separation can be determined, and in the subsequent only the pixel conversion of the target region to the Lab space is needed to calculate the color separation degree, which reduces the calculation amount and improves the calculation efficiency.
[0067] Please refer to Figure 4 In some embodiments, step 02 (performing edge detection on the current frame to obtain an edge image) comprises:
[0068] 021: converting the current frame to obtain a gray-scale frame;
[0069] 022: performing edge detection on the gray-scale frame to obtain an edge image.
[0070] Specifically, the step 021 to the step 022 can be implemented by the image processing module, that is, the image processing module can be used to convert the current picture to obtain a gray picture, and perform edge detection on the gray picture to obtain an edge image. The current picture is a color picture, and is in an RGB color space. Since color separation often occurs in an area where the gray level is discontinuous or the gray level continuity is poor, the edge image can be extracted after the current picture is converted into a gray picture. The method for converting the current picture into a gray picture includes a maximum value method, an average value method, a weighted average method, etc. After the current picture is converted into a gray picture, the edge detection is performed on the gray picture to obtain the edge image, so that the calculation amount of the edge detection is reduced. In an embodiment, the weighted average method is used for the gray conversion processing, and the specific formula is as follows:
[0071] Gray(i,j) = a * R(i,j) + b * G(i,j) + g * B(i,j)
[0072] wherein, considering that the sensitivity of the human eye to green is the highest and the sensitivity of the human eye to blue is the lowest, b can be a larger value among the three coefficients, and g can be a smaller value among the three coefficients. According to the formula, the r, g, b values of each pixel of the current picture are weighted to obtain a gray value, so that the conversion from the current picture to the gray picture is realized.
[0073] In this way, the current picture is first converted into a gray picture, and then the edge detection is performed on the gray picture to obtain the edge image, so that the calculation amount of the edge detection is reduced, and the accuracy of the edge detection is improved.
[0074] Please refer to Figure 5 In some embodiments, the step 022 (performing edge detection on the gray picture to obtain an edge image) includes:
[0075] 0221: performing edge detection on the gray picture by using a horizontal detection template to obtain a horizontal edge image;
[0076] 0222: performing edge detection on the gray picture by using a vertical detection template to obtain a vertical edge image;
[0077] 0223: fusing the horizontal edge image and the vertical edge image to obtain an edge image.
[0078] Specifically, the step 030221 to the step 0223 can be implemented by the image processing module, that is, the image processing module can be used to perform edge detection on the gray picture by using a horizontal detection template to obtain a horizontal edge image, perform edge detection on the gray picture by using a vertical detection template to obtain a vertical edge image, and fuse the horizontal edge image and the vertical edge image to obtain an edge image.
[0079] The edge detection performed on the current image can be Sobel edge detection, with two detection templates: a horizontal detection template for detecting horizontal edges and a vertical detection template for detecting vertical edges. The horizontal detection template is used to obtain the horizontal edge image imgH; the vertical detection template is used to obtain the vertical edge image imgV. In one embodiment, the detection templates are as follows: Figure 6 As shown, the left side of the image is the vertical detection template, and the right side is the horizontal detection template. After obtaining the horizontal and vertical edge images, these two edge images are weighted to obtain the final edge image. Edge detection is performed in both directions on the current image (original image), and edge fusion is performed to obtain the edge image. The region of interest is then determined based on the edge image, which is used as the target region. Figure 7 As shown.
[0080] Thus, we first perform edge detection in the horizontal and vertical directions on the current image to obtain horizontal edge images and vertical edge images, and then fuse the horizontal edge images and vertical edge images to obtain a complete edge image.
[0081] Please see Figure 8 In some implementations, step 0223 (fusing the horizontal edge image and the vertical edge image to obtain an edge image) includes:
[0082] 02231: The horizontal and vertical edge images are fused based on the horizontal and vertical offsets to obtain the edge image. The horizontal offset is the magnitude of the projection of the pixel offset vector in the horizontal direction, and the vertical offset is the magnitude of the projection of the pixel offset vector in the vertical direction. The pixel offset vector includes the pixel offset direction and the pixel offset distance.
[0083] Specifically, step 02231 can be implemented by the image processing module, that is, the image processing module can be used to fuse the horizontal edge image and the vertical edge image according to the horizontal offset and the vertical offset to obtain the edge image, the horizontal offset is the size of the projection of the pixel offset vector in the horizontal direction, and the vertical offset is the size of the projection of the offset vector in the vertical direction. The direction of the pixel offset vector is the pixel offset direction, and the size of the pixel offset vector is the pixel offset distance. The pixel offset vector n is projected in the horizontal direction (X direction), and the horizontal offset n x can be obtained. The pixel offset vector n is projected in the vertical direction (Y direction), and the vertical offset n y can be obtained. Fusing the horizontal edge image and the vertical edge image according to the horizontal offset and the vertical offset to obtain the edge image can make the edge information contained in the edge image and the place where the color separation phenomenon is obvious more consistent. In this way, the horizontal offset and the vertical offset are used as weights to fuse the horizontal edge image and the vertical edge image to obtain the edge image, complete the acquisition of the complete edge image, and determine the edge image based on the pixel offset vector. The edge image and the pixel offset vector are associated, which facilitates subsequent determination of the target region.
[0084] Referring to Figure 9 In some embodiments, step 02231 (fusing the horizontal edge image and the vertical edge image according to the horizontal offset and the vertical offset to obtain the edge image) comprises:
[0085] 022311: determining a horizontal weight, the horizontal weight being the proportion of the horizontal offset in the sum of the horizontal offset and the vertical offset;
[0086] 022312: determining a vertical weight, the vertical weight being the proportion of the horizontal offset in the sum of the horizontal offset and the vertical offset;
[0087] 022313: fusing the horizontal edge image and the vertical edge image according to the horizontal weight and the vertical weight to obtain the edge image.
[0088] Specifically, steps 022311 to 022313 can be implemented by the image processing module, that is, the image processing module can be used to determine a horizontal weight, the horizontal weight being the proportion of the horizontal offset in the sum of the horizontal offset and the vertical offset; determine a vertical weight, the vertical weight being the proportion of the horizontal offset in the sum of the horizontal offset and the vertical offset; and fuse the horizontal edge image and the vertical edge image according to the horizontal weight and the vertical weight to obtain the edge image. Referring to Figure 10, the horizontal edge image imgH(i, j) and the vertical edge image imgV(i, j) are fused according to the size of the horizontal offset n_x and the vertical offset n_y to obtain the edge image dst(i, j), and the specific formula is:
[0089] dst(i,j) = imgH(i,j) * w1 + imgV(i,j) * w2
[0090] wherein:
[0091] w1 = n_x / (n_x + n_y)
[0092] w2 = n_x / (n_x + n_y)
[0093] In this way, the horizontal weight and the vertical weight are determined according to the horizontal offset and the vertical offset, so that the edge image obtained by fusion is more consistent with the color separation phenomenon.
[0094] Referring to Figure 11 In some embodiments, the current picture and the offset picture each include a plurality of pixels, and step 04 (converting the current target pixel of the current picture in the target region and the reference target pixel of the offset picture in the target region into a color-opponent space respectively to obtain the current color-opponent information value and the offset color-opponent information value) includes:
[0095] 041: converting the current target pixel and the reference target pixel into an XYZ color space to obtain current XYZ information and offset XYZ information;
[0096] 042: determining the current color-opponent information value and the offset color-opponent information value according to the current XYZ information and the offset XYZ information.
[0097] Specifically, steps 041 and 042 can be implemented by an image processing module, that is, the image processing module can be used to convert the current target pixel and the reference target pixel into an XYZ color space to obtain current XYZ information and offset XYZ information; and determine the current color-opponent information value and the offset color-opponent information value according to the current XYZ information and the offset XYZ information.
[0098] The pixel of the current picture in the target region is the current target pixel, and the pixel of the offset picture in the target region is the reference target pixel. When the current target pixel and the reference target pixel are converted into a color-opponent space (Lab space), since the pixel value of any pixel cannot be directly converted into Lab, the current target pixel and the reference target pixel need to be first converted into an XYZ color space and then converted into Lab. Assuming that r, g, and b are three channel values of the pixel, the value range of R, G, and B is [0, 255], and the conversion formula is:
[0099]
[0100]
[0101] Conventionally, Xn, Yn, Zn are the sum of the first row, the second row, and the third row elements of the M matrix, respectively, so as to obtain the current XYZ information and the offset XYZ information. Further, we have:
[0102]
[0103] wherein a can be 116, d can be 16, b can be 500, g can be 200, and f(t) is:
[0104]
[0105] wherein w th can be 0.008856, and g(t) can be:
[0106]
[0107] Therefore, the current color-opponent information value and the offset color-opponent information value can be determined from the current XYZ information and the offset XYZ information. As can be seen from the above formulae, the process of converting from the RGB color space to the Lab space is relatively complicated and time-consuming, and the embodiments of the present application only need to convert the pixels in the target region of the current picture and the offset picture to the Lab space. In one embodiment, only about 6.91% of the pixel quantity is converted to the Lab space.
[0108] In this way, by first converting the current target pixel and the reference target pixel to the XYZ color space, and then converting to the current color-opponent information value and the offset color-opponent information value, the conversion from the RGB color space to the Lab space is realized.
[0109] Please refer to Figure 12 In some embodiments, step 05 (determining the color separation degree of the offset picture and the current picture according to the current color-opponent information value and the offset color-opponent information value) comprises:
[0110] 051: determining the average value of the distance between the current target pixel and the reference target pixel in the color-opponent space according to the current color-opponent information value and the offset color-opponent information value, so as to determine the color separation degree.
[0111] Specifically, step 051 can be implemented by the image processing module, that is, the image processing module can be used to determine the average of the distances of the current target pixel and the reference target pixel in the color opponent space according to the current color opponent information value and the offset color opponent information value, to determine the color separation degree. After the current target pixel and the reference target pixel are converted to the Lab space, the current color opponent information value and the offset color opponent information value are obtained, the current color opponent information value and the offset color opponent information value corresponding to each pixel are subtracted pixel by pixel, and the average of the spatial distances in the Lab space is calculated. In an embodiment, the ith pixel in the target region of the current picture and the offset picture is converted to the Lab space, to obtain the current color opponent information value (L_i0, a_i0, b_i0) and the offset color opponent information value (L_ip, a_ip, b_ip), and the calculation formula of the CBU is as follows:
[0112]
[0113] wherein N is the number of pixels whose difference between the current color opponent information value and the offset color opponent information value is not zero, and the calculated CBUp=12.87.
[0114] In this way, according to the current color opponent information value and the offset color opponent information value obtained by converting the current target pixel and the reference target pixel to the color opponent space, the average of the distances of the current target pixel and the reference target pixel in the color opponent space can be determined, and the average is the color separation degree, that is, the calculation of the color separation degree is completed.
[0115] Referring to Figure 13 In some embodiments, the determining method further comprises:
[0116] 06: inhibiting the color separation phenomenon generated by the display device when displaying the current picture according to the color separation degree, to obtain a processed picture;
[0117] 07: driving the display device to display the processed picture.
[0118] Specifically, referring to Figure 14 Step 06 can be implemented by the picture rendering module 110 of the driving device 100 in the embodiments of the present application, and step 07 can be implemented by the driving module 120 of the driving device in the embodiments of the present application, that is, the picture rendering module 110 can be used to inhibit the color separation phenomenon generated by the display device when displaying the current picture according to the color separation degree, to obtain a processed picture; and the driving module 120 can be used to drive the display device to display the processed picture.
[0119] The processing method can be color gamut compression or color gamut fitting. The color gamut compression refers to taking a line segment formed by a color gamut vertex and a white point as a saturation adjustment range of the three color subframes, that is, a compression ratio. After saturation adjustment of the subfields, a smaller color gamut triangle is obtained. Each color point in the image is mapped from the original color gamut to the compressed new color gamut, so as to complete the color gamut compression. The color gamut fitting refers to fitting a smallest color gamut triangle, which can envelop all color points in the image. The color gamut vertex of the smallest color gamut triangle is the maximum saturation of the three color subframes. The color gamut triangle can be fitted according to the color separation degree to determine the most accurate color gamut triangle, so as to suppress the color separation phenomenon to the greatest extent. The rendering module can process the current picture by the color gamut compression or the color gamut fitting to obtain a processed picture. The driving module can include a backlight driving module and a panel driving module. The backlight driving module and the panel driving module drive the display device to display according to the processed picture. The determined CBU value can guide the degree of suppression of the color separation, so that a better suppression effect can be achieved. Meanwhile, more color information can be preserved as much as possible under the premise of suppressing the color separation, and the display effect is improved.
[0120] In this way, the color separation can be suppressed in combination with the determined CBU value, and the display effect can be improved.
[0121] Please refer to Figure 15 In some embodiments, the step 06 (suppressing the color separation phenomenon generated by the display device when displaying the current picture according to the color separation degree) includes:
[0122] 061: determining a color gamut compression ratio according to the color separation degree;
[0123] 062: performing color gamut compression on the current picture according to the color gamut compression ratio, so as to suppress the color separation phenomenon generated by the display device when displaying the current picture.
[0124] Specifically, the steps 061 and 062 can be implemented by the picture rendering module 110 of the driving device 100, that is, the picture rendering module 110 can be used to: determine a color gamut compression ratio according to the color separation degree; and perform color gamut compression on the current picture according to the color gamut compression ratio, so as to suppress the color separation phenomenon generated by the display device when displaying the current picture.
[0125] That is, the color gamut compression ratio can be determined according to the determined CBU value, and the color gamut compression can be performed on the current picture, so as to suppress the color separation phenomenon generated by the display device when displaying the current picture. When the color separation degree is more serious, that is, the CBU value is larger, the color gamut compression ratio can be increased; when the color separation is slight, the color gamut compression ratio can be reduced. In this way, the dynamic adjustment of the color gamut compression ratio can be implemented, so as to improve the accuracy of the color gamut compression result and achieve a better color separation suppression effect.
[0126] Therefore, the color gamut compression ratio is determined according to the color separation degree, and the color gamut compression ratio can be dynamically adjusted according to the eye movement speed and the content of the current picture, so that the accuracy of the color gamut compression result is improved, and better color separation suppression effect is achieved.
[0127] The display device 200 provided by the embodiment of the present application comprises one or more processors and a memory, and the memory stores a computer program. When the computer program is executed by the processor, the steps of the determination method of any of the above embodiments are implemented.
[0128] Specifically, referring to Figure 16 , the display device 200 further comprises an acquisition module 210, an eye movement processing module 220, a picture processing module 230, a rendering module 240 and a display module 250. The acquisition module 210 can be a camera or other types of sensors, and is used to capture an eye image. The eye image is transmitted to the eye movement processing module 220. The eye movement processing module 220 processes the eye image to calculate an eye movement speed and an eye movement direction, and calculates a pixel offset distance and a pixel offset direction of a sub-frame according to the eye movement speed and the eye movement direction. The picture processing module 230 obtains a single image or a video stream content source to obtain a current picture, and determines an offset picture according to the pixel offset distance and the pixel offset direction determined by the eye movement processing module 220. Meanwhile, the picture processing module 230 detects an edge of the current picture, determines a target region according to the edge, converts pixels of the target region to a Lab space to calculate a CBU value of the target region, and transmits the CBU value to the rendering module 240. The rendering module 240 performs color gamut compression or color gamut fitting on the image according to the real-time determined CBU value to suppress color separation phenomenon. Then, the rendering module 240 combines a screen parameter and the current picture to perform pixel-by-pixel rendering, and transmits a rendering result to the display module 250. The display module 250 comprises a backlight drive and a panel drive, and the backlight drive and the panel drive drive a display module to display according to the rendering result.
[0129] Therefore, after the current picture is converted to a gray picture, the gray picture is subjected to edge detection to obtain an edge image, and the target region is determined according to the edge image, the pixel offset distance and the offset direction. Only the pixels of the target region need to be converted to a color opponent space to determine the color separation degree, and all pixels of the entire picture do not need to be converted, so that the calculation amount is greatly reduced and the calculation efficiency is improved.
[0130] The embodiment of the present application provides a computer readable storage medium, which stores a computer program. When the program is executed by a processor, the steps of the determination method of any of the above embodiments are implemented.
[0131] Thus, the current picture is converted into a gray picture, the edge detection is performed on the gray picture to obtain an edge image, the target region is determined according to the edge image, the pixel offset distance and the offset direction, and only the pixels of the target region are converted into the color opponent space to determine the color separation degree, without converting all pixels of the whole picture, so that the calculation amount is greatly reduced and the calculation efficiency is improved.
[0132] In the description of the present specification, the description of the terms "one embodiment", "some embodiments", "exemplary embodiment", "example", "specific example" or "some examples" and the like means that the specific features, structures, materials or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present application. In the present specification, the exemplary description of the above terms is not necessarily directed to the same embodiment or example. In addition, the person skilled in the art can combine and combine the different embodiments or examples described in the present specification and the features of the different embodiments or examples without contradiction.
[0133] In addition, the term "connection" should be understood broadly, for example, it can include fixed connection, or detachable connection, or integral connection; it can include direct connection, or indirect connection through intermediate medium, or it can include the communication inside two elements. For the person skilled in the art, the specific meaning of the above terms in the present application can be understood according to the specific circumstances.
[0134] In addition, the terms "first", "second" are only for the purpose of description, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined with "first", "second" can explicitly or implicitly include at least one of the features. In the description of the present application, the meaning of "multiple" is at least two, for example, two, three, etc., unless otherwise specifically limited.
[0135] Any process or method descriptions in flow charts or otherwise described herein can be understood as representing code modules, segments, or portions of code that include one or more executable instructions for implementing specific logic functions or other processes, and the various embodiments of the present application can include additional or fewer functions, in addition to those shown or discussed, and the functions can be performed in the order shown, in reverse order, or in other orders, in accordance with the embodiments of the present application, as will be understood by those skilled in the art.
[0136] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limiting the present application, and the person skilled in the art can make changes, modifications, replacements and variations to the above embodiments within the scope of the present application.
Claims
1. A method for determining, used in a display device, characterized in that, The determination method includes: The pixel offset distance and pixel offset direction are obtained, and the pixel offset distance and pixel offset direction are used to characterize the color separation phenomenon of the display device when displaying the current screen. Perform edge detection on the current image to obtain an edge image; The target region is determined based on the edge image, the pixel offset distance, and the pixel offset direction; The current target pixel in the target area of the current image and the reference target pixel in the target area of the offset image are respectively converted to the color contrast space to obtain the current color contrast information value and the offset color contrast information value. The offset image is determined based on the current image, the pixel offset distance and the pixel offset direction. The degree of color separation between the offset image and the current image is determined based on the current color contrast information value and the offset color contrast information value; Determining the target region based on the edge image, the pixel offset distance, and the pixel offset direction includes: Determine the edges of the current image based on the edge image; A reference edge is determined, wherein the distance between the reference edge and the edge in both the positive and negative directions of the pixel offset direction is the pixel offset distance; The target region is determined based on the reference edge; The step of performing edge detection on the current image to obtain an edge image includes: The current image is converted to a grayscale image; Edge detection is performed on the grayscale image to obtain an edge image.
2. The determination method according to claim 1, characterized in that, The step of performing edge detection on the grayscale image to obtain an edge image includes: The grayscale image is edge-detected using a horizontal detection template to obtain a horizontal edge image; The grayscale image is edge-detected using a vertical detection template to obtain a vertical edge image; The horizontal edge image and the vertical edge image are fused to obtain the edge image.
3. The determination method according to claim 2, characterized in that, The process of fusing the horizontal edge image and the vertical edge image to obtain the edge image includes: The horizontal edge image and the vertical edge image are fused based on the horizontal offset and the vertical offset to obtain the edge image. The horizontal offset is the magnitude of the projection of the pixel offset vector in the horizontal direction, and the vertical offset is the magnitude of the projection of the pixel offset vector in the vertical direction. The pixel offset vector includes the pixel offset direction and the pixel offset distance.
4. The determination method according to claim 3, characterized in that, The step of fusing the horizontal edge image and the vertical edge image based on horizontal and vertical offsets to obtain the edge image includes: Determine the horizontal weight, which is the proportion of the horizontal offset in the sum of the horizontal offset and the vertical offset; Determine the vertical weight, which is the proportion of the horizontal offset in the sum of the horizontal offset and the vertical offset; The horizontal edge image and the vertical edge image are fused according to horizontal and vertical weights to obtain the edge image.
5. The determination method according to claim 1, characterized in that, Both the current frame and the offset frame include multiple pixels. The step of converting the current target pixel of the current frame in the target area and the reference target pixel of the offset frame in the target area to a color contrast space to obtain the current color contrast information value and the offset color contrast information value includes: The current target pixel and the reference target pixel are converted to the XYZ color space to obtain the current XYZ information and the offset XYZ information; The current color contrast information value and the offset color contrast information value are determined based on the current XYZ information and the offset XYZ information.
6. The determination method according to claim 1, characterized in that, Determining the degree of color separation between the offset image and the current image based on the current color contrast information value and the offset color contrast information value includes: The mean distance between the current target pixel and the reference target pixel in the color contrast space is determined based on the current color contrast information value and the offset color contrast information value, so as to determine the degree of color separation.
7. The determination method according to claim 1, characterized in that, The determination method further includes: Based on the degree of color separation, the color separation phenomenon generated by the display device when displaying the current image is suppressed, so as to obtain the processed image; The driver displays the processed image on the display device.
8. The determination method according to claim 7, characterized in that, Suppressing color separation phenomena generated by the display device when displaying the current image based on the degree of color separation includes: The color gamut compression ratio is determined based on the degree of color separation. The current image is compressed according to the stated color gamut compression ratio to suppress color separation when the display device displays the current image.
9. A determining device for displaying a device, characterized in that, The determining device includes an image processing module, which is used for: The pixel offset distance and pixel offset direction are obtained, and the pixel offset distance and pixel offset direction are used to reflect the color separation phenomenon when the display device displays the current screen. Perform edge detection on the current image to obtain an edge image; The target region is determined based on the edge image, the pixel offset distance, and the pixel offset direction; The current target pixel in the target area of the current image and the reference target pixel in the target area of the offset image are respectively converted to the color contrast space to obtain the current color contrast information value and the offset color contrast information value. The offset image is determined based on the current image, the pixel offset distance and the pixel offset direction. The degree of color separation between the offset image and the current image is determined based on the current color contrast information value and the offset color contrast information value; The image processing module is used to determine the target region based on the edge image, the pixel offset distance, and the pixel offset direction. Specifically, the image processing module is used to: Determine the edges of the current image based on the edge image; A reference edge is determined, wherein the distance between the reference edge and the edge in both the positive and negative directions of the pixel offset direction is the pixel offset distance; The target region is determined based on the reference edge; The image processing module is used to perform edge detection on the current image to obtain an edge image. Specifically, the image processing module is used for: The current image is converted to a grayscale image; Edge detection is performed on the grayscale image to obtain an edge image.
10. A driving device for a display device, characterized in that, The driving device includes: The image rendering module is used to process the current image according to the degree of color separation and obtain a processed image to suppress the color separation phenomenon generated by the display device when displaying the current image. The degree of color separation is determined based on the current color contrast information value and the offset color contrast information value. The current color contrast information value is obtained by converting the current target pixel in the target area of the current image to the color contrast space. The offset color contrast information value is obtained by converting the reference target pixel in the target area of the offset image to the color contrast space respectively. The target area is determined based on the edge image, the pixel offset distance, and the pixel offset direction. The edge image is obtained by performing edge detection on the current image. A driving module is used to drive the display device to display the processed image.
11. A display device, characterized in that, The display device includes one or more processors and a memory, the memory storing a computer program that, when executed by the processor, implements the steps of the determination method according to any one of claims 1 to 8.
12. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by a processor, it implements the steps of the determination method according to any one of claims 1 to 8.
Citation Information
Patent Citations
Image processing apparatus and control method therefor
CN102055988A
Color sequence type display control method and device based on deep learning
CN113408655A