Crosstalk compensation effect determination method and device, electronic equipment and storage medium
By obtaining the compensated image and calculating the brightness difference value, objectively evaluating the crosstalk compensation effect, the uncertainty and inefficiency of subjective evaluation in the prior art are solved, and a more accurate and efficient effect evaluation is achieved.
Patent Information
- Application Number
- CN202311426307.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-10-30
- Publication Date
- 2025-05-06
AI Technical Summary
When evaluating the effect of crosstalk compensation, the prior art mainly relies on subjective methods, with uncertainty in the results and inefficiency, and requires professionals to judge, limiting the effectiveness evaluation of developers.
By acquiring the compensated image, the brightness difference value of the region where the crosstalk jump occurs and the region where there is no crosstalk jump occurs, and the crosstalk compensation effect is determined based on the brightness difference value, and an objective effect evaluation is achieved.
By comparing the brightness difference in the compensated image, this method can objectively evaluate the crosstalk compensation effect, improve the accuracy and efficiency of the evaluation, and reduce the dependence on professionals.
Smart Images

Figure CN119941590A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of electronic devices, and more specifically, to a method, device, electronic device and storage medium for determining a crosstalk compensation effect. Background Art
[0002] The crosstalk phenomenon is caused by the coupling capacitance between the pixel metal electrode and the data metal line and the overall deviation of the data voltage in the scanning line, which is closely related to the manufacturing process. The crosstalk phenomenon affects the display effect of the picture, and it is necessary to use certain methods and technologies to reversely compensate for the crosstalk in order to achieve a better display effect. Therefore, the evaluation of the effect after compensation is particularly important. Summary of the invention
[0003] In view of the above problems, the present application proposes a method, device, electronic device and storage medium for determining a crosstalk compensation effect to solve the above problems.
[0004] In a first aspect, an embodiment of the present application provides a method for determining a crosstalk compensation effect, the method comprising: acquiring a compensated image, wherein the compensated image is obtained by performing crosstalk compensation on an image having crosstalk jumps; determining an area in the compensated image where crosstalk jumps occur as a first area, and determining an area in the compensated image other than the first area as a second area; extracting a first brightness value of the first area and a second brightness value of the second area, and calculating a brightness difference between the first brightness value and the second brightness value; and determining a crosstalk compensation effect corresponding to the compensated image based on the brightness difference.
[0005] In a second aspect, an embodiment of the present application provides a device for determining a crosstalk compensation effect, the device comprising: an image acquisition module, used to acquire a compensated image, wherein the compensated image is obtained by performing crosstalk compensation on an image with crosstalk jumps; an area determination module, used to determine an area in the compensated image where a crosstalk jump occurs as a first area, and to determine an area in the compensated image other than the first area as a second area; a brightness difference determination and calculation module, used to extract a first brightness value of the first area and a second brightness value of the second area, and calculate the brightness difference between the first brightness value and the second brightness value; and a crosstalk compensation effect determination module, used to determine the crosstalk compensation effect corresponding to the compensated image based on the brightness difference.
[0006] In a third aspect, an embodiment of the present application provides an electronic device, comprising a memory and a processor, wherein the memory is coupled to the processor, the memory stores instructions, and when the instructions are executed by the processor, the processor executes the above method.
[0007] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which a program code is stored, and the program code can be called by a processor to execute the above method.
[0008] The embodiments of the present application provide a method, an apparatus, an electronic device, and a storage medium for determining a crosstalk compensation effect, and obtain a compensated image, wherein the compensated image is obtained by performing crosstalk compensation on an image with crosstalk jumps, determining an area in the compensated image where the crosstalk jumps occur as a first area, and determining an area other than the first area in the compensated image as a second area, extracting a first brightness value of the first area and a second brightness value of the second area, and calculating a brightness difference between the first brightness value and the second brightness value, and determining a crosstalk compensation effect corresponding to the compensated image based on the brightness difference, thereby determining the crosstalk compensation effect by comparing the brightness difference between an area where the crosstalk jumps occur and an area where the crosstalk jumps do not occur for the compensated image, thereby ensuring the objectivity of the determined crosstalk compensation effect. BRIEF DESCRIPTION OF THE DRAWINGS
[0009] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.
[0010] Figure 1 A schematic flow chart of a method for determining a crosstalk compensation effect provided by an embodiment of the present application is shown;
[0011] Figure 2 A schematic flow chart of a method for determining a crosstalk compensation effect provided by an embodiment of the present application is shown;
[0012] Figure 3 A schematic flow chart of a method for determining a crosstalk compensation effect provided by an embodiment of the present application is shown;
[0013] Figure 4 This application shows Figure 3 FIG. 1 is a flow chart of step S340 of the method for determining the crosstalk compensation effect; FIG.
[0014] Figure 5 This application shows Figure 3 FIG. 1 is a flow chart of step S350 of the method for determining the crosstalk compensation effect; FIG.
[0015] Figure 6 A module block diagram of a device for determining a crosstalk compensation effect provided by an embodiment of the present application is shown;
[0016] Figure 7 A block diagram of an electronic device according to an embodiment of the present application for executing a method for determining a crosstalk compensation effect according to an embodiment of the present application is shown;
[0017] Figure 8 A storage unit for storing or carrying a program code for implementing a method for determining a crosstalk compensation effect according to an embodiment of the present application is shown. DETAILED DESCRIPTION
[0018] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.
[0019] At present, the evaluation methods for the effect after crosstalk compensation are divided into two methods: subjective and objective. Most of them use subjective methods to evaluate the compensation effect before and after crosstalk compensation, that is, the human eye distinguishes the color difference of the area before and after compensation, or uses tools such as color cards to assist in judgment to define the color difference value after compensation. Among them, the current subjective human eye distinguishes the color difference state before and after compensation of the picture with crosstalk, and observes the picture after crosstalk compensation with the human eye to determine whether the crosstalk phenomenon is obvious. In addition, based on the judgment of the human eye, the method of judging with the help of auxiliary tools such as color cards requires professionally trained professional eyes to judge the brightness and chromaticity of the compensated crosstalk part, define its minimum perceptible difference JND value, and define the minimum threshold value to judge whether the effect after compensation meets the standard.
[0020] The subjective judgment method of using human eyes to subjectively distinguish the degree of color difference before and after compensation of a picture with crosstalk has uncertainty in the results, which will reduce work efficiency in practical applications. Although the method of adding the JND value sets a minimum threshold, it requires professionals or experienced personnel to make judgments, which limits the effect evaluation of general developers in the process of developing compensation methods, reduces the wide applicability of the subjective judgment method, and cannot meet the needs of all users.
[0021] In view of the above problems, the inventors have found through long-term research and proposed a method for determining the crosstalk compensation effect, a row-by-row finger, an electronic device, and a storage medium provided in the embodiments of the present application. The crosstalk compensation effect is determined by comparing the brightness difference between the area where the crosstalk jump occurs and the area where the crosstalk jump does not occur for the compensated image, thereby ensuring the objectivity of the determined crosstalk compensation effect. The specific method for determining the crosstalk compensation effect is described in detail in the subsequent embodiments.
[0022] See also Figure 1 , Figure 1The flowchart of the method for determining the crosstalk compensation effect provided by an embodiment of the present application is shown. The method is used to determine the crosstalk compensation effect by comparing the brightness difference between the area where the crosstalk jump occurs and the area where the crosstalk jump does not occur for the compensated image, so as to ensure the objectivity of the determined crosstalk compensation effect. In a specific embodiment, the method for determining the crosstalk compensation effect is applied to Figure 6 The crosstalk compensation effect determination device 200 and the electronic device 100 ( Figure 7 ). The following will take an electronic device as an example to illustrate the specific process of this embodiment. Of course, it can be understood that the electronic device used in this embodiment may include a smart phone, a tablet computer, a wearable electronic device, etc., which is not limited here. Figure 1 The process shown in FIG. 1 is described in detail, and the method for determining the crosstalk compensation effect may specifically include the following steps:
[0023] Step S110: Acquire a compensated image, wherein the compensated image is obtained by performing crosstalk compensation on an image with crosstalk jumps.
[0024] In this embodiment, a compensated image can be obtained, wherein the compensated image is obtained by performing crosstalk compensation on an image with crosstalk jump.
[0025] In some embodiments, when a certain image is obtained, it can be determined whether the image has a crosstalk jump, for example, the color difference of the image can be distinguished by human eyes, or the color difference degree value can be assisted by tools such as color cards to determine whether the image has a crosstalk jump. If it is determined that the image has a crosstalk jump, crosstalk compensation can be performed on the image to obtain the compensated image, so that the compensated image can be obtained.
[0026] As an implementable manner, the electronic device may pre-set and store a target crosstalk compensation method. Based on this, if it is determined that the image has a crosstalk jump, the image may be crosstalk compensated using the target crosstalk compensation method to obtain the compensated image.
[0027] As another implementable method, the electronic device may pre-set and store multiple crosstalk compensation methods. Based on this, if it is determined that the image has a crosstalk jump, the target crosstalk compensation method can be determined from multiple crosstalk compensation methods, and the image is crosstalk compensated by the target crosstalk compensation method to obtain the compensated image. Optionally, determining the target crosstalk compensation method from multiple crosstalk compensation methods may include: determining the target crosstalk compensation method from multiple crosstalk compensation methods based on the image, for example, determining the target crosstalk compensation method from multiple crosstalk compensation methods based on the proportion of the area with crosstalk jumps in the image; determining the target crosstalk compensation method from multiple crosstalk compensation methods based on the shape of the area with crosstalk jumps in the image; determining the target crosstalk compensation method from multiple crosstalk compensation methods based on the severity of the area with crosstalk jumps in the image, etc., which is not limited here.
[0028] In some embodiments, the electronic device may include a camera. When crosstalk compensation has been completed for an image with crosstalk jump, the image after crosstalk compensation can be photographed by the camera to obtain a compensated image. Optionally, the camera may include a front camera, a rear camera, a rotating camera, a telescopic camera, etc., which is not limited here.
[0029] Step S120: determining a region in the compensated image where a crosstalk jump occurs as a first region, and determining a region in the compensated image other than the first region as a second region.
[0030] In this embodiment, when a compensated image is acquired, the area in the compensated image where the crosstalk jump occurs can be determined, and the area in the compensated image where the crosstalk jump exists can be determined as the first area, and when the first area is determined, the area in the compensated image other than the first area can be determined as the second area.
[0031] In some embodiments, before crosstalk compensation is performed on an image with crosstalk jumps, a region in the image with crosstalk jumps where the crosstalk jumps occur may be detected and recorded as a reference region. Accordingly, when crosstalk compensation is performed on an image with crosstalk jumps to obtain a compensated image, a region in the compensated image corresponding to the reference region may be determined as the first region.
[0032] As an implementable method, the row in which a jump occurs in the compensated image can be detected, and the area where the row is located is determined as the first area. Among them, before crosstalk compensation is performed on the image with crosstalk jumps, the row in which the crosstalk jump occurs in the image with crosstalk jumps can be detected and recorded as a reference row. Accordingly, when crosstalk compensation is performed on the image with crosstalk jumps to obtain a compensated image, the area in the compensated image corresponding to the reference row can be determined as the first area. Optionally, the area corresponding to the reference row at least surrounds the reference row, that is, the size of the area corresponding to the reference row can be equal to the size of the reference row, or can be larger than the size of the reference row, which is not limited here.
[0033] As another feasible method, the column in which the jump occurs in the compensated image can be detected, and the area where the column is located is determined as the first area. Among them, before crosstalk compensation is performed on the image with crosstalk jump, the column in which the crosstalk jump occurs in the image with crosstalk jump can be detected and recorded as a reference column. Accordingly, when crosstalk compensation is performed on the image with crosstalk jump to obtain the compensated image, the area corresponding to the reference column in the compensated image can be determined as the first area. Optionally, the area corresponding to the reference column at least surrounds the reference column, that is, the size of the area corresponding to the reference column can be equal to the size of the reference column, or can be larger than the size of the reference column, which is not limited here.
[0034] As another feasible method, the rows and columns in the compensated image where jumps occur can be detected, and the area where the rows and columns are located can be determined as the first area. Among them, before crosstalk compensation is performed on the image with crosstalk jumps, the rows and columns in the image with crosstalk jumps where crosstalk jumps occur can be detected and recorded as reference rows and columns as reference columns. Accordingly, when crosstalk compensation is performed on the image with crosstalk jumps to obtain a compensated image, the area in the compensated image corresponding to the reference rows and reference columns can be determined as the first area. Optionally, the area corresponding to the reference rows and reference columns at least surrounds the reference rows and the reference columns, that is, the size of the area corresponding to the reference rows and reference columns can be equal to the size of the reference rows and reference columns, or can be larger than the size of the reference rows and reference columns, which is not limited here.
[0035] Step S130: extracting a first brightness value of the first area and a second brightness value of the second area, and calculating a brightness difference between the first brightness value and the second brightness value.
[0036] In this embodiment, when the first area and the second area are determined, the brightness value of the first area can be extracted and the extracted brightness value of the first area can be determined as the first brightness value, and the brightness value of the second area can be extracted and the extracted brightness value of the second area can be determined as the second brightness value. Afterwards, when the first brightness value and the second brightness value are obtained, the brightness difference between the first brightness value and the second brightness value can be calculated.
[0037] In some embodiments, when the first area is determined, the first area can be converted into a first grayscale image. For example, the cvCvtColor function in the OpenCV library can be used to convert the first area into the first grayscale image. Then, the mean of the first grayscale image is calculated to reflect the overall brightness of the first area through the mean of the first grayscale image. For example, the cvAvgsqr function in the OpenCV library can be used to calculate the mean of the first grayscale image. Then, the mean of the first grayscale image can be converted into a brightness value to obtain a first brightness value. For example, the mean of the first grayscale image can be multiplied by 255 to obtain the first brightness value, or the mean of the first grayscale image can be converted into a percentage and then multiplied by 100 to obtain the first brightness value.
[0038] In some embodiments, when the second area is determined, the second area can be converted into a second grayscale image. For example, the cvCvtColor function in the OpenCV library can be used to convert the second area into the second grayscale image. Then, the mean of the second grayscale image is calculated to reflect the overall brightness of the second area through the mean of the second grayscale image. For example, the cvAvgsqr function in the OpenCV library can be used to calculate the mean of the second grayscale image. Then, the mean of the second grayscale image can be converted into a brightness value to obtain a second brightness value. For example, the mean of the second grayscale image can be multiplied by 255 to obtain the second brightness value, or the mean of the second grayscale image can be converted into a percentage and then multiplied by 100 to obtain the second brightness value.
[0039] In some embodiments, calculating the brightness difference between the first brightness value and the second brightness value may include: obtaining the first difference by subtracting the second brightness value from the first brightness value, and calculating the absolute value of the first difference to obtain the brightness difference; or obtaining the second difference by subtracting the first brightness value from the second brightness value, and calculating the absolute value of the second difference to obtain the brightness difference.
[0040] Step S140: determining a crosstalk compensation effect corresponding to the compensated image based on the brightness difference value.
[0041] In this embodiment, when the brightness difference value is obtained, the crosstalk compensation effect corresponding to the compensated image can be determined based on the brightness difference value. Optionally, the crosstalk compensation effect corresponding to the compensated image can include a crosstalk compensation effect pass (OK), or can include a crosstalk compensation effect fail (NG).
[0042] In some embodiments, when the brightness difference is obtained, the difference value corresponding to the brightness difference value can be determined. If the difference value of the brightness difference indicates that the brightness difference value is large, it can be determined that the compensated image has a brightness unevenness problem and the crosstalk compensation effect is not passed; if the difference value of the brightness difference indicates that the brightness difference value is small, it can be determined that the compensated image does not have a brightness unevenness problem and the crosstalk compensation effect is passed.
[0043] An embodiment of the present application provides a method for determining a crosstalk compensation effect, wherein a compensated image is obtained by performing crosstalk compensation on an image with crosstalk jumps, a region in the compensated image where the crosstalk jumps occur is determined as a first region, and a region other than the first region in the compensated image is determined as a second region, a first brightness value of the first region and a second brightness value of the second region are extracted, and a brightness difference between the first brightness value and the second brightness value is calculated, and a crosstalk compensation effect corresponding to the compensated image is determined based on the brightness difference, so that the crosstalk compensation effect is determined by comparing the brightness difference between a region where the crosstalk jumps occur and a region where the crosstalk jumps do not occur for the compensated image, thereby ensuring the objectivity of the determined crosstalk compensation effect.
[0044] See also Figure 2 , Figure 2 The flow chart of the method for determining the crosstalk compensation effect provided by an embodiment of the present application is shown. The method is applied to the above electronic device. Figure 2 The process shown in FIG. 1 is described in detail, and the method for determining the crosstalk compensation effect may specifically include the following steps:
[0045] Step S210: Acquire a compensated image, wherein the compensated image is obtained by performing crosstalk compensation on an image with crosstalk jumps.
[0046] Step S220: determining the area in the compensated image where the crosstalk jump occurs as a first area, and determining the area in the compensated image other than the first area as a second area.
[0047] Step S230: extracting a first brightness value of the first area and a second brightness value of the second area, and calculating a brightness difference between the first brightness value and the second brightness value.
[0048] For the detailed description of step S210 to step S230 , please refer to step S110 to step S130 , which will not be repeated here.
[0049] Step S240: If the brightness difference is less than or equal to the brightness difference threshold, it is determined that the crosstalk compensation effect corresponding to the compensated image reaches a preset effect.
[0050] In some embodiments, the electronic device may pre-set and store a brightness difference threshold, wherein the brightness difference threshold is used as a basis for judging the brightness difference. It is understandable that the brightness difference threshold can be used to judge the size of the brightness difference, and a brightness difference that is less than or equal to the brightness difference threshold can be considered to be small, and a brightness difference that is greater than the brightness difference threshold can be considered to be large. In this embodiment, when the brightness difference between the first brightness value and the second brightness value is obtained, the brightness difference can be compared with the brightness difference threshold to determine the size relationship between the brightness difference and the brightness difference threshold.
[0051] Among them, if the brightness difference is determined to be less than or equal to the brightness difference threshold based on the size relationship between the brightness difference and the brightness difference threshold, it can be determined that the brightness difference is small, and it can be determined that the crosstalk compensation effect corresponding to the compensated image reaches the preset effect, that is, the crosstalk compensation effect is passed.
[0052] Step S250: If the brightness difference is greater than the brightness difference threshold, it is determined that the crosstalk compensation effect corresponding to the compensated image does not reach a preset effect.
[0053] Among them, if the brightness difference is determined to be greater than the brightness difference threshold based on the size relationship between the brightness difference and the brightness difference threshold, it can be determined that the brightness difference is large, and it can be determined that the crosstalk compensation effect corresponding to the compensated image does not reach the preset effect, that is, the crosstalk compensation effect fails.
[0054] Step S260: Determine a first crosstalk compensation method corresponding to the compensated image.
[0055] In this embodiment, when it is determined that the crosstalk compensation effect corresponding to the compensated image does not reach the preset effect, the crosstalk compensation method corresponding to the compensated image can be determined and determined as the first crosstalk compensation method.
[0056] In some embodiments, when a crosstalk compensation method is selected to perform crosstalk compensation on an image to obtain a compensated image, a target identifier corresponding to the selected crosstalk compensation method may be recorded, wherein the target identifier may be used to uniquely identify the selected crosstalk compensation method. Based on this, when it is determined that the crosstalk compensation effect corresponding to the compensated image does not reach a preset effect, the recorded target identifier may be obtained, and the selected crosstalk compensation method may be determined as the first crosstalk compensation method based on the target identifier.
[0057] Step S270: selecting a second crosstalk compensation method different from the first crosstalk compensation method from a plurality of crosstalk compensation methods, and performing crosstalk compensation on the image with crosstalk jumps by using the second crosstalk compensation method to obtain a target image.
[0058] In some embodiments, the electronic device may be pre-set with multiple crosstalk compensation methods, and optionally, the multiple crosstalk compensation methods may include a first crosstalk compensation method, a second crosstalk compensation method, a third crosstalk compensation method, ... an Nth crosstalk compensation method, etc., which are not limited here. Among them, the multiple crosstalk compensation methods may be different crosstalk compensation methods, and the multiple crosstalk compensation methods may achieve different crosstalk compensation effects when performing crosstalk compensation for the same image with crosstalk jumps.
[0059] In this embodiment, when a first crosstalk compensation method corresponding to a compensated image is determined and it is determined that the crosstalk compensation effect corresponding to the crosstalk compensation for the image with crosstalk jumps performed by the first crosstalk compensation method does not reach a preset effect, a second crosstalk compensation method different from the first crosstalk compensation method can be selected from multiple crosstalk compensation methods, and crosstalk compensation can be performed on the image with crosstalk jumps by the second crosstalk compensation method to obtain a target image.
[0060] In some embodiments, when crosstalk compensation is performed on the image with crosstalk jumps through the second crosstalk compensation method to obtain a target image, the target image can be used as a compensated image, and the steps of obtaining the compensated image, selecting a second crosstalk compensation method different from the first crosstalk compensation method from multiple crosstalk compensation methods, and performing crosstalk compensation on the image with crosstalk jumps through the second crosstalk compensation method to obtain the target image are repeated until the crosstalk compensation effect corresponding to the obtained target image reaches a preset effect, or until multiple crosstalk compensation methods have been selected.
[0061] In some embodiments, selecting a second crosstalk compensation method different from the first crosstalk compensation method from multiple crosstalk compensation methods may include: selecting a second crosstalk compensation method different from the first crosstalk compensation method from multiple crosstalk compensation methods based on the proportion of areas where crosstalk jumps exist in the image; selecting a second crosstalk compensation method different from the first crosstalk compensation method from multiple crosstalk compensation methods based on the shape of the area where crosstalk jumps exist in the image; selecting a second crosstalk compensation method different from the first crosstalk compensation method from multiple crosstalk compensation methods based on the severity of the area where crosstalk jumps exist in the image, etc., and no limitation is made here.
[0062] An embodiment of the present application provides a method for determining the crosstalk compensation effect, obtaining a compensated image, wherein the compensated image is obtained by performing crosstalk compensation on an image with crosstalk jumps, determining an area in the compensated image where the crosstalk jumps occur as a first area, and determining an area other than the first area in the compensated image as a second area, extracting a first brightness value of the first area and a second brightness value of the second area, and calculating a brightness difference between the first brightness value and the second brightness value, and if the brightness difference is less than or equal to a brightness difference threshold, determining that the crosstalk compensation effect corresponding to the compensated image reaches a preset effect, or if the brightness difference is greater than the brightness difference threshold, determining that the crosstalk compensation effect corresponding to the compensated image does not reach a preset effect, determining a first crosstalk compensation method corresponding to the compensated image, selecting a second crosstalk compensation method different from the first crosstalk compensation method from a plurality of crosstalk compensation methods, and performing crosstalk compensation on the image with crosstalk jumps through the second crosstalk compensation method to obtain a target image. Compared to Figure 1 The method for determining the crosstalk compensation effect shown in the figure, this embodiment also determines that the crosstalk compensation effect reaches the preset effect when the brightness difference is less than or equal to the brightness difference threshold, which can improve the efficiency and accuracy of judging the crosstalk compensation effect. In addition, this embodiment also switches the crosstalk compensation mode when the crosstalk compensation effect does not reach the preset effect, which can improve the crosstalk compensation effect.
[0063] See also Figure 3 , Figure 3 The flow chart of the method for determining the crosstalk compensation effect provided by an embodiment of the present application is shown. The method is applied to the above electronic device. Figure 3 The process shown in FIG. 1 is described in detail, and the method for determining the crosstalk compensation effect may specifically include the following steps:
[0064] Step S310: Acquire a compensated image, wherein the compensated image is obtained by performing crosstalk compensation on an image with crosstalk jumps.
[0065] Step S320: determining the area in the compensated image where the crosstalk jump occurs as a first area, and determining the area in the compensated image other than the first area as a second area.
[0066] For the detailed description of step S310 to step S320, please refer to step S110 to step S120, which will not be repeated here.
[0067] Step S330: extracting the brightness value of each pixel in the first area, and extracting the second brightness value of the second area.
[0068] Among them, in order to eliminate the influence of the sub-pixel mosaic phenomenon caused by the clarity problem of the photographing and improve the accuracy of the calculation results, the present embodiment can adopt the calculation method of averaging. As an implementable method, the rows and columns that generate the crosstalk jump are detected and located, and then the row / column and / or several rows / columns are averaged to determine whether it is bright line crosstalk or dark line crosstalk. If it is bright line crosstalk, the data greater than the mean value of the row / column and / or several rows / columns can be averaged, and the difference between the brightness value of the area without crosstalk jump is calculated. If it is dark line crosstalk, the data less than the mean value of the row / column and / or several rows / columns can be averaged, and the difference between the brightness value of the area without crosstalk jump is calculated. This data processing method can more accurately obtain the brightness difference before and after crosstalk compensation, improve the accuracy of calculation, and reduce the misjudgment rate.
[0069] In this embodiment, the brightness value of each pixel in the first area can be extracted, and the second brightness value of the second area can be extracted. Wherein, the image is composed of pixels, and the pixel is the smallest unit of the image. Each pixel is arranged in a regular pattern in the image space and has a certain connection with each other. Therefore, the brightness value of each pixel in the first area can be extracted.
[0070] In some embodiments, extracting the second brightness value of the second area may include: extracting the brightness value of each pixel in the second area, and performing average calculation on the brightness value of each pixel in the second area to obtain the second brightness value.
[0071] Step S340: Calculate the average brightness value of each pixel in the first area to obtain a first brightness average value.
[0072] In this embodiment, when the brightness values of pixels in the first area are obtained, the brightness values of the pixels in the first area may be averaged to obtain a first brightness average.
[0073] As an implementable method, first, the first region can be converted into a third grayscale image, for example, by using the cvCvtColor function in the OpenCV library to convert the first region into a third grayscale image. Secondly, each pixel in the third grayscale image is traversed and the brightness value corresponding to each pixel is obtained. For example, the corresponding brightness value can be obtained by accessing the grayscale value of each pixel. The larger the grayscale value, the larger the corresponding brightness value, and the smaller the grayscale value, the smaller the corresponding brightness value. Afterwards, the average brightness value of all pixels can be calculated. For example, after traversing all pixels, the average brightness value of all pixels can be calculated, that is, the first brightness mean corresponding to the first region can be obtained.
[0074] See also Figure 4 , Figure 4 This application shows Figure 3 The flowchart of step S340 of the method for determining the crosstalk compensation effect is shown in FIG. Figure 4 The process shown is described in detail, and the method may specifically include the following steps:
[0075] Step S341: Filter each pixel point in the first area based on the brightness value of each pixel point in the first area to obtain a third target pixel point.
[0076] In some embodiments, when the brightness value of each pixel point in the first area is obtained, the pixel points in the first area may be screened based on the brightness value of each pixel point in the first area to obtain the third target pixel point.
[0077] As an implementable method, when the brightness value of each pixel point in the first area is obtained, the each pixel point in the first area can be filtered / denoised based on the brightness value of each pixel point in the first area to obtain the filtered third target pixel point. Based on this, the pixel points with relatively large deviations among the pixel points in the first area can be eliminated, thereby improving the accuracy of the subsequently determined brightness values.
[0078] As an example, when the brightness value of each pixel in the first area is obtained, the average value of each pixel in the first area can be calculated, and then the difference between the brightness value of each pixel and the average value is compared, and based on the difference between the brightness value of each pixel and the average value, the pixels in the first area are screened to obtain the third target pixel. For example, the pixels in the first area whose corresponding brightness value and the average value have a difference greater than a preset difference can be eliminated to obtain the third target pixel.
[0079] As another example, when the brightness value of each pixel in the first area is obtained, the brightness value of each pixel can be compared to obtain a size comparison result, and the pixels in the first area are screened according to the size comparison result to obtain a third target pixel. For example, one or more pixels with the largest and / or smallest brightness value in the first area can be eliminated to obtain the third target pixel.
[0080] Step S342: Calculate the average of the brightness values of the third target pixel points to obtain the first brightness average.
[0081] In this embodiment, when the third target pixel point is obtained, the brightness value of the third target pixel point may be averaged to obtain the first brightness average.
[0082] Step S350: Calculate the brightness difference between the first brightness mean value and the second brightness value.
[0083] In this embodiment, when the first average brightness value and the second brightness value are obtained, the brightness difference between the first average brightness value and the second brightness value may be calculated.
[0084] In some embodiments, calculating the brightness difference between the first brightness mean and the second brightness value may include: obtaining a third difference by subtracting the second brightness value from the first brightness mean, and calculating the absolute value of the third difference to obtain the brightness difference; or, obtaining a fourth difference by subtracting the first brightness mean from the second brightness value, and calculating the absolute value of the fourth difference to obtain the brightness difference.
[0085] See also Figure 5 , Figure 5 This application shows Figure 3 The flowchart of step S350 of the method for determining the crosstalk compensation effect is shown in FIG. Figure 5 The process shown is described in detail, and the method may specifically include the following steps:
[0086] Step S351: determining a crosstalk type corresponding to the first area, wherein the crosstalk type includes bright line crosstalk or dark line crosstalk.
[0087] In some embodiments, when the first brightness mean is obtained, the crosstalk type corresponding to the first area can be determined. Optionally, the crosstalk type can include bright line crosstalk or dark line crosstalk. Bright line crosstalk generally indicates lines or areas with higher brightness and bright colors in the image; dark line crosstalk generally indicates lines or areas with lower brightness and dark colors in the image, such as shadows, black or dark areas.
[0088] As an implementable method, the crosstalk type corresponding to the first area can be determined by distinguishing the color difference between the first area and the second area by human eyes, or by using tools such as color cards to assist in determining the color difference value.
[0089] Step S352: Calculate the average brightness value of each pixel in the first area based on the crosstalk type and the first brightness average value to obtain a second brightness average value.
[0090] In some embodiments, when the crosstalk type corresponding to the first area is determined, the brightness values of each pixel in the first area may be averaged based on the crosstalk type and the first brightness average to obtain a second brightness average.
[0091] As an implementable method, when the crosstalk type corresponding to the first area is determined, the pixel points of the first area can be screened based on the crosstalk type and the first brightness mean, and the brightness values of the screened pixel points can be averaged to obtain the second brightness mean.
[0092] As an example, if the crosstalk type is determined to be bright line crosstalk, a first target pixel point whose brightness value is greater than the first brightness mean can be determined from the pixel points in the first area, and the brightness value of the first target pixel point can be averaged to obtain a second brightness mean.
[0093] As another example, if the crosstalk type is determined to be dark line crosstalk, a second target pixel point whose brightness value is less than the first brightness mean can be determined from the pixel points in the first area, and the brightness values of the second target pixel point can be averaged to obtain a second brightness mean.
[0094] Step S353: Calculate the brightness difference between the second brightness mean value and the second brightness value.
[0095] Step S360: determining a crosstalk compensation effect corresponding to the compensated image based on the brightness difference value.
[0096] For the detailed description of step S360, please refer to step S140, which will not be repeated here.
[0097] An embodiment of the present application provides a method for determining the effect of crosstalk compensation, obtaining a compensated image, wherein the compensated image is obtained by performing crosstalk compensation on an image with crosstalk jumps, determining the area in the compensated image where the crosstalk jumps occur as the first area, and determining the area in the compensated image other than the first area as the second area, extracting the brightness value of each pixel in the first area, and the second brightness value of the remaining second area, calculating the average of the brightness values of each pixel in the first area to obtain a first brightness average, calculating the brightness difference between the first brightness average and the second brightness value, and determining the crosstalk compensation effect corresponding to the compensated image based on the brightness difference. Compared to Figure 1 The method for determining the crosstalk compensation effect shown in the figure, this embodiment also calculates the brightness mean of the brightness values of each pixel point in the crosstalk jump area where there is a crosstalk jump, and calculates the difference between the brightness mean and the brightness value of the area where there is no crosstalk jump, so as to improve the accuracy of the determined crosstalk compensation effect in the case of a mosaic phenomenon.
[0098] See also Figure 6 , Figure 6 The module block diagram of the device for determining the crosstalk compensation effect provided by an embodiment of the present application is shown. The device for determining the crosstalk compensation effect 200 is applied to the above electronic device. Figure 6 The block diagram shown in FIG. 1 is used to illustrate that the crosstalk compensation effect determination device 200 includes: an image acquisition module 210, a region determination module 220, a brightness difference calculation module 230 and a crosstalk compensation effect determination module 240, wherein:
[0099] The image acquisition module 210 is used to acquire a compensated image, wherein the compensated image is obtained by performing crosstalk compensation on an image with crosstalk jump.
[0100] The region determination module 220 is configured to determine a region in the compensated image where a crosstalk jump occurs as a first region, and determine a region in the compensated image other than the first region as a second region.
[0101] Furthermore, the region determination module 220 includes: a crosstalk transition region detection submodule and a region determination submodule, wherein:
[0102] The crosstalk jump area detection submodule is used to detect the rows and / or columns where the crosstalk jump occurs in the compensated image.
[0103] The region determination submodule is used to determine the region where the row is located and / or the region where the column is located as the first region.
[0104] The brightness difference calculation module 230 is used to extract a first brightness value of the first area and a second brightness value of the second area, and calculate a brightness difference between the first brightness value and the second brightness value.
[0105] Furthermore, the brightness difference calculation module 230 includes: a brightness value extraction submodule, a brightness mean acquisition submodule and a brightness difference calculation submodule, wherein:
[0106] The brightness value extraction submodule is used to extract the brightness value of each pixel in the first area and extract the second brightness value of the second area.
[0107] The brightness mean obtaining submodule is used to calculate the mean of the brightness values of each pixel point in the first area to obtain a first brightness mean.
[0108] Furthermore, the brightness mean value obtaining submodule includes: a third target pixel point obtaining unit and a first brightness mean value obtaining unit, wherein:
[0109] The third target pixel point obtaining unit is used to screen the pixels of the first area based on the brightness values of the pixels of the first area to obtain the third target pixel point.
[0110] The first brightness mean value obtaining unit is used to calculate the mean of the brightness values of the third target pixel points to obtain the first brightness mean value.
[0111] The brightness difference calculation submodule is used to calculate the brightness difference between the first brightness mean value and the second brightness value.
[0112] Furthermore, the brightness difference calculation submodule includes: a crosstalk type determination unit, a second brightness mean value acquisition unit and a brightness difference calculation unit, wherein:
[0113] A crosstalk type determination unit is used to determine a crosstalk type corresponding to the first area, wherein the crosstalk type includes bright line crosstalk or dark line crosstalk.
[0114] The second brightness mean value obtaining unit is used to calculate the average brightness value of each pixel point in the first area based on the crosstalk type and the first brightness mean value to obtain a second brightness mean value.
[0115] Furthermore, the second brightness mean value obtaining unit includes: a first target pixel point determining subunit and a first brightness mean value obtaining subunit, wherein:
[0116] The first target pixel point determination subunit is configured to determine, if the crosstalk type is the bright line crosstalk, a first target pixel point having a brightness value greater than the first brightness average value from the pixels in the first area.
[0117] The first brightness mean value obtaining subunit is used to calculate the mean of the brightness values of the first target pixel points to obtain the second brightness mean value.
[0118] Furthermore, the brightness mean value obtaining unit includes: a second target pixel point determination subunit and a second brightness mean value obtaining subunit, wherein:
[0119] The second target pixel point determination subunit is configured to determine, if the crosstalk type is the dark line crosstalk, a second target pixel point having a brightness value less than the first brightness average value from the pixels in the first area.
[0120] The second brightness mean value obtaining subunit is used to calculate the mean of the brightness values of the second target pixel points to obtain the second brightness mean value.
[0121] A brightness difference calculation unit is used to calculate the brightness difference between the second brightness mean value and the second brightness value.
[0122] The crosstalk compensation effect determination module 240 is configured to determine the crosstalk compensation effect corresponding to the compensated image based on the brightness difference value.
[0123] Furthermore, the crosstalk compensation effect determination module 240 includes: a first crosstalk compensation effect determination submodule and a second crosstalk compensation effect determination submodule, wherein:
[0124] The first crosstalk compensation effect determination submodule is used to determine that the crosstalk compensation effect corresponding to the compensated image reaches a preset effect if the brightness difference is less than or equal to a brightness difference threshold.
[0125] The second crosstalk compensation effect determination submodule is used to determine that the crosstalk compensation effect corresponding to the compensated image does not reach a preset effect if the brightness difference is greater than the brightness difference threshold.
[0126] Furthermore, the crosstalk compensation effect determination module 240 further includes: a crosstalk compensation mode determination submodule and a crosstalk compensation mode switching submodule, wherein:
[0127] The crosstalk compensation mode determination submodule is used to determine a first crosstalk compensation mode corresponding to the compensated image.
[0128] The crosstalk compensation mode switching submodule is used to select a second crosstalk compensation mode different from the first crosstalk compensation mode from multiple crosstalk compensation modes, and perform crosstalk compensation on the image with crosstalk jumps through the second crosstalk compensation mode to obtain a target image.
[0129] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.
[0130] In several embodiments provided in the present application, the coupling between modules may be electrical, mechanical or other forms of coupling.
[0131] In addition, each functional module in each embodiment of the present application can be integrated into a processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or software functional modules.
[0132] See also Figure 7 , which shows a structural block diagram of an electronic device 100 provided in an embodiment of the present application. The electronic device 100 may be an electronic device capable of running applications, such as a smart phone, a tablet computer, an e-book, etc. The electronic device 100 in the present application may include one or more of the following components: a processor 110, a memory 120, a touch screen 130, and one or more applications, wherein one or more applications may be stored in the memory 120 and configured to be executed by one or more processors 110, and one or more programs are configured to execute the method described in the aforementioned method embodiment.
[0133] Among them, the processor 110 may include one or more processing cores. The processor 110 uses various interfaces and lines to connect various parts of the entire electronic device 100, and executes various functions and processes data of the electronic device 100 by running or executing instructions, programs, code sets or instruction sets stored in the memory 120, and calling data stored in the memory 120. Optionally, the processor 110 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 110 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 110, but may be implemented separately through a communication chip.
[0134] The memory 120 may include a random access memory (RAM) or a read-only memory (ROM). The memory 120 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing functions (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the following various method embodiments, etc. The data storage area may also store data (such as a phone book, audio and video data, chat record data) created by the electronic device 100 during use.
[0135] See also Figure 8 , which shows a structural block diagram of a computer-readable storage medium provided in an embodiment of the present application. The computer-readable medium 300 stores program codes, which can be called by a processor to execute the method described in the above method embodiment.
[0136] The computer readable storage medium 300 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk, or a ROM. Optionally, the computer readable storage medium 300 includes a non-transitory computer-readable storage medium. The computer readable storage medium 300 has storage space for program code 310 that performs any method steps in the above method. These program codes can be read from or written to one or more computer program products. The program code 310 can be compressed, for example, in an appropriate form.
[0137] In summary, the method, device, electronic device and storage medium for determining the crosstalk compensation effect provided in the embodiments of the present application obtain a compensated image, wherein the compensated image is obtained by performing crosstalk compensation on an image with crosstalk jumps, determining an area in the compensated image where the crosstalk jumps occur as a first area, and determining an area other than the first area in the compensated image as a second area, extracting a first brightness value of the first area and a second brightness value of the second area, and calculating a brightness difference between the first brightness value and the second brightness value, and determining the crosstalk compensation effect corresponding to the compensated image based on the brightness difference, thereby determining the crosstalk compensation effect by comparing the brightness difference between an area where the crosstalk jumps occur and an area where there are no crosstalk jumps for the compensated image, thereby ensuring the objectivity of the determined crosstalk compensation effect.
[0138] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.
Claims
1. A method for determining a crosstalk compensation effect, characterized in that: The method comprises: Acquire a compensated image, wherein the compensated image is obtained by performing crosstalk compensation on an image with crosstalk jump; Determine a region in the compensated image where a crosstalk jump occurs as a first region, and determine a region in the compensated image other than the first region as a second region; Extracting a first brightness value of the first area and a second brightness value of the second area, and calculating a brightness difference between the first brightness value and the second brightness value; Based on the brightness difference, a crosstalk compensation effect corresponding to the compensated image is determined.
2. The method according to claim 1, characterized in that The determining, based on the brightness difference, a crosstalk compensation effect corresponding to the compensated image includes: If the brightness difference is less than or equal to the brightness difference threshold, it is determined that the crosstalk compensation effect corresponding to the compensated image reaches a preset effect; or If the brightness difference is greater than the brightness difference threshold, it is determined that the crosstalk compensation effect corresponding to the compensated image does not reach a preset effect.
3. The method according to claim 2, characterized in that After determining that the crosstalk compensation effect corresponding to the compensated image does not reach a preset effect if the brightness difference is greater than the brightness difference threshold, the method further includes: Determining a first crosstalk compensation method corresponding to the compensated image; A second crosstalk compensation method different from the first crosstalk compensation method is selected from a plurality of crosstalk compensation methods, and crosstalk compensation is performed on the image with crosstalk jumps by using the second crosstalk compensation method to obtain a target image.
4. The method according to any one of claims 1 to 3, characterized in that: The extracting a first brightness value of the first area and a second brightness value of the second area, and calculating a brightness difference between the first brightness value and the second brightness value, comprises: Extracting the brightness value of each pixel in the first area, and extracting the second brightness value of the second area; Calculating the average brightness of each pixel in the first area to obtain a first average brightness value; The brightness difference between the first brightness mean value and the second brightness value is calculated.
5. The method according to claim 4, characterized in that The calculating the brightness difference between the first brightness mean value and the second brightness value comprises: Determine a crosstalk type corresponding to the first area, wherein the crosstalk type includes bright line crosstalk or dark line crosstalk; Calculate the average brightness of each pixel point in the first area based on the crosstalk type and the first brightness average to obtain a second brightness average; The brightness difference between the second brightness mean value and the second brightness value is calculated.
6. The method according to claim 5, characterized in that The calculating the average brightness value of each pixel point in the first area based on the crosstalk type and the first brightness average value to obtain a second brightness average value includes: If the crosstalk type is the bright line crosstalk, determining a first target pixel point whose brightness value is greater than the first brightness average value from each pixel point in the first area; The brightness values of the first target pixel points are averaged to obtain the second brightness average.
7. The method according to claim 5, characterized in that The calculating the average brightness value of each pixel point in the first area based on the crosstalk type and the first brightness average value to obtain a second brightness average value includes: If the crosstalk type is the dark line crosstalk, determining a second target pixel point whose brightness value is less than the first brightness average value from each pixel point in the first area; The brightness values of the second target pixel points are averaged to obtain the second brightness average.
8. The method according to claim 4, characterized in that The step of calculating the average brightness value of each pixel point in the first area to obtain a first average brightness value includes: Filter each pixel point in the first area based on the brightness value of each pixel point in the first area to obtain a third target pixel point; The brightness values of the third target pixel points are averaged to obtain the first brightness average.
9. The method according to any one of claims 1 to 3, characterized in that: The step of determining the area in the compensated image where the crosstalk jump occurs as the first area includes: Detecting rows and / or columns in the compensated image where crosstalk transitions occur; An area where the row is located and / or an area where the column is located is determined as the first area.
10. A device for determining a crosstalk compensation effect, characterized in that: The device comprises: An image acquisition module, used for acquiring a compensated image, wherein the compensated image is obtained by performing crosstalk compensation on an image with crosstalk jump; A region determination module, configured to determine a region in the compensated image where a crosstalk jump occurs as a first region, and determine a region in the compensated image other than the first region as a second region; a brightness difference calculation module, configured to extract a first brightness value of the first area and a second brightness value of the second area, and calculate a brightness difference between the first brightness value and the second brightness value; A crosstalk compensation effect determination module is used to determine the crosstalk compensation effect corresponding to the compensated image based on the brightness difference value.
11. An electronic device, characterized in that: The method comprises a memory and a processor, wherein the memory is coupled to the processor, the memory stores instructions, and when the instructions are executed by the processor, the processor executes the method according to any one of claims 1 to 9.
12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores program codes, which can be called by a processor to execute the method according to any one of claims 1 to 9.