Video image processing method and device, electronic equipment and storage medium
By dividing the image into regions based on brightness differences and using different ODC modes for compensation, the problem of poor image display in the prior art is solved, and the visual effect of the image is improved.
Patent Information
- Application Number
- CN202310524208.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-10
- Publication Date
- 2026-01-09
- Estimated Expiration
- 2043-05-10
AI Technical Summary
In existing technologies, image processing methods cannot comprehensively improve the visual effect of image display, especially in the low-frequency and high-frequency regions where the compensation is not precise enough, resulting in poor image processing performance.
By obtaining the brightness value difference between adjacent frames, the image region is divided, and different overdrive compensation ODC modes are used to process different regions to ensure that overcompensation does not occur in high-frequency regions.
It improves the visual effect of each region after image processing, ensures that high-frequency regions are not affected, and achieves better image quality.
Smart Images

Figure CN116600094B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present disclosure relates to the technical field of computer, and particularly relates to a video image processing method and device, electronic equipment and storage medium. BACKGROUND
[0002] In image processing, it is often necessary to compensate for low-frequency image regions to improve the visual effect of image display. However, this method cannot comprehensively compensate for the image, thereby resulting in poor image processing effect. SUMMARY
[0003] The present disclosure aims to at least partially solve one of the technical problems in the related art.
[0004] The first aspect of the present disclosure provides a video image processing method, comprising:
[0005] obtaining a first luminance value corresponding to each pixel point in an i-th image and a second luminance value corresponding to each pixel point in an i+1-th image, wherein i is a natural number;
[0006] determining a luminance change value corresponding to each pixel point in the i+1-th image according to a difference between the first luminance value and the second luminance value;
[0007] determining a first region satisfying a preset condition and a second region not satisfying the preset condition contained in the i+1-th image according to the luminance change value corresponding to each pixel point;
[0008] performing ODC processing on the first region and the second region based on different ODC modes, respectively.
[0009] The second aspect of the present disclosure provides a video image processing device, comprising:
[0010] an obtaining module configured to obtain a first luminance value corresponding to each pixel point in an i-th image and a second luminance value corresponding to each pixel point in an i+1-th image, wherein i is a natural number;
[0011] a first determining module configured to determine a luminance change value corresponding to each pixel point in the i+1-th image according to a difference between the first luminance value and the second luminance value;
[0012] a second determining module configured to determine a first region satisfying a preset condition and a second region not satisfying the preset condition contained in the i+1-th image according to the luminance change value corresponding to each pixel point;
[0013] a processing module configured to perform ODC processing on the first region and the second region based on different ODC modes, respectively.
[0014] A third aspect of the present disclosure provides a computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the video image processing method according to the first aspect of the present disclosure when executing the program.
[0015] A fourth aspect of the present disclosure provides a computer-readable storage medium storing a computer program, wherein the computer program is executable on a processor to implement the video image processing method according to the first aspect of the present disclosure.
[0016] A fifth aspect of the present disclosure provides a computer program product comprising a computer program, wherein the computer program is executable on a processor to implement the video image processing method according to the first aspect of the present disclosure.
[0017] The video image processing method, device, computer device, and storage medium provided by the present disclosure have the following beneficial effects:
[0018] In the embodiments of the present disclosure, first, the first luminance value corresponding to each pixel point in the i-th image and the second luminance value corresponding to each pixel point in the i+1-th image are obtained, then the luminance change value corresponding to each pixel point in the i+1-th image is determined according to the difference between the first luminance value and the second luminance value, then the first region satisfying the preset condition and the second region not satisfying the preset condition contained in the i+1-th image are determined according to the luminance change value corresponding to each pixel point, and finally the ODC processing is performed on the first region and the second region based on different ODC modes. Thus, the image is divided into different regions based on the luminance change value of the pixel point in the image, and different ODC modes are used to compensate different regions, so that the visual effect of each region of the processed image is improved and enhanced.
[0019] The additional aspects and advantages of the present disclosure will be partially given in the following description, partially will become obvious from the following description, or will be understood through the practice of the present disclosure. BRIEF DESCRIPTION OF DRAWINGS
[0020] The above and / or additional aspects and advantages of the present disclosure will become apparent and more readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings, in which:
[0021] Figure 1 A flowchart of a video image processing method provided by an embodiment of the present disclosure;
[0022] Figure 2 A flowchart of a video image processing method provided by an embodiment of the present disclosure;
[0023] Figure 3 A structural schematic diagram of a video image processing method and device provided by an embodiment of the present disclosure is shown.
[0024] Figure 4 A structural diagram of a display driving chip (DDIC) suitable for implementing an embodiment of the present disclosure is shown.
[0025] Figure 5 A structural diagram of an electronic device suitable for implementing an embodiment of the present disclosure is shown.
[0026] Figure 6 A block diagram of an exemplary computer device suitable for implementing an embodiment of the present disclosure is shown. DETAILED DESCRIPTION
[0027] Embodiments of the present disclosure are described in detail below with reference to the accompanying drawings, in which examples of embodiments are shown, and in which like or similar designations denote like or similar elements or elements having the same or similar functions throughout the figures. The embodiments described below by reference to the drawings are exemplary and are intended to explain the present disclosure, and cannot be understood as a limitation of the present disclosure.
[0028] In related technologies, the same overdrive compensation algorithm is usually used for high-frequency image regions and low-frequency image regions. The low-frequency regions are well processed, but problems occur in the high-frequency regions, resulting in poor effects. At the same time, when compensating for images in motion, potential compensation regions are not considered, so that part of the compensable regions appearing in the high-frequency image regions are ignored, resulting in poor image processing effects and affecting the visual effects of the images.
[0029] The present disclosure proposes a video image processing method to solve the above problems. The brightness change value corresponding to each pixel point in the current frame image is determined based on the pixel values of each pixel point in the adjacent previous frame image. Then, the current frame image is divided into different regions based on the brightness change value. Then, different overdrive compensation modes are used for different regions, so that the visual effects of each region of the processed image are improved and enhanced.
[0030] The video image processing method, device, electronic device and storage medium of the embodiments of the present disclosure are described below with reference to the accompanying drawings.
[0031] Figure 1 A flowchart of a video image processing method provided by an embodiment of the present disclosure is shown.
[0032] As Figure 1 shown, the video image processing method can include the following steps:
[0033] In step 101, a first luminance value corresponding to each pixel point in the i-th frame image and a second luminance value corresponding to each pixel point in the i+1-th frame image are obtained, where i is a natural number.
[0034] A frame can be used to describe an image in a video image. A frame is a still image, and continuous frames form an animation. The i-th frame is the i-th still image.
[0035] A pixel point is the smallest light-emitting unit for displaying a picture of a display and is composed of three pixel units of red, green and blue (RGB).
[0036] A luminance value is used to reflect the brightness of a pixel point. Generally, the larger the pixel value of a pixel point, the larger the luminance value, and vice versa.
[0037] In the present disclosure, each pixel point is composed of three RGB channels. When the luminance value corresponding to a pixel point is obtained, different ways can be used to determine the luminance value corresponding to the pixel point according to different settings. For example, the luminance value of a pixel point is set to be the maximum value in the RGB channel, and then the luminance value can be determined based on the maximum value in the RGB channel of the pixel point. Alternatively, the luminance value of a pixel point is set to be the average value of the RGB channel, and then the luminance value of the pixel point can be determined based on the average value of the RGB channel. The present disclosure does not limit this.
[0038] In some possible implementation forms, when the luminance value corresponding to a pixel point is obtained according to a set way, the set way can also be to determine the luminance value based on a value in another color space. Then the RGB color space can be converted into another color space, and then the luminance value can be determined. For example, the RGB color space can be converted into a YUV color space, and the Y component can be used as the luminance value of the pixel point. The RGB color space can also be converted into an HSL color space, and the L component can be used as the luminance value of the pixel point. The RGB color space can also be converted into an HSV color space, and the V component can be used as the luminance of the pixel.
[0039] A YUV color space is a color space in which a colorful picture is divided into a luminance signal (Luminance) Y representing brightness and two chrominance signals (Chrominance) U and V representing color. The U and V channels are blue and red channels respectively, and the Y channel represents luminance information. The higher the value of the U channel, the closer the color is to blue. The higher the value of the V channel, the closer the color is to red. The higher the value of the Y channel, the brighter the picture.
[0040] HSL color space, is to get a variety of colors by changing the hue (Hue), saturation (Saturation), lightness (Lightness) three color channels and their mutual superposition. Among them, hue, is the color name, such as "red", "blue". Saturation, is the purity of color, the greater the value, the less gray in color, the more colorful, presents a change from gray to pure color. Lightness, is the brightness of color, the smaller the value, the darker the color, closer to black; the greater the value, the brighter the color, closer to white.
[0041] HSV color space, is to represent color by changing the hue (hue), saturation (Saturation), brightness (Value) three color channels and their mutual superposition. Among them, brightness (Value), is the brightness of color, 0 is black, the maximum brightness is the most vivid state of color, its range is 0~1.
[0042] For example, in a continuous image, the first brightness value corresponding to each pixel point of the i-th frame image is: 0, 0, 0, 0, 0, 0, 0, 0. The second brightness value corresponding to each pixel point of the i+1-th frame image is: 100, 0, 175, 103, 242, 191, 89, 171, 201, 166.
[0043] Step 102, according to the difference between the first brightness value and the second brightness value, determine the brightness change value corresponding to each pixel point in the i+1-th frame image.
[0044] In this disclosure, after obtaining the first brightness value corresponding to each pixel point in the i-th frame image and the second brightness value corresponding to each pixel point in the i+1-th frame image, the difference between the second brightness value and the first brightness value can be obtained, and the absolute value is the brightness change value corresponding to each pixel point in the i+1-th frame image.
[0045] Taking the above example, the difference between the first brightness value and the second brightness value is: 100, 0, 175, 103, 242, 191, 89, 171, 201, 166, then the brightness change value corresponding to each pixel point in the i+1-th frame image is: 100, 0, 175, 103, 242, 191, 89, 171, 201, 166.
[0046] Step 103, according to the brightness change value corresponding to each pixel point, determine the first region satisfying the preset condition and the second region not satisfying the preset condition contained in the i+1-th frame image.
[0047] The preset condition is various conditions pre-configured for region division of the image. For example, the preset condition can include an intensity threshold parameter and a distance threshold parameter. The intensity threshold parameter is a critical value parameter of a luminance change value corresponding to a pixel point. The distance threshold parameter is a critical value parameter for distinguishing whether a pixel point in the distance range is a first region or a second region. The present disclosure does not limit this.
[0048] The first region is a region directly or indirectly showing linear transition in the i+1th image. The second region is a non-linear transition region.
[0049] In some possible implementation forms, in a case where luminance change values corresponding to the first number of continuous pixel points are all greater than the first change threshold, it is determined that the region composed of the first number of continuous pixel points is the first region satisfying the preset condition, and other regions are the second region. The first number is greater than or equal to the first number threshold.
[0050] The first number of pixel points are a plurality of continuous pixel points in the i+1th image. The first number threshold can be determined based on the preset condition, or can be a preset value, and the present disclosure does not limit this. In addition, the first number of pixel points can be a plurality of continuous pixel points in the same row, the same column, or the same diagonal direction in the i+1th image. The present disclosure does not limit this.
[0051] The first change threshold is a change threshold for distinguishing the first region and the second region in the preset condition.
[0052] In some possible implementation forms, in a case where a straight line slope of the second number of continuous pixel points and corresponding luminance change values is non-zero, and luminance change values corresponding to a preset proportion of pixel points in the second number of continuous pixel points are all greater than the first change threshold, it is determined that the region composed of the second number of continuous pixel points is the first region satisfying the preset condition, and other regions are the second region. The second number is greater than or equal to the second number threshold.
[0053] The second number of pixel points are a plurality of continuous pixel points in the i+1th image. The second number threshold can be different from the first number threshold, or can be the same, and the present disclosure does not limit this. In addition, the second number of pixel points can be a plurality of continuous pixel points in the same row, the same column, or the same diagonal direction in the i+1th image. The present disclosure does not limit this.
[0054] The preset ratio is a value set in the preset conditions. When the proportion of pixels with brightness changes greater than the first change threshold to the total number of pixels is greater than the preset ratio, the area composed of the second consecutive number of pixels can be determined as the first area; otherwise, it is the second area. The preset ratio may be any value such as 80%, 90%, or 95%. For different devices or different types of videos, the preset ratio may be the same or different, and this disclosure does not limit it.
[0055] In some possible implementations, after determining the brightness change value corresponding to each consecutive pixel, the brightness difference slope can be calculated based on the brightness difference between each pixel. If there are multiple brightness difference slopes calculated for each consecutive pixel, then the consecutive pixels can be divided into different feature regions using the pixel coordinates where the slope changes at each step as the boundary. The inter-frame brightness difference curve of the consecutive pixels, constructed with the x-coordinate of each region as the pixel coordinate and the pixel brightness change value as the y-coordinate, might look like this: Figure 1.1 As shown.
[0056] If the slope of the inter-frame brightness difference curve is zero, but the brightness change values corresponding to a first number of consecutive pixels are all greater than a first change threshold, then the region consisting of the first number of consecutive pixels can be determined as the first region, and the other regions as the second region. Figure 1.2 As shown in the figure, the dashed line represents the intensity threshold, and L_TH represents the first quantity threshold.
[0057] like Figure 1.2 As shown, the m-th row of two adjacent frames are line segments with the same intensity. Therefore, the brightness difference corresponding to the pixel is represented as a horizontal line in the coordinate space with a slope of 0. Since the pixel brightness difference is greater than the intensity threshold, the region composed of this part of the pixels is determined as the first region.
[0058] If the slope of the inter-frame brightness difference curve is non-zero, and the brightness change values corresponding to a preset proportion of pixels in a consecutive second number of pixels are all greater than the first change threshold, then the region composed of consecutive pixels is determined as the first region, and the other regions are designated as the second region. Figure 1.3 As shown.
[0059] like Figure 1.3 As shown, the brightness difference between the m-th row pixels of two adjacent frames is represented by a non-zero slope in coordinate space. Therefore, both the change in pixel brightness and the change in pixel brightness difference are linear functions. Although the brightness difference corresponding to the 0th pixel is 0, which is less than the intensity threshold, the brightness change values corresponding to 90% of the pixels are greater than the intensity threshold. Therefore, the region composed of these pixels can also be defined as the first region.
[0060] At step 104, the first region and the second region are subjected to ODC processing based on different over drive compensation (ODC) modes respectively.
[0061] The over drive compensation (ODC) mode is a kind of image quality compensation algorithm. In the compensation process, the difference between the pixel value of the current frame image and the pixel value of the previous frame image is calculated, the over drive gain is obtained, and the over drive gain is added to the pixel value of the current frame image.
[0062] In the present disclosure, since the first region is a region directly or indirectly represented as a linear change, and the second region is a non-linear change region, that is, the first region is a low frequency region, and the second region is a high frequency region, when the first region and the second region are subjected to ODC processing based on different over drive compensation (ODC) modes, the ODC compensation value adopted by the first region can be greater than the ODC compensation value corresponding to the second region, so that each region in the image can be subjected to ODC compensation, and the problem of over compensation in the high frequency region is avoided.
[0063] The ODC compensation value corresponding to different regions can be pre-configured, or can be actually calculated based on the relationship between the current luminance difference and the change threshold. The present disclosure does not limit this.
[0064] In the embodiment of the present disclosure, first, the first luminance value corresponding to each pixel point in the i-th frame image and the second luminance value corresponding to each pixel point in the i+1-th frame image are obtained, then the luminance change value corresponding to each pixel point in the i+1-th frame image is determined according to the difference between the first luminance value and the second luminance value, and then the first region satisfying the preset condition and the second region not satisfying the preset condition contained in the i+1-th frame image are determined according to the luminance change value corresponding to each pixel point, and finally the first region and the second region are subjected to ODC processing based on different over drive compensation (ODC) modes respectively. Thereby, the image is divided into different regions based on the luminance change value of the pixel point in the image, and different ODC modes are used for compensation of different regions, so that the visual effect of each region of the processed image is improved and enhanced.
[0065] Figure 2 A flowchart of a video image processing method provided by an embodiment of the present disclosure.
[0066] As shown in the figure, the video image processing method can include the following steps: Figure 2
[0067] At step 201, the first luminance value corresponding to each reference pixel point in the i-th frame image is obtained from the storage area.
[0068] The storage area is an address space for storing the luminance values of the pixels of the image.
[0069] The reference pixel points are part of the pixel points in the i-th image. In order to reduce the storage resource occupied by the image processing process as much as possible, in the present disclosure, only the luminance values of part of the pixel points in the image can be stored. That is, the number of reference pixel points is less than the total number of pixel points in each image. For example, the first luminance value of one pixel point can be stored every other pixel point, or the first luminance value of one pixel point can be stored every two pixel points.
[0070] It should be noted that, since the first luminance value of the pixel points in each image is only used to calculate the luminance change value corresponding to the pixel points in the next image, in the present disclosure, the storage area required is only used to store the first luminance value corresponding to the reference pixel points in one image. For this storage area, in each image processing process, a reading process (reading the first luminance value corresponding to the reference pixel points in the previous image) and a writing process (writing the second luminance value corresponding to the reference pixel points in the current image into the storage area) are required.
[0071] In step 202, the first luminance value of the pixel point associated with each reference pixel point in the i-th image is determined according to the first luminance value corresponding to each reference pixel point.
[0072] The pixel point associated with the reference pixel point is a pixel point adjacent to the reference pixel point in the i-th image, or a pixel point having a distance less than a distance threshold from the reference pixel point. Since the storage area does not store the first luminance value corresponding to the associated pixel point, the first luminance value of the associated pixel point can be calculated based on the first luminance value of the reference pixel point adjacent or close to it.
[0073] In some possible implementation forms, the first luminance value of the reference pixel point can be directly determined as the first luminance value of the associated pixel point, or the first luminance values of a plurality of reference pixel points can be weighted and summed to determine the first luminance value of the associated pixel point based on the distance between the associated pixel point and the plurality of reference pixel points.
[0074] In step 203, the second luminance value corresponding to each pixel point in the i+1-th image is determined according to the maximum value or the average value of the sub-pixels contained in each pixel point in the i+1-th image.
[0075] The specific implementation of step 203 can refer to the detailed description of other embodiments of the present disclosure, which will not be described here.
[0076] It should be noted that the step 203 can be performed before the step 201 and the step 202, or can be performed in parallel with the step 201 and the step 202, and the present disclosure does not limit this.
[0077] In some possible implementation forms, the calculation manner of the second luminance value corresponding to each pixel point in the i+1th frame image can be determined with reference to the determination manner of the first luminance value corresponding to each pixel point in the ith frame image in the present disclosure. For example, if the first luminance value corresponding to each pixel point in the ith frame image is determined based on the maximum value of the sub-pixels included in each pixel point, then the second luminance value corresponding to each pixel point in the i+1th frame image can also be determined based on the maximum value of the sub-pixels included in each pixel point; or if the first luminance value corresponding to each pixel point in the ith frame image is determined based on the average value of the sub-pixels included in each pixel point, then the second luminance value corresponding to each pixel point in the i+1th frame image can also be determined based on the average value of the sub-pixels included in each pixel point.
[0078] In step 204, a luminance change value corresponding to each pixel point in the i+1th frame image is determined according to the difference between the first luminance value and the second luminance value.
[0079] In the specific implementation forms of the step 204, refer to the detailed description of other embodiments of the present disclosure, which will not be repeated here.
[0080] In step 205, a candidate pixel point included in the i+1th frame image and corresponding to a luminance change value greater than a second change threshold is determined.
[0081] The second change threshold is a change threshold for distinguishing the high-frequency region and the low-frequency region set in the preset condition.
[0082] In some possible implementation forms, after the luminance change value corresponding to each pixel point included in the i+1th frame image is determined, the pixel points in the i+1th frame image are first filtered based on the second change threshold to distinguish the low-frequency region and the high-frequency region. The pixel points included in the determined high-frequency region correspond to a luminance change value greater than the second change threshold.
[0083] In step 206, a first region included in the i+1th frame image and satisfying the preset condition and a second region included in the i+1th frame image and not satisfying the preset condition are determined according to the luminance change value corresponding to the candidate pixel point.
[0084] In the present disclosure, after the candidate pixel points included in the i+1th frame image are determined, the first region satisfying the condition and the second region not satisfying the preset condition are determined from the candidate pixel points based on the positions of the candidate pixel points and the preset condition.
[0085] For example, the second change threshold is 10. After screening, it is known that the luminance change values corresponding to the continuous 10 pixel points in the kth row in the i+1th frame image are all greater than the second change threshold, and the luminance change values corresponding to the continuous 19 pixel points in the mth row are all greater than the second change threshold, that is, the i+1th frame image contains 10+19 candidate pixel points. The quantity threshold in the preset condition is 15, and the first change threshold is 20. Then, it is known through the judgment that, among these candidate pixel points, the 10 candidate pixel points in the kth row do not satisfy the quantity threshold in the preset condition, and the quantity of the 19 continuous pixel points located in the mth row satisfies the quantity threshold. At this time, if the luminance change values corresponding to the 19 pixel points are all greater than 20, it can be determined that the region composed of the 19 candidate pixel points is the first region, otherwise the region composed of the 19 pixel points is the second region. Alternatively, if the proportion threshold in the preset condition is 80%, and the first change threshold is 15, at this time, if the luminance change values corresponding to 16 pixel points in the 19 candidate pixel points are greater than 15, since 16 / 19=0.84>0.8, it can be determined that the region composed of the 19 candidate pixel points is the first region.
[0086] In step 207, the first region and the second region are subjected to ODC processing based on different ODC modes of overdrive compensation respectively.
[0087] The specific implementation forms of 207 can refer to the detailed description of other embodiments of the present disclosure, which will not be described here again.
[0088] In the embodiments of the present disclosure, first, the first luminance values corresponding to each reference pixel point in the i th frame image are obtained from the storage area, and the first luminance values of the pixel points associated with each reference pixel point in the i th frame image are determined according to the first luminance values corresponding to each reference pixel point. Then, the second luminance values corresponding to each pixel point in the i+1th frame image are determined according to the maximum value or the average value of the sub-pixels contained in each pixel point in the i+1th frame image, and then the luminance change values corresponding to each pixel point in the i+1th frame image are determined according to the difference between the first luminance values and the second luminance values, the candidate pixel points contained in the i+1th frame image and corresponding to the luminance change values greater than the second change threshold are determined, and the first region satisfying the preset condition and the second region not satisfying the preset condition contained in the i+1th frame image are determined according to the luminance change values corresponding to the candidate pixel points. Finally, the first region and the second region are subjected to ODC processing based on different ODC modes of overdrive compensation respectively. Thus, by using the luminance change values of the image pixel points and the preset condition, the image is divided into different regions, different ODC modes are used for compensation, and the visual effects of the regions of the processed image are improved and enhanced.
[0089] In order to realize the above-mentioned embodiments, the present disclosure further provides a video image processing device.
[0090] Figure 3 A structural schematic diagram of a video image processing device provided by an embodiment of the present disclosure.
[0091] As Figure 3 shown, the video image processing device 300 can include:
[0092] The acquisition module 310 is configured to acquire a first luminance value corresponding to each pixel point in an i-th frame image and a second luminance value corresponding to each pixel point in an i+1-th frame image, where i is a natural number.
[0093] The first determination module 320 is configured to determine a luminance change value corresponding to each pixel point in the i+1-th frame image according to a difference between the first luminance value and the second luminance value.
[0094] The second determination module 330 is configured to determine a first region satisfying a preset condition and a second region not satisfying the preset condition included in the i+1-th frame image according to the luminance change value corresponding to each pixel point.
[0095] The processing module 340 is configured to perform ODC processing on the first region and the second region based on different ODC modes, respectively.
[0096] Optionally, an ODC compensation value corresponding to the first region is greater than an ODC compensation value corresponding to the second region.
[0097] Optionally, the acquisition module 310 is further configured to:
[0098] acquire, from a storage region, a first luminance value corresponding to each reference pixel point in the i-th frame image.
[0099] Optionally, the first determination module 320 is further configured to:
[0100] determine, according to the first luminance value corresponding to each reference pixel point, a first luminance value of a pixel point associated with each reference pixel point in the i-th frame image;
[0101] determine, according to a maximum value or an average value of a sub-pixel included in each pixel point in the i+1-th frame image, the second luminance value corresponding to each pixel point in the i+1-th frame image;
[0102] In a case where the first luminance value is determined based on the maximum value of the sub-pixel, the second luminance value corresponding to each pixel point is determined according to the maximum value of the sub-pixel included in each pixel point in the i+1-th frame image.
[0103] Or, in a case where the first luminance value is determined based on the average value of the sub-pixel, the second luminance value corresponding to each pixel point is determined according to the average value of the sub-pixel included in each pixel point in the i+1-th frame image.
[0104] Optionally, the second determining module 330 is further configured to:
[0105] In a case where the luminance change values corresponding to the continuous first number of pixel points are all greater than the first change threshold, determining that a region composed of the continuous first number of pixel points is a first region satisfying the preset condition, and other regions are second regions, wherein the first number is greater than or equal to a first number threshold;
[0106] In a case where a straight line slope composed of the continuous second number of pixel points and corresponding luminance change values is non-zero, and the luminance change values corresponding to a preset proportion of pixel points in the second number of pixel points are all greater than the first change threshold, determining that a region composed of the continuous second number of pixel points is a first region satisfying the preset condition, and other regions are second regions, wherein the second number is greater than or equal to a second number threshold;
[0107] determining candidate pixel points contained in the i+1th image and corresponding to luminance change values greater than a second change threshold;
[0108] determining, according to the luminance change values corresponding to the candidate pixel points, a first region satisfying the preset condition and a second region not satisfying the preset condition contained in the i+1th image.
[0109] The functions and specific implementation principles of the above modules in the embodiments of the present disclosure can be referred to the above method embodiments, which will not be described here.
[0110] The video image processing apparatus of the embodiments of the present disclosure first acquires a first luminance value corresponding to each pixel point in the i th image and a second luminance value corresponding to each pixel point in the i+1th image, then determines a luminance change value corresponding to each pixel point in the i+1th image according to a difference between the first luminance value and the second luminance value, and then determines a first region satisfying the preset condition and a second region not satisfying the preset condition contained in the i+1th image according to the luminance change values corresponding to the respective pixel points. Finally, the first region and the second region are subjected to ODC processing based on different ODC modes, respectively. Thus, by dividing the image into different regions based on the luminance change values of the pixel points in the image, and using different ODC modes for different regions for compensation, the visual effects of each region of the processed image are improved and enhanced.
[0111] To implement the above embodiments, the present disclosure further proposes a display driving chip (Display Driver Integrated Circuit, DDIC), as shown in Figure 4As shown, it includes: at least one processor, and a memory communicatively connected to the at least one processor, wherein the memory stores instructions that may be executed by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the video image processing method proposed in the foregoing embodiments of this disclosure.
[0112] To implement the above embodiments, this disclosure also proposes an electronic device, such as... Figure 5 As shown, it includes: the display driver chip DDIC and the display panel.
[0113] DDIC is used to execute video image processing methods, process images, and then drive the source driver based on the processing results to display the processed image on the display panel.
[0114] To implement the above embodiments, this disclosure also proposes a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the video image processing method proposed in the foregoing embodiments of this disclosure.
[0115] To implement the above embodiments, this disclosure also proposes a computer program product, including a computer program that, when executed by a processor, implements the charging method proposed in the foregoing embodiments of this disclosure.
[0116] Figure 6 A block diagram of an exemplary computer device suitable for implementing embodiments of the present disclosure is shown. Figure 6 The computer device 12 shown is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments disclosed herein.
[0117] like Figure 6 As shown, the computer device 12 is represented in the form of a general-purpose computing device. The components of the computer device 12 may include, but are not limited to: one or more processors or processing units 16, system memory 28, and a bus 18 connecting different system components (including system memory 28 and processing unit 16).
[0118] Bus 18 represents one or more of several bus architectures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of the various bus architectures. Examples of these architectures include, but are not limited to, the Industry Standard Architecture (ISA) bus, the Micro Channel Architecture (MAC) bus, the Enhanced ISA bus, the Video Electronics Standards Association (VESA) local bus, and the Peripheral Component Interconnect (PCI) bus.
[0119] Computer device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by computer device 12, including volatile and non-volatile media, removable and non-removable media.
[0120] Memory 28 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM) 30 and / or cache memory 32. Computer device 12 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 34 may be used to read and write non-removable, non-volatile magnetic media (…). Figure 6 Not shown; usually referred to as a "hard drive"). Although Figure 6 Not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk") and an optical disc drive for reading and writing to a removable non-volatile optical disc (e.g., a compact disc read-only memory (CD-ROM), a digital video disc read-only memory (DVD-ROM), or other optical media) may be provided. In these cases, each drive may be connected to bus 18 via one or more data media interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of the embodiments of this disclosure.
[0121] Program / utility 40 having a set of programs / modules 42 can be stored in memory 28 by way of example, such programs / modules 42 include an operating system, one or more application programs, other programs, and program data, each or any combination thereof, which may
[0122] Computer device 12 can also communicate with one or more external devices 14 such as a keyboard, a pointing device, a display 24, etc.; one or more devices that enable a user to interact with computer device 12; and / or one or more devices that enable computer device 12 to communicate with one or more other computing devices. Such communication can be via input / output (I / O) interfaces 22. Still yet, computer device 12 can communicate with one or more networks, such as one or more local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet, via network adapter 20. As depicted, network adapter 20 communicates with the other components of computer device 12 via bus 18. It should be appreciated that although not shown, other hardware and / or software components could be used in conjunction with computer device 12. These include, but are not limited to, microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data archival storage systems, etc.
[0123] Processing unit 16 executes various program applications and data processing by running programs stored in system memory 28, such as implementing the methods mentioned in the foregoing embodiments.
[0124] The technical solution of the present disclosure first acquires a first luminance value corresponding to each pixel point in the i-th frame image and a second luminance value corresponding to each pixel point in the i+1-th frame image, then determines a luminance change value corresponding to each pixel point in the i+1-th frame image according to the difference between the first luminance value and the second luminance value, and then determines a first region satisfying a preset condition and a second region not satisfying the preset condition contained in the i+1-th frame image according to the luminance change value corresponding to each pixel point, and finally performs ODC processing on the first region and the second region based on different overdrive compensation ODC modes. Thus, by dividing the image into different regions based on the luminance change value of the pixel point in the image, and using different ODC modes for compensation on different regions, the visual effects of each region of the processed image are improved and enhanced.
[0125] In the description of the disclosure, the description of the terms "one embodiment", "some embodiments", "an example", "a specific example", or "some examples" and the like means that the specific features, structures, materials or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the disclosure. In the description of the disclosure, the illustrative description of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any suitable manner in any one or more embodiments or examples. In addition, the person skilled in the art can combine and combine the different embodiments or examples described in the specification and the features of the different embodiments or examples without contradiction.
[0126] In addition, the terms "first", "second" are only for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with "first", "second" can explicitly or implicitly include at least one of the features. In the description of the disclosure, the meaning of "a plurality of" is at least two, for example, two, three, etc., unless otherwise explicitly specified.
[0127] Any process or method descriptions in flow charts or otherwise described herein, represent an example of embodiments of the present disclosure. It should be understood that the acts, steps, or blocks of the processes can be performed in an arbitrary sequence or in parallel, unless otherwise indicated, and that the descriptions could be made in different forms. In other words, every combination of claimed acts or features is possible unless otherwise indicated.
[0128] The logic and / or steps represented in the flow chart or otherwise described herein, for example, can be considered as a list of executable instructions for implementing the logic function, which can be specifically embodied in any computer-readable medium for use by an instruction execution system, device or apparatus, such as a computer-based system, a system including a processor, or other system that can fetch instructions from the instruction execution system, device or apparatus and execute the instructions, or in conjunction with these instructions execution system, device or apparatus.
[0129] For the purposes of this specification, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. The computer-readable medium can be a computer- readable storage medium or a computer-readable communication medium. Computer-readable storage mediums can include, but are not limited to, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or Flash memory), optical fiber devices, and portable compact disc read-only memory (CDROM), and the like. Computer-readable communication mediums can include, but are not limited to, modulated data signals such as carrier waves, data signals, and other transport mechanisms and / or data structures, and the like. The computer-readable medium can also be paper or other suitable medium upon which the program is printed, as the program can be electronically captured, via, for instance, optical scanning of the paper or other suitable medium, then compiled, interpreted, or otherwise processed, and then stored in a computer memory in a form that is then reproducible within a computer.
[0130] It should be understood that aspects of the disclosure can be implemented in hardware, software, firmware or combinations thereof. In the above embodiments, various steps or methods can be implemented in software or firmware that is stored in memory and executed by a suitable instruction execution system. As such, it should be noted that when implemented in software or firmware, the several steps or methods can be stored in one or more of the storage mediums mentioned above, or other types of storage mediums that are suitable for storing program code. Also, it should be noted that software that implements the several steps or methods can be initially stored on a remote computer or server that is connected to a network, such as the Internet, and downloaded to a user's computer or other device over the network. In such a case, the user's device can be considered to be a computer-readable medium that is configured to store the program code for execution by the user's device.
[0131] Those skilled in the art can understand that all or part of the steps involved in the above-mentioned embodiment methods can be completed by programs instructing relevant hardware, and the programs can be stored in a computer-readable storage medium. When the programs are executed, they include one or a combination of the steps of the method embodiments.
[0132] In addition, each functional unit in each embodiment of the present disclosure can be integrated into one processing module, or each unit can exist physically independently, or two or more units can be integrated into one module. The integrated module can be implemented in the form of hardware or in the form of a software function module. If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium.
[0133] The storage medium mentioned above can be a read-only memory, a magnetic disk or an optical disk, etc. Although the embodiments of the present disclosure have been shown and described above, it is understood that the above-mentioned embodiments are exemplary and cannot be understood as limiting the present disclosure, and those of ordinary skill in the art can make changes, modifications, replacements and variations to the above-mentioned embodiments within the scope of the present disclosure.
Claims
1. A method of processing a video image, characterized by, The method comprises: obtaining a first luminance value corresponding to each pixel point in an i-th frame image and a second luminance value corresponding to each pixel point in an i+1-th frame image, wherein i is a natural number; determining a luminance change value corresponding to each pixel point in the i+1-th frame image according to a difference between the first luminance value and the second luminance value; determining a first region meeting a preset condition and a second region not meeting the preset condition included in the i+1-th frame image according to the luminance change value corresponding to each pixel point; performing ODC processing on the first region and the second region based on different ODC modes respectively; the determining of the first region meeting the preset condition and the second region not meeting the preset condition included in the i+1-th frame image according to the luminance change value corresponding to each pixel point comprises: in a case that luminance change values corresponding to a first number of continuous pixel points are all greater than a first change threshold, determining that a region composed of the first number of continuous pixel points is the first region meeting the preset condition, and other regions are the second region, wherein the first number is greater than or equal to a first number threshold.
2. The method of claim 1, wherein, the determining of the first region meeting the preset condition and the second region not meeting the preset condition included in the i+1-th frame image according to the luminance change value corresponding to each pixel point comprises: in a case that a straight line slope composed of a second number of continuous pixel points and corresponding luminance change values is not zero, and luminance change values corresponding to a preset proportion of pixel points in the second number of continuous pixel points are all greater than a first change threshold, determining that a region composed of the second number of continuous pixel points is the first region meeting the preset condition, and other regions are the second region, wherein the second number is greater than or equal to a second number threshold.
3. The method of claim 1, wherein, an ODC compensation value corresponding to the first region is greater than an ODC compensation value corresponding to the second region.
4. The method according to any one of claims 1 to 3, characterized in that, the obtaining of the first luminance value corresponding to each pixel point in the i-th frame image and the second luminance value corresponding to each pixel point in the i+1-th frame image comprises: obtaining a first luminance value corresponding to each reference pixel point in the i-th frame image from a storage area; determining a first luminance value of a pixel point associated with each reference pixel point in the i-th frame image according to the first luminance value corresponding to each reference pixel point; determining a second luminance value corresponding to each pixel point in the i+1-th frame image according to a maximum value or an average value of sub-pixels included in each pixel point in the i+1-th frame image.
5. The method of claim 4, wherein, the determining of the second luminance value corresponding to each pixel point in the i+1-th frame image according to the maximum value or the average value of sub-pixels included in each pixel point in the i+1-th frame image comprises: in a case that the first luminance value is determined based on the maximum value of sub-pixels, determining the second luminance value corresponding to each pixel point according to the maximum value of sub-pixels included in each pixel point in the i+1-th frame image; or in a case that the first luminance value is determined based on the average value of sub-pixels, determining the second luminance value corresponding to each pixel point according to the average value of sub-pixels included in each pixel point in the i+1-th frame image.
6. A video image processing apparatus characterized by comprising: The method comprises: An acquisition module is configured to acquire a first luminance value corresponding to each pixel point in an i-th frame of image and a second luminance value corresponding to each pixel point in an i+1-th frame of image, where i is a natural number; A first determination module is configured to determine a luminance change value corresponding to each pixel point in the i+1-th frame of image according to a difference between the first luminance value and the second luminance value; A second determination module is configured to determine a first region meeting a preset condition and a second region not meeting the preset condition included in the i+1-th frame of image according to the luminance change value corresponding to each pixel point; A processing module is configured to perform ODC processing on the first region and the second region based on different ODC modes respectively. The second determination module is specifically configured to: In a case where luminance change values corresponding to a first number of continuous pixel points are all greater than a first change threshold, determine that a region composed of the first number of continuous pixel points is the first region meeting the preset condition, and other regions are the second region not meeting the preset condition, where the first number is greater than or equal to a first number threshold.
7. A display driver chip DDIC, characterized in that, Comprise: At least one processor; And a memory connected with the at least one processor in communication; Wherein, the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the method of any one of claims 1-5.
8. An electronic device, comprising: The display driving chip (DDIC) and the display panel.
9. A non-transitory computer readable storage medium having stored thereon computer instructions, wherein, The computer instructions are used to make the computer execute the method according to any one of claims 1-5.
10. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-5.
10. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-5.
Citation Information
Patent Citations
Image display method and device
CN107993616A