Image processing method and device, equipment and medium

Abstract

The invention discloses an image processing method and device, equipment and a medium, which are used for protecting a display screen in a highlight display area and reducing the aging speed of the display screen so as to avoid ghosting of a display picture and improve the display quality. The image processing method provided by the embodiment of the invention comprises the steps of obtaining a currently input to-be-detected target image, and performing image block division on the target image according to a preset rule to obtain at least one image block; matching an image block in the target image with an image block corresponding to an easy-to-age area of a display screen determined in advance based on a historical input image, and determining at least one matched image block in the target image; wherein the display screen easy-to-age area determined in advance based on the historical input image comprises a display area corresponding to at least one image block; and based on the at least one matching image block in the target image, determining whether image brightness adjustment operation needs to be performed on the target image.

Description

Technical Field

[0001] The present application relates to the field of display technology, and in particular to an image processing method, device, equipment and medium. Background Art

[0002] Organic Light-Emitting Diode (OLED) is a current-type light-emitting device that has the advantages of low power consumption, small thickness, light weight, good shock resistance, large screen viewing angle, fast response speed, high luminous efficiency, low energy consumption, thin and light, etc. It can also be manufactured on substrates of different materials and can be made into curved soft displays.

[0003] However, OLED has a short service life and currently cannot achieve mass production of large-size screens. It is only suitable for portable digital products. There is a problem of insufficient color purity. It is not easy to display bright and rich colors. In addition, due to its own material problems, the performance of organic light-emitting materials decays after long-term operation. Since the content displayed for a long time in adjacent pixels or adjacent areas is different, the high-brightness areas such as fixed icons and taskbars are displayed for a long time, which accelerates aging. At the same voltage, the brightness of the high-brightness area is lower than that of other areas. When a similar grayscale needs to be displayed, the display brightness contrast of this area is low, which is manifested as a "residual image", also known as the "afterimage" in this area. Summary of the invention

[0004] The embodiments of the present application provide an image processing method, apparatus, device and medium for protecting a display screen in a highlighted display area and reducing its aging rate, thereby avoiding image retention of the displayed image and improving display quality.

[0005] An image processing method provided in an embodiment of the present application includes:

[0006] Acquire a target image to be detected that is currently input, and divide the target image into image blocks according to a preset rule to obtain at least one image block;

[0007] Matching an image block in the target image with an image block corresponding to an area of ​​the display screen susceptible to aging determined in advance based on a historical input image, to determine at least one matching image block in the target image; wherein the area of ​​the display screen susceptible to aging determined in advance based on a historical input image includes a display area corresponding to at least one image block;

[0008] Based on at least one of the matching image blocks in the target image, it is determined whether an image brightness adjustment operation needs to be performed on the target image.

[0009] It can be seen that the image processing method provided by the embodiment of the present application obtains the currently input target image to be detected, and divides the target image into image blocks according to preset rules to obtain at least one image block; and matches the image blocks in the target image with the image blocks corresponding to the aging-prone area of ​​the display screen determined in advance based on the historical input image to determine at least one matching image block in the target image; finally, based on at least one matching image block in the target image, it is judged whether it is necessary to perform an image brightness adjustment operation on the target image, thereby realizing the use of historical accumulated data (i.e., the image blocks corresponding to the aging-prone area of ​​the display screen determined based on the historical input image) to judge whether to adjust the brightness of the currently input target image to be detected, effectively utilizing the existing data, and quickly and accurately judging whether there is an image block that needs to be adjusted in the brightness in the currently input target image to be detected, and then after the brightness adjustment, the display screen in the highlighted display area can be protected and its aging speed can be reduced, thereby avoiding the afterimage of the display screen and improving the display quality.

[0010] In some embodiments, determining the display screen prone to aging area based on the historical input image in advance includes:

[0011] Obtain at least one frame of historical input image from a local device;

[0012] Based on the at least one frame of historical input image, for each pixel, calculating an average pixel value of the pixel;

[0013] Regenerate the image based on the average pixel value of each pixel;

[0014] According to the preset rule, dividing the regenerated image into image blocks to obtain at least one image block;

[0015] For each image block in the regenerated image, or for each image block in a preset candidate area in the regenerated image, the pixel sum of the image block is counted, and when the pixel sum is greater than a preset threshold, it is determined that the display area corresponding to the image block belongs to the display screen prone to aging area.

[0016] In some embodiments, judging whether it is necessary to perform an image brightness adjustment operation on the target image based on at least one matching image block in the target image includes:

[0017] Determine whether there is a target image block that needs brightness adjustment in at least one of the matching image blocks in the target image;

[0018] When the target image block exists, a brightness reduction operation is performed on the target image block.

[0019] In some embodiments, determining whether there is a target image block that needs to be brightness adjusted in at least one of the matching image blocks in the target image includes:

[0020] For each of the matching image blocks, a sum of pixel values ​​of each pixel point in the matching image block is determined to obtain a first sum value; and a sum of pixel values ​​of each pixel point in a pre-recorded image block corresponding to the matching image block is determined to obtain a second sum value; when the first sum value is greater than or equal to the second sum value, the matching image block is determined to be a target image block requiring brightness adjustment;

[0021] Alternatively, for each matching image block, the sum of the pixel values ​​of each pixel in the matching image block is determined, and when the sum is greater than or equal to a preset threshold, the matching image block is determined to be a target image block requiring brightness adjustment.

[0022] In some embodiments, performing a brightness reduction operation on the target image block includes:

[0023] According to a preset adjustment strategy, at least one brightness reduction operation is performed on the target image block.

[0024] In some embodiments, the method further comprises:

[0025] For each of the target image blocks, after each brightness reduction operation on the target image block is completed, it is determined whether the adjusted brightness of the target image block meets the conditions for continuing the brightness reduction operation. If so, the next brightness reduction operation is continued; otherwise, the brightness reduction operation on the target image block is stopped.

[0026] In some embodiments, matching the image blocks in the target image with pre-recorded image blocks to determine the matching image blocks in the target image includes:

[0027] According to the recorded coordinate index information of the image block in the display area, the image block having the same coordinate index information is searched in the target image, and the searched image block is used as the matching image block in the target image.

[0028] An image processing device provided in an embodiment of the present application includes:

[0029] The first unit is used to obtain a target image to be detected that is currently input, and divide the target image into image blocks according to a preset rule to obtain at least one image block;

[0030] A second unit is used to match an image block in the target image with an image block corresponding to an area of ​​the display screen susceptible to aging that is determined in advance based on a historical input image, to determine at least one matching image block in the target image; wherein the area of ​​the display screen susceptible to aging that is determined in advance based on a historical input image includes a display area corresponding to at least one image block;

[0031] The third unit is used to determine whether it is necessary to perform an image brightness adjustment operation on the target image based on at least one matching image block in the target image.

[0032] Another embodiment of the present application provides an electronic device, which includes a memory and a processor, wherein the memory is used to store program instructions, and the processor is used to call the program instructions stored in the memory and execute any of the above methods according to the obtained program.

[0033] Another embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to enable the computer to execute any of the above methods. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0035] Figure 1 A flowchart of an image processing method provided in an embodiment of the present application;

[0036] Figure 2 A schematic diagram of a process for determining an area prone to aging of a display screen provided in an embodiment of the present application;

[0037] Figure 3 A schematic diagram of a process for determining an aging-prone area of ​​a target image provided in an embodiment of the present application;

[0038] Figure 4 A schematic diagram of a process for determining an aging-prone area of ​​a target image provided in an embodiment of the present application;

[0039] Figure 5 A schematic diagram of a process for determining an aging-prone area of ​​a target image provided in an embodiment of the present application;

[0040] Figure 6 A schematic diagram of a candidate area in a display area provided in an embodiment of the present application;

[0041] Figure 7 A schematic diagram of an aging-prone region in a candidate region provided in an embodiment of the present application;

[0042] Figure 8 A schematic diagram of matching image blocks on a currently input target image provided by an embodiment of the present application;

[0043] Fig. 9 A schematic diagram of the overall process of an image processing method provided in an embodiment of the present application;

[0044] Fig.10 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0045] Fig.11 A schematic diagram of the structure of an image processing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0046] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0047] The embodiments of the present application provide an image processing method, apparatus, device and medium for protecting a display screen in a highlighted display area and reducing its aging rate, thereby avoiding image retention of the displayed image and improving display quality.

[0048] Among them, the method and the device, equipment, and medium are based on the same application concept. Since the principles of solving problems by the method and the device, equipment, and medium are similar, the implementation of the device, equipment, medium, and method can refer to each other, and the repeated parts will not be repeated.

[0049] The terms "first", "second", etc. (if any) in the specification and claims of the embodiments of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments described herein can be implemented in an order other than the content illustrated or described here. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0050] The following examples and embodiments are to be understood as illustrative examples only. Although this specification may refer to "one", "an" or "some" examples or embodiments in several places, this does not mean that each such reference relates to the same example or embodiment, nor does it mean that the feature applies only to a single example or embodiment. Individual features of different embodiments may also be combined to provide other embodiments. In addition, terms such as "including" and "comprising" should be understood as not limiting the described embodiments to only those features that have been mentioned; such examples and embodiments may also include features, structures, units, modules, etc. that are not specifically mentioned.

[0051] The following is a detailed description of each embodiment of the present application in conjunction with the accompanying drawings. It should be noted that the display order of the embodiments of the present application only represents the order of the embodiments, and does not represent the advantages and disadvantages of the technical solutions provided by the embodiments.

[0052] In order to prevent the generation of afterimages on the OLED screen and avoid uneven brightness, two aspects are mainly considered. On the one hand, the screen should avoid being static and bright for a long time to achieve the purpose of prevention. For example, the theme can be changed to dark mode, fixed icons and taskbars can be adjusted to semi-transparent, and the screen brightness can be reduced when long static scenes are detected. On the other hand, the OLED display is usually compensated regularly by compensating for OLED aging. One of the common methods of compensating for OLED aging is to estimate the loss of each pixel based on the accumulated value of image data and generate a compensation coefficient to compensate for the aging of the OLED.

[0053] In actual use, the theme can be changed to dark mode, and fixed icons and taskbars can be adjusted to transparent, which is closely related to user habits. However, for monitors and portable display devices (laptops, mobile phones, etc.), there are a large number of static highlight icons and status bars, so it is hoped that the aging of these areas can be effectively slowed down without being easily noticed by the human eye.

[0054] Therefore, the embodiment of the present application proposes a method for effectively slowing down the aging of target display areas (i.e., aging-prone areas) such as static highlight icons and status bars. The method makes full use of historical data (e.g., the average pixel value of each pixel point obtained based on historical input images), and uses the statistical data to generate a cumulative data image (characterizing the aging degree of the display screen area corresponding to the pixel or image block), and compares and analyzes the current input image with the cumulative data image, thereby effectively utilizing the existing data, more accurately determining the aging-prone area in the current input image, and then reducing the brightness of the aging-prone area. The historical data, for example, is the cumulative data obtained by using the screen brightness compensation (de-burn-in, i.e., afterimage elimination) method. De-burn-in is a method for compensating for OLED aging. The embodiment of the present application uses the cumulative data obtained by the method to greatly reduce the occupation of memory resources and improve the detection rate of the aging-prone area of ​​the OLED display, thereby effectively achieving the effect of slowing down the aging of target display areas (i.e., aging-prone areas) such as static highlight icons and status bars.

[0055] Embodiment 1:

[0056] The method for preventing image sticking from occurring on an OLED display screen provided in the embodiments of the present application is, for example, Figure 1 As shown, the following steps are included:

[0057] S101, obtaining at least one frame of historical input image;

[0058] For example, a video image played by a local device, such as a historical image sequence of n frames, is obtained as a historical input image.

[0059] S102, based on the historical input image, for each pixel, calculating the average pixel value of the pixel;

[0060] The cumulative pixel average value is the usage of each pixel obtained by statistics based on the historical input image. Taking any pixel P in the image as an example, the formula for calculating the usage of the pixel includes:

[0061] P n (x,y)=max(R n (x,y),G n (x,y),B n (x,y));

[0062]

[0063] in:

[0064]

[0065]

[0066] ………

[0067]

[0068] In the above formula, n represents the number of times the cumulative average value of the pixel average value is calculated for any pixel within a preset time period. n can start from 0.

[0069] P n Indicates the maximum value of the R, G, and B channels of the pixel point P in the nth frame image; x and y represent the pixel row index and pixel column index on the image respectively;

[0070] avg n Indicates the cumulative calculation results of n times, for example:

[0071] Input the 0th frame image, avg 0 =P 0

[0072] Input the first frame image, avg 1 =(P 0 +P 1 ) / 2;

[0073] Input the second frame image, avg 2 =(P 0 +P 1 +P 2 ) / 3=(2*avg 1 +P 2 ) / 3;

[0074] And so on.

[0075] For example, if n is equal to 10, then the cumulative usage of each pixel obtained in step S102, avg 10 , where the cumulative pixel average corresponding to any pixel position (x, y) is

[0076] S103, determining a display screen prone to aging area (hereinafter referred to as prone to aging area);

[0077] Specifically, see Figure 2 , this step S103 for example includes:

[0078] S201, regenerating an image based on the average pixel value of each pixel point (also referred to as a cumulative data image, i.e., an image regenerated using the historical pixel value of each pixel point);

[0079] S202, dividing the accumulated data image into M*N image blocks;

[0080] Wherein, M and N are preset positive integers.

[0081] The size of each image block is BW*BH.

[0082] S203: Count the pixels and Sum of each image block k ;

[0083] Among them, 0≤k≤(M*N-1);

[0084] S204, if Sum k ≥ the preset aging threshold th, the display area corresponding to the image block is determined to be an area prone to aging of the display screen;

[0085] S205, saving index information of the image block corresponding to each aging-prone area, that is, recording the aging-prone area index information;

[0086] The index information of the image block, for example, the index value of the upper left corner pixel position of the image block

[0087] For example, save the upper left corner index value of the image block corresponding to Q aging-prone areas, that is, record Q Wherein, Q is a preset positive integer.

[0088] S104, obtaining the currently input target image to be detected;

[0089] S105, determining an aging-prone area of ​​the target image;

[0090] It should be noted that the aging-prone area described in the embodiments of the present application may be a pixel on an image, or may be an image area including multiple pixels.

[0091] Specifically, see Figure 3 , this step S105 for example includes:

[0092] S301, dividing the target image into M*N image blocks;

[0093] S302, searching for a matching image block from the M*N image blocks of the target image according to the recorded index information of the susceptible aging area;

[0094] For example, index information for areas prone to aging The upper left corner index value of the matched image block is also

[0095] S303, determining a target image block that needs brightness adjustment by comparing the image blocks;

[0096] Specifically, a matching image block in the target image (for the convenience of description, the image block is referred to as a first image block) is compared with an image block corresponding to the recorded aging-prone area (for the convenience of description, the image block is referred to as a second image block); wherein the coordinate index information of the first image block and the second image block in the display area is consistent.

[0097] If the sum of the pixel values ​​of each pixel point in the first image block (i.e., the first sum) is greater than or equal to the sum of the pixel values ​​of each pixel point in the second image block (i.e., the second sum), the first image block is determined as a target image block requiring brightness adjustment;

[0098] That is to say, the image area on the target image block is the aging-prone area of ​​the target image.

[0099] S106: Adjust the brightness of the aging-prone area of ​​the target image.

[0100] Specifically, for example:

[0101] Preset the maximum brightness drop percentage max_drop_ratio and the maximum drop time Td (i.e., the maximum time allowed for the brightness drop operation to be performed on the image block);

[0102] In some embodiments, for each target image block, the brightness of the target image block can be slowly reduced, that is, the brightness of the target image block can be reduced multiple times according to a preset period or a preset number of times, and after each adjustment, the adjusted pixel value is compared with the pixel value of the recorded image block. When it is detected that the target image block does not meet the conditions of being a target image block, that is, the pixel value of the target image block is less than the pixel value of the image block corresponding to the recorded aging-prone area that matches it, the brightness reduction operation for the target image block is immediately exited. In other words, the brightness of the target image block may not necessarily be reduced to the maximum percentage.

[0103] For each target image block, the brightness of the target image block is slowly reduced. Figure 4 , for example:

[0104] S401, for the target image block, determine the percentage drop_ratio of the brightness drop over time t (starting from 0, with a maximum value of Td):

[0105] drop_ratio(t)=1-(1-max_drop_ratio)*t / Td;

[0106] S402: Based on the drop_ratio, the brightness of the three channels R, G, and B of the target image block is lowered.

[0107] That is, the brightness of the R, G, and B channels of the target image block is reduced to:

[0108] P(i,j).R=P(i,j).R*drop_ratio;

[0109] P(i,j).G=P(i,j).G*drop_ratio;

[0110] P(i,j).B=P(i,j).B*drop_ratio.

[0111] Another more specific embodiment is described below.

[0112] Embodiment 2:

[0113] See also Figure 5 , the method provided in this embodiment includes, for example, the following steps:

[0114] S501, inputting a sequence of n frames of images, each image having a size of 1920*1080;

[0115] S502, using the n-frame image sequence, for each pixel point, calculating its pixel average value;

[0116] For example, the pixel average value of pixel point P(x,y) in an n-frame image sequence is:

[0117]

[0118] S503, generating an image (i.e., a cumulative data image) based on the pixel average value of each pixel point;

[0119] The screen area corresponding to the image area with a higher grayscale value (ie, brighter) in the accumulated data image has more serious aging.

[0120] S504, dividing the accumulated data image into 480*270 image blocks, wherein the size of each image block is 4*4;

[0121] S505, determining a candidate area in the display area;

[0122] For example, in an office scenario, the status bar at the bottom of the display interface is a fixed display area, that is, the display content in this area is relatively fixed and does not change frequently. Therefore, the status bar area can be set as a candidate area, such as Figure 6 shown.

[0123] S506, determining an aging-prone area in the candidate area;

[0124] For example, the value range of the height h of the candidate area is: 270>h>256;

[0125] Count the pixels and sum_blk of each image block in the candidate area, where 0<=sum_blk<=4080;

[0126] If the aging threshold is set to th=3680 in advance, the image blocks with pixels and sum_blk>=th in the candidate area (status bar area) are extracted, and the area where the image blocks satisfying sum_blk>=th in the candidate area are located is taken as the prone aging area, such as Figure 7 As shown;

[0127] S507, recording the coordinates (ie, index) of the image block corresponding to each aging-prone area;

[0128] For example, the coordinates of the image blocks corresponding to the aging-prone areas are: blk(4,261), blk(5,261), blk(6,261), ...

[0129] S508, input the current target image to be detected, that is, input the (n+1)th frame image;

[0130] The n frames of images inputted above are used as historical input images to determine the areas susceptible to aging;

[0131] The (n+1)th frame image input in this step, i.e. the current image, is the target image to be detected;

[0132] S509, searching for a matching image block on the target image based on the coordinates of the image block corresponding to the aging-prone area;

[0133] That is, this step is to find the image blocks in the current image that correspond to the positions of the above-mentioned recorded image blocks (i.e., the image blocks corresponding to the aging-prone areas), such as Figure 8 As shown;

[0134] S510 . For each matching image block in the target image, when it is determined that the sum of pixels in the image block is greater than a preset threshold, adjust the brightness of the image block.

[0135] For example, for the image block with the same coordinates as blk(4,261) in the current image, it is determined that it includes the following pixel points: p(16,1044), p(17,1044), p(18,1044), p(19,1044), p(16,1045), ... p(16,1047), p(17,1047), p(18,1047), p(19,1047);

[0136] It is determined whether the pixel sum of the above pixels in the image block with the coordinates blk(4,261) is greater than a preset threshold th_1. If so, the image block area is subjected to brightness reduction processing.

[0137] Take the pixel p(16,1044)=245 as an example, assuming that the preset maximum drop brightness is max_drop_ratio=85%, and the maximum drop time is 15s, then it drops by 1% per second, that is, after t seconds, the pixel value of the pixel drops to:

[0138] P_out = p*(100%-t*1%);

[0139] That is, after 1 second, the pixel value of pixel point p(16,1044) drops to 243, and after 15 seconds it drops to 208 (ie, drops to 85% of the original pixel value).

[0140] The above example is to reduce the brightness once per second (ie, the pixel value decreases by 1% per second). In some embodiments, the brightness may be reduced once every two seconds, or once every more seconds, depending on actual needs.

[0141] In some embodiments, each time after the pixel value of each pixel point in the target image block is lowered, the sum of the pixel values ​​of each pixel point in the image block after adjustment is compared with a preset threshold value th_1. If the sum of the pixel values ​​of each pixel point in the image block after adjustment is less than th_1, the brightness lowering operation of the image block can be stopped, that is, the pixel values ​​of each pixel point in the image block are no longer lowered using the above formula.

[0142] In summary, see Fig. 9 , an image processing method provided by an embodiment of the present application includes:

[0143] S901, obtaining a target image to be detected that is currently input, and dividing the target image into image blocks according to a preset rule to obtain at least one image block;

[0144] The preset rule is, for example, the image block division rule described in the above-mentioned embodiment 1 and embodiment 2. The specific rule is not limited in the embodiment of the present application.

[0145] It should be noted that the technical solution provided in the embodiments of the present application can be applied to the brightness adjustment of the image displayed on the OLED screen, and can also be applied to the brightness adjustment of the image displayed on other types of display screens, and is not limited in the embodiments of the present application.

[0146] S902, matching an image block in the target image with an image block corresponding to an area of ​​the display screen susceptible to aging determined in advance based on a historical input image, to determine at least one matching image block in the target image; wherein the area of ​​the display screen susceptible to aging determined in advance based on the historical input image includes a display area corresponding to at least one image block;

[0147] S903: Based on at least one of the matching image blocks in the target image, determine whether it is necessary to perform an image brightness adjustment operation on the target image.

[0148] It should be noted that in the embodiment of the present application, the adjustment of image brightness is illustrated by taking the adjustment of brightness as an example, but it is not limited to this. The brightness can also be adjusted up according to actual needs.

[0149] In some embodiments, determining the display screen prone to aging area based on the historical input image in advance includes:

[0150] Obtain at least one frame of historical input image from a local device;

[0151] Based on the at least one frame of historical input image, for each pixel, calculating an average pixel value of the pixel;

[0152] Regenerate an image (i.e., the accumulated data image described in the above embodiment) based on the average pixel value of each pixel;

[0153] According to the preset rule, dividing the regenerated image into image blocks to obtain at least one image block;

[0154] For each image block in the regenerated image (see the above-mentioned embodiment 1), or for each image block in a preset candidate area in the regenerated image (see the above-mentioned embodiment 2), the pixel sum of the image block is counted, and when the pixel sum is greater than a preset threshold, it is determined that the display area corresponding to the image block belongs to the display screen prone to aging area.

[0155] The candidate area is, for example, the status bar area in the second embodiment.

[0156] In some embodiments, judging whether it is necessary to perform an image brightness adjustment operation on the target image based on at least one matching image block in the target image includes:

[0157] Determine whether there is a target image block that needs brightness adjustment in at least one of the matching image blocks in the target image;

[0158] When the target image block exists, a brightness reduction operation is performed on the target image block.

[0159] In the embodiment of the present application, a target image block is further identified from the matching image blocks, so that the image brightness reduction operation can be performed more accurately.

[0160] In some embodiments, determining whether there is a target image block that needs to be brightness adjusted in at least one of the matching image blocks in the target image includes:

[0161] For each of the matching image blocks, determine the sum of the pixel values ​​of each pixel point in the matching image block to obtain a first sum value; and determine the sum of the pixel values ​​of each pixel point in the pre-recorded image block corresponding to the matching image block to obtain a second sum value; when the first sum value is greater than or equal to the second sum value, determine that the matching image block is a target image block that needs to be brightness adjusted (see the above-mentioned embodiment 1);

[0162] Alternatively, for each of the matching image blocks, the sum of the pixel values ​​of each pixel in the matching image block is determined; when the sum is greater than or equal to a preset threshold, the matching image block is determined to be a target image block that requires brightness adjustment (see the above-mentioned second embodiment).

[0163] In some embodiments, performing a brightness reduction operation on the target image block includes:

[0164] According to a preset adjustment strategy, at least one brightness reduction operation is performed on the target image block.

[0165] The adjustment strategy is, for example, the strategy of reducing the brightness of the target image block described in the above-mentioned embodiment 1 and embodiment 2. The specific strategy is not limited in the embodiment of the present application and can be determined according to actual needs.

[0166] In the embodiment of the present application, the strategy of adjusting the target image block one by one can achieve the effect of slowly reducing the brightness of the target image block.

[0167] In some embodiments, the method further comprises:

[0168] For each of the target image blocks, after each brightness reduction operation on the target image block is completed, it is determined whether the adjusted brightness of the target image block meets the conditions for continuing the brightness reduction operation. If so, the next brightness reduction operation is continued; otherwise, the brightness reduction operation on the target image block is stopped.

[0169] Among them, regarding determining whether the brightness of the target image block after adjustment meets the condition for continuing the brightness down adjustment operation, the specific determination method can also be the determination method of determining whether the matching image block can be used as the target image block, and the specific details are not repeated here. Of course, other determination conditions can also be used for determination, which is not limited in the embodiment of the present application and can be determined according to actual needs.

[0170] In some embodiments, matching the image blocks in the target image with pre-recorded image blocks to determine the matching image blocks in the target image includes:

[0171] According to the recorded coordinate index information of the image block in the display area, the image block having the same coordinate index information is searched in the target image, and the searched image block is used as the matching image block in the target image.

[0172] That is to say, the image block in the target image whose coordinates are consistent with the recorded image block is the matching image block.

[0173] The following is an introduction to the equipment or device provided in the embodiments of the present application, in which the explanations or examples of technical features that are the same or corresponding to those described in the above method will not be repeated later.

[0174] An electronic device provided in an embodiment of the present application may be any display device (computer, television, mobile phone, etc.) or other types of electronic devices, see Fig.10 , for example:

[0175] The processor 600 is used to read the program in the memory 620 and execute the following process:

[0176] Acquire a target image to be detected that is currently input, and divide the target image into image blocks according to a preset rule to obtain at least one image block;

[0177] Matching an image block in the target image with an image block corresponding to an area of ​​the display screen susceptible to aging determined in advance based on a historical input image, to determine at least one matching image block in the target image; wherein the area of ​​the display screen susceptible to aging determined in advance based on a historical input image includes a display area corresponding to at least one image block;

[0178] Based on at least one of the matching image blocks in the target image, it is determined whether an image brightness adjustment operation needs to be performed on the target image.

[0179] In some embodiments, the processor 600 is further configured to read a program in the memory 620 and execute the following process:

[0180] The display screen prone to aging area is determined in advance based on the historical input image in the following manner:

[0181] Obtain at least one frame of historical input image from a local device;

[0182] Based on the at least one frame of historical input image, for each pixel, calculating an average pixel value of the pixel;

[0183] Regenerate the image based on the average pixel value of each pixel;

[0184] According to the preset rule, dividing the regenerated image into image blocks to obtain at least one image block;

[0185] For each image block in the regenerated image, or for each image block in a preset candidate area in the regenerated image, the pixel sum of the image block is counted, and when the pixel sum is greater than a preset threshold, it is determined that the display area corresponding to the image block belongs to the display screen prone to aging area.

[0186] In some embodiments, judging whether it is necessary to perform an image brightness adjustment operation on the target image based on at least one matching image block in the target image includes:

[0187] Determine whether there is a target image block that needs brightness adjustment in at least one of the matching image blocks in the target image;

[0188] When the target image block exists, a brightness reduction operation is performed on the target image block.

[0189] In some embodiments, determining whether there is a target image block that needs to be brightness adjusted in at least one of the matching image blocks in the target image includes:

[0190] For each of the matching image blocks, a sum of pixel values ​​of each pixel point in the matching image block is determined to obtain a first sum value; and a sum of pixel values ​​of each pixel point in a pre-recorded image block corresponding to the matching image block is determined to obtain a second sum value; when the first sum value is greater than or equal to the second sum value, the matching image block is determined to be a target image block requiring brightness adjustment;

[0191] Alternatively, for each matching image block, the sum of the pixel values ​​of each pixel in the matching image block is determined, and when the sum is greater than or equal to a preset threshold, the matching image block is determined to be a target image block requiring brightness adjustment.

[0192] In some embodiments, performing a brightness reduction operation on the target image block includes:

[0193] According to a preset adjustment strategy, at least one brightness reduction operation is performed on the target image block.

[0194] In some embodiments, the processor 600 is further configured to read a program in the memory 620 and execute the following process:

[0195] For each of the target image blocks, after each brightness reduction operation on the target image block is completed, it is determined whether the adjusted brightness of the target image block meets the conditions for continuing the brightness reduction operation. If so, the next brightness reduction operation is continued; otherwise, the brightness reduction operation on the target image block is stopped.

[0196] In some embodiments, matching the image blocks in the target image with pre-recorded image blocks to determine the matching image blocks in the target image includes:

[0197] According to the recorded coordinate index information of the image block in the display area, the image block having the same coordinate index information is searched in the target image, and the searched image block is used as the matching image block in the target image.

[0198] The transceiver 610 is configured to receive and send data under the control of the processor 600 .

[0199] Among them, Fig.10 In the embodiment, the bus architecture may include any number of interconnected buses and bridges, specifically one or more processors represented by processor 600 and various circuits of memory represented by memory 620 are linked together. The bus architecture may also link together various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art and are therefore not further described herein. The bus interface provides an interface. The transceiver 610 may be a plurality of components, namely, a transmitter and a receiver, providing a unit for communicating with various other devices on a transmission medium, including wireless channels, wired channels, optical cables, and other transmission media. For different user devices, the user interface 630 may also be an interface capable of externally and internally connecting required devices, and the connected devices include but are not limited to a keypad, a display, a speaker, a microphone, a joystick, and the like.

[0200] The processor 600 is responsible for managing the bus architecture and general processing, and the memory 620 can store data used by the processor 600 when performing operations.

[0201] In some embodiments, the processor 600 may be a CPU (central processing unit), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array) or a CPLD (Complex Programmable Logic Device), and the processor may also adopt a multi-core architecture.

[0202] The processor calls the computer program stored in the memory to execute any of the methods provided in the embodiments of the present application according to the obtained executable instructions. The processor and the memory can also be arranged physically separately.

[0203] It should be noted here that the above-mentioned device provided in the embodiment of the present application can implement all the method steps implemented in the above-mentioned method embodiment, and can achieve the same technical effect. The parts and beneficial effects of this embodiment that are the same as those in the method embodiment will not be described in detail here.

[0204] See also Fig.11 , an image processing device provided by an embodiment of the present application includes:

[0205] The first unit 11 is used to obtain a target image to be detected that is currently input, and divide the target image into image blocks according to a preset rule to obtain at least one image block;

[0206] The second unit 12 is used to match the image block in the target image with the image block corresponding to the display screen aging-prone area determined in advance based on the historical input image, and determine at least one matching image block in the target image; wherein the display screen aging-prone area determined in advance based on the historical input image includes a display area corresponding to at least one image block;

[0207] The third unit 13 is used to determine whether it is necessary to perform an image brightness adjustment operation on the target image based on at least one matching image block in the target image.

[0208] In some embodiments, a preprocessing unit (not shown in the figure) is further included for determining the aging-prone area of ​​the display screen based on the historical input image in advance. The preprocessing unit is specifically used for:

[0209] Obtain at least one frame of historical input image from a local device;

[0210] Based on the at least one frame of historical input image, for each pixel, calculating an average pixel value of the pixel;

[0211] Regenerate the image based on the average pixel value of each pixel;

[0212] According to the preset rule, dividing the regenerated image into image blocks to obtain at least one image block;

[0213] For each image block in the regenerated image, or for each image block in a preset candidate area in the regenerated image, the pixel sum of the image block is counted, and when the pixel sum is greater than a preset threshold, it is determined that the display area corresponding to the image block belongs to the display screen prone to aging area.

[0214] In some embodiments, judging whether it is necessary to perform an image brightness adjustment operation on the target image based on at least one matching image block in the target image includes:

[0215] Determine whether there is a target image block that needs brightness adjustment in at least one of the matching image blocks in the target image;

[0216] When the target image block exists, a brightness reduction operation is performed on the target image block.

[0217] In some embodiments, determining whether there is a target image block that needs to be brightness adjusted in at least one of the matching image blocks in the target image includes:

[0218] For each of the matching image blocks, a sum of pixel values ​​of each pixel point in the matching image block is determined to obtain a first sum value; and a sum of pixel values ​​of each pixel point in a pre-recorded image block corresponding to the matching image block is determined to obtain a second sum value; when the first sum value is greater than or equal to the second sum value, the matching image block is determined to be a target image block requiring brightness adjustment;

[0219] Alternatively, for each matching image block, the sum of the pixel values ​​of each pixel in the matching image block is determined, and when the sum is greater than or equal to a preset threshold, the matching image block is determined to be a target image block requiring brightness adjustment.

[0220] In some embodiments, performing a brightness reduction operation on the target image block includes:

[0221] According to a preset adjustment strategy, at least one brightness reduction operation is performed on the target image block.

[0222] In some embodiments, the third unit 13 is further configured to:

[0223] For each of the target image blocks, after each brightness reduction operation on the target image block is completed, it is determined whether the adjusted brightness of the target image block meets the conditions for continuing the brightness reduction operation. If so, the next brightness reduction operation is continued; otherwise, the brightness reduction operation on the target image block is stopped.

[0224] In some embodiments, matching the image blocks in the target image with pre-recorded image blocks to determine the matching image blocks in the target image includes:

[0225] According to the recorded coordinate index information of the image block in the display area, the image block having the same coordinate index information is searched in the target image, and the searched image block is used as the matching image block in the target image.

[0226] It should be noted that the division of units in the embodiments of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation. In addition, each functional unit in each embodiment of the present application may be integrated into a processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0227] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), disk or optical disk and other media that can store program codes.

[0228] Any of the devices or apparatuses provided in the embodiments of the present application may specifically be a desktop computer, a portable computer, a smart phone, a tablet computer, a personal digital assistant (PDA), etc. It may include a central processing unit (CPU), a memory, an input / output device, etc. The input device may include a keyboard, a mouse, a touch screen, etc. The output device may include a display device, such as a liquid crystal display (LCD), a cathode ray tube (CRT), etc.

[0229] The memory may include a read-only memory (ROM) and a random access memory (RAM), and provides the processor with program instructions and data stored in the memory. In an embodiment of the present application, the memory may be used to store the program of any of the methods provided in the embodiments of the present application.

[0230] The processor calls the program instructions stored in the memory, and the processor is used to execute any of the methods provided in the embodiments of the present application according to the obtained program instructions.

[0231] The present application embodiment also provides a computer program product or computer program, which includes a computer instruction, which is stored in a computer-readable storage medium. The processor of the computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction so that the computer device executes any of the methods described in the above embodiments. The program product can use any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, - but not limited to - an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of readable storage media (non-exhaustive list) include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0232] The embodiment of the present application provides a computer-readable storage medium for storing computer program instructions used by the apparatus provided in the embodiment of the present application, which includes a program for executing any of the methods provided in the embodiment of the present application. The computer-readable storage medium may be a non-transitory computer-readable medium.

[0233] The computer-readable storage medium can be any available medium or data storage device that can be accessed by a computer, including but not limited to magnetic storage (such as floppy disks, hard disks, magnetic tapes, magneto-optical disks (MO), etc.), optical storage (such as CD, DVD, BD, HVD, etc.), and semiconductor storage (such as ROM, EPROM, EEPROM, non-volatile memory (NANDFLASH), solid-state drive (SSD)), etc.

[0234] It should be understood that:

[0235] The access technology through which entities in the communication network transmit traffic can be any suitable current or future technology, such as WLAN (Wireless Local Access Network), WiMAX (Worldwide Interoperability for Microwave Access), LTE, LTE-A, 5G, Bluetooth, infrared, etc.; in addition, the embodiments can also apply wired technology, for example, IP-based access technology, such as a wired network or a fixed line.

[0236] Embodiments suitable for being implemented as software code or a portion thereof and running using a processor or processing functionality are independent of the software code and may be specified using any known or future developed programming language, such as a high-level programming language such as objective-C, C, C++, C#, Java, Python, Javascript, other scripting languages, etc., or a low-level programming language such as machine language or assembler.

[0237] The implementation of the embodiments is hardware independent and may be implemented using any known or future developed hardware technology or any mixture thereof, such as a microprocessor or CPU (central processing unit), MOS (metal oxide semiconductor), CMOS (complementary MOS), BiMOS (bipolar MOS), BiCMOS (bipolar CMOS), ECL (emitter coupled logic) and / or TTL (transistor-transistor logic).

[0238] Embodiments may be implemented as separate devices, apparatuses, units, components, or functions, or in a distributed manner, for example, one or more processors or processing functions may be used or shared in a process, or one or more processing segments or processing portions may be used and shared in a process, wherein one physical processor or more than one physical processor may be used to implement one or more processing portions dedicated to a specific process as described.

[0239] The device may be implemented by a semiconductor chip, a chipset, or a (hardware) module including such a chip or chipset.

[0240] The embodiments may also be implemented as any combination of hardware and software, such as ASIC (Application Specific IC (Integrated Circuit)) components, FPGA (Field Programmable Gate Array) or CPLD (Complex Programmable Logic Device) components or DSP (Digital Signal Processor) components.

[0241] The embodiments may also be implemented as a computer program product including a computer usable medium having computer readable program code embodied therein, the computer readable program code being adapted to perform the processes as described in the embodiments, wherein the computer usable medium may be a non-transitory medium.

[0242] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) that contain computer-usable program code.

[0243] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0244] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0245] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0246] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. An image processing method, characterized in that: The method comprises: Acquire a target image to be detected that is currently input, and divide the target image into image blocks according to a preset rule to obtain at least one image block; Matching an image block in the target image with an image block corresponding to an area of ​​the display screen susceptible to aging determined in advance based on a historical input image, to determine at least one matching image block in the target image; wherein the area of ​​the display screen susceptible to aging determined in advance based on a historical input image includes a display area corresponding to at least one image block; Based on at least one of the matching image blocks in the target image, it is determined whether an image brightness adjustment operation needs to be performed on the target image.

2. The method according to claim 1, characterized in that Determining the display screen prone to aging area based on the historical input image in advance includes: Obtain at least one frame of historical input image from a local device; Based on the at least one frame of historical input image, for each pixel, calculating an average pixel value of the pixel; Regenerate the image based on the average pixel value of each pixel; According to the preset rule, dividing the regenerated image into image blocks to obtain at least one image block; For each image block in the regenerated image, or for each image block in a preset candidate area in the regenerated image, the pixel sum of the image block is counted, and when the pixel sum is greater than a preset threshold, it is determined that the display area corresponding to the image block belongs to the display screen prone to aging area.

3. The method according to claim 1, characterized in that Based on at least one of the matching image blocks in the target image, determining whether an image brightness adjustment operation needs to be performed on the target image includes: Determine whether there is a target image block that needs brightness adjustment in at least one of the matching image blocks in the target image; When the target image block exists, a brightness reduction operation is performed on the target image block.

4. The method according to claim 3, characterized in that Determining whether there is a target image block that needs to be brightness adjusted in at least one of the matching image blocks in the target image includes: For each of the matching image blocks, a sum of pixel values ​​of each pixel point in the matching image block is determined to obtain a first sum value; and a sum of pixel values ​​of each pixel point in a pre-recorded image block corresponding to the matching image block is determined to obtain a second sum value; when the first sum value is greater than or equal to the second sum value, the matching image block is determined to be a target image block requiring brightness adjustment; Alternatively, for each matching image block, the sum of the pixel values ​​of each pixel in the matching image block is determined, and when the sum is greater than or equal to a preset threshold, the matching image block is determined to be a target image block requiring brightness adjustment.

5. The method according to claim 3, characterized in that: Performing a brightness reduction operation on the target image block includes: According to a preset adjustment strategy, at least one brightness reduction operation is performed on the target image block.

6. The method according to claim 5, characterized in that The method further comprises: For each of the target image blocks, after each brightness reduction operation on the target image block is completed, it is determined whether the adjusted brightness of the target image block meets the conditions for continuing the brightness reduction operation. If so, the next brightness reduction operation is continued; otherwise, the brightness reduction operation on the target image block is stopped.

7. The method according to claim 1, characterized in that Matching the image blocks in the target image with the pre-recorded image blocks to determine the matching image blocks in the target image includes: According to the recorded coordinate index information of the image block in the display area, the image block having the same coordinate index information is searched in the target image, and the searched image block is used as the matching image block in the target image.

8. An image processing device, characterized in that: The device comprises: The first unit is used to obtain a target image to be detected that is currently input, and divide the target image into image blocks according to a preset rule to obtain at least one image block; A second unit is used to match an image block in the target image with an image block corresponding to an area of ​​the display screen susceptible to aging that is determined in advance based on a historical input image, to determine at least one matching image block in the target image; wherein the area of ​​the display screen susceptible to aging that is determined in advance based on a historical input image includes a display area corresponding to at least one image block; The third unit is used to determine whether it is necessary to perform an image brightness adjustment operation on the target image based on at least one matching image block in the target image.

9. An electronic device, characterized in that: include: A memory for storing program instructions; A processor, configured to call the program instructions stored in the memory, and execute the method according to any one of claims 1 to 7 according to the obtained program.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to enable the computer to execute the method according to any one of claims 1 to 7.

Images