A video coding processing method, apparatus, device, storage medium and product

Abstract

Embodiments of the present application provide a video encoding processing method, device, equipment, storage medium and product. The technical solution provided by the embodiments of the present application divides a to-be-processed frame into a region of interest, a region of non-interest and a transition region, determines filter strength information corresponding to a smooth block in the region of non-interest, performs filter processing on the smooth block in the to-be-processed frame according to the filter strength information to obtain a filter image frame, adjusts initial quantization parameters of a plurality of coding units in the filter image frame determined based on an average code rate code control strategy, and encodes the filter image frame according to target quantization parameters of each coding unit. While ensuring the video encoding quality, the embodiments of the present application reduce the situation that the region of non-interest produces blur and block effect due to too low allocated code rate, effectively solve the technical problem that the average code rate code control strategy easily leads to the decline of video encoding quality in the case of limited bandwidth, and improve the video encoding quality.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the technical field of coding, and in particular, to a video coding processing method and device, equipment, storage medium and product. BACKGROUND

[0002] With the development of video coding technology, video coding technology has been applied to various fields of life. For different application scenarios, video coding has different optimization directions. In the limited bandwidth scenarios such as entertainment video and video call, the importance of the region where the human face is located is higher than that of the background region, and the region where the human face is located often needs to be improved in video coding.

[0003] In many application scenarios, low complexity human face detection is necessary because human face detection needs to be performed on each frame of image. Therefore, some low complexity skin color detection algorithms are proposed. The core idea is to convert the current pixel point to different color spaces, compare whether each color component of the color space meets the empirical value of the skin color, and divide the skin color region of interest containing all skin color pixels. In the coding process, the code rate allocated to the skin color region of interest can be increased, and the subjective quality of this region is improved to improve the perception of the overall quality by the human eye.

[0004] However, in the limited bandwidth scenarios such as entertainment video and video call, the total code rate that can be used by video coding is constant. Generally, the average code rate control strategy (for example, the average bit rate control strategy ABR) is used, that is, the output code rate of coding needs to meet the input code rate designed according to the bandwidth, so as to ensure that the coded stream can be sent out under the current bandwidth. Under this code control strategy, while increasing the code rate allocated to the skin color region of interest, the code rate allocated to the non-interest region needs to be reduced. When the bandwidth condition is not ideal or the given code rate is very low, reducing the code rate of the non-interest region will cause the quality of the non-interest region to decrease significantly, resulting in block effect and blur and other situations that are not conducive to the subjective, and thus leading to a decrease in video coding quality and poor video coding quality. SUMMARY

[0005] Embodiments of the present application provide a video coding processing method, device, equipment, storage medium and product to solve the technical problem of related art that the average code rate control strategy in the limited bandwidth scenario easily leads to a decrease in video coding quality and poor video coding quality, and effectively improve the video coding quality.

[0006] In a first aspect, embodiments of the present application provide a video coding processing method, comprising:

[0007] determining an interest region, a non-interest region and a transition region in a frame to be processed, the transition region being located between the interest region and the non-interest region;

[0008] determine smooth blocks in the non-interest region and filter strength information corresponding to each of the smooth blocks, and perform filter processing on the smooth blocks in the frame to be processed according to the filter strength information, to obtain a filtered image frame;

[0009] determine initial quantization parameters of a plurality of coding units in the filtered image frame based on a set average code rate code control strategy, and adjust the initial quantization parameters corresponding to the interest region, the non-interest region and the transition region, to obtain target quantization parameters of each of the coding units, wherein the adjustment values of the initial quantization parameters of the interest region, the transition region and the non-interest region increase in turn;

[0010] perform coding processing on the filtered image frame according to the target quantization parameters of each of the coding units.

[0011] In a second aspect, an embodiment of the present application provides a video coding processing apparatus, comprising a region determination module, an image filter module, a parameter adjustment module and an image coding module, wherein:

[0012] The region determination module is configured to determine an interest region, a non-interest region and a transition region in a frame to be processed, and the transition region is located between the interest region and the non-interest region.

[0013] The image filter module is configured to determine smooth blocks in the non-interest region and filter strength information corresponding to each of the smooth blocks, and perform filter processing on the smooth blocks in the frame to be processed according to the filter strength information, to obtain a filtered image frame.

[0014] The parameter adjustment module is configured to determine initial quantization parameters of a plurality of coding units in the filtered image frame based on a set average code rate code control strategy, and adjust the initial quantization parameters corresponding to the interest region, the non-interest region and the transition region, to obtain target quantization parameters of each of the coding units, wherein the adjustment values of the initial quantization parameters of the interest region, the transition region and the non-interest region increase in turn.

[0015] The image coding module is configured to perform coding processing on the filtered image frame according to the target quantization parameters of each of the coding units.

[0016] In a third aspect, an embodiment of the present application provides a video coding processing device, comprising a memory and one or more processors.

[0017] The memory is used to store one or more programs.

[0018] When the one or more programs are executed by the one or more processors, the one or more processors implement the video encoding processing method as the first aspect.

[0019] In a fourth aspect, the embodiments of the present application provide a non-transitory storage medium storing computer-executable instructions for executing a video encoding processing method as the first aspect when executed by a computer processor.

[0020] In a fifth aspect, the embodiments of the present application provide a computer program product including a computer program stored in a computer readable storage medium, and at least one processor of a device reads and executes the computer program from the computer readable storage medium, so that the device executes a video encoding processing method as the first aspect.

[0021] The embodiments of the present application divide the to-be-processed frame into the region of interest, the non-region of interest and the transition region, determine the filter strength information corresponding to the smooth block in the non-region of interest, perform filter processing on the smooth block in the to-be-processed frame according to the filter strength information to obtain a filter image frame, adjust the initial quantization parameter of a plurality of coding units in the filter image frame determined based on the average code rate code control strategy, and then encode the filter image frame according to the target quantization parameter of each coding unit. The non-region of interest has less impact on the subjective quality of the human eye, and the adjustment value of the initial quantization parameter of the region of interest, the transition region and the non-region of interest is increased in turn. In this way, the video encoding quality is ensured, the blurring and blocking effect caused by the too low allocated code rate in the non-region of interest is reduced, the technical problem that the average code rate code control strategy easily leads to the decline of the video encoding quality and the poor video encoding quality in the case of limited bandwidth is effectively solved, and the video encoding quality is improved. BRIEF DESCRIPTION OF DRAWINGS

[0022] Figure 1 is a flowchart of a video encoding processing method provided by the embodiments of the present application;

[0023] Figure 2 is a flowchart of another video encoding processing method provided by the embodiments of the present application;

[0024] Figure 3 is a schematic diagram of original region division provided by the embodiments of the present application;

[0025] Figure 4 is a schematic diagram of revised region division provided by the embodiments of the present application;

[0026] Figure 5is a display schematic diagram of a region of interest, a region of non-interest and a transition region provided by an embodiment of the present application;

[0027] Figure 6 is a structural schematic diagram of a video encoding processing device provided by an embodiment of the present application;

[0028] Figure 7 is a structural schematic diagram of a video encoding processing device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0029] In order to make the purposes, technical solutions and advantages of the present application clearer, the following further describes specific embodiments of the present application with reference to the drawings. It can be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application. In addition, it should be noted that, for the convenience of description, only parts related to the present application are shown in the drawings, but not all contents. Before discussing the example embodiments in more detail, it should be mentioned that some example embodiments are described as processes or methods depicted by flowcharts. Although the flowcharts describe each operation (or step) as a sequential process, many of the operations can be implemented in parallel, concurrently or simultaneously. In addition, the order of the operations can be rearranged. The above process can be terminated when its operations are completed, but can also have additional steps not included in the drawings. The above process can correspond to a method, function, procedure, subroutine, subprogram, etc.

[0030] The video encoding processing method provided by the present application can be applied to live scene, video call scene or other video transmission scene under code rate / bandwidth limitation, aims to filter process the region of non-interest which has less influence on human subjective quality, and adjust the initial quantization parameter of multiple coding units in the filtered image frame determined based on the average code rate control strategy, and the adjustment value of the initial quantization parameter of the region of interest, the transition region and the region of non-interest is increased in turn, so as to improve the video encoding quality based on the average code rate control strategy under the condition of limited bandwidth. In the existing video encoding scheme, when video encoding is performed based on the average code rate control strategy under the condition of limited bandwidth, the code rate allocated to the skin color region of interest is generally directly increased, while the code rate allocated to the region of non-interest needs to be reduced. When the bandwidth condition is not ideal or the given code rate is very low, reducing the code rate of the region of non-interest will cause the quality of the region of non-interest to decrease greatly, resulting in block effect and blur which are not conducive to the subjective quality of the video, and thus the overall subjective quality becomes worse. Based on this, the video encoding processing method provided by an embodiment of the present application is provided to solve the technical problem that the existing video encoding scheme based on the average code rate control strategy under the condition of limited bandwidth easily leads to the decrease of video encoding quality and poor video encoding quality.

[0031] Figure 1 A flowchart of a video encoding processing method provided by an embodiment of the present application is given. The video encoding processing method provided by the embodiment of the present application can be executed by a video encoding processing apparatus, which can be implemented in hardware and / or software and integrated in a video encoding processing device.

[0032] The video encoding processing method executed by the video encoding processing apparatus is described below by way of example. With reference to Figure 1 , the video encoding processing method comprises:

[0033] S110: determining a region of interest, a non-region of interest and a transition region in a frame to be processed, the transition region being located between the region of interest and the non-region of interest.

[0034] The frame to be processed provided by the present solution can be an image frame to be encoded in the video information to be encoded. For example, after obtaining the frame to be processed to be encoded, a region of interest (ROI), a non-region of interest and a transition region in the frame to be processed are determined, wherein the transition region is located between the region of interest and the non-region of interest as a transition between the region of interest and the non-region of interest. The region of interest can be understood as a region of interest to human eyes in the frame to be processed. In the present solution, a region corresponding to human skin in the frame to be processed is taken as the region of interest. In the encoding process, the encoding bit rate of the region of interest is increased, the encoding bit rate of the non-region of interest is decreased, and the encoding bit rate of the transition region is transitioned between the region of interest and the non-region of interest. The region of interest provided by the present solution can be a region corresponding to human skin color in the image. For example, the region of interest can be a region formed by a plurality of pixel points with color values in a preset skin color pixel point color value range, and the non-region of interest can be a region formed by a plurality of pixel points with color values not in the preset skin color pixel point color value range. The transition region is a transition between the region of interest and the non-region of interest, and the pixel points corresponding to the transition region can be determined among the pixel points adjacent to the region of interest in the non-region of interest.

[0035] In an embodiment, the frame to be processed can be divided into a plurality of image blocks of a set size, each image block comprising a plurality of pixels, and a region corresponding to each image block is determined, for example, the region corresponding to each image block can be determined according to the block pixel value (for example, the average pixel value of the plurality of pixels in the image block) of the image block. The pixel value provided by the present scheme can be represented by the pixel value of the Y channel reflecting brightness and the pixel value of the UV channel reflecting color in the YUV (brightness, chroma, concentration) color space. Optionally, according to the block pixel value of the image block, it can be determined whether the image block belongs to the region of interest (the block pixel value is within the empirical range of the skin color pixel value) or the non-region of interest (the block pixel value is outside the empirical range of the skin color pixel value), and the image blocks in the non-region of interest adjacent or close to the region of interest are divided into the transition region.

[0036] Optionally, the set size of the image block of the frame to be processed can be determined according to the different resolutions of the frame to be processed, and the lower the resolution of the frame to be processed or the encoded video information, the smaller the corresponding set size. In addition, the pixel value corresponding to the pixel point of the central set size (for example, 2x2) of the image block can be divided into regions, and the calculation amount of video encoding processing can be effectively reduced by dividing the frame to be processed into a plurality of image blocks of a set size. For example, the frame to be processed is divided into NxN image blocks. Considering the accuracy of skin color recognition, for a video with a resolution less than 360p, the image block can be divided smaller, and N=8 at this time. For a video of 360p and above, N=16. Optionally, the pixel value of each NxN image block is recorded (for example, recorded into skin_map. Optionally, skin_map can record only the pixel value of the Y component, and the UV component can not be recorded, thereby reducing the occupation of storage space.). If the recorded pixel value of the current image block meets the skin color empirical value, it is considered that the current image block belongs to the region of interest. If the recorded pixel value of the current image block does not meet the skin color empirical value, it is considered that the current image block belongs to the non-region of interest, and the image blocks in the non-region of interest adjacent to the region of interest are divided into the transition region.

[0037] S120: determining the smooth block in the non-region of interest and the filter strength information corresponding to each smooth block, and performing filter processing on the smooth block in the frame to be processed according to the filter strength information, to obtain a filtered image frame.

[0038] For example, after determining the region of interest, the non-region of interest, and the transition region in the frame to be processed, the smooth block in each image block in the non-region of interest is determined, and the filter strength information corresponding to each smooth block is determined.

[0039] The image blocks in the non-interest region can be divided into smooth blocks and non-smooth blocks according to the smoothness of the pixel values of the image blocks, and each smooth block corresponds to a filter strength information. When the smoothness of the pixel values of an image block reaches a set threshold, the image block is considered as a smooth block; when the smoothness of the pixel values of an image block does not reach the set threshold, the image block is considered as a non-smooth block. Optionally, the higher the smoothness of the pixel values of a smooth region, the higher the filter strength information of the filter strength that can be set.

[0040] In an embodiment, the detection of the smooth blocks in the non-interest region can be determined according to the difference between the average pixel values of the multiple pixel points around the periphery and the center of the image blocks in the non-interest region (the average pixel values can be determined according to the first average pixel value of the multiple pixel points around the periphery and the second average pixel value of the multiple pixel points at the center) and the average pixel value of the multiple pixel points at the center of the image blocks, and the smaller the difference, the higher the smoothness. The detection of the smooth blocks in the non-interest region can also be based on edge detection of the Sobel operator, which identifies the gradient around each pixel point of the image block to determine whether the current pixel point is an edge pixel with obvious high frequency. If the proportion of the edge pixels in an image block is less than a set proportion threshold, the current image block is considered as a smooth block. In addition, different filter strength information (such as Gaussian threshold) can be assigned according to the proportion of the edge pixels. Optionally, since the brightness Y component can best represent the texture information of the pixels, the texture information can be used to accurately determine the smoothness of the pixel values, and the detection of the smooth blocks in the non-interest region can be determined according to the Y channel pixel values reflecting the brightness of the multiple pixel points around the periphery and the center of the image blocks in the non-interest region.

[0041] In an embodiment, for each smooth block, the smooth block in the frame to be processed is filtered according to the filter strength information to obtain a filtered image frame. The filtering of the smooth block can reduce the high frequency information in the smooth block and reduce the block effect generated by subsequent encoding of the smooth block.

[0042] Optionally, the filtering manner of the smoothing block can be Gaussian filtering, mean filtering, median filtering, bilateral filtering (allowed in occasions with higher complexity) or other filtering manners designed according to video characteristics to reduce high-frequency information. For example, in occasions with more noise (e.g., dark light, unstable acquisition, etc.), median filtering can effectively reduce the high-frequency salt and pepper noise in the video, and also improve the subjective quality of the non-skin color region (non-interest region). Through the combination of skin color detection of the frame to be processed and Gaussian filtering of the non-skin color region (non-interest region), the skin color detection result is used for subsequent encoder adjustment of code rate allocation, and the Gaussian filtering directly processes the original image before encoding. By adaptively performing Gaussian filtering on the non-skin color region, the high-frequency information loss of the relatively smoother region is minimized, and the video encoding quality is improved.

[0043] In one embodiment, when filtering an image block in the smoothing region according to the filtering strength information, each pixel point in the image block can be sequentially traversed, and the filtered value of the center point is taken as the filtering result of the pixel value of the surrounding region (3x3 or 5x5 region) centered on the corresponding pixel.

[0044] S130: Determine the initial quantization parameters of the multiple coding units in the filtered image frame based on the set average code rate code control strategy, and adjust the initial quantization parameters corresponding to the interest region, the non-interest region and the transition region to obtain the target quantization parameters of each coding unit.

[0045] In this scheme, the adjustment values of the initial quantization parameters (QP, Quantization Parameter) of the interest region, the transition region and the non-interest region are sequentially increased. It needs to be explained that when encoding the image, after determining the quantization parameters of the multiple coding units in the image, the coding units of the image can be encoded according to the quantization parameters, and the code rate corresponding to the coding units after the encoding processing is negatively correlated with the quantization parameters, that is, the larger the quantization parameter during the final quantization, the smaller the code rate after the encoding.

[0046] For example, based on the set average code rate code control strategy (ABR code control strategy), the initial quantization parameters of the multiple coding units of the filtered image frame obtained by the above filtering processing are determined, and the initial quantization parameters corresponding to the interest region, the non-interest region and the transition region are adjusted respectively to obtain the target quantization parameters of each coding unit.

[0047] In the encoding process, the region of interest is considered as a more important region, and more code rate can be allocated to the region of interest. The transition region is considered as a transition region adjacent to the important region, and the code rate allocated to the transition region can be slightly increased or decreased. The non-interest region is considered as a region insensitive to human eyes, and the code rate allocated to the non-interest region can be reduced. The initial quantization parameters of the multiple coding units in the filtered image frame determined based on the average code rate control strategy are adjusted to adjust the code rate allocated to the region of interest, the non-interest region and the transition region.

[0048] For example, for the region of interest, the initial quantization parameters of the coding units in the region of interest are reduced (or remain unchanged) to obtain the target quantization parameters of the corresponding coding units, and more code rate (or remain unchanged) is allocated to the coding units in the region of interest during encoding. For the non-interest region, the initial quantization parameters of the coding units in the non-interest region are increased (or remain unchanged) to obtain the target quantization parameters of the corresponding coding units, and less code rate (or remain unchanged) is allocated to the coding units in the non-interest region during encoding. For the transition region, the initial quantization parameters of the coding units in the transition region are slightly increased or reduced (or remain unchanged) to obtain the target quantization parameters of the corresponding coding units, and the code rate allocated to the coding units in the transition region is slightly reduced or increased (or remain unchanged) relative to the code rate allocated according to the initial quantization parameters during encoding. The adjustment value of the initial quantization parameters of the transition region is between the adjustment values of the initial quantization parameters of the region of interest and the non-interest region.

[0049] In one possible embodiment, the first adjustment value of the initial quantization parameters of the region of interest is less than or equal to 0, the second adjustment value of the initial quantization parameters of the non-interest region is greater than or equal to 0, and the third adjustment value of the initial quantization parameters of the transition region is between the first adjustment value and the second adjustment value. When the initial quantization parameters of the region of interest, the non-interest region and the transition region are adjusted, the sum of the initial quantization parameters and the corresponding adjustment values can be used as the target quantization parameters. The third adjustment values corresponding to different coding units can be the same or different. The initial quantization parameters of the region of interest, the non-interest region and the transition region are adjusted by the first adjustment value, the second adjustment value and the third adjustment value, respectively, to accurately obtain the target quantization parameters corresponding to different regions. The display quality of the skin color in the region of interest is maintained, the transition between different regions is smoother and more natural, the blurring and blocking effect in the non-interest region due to the low allocated code rate is reduced, and the video encoding quality is ensured.

[0050] In one embodiment, in a case where the pixels of one coding unit exist in different regions (including the region of interest, the region of non-interest, and the transition region), the initial quantization parameter of the coding unit can be adjusted based on the adjustment values (including the first adjustment value, the second adjustment value, and the third adjustment value) corresponding to the different regions to obtain the target quantization parameter of the coding unit. For example, the average of the adjustment values of the regions where the pixels of the coding unit exist is taken as the adjustment value for adjusting the initial quantization parameter of the coding unit, or the multiple adjustment values are weighted and summed according to the proportions of the pixels in the different regions, and the weighted sum result is taken as the adjustment value for adjusting the initial quantization parameter of the coding unit.

[0051] S140: Perform encoding processing on the filtered image frame according to the target quantization parameter of each coding unit.

[0052] For example, in the determination of the target quantization parameter corresponding to each coding unit, the encoding processing on the filtered image frame is performed according to the target quantization parameter of each coding unit to obtain an encoded image. Since the target quantization parameter of the region of interest, the region of non-interest, and the transition region changes relative to the initial quantization parameter, for the coding unit whose quantization parameter changes, when the target quantization parameter increases relative to the initial quantization parameter, the code rate allocated in the encoding process decreases, and when the target quantization parameter decreases relative to the initial quantization parameter, the code rate allocated in the encoding process increases.

[0053] In the final encoded image, the total code rate corresponding to the region of interest is improved relative to the total code rate corresponding to the region of interest in the encoded image obtained based on the initial quantization parameter, the total code rate corresponding to the region of non-interest is reduced relative to the total code rate corresponding to the region of non-interest in the encoded image obtained based on the initial quantization parameter, and the total code rate corresponding to the transition region is slightly reduced or increased relative to the total code rate corresponding to the transition region in the encoded image obtained based on the initial quantization parameter. The display quality in the region of interest is higher, the display in the transition region is smoother and more natural, and the blurring and blocking effect in the region of non-interest due to the excessively low allocated code rate is effectively reduced while the video encoding quality is ensured.

[0054] In one embodiment, in the encoding processing on the filtered image frame according to the target quantization parameter of each coding unit, the target quantization parameter is first subjected to rounding processing, and then the integer target quantization parameter is obtained based on the integer target quantization parameter.

[0055] By dividing the frame to be processed into the region of interest, the region of non-interest and the transition region, determining the filtering strength information corresponding to the smooth blocks in the region of non-interest, filtering the smooth blocks in the frame to be processed according to the filtering strength information to obtain the filtered image frame, adjusting the initial quantization parameters of the multiple coding units in the filtered image frame determined based on the average code rate control strategy, and encoding the filtered image frame according to the target quantization parameters of each coding unit, the region of non-interest which has less influence on the subjective quality of the human eye is filtered, and the adjustment values of the initial quantization parameters of the region of interest, the transition region and the region of non-interest are sequentially increased, so that the video coding quality is ensured, the blurring and blocking effect caused by the too low allocated code rate in the region of non-interest is reduced, the technical problem that the average code rate control strategy easily leads to the decline of the video coding quality and the poor video coding quality in the case of limited bandwidth is effectively solved, and the video coding quality is improved.

[0056] On the basis of the above-mentioned embodiments, Figure 2 A flowchart of another video coding processing method provided by the embodiments of the present application is given, which is a specific embodiment of the above-mentioned video coding processing method. Referring to Figure 2 The video coding processing method comprises:

[0057] S210: determining the first pixel value of each image block in the frame to be processed.

[0058] S220: dividing each image block into the region of interest or the region of non-interest based on the first pixel value and the set skin color experience range.

[0059] S230: dividing the image block adjacent to the region of interest in the region of non-interest into the transition region.

[0060] For example, the frame to be processed is divided into multiple image blocks of a set size (for example, 8x8), and the first pixel value of each image block is calculated. Optionally, the first pixel value can be represented by the average pixel value of multiple pixel points in a set range (for example, 2x2) in the image block.

[0061] The first pixel value of each image block is compared with the set skin color experience range (the pixel value range corresponding to the skin color), and the image block with the first pixel value in the skin color experience range is divided into the region of interest, and the image block with the first pixel value outside the skin color experience range is divided into the region of non-interest. After determining that each image block belongs to the region of interest or the region of non-interest, the image block adjacent to the region of interest in the region of non-interest is divided into the transition region. At this time, the transition region is located between the region of interest and the region of non-interest.

[0062] The present scheme divides the to-be-processed frame into the region of interest or the region not of interest according to the comparison of the first pixel value of each image block and the skin color empirical range, and divides the image block adjacent to the region of interest in the region not of interest into the transition region, thereby accurately dividing the to-be-processed frame into the region of interest, the region not of interest and the transition region, and improving the subsequent filtering processing of the region not of interest and the video coding quality.

[0063] In one possible embodiment, after dividing each image block into the region of interest or the region not of interest based on the first pixel value and the set skin color empirical range (before dividing the image block adjacent to the region of interest in the region not of interest into the transition region), the video coding processing method provided by the present scheme further includes at least one of S231 and S232:

[0064] S231: converting the image block independently existing in the region of interest into the region not of interest.

[0065] S232: converting the image block adjacent to the region of interest in the region not of interest into the region of interest when the number of the adjacent image blocks reaches a set number.

[0066] In one embodiment, after dividing each image block into the region of interest or the region not of interest, the image block independently existing in the region of interest is determined, and the image block is converted from the region of interest into the region not of interest. Optionally, when the number of the image blocks belonging to the region of interest in the eight image blocks around the image block in the region of interest is less than or equal to a set first number (for example, 1-2), the corresponding image block is considered as the image block independently existing.

[0067] In one embodiment, after dividing each image block into the region of interest or the region not of interest, the image block adjacent to the region of interest in the region not of interest is determined, the number of the adjacent image blocks (i.e. the number of the image blocks belonging to the region of interest in the eight image blocks around the image block) is determined, and the image block in the region not of interest corresponding to the adjacent number reaching a set number is converted into the region of interest. Optionally, when the adjacent number reaches a set second number (for example, 6-8), the image block in the region not of interest is considered as the image block surrounded by the region of interest, and the image block is converted into the region of interest.

[0068] The present scheme converts the image block independently existing in the region of interest into the region not of interest, and converts the image block surrounded by the region of interest in the region not of interest into the region of interest, thereby reducing the case that an independent region is not allocated with the code rate or the independent region is allocated with a high code rate when allocating the code rate for the image blocks in different regions, reducing the misjudgment of the skin color region, and improving the video coding quality.

[0069] For example, after dividing each image block into the region of interest or the region of non-interest based on the first pixel value and the set skin color experience range, and dividing the image block adjacent to the region of interest in the region of non-interest into the transition region, an original region division schematic diagram is obtained as shown in the following table. Figure 3 Each small box in the table is an image block, wherein the region A is the region of interest, the region B is the region of non-interest, and different regions are distinguished by different textures.

[0070] It is assumed that the first quantity is set to 2 and the second quantity is set to 6. Among them, the number of image blocks belonging to the region of interest in the eight image blocks around the image blocks a, b and c in the region of interest is 1, which is less than the first quantity, and the image blocks a, b and c in the region of interest are considered to be independent image blocks in the region of interest, and the image blocks a, b and c are divided into the region of non-interest. The number of image blocks d, e and f in the region of non-interest is 6, which reaches the second quantity, and the image blocks d, e and f are converted into the region of interest. At this time, a modified region division schematic diagram is obtained as shown in the following table. Figure 4 The modified region division schematic diagram is provided on the basis of the original region division schematic diagram. Figure 4 The image blocks adjacent to the region of interest in the region of non-interest are divided into the transition region, and a display schematic diagram of the region of interest, the region of non-interest and the transition region is obtained as shown in the following table. Figure 5 The modified region division schematic diagram is provided on the basis of the original region division schematic diagram.

[0071] S240: Determine the pixel change value of each image block in the region of non-interest.

[0072] S250: Determine the smoothing block in the multiple image blocks in the region of non-interest according to the smoothing threshold range corresponding to the pixel change value, and determine the filter intensity information corresponding to each smoothing block.

[0073] The different smooth threshold ranges correspond to different filtering intensity information. For example, the pixel change value of each image block in the non-interest region is calculated, and the smooth threshold range corresponding to the pixel change value of each image block is determined. The smooth block is determined in the multiple image blocks in the non-interest region according to the smooth threshold range corresponding to the pixel change value, and the filtering intensity information corresponding to the smooth block is determined according to the filtering intensity information corresponding to the different smooth blocks. The smaller the value corresponding to the smooth threshold range, the greater the corresponding filtering intensity information. According to the smooth threshold range corresponding to the pixel change value of each image block in the non-interest region, the smooth block is accurately determined, and the filtering intensity information corresponding to each smooth block is determined according to the smooth threshold range, so that the determination efficiency of the filtering intensity information is improved, the filtering processing of the non-smooth block is reduced, and the video coding quality is ensured.

[0074] In one embodiment, the video coding processing method provided by the present solution comprises the following steps when determining the pixel change value of each image block in the non-interest region:

[0075] S241: determining the first average pixel value of each image block in the non-interest region in the first pixel range and the second average pixel value in the second pixel range.

[0076] S242: determining the pixel change value of each image block in the non-interest region according to the first average pixel value and the second average pixel value.

[0077] For example, the first average pixel value of each image block in the non-interest region in the first pixel range and the second average pixel value in the second pixel range are determined, wherein the first pixel range and the second pixel range have different pixel points. For example, the first pixel range can be a pixel point range composed of pixel points at four corners of the image block, and the first pixel range can be a pixel point range composed of pixel points with a set size (for example, 2x2) at the center of the image block. Optionally, the second average pixel value can be the first pixel value of the corresponding image block in the to-be-processed frame determined above.

[0078] The pixel change value of each image block in the non-interest region is determined according to the first average pixel value and the second average pixel value. For example, for an image block, the absolute value of the difference between the first average pixel value and the second average pixel value of the image block is taken as the pixel change value of the image block. For example, assuming that the pixel values of the image block at the top left corner, the top right corner, the bottom left corner and the bottom right corner are x_tl, x_tr, x_bl and x_br respectively, the first average pixel value is avg(x_tl+x_tr+x_bl+x_br). x is the serial number of the image block, and the second average pixel value can be represented by the first pixel value skin_map[x] of the corresponding image block in the to-be-processed frame determined above. Then, the pixel change value of the image block can be represented as abs(avg(x_tl+x_tr+x_bl+x_br)-skin_map[x]). According to the first average pixel value of each image block in the non-interest region in the first pixel range and the second average pixel value of each image block in the non-interest region in the second pixel range, the pixel change value of each image block in the non-interest region is accurately determined, the calculation amount of the pixel change value is reduced, the change degree of the pixel points in the image block is correctly reflected, the smooth block and the non-smooth block are accurately distinguished, and the video coding quality is improved.

[0079] In one possible embodiment, the video coding processing method provided by the scheme determines the smooth block in the non-interest region according to the smooth threshold range corresponding to the pixel change value, and determines the filter strength information corresponding to each smooth block, and includes the following steps.

[0080] In the case that the pixel change value of the image block in the non-interest region is in the first smooth threshold range, the image block is determined as the first smooth block, and the filter strength information corresponding to the first smooth block is determined as the first filter strength information.

[0081] In the case that the pixel change value of the image block in the non-interest region is in the second smooth threshold range, the image block is determined as the second smooth block, and the filter strength information corresponding to the second smooth block is determined as the second filter strength information. The second smooth threshold range is higher than the first smooth threshold range, and the first filter strength information is greater than the second filter strength information.

[0082] In the case that the pixel change value of the image block in the non-interest region is out of the second smooth threshold range, the image block is determined as the non-smooth block, and the filter strength information corresponding to the non-smooth block is determined as the third filter strength information. The second smooth threshold range is higher than the first smooth threshold range, and the second filter strength information is greater than the third filter strength information.

[0083] For example, for each image block in the non-interest region, a smooth threshold range corresponding to the pixel variation value of the image block is determined. When the pixel variation value is within the first smooth threshold range, the image block is determined as a first smooth block, and the filter strength information corresponding to the first smooth block is determined as first filter strength information. When the pixel variation value is within the second smooth threshold range, the image block is determined as a second smooth block, and the filter strength information corresponding to the second smooth block is determined as second filter strength information. When the pixel variation value is outside the second smooth threshold range, the image block is determined as a non-smooth block, and the filter strength information corresponding to the non-smooth block is determined as third filter strength information. The smooth degree corresponding to the first smooth block is greater than the smooth degree of the second smooth block.

[0084] Optionally, the filter strength corresponding to the third filter strength information can be set to 0, that is, no filter processing is performed on the image block corresponding to the third filter strength information.

[0085] For example, the filter strength information can be determined based on the following formula:

[0086]

[0087] where th1 is the lower limit value corresponding to the first smooth threshold range, th2 is the upper limit value corresponding to the second smooth threshold range, flat_a, flat_b, and flat_c are regions indicating different smooth degrees, and the smooth degrees corresponding to the regions flat_a, flat_b, and flat_c decrease in turn. Optionally, different filter strength information can be configured for the regions flat_a, flat_b, and flat_c in advance, for example, the filter strength information corresponding to the region flat_a is the first filter strength information, the filter strength information corresponding to the region flat_b is the second filter strength information, and the filter strength information corresponding to the region flat_c is the third filter strength information, and the first filter strength information is greater than the second filter strength information, and the second filter strength information is greater than the third filter strength information. Optionally, the third filter strength information can be 0, that is, when the filter strength information is the third filter strength information, no filter processing is performed on the region corresponding to the third filter strength information. The present scheme accurately distinguishes smooth blocks and non-smooth blocks and the smooth degree of the smooth blocks according to the smooth threshold range corresponding to the pixel variation value of the image block, and accurately determines the filter strength information, thereby improving the video encoding quality.

[0088] In one possible embodiment, the video encoding processing method provided by the present scheme, when determining the smooth blocks in the multiple image blocks in the non-interest region according to the smooth threshold range corresponding to the pixel variation value, and determining the filter strength information corresponding to each smooth block, further comprises:

[0089] In a case that the pixel variation value of the image block in the non-interest region is within the first smooth threshold range and the image block neighbors the transition region, the image block is determined as a second smooth block, and the filter strength information corresponding to the second smooth block is determined as second filter strength information.

[0090] In a case that the pixel variation value of the image block in the non-interest region is within the second smooth threshold range and the image block neighbors the transition region, the image block is determined as a non-smooth block, and the filter strength information corresponding to the non-smooth block is determined as third filter strength information.

[0091] For example, in a case that the pixel variation value of the image block in the non-interest region is within the first smooth threshold range and the image block neighbors the transition region, the image block is determined as a second smooth block, and the filter strength information corresponding to the second smooth block is determined as second filter strength information. In a case that the pixel variation value of the image block in the non-interest region is within the first smooth threshold range but the image block does not neighbor the transition region, the image block is a first smooth block.

[0092] In a case that the pixel variation value of the image block in the non-interest region is within the second smooth threshold range and the image block neighbors the transition region, the image block is determined as a non-smooth block, and the filter strength information corresponding to the non-smooth block is determined as third filter strength information. In a case that the pixel variation value of the image block in the non-interest region is within the second smooth threshold range but the image block does not neighbor the transition region, the image block is a second smooth block. Since the regions near the skin color are also relatively easy to be perceived by the human eye, such as the hair, clothes, handheld objects, etc. of a person, in order to avoid the negative impact of the excessively high filter strength on the coding quality, the filter strength information of the smooth block neighboring the transition region is degraded, and the filter strength on the neighboring transition region is reduced, thereby improving the video coding quality.

[0093] In one possible embodiment, the video coding processing method provided by the present solution further includes, after determining the smooth blocks in the non-interest region and the filter strength information corresponding to each smooth block, performing filter strength transition processing on the filter strength information corresponding to the smooth block neighboring the non-filtered block.

[0094] The non-filtered blocks can be image blocks in the transition region and image blocks in the non-interest region that are considered as non-smooth blocks, and these blocks are image blocks that do not need to be filtered. For example, for the smooth blocks adjacent to the non-filtered blocks, the filter strength information of the smooth blocks is subjected to filter strength transition processing. For example, for the smooth blocks adjacent to the non-filtered blocks, the closer the smooth blocks are to the pixel points of the adjacent non-filtered region, the lower the filter strength corresponding to the filter strength information. At this time, there are various filter strength information corresponding to different pixel points in the smooth region.

[0095] Optionally, when the filter strength information of the smooth blocks adjacent to the non-filtered blocks is subjected to filter strength transition processing, blocks smaller than the size of the smooth blocks (for example, 4x4 blocks) can be subjected to filter strength transition processing. If the filter strengths of two adjacent smooth blocks are different, if there is no transition between the two smooth blocks, for example, two adjacent smooth blocks A and B, smooth block A is strong filtering (filtering based on first filter strength information), and smooth block B is not filtered, the coding effect is actually easy to see that there is a clear boundary between the two blocks. The present solution performs a relatively narrow filter strength transition processing between smooth blocks A and B, gradually reducing the filter strength in the transition region, rather than transitioning the original size (8x8 or 16x16) of the smooth blocks, without directly filtering the entire smooth block, further improving the video coding quality.

[0096] In one possible embodiment, the video coding processing method provided by the present solution further includes, after determining the smooth blocks in the non-interest region and the filter strength information corresponding to each smooth block, performing filter strength transition processing on the filter strength information corresponding to the blocks with different filter strength information and adjacent to each other.

[0097] For example, the filter strength information corresponding to the blocks with different filter strength information and adjacent to each other (for example, two adjacent first smooth blocks and second smooth blocks) is subjected to filter strength transition processing, for example, the filter strength information corresponding to the adjacent boundary setting range (for example, a range of 2xN) in the blocks with different filter strength information and adjacent to each other is set to the average of the two filter strength information. The present solution effectively reduces the case that the filter strengths of adjacent smooth blocks are different and there is a clear contrast between the boundaries by performing filter strength transition processing on the filter strength information corresponding to the blocks with different filter strength information and adjacent to each other, thereby ensuring the video coding quality.

[0098] It needs to be explained that in the image coding process, the coding of high frequency information in the image will occupy part of the code rate, the image coding process will convert the image information from time domain to frequency domain, and finally the coefficients of the image frequency domain information are coded, the smoother the area in the image, the more concentrated the corresponding frequency domain information, and the lower the code rate of the area. In the case of code rate or bandwidth limitation, the present scheme smoothes the transition of the non-interest area, so that the interesting area and the transition area can be allocated more code rate, which can effectively improve the video coding quality. And the subsequent coding operation will reduce the code rate allocated to the non-interest area to improve the code rate allocated to the interesting area and the transition area. However, under the condition of lower code rate allocation, if there is still a lot of high frequency information in the non-interest area, there is a possibility of block effect, and the relatively smooth area is more likely to appear obvious block effect. The present scheme can effectively reduce the block effect of the non-interest area by filtering the filtering strength information of the non-interest area, and improve the video coding quality.

[0099] S260: filtering the smooth block in the frame to be processed according to the filtering strength information to obtain a filtered image frame.

[0100] S270: determining the initial quantization parameter of each coding unit in the filtered image frame based on the set average code rate code control strategy, and adjusting the initial quantization parameter corresponding to the interesting area, the non-interest area and the transition area to obtain the target quantization parameter of each coding unit.

[0101] Wherein, the adjustment value of the initial quantization parameter of the interesting area, the transition area and the non-interest area increases in turn.

[0102] S280: coding the filtered image frame according to the target quantization parameter of each coding unit.

[0103] According to the above, by dividing the to-be-processed frame into the region of interest, the non-region of interest and the transition region, determining the filtering strength information corresponding to the smooth block in the non-region of interest, performing filtering processing on the smooth block in the to-be-processed frame according to the filtering strength information to obtain a filtered image frame, adjusting the initial quantization parameter of the plurality of coding units in the filtered image frame determined based on the average code rate code control strategy, and then encoding the filtered image frame according to the target quantization parameter of each coding unit, the non-region of interest with less subjective quality impact on human eyes is filtered, and the adjustment value of the initial quantization parameter of the region of interest, the transition region and the non-region of interest is increased in turn, so that the video coding quality is ensured, the blurring and blocking effect caused by the too low allocated code rate in the non-region of interest is reduced, the technical problem that the average code rate code control strategy easily leads to the decline of video coding quality and poor video coding quality in the case of limited bandwidth is effectively solved, and the video coding quality is improved. At the same time, by comparing the first pixel value of each image block with the skin color experience range, the to-be-processed frame is divided into the region of interest or the non-region of interest, and the image block adjacent to the region of interest in the non-region of interest is divided into the transition region, so that the to-be-processed frame is accurately divided into the region of interest, the non-region of interest and the transition region, the subsequent filtering processing of the non-region of interest is more accurate, and the video coding quality is improved. By accurately determining the smooth block according to the smooth threshold range corresponding to the pixel change value of each image block in the non-region of interest, and determining the filtering strength information corresponding to each smooth block according to the smooth threshold range, the determination efficiency of the filtering strength information is improved, the filtering processing of the non-smooth block is reduced, and the video coding quality is ensured.

[0104] Figure 6 is a structural schematic diagram of a video coding processing device provided by the embodiment of the present application. Referring to Figure 6 The video coding processing device includes a region determination module 61, an image filtering module 62, a parameter adjustment module 63 and an image encoding module 64.

[0105] The region determination module 61 is configured to determine a region of interest, a region of non-interest and a transition region in the frame to be processed, and the transition region is located between the region of interest and the region of non-interest. The image filtering module 62 is configured to determine a smooth block in the region of non-interest and filtering intensity information corresponding to each smooth block, and perform filtering processing on the smooth block in the frame to be processed according to the filtering intensity information to obtain a filtered image frame. The parameter adjustment module 63 is configured to determine initial quantization parameters of a plurality of coding units in the filtered image frame based on a set average code rate code control strategy, and adjust the initial quantization parameters corresponding to the region of interest, the region of non-interest and the transition region to obtain a target quantization parameter of each coding unit, wherein the adjustment values of the initial quantization parameters of the region of interest, the transition region and the region of non-interest are sequentially increased. The image coding module 64 is configured to perform coding processing on the filtered image frame according to the target quantization parameter of each coding unit.

[0106] By dividing the frame to be processed into the region of interest, the region of non-interest and the transition region, determining the filtering intensity information corresponding to the smooth block in the region of non-interest, performing filtering processing on the smooth block in the frame to be processed according to the filtering intensity information to obtain the filtered image frame, adjusting the initial quantization parameters of the plurality of coding units in the filtered image frame based on the average code rate code control strategy, and performing coding processing on the filtered image frame according to the target quantization parameter of each coding unit, the region of non-interest which has less influence on the subjective quality of the human eye is filtered, and the adjustment values of the initial quantization parameters of the region of interest, the transition region and the region of non-interest are sequentially increased, so that the video coding quality is ensured, the blurring and blocking effect caused by the too low allocated code rate in the region of non-interest is reduced, the technical problem that the average code rate code control strategy easily leads to the decline of the video coding quality in the case of limited bandwidth is effectively solved, and the video coding quality is improved.

[0107] In one possible embodiment, the region determination module 61 is specifically configured to:

[0108] determine first pixel values of each image block in the frame to be processed;

[0109] divide each image block into the region of interest or the region of non-interest based on the first pixel values and a set skin color experience range;

[0110] divide the image block adjacent to the region of interest in the region of non-interest into the transition region.

[0111] In a possible embodiment, the video coding processing apparatus further comprises a region modification module configured to: convert an image block in the region of interest to the non-region of interest if the image block is independent of the region of interest; and / or convert an image block in the non-region of interest to the region of interest if the image block is adjacent to the region of interest and the number of adjacent image blocks reaches a preset number.

[0112] In a possible embodiment, the parameter adjustment module 63 is configured to:

[0113] determine a pixel variation value of each image block in the non-region of interest;

[0114] determine a smoothing block in the non-region of interest according to a smoothing threshold range corresponding to the pixel variation value, and determine filter strength information corresponding to each smoothing block, wherein different smoothing threshold ranges correspond to different filter strength information.

[0115] In a possible embodiment, the parameter adjustment module 63 is configured to:

[0116] determine a first average pixel value of each image block in the non-region of interest in a first pixel range and a second average pixel value in a second pixel range;

[0117] determine a pixel variation value of each image block in the non-region of interest according to the first average pixel value and the second average pixel value.

[0118] In a possible embodiment, the parameter adjustment module 63 is configured to:

[0119] determine the image block as a first smoothing block and determine the filter strength information corresponding to the first smoothing block as first filter strength information if the pixel variation value of the image block in the non-region of interest is in a first smoothing threshold range;

[0120] determine the image block as a second smoothing block and determine the filter strength information corresponding to the second smoothing block as second filter strength information if the pixel variation value of the image block in the non-region of interest is in a second smoothing threshold range, the second smoothing threshold range being higher than the first smoothing threshold range, and the first filter strength information being greater than the second filter strength information;

[0121] In a case that the pixel variation value of the image block in the non-interest region is out of the second smooth threshold range, the image block is determined as a non-smooth block, and the filter strength information corresponding to the non-smooth block is determined as third filter strength information, the second smooth threshold range is higher than the first smooth threshold range, and the second filter strength information is greater than the third filter strength information.

[0122] In a possible embodiment, the parameter adjustment module 63 is further configured to:

[0123] In a case that the pixel variation value of the image block in the non-interest region is in the first smooth threshold range, and the image block is adjacent to the transition region, the image block is determined as a second smooth block, and the filter strength information corresponding to the second smooth block is determined as second filter strength information.

[0124] In a case that the pixel variation value of the image block in the non-interest region is in the second smooth threshold range, and the image block is adjacent to the transition region, the image block is determined as a non-smooth block, and the filter strength information corresponding to the non-smooth block is determined as third filter strength information.

[0125] In a possible embodiment, the video coding processing apparatus further comprises a first transition module configured to perform filter strength transition processing on the filter strength information corresponding to the smooth block adjacent to the non-filtered block.

[0126] In a possible embodiment, the video coding processing apparatus further comprises a second transition module configured to perform filter strength transition processing on the filter strength information corresponding to the blocks adjacent to each other and having different filter strength information.

[0127] In a possible embodiment, the first adjustment value for adjusting the initial quantization parameter corresponding to the interest region is less than or equal to 0, the second adjustment value for adjusting the initial quantization parameter corresponding to the non-interest region is greater than or equal to 0, and the third adjustment value for adjusting the initial quantization parameter corresponding to the transition region is between the first adjustment value and the second adjustment value.

[0128] It is worth noting that, in the embodiments of the video coding processing apparatus described above, each unit and module included is only divided according to functional logic, but is not limited to the above division, as long as the corresponding functions can be implemented; in addition, the specific names of each functional unit are only for easy mutual differentiation, and do not limit the protection scope of the embodiments of the present application.

[0129] The embodiments of the present application also provide a video coding processing device, which can integrate the video coding processing apparatus provided by the embodiments of the present application. Figure 7 is a structural schematic diagram of a video coding processing device provided by the embodiments of the present application. Referring to Figure 7The video coding processing device includes: an input device 73, an output device 74, a memory 72, and one or more processors 71; the memory 72 is configured to store one or more programs; when the one or more programs are executed by the one or more processors 71, the one or more processors 71 implement the video coding processing method provided by the above embodiments. The video coding processing device, device and computer provided by the above embodiments can be used to execute the video coding processing method provided by any of the above embodiments, and have the corresponding functions and advantages.

[0130] The embodiments of the present application further provide a non-volatile storage medium storing computer executable instructions, which, when executed by a computer processor, are used to perform the video coding processing method provided by the above embodiments. Of course, the non-volatile storage medium storing computer executable instructions provided by the embodiments of the present application is not limited to the video coding processing method provided above, but can also perform the related operations in the video coding processing method provided by any of the embodiments of the present application. The video coding processing device, device and storage medium provided in the above embodiments can execute the video coding processing method provided by any of the embodiments of the present application, and the technical details not described in detail in the above embodiments can be referred to the video coding processing method provided by any of the embodiments of the present application.

[0131] On the basis of the above embodiments, the embodiments of the present application further provide a computer program product, the technical solutions of the present application essentially or the part of the prior art that makes a contribution or the whole or part of the technical solutions can be embodied in the form of a software product, and the computer program product is stored in a storage medium and includes a plurality of instructions for causing a computer device, a mobile terminal or a processor therein to execute all or part of the steps of the video coding processing method provided by the embodiments of the present application.

Claims

1. A video encoding processing method, characterized in that, include: Identify the region of interest, region of non-interest, and transition region in the frame to be processed, wherein the transition region is located between the region of interest and the region of non-interest; Determine the pixel change value of each image block in the region of non-interest; Based on the smoothing threshold range corresponding to the pixel change value, a smoothing block is determined in multiple image blocks in the non-interest region, and the filtering intensity information corresponding to each smoothing block is determined. The smoothing blocks in the frame to be processed are then filtered based on the filtering intensity information to obtain a filtered image frame. Different smoothing threshold ranges correspond to different filtering intensity information. Based on the set average bit rate control strategy, the initial quantization parameters of multiple coding units in the filtered image frame are determined, and the initial quantization parameters corresponding to the region of interest, the region of non-interest, and the transition region are adjusted to obtain the target quantization parameters of each coding unit. The adjustment values ​​of the initial quantization parameters of the region of interest, the transition region, and the region of non-interest increase sequentially. The filtered image frame is encoded according to the target quantization parameter of each encoding unit.

2. The video encoding processing method according to claim 1, characterized in that, The process of determining the region of interest, non-region of interest, and transition region in the frame to be processed includes: Determine the first pixel value of each image block in the frame to be processed; Based on the first pixel value and the set skin color experience range, each of the image blocks is divided into a region of interest or a region of non-interest. The image blocks adjacent to the region of interest in the non-region of interest are divided into transition regions.

3. The video encoding processing method according to claim 2, characterized in that, After dividing each image block into a region of interest or a region of non-interest based on the first pixel value and a set skin tone experience range, the method further includes at least one of the following: The image blocks that exist independently within the region of interest are converted to the region of non-interest, wherein the number of image blocks surrounding the independently existing image block that belong to the region of interest is less than or equal to a predetermined first number; The image blocks in the non-interest region that are adjacent to the region of interest a set number are converted into the region of interest.

4. The video encoding processing method according to claim 1, characterized in that, Determining the pixel change value of each image block in the non-interest region includes: Determine the first average pixel value and the second average pixel value of each image block in the non-interest region within a first pixel range; The pixel change value of each image block in the region of non-interest is determined based on the first average pixel value and the second average pixel value.

5. The video encoding processing method according to claim 1, characterized in that, The step of determining smoothing blocks in multiple image blocks within the non-interest region based on the smoothing threshold range corresponding to the pixel change value, and determining the filter intensity information corresponding to each smoothing block, includes: If the pixel change value of the image block in the non-interest region is within the range of a first smoothing threshold, the image block is determined to be a first smoothing block, and the filter intensity information corresponding to the first smoothing block is determined to be the first filter intensity information. If the pixel change value of the image block in the non-interest region is within the range of the second smoothing threshold, the image block is determined to be the second smoothing block, and the filter intensity information corresponding to the second smoothing block is determined to be the second filter intensity information. The second smoothing threshold range is higher than the first smoothing threshold range, and the first filter intensity information is greater than the second filter intensity information. If the pixel change value of the image block in the non-interest region is outside the range of the second smoothing threshold, the image block is determined to be a non-smooth block, and the filter intensity information corresponding to the non-smooth block is determined to be the third filter intensity information, wherein the second filter intensity information is greater than the third filter intensity information.

6. The video encoding processing method according to claim 1, characterized in that, The step of determining smoothing blocks in multiple image blocks within the non-interest region based on the smoothing threshold range corresponding to the pixel change value, and determining the filter intensity information corresponding to each smoothing block, further includes: If the pixel change value of the image block in the non-interest region is within the first smoothing threshold range, and the image block is adjacent to the transition region, the image block is determined to be a second smoothing block, and the filter intensity information corresponding to the second smoothing block is determined to be the second filter intensity information. If the pixel change value of the image block in the non-interest region is within the range of the second smoothing threshold, and the image block is adjacent to the transition region, the image block is determined to be a non-smooth block, and the filter intensity information corresponding to the non-smooth block is determined to be the third filter intensity information, wherein the range of the second smoothing threshold is higher than the range of the first smoothing threshold, and the second filter intensity information is greater than the third filter intensity information.

7. The video encoding processing method according to claim 1, characterized in that, After determining the filter intensity information corresponding to each of the smoothing blocks, the method further includes: The filter intensity information corresponding to the smooth block adjacent to the non-filtered block is subjected to filter intensity transition processing.

8. The video encoding processing method according to claim 1, characterized in that, After determining the filter intensity information corresponding to each of the smoothing blocks, the method further includes: For adjacent blocks with different filter intensity information, a filter intensity transition process is performed.

9. The video encoding processing method according to any one of claims 1-8, characterized in that, The first adjustment value for adjusting the initial quantization parameter corresponding to the region of interest is less than or equal to 0, the second adjustment value for adjusting the initial quantization parameter corresponding to the region of non-interest is greater than or equal to 0, and the third adjustment value for adjusting the initial quantization parameter corresponding to the transition region is located between the first adjustment value and the second adjustment value.

10. A video encoding processing apparatus, characterized in that, It includes a region determination module, an image filtering module, a parameter adjustment module, and an image encoding module, among which: The region determination module is configured to determine the region of interest, the region of non-interest, and the transition region in the frame to be processed, wherein the transition region is located between the region of interest and the region of non-interest. The image filtering module is configured to determine the pixel change value of each image block in the region of non-interest; determine smoothing blocks in multiple image blocks in the region of non-interest according to the smoothing threshold range corresponding to the pixel change value; determine the filtering intensity information corresponding to each smoothing block; and perform filtering processing on the smoothing blocks in the frame to be processed according to the filtering intensity information to obtain a filtered image frame, wherein different smoothing threshold ranges correspond to different filtering intensity information. The parameter adjustment module is configured to determine the initial quantization parameters of multiple coding units in the filtered image frame based on a set average bit rate control strategy, and adjust the initial quantization parameters corresponding to the region of interest, the region of non-interest, and the transition region to obtain the target quantization parameters of each coding unit, wherein the adjustment values ​​of the initial quantization parameters of the region of interest, the transition region, and the region of non-interest increase sequentially. The image encoding module is configured to encode the filtered image frame according to the target quantization parameter of each encoding unit.

11. A video encoding processing device, characterized in that, include: Memory and one or more processors; The memory is used to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the video encoding processing method as described in any one of claims 1-9.

12. A non-volatile storage medium for storing computer-executable instructions, characterized in that, The computer-executable instructions, when executed by a computer processor, are used to perform the video encoding processing method as described in any one of claims 1-9.

13. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the video encoding processing method according to any one of claims 1-9.

Images