Deblocking filtering coding and decoding method, device and equipment based on coding block and medium

Abstract

The embodiment of the invention provides a deblocking filtering coding method and device based on a coding block, a decoding method and device, electronic equipment, a storage medium and a computer program product, and relates to the technical field of image processing. The method comprises the following steps: performing deblocking filtering analysis on a coding block, and determining a block-level filtering strategy; based on the filtering strategy, carrying out deblocking filtering processing on the coding block, or skipping to block filtering processing, and reserving the coding block; and setting identification information corresponding to the filtering identification of the coding block based on the filtering strategy. According to the method, deblocking filtering analysis is carried out on coding blocks, and differentiated filtering strategies are adopted for different coding blocks, so that whether deblocking filtering processing is carried out on the coding blocks or not is determined. In this way, more flexible block-level switch control can be added to deblocking filtering processing. Meanwhile, filtering identification is carried out on the filtering strategy adopted by the coding block, so that the decoding end can carry out corresponding processing, the calculation complexity of the decoding end is reduced, and the decoding speed is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of image processing technology, and in particular to a deblocking filtering encoding method, decoding method, device, electronic device, storage medium and computer program product based on coding blocks. Background Art

[0002] Most current video coding standards use a block-based hybrid coding framework, which divides the video into several coding blocks of different sizes according to the characteristics of the video content, and encodes the blocks in units. Due to the differences in encoding methods and quantization parameters between coding blocks, the encoded image will have visible block effects, which seriously affects the subjective quality of the compressed video. Therefore, in the loop filtering stage, many coding standards have introduced deblocking filtering (DBF) to remove the block effects.

[0003] In the deblocking filtering process, complex decision-making and filtering operations need to be performed on all the boundaries of each frame of the video, which has a high algorithm complexity. Especially on the decoding end, it has a high proportion of computational complexity. This will cause a waste of computing power and time. Summary of the invention

[0004] The embodiments of the present disclosure provide a coding block-based deblocking filtering encoding method, decoding method, device, electronic device, storage medium and computer program product.

[0005] According to a first aspect of an embodiment of the present disclosure, a deblocking filtering encoding method based on a coding block is provided, comprising: obtaining a coding block; the coding block is generated by encoding a corresponding original block; performing a deblocking filtering analysis on the coding block to determine a filtering strategy for the coding block; in response to the filtering strategy being that filtering processing is required, performing a deblocking filtering process on the coding block, and setting a filtering identifier corresponding to the coding block to first identification information; in response to the filtering strategy being that filtering processing is not required, retaining the coding block, and setting the filtering identifier corresponding to the coding block to second identification information.

[0006] In some exemplary embodiments of the present disclosure, the coding block is a coding unit (Coding Unit, CU) or a coding tree unit (Coding Tree Unit, CTU).

[0007] In some exemplary embodiments of the present disclosure, the filter identifier is a luminance filter identifier and / or a chrominance filter identifier.

[0008] In some exemplary embodiments of the present disclosure, performing deblocking filtering analysis on the coding block to determine the filtering strategy of the coding block includes: acquiring characteristic parameters of the coding block; determining a parameter threshold of the coding block; and determining the filtering strategy of the coding block based on the characteristic parameters and the parameter threshold.

[0009] In some exemplary embodiments of the present disclosure, the characteristic parameter includes at least one of a pixel gradient value, an intra-frame and inter-frame prediction ratio, a coding mode and a quantization parameter.

[0010] In some exemplary embodiments of the present disclosure, the determining the parameter threshold of the coding block includes: acquiring a quantization parameter of the coding block; and determining the parameter threshold according to the quantization parameter.

[0011] In some exemplary embodiments of the present disclosure, the performing deblocking filtering analysis on the coding block to determine the filtering strategy of the coding block includes: performing deblocking filtering on the coding block to obtain a filtering block; performing distortion calculation on the coding block and the filtering block relative to the original block to obtain a first distortion value and a second distortion value; and determining the filtering strategy of the coding block based on the first distortion value and the second distortion value.

[0012] In some exemplary embodiments of the present disclosure, determining the filtering strategy of the coding block according to the first distortion value and the second distortion value includes: obtaining a rate loss value corresponding to the filtering identifier; obtaining a first rate distortion value according to the first distortion value; obtaining a second rate distortion value according to the second distortion value and the rate loss value; and determining the filtering strategy of the coding block according to the first rate distortion value and the second rate distortion value.

[0013] In some exemplary embodiments of the present disclosure, determining the filtering strategy of the coding block according to the first rate-distortion value and the second rate-distortion value includes: calculating a strategy threshold according to the second rate-distortion value and an adjustment coefficient; in response to the first rate-distortion value being less than the strategy threshold, determining that the filtering strategy does not require filtering processing; in response to the first rate-distortion value being greater than the strategy threshold, determining that the filtering strategy requires filtering processing.

[0014] In some exemplary embodiments of the present disclosure, a quantization parameter of the coding block is acquired; and the adjustment coefficient is determined according to the quantization parameter.

[0015] According to a second aspect of an embodiment of the present disclosure, a deblocking filtering decoding method based on a coding block is provided, comprising: decoding a coding block to obtain a decoding block; acquiring a filtering identifier corresponding to the decoding block; in response to the filtering identifier being first identification information, performing deblocking filtering on the decoding block; in response to the filtering identifier being second identification information, retaining the decoding block.

[0016] According to a third aspect of an embodiment of the present disclosure, a deblocking filtering encoding device based on a coding block is provided, comprising: a coding module, configured to obtain a coding block; the coding block is generated by encoding a corresponding original block; a filtering analysis module, configured to perform a deblocking filtering analysis on the coding block to determine a filtering strategy for the coding block; a first filtering processing module, configured to, in response to the filtering strategy being that filtering processing is required, perform a deblocking filtering process on the coding block, and set a filtering identifier corresponding to the coding block to first identification information; in response to the filtering strategy being that filtering processing is not required, retain the coding block, and set the filtering identifier corresponding to the coding block to second identification information.

[0017] According to a fourth aspect of an embodiment of the present disclosure, a deblocking filtering decoding device based on a coding block is provided, comprising: a decoding module, configured to perform decoding processing on the coding block to obtain a decoding block; an identification acquisition module, configured to obtain a filtering identification corresponding to the decoding block; a second filtering processing module, configured to perform deblocking filtering processing on the decoding block in response to the filtering identification being first identification information; and retain the decoding block in response to the filtering identification being second identification information.

[0018] According to the fifth aspect of an embodiment of the present disclosure, an electronic device is provided, characterized in that it includes: a processor; a memory for storing executable instructions of the processor; wherein the processor is configured to execute the executable instructions to implement any one of the coding block-based deblocking filtering encoding methods or coding block-based deblocking filtering decoding methods.

[0019] According to the sixth aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided. When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute any one of the coding block-based deblocking filtering encoding methods or coding block-based deblocking filtering decoding methods.

[0020] According to the seventh aspect of the embodiments of the present disclosure, a computer program product is provided, comprising a computer program / instruction, characterized in that when the computer program / instruction is executed by a processor, it implements any one of the coding block-based deblocking filtering encoding methods or coding block-based deblocking filtering decoding methods.

[0021] The deblocking filter coding method based on the coding block provided by the embodiment of the present disclosure performs deblocking filter analysis on the coding block to determine the block-level filtering strategy; based on the filtering strategy, performs deblocking filter processing on the coding block, or skips deblocking filter processing and retains the coding block; and sets identification information of the filter identification corresponding to the coding block based on the filtering strategy. This method adopts differentiated filtering strategies for different coding blocks by performing deblocking filter analysis on the coding block to determine whether the coding block is subjected to deblocking filter processing. In this way, more flexible block-level switch control can be added to the deblocking filter processing. At the same time, the filtering strategy adopted by the coding block is filtered and identified so that the decoding end can perform corresponding processing, thereby reducing the computational complexity of the decoding end and improving the decoding speed.

[0022] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification are used to explain the principles of the present disclosure. Obviously, the accompanying drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without creative work.

[0024] Figure 1 A schematic diagram showing an exemplary system architecture to which the method according to an embodiment of the present disclosure can be applied is shown.

[0025] Figure 2 The present invention is a flowchart showing a deblocking filtering encoding method based on a coding block according to an exemplary embodiment.

[0026] Figure 3 The figure is a flowchart of a deblocking filtering analysis method before filtering according to an exemplary embodiment.

[0027] Figure 4 The figure is a flowchart of a method for analyzing a deblocking filter after filtering according to an exemplary embodiment.

[0028] Figure 5 The figure is a flow chart of a method for determining a filtering strategy based on a distortion value according to an exemplary embodiment.

[0029] Figure 6 The invention is a flowchart showing a coding process of deblocking filtering based on coding blocks according to an exemplary embodiment.

[0030] Figure 7 The present invention is a flowchart showing a deblocking filtering decoding method based on a coding block according to an exemplary embodiment.

[0031] Figure 8 The invention is a block diagram showing a deblocking filtering encoding device based on a coding block according to an exemplary embodiment.

[0032] Fig. 9 The invention is a block diagram showing a deblocking filtering decoding device based on a coding block according to an exemplary embodiment.

[0033] Fig.10 It is a schematic diagram showing the structure of an electronic device suitable for implementing the exemplary embodiments of the present disclosure according to an exemplary embodiment. DETAILED DESCRIPTION

[0034] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in many forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be comprehensive and complete and will fully convey the concepts of the example embodiments to those skilled in the art. The same reference numerals in the figures represent the same or similar parts, and thus their repeated description will be omitted.

[0035] The features, structures or characteristics described in the present disclosure may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced while omitting one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted. In other cases, known methods, devices, implementations or operations are not shown or described in detail to avoid blurring the various aspects of the present disclosure.

[0036] The accompanying drawings are only schematic diagrams of the present disclosure, and the same reference numerals in the drawings represent the same or similar parts, so their repeated description will be omitted. Some block diagrams shown in the accompanying drawings do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in at least one hardware module or integrated circuit, or implemented in different networks and / or processor devices and / or microcontroller devices.

[0037] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and steps, nor must they be executed in the order described. For example, some steps can be decomposed, and some steps can be combined or partially combined, so the actual execution order may change according to actual conditions.

[0038] In this specification, the terms "a", "an", "the", "said" and "at least one" are used to indicate the presence of at least one element / component / etc.; the terms "comprising", "including" and "having" are used to express an open-ended inclusion and mean that additional elements / components / etc. may exist in addition to the listed elements / components / etc.; the terms "first", "second" and "third" etc. are used only as labels and are not intended to limit the quantity of their objects.

[0039] Figure 1 A schematic diagram showing an exemplary system architecture to which the method according to an embodiment of the present disclosure can be applied is shown.

[0040] like Figure 1 As shown, the system architecture may include a server 101, a network 102, a terminal device 103, a terminal device 104, and a terminal device 105. The network 102 is used to provide a medium for a communication link between the terminal device 103, the terminal device 104, or the terminal device 105 and the server 101. The network 102 may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc.

[0041] The server 101 may be a server that provides various services, such as a background management server that provides support for devices operated by users using the terminal device 103, the terminal device 104, or the terminal device 105. The background management server may analyze and process the received request and other data, and feed back the processing results to the terminal device 103, the terminal device 104, or the terminal device 105.

[0042] Terminal device 103, terminal device 104 and terminal device 105 can be a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a wearable smart device, a virtual reality device, an augmented reality device, etc., but are not limited thereto.

[0043] It should be understood that Figure 1 The number of terminal devices 103, terminal devices 104, terminal devices 105, networks 102 and servers 101 are merely illustrative. Server 101 may be a physical server, a server cluster consisting of multiple servers, or a cloud server. Depending on actual needs, any number of terminal devices, networks and servers may be provided.

[0044] Below, each step of the method in the exemplary embodiment of the present disclosure will be described in more detail with reference to the accompanying drawings and embodiments.

[0045] Figure 2 The present invention is a flowchart showing a deblocking filtering encoding method based on a coding block according to an exemplary embodiment. Figure 2The method provided in the embodiment is applied to the client and can be executed by any electronic device, such as the above Figure 1 The terminal device in Figure 1 Servers in, or Figure 1 The terminal device and the server in the embodiment are jointly executed, but the present disclosure is not limited to this.

[0046] In step S210, a coding block is obtained; the coding block is generated by encoding the corresponding original block.

[0047] In the related technology, the deblocking filtering process mainly includes two parts: filtering decision and filtering operation. First, the filtering decision will traverse all block boundaries of each frame image, and determine whether the pixels of the boundary need to be filtered according to the video content and coding information of the coding blocks on both sides of the boundary. Then, the filtering operation will perform different degrees of filtering operations on the pixels of the block boundaries that need to be filtered according to the results of the filtering decision. In this process, complex decisions and filtering operations need to be performed on all boundaries of each frame image in the video, which has a high algorithmic complexity. Especially on the decoding end, it has a high proportion of computational complexity. This will cause a waste of computing power and time.

[0048] In the disclosed embodiment, the current coding block in the video frame to be processed is obtained. The coding block is generated by the encoder encoding the original block based on the coding standard. Since the video encoding process is based on each block, the boundary between each block may be affected by block effects due to the different encoding methods and quantization parameters between different blocks. Therefore, the filtering decision process is also based on the coding block.

[0049] In an exemplary embodiment, the coding block may be a coding unit (CU) or a coding tree unit (CTU). The CU is a basic image block used for independent prediction, transformation and quantization processing in video coding. The size of the CU is usually 2N×2N. The CTU is a larger image block defined in video coding. A CTU can be divided into multiple CUs.

[0050] In step S220, a deblocking filtering analysis is performed on the coding block to determine a filtering strategy for the coding block.

[0051] In the related art, in the deblocking filtering process, the filtered pixel values ​​are usually directly used to reconstruct the block, and there is no evaluation mechanism to verify whether the filtering result is better than the state before filtering.

[0052] In order to avoid this situation, a block-level deblocking filter decision algorithm is designed in the embodiment of the present disclosure. By performing deblocking filter analysis on the coding block, filtering evaluation is performed on the coding block to determine whether the coding block needs to be processed by deblocking filter, and to determine the filtering strategy of the coding block. The filtering strategy can be to require filtering or not to require filtering.

[0053] It should be pointed out that whether the coding block needs to be filtered can be considered from a variety of different dimensions. For example, the image quality of the coding block before and after filtering, the image quality benefit after filtering and the computing power overhead of filtering processing, the computing power overhead of the coding block at the decoding end after filtering, the delay overhead caused by block filtering processing, etc. Different deblocking filtering analysis algorithms and corresponding filtering strategies can be formulated according to the needs of different video encoding and decoding scenarios. The present disclosure does not limit the specific algorithms and filtering strategies adopted.

[0054] In step S230, in response to the filtering strategy requiring filtering, deblocking filtering is performed on the coding block, and a filtering identifier corresponding to the coding block is set to first identifier information.

[0055] In the embodiment of the present disclosure, in response to the filtering strategy requiring filtering, the coding block is subjected to deblocking filtering to generate a filtered coding block. The coding block is reconstructed based on the filtered coding block. It should be noted that there are many deblocking filtering algorithms, and the present disclosure does not limit the specific algorithm used.

[0056] In the embodiment of the present disclosure, in response to the filtering strategy requiring filtering, the filtering flag corresponding to the coding block is also set to the first identification information. For example, the filtering flag is set to "1". The filtering flag is used to identify whether the corresponding coding block is subjected to deblocking filtering. The filtering flag corresponds to the coding block one by one. The decoding end can identify whether each coding block is subjected to deblocking filtering at the encoding end through the filtering flag.

[0057] In an exemplary embodiment, the block effect between coding blocks can be divided into brightness block effect and chroma block effect. And it can be determined whether to perform deblocking filtering based on brightness and chroma components, and different degrees of filtering can be performed respectively. Therefore, the filter identifier can be divided into a brightness filter identifier db_ctu_flag[ctuRsAddr][0] and a chroma filter identifier db_ctu_flag[ctuRsAddr][1]. The brightness filter identifier and the chroma filter identifier independently identify the brightness filter strategy and the chroma filter strategy of the coding block. In practical applications, the brightness filter identifier and / or the chroma filter identifier can be selected as needed.

[0058] In an exemplary embodiment, the block effect between coding blocks can be evaluated based on the block effect of the directional dimension in addition to considering the brightness and chrominance components. Therefore, the filter identifier can be divided into a vertical filter identifier and a horizontal filter identifier. The vertical filter identifier and the horizontal filter identifier independently identify the vertical filtering strategy and the horizontal filtering strategy of the coding block. In practical applications, the vertical filter identifier and / or the horizontal filter identifier can be selected as needed.

[0059] In step S240, in response to the filtering strategy not requiring filtering processing, the coding block is retained, and the filtering identifier corresponding to the coding block is set to the second identifier information.

[0060] In the disclosed embodiment, in response to the filtering strategy indicating that filtering processing is not required, the deblocking filtering process of the coding block is skipped, and the coding block is directly retained.

[0061] In the embodiment of the present disclosure, in response to the filtering strategy not requiring filtering, the filtering identifier corresponding to the coding block is also set to the second identification information. For example, the filtering identifier is set to "0". The filtering identifier is used to identify whether the corresponding coding block is subjected to deblocking filtering. The filtering identifier corresponds to the coding block one by one. The decoding end can identify whether each coding block is subjected to deblocking filtering at the encoding end through the filtering identifier.

[0062] The deblocking filter coding method based on the coding block provided by the embodiment of the present disclosure performs deblocking filter analysis on the coding block to determine the block-level filtering strategy; based on the filtering strategy, performs deblocking filter processing on the coding block, or skips deblocking filter processing and retains the coding block; and sets identification information of the filter identification corresponding to the coding block based on the filtering strategy. This method adopts differentiated filtering strategies for different coding blocks by performing deblocking filter analysis on the coding block to determine whether the coding block is subjected to deblocking filter processing. In this way, more flexible block-level switch control can be added to the deblocking filter processing. At the same time, the filtering strategy adopted by the coding block is filtered and identified so that the decoding end can perform corresponding processing, thereby reducing the computational complexity of the decoding end and improving the decoding speed.

[0063] Figure 3 is a flowchart of a deblocking filter analysis method before filtering according to an exemplary embodiment. Figure 2 Based on the deblocking filtering encoding method shown, the aforementioned step S220 may include the following steps.

[0064] In step S310, characteristic parameters of the coding block are obtained.

[0065] In the disclosed embodiment, deblocking filtering analysis is performed on the coding block before the deblocking filtering is performed on the coding block to determine the filtering strategy. Corresponding feature parameters are extracted and collected from the coding block to perform deblocking filtering analysis based on the relevant feature parameters.

[0066] In an exemplary embodiment, the coding block has many characteristic parameters for deblocking filtering analysis, which may include at least one of pixel gradient value, intra-frame and inter-frame prediction ratio, coding mode and quantization parameter.

[0067] Pixel gradient value is an indicator that measures the rate of change of brightness or chromaticity value of each pixel in an image. It can usually be extracted through the Sobel filter algorithm.

[0068] Intra-Inter Prediction Ratio refers to the ratio of the number of blocks using intra-prediction to the number of blocks using inter-prediction in the video frame. It is usually measured in CU.

[0069] Coding Mode refers to the prediction coding mode selected for the coding block.

[0070] Quantization Parameter (QP) is an integer value used to control the quantization strength in the video encoding process, which directly affects the bit rate and image quality after encoding.

[0071] It should be noted that there are many other characteristic parameters that can be used to evaluate the coding block filtering strategy. In practical applications, one or more of the above characteristic parameters can be selected according to the scene requirements.

[0072] In step S320, a parameter threshold of the coding block is determined.

[0073] In the embodiment of the present disclosure, a parameter threshold corresponding to each characteristic parameter is determined according to the characteristic parameters acquired in S310.

[0074] In an exemplary embodiment, the parameter threshold may be a preset fixed value. According to the characteristic parameter type acquired in S310, a corresponding preset parameter threshold is determined.

[0075] In an exemplary embodiment, the parameter threshold may be a calculation function related to the aforementioned characteristic parameter. According to the calculation function, the aforementioned acquired characteristic parameter is substituted into the calculation to obtain the corresponding parameter threshold.

[0076] Since the quantization parameter is highly correlated with the degree of video coding distortion, a calculation function of the parameter threshold can be constructed based on the quantization parameter. The calculation function is a calculation function corresponding to the above-mentioned characteristic parameters based on the linear change of the quantization parameter. The quantization parameter of the coding block is obtained through step S310. The quantization parameter is substituted into the pre-constructed calculation function of the parameter threshold to determine the parameter threshold corresponding to each characteristic parameter.

[0077] In addition, a matching table based on the quantization parameter and the parameter thresholds corresponding to each characteristic parameter can also be pre-constructed. The matching table stores the parameter thresholds corresponding to each characteristic parameter under different quantization parameters. The quantization parameter of the coding block is obtained through step S310. The parameter threshold is determined according to the quantization parameter and the matching table.

[0078] In an exemplary embodiment, the calculation function of the parameter threshold can be constructed by a pre-trained AI model. The distribution of the collected features and the actual change in subjective quality after filtering are statistically analyzed. Based on the pre-constructed AI model, the correlation between the two situations is calculated, and then a set of parameter thresholds corresponding to different quantization parameters are trained for each feature parameter. Based on the results of the AI ​​model training output, the above matching table is generated or the calculation function of the parameter threshold is constructed.

[0079] It should be noted that based on the brightness change and chrominance change of the coding block, different parameter thresholds can also be generated based on quantization parameter training, which will not be described in detail here.

[0080] In step S330, a filtering strategy for the coding block is determined according to the characteristic parameter and the parameter threshold.

[0081] In the disclosed embodiment, the filtering strategy of the coding block is determined by comparing the characteristic parameters obtained in the aforementioned step S310 with the corresponding parameter threshold determined in step S320, that is, whether to skip the deblocking filtering process. It should be noted that the corresponding filtering strategies can be determined based on the brightness change and chrominance change of the coding block, which will not be repeated here.

[0082] The deblocking filter coding method based on the coding block provided by the embodiment of the present disclosure performs deblocking filter analysis on the coding block before the deblocking filter processing is performed on the coding block, and extracts and collects corresponding feature parameters from the coding block to determine the filtering strategy based on the relevant feature parameters. By determining the filtering strategy of the coding block before the filtering processing, the computing power overhead of the coding end for the deblocking filter processing of the coding block can be saved. At the same time, the deblocking filter analysis is performed through rich feature parameters, which can meet the needs of various application scenarios.

[0083] Figure 4is a flowchart of a method for analyzing a deblocking filter after filtering according to an exemplary embodiment. Figure 2 Based on the deblocking filtering encoding method shown, the aforementioned step S220 may include the following steps.

[0084] In step S410, a deblocking filter is performed on the coding block to obtain a filter block.

[0085] In the disclosed embodiment, after the coding block is subjected to deblocking filtering processing, a deblocking filtering analysis is performed on the coding block to determine a filtering strategy.

[0086] In the disclosed embodiment, the coding block is first subjected to deblocking filtering to obtain a corresponding filtering block, and the filtering strategy is determined by comparing and analyzing the distortion of the coding block and the filtering block with the original block.

[0087] In step S420, distortion calculation is performed on the coding block and the filtering block respectively relative to the original block to obtain a first distortion value and a second distortion value.

[0088] In the disclosed embodiment, a first distortion value and a second distortion value are obtained based on the distortion calculation of the coding block and the filtering block with the corresponding original block. The first distortion value represents the distortion value of the coding block relative to the original block. The second distortion value represents the distortion value of the filtering block relative to the original block.

[0089] It should be noted that there are many distortion calculation algorithms, such as SAD, SATD, PSNR, SSIM, etc. The present disclosure does not limit the specific distortion algorithm used.

[0090] In step S430, a filtering strategy for the coding block is determined according to the first distortion value and the second distortion value.

[0091] In the disclosed embodiment, the first distortion value and the second distortion value respectively represent the distortion loss of the coding block and the filtering block relative to the original block, that is, they characterize the image quality of the coding block before and after filtering. Based on this, it can be used to evaluate the coding effect and computing power overhead of the coding block before and after filtering, and then determine the filtering strategy of the coding block.

[0092] Figure 5 is a flow chart of a method for determining a filtering strategy based on a distortion value according to an exemplary embodiment. Figure 4 Based on the deblocking filtering encoding method shown, the aforementioned step S430 may include the following steps.

[0093] In step S510, a bit rate loss value corresponding to the filter identifier is obtained.

[0094] In the embodiments of the present disclosure, Figure 4 Based on the embodiment shown, in addition to evaluating the first distortion value D1 and the second distortion value D2 of the coding block and the filtering block relative to the original block, the code rate loss problem introduced by adding the filtering identifier is further considered. The corresponding code rate loss value R is obtained according to the filtering identifier.

[0095] In step S520, a first rate-distortion value is obtained according to the first distortion value.

[0096] In the disclosed embodiment, the corresponding rate-distortion value is calculated according to the rate-distortion value calculation formula: Rdcost = D + λR. The rate-distortion value is an indicator that measures the bit rate of the encoded data and the difference (distortion) between the original image and the reconstructed image in video encoding. Among them, D is the distortion value, R is the bit rate loss value, and λ is the Lagrangian factor. The Lagrangian factor is related to the quantization coefficient of the coding block.

[0097] In an exemplary embodiment, since the deblocking filtering process is skipped and the coding block is directly used, the filtering flag may not be added. Therefore, the corresponding code rate loss value R is 0. Therefore, the corresponding first rate distortion value Rdcost1=D1.

[0098] In an exemplary embodiment, even if the coding block is directly used, the filter identifier can be added. For example, the filter identifier is set as the second identifier information. Therefore, based on the filter identifier, the corresponding first code rate loss value R1 can be obtained. Based on this, the corresponding first rate distortion value Rdcost1=D1+λR1.

[0099] In step S530, a second rate-distortion value is obtained according to the second distortion value and the bit rate loss value.

[0100] In the disclosed embodiment, the corresponding rate-distortion value is calculated according to the rate-distortion value calculation formula: Rdcost=D+λR.

[0101] In an exemplary embodiment, the coding block is reconstructed based on the filter block, and the filter identifier is set to the first identifier information. Therefore, based on the filter identifier, the corresponding second rate loss value R2 can be obtained. Based on this, the corresponding second rate distortion value Rdcost2=D2+λR2.

[0102] In step S540, a filtering strategy for the coding block is determined according to the first rate-distortion value and the second rate-distortion value.

[0103] In the embodiments of the present disclosure, since the rate - distortion value is an index for measuring the bit - rate of the encoded data and the difference (distortion) between the original image and the reconstructed image. Based on the first rate - distortion value and the second rate - distortion value corresponding to the encoding block and the filtering block respectively, the filtering strategy for the encoding block is determined. That is, the encoding block is reconstructed based on the filtering block, or the filtering block is "discarded" and the encoding block is retained.

[0104] In an exemplary embodiment, the first rate - distortion value Rdcost1 and the second rate - distortion value Rdcost2 can be directly compared. If Rdcost1 < Rdcost2, it indicates that the rate - distortion value of the encoding block before filtering is better, then the filtering block is "discarded" and the encoding block is retained. If Rdcost1 ≥ Rdcost2, it indicates that the rate - distortion value of the filtering block after filtering is better, then the encoding block is reconstructed based on the filtering block.

[0105] In an exemplary embodiment, considering that "discarding" the filtering block and retaining the encoding block can save the computing power overhead of block reconstruction at the encoding end and can also save the computing power overhead of de - blocking filtering processing at the decoding end. Therefore, the condition for "discarding" the filtering block can be further relaxed to allow some cases where the first rate - distortion value Rdcost1 is larger. Based on this, an adjustment coefficient can be introduced between the first rate - distortion value and the second rate - distortion value to adjust the comparison relationship between the first rate - distortion value and the second rate - distortion value. The following steps can be included.

[0106] According to the second rate - distortion value and the adjustment coefficient, a strategy threshold is calculated.

[0107] In response to the first rate - distortion value being less than the strategy threshold, it is determined that the filtering strategy is that no filtering processing is required.

[0108] In response to the first rate - distortion value being greater than the strategy threshold, it is determined that the filtering strategy is that filtering processing is required.

[0109] In the embodiments of the present disclosure, the second rate - distortion value is adjusted by the adjustment coefficient, so as to calculate the strategy threshold. Furthermore, based on the comparison between the first rate - distortion value and the strategy threshold, the filtering strategy of the encoding block is determined.

[0110] For example, the adjustment coefficient is preset as k, and based on k×Rdcost2, the strategy threshold is calculated. If Rdcost1 < k×Rdcost2, then the filtering block is "discarded" and the encoding block is retained. If Rdcost1 ≥ k×Rdcost2, then the encoding block is reconstructed based on the filtering block.

[0111] In an exemplary embodiment, the adjustment coefficient k may be a preset fixed coefficient or a dynamic coefficient adjusted based on a quantization parameter QP. The adjustment coefficient k is determined by obtaining the quantization parameter QP of the coding block and according to the quantization parameter QP.

[0112] In an exemplary embodiment, the adjustment coefficient may be added to the second rate-distortion value to calculate the policy threshold. Similarly, the adjustment coefficient k may be a preset fixed coefficient or a dynamic coefficient adjusted based on the quantization parameter QP. Furthermore, the comparison process between the first rate-distortion value and the policy threshold is similar to that in the above embodiment and will not be repeated here.

[0113] The deblocking filter coding method based on the coding block provided by the embodiment of the present disclosure performs deblocking filter analysis on the coding block after the deblocking filter processing is performed on the coding block. By comparing the distortion values ​​between the coding block and the filter block relative to the original block, the distortion loss caused by the deblocking filter processing can be estimated, thereby deciding the filtering strategy of the coding block. In addition, by further considering the code rate loss problem introduced by adding the filter identifier, the filtering strategy of the coding block is decided based on the rate-distortion value, so that a more comprehensive filtering decision can be made to obtain a better filtering decision result.

[0114] Figure 6 The invention is a flowchart showing a coding process of deblocking filtering based on coding blocks according to an exemplary embodiment.

[0115] Figure 3 A method for performing deblocking filtering analysis on a coding block before the coding block is subjected to deblocking filtering processing is provided. Figure 4 , 5 A method for performing deblocking filter analysis on a coding block after the coding block is subjected to deblocking filter processing is provided. As mentioned above, different deblocking filter analysis algorithms and corresponding filtering strategies can be formulated according to the needs of different video encoding and decoding scenarios. Figure 3 , 4 The algorithm example shown in 5 is not intended to limit the scope of the deblocking filtering analysis algorithm that can be adopted in the present disclosure.

[0116] In the disclosed embodiment, a plurality of different deblocking filter analysis algorithms may also be combined to perform the relevant deblocking filter analysis process. Figure 6 As shown, it can be Figure 3 The deblocking filter analysis method shown before filtering is Figure 4 , 5 The filtering and deblocking filtering analysis methods shown are combined for correlation analysis.

[0117] like Figure 6 As shown, before deblocking filtering, it can be done by Figure 3The deblocking filter analysis method shown in the figure performs deblocking filter analysis. When it is determined based on the analysis process that no filtering process is required, the deblocking filter process can be directly skipped and the corresponding filter flag setting can be performed. Figure 3 If it is not determined that filtering is not required during the deblocking filter analysis process, deblocking filtering is performed on the coded block to generate a corresponding filter block. Figure 4 , 5 The deblocking filter analysis method performs deblocking filter analysis and determines the filtering strategy of the coding block by comparing the first distortion value and the second distortion value of the coding block and the filtering block relative to the original block respectively.

[0118] The coding block-based deblocking filtering coding method provided by the embodiments of the present disclosure combines the respective advantages of pre-filtering decision and post-filtering decision, thereby improving the efficiency and decision results of the overall filtering decision.

[0119] Figure 7 The present invention is a flowchart showing a deblocking filtering decoding method based on a coding block according to an exemplary embodiment. Figure 7 The method provided in the embodiment is applied to the client and can be executed by any electronic device, such as the above Figure 1 The terminal device in Figure 1 Servers in, or Figure 1 The terminal device and the server in the embodiment are jointly executed, but the present disclosure is not limited to this.

[0120] In step S710, the coded block is decoded to obtain a decoded block.

[0121] In step S720, a filter identifier corresponding to the decoding block is obtained.

[0122] In step S730, in response to the filtering identifier being the first identifier information, a deblocking filtering process is performed on the decoded block.

[0123] In step S740, in response to the filtering identifier being the second identifier information, the decoded block is retained.

[0124] In the related art, based on the deblocking filtering process performed on each coding block in the video frame at the encoding end, the deblocking filtering process also needs to be performed on each coding block in the video frame at the decoding end. This brings a great burden to the decoding end, both in terms of computing power and processing delay.

[0125] In the disclosed embodiment, since the encoding end configures a corresponding filtering strategy for each coding block based on the deblocking filtering analysis, and sets a corresponding filtering flag based on the filtering strategy to identify that some coding blocks are subjected to deblocking filtering processing and some coding blocks are not subjected to deblocking filtering processing. Based on the filtering flag, the decoding end can also select to perform deblocking filtering processing on the corresponding coding block, or directly skip the deblocking filtering processing process.

[0126] Specifically, the decoding end first decodes the current coding block to obtain a corresponding decoding block. Obtain a filter identifier corresponding to the decoding block. The filter identifier is sent to the decoding end along with the coded data sent by the encoding end. In response to the filter identifier being the first identification information, that is, the encoding end has performed deblocking filtering on the coding block, then the decoding block is subjected to deblocking filtering. In response to the filter identifier being the second identification information, that is, the encoding end has not performed deblocking filtering on the coding block, then the decoding block can also skip the deblocking filtering process and be directly reconstructed based on the decoding block.

[0127] At the same time, based on the design concept of the present disclosure, the contents disclosed in the aforementioned embodiments related to the encoding end can all be referred to as the contents of the decoding end embodiments and will not be repeated here.

[0128] The deblocking filter coding method based on the coding block provided by the embodiment of the present disclosure performs deblocking filter analysis on the coding block to determine the block-level filtering strategy; based on the filtering strategy, performs deblocking filter processing on the coding block, or skips deblocking filter processing and retains the coding block; and sets identification information of the filter identification corresponding to the coding block based on the filtering strategy. This method adopts differentiated filtering strategies for different coding blocks by performing deblocking filter analysis on the coding block to determine whether the coding block is subjected to deblocking filter processing. In this way, more flexible block-level switch control can be added to the deblocking filter processing. At the same time, the filtering strategy adopted by the coding block is filtered and identified so that the decoding end can perform corresponding processing, thereby reducing the computational complexity of the decoding end and improving the decoding speed.

[0129] The following are embodiments of the device disclosed herein, which can be used to execute the method embodiments disclosed herein. For details not disclosed in the device embodiments disclosed herein, please refer to the method embodiments disclosed herein.

[0130] Figure 8 is a block diagram of a deblocking filter encoding device based on a coding block according to an exemplary embodiment. Figure 8 The coding block-based deblocking filter encoding device 800 may include: an encoding module 810, a filtering analysis module 820 and a first filtering processing module 830.

[0131] The encoding module 810 is configured to obtain an encoding block; the encoding block is generated by encoding the corresponding original block.

[0132] The filtering analysis module 820 is configured to perform deblocking filtering analysis on the coding block to determine a filtering strategy for the coding block.

[0133] The first filtering processing module 830 is configured to, in response to the filtering strategy requiring filtering processing, perform deblocking filtering on the coding block and set the filtering identifier corresponding to the coding block to the first identification information; in response to the filtering strategy not requiring filtering processing, retain the coding block and set the filtering identifier corresponding to the coding block to the second identification information.

[0134] In some exemplary embodiments of the present disclosure, the coding block is a coding unit (Coding Unit, CU) or a coding tree unit (Coding Tree Unit, CTU).

[0135] In some exemplary embodiments of the present disclosure, the filter identifier is a luminance filter identifier and / or a chrominance filter identifier.

[0136] In some exemplary embodiments of the present disclosure, the filtering analysis module 820 is further configured to obtain characteristic parameters of the coding block; determine a parameter threshold of the coding block; and determine a filtering strategy for the coding block based on the characteristic parameters and the parameter threshold.

[0137] In some exemplary embodiments of the present disclosure, the characteristic parameter includes at least one of a pixel gradient value, an intra-frame and inter-frame prediction ratio, a coding mode and a quantization parameter.

[0138] In some exemplary embodiments of the present disclosure, the filtering analysis module 820 is further configured to obtain a quantization parameter of the coding block; and determine the parameter threshold according to the quantization parameter.

[0139] In some exemplary embodiments of the present disclosure, the filtering analysis module 820 is further configured to perform deblocking filtering on the coding block to obtain a filtering block; perform distortion calculation on the coding block and the filtering block relative to the original block to obtain a first distortion value and a second distortion value; and determine a filtering strategy for the coding block based on the first distortion value and the second distortion value.

[0140] In some exemplary embodiments of the present disclosure, the filtering analysis module 820 is also configured to obtain a rate loss value corresponding to the filtering identifier; obtain a first rate distortion value based on the first distortion value; obtain a second rate distortion value based on the second distortion value and the rate loss value; and determine the filtering strategy of the coding block based on the first rate distortion value and the second rate distortion value.

[0141] In some exemplary embodiments of the present disclosure, the filtering analysis module 820 is further configured to calculate a strategy threshold based on the second rate-distortion value and the adjustment coefficient; in response to the first rate-distortion value being less than the strategy threshold, determine that the filtering strategy does not require filtering processing; in response to the first rate-distortion value being greater than the strategy threshold, determine that the filtering strategy requires filtering processing.

[0142] In some exemplary embodiments of the present disclosure, the filtering analysis module 820 is further configured to obtain a quantization parameter of the coding block; and determine the adjustment coefficient according to the quantization parameter.

[0143] Fig. 9 is a block diagram of a deblocking filter decoding device based on a coding block according to an exemplary embodiment. Fig. 9 The coding block-based deblocking filter decoding device 900 may include: a decoding module 910, an identification acquisition module 920 and a second filtering processing module 930.

[0144] The decoding module 910 is configured to perform decoding processing on the coded block to obtain a decoded block.

[0145] The identifier acquisition module 920 is configured to acquire the filter identifier corresponding to the decoding block.

[0146] The second filtering processing module 930 is configured to perform deblocking filtering on the decoded block in response to the filtering identifier being the first identification information; and retain the decoded block in response to the filtering identifier being the second identification information.

[0147] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0148] Refer to the following Fig.10 hereinafter describes the electronic device 1000 according to such an embodiment of the present disclosure. Fig.10 The electronic device 1000 shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0149] like Fig.10 As shown, the electronic device 1000 is in the form of a general computing device. The components of the electronic device 1000 may include but are not limited to: the at least one processing unit 1010, the at least one storage unit 1020, a bus 1030 connecting different system components (including the storage unit 1020 and the processing unit 1010), and a display unit 1040.

[0150] The storage unit stores program codes, which can be executed by the processing unit 1010, so that the processing unit 1010 performs the steps according to various exemplary embodiments of the present disclosure described in the above “Exemplary Method” section of this specification. For example, the processing unit 1010 can perform the following steps: Figure 2 The steps shown.

[0151] For example, electronic devices can achieve Figure 2 The steps shown.

[0152] The storage unit 1020 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 1021 and / or a cache memory unit 1022 , and may further include a read-only memory unit (ROM) 1023 .

[0153] The storage unit 1020 may also include a program / utility 1024 having a set (at least one) of program modules 1025, such program modules 1025 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0154] Bus 1030 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

[0155] The electronic device 1000 may also communicate with one or more external devices 1070 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 1000, and / or communicate with any device that enables the electronic device 1000 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed via an input / output (I / O) interface 1050. Furthermore, the electronic device 1000 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) via a network adapter 1060. As shown, the network adapter 1060 communicates with other modules of the electronic device 1000 via a bus 1030. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 1000, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0156] Through the description of the above embodiments, it is easy for those skilled in the art to understand that the example embodiments described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the embodiment of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the embodiment of the present disclosure.

[0157] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided, such as a memory including instructions, and the above instructions can be executed by a processor of the device to complete the above method. Optionally, the computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0158] In an exemplary embodiment, a computer program product is also provided, including a computer program / instruction, and when the computer program / instruction is executed by a processor, the method in the above embodiment is implemented.

[0159] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0160] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A deblocking filtering coding method based on coding blocks, characterized in that: include: Get the encoding block; The coded block is generated by encoding the corresponding original block; Performing a deblocking filtering analysis on the coding block to determine a filtering strategy for the coding block; In response to the filtering strategy requiring filtering, performing deblocking filtering on the coding block, and setting the filtering identifier corresponding to the coding block to the first identifier information; In response to the filtering strategy not requiring filtering processing, the coding block is retained, and the filtering identifier corresponding to the coding block is set to the second identifier information.

2. The method according to claim 1, characterized in that: The coding block is a coding unit (CodingUnit, CU) or a coding tree unit (Coding Tree Unit, CTU).

3. The method according to claim 1, characterized in that The performing deblocking filtering analysis on the coding block to determine the filtering strategy of the coding block includes: Obtaining characteristic parameters of the coding block; Determining a parameter threshold of the coding block; A filtering strategy for the coding block is determined according to the characteristic parameter and the parameter threshold.

4. The method according to claim 3, characterized in that The characteristic parameters include: at least one of a pixel gradient value, an intra-frame or inter-frame prediction ratio, a coding mode, and a quantization parameter.

5. The method according to claim 3, characterized in that: The determining the parameter threshold of the coding block includes: Obtaining a quantization parameter of the coding block; The parameter threshold is determined according to the quantization parameter.

6. The method according to claim 1, characterized in that The performing deblocking filtering analysis on the coding block to determine the filtering strategy of the coding block includes: Performing a deblocking filter process on the coding block to obtain a filter block; Performing distortion calculation on the coding block and the filtering block relative to the original block, respectively, to obtain a first distortion value and a second distortion value; A filtering strategy for the coding block is determined according to the first distortion value and the second distortion value.

7. The method according to claim 6, characterized in that The determining, according to the first distortion value and the second distortion value, a filtering strategy for the coding block includes: Obtaining a bit rate loss value corresponding to the filter identifier; Obtaining a first rate-distortion value according to the first distortion value; Obtaining a second rate-distortion value according to the second distortion value and the bit rate loss value; A filtering strategy for the coding block is determined according to the first rate-distortion value and the second rate-distortion value.

8. The method according to claim 7, characterized in that The determining, according to the first rate-distortion value and the second rate-distortion value, a filtering strategy for the coding block includes: Calculating a policy threshold according to the second rate distortion value and the adjustment coefficient; In response to the first rate-distortion value being less than the strategy threshold, determining that the filtering strategy does not require filtering processing; In response to the first rate-distortion value being greater than the strategy threshold, determining that the filtering strategy requires filtering processing.

9. The method according to claim 8, characterized in that The method further comprises: Obtaining a quantization parameter of the coding block; The adjustment coefficient is determined according to the quantization parameter.

10. A deblocking filtering decoding method based on coding blocks, characterized in that: include: Decoding the coded block to obtain a decoded block; Obtaining a filter identifier corresponding to the decoding block; In response to the filtering identifier being the first identification information, performing a deblocking filtering process on the decoded block; In response to the filtering identifier being the second identification information, the decoding block is retained.

11. A deblocking filter encoding device based on coding blocks, characterized in that: include: The encoding module is configured to obtain an encoding block; the encoding block is generated by encoding the corresponding original block; A filtering analysis module, configured to perform a deblocking filtering analysis on the coding block to determine a filtering strategy for the coding block; The first filtering processing module is configured to, in response to the filtering strategy requiring filtering processing, perform deblocking filtering on the coding block and set the filtering identifier corresponding to the coding block to the first identification information; in response to the filtering strategy not requiring filtering processing, retain the coding block and set the filtering identifier corresponding to the coding block to the second identification information.

12. A deblocking filter decoding device based on coding blocks, characterized in that: include: A decoding module is configured to decode the encoding block to obtain a decoding block; An identification acquisition module, configured to acquire a filter identification corresponding to the decoding block; The second filtering processing module is configured to perform deblocking filtering on the decoded block in response to the filtering identifier being the first identification information; and retain the decoded block in response to the filtering identifier being the second identification information.

13. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the executable instructions to implement the coding block-based deblocking filtering encoding method as described in any one of claims 1 to 9 or the coding block-based deblocking filtering decoding method as described in claim 10.

14. A computer-readable storage medium, when the instructions in the computer-readable storage medium are executed by a processor of an electronic device, enables the electronic device to perform the coding block-based deblocking filtering encoding method as described in any one of claims 1 to 9 or the coding block-based deblocking filtering decoding method as described in claim 10.

15. A computer program product comprising a computer program / instructions, characterized in that When the computer program / instruction is executed by a processor, the deblocking filtering encoding method based on coding blocks as described in any one of claims 1 to 9 or the deblocking filtering decoding method based on coding blocks as described in claim 10 is implemented.

Images