Intra-frame coding block adaptive division method, system and device, and storage medium

By calculating the optimal rate distortion cost of the current layer coded block and the pixel information fitting index model, the intra-coded block division is determined, which solves the problem of time-consuming decision-making of intra-coded block division, and improves the video encoding speed and efficiency.

WO2024234975A1PCT designated stage expired Publication Date: 2024-11-21SHANGHAI LUOTA INFORMATION TECHNOLOGY CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/090154
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-12
Filing Date
2024-04-26
Publication Date
2024-11-21

AI Technical Summary

Technical Problem

In the existing video encoding technology, intra-coded block division decisions take a long time, which affects the encoding efficiency.

Method used

By calculating the optimal rate distortion cost of the current layer coded block and calculating the division threshold based on the setting exponential model, the exponential model is used to fit the optimal rate distortion cost and pixel information of different coded blocks, and decide whether to divide the coded blocks, simplifying the calculation process and reduce complexity.

Benefits of technology

While ensuring the accuracy of coding block division, the speed and efficiency of intra-coded block division are significantly improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024090154_21112024_PF_FP_ABST
    Figure CN2024090154_21112024_PF_FP_ABST
Patent Text Reader

Abstract

Disclosed in embodiments of the present application are an intra-frame coding block adaptive division method, system and device, and a storage medium. The technical solution provided in the embodiments of the present application comprises: calculating an optimal rate distortion cost of a coding block of a current layer, and calculating a division threshold for the coding block of the current layer on the basis of a set exponential model of the current layer, wherein the set exponential model is fitted and built in advance on the basis of optimal rate distortion costs of different coding blocks and corresponding pixel information; and when the optimal rate distortion cost of the coding block of the current layer is smaller than the division threshold, ending division of the coding block of the current layer, and when the optimal rate distortion cost of the coding block of the current layer is greater than or equal to the division threshold, dividing the coding block of the current layer and proceeding to coding block division decision making for the next layer. By using the described technical means, the coding block division precision can be guaranteed, a calculation process for coding block division determination is simplified, the calculation complexity is reduced, the coding block division calculation efficiency is then improved, and the video intra-frame coding speed is increased.
Need to check novelty before this filing date? Find Prior Art

Description

Intra-frame coding block adaptive division method, system, device and storage medium

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on May 12, 2023, with application number 202310540006.7, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The embodiments of the present application relate to the field of video coding technology, and in particular to a method, system, device, and storage medium for adaptively dividing intra-frame coding blocks. Background Art

[0003] Intra-frame coding is a core technology in video coding. During the video coding process, as shown in Figure 1, each frame is first divided into fixed-size coding units. These units are then layered into coding blocks based on the image's complexity. Different regions have different levels of coding blocks, resulting in different sizes. Currently, the optimal rate-distortion cost for each layer of coding block is calculated. The optimal number of layers for the coding block is selected to minimize this cost, effectively achieving precise intra-frame coding block division.

[0004] However, the method of deciding the optimal number of layers for dividing coding blocks requires calculating the optimal rate-distortion cost layer by layer, which makes the intra-frame coding block division time-consuming, and thus causes the entire intra-frame coding process to be time-consuming, affecting the intra-frame coding efficiency.

[0005] Summary of the Invention

[0006] The embodiments of the present application provide a method, system, device and storage medium for adaptively dividing intra-frame coding blocks, which can improve the division speed of intra-frame coding blocks and solve the technical problem that the intra-frame coding block division decision takes a long time.

[0007] In a first aspect, an embodiment of the present application provides a method for adaptively dividing intra-frame coding blocks, including:

[0008] Calculate the optimal rate-distortion cost of the current layer coding block, and calculate the partition threshold of the current layer coding block based on the set exponential model of the current layer. The set exponential model is pre-fitted with the optimal rate-distortion cost of different coding blocks and the corresponding pixel information;

[0009] When the optimal rate-distortion cost of the current layer coding block is less than the division threshold, the division of the current layer coding block is terminated. When the optimal rate-distortion cost of the current layer coding block is greater than or equal to the division threshold, the current layer coding block is divided and the next layer coding block division decision is entered.

[0010] In a second aspect, an embodiment of the present application provides an intra-frame coding block adaptive partitioning system, including:

[0011] a calculation module configured to calculate an optimal rate-distortion cost of a coding block of a current layer, and calculate a partitioning threshold of the coding block of the current layer based on a set exponential model of the current layer, where the set exponential model is pre-fitted and constructed using the optimal rate-distortion costs of different coding blocks and corresponding pixel information;

[0012] The division module is configured to end the division of the current layer coding block when the optimal rate-distortion cost of the current layer coding block is less than the division threshold, and to divide the current layer coding block when the optimal rate-distortion cost of the current layer coding block is greater than or equal to the division threshold, and enter the next layer coding block division decision.

[0013] In a third aspect, an embodiment of the present application provides an intra-frame coding block adaptive partitioning device, including:

[0014] memory and one or more processors;

[0015] The memory is configured to store one or more programs;

[0016] When the one or more programs are executed by the one or more processors, the one or more processors implement the intra-frame coding block adaptive partitioning method as described in the first aspect.

[0017] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores computer-executable instructions. When the computer-executable instructions are executed by a computer processor, they are configured to perform the intra-frame coding block adaptive partitioning method as described in the first aspect.

[0018] In a fifth aspect, an embodiment of the present application provides a computer program product, which includes instructions. When the instructions are executed on a computer or a processor, the computer or the processor executes the method for adaptive partitioning of intra-frame coding blocks as described in the first aspect.

[0019] The embodiment of the present application calculates the optimal rate-distortion cost of the current layer coding block, and calculates the division threshold of the current layer coding block based on the set exponential model of the current layer, and sets the exponential model to fit and construct the optimal rate-distortion cost of different coding blocks and the corresponding pixel information in advance; when the optimal rate-distortion cost of the current layer coding block is less than the division threshold, the division of the current layer coding block is ended, and when the optimal rate-distortion cost of the current layer coding block is greater than or equal to the division threshold, the current layer coding block is divided and the next level of coding block division decision is entered. The above-mentioned technical means are adopted to construct an exponential model by fitting the optimal rate-distortion cost of the coding block and the corresponding pixel information, and the exponential model is used to accurately make decisions on coding block division. In this way, while ensuring the accuracy of coding block division, the calculation process of coding block division judgment can be simplified, the calculation complexity can be reduced, and the efficiency of coding block division calculation can be improved, thereby improving the speed of video intra-frame coding. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] FIG1 is a schematic diagram of coding block division in the video coding process;

[0021] FIG2 is a flowchart of a method for adaptively dividing intra-frame coding blocks provided by an embodiment of the present application;

[0022] FIG3 is a schematic diagram of layer-by-layer division decision of coding blocks in an embodiment of the present application;

[0023] FIG4 is a flowchart of iterative correction of the setting index model in an embodiment of the present application;

[0024] FIG5 is a schematic structural diagram of an intra-frame coding block adaptive division system provided by an embodiment of the present application;

[0025] FIG6 is a schematic structural diagram of an intra-frame coding block adaptive division device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0026] In order to make the purpose, technical solutions and advantages of the present application clearer, the specific embodiments of the present application are further described in detail below in conjunction with the accompanying drawings. It is understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application. It should also be noted that, for ease of description, only parts related to the present application, not all of the contents, are shown in the accompanying drawings. Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flow charts. Although the flow charts describe each operation (or step) as a sequential process, many of the operations therein can be implemented in parallel, concurrently or simultaneously. In addition, the order of the operations can be rearranged. The process can be terminated when its operation is completed, but can also have additional steps not included in the accompanying drawings. The process can correspond to a method, function, procedure, subroutine, subprogram, etc.

[0027] The adaptive intra-frame coding block partitioning provided in this application aims to construct an exponential model by fitting the optimal rate-distortion cost of the coding block and the corresponding pixel information, calculate the partitioning threshold through the exponential model, and then quickly decide whether to perform coding block partitioning based on the comparison result of the optimal rate-distortion cost of the coding block and the partitioning threshold, so as to improve the efficiency of coding block partitioning decision-making and increase the speed of coding block partitioning.

[0028] In relevant coding block division decision schemes, the optimal rate-distortion cost is usually calculated layer by layer, and then the optimal rate-distortion costs are compared. The number of layers corresponding to the optimal rate-distortion cost with the smallest value is selected as the optimal number of layers for the coding block. Since the optimal rate-distortion cost of all layers of coding blocks needs to be calculated, the calculation is bound to take a long time, which will extend the time of the entire coding block division process, thereby delaying the intra-frame coding of the video and affecting the coding efficiency. Based on this, an embodiment of the present application provides an adaptive intra-frame coding block division method to solve the technical problem of the long time consumption of intra-frame coding block division decision.

[0029] Example:

[0030] FIG2 is a flowchart of a method for adaptively partitioning intra-frame coding blocks provided in an embodiment of the present application. The method for adaptively partitioning intra-frame coding blocks provided in this embodiment can be performed by an adaptive intra-frame coding block partitioning device. The adaptive intra-frame coding block partitioning device can be implemented in software and / or hardware. The adaptive intra-frame coding block partitioning device can be composed of two or more physical entities or a single physical entity. Generally speaking, the adaptive intra-frame coding block partitioning device can be a computing device such as an encoder device, an encoding server, a computer, or a host device.

[0031] The following description will be made by taking the intra-frame coding block adaptive division device as an example to perform the intra-frame coding block adaptive division method. Referring to FIG2 , the intra-frame coding block adaptive division method specifically includes:

[0032] S110, calculating the optimal rate-distortion cost of the coding block of the current layer, and calculating the partition threshold of the coding block of the current layer based on a set exponential model of the current layer, where the set exponential model is pre-fitted and constructed using the optimal rate-distortion costs of different coding blocks and corresponding pixel information;

[0033] S120. When the optimal rate-distortion cost of the current layer coding block is less than the division threshold, the division of the current layer coding block is ended. When the optimal rate-distortion cost of the current layer coding block is greater than or equal to the division threshold, the current layer coding block is divided and the next layer coding block division decision is entered.

[0034] When performing intra-frame coding block division, the embodiment of the present application uses an exponential model estimation method instead of traversing all levels of coding blocks to calculate the optimal rate-distortion cost, thereby reducing the amount of calculation in the coding block division decision process and achieving the effect of improving the coding block division speed.

[0035] It is understandable that when dividing the coding blocks layer by layer, if it is necessary to calculate the optimal rate-distortion cost of the coding blocks for each level, and then select the optimal number of division layers based on the rate-distortion cost, then from the maximum level of the coding block to the minimum level of the division set by the video frame, each level needs to perform an optimal rate-distortion cost calculation. However, when using the adaptive division method of intra-frame coding blocks in the embodiment of the present application, it is only necessary to calculate whether the current level coding block is the optimal level when dividing the coding blocks layer by layer from large to small, and then decide whether to continue dividing it. The calculation process only needs to continue to the optimal division level. Compared with the method of calculating the optimal rate-distortion cost for all levels, the embodiment of the present application significantly reduces the optimal rate-distortion cost calculation process of the subsequent levels by adaptively judging whether to continue dividing the coding blocks, thereby improving the coding block division speed.

[0036] Furthermore, when determining whether to split the current-level coding block, an exponential model is constructed by fitting the optimal rate-distortion costs of different coding blocks and the corresponding pixel information. This exponential model is used to calculate a split threshold, and the actual optimal rate-distortion cost of the current-level coding block is then compared with the split threshold to determine whether to split the current-level coding block. Because the exponential model is constructed by fitting the optimal rate-distortion costs of different coding blocks and the corresponding pixel information, the calculated split threshold can be represented as the estimated optimal rate-distortion cost information for the current-level coding block. If the actual optimal rate-distortion cost of the current-level coding block is smaller than the estimated optimal rate-distortion cost information, the actual rate-distortion performance of the current-level coding block is better than the rate-distortion performance predicted by the exponential model. In this case, it is determined that no further splitting of the current-level coding block is necessary, and further splitting may incur a higher rate-distortion cost. Otherwise, it indicates that the actual rate-distortion performance of the current-level coding block after splitting deviates from the rate-distortion performance predicted by the exponential model. In this case, it is determined that the current-level coding block needs to be split, and the decision on the next-level coding block split is made.

[0037] The rate-distortion cost is D + λR, where D represents distortion, R represents the bit rate, and λ represents the Lagrange coefficient. It can be understood that a smaller rate-distortion cost indicates better coding performance. By finding the level with the lowest rate-distortion cost, the optimal coding block partitioning result can be obtained.

[0038] Based on the above-mentioned coding block division judgment logic, division decisions are made for each coding block layer by layer until the optimal rate-distortion cost is less than the division threshold calculated by the exponential model, and the coding block division process is terminated. Since the exponential model is constructed by fitting the optimal rate-distortion cost of different coding blocks and the corresponding pixel information, the optimal rate-distortion cost of different coding blocks is used as the division threshold to fit the model estimation formula, thereby ensuring that the estimated division threshold reflects the rate-distortion situation of the corresponding coding block more accurately. By comparing the division threshold provided by the exponential model with the actual optimal rate-distortion cost of the coding block to make a division decision, the speed of coding block division decision-making can be improved while ensuring the accuracy of coding block division.

[0039] For example, as shown in FIG3 , when determining the intra-frame coding block division of a video image, the division begins with the topmost coding block and proceeds downwards, performing the coding block division decision process of steps S110-S120 at each layer. If further division is possible, the above steps are repeated. Otherwise, the coding block division process ends, and the optimal number of division layers and corresponding coding mode are obtained.

[0040] Specifically, the setting index model of the embodiment of the present application is fitted and constructed based on the mapping relationship between the division threshold and the corresponding pixel information and video characteristic parameters. The setting index model is set by pre-setting the optimal rate-distortion cost of different coding blocks as the division threshold, and inputting the optimal rate-distortion cost and corresponding pixel information of different coding blocks into the formula of the setting index model to obtain the model influence coefficient by fitting, and the video characteristic parameters are obtained based on the model influence coefficient.

[0041] An exponential model is fitted using a large number of actual optimal rate-distortion costs and corresponding pixel information, enabling it to estimate the rate-distortion cost of a coding block. This exponential model is then used to estimate the rate-distortion cost of the current coding block, which is the splitting threshold. The actual rate-distortion cost of the current coding block is compared with the splitting threshold to determine whether to terminate the splitting process for the current coding block.

[0042] The formula of the setting index model is expressed as: y = ae bx

[0043] Wherein, a and b represent video characteristic parameters, y represents the division threshold, and x represents the pixel information of the current layer coding block.

[0044] Pixel information can be the variance, mean, or gradient of the pixels in the coding block. Different pixel information and coding blocks at different levels correspond to different optimal rate-distortion costs. When constructing an exponential model, the known pixel information and optimal rate-distortion costs of different coding blocks are first input into the exponential model formula. The values ​​of the video characteristic parameters a and b are then fitted using a large amount of data. These values ​​are then substituted into the exponential model formula for subsequent calculation of the partitioning threshold. When making a partitioning decision for a coding block, the pixel information of the coding block is input into the exponential model, and the corresponding estimated partitioning threshold is output. This partitioning threshold can be used to determine whether to partition the current coding block by comparing it with the optimal rate-distortion cost of the current coding block. In practical applications, the amount of fitting data can be adaptively adjusted based on the exponential model's estimation accuracy requirements to ensure sufficient estimation accuracy for the exponential model.

[0045] Furthermore, after dividing the current layer coding block, as shown in FIG4 , the following is further included:

[0046] S1301: Detect whether the current layer coding block is at the set lowest level. If the current layer coding block is at the lowest level, end coding block division.

[0047] S1302: Determine whether there is an error in the division of the coding blocks within the current frame based on the optimal rate-distortion cost of the coding blocks of each layer;

[0048] S1303: When it is determined that there is an error in the division of the coding blocks in the current frame, the optimal rate-distortion cost with the minimum value and the corresponding pixel information in the coding blocks of each layer are selected as correction data for setting the iterative correction of the exponential model.

[0049] In addition to ending the division of the current layer coding block when the optimal rate-distortion cost is less than the division threshold, in the process of dividing the coding block layer by layer, if the division of the current coding block has reached the preset lowest level, there is no need to further divide the coding block to improve coding efficiency.

[0050] After completing the coding block division, the embodiment of the present application further verifies whether the current coding block is divided accurately, so as to correct the exponential model according to the verification result. Among them, by calculating the optimal rate-distortion cost of the coding blocks of all levels, it is determined whether the optimal rate-distortion cost of the coding block at the current end division level is the smallest among all levels of coding blocks. It can be understood that if the optimal rate-distortion cost of the coding block at the end division level is the smallest, it is determined that the current intra-frame coding block division is accurate. On the contrary, if the optimal rate-distortion cost of the coding block at the end division level is not the smallest value among all levels of coding blocks, it is determined that there is an error in the current intra-frame coding block division. At this time, in order to improve the accuracy of coding block division decision-making, it is necessary to correct the exponential model so that its estimated division threshold can more accurately decide whether to perform coding block division.

[0051] Based on this, when it is determined that there is an error in the division of the coding block in the current frame, the optimal rate-distortion cost with the smallest value and the corresponding pixel information in each layer of coding block will be selected as correction data, and this part of the correction data will be used to iteratively correct the exponential model.

[0052] The iterative correction process of the exponential model includes: obtaining a data mean for a set number of correction data, and using the data mean to update the video characteristic parameters of the set exponential model.

[0053] For example, since the initial values ​​of the video characteristic parameters a and b in the exponential model are derived from the fitting of a large amount of data, they are universal parameters and may not be optimal for the current coded video. There may be inaccuracies, such as when the exponential model determines that the current coding block should continue to perform the next level of division. However, after the next level of division, the current level of division is still more effective. Although this has no impact on the coding quality, the computational time spent on the lower-level division decision will inevitably extend the coding time. Therefore, in order to improve the accuracy of the exponential model, the pixel information of the current level and the corresponding optimal rate-distortion cost will be used to update the model parameters, so that the model better fits the current coded image and adaptively improves accuracy. At the same time, in order to prevent the influence of individual outlier data on the model, after accumulating a set amount of data, the data will be averaged to obtain the data mean. The data mean is used to further fit the video characteristic parameters of the exponential model to smooth the impact of outliers.

[0054] Furthermore, considering the different characteristics of coding blocks at different levels, using the same exponential model for different coding blocks can easily lead to certain estimation errors. Based on this principle, when updating the exponential model, the embodiment of the present application uses the exponential model constructed using the initial values ​​of a and b obtained by the above fitting to make the coding block partition decision for the first coding block to be partitioned. Subsequent coding blocks are updated with the exponential model in the same manner as above, and the updated exponential model is used to make the corresponding coding block partition decision.

[0055] The values ​​of the video characteristic parameters corresponding to different specific coding blocks are different. The first coding block of the corresponding video frame uses the model influence coefficient as the video characteristic parameter, and the remaining coding blocks use the video characteristic parameters of the coding blocks they refer to as reference data. They update their own video characteristic parameters based on the reference data and the data mean of the corresponding level.

[0056] For example, for the first block to be encoded, since there is no reference block data, the values ​​of its video characteristic parameters a and b are initialized using values ​​fitted from a large amount of data. After the encoding of the block to the left or above is completed, the current block to be encoded uses the information from the block to the left or above, combined with the data mean used for iterative updating of the exponential model, to update the video characteristic parameters a and b in the exponential model.

[0057] Among them, updating its own video characteristic parameters based on reference data and the data mean of the corresponding level includes: determining the prediction error information of the set exponential model based on the data mean of the corresponding level; updating its own video characteristic parameters according to the prediction error information, reference data and the set adjustment rate coefficient.

[0058] In the embodiment of the present application, the video characteristic parameter update is performed using a gradient descent method. New video characteristic parameters are derived based on old video characteristic parameters. Furthermore, the old video characteristic parameters are derived from the video characteristic parameters of the exponential model of the reference coding block. The old video characteristic parameters are defined as reference data. When updating the video characteristic parameters, prediction error information for the current exponential model is first determined based on the data mean and the estimated threshold corresponding to the exponential model. This prediction error information is then added to the reference data to obtain new video characteristic parameters, thereby completing the video characteristic parameter update.

[0059] Optionally, to maintain the updates of video characteristic parameters a and b within a reasonable range and avoid excessive changes that could lead to model errors, a corresponding adjustment rate coefficient can be added when calculating the new video characteristic parameters. By adjusting the rate coefficient to control the adjustment range of the video characteristic parameters, the updated exponential model can more accurately predict the segmentation threshold, thereby achieving more precise coding module segmentation.

[0060] In practical applications, the update of the exponential model can also introduce other different influencing parameters, and use corresponding formulas to calculate the updated video characteristic parameters a and b. The embodiment of the present application does not impose a fixed restriction on the specific model update method, and will not be described in detail here.

[0061] At this point, an exponential model is constructed by fitting actual data and used to make decisions about block division. The exponential model for the block to be encoded is updated in real time based on reference data provided by nearby, already-encoded blocks and the exponential model's historical error data. This ensures accurate block division while accelerating encoding.

[0062] As mentioned above, by calculating the optimal rate-distortion cost of the current layer coding block, and calculating the division threshold of the current layer coding block based on the set exponential model of the current layer, the set exponential model is pre-fitted and constructed with the optimal rate-distortion cost of different coding blocks and the corresponding pixel information; when the optimal rate-distortion cost of the current layer coding block is less than the division threshold, the division of the current layer coding block is ended, and when the optimal rate-distortion cost of the current layer coding block is greater than or equal to the division threshold, the current layer coding block is divided and the next level of coding block division decision is entered. By adopting the above technical means, an exponential model is constructed by fitting the optimal rate-distortion cost of the coding block and the corresponding pixel information, and the exponential model is used to accurately make decisions on coding block division. In this way, while ensuring the accuracy of coding block division, the calculation process of coding block division judgment can be simplified, the calculation complexity can be reduced, and the efficiency of coding block division calculation can be improved, thereby improving the speed of intra-frame coding in the video.

[0063] Based on the above embodiment, FIG5 is a schematic diagram of the structure of an intra-frame coding block adaptive partitioning system provided by this application. Referring to FIG5 , the intra-frame coding block adaptive partitioning system provided by this embodiment specifically includes: a calculation module 21 and a partitioning module 22 .

[0064] The calculation module 21 is configured to calculate the optimal rate-distortion cost of the coding block of the current layer, and calculate the division threshold of the coding block of the current layer based on the set exponential model of the current layer, where the set exponential model is pre-fitted and constructed using the optimal rate-distortion costs of different coding blocks and corresponding pixel information;

[0065] The division module 22 is configured to end the division of the current layer coding block when the optimal rate-distortion cost of the current layer coding block is less than the division threshold, and to divide the current layer coding block when the optimal rate-distortion cost of the current layer coding block is greater than or equal to the division threshold, and enter the next level coding block division decision.

[0066] Specifically, an exponential model is set to be fitted and constructed based on the mapping relationship between the division threshold and the corresponding pixel information and video characteristic parameters. The exponential model is set by pre-setting the optimal rate-distortion cost of different coding blocks as the division threshold, inputting the optimal rate-distortion cost of different coding blocks and the corresponding pixel information into the formula of the exponential model, fitting to obtain the model influence coefficient, and obtaining the video characteristic parameters based on the model influence coefficient.

[0067] Specifically, the formula of the exponential model is expressed as: y = ae bx

[0068] Wherein, a and b represent video characteristic parameters, y represents the division threshold, and x represents the pixel information of the current layer coding block.

[0069] Specifically, after dividing the current layer coding block, it also includes:

[0070] Detect whether the current layer coding block is at the set lowest level, and end the coding block division if the current layer coding block is at the lowest level;

[0071] Determine whether there is an error in the current intra-frame coding block division based on the optimal rate-distortion cost of each layer of coding blocks;

[0072] When it is determined that there is an error in the division of the coding block in the current frame, the optimal rate-distortion cost with the minimum value and the corresponding pixel information in the coding blocks of each layer are selected as correction data to set the iterative correction of the exponential model.

[0073] Specifically, the iterative correction of the exponential model is set, including:

[0074] A data mean is calculated for a set number of correction data, and the data mean is used to update the video characteristic parameters of the set exponential model.

[0075] Specifically, the values ​​of the video characteristic parameters corresponding to different coding blocks are different. The first coding block of the corresponding video frame uses the model influence coefficient as the video characteristic parameter, and the remaining coding blocks use the video characteristic parameters of the coding blocks they refer to as reference data, and update their own video characteristic parameters based on the reference data and the data mean of the corresponding level.

[0076] Specifically, the video feature parameters are updated based on the reference data and the data mean of the corresponding level, including:

[0077] Determine the prediction error information of the set index model based on the data mean of the corresponding level;

[0078] Update its own video characteristic parameters according to the prediction error information, reference data and the set adjustment rate coefficient.

[0079] As mentioned above, by calculating the optimal rate-distortion cost of the current layer coding block, and calculating the division threshold of the current layer coding block based on the set exponential model of the current layer, the set exponential model is pre-fitted and constructed with the optimal rate-distortion cost of different coding blocks and the corresponding pixel information; when the optimal rate-distortion cost of the current layer coding block is less than the division threshold, the division of the current layer coding block is ended, and when the optimal rate-distortion cost of the current layer coding block is greater than or equal to the division threshold, the current layer coding block is divided and the next level of coding block division decision is entered. By adopting the above technical means, an exponential model is constructed by fitting the optimal rate-distortion cost of the coding block and the corresponding pixel information, and the exponential model is used to accurately make decisions on coding block division. In this way, while ensuring the accuracy of coding block division, the calculation process of coding block division judgment can be simplified, the calculation complexity can be reduced, and the efficiency of coding block division calculation can be improved, thereby improving the speed of intra-frame coding in the video.

[0080] The intra-frame coding block adaptive division system provided in the embodiment of the present application can be configured to execute the intra-frame coding block adaptive division method provided in the above embodiment, and has corresponding functions and beneficial effects.

[0081] Based on the above practical example, an embodiment of the present application further provides an intra-frame coding block adaptive partitioning device. Referring to FIG6 , the intra-frame coding block adaptive partitioning device includes: a processor 31, a memory 32, a communication module 33, an input device 34, and an output device 35. The memory, as a computer-readable storage medium, can be configured to store software programs, computer-executable programs, and modules, such as program instructions / modules corresponding to the intra-frame coding block adaptive partitioning method described in any embodiment of the present application (e.g., a computing module in an intra-frame coding block adaptive partitioning system). The communication module is configured to perform data transmission. The processor executes the software programs, instructions, and modules stored in the memory to execute various functional applications and data processing of the device, thereby implementing the above-mentioned intra-frame coding block adaptive partitioning method. The input device can be configured to receive input digital or character information and generate key signal input related to user settings and function control of the device. The output device can include a display device such as a display screen. The above-mentioned intra-frame coding block adaptive partitioning device can be configured to execute the intra-frame coding block adaptive partitioning method provided in the above-mentioned embodiments, and has corresponding functions and beneficial effects.

[0082] Based on the above embodiments, embodiments of the present application further provide a computer-readable storage medium storing computer-executable instructions. When executed by a computer processor, the computer-executable instructions are configured to execute a method for adaptively partitioning intra-frame coding blocks. The storage medium may be any of various types of memory devices or storage devices. Of course, the computer-executable instructions of the computer-readable storage medium provided in embodiments of the present application are not limited to the method for adaptively partitioning intra-frame coding blocks described above, and may also execute related operations in the method for adaptively partitioning intra-frame coding blocks provided in any embodiment of the present application.

[0083] Based on the above embodiments, the embodiments of the present application also provide a computer program product. The technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer program product is stored in a storage medium and includes a number of instructions for enabling a computer device, a mobile terminal, or a processor therein to execute all or part of the steps of the adaptive intra-frame coding block partitioning method described in each embodiment of the present application.

Claims

1. A method for adaptively partitioning intra-frame coding blocks, wherein: include: Calculate the optimal rate-distortion cost of the current layer coding block, and calculate the division threshold of the current layer coding block based on the set exponential model of the current layer, wherein the set exponential model is pre-fitted and constructed with the optimal rate-distortion costs of different coding blocks and corresponding pixel information; When the optimal rate-distortion cost of the current layer coding block is less than the division threshold, the division of the current layer coding block is terminated; when the optimal rate-distortion cost of the current layer coding block is greater than or equal to the division threshold, the current layer coding block is divided and the coding block division decision of the next level is entered.

2. The method for adaptively dividing intra-frame coding blocks according to claim 1, wherein: The set index model is constructed by fitting based on the mapping relationship between the division threshold and the corresponding pixel information and the video characteristic parameters. The set index model is constructed by pre-setting the optimal rate-distortion cost of different coding blocks as the division threshold, inputting the optimal rate-distortion cost of different coding blocks and the corresponding pixel information into the formula of the set index model, fitting to obtain the model influence coefficient, and obtaining the video characteristic parameter based on the model influence coefficient.

3. The method for adaptively dividing intra-frame coding blocks according to claim 2, wherein: The formula of the setting index model is expressed as: y = ae bx Wherein, a and b represent the video characteristic parameters, y represents the division threshold, and x represents the pixel information of the current layer coding block.

4. The method for adaptively dividing intra-frame coding blocks according to claim 2, wherein: After dividing the current layer coding block, the method further includes: Detecting whether the current layer coding block is at a set lowest level, and ending coding block division when the current layer coding block is at the lowest level; Based on the optimal rate-distortion cost of each layer of coding block, it is determined whether there is an error in the current intra-frame coding block division; When it is determined that there is an error in the division of the coding block in the current frame, the optimal rate-distortion cost with the smallest value in each layer of coding blocks and the corresponding pixel information are selected as correction data for iterative correction of the set exponential model.

5. The method for adaptively dividing intra-frame coding blocks according to claim 4, wherein: The iterative modification of the setting index model includes: The data mean is calculated for the set number of correction data, and the data mean is used to update the The video characteristic parameters of the exponential model are set.

6. The method for adaptively dividing intra-frame coding blocks according to claim 5, wherein: The values ​​of the video characteristic parameters corresponding to different coding blocks are different. The first coding block of the corresponding video frame uses the model influence coefficient as the video characteristic parameter, and the remaining coding blocks use the video characteristic parameters of the coding blocks they refer to as reference data, and update their own video characteristic parameters based on the reference data and the data mean of the corresponding level.

7. The method for adaptively dividing intra-frame coding blocks according to claim 6, wherein: Updating the video characteristic parameters of the video itself based on the reference data and the data mean of the corresponding level includes: Determine the prediction error information of the set index model based on the data mean of the corresponding level; The video characteristic parameters of the self are updated according to the prediction error information, the reference data and the set adjustment rate coefficient.

8. An intra-frame coding block adaptive partitioning system, wherein: include: A calculation module, configured to calculate an optimal rate-distortion cost of a coding block of a current layer, and calculate a division threshold of the coding block of the current layer based on a set exponential model of the current layer, wherein the set exponential model is pre-fitted and constructed with optimal rate-distortion costs of different coding blocks and corresponding pixel information; The division module is configured to compare the optimal rate-distortion cost of the current layer coding block with the division threshold, and when the optimal rate-distortion cost of the current layer coding block is less than the division threshold, end the division of the current layer coding block; when the optimal rate-distortion cost of the current layer coding block is greater than or equal to the division threshold, divide the current layer coding block and enter the next level of coding block division decision.

9. An intra-frame coding block adaptive partitioning device, wherein: include: memory and one or more processors; The memory is configured to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the intra-frame coding block adaptive partitioning method as described in any one of claims 1-7.

10. A computer-readable storage medium, wherein: The computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by a computer processor, they are configured to execute the intra-frame coding block adaptive partitioning method according to any one of claims 1 to 7.

11. A computer program product, wherein: The computer program product includes instructions, and when the instructions are executed on a computer or a processor, the computer or the processor executes the method for adaptively dividing intra-frame coding blocks as claimed in any one of claims 1 to 7.

Citation Information

Patent Citations

  • Intra-frame prediction mode selection method and system of 3D (3-dimension) video plus depth image

    CN104378643A

  • Space-domain correlation based rapid HEVC (High Efficiency Video Coding) predication mode selection method

    CN104394409A

  • Coding processing method and device, electronic equipment and storage medium

    CN115623204A

  • Coding processing method and device, electronic equipment and storage medium

    CN115623205A

  • Intra-frame coding block adaptive division method, system and device and storage medium

    CN116567233A