Display stream division method, device, electronic equipment and storage medium

Abstract

The application relates to a display stream division mode determination method and device, electronic equipment and a storage medium. The display stream division mode determination method comprises the following steps: in the process of display stream compression coding, the division evaluation parameters of each preset division mode are calculated in sequence according to the calculation order of each preset division mode of the current coding block in the prediction mode, and the calculation of the remaining division modes is stopped until the division evaluation parameters meet the preset requirements; one of the preset division modes that have been calculated is selected as the target division mode of the prediction mode. The display stream division mode determination method can reduce the complexity of determining the division mode of the prediction mode.

Description

Technical Field

[0001] This application relates to the field of display stream compression technology, and in particular to a method, apparatus, electronic device, and storage medium for determining a display stream partitioning method. Background Technology

[0002] To achieve low-cost, visually lossless, and efficient video compression in the display link, VDC-M employs many advanced compression coding tools, such as Block Prediction (BP). BP divides the coded block into 2x2 and 2x1 sub-blocks. For example, an 8x2 coded block will be divided into four 2x2 and eight 2x1 sub-blocks. Each 2x2 and 2x1 sub-block performs motion estimation at 64 positions relative to the adjacent encoded pixels in the current coded block and selects the optimal position as the optimal prediction position for the sub-block, thus removing spatial information redundancy. After all sub-blocks have selected their optimal prediction positions, an 8x2 coded block will have 16 possible partitioning methods. In BP, to obtain the optimal partitioning method, the rate-distortion cost of each partitioning method needs to be calculated, and then the partitioning method with the lowest rate-distortion cost is selected as the optimal partitioning method.

[0003] However, the calculation of rate-distortion cost is required for all partitioning methods, which makes determining the partitioning method for the prediction model highly complex. Summary of the Invention

[0004] This application provides a method, apparatus, electronic device, and storage medium for determining the display stream partitioning method, which can reduce the complexity of determining the partitioning method of the prediction mode.

[0005] Firstly, this application provides a method for determining the display stream partitioning method, including:

[0006] During the display stream compression encoding process, the partitioning evaluation parameters of each preset partitioning method are calculated sequentially according to the calculation order of each preset partitioning method when the current coding block is in prediction mode, until the partitioning evaluation parameters meet the preset requirements and the calculation of the remaining partitioning methods is stopped.

[0007] Select one of the pre-calculated preset partitioning methods as the target partitioning method for the prediction mode.

[0008] In one embodiment, the partitioning evaluation parameters include at least one of the following:

[0009] The sum of the residual losses of each color component of each pixel in the current coding block;

[0010] The sum of the rate-distortion costs of each color component of each pixel in the current coding block;

[0011] The partitioning evaluation parameters meet preset requirements, including:

[0012] At least one of the partitioning evaluation parameters is less than the threshold corresponding to that partitioning evaluation parameter.

[0013] In one embodiment, the partitioning evaluation parameters include the sum of the residual losses, and the calculation of the partitioning evaluation parameters for each preset partitioning method includes:

[0014] Extract the residual pixel value and inverse quantization residual value of each color component of each pixel in the current coding block;

[0015] The sum of the residual losses is determined based on the residual pixel values ​​and the inverse quantization residual values.

[0016] In one embodiment, the sum of the residual losses is determined according to the following formula:

[0017]

[0018] in:

[0019] Where M and N are the width and brightness of the coded block, respectively; i and j are the x and y coordinates of the pixel in the coded block, respectively; and k∈{0,1,2} represents the three color components corresponding to the pixel in the coded block. Represents the residual pixel value. This represents the inverse quantization residual value, and D represents the sum of residual losses.

[0020] In one embodiment, the partitioning evaluation parameters include the sum of the rate-distortion costs, and the calculation of the partitioning evaluation parameters for each preset partitioning method includes:

[0021] Extract the rate-distortion cost of each color component of each pixel in the current coding block;

[0022] The sum of the rate-distortion values ​​is determined based on the rate-distortion values ​​of each color component.

[0023] In one embodiment, each pixel includes three color components, and the sum of the rate-distortion costs is determined according to the following formula:

[0024]

[0025] Among them, RD k ,k∈{0,1,2} represents the rate-distortion cost, k∈{0,1,2} represents the three color components corresponding to the pixel in the coding block, and RD represents the sum of the rate-distortion costs.

[0026] Secondly, this application provides a module for determining the display stream partitioning method, including:

[0027] The calculation module is used to calculate the partitioning evaluation parameters of each preset partitioning method in sequence according to the calculation order of each preset partitioning method when the current coding block is in the prediction mode during the display stream compression encoding process, until the partitioning evaluation parameters meet the preset requirements and then stop the calculation of the remaining partitioning methods.

[0028] The partitioning method determination module is used to select one of the pre-calculated partitioning methods as the target partitioning method for the prediction mode.

[0029] Thirdly, this application provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor performs the steps of the method described above.

[0030] Fourthly, this application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the method described above.

[0031] Fifthly, this application provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the above-described method.

[0032] The aforementioned method, apparatus, electronic device, and storage medium for determining the display stream partitioning method include: during the display stream compression encoding process, calculating the partitioning evaluation parameters of each preset partitioning method sequentially according to the calculation order of the current encoding block in prediction mode, until the partitioning evaluation parameters meet preset requirements, at which point the calculation of the remaining partitioning methods is stopped; selecting one of the calculated preset partitioning methods as the target partitioning method for the prediction mode, since the partitioning evaluation parameters of each preset partitioning method are calculated sequentially during the selection of the target partitioning method, stopping the calculation when the partitioning evaluation parameters of a certain preset partitioning method meet the preset requirements. The calculation is stopped, and one of the pre-calculated pre-defined partitioning methods is selected as the target partitioning method. The number of pre-calculated pre-defined partitioning methods is definitely no more than the total number of pre-defined partitioning methods. Generally, the number of pre-calculated pre-defined partitioning methods is less than the total number of pre-defined partitioning methods. Therefore, selecting one pre-calculated pre-defined partitioning method as the target partitioning method is less complex than selecting one pre-defined partitioning method as the target partitioning method. This solves the technical problem that the calculation of rate-distortion cost value is required for all partitioning methods, which leads to high complexity in determining the partitioning method of the prediction mode. This reduces the complexity of determining the partitioning method of the prediction mode. Attached Figure Description

[0033] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0034] Figure 1 This is a flowchart illustrating a method for determining the display stream partitioning method in one embodiment;

[0035] Figure 2 This is a flowchart illustrating the method for determining the flow partitioning method in another embodiment;

[0036] Figure 3 This is a schematic diagram of the structure of a device for determining the display stream partitioning method in one embodiment;

[0037] Figure 4 This is a diagram of the internal structure of an electronic device in one embodiment. Detailed Implementation

[0038] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0039] It is understood that the terms "first," "second," etc., used in this application may be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish one element from another. For example, without departing from the scope of this application, a first client may be referred to as a second client, and similarly, a second client may be referred to as a first client. Both the first client and the second client are clients, but they are not the same client.

[0040] refer to Figure 1 , Figure 1 This is a flowchart illustrating a method for determining the display stream partitioning method in one embodiment. In one embodiment, such as... Figure 1 As shown, a method for determining the display stream partitioning method is provided. This embodiment illustrates the application of this method to an electronic device. It is understood that this method can also be applied to a server, and further to a system including both electronic devices and servers, and implemented through the interaction between the electronic device and the server. In this embodiment, steps 110 to 120 of the method are described.

[0041] Step 110: During the display stream compression encoding process, the partitioning evaluation parameters of each preset partitioning method are calculated sequentially according to the calculation order of each preset partitioning method when the current coding block is in prediction mode, until the partitioning evaluation parameters meet the preset requirements and the calculation of the remaining partitioning methods is stopped.

[0042] In this approach, video coding is block-based, dividing a video frame into different blocks, and then encoding each block separately. A coding block refers to the block obtained from dividing a video frame for encoding. The prediction mode refers to the mode used for intra-frame or inter-frame prediction of the current coding block. In this embodiment, the prediction mode is used to determine the partitioning method of the current coding block. For example, an 8x2 coding block will have 16 partitioning methods (an 8x2 coding block consists of four 2x2 regions, and each 2x2 region can be partitioned into either two 2x2 regions or two 2x1 regions). In block prediction, the optimal partitioning method for the coding block needs to be obtained.

[0043] In this step, the calculation order of each preset partitioning method can be the default or related to the probability that the preset partitioning method is the optimal partitioning method. The higher the probability that the preset partitioning method is the optimal partitioning method, the earlier it is calculated. The partitioning evaluation parameters refer to the parameters obtained from calculating the preset partitioning methods. These parameters can be considered as parameters used to evaluate whether it is necessary to continue calculating the remaining partitioning methods. Specifically, the calculation of the remaining partitioning methods stops when the partitioning evaluation parameters meet the preset requirements. The remaining partitioning methods refer to the partitioning methods other than those whose partitioning evaluation parameters have already been calculated.

[0044] For example, there are three preset partitioning methods: A, B, and C. The probability of these being the optimal partitioning methods, from highest to lowest, is as follows: First, the partitioning evaluation parameters for preset partitioning method A are calculated. Then, it is determined whether the partitioning evaluation parameters for preset partitioning method A meet the preset requirements. If they do, the calculation of preset partitioning methods B and C is stopped. If the partitioning evaluation parameters for preset partitioning method A do not meet the preset requirements, the partitioning evaluation parameters for preset partitioning method B are calculated, and then it is determined whether the partitioning evaluation parameters for preset partitioning method B meet the preset requirements. This process continues until the partitioning evaluation parameters for a certain preset partitioning method meet the preset requirements, at which point the calculation of the remaining partitioning methods is stopped.

[0045] Step 120: Select one of the pre-calculated preset partitioning methods as the target partitioning method for the prediction mode.

[0046] In this step, for example, if the partitioning evaluation parameters of preset partitioning method A meet the preset requirements, then preset partitioning method A is used as the target partitioning method of the prediction mode; if the partitioning evaluation parameters of preset partitioning method B meet the preset requirements, then one of preset partitioning method A and preset partitioning method B is used as the target partitioning method of the prediction mode.

[0047] The technical solution of this embodiment, during the display stream compression encoding process, sequentially calculates the partitioning evaluation parameters of each preset partitioning method according to the calculation order of each preset partitioning method in the prediction mode of the current coding block, until the partitioning evaluation parameters meet the preset requirements and then stops the calculation of the remaining partitioning methods; from the calculated preset partitioning methods, one of them is selected as the target partitioning method of the prediction mode. Since the partitioning evaluation parameters of each preset partitioning method are calculated sequentially during the selection of the target partitioning method, and the calculation stops when the partitioning evaluation parameters of a certain preset partitioning method meet the preset requirements, and one of the calculated preset partitioning methods is selected as the target partitioning method, the number of calculated preset partitioning methods is definitely no more than the total number of preset partitioning methods. Generally, the number of calculated preset partitioning methods is less than the total number of preset partitioning methods. Therefore, selecting one from the calculated preset partitioning methods as the target partitioning method has lower complexity compared to selecting one from all preset partitioning methods as the target partitioning method. This solves the technical problem that the calculation of rate-distortion cost values ​​is required for all partitioning methods, resulting in high complexity in determining the partitioning method of the prediction mode, and achieves a reduction in the complexity of determining the partitioning method of the prediction mode. Correspondingly, due to the reduced complexity, the compression encoding is more efficient, improving the real-time performance of the display stream transmission and reducing the energy consumption of the display stream compression standard hardware circuit.

[0048] It should be noted that selecting one of the pre-calculated preset partitioning directions as the target partitioning method can be achieved by calculating the rate-distortion cost of each pre-calculated preset partitioning direction separately and selecting the pre-calculated preset partitioning direction with the smallest rate-distortion cost as the target partitioning direction.

[0049] The following examples illustrate how to determine the calculation order of each preset partitioning method.

[0050] In one possible implementation, the method for determining the display stream partitioning scheme further includes:

[0051] Determine the optimal partitioning method that the current coding block has appeared in the prediction mode;

[0052] The optimal partitioning method that has appeared is taken as the preset partitioning method, and the occurrence frequency of each preset partitioning method is counted.

[0053] The calculation order of each preset division method is determined based on the frequency of occurrence of each preset division method, with the more frequent the occurrence, the earlier the calculation order.

[0054] In one possible implementation, the partitioning evaluation parameters include at least one of the following:

[0055] The sum of the residual losses of each color component of each pixel in the current coding block;

[0056] The sum of the rate-distortion costs of each color component of each pixel in the current coding block.

[0057] Accordingly, the division evaluation parameters meet preset requirements, including:

[0058] At least one of the partitioning evaluation parameters is less than the threshold corresponding to that partitioning evaluation parameter.

[0059] The sum of residual losses refers to the sum of the residual losses of each color component of each pixel. The sum of rate-distortion costs refers to the sum of the rate-distortion costs of each color component of each pixel.

[0060] It should be noted that, alternatively, only one of the preset partitioning evaluation parameters can be calculated, and the calculation of the remaining partitioning methods can be stopped when one of the partitioning evaluation parameters meets the preset requirement; alternatively, all the aforementioned partitioning evaluation parameters can be calculated separately, and the calculation of the remaining partitioning methods can be stopped when one of the partitioning evaluation parameters is less than the corresponding threshold. Optionally, the larger the threshold corresponding to the partitioning evaluation parameter, the easier it is to meet the preset requirement, and therefore the easier it is to stop the calculation, resulting in lower complexity and lower quality of compressed encoding.

[0061] When calculating multiple partitioning evaluation parameters for a preset partitioning method, it is also possible to calculate the (n-1)th partitioning evaluation parameter. If the corresponding threshold is not met, the nth partitioning evaluation parameter is calculated again, until one of the partitioning evaluation parameters is less than the corresponding threshold, where 1 < n ≤ the number of partitioning evaluation parameters.

[0062] For example, in the process of calculating the partitioning evaluation parameters of one of the preset partitioning methods (e.g., preset partitioning method A), the sum of residual losses is first calculated; if the sum of residual losses is greater than or equal to the threshold corresponding to the sum of residual losses, the sum of rate distortion costs is calculated; where, when one of the partitioning evaluation parameters is less than the corresponding threshold, the preset partitioning method is taken as the target partitioning method; when none of the partitioning evaluation parameters meet the corresponding threshold, the calculation of the next preset partitioning method continues.

[0063] It is understandable that when there are multiple partitioning evaluation parameters for a preset partitioning method, the computational load of the partitioning evaluation parameters can be reduced by calculating one partitioning evaluation parameter in sequence and then calculating another partitioning evaluation parameter, thereby further reducing the complexity of determining the partitioning method for the prediction mode.

[0064] It should be noted that the thresholds corresponding to the partitioning evaluation parameters can be adaptively adjusted as needed. For example, different thresholds can be set for different partitioning evaluation parameters for the same preset partitioning method. Specifically, the partitioning parameters when the preset partitioning method is the optimal partitioning method can be statistically analyzed, and these optimal partitioning parameters can be used as the thresholds corresponding to the partitioning evaluation parameters.

[0065] For example, when the preset partitioning method A is the optimal partitioning method, the partitioning parameters of the optimal partitioning method A are calculated, such as the sum of residual losses and the sum of rate distortion costs of the optimal partitioning method A; and the sum of residual losses of the optimal partitioning method A is used as the threshold corresponding to the sum of residual losses of the preset partitioning method A, and the sum of rate distortion costs of the optimal partitioning method A is used as the threshold corresponding to the sum of rate distortion costs of the preset partitioning method A.

[0066] Optionally, different thresholds can be set for the partitioning evaluation parameters of different preset partitioning methods. For example, the threshold corresponding to the partitioning evaluation parameters of preset partitioning method A is different from the threshold corresponding to the partitioning evaluation parameters of preset partitioning method B.

[0067] The following examples, based on any of the above examples, illustrate how to determine each division evaluation parameter.

[0068] In one possible implementation, the partitioning evaluation parameters include the sum of the residual losses, and the calculation of the partitioning evaluation parameters for each preset partitioning method includes:

[0069] Extract the residual pixel value and inverse quantization residual value of each color component of each pixel in the current coding block;

[0070] The sum of the residual losses is determined based on the residual pixel values ​​and the inverse quantization residual values.

[0071] Here, the residual pixel value refers to the residual value of a pixel, which is generally the difference between the predicted value and the current actual value of the pixel. In this embodiment, the residual pixel value refers to the difference between the predicted value and the original value of the pixel. The inverse quantization residual value refers to the value obtained by inverse quantizing the residual pixel value. In this embodiment, the residual pixel value and the inverse quantization residual value can be directly extracted, thereby determining the sum of residual losses based on the residual pixel value and the inverse quantization residual value.

[0072] In one possible implementation, the sum of the residual losses is determined according to the following formula:

[0073]

[0074] in:

[0075] Where M and N are the width and brightness of the coded block, respectively; i and j are the x and y coordinates of the pixel in the coded block, respectively; and k∈{0,1,2} represents the three color components corresponding to the pixel in the coded block. Represents the residual pixel value. This represents the inverse quantization residual value, and D represents the sum of residual losses.

[0076] It should be noted that, generally, each pixel corresponds to three color components: RGB. Therefore, k∈{0,1,2} represents the three color components corresponding to the pixel in the coded block.

[0077] In one possible implementation, the partitioning evaluation parameters include the sum of the rate-distortion costs, and the calculation of the partitioning evaluation parameters for each preset partitioning method includes:

[0078] Extract the rate-distortion cost of each color component of each pixel in the current coding block;

[0079] The sum of the rate-distortion values ​​is determined based on the rate-distortion values ​​of each color component.

[0080] Here, rate-distortion cost refers to the value calculated by performing rate-distortion cost. In this embodiment, the sum of the rate-distortion cost values ​​corresponding to each color component is taken as the sum of the rate-distortion cost values.

[0081] In one possible implementation, each pixel comprises three color components, the sum of which is determined according to the following formula:

[0082]

[0083] Among them, RD k ,k∈{0,1,2} represents the rate-distortion cost, k∈{0,1,2} represents the three color components corresponding to the pixel in the coding block, and RD represents the sum of the rate-distortion costs.

[0084] In this embodiment, the rate-distortion cost can be calculated for a certain preset division method, and the rate-distortion cost of each color component in the current coding block can be extracted to obtain the sum of the rate-distortion costs. Then, it can be determined whether the division evaluation parameters meet the preset requirements. If they do, the calculation can be stopped.

[0085] refer to Figure 2 , Figure 2 This is a flowchart illustrating a method for determining the flow partitioning method in another embodiment. In one embodiment, such as... Figure 2 As shown, the method for determining the flow partitioning method includes steps 210 to 270.

[0086] Step 210: The current coding block enters prediction mode.

[0087] Step 220: Calculate the sum of residual losses for each color component of each pixel in the current coding block of the nth preset partitioning method.

[0088] Generally, n is 1 for the first calculation.

[0089] Step 230: Determine whether the sum of residual losses is less than the corresponding threshold.

[0090] In this step, if the sum of residual losses is less than the corresponding threshold, then step 290 is executed; if the sum of residual losses is greater than or equal to the corresponding threshold, then step 240 is executed.

[0091] Step 240: Calculate the sum of the rate-distortion costs of each color component of each pixel in the current coding block of the nth preset partitioning method.

[0092] This step can be referred to the description of any of the above embodiments, and will not be repeated in this embodiment.

[0093] Step 250: Determine whether the sum of the variances of the predicted residual loss is less than the corresponding threshold.

[0094] In this step, if the sum of rate-distortion costs is less than the corresponding threshold, then step 270 is executed; if the sum of rate-distortion costs is greater than or equal to the corresponding threshold, then step 260 is executed.

[0095] Steps 260 and n+1 are executed, and then the process returns to step 220.

[0096] In this step, if none of the partitioning evaluation parameters of the nth preset partitioning method meet the corresponding threshold, it is necessary to calculate the partitioning evaluation parameters of the next preset partitioning method, so n+1, and return to execute step 220, thereby determining whether the partitioning evaluation parameters of the (n+1)th preset partitioning method meet the preset requirements.

[0097] Step 270: Stop calculating the remaining partitioning methods, and select one of the pre-calculated partitioning methods as the target partitioning method for the prediction mode.

[0098] It should be understood that, although Figure 1-2The steps in the flowchart are shown sequentially as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order in which these steps are executed, and they can be performed in other orders. Figure 1-2 At least some of the steps in the process may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least some of the sub-steps or stages of other steps.

[0099] Based on the same inventive concept, this application also provides a display stream partitioning method determination apparatus for implementing the above-described method for determining display stream partitioning. The solution provided by this apparatus is similar to the implementation described in the above-described method; therefore, the specific limitations in one or more embodiments of the display stream partitioning method determination apparatus provided below can be found in the limitations of the display stream partitioning method determination method described above, and will not be repeated here.

[0100] refer to Figure 3 , Figure 3 This is a schematic diagram of the structure of a device for determining the display stream partitioning method in one embodiment. Figure 3 As shown, the device for determining the flow partitioning method includes a calculation module 310 and a partitioning method determination module 320, wherein:

[0101] The calculation module 310 is used to calculate the partitioning evaluation parameters of each preset partitioning method in sequence according to the calculation order of each preset partitioning method when the current coding block is in the prediction mode during the display stream compression encoding process, until the partitioning evaluation parameters meet the preset requirements and then stop the calculation of the remaining partitioning methods.

[0102] The partitioning method determination module 320 is used to select one of the pre-calculated partitioning methods as the target partitioning method of the prediction mode.

[0103] In one embodiment, the partitioning evaluation parameters include at least one of the following:

[0104] The sum of the residual losses of each color component of each pixel in the current coding block;

[0105] The sum of the rate-distortion costs of each color component of each pixel in the current coding block;

[0106] The partitioning evaluation parameters meet preset requirements, including:

[0107] At least one of the partitioning evaluation parameters is less than the threshold corresponding to that partitioning evaluation parameter.

[0108] In one embodiment, the partitioning evaluation parameters include the sum of the residual losses, and the calculation module 310 includes:

[0109] The first calculation unit is used to extract the residual pixel value and the inverse quantization residual value of each color component of each pixel in the current coding block; and to determine the sum of the residual loss based on the residual pixel value and the inverse quantization residual value.

[0110] In one embodiment, the first computing unit is specifically used for:

[0111]

[0112] in:

[0113] Where M and N are the width and brightness of the coded block, respectively; i and j are the x and y coordinates of the pixel in the coded block, respectively; and k∈{0,1,2} represents the three color components corresponding to the pixel in the coded block. Represents the residual pixel value. This represents the inverse quantization residual value, and D represents the sum of residual losses.

[0114] In one embodiment, the partitioning evaluation parameters include the sum of the rate-distortion costs, and the calculation module 310 includes:

[0115] The second calculation unit is used to extract the rate-distortion value of each color component of each pixel in the current coding block; and to determine the sum of the rate-distortion values ​​based on the rate-distortion values ​​of each color component.

[0116] In one embodiment, each pixel includes three color components, and the second calculation unit is specifically used for:

[0117]

[0118] Among them, RD k ,k∈{0,1,2} represents the rate-distortion cost, k∈{0,1,2} represents the three color components corresponding to the pixel in the coding block, and RD represents the sum of the rate-distortion costs.

[0119] The division of each module in the above-described display stream partitioning method determination device is only for illustrative purposes. In other embodiments, the display stream partitioning method determination device can be divided into different modules as needed to complete all or part of the functions of the above-described display stream partitioning method determination device.

[0120] Specific limitations regarding the device for determining the display stream partitioning method can be found in the limitations of the method for determining the display stream partitioning method described above, and will not be repeated here. Each module in the aforementioned device for determining the display stream partitioning method can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in hardware or independently of the processor in the electronic device, or stored in software in the memory of the electronic device, so that the processor can call and execute the operations corresponding to each module.

[0121] refer to Figure 4 , Figure 4 This is an internal structural diagram of an electronic device in one embodiment. In one embodiment, an electronic device is provided, which may be a terminal, and its internal structural diagram may be as shown below. Figure 4 As shown, the electronic device includes a processor, memory, communication interface, display screen, and input device connected via a system bus. The processor provides computing and control capabilities. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage medium. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, mobile cellular networks, NFC (Near Field Communication), or other technologies. When the computer program is executed by the processor, it implements a method for determining a display stream partitioning mode. The display screen can be a liquid crystal display (LCD) or an e-ink display. The input device can be a touch layer covering the display screen, buttons, a trackball, or a touchpad mounted on the device's casing, or an external keyboard, touchpad, or mouse.

[0122] Those skilled in the art will understand that Figure 4 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the electronic device to which the present application is applied. The specific electronic device may include more or fewer components than shown in the figure, or combine certain components, or have different component arrangements.

[0123] The implementation of each module in the display stream partitioning method determination device provided in this application embodiment can be in the form of a computer program. This computer program can run on an electronic device or a server. The program modules constituted by this computer program can be stored in the memory of the electronic device. When the computer program is executed by a processor, it implements the steps of the method described in the embodiments of this application.

[0124] This application also provides a computer-readable storage medium. One or more non-volatile computer-readable storage media containing computer-executable instructions, which, when executed by one or more processors, cause the processors to perform the steps of a method for determining a display stream partitioning scheme.

[0125] A computer program product containing instructions that, when run on a computer, causes the computer to execute a method for determining the display stream partitioning method.

[0126] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.

[0127] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0128] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A method for determining the display stream partitioning mode, characterized in that, include: During the display stream compression encoding process, the partitioning evaluation parameters of each preset partitioning method are calculated sequentially according to the calculation order of each preset partitioning method when the current coding block is in prediction mode, until the partitioning evaluation parameters meet the preset requirements and the calculation of the remaining partitioning methods is stopped. From the pre-calculated preset partitioning methods, select one as the target partitioning method for the prediction mode; The partitioning evaluation parameters include: The sum of the residual losses of each color component of each pixel in the current coding block; The sum of the rate-distortion costs of each color component of each pixel in the current coding block; The partitioning evaluation parameters meet preset requirements, including: At least one of the partitioning evaluation parameters is less than the threshold corresponding to that parameter; different thresholds are set for different partitioning evaluation parameters of the same preset partitioning method. The calculation of the partitioning evaluation parameters for each preset partitioning method includes: Extract the residual pixel value and inverse quantization residual value of each color component of each pixel in the current coding block; determine the sum of the residual loss based on the residual pixel value and inverse quantization residual value; Extract the rate-distortion value of each color component of each pixel in the current coding block; determine the sum of the rate-distortion values ​​based on the rate-distortion values ​​of each color component; The sum of the residual losses is determined according to the following formula: ;in: ; in, and These represent the width and brightness of the encoded block, respectively. and These are the x and y coordinates of the pixels in the encoded block, respectively. This represents the three color components corresponding to the pixels in the coded block. Represents the residual pixel value. This represents the inverse quantization residual value, and D represents the sum of residual losses; Each pixel comprises three color components, and the sum of the rate-distortion costs is determined according to the following formula: ； in, The value represented by the rate of distortion. It represents the three color components corresponding to the pixel in the coded block, and RD represents the sum of rate-distortion costs; In the process of calculating the partitioning evaluation parameters of one of the preset partitioning methods, the sum of residual losses is first calculated; if the sum of residual losses is greater than or equal to the threshold corresponding to the sum of residual losses, the sum of rate distortion costs is calculated; when one of the partitioning evaluation parameters is less than the corresponding threshold, the preset partitioning method is taken as the target partitioning method; when none of the partitioning evaluation parameters meet the corresponding threshold, the calculation of the next preset partitioning method continues.

2. A module for determining a display stream partitioning method, characterized in that, include: The calculation module is used to calculate the partitioning evaluation parameters of each preset partitioning method in sequence according to the calculation order of each preset partitioning method when the current coding block is in prediction mode during the display stream compression encoding process, until the partitioning evaluation parameters meet the preset requirements and then stop the calculation of the remaining partitioning methods. The partitioning method determination module is used to select one of the pre-calculated partitioning methods as the target partitioning method for the prediction mode. The partitioning evaluation parameters include: The sum of the residual losses of each color component of each pixel in the current coding block; The sum of the rate-distortion costs of each color component of each pixel in the current coding block; The partitioning evaluation parameters meet preset requirements, including: At least one of the partitioning evaluation parameters is less than the threshold corresponding to that parameter; different thresholds are set for different partitioning evaluation parameters of the same preset partitioning method. The computing module includes: The first calculation unit is used to extract the residual pixel value and the inverse quantization residual value of each color component of each pixel in the current coding block; and to determine the sum of the residual loss based on the residual pixel value and the inverse quantization residual value. The first calculation unit is specifically used to determine the sum of the residual losses according to the following formula: ;in: ; in, and These represent the width and brightness of the encoded block, respectively. and These are the x and y coordinates of the pixels in the encoded block, respectively. This represents the three color components corresponding to the pixels in the coded block. Represents the residual pixel value. This represents the inverse quantization residual value, and D represents the sum of residual losses; The computing module also includes: The second calculation unit is used to extract the rate-distortion cost of each color component of each pixel in the current coding block; and to determine the sum of the rate-distortion costs based on the rate-distortion costs of each color component. Each pixel includes three color components, and the second calculation unit is specifically used for: ； in, The value represented by the rate of distortion. It represents the three color components corresponding to the pixel in the coded block, and RD represents the sum of rate-distortion costs; In the process of calculating the partitioning evaluation parameters of one of the preset partitioning methods, the sum of residual losses is first calculated; if the sum of residual losses is greater than or equal to the threshold corresponding to the sum of residual losses, the sum of rate distortion costs is calculated; when one of the partitioning evaluation parameters is less than the corresponding threshold, the preset partitioning method is taken as the target partitioning method; when none of the partitioning evaluation parameters meet the corresponding threshold, the calculation of the next preset partitioning method continues.

3. An electronic device, comprising a memory and a processor, wherein the memory stores a computer program, and when executed by the processor, the computer program causes the processor to perform the steps of the method as described in claim 1.

4. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps of the method as described in claim 1.

5. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method of claim 1.

Images