Multimedia information code rate determination method and device and electronic equipment

Abstract

The embodiment of the invention discloses a multimedia information code rate determination method and device and electronic equipment, and the method comprises the steps: carrying out the motion estimation of a target frame in to-be-processed multimedia information and a reference frame of the target frame, carrying out the classification of each coding block according to the motion estimation result corresponding to each coding block, and obtaining the code rate of the to-be-processed multimedia information; determining the block category of each coding block; classifying each tree coding unit in the target frame according to the block category of the coding block in each tree coding unit, and determining the unit category of each tree coding unit; adjusting a quantization parameter of a static coding block in the static tree coding unit and a quantization parameter of a dynamic coding block in the dynamic tree coding unit, and determining a new quantization parameter of the coding block in each tree coding unit; and determining a code rate corresponding to each coding block based on the new quantization parameter of each coding block. According to the technical scheme provided by the invention, the code rates of the coding blocks in the multimedia information can be automatically determined and reasonably distributed.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a method, device and electronic device for determining a multimedia information bit rate. Background Art

[0002] With the development of computer and Internet technology, there are more and more types of multimedia information, which greatly facilitates people's work and life. Multimedia information generally needs to be encoded before it can be played normally. During the encoding process, the bit rate is an important factor affecting the quality of multimedia information.

[0003] Bit rate refers to the number of data bits transmitted per unit time during data transmission. The higher the bit rate, the faster the data transmission speed. In simple terms, bit rate is the sampling rate. The higher the sampling rate per unit time, the higher the accuracy, and the closer the processed file is to the original file. However, the file size is proportional to the sampling rate, so almost all encoding formats focus on how to use the lowest bit rate to achieve the least distortion. However, things are not always absolute. For example, for an audio, the higher the bit rate, the smaller the compression ratio, the smaller the sound quality loss, and the closer to the sound quality of the sound source. Therefore, how to reasonably allocate bit rates for multimedia information is an important means to improve the quality of multimedia information.

[0004] In the prior art, there are some methods that estimate the impact of the coding distortion of each block in the reference frame on the distortion of the future coding block, thereby estimating the cost of the distortion transmission of the current block and adjusting the bit rate. However, the distortion cannot fully characterize the magnitude of the correlation between frames. This method only considers the impact of the distortion on the future coding block. It is a relatively universal calculation method. However, it may lead to unreasonable bit rate allocation for situations of different complexity in multimedia information, thereby affecting the quality or transmission efficiency of multimedia information.

[0005] Therefore, how to provide a multimedia information bit rate determination solution that can more reasonably determine the bit rate of multimedia information is a technical problem that urgently needs to be solved in the field. Summary of the invention

[0006] The embodiments of this specification provide a method, apparatus, device, storage medium, and computer program product for determining the bit rate of multimedia information, which realize the automatic determination of the bit rate of coding blocks in multimedia information and the reasonable allocation of bit rates in dynamic and static scenes, thereby improving the coding quality and data transmission speed of multimedia information.

[0007] On the one hand, an embodiment of this specification provides a method for determining a multimedia information bit rate, the method comprising:

[0008] Performing motion estimation on a target frame in the multimedia information to be processed and a reference frame of the target frame to obtain motion estimation results corresponding to each coding block in the target frame; wherein the target frame includes a plurality of tree coding units, and each tree coding unit includes a plurality of coding blocks;

[0009] Classifying each coding block according to the motion estimation result corresponding to each coding block, and determining the block category of each coding block, wherein the block category includes: static coding block and dynamic coding block;

[0010] Classifying each tree coding unit in the target frame according to the block category of the coding block in each tree coding unit, and determining the unit category of each tree coding unit, wherein the unit category includes: a static tree coding unit and a dynamic tree coding unit;

[0011] Adjusting the quantization parameters of the static coding blocks in the static tree coding units and the quantization parameters of the dynamic coding blocks in the dynamic tree coding units to determine new quantization parameters of the coding blocks in each tree coding unit;

[0012] The bit rate corresponding to each coding block is determined based on the new quantization parameter of each coding block.

[0013] Another aspect provides a device for determining a multimedia information bit rate, the device comprising:

[0014] A motion estimation module, configured to perform motion estimation on a target frame in the multimedia information to be processed and a reference frame of the target frame, and obtain motion estimation results corresponding to each coding block in the target frame; wherein the target frame includes a plurality of tree coding units, and each tree coding unit includes a plurality of coding blocks;

[0015] A block classification module, used to classify each coding block according to the motion estimation result corresponding to each coding block, and determine the block category of each coding block, wherein the block category includes: static coding block and dynamic coding block;

[0016] A tree coding unit classification module, used to classify each tree coding unit in the target frame according to the block category of the coding block in each tree coding unit, and determine the unit category of each tree coding unit, wherein the unit category includes: static tree coding unit and dynamic tree coding unit;

[0017] A quantization parameter adjustment module, used to adjust the quantization parameters of the static coding blocks in the static tree coding unit and the quantization parameters of the dynamic coding blocks in the dynamic tree coding unit, and determine new quantization parameters of the coding blocks in each tree coding unit;

[0018] The bit rate determination module is used to determine the bit rate corresponding to each coding block based on the new quantization parameter of each coding block.

[0019] Another aspect provides an electronic device, including: a processor;

[0020] a memory for storing instructions executable by the processor;

[0021] The processor is configured to execute the instructions to implement any of the above methods for determining the multimedia information bit rate.

[0022] On the other hand, a computer-readable storage medium is provided. When instructions in the storage medium are executed by a processor of an electronic device, the electronic device can execute any of the above-mentioned methods for determining a multimedia information bit rate.

[0023] On the other hand, a computer program product or a computer program is provided, the computer program product or the computer program includes computer instructions, the computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the multimedia information bit rate determination method provided in the above various optional implementations.

[0024] The multimedia information bit rate determination method, apparatus, device, storage medium, and computer program product provided in the embodiments of this specification have the following technical effects:

[0025] The method for determining the bit rate of multimedia information provided in the embodiment of this specification performs block-level motion estimation on the target frame and its reference frame in the multimedia information to be processed, and calculates the motion estimation results between each coding block in the target frame and the reference frame. Based on the motion estimation results corresponding to the coding blocks, each coding block in the target frame is classified to determine whether each coding block is a static coding block or a dynamic coding block. According to the category of the coding block, the CTU in the target frame is classified, and the CTU is divided into a static CTU and a dynamic CTU, and then the quantization parameter of the static coding block in the static CTU and the quantization parameter QP of the dynamic coding block in the dynamic CTU are adjusted, thereby improving the encoding quality of the entire static CTU and the dynamic CTU. By reasonably adjusting the QP value of the coding block, the automatic adjustment of the bit rate of the coding block is realized, and according to the content of the multimedia information, the bit rate of the static and dynamic scenes is reasonably allocated, ensuring that the overall bit rate of the entire multimedia information is reasonable, thereby improving the quality of the multimedia information and the data transmission speed. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the technical solutions and advantages in the embodiments of this specification or the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0027] Figure 1 It is a schematic diagram of an application environment of a method for determining a multimedia information bit rate provided in an embodiment of this specification;

[0028] Figure 2 It is a flowchart of a method for determining a multimedia information bit rate provided by an embodiment of this specification;

[0029] Figure 3 is a schematic diagram of the frame structure of Gop8 in one embodiment of this specification;

[0030] Figure 4 This is a schematic diagram of the principle flow of determining the video bit rate in a scenario example of this specification;

[0031] Figure 5 It is a structural schematic diagram of a multimedia information bit rate determination device provided in an embodiment of this specification;

[0032] Figure 6 is a block diagram of an electronic device for determining a multimedia information bit rate provided by an embodiment of this specification;

[0033] Figure 7 This is a block diagram of another electronic device for determining the bit rate of multimedia information provided by an embodiment of this specification. DETAILED DESCRIPTION

[0034] The following will be combined with the drawings in the embodiments of this specification to clearly and completely describe the technical solutions in the embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this specification, not all of the embodiments. Based on the embodiments in this specification, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this specification.

[0035] It should be noted that the terms "first", "second", etc. in the description and claims of the embodiments of this specification and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of this specification described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product, or server that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products, or devices.

[0036] See also Figure 1 , Figure 1 1 is a schematic diagram of an application environment of a method for determining a multimedia information bit rate provided in an embodiment of the present specification. The application environment may at least include a server 100 and a terminal 200.

[0037] In an optional embodiment, the server 100 can be used to receive multimedia information sent by the terminal 200, automatically encode the multimedia information, determine the bit rate of the multimedia information, or can also be used to obtain and store multimedia information for use by the terminal 200. The server 100 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms.

[0038] In an optional embodiment, the terminal 200 may be a terminal that sends multimedia information to the server 100, or may encode the multimedia information locally at the terminal as needed to determine the bit rate of the multimedia information. Specifically, the terminal 200 may include but is not limited to smart phones, desktop computers, tablet computers, laptop computers, smart speakers, digital assistants, augmented reality (AR) / virtual reality (VR) devices, smart wearable devices, vehicle terminals, smart TVs and other types of electronic devices; it may also be software running on the above electronic devices, such as applications, applets, etc. The operating system running on the electronic device in the embodiments of this specification may include but is not limited to Android system, IOS system, Linux, Windows, etc.

[0039] In addition, it should be noted that Figure 1What is shown is merely a schematic diagram of an application environment of a method for determining a multimedia information bit rate, and the embodiments of this specification are not limited to the above.

[0040] In the embodiments of this specification, the server 100 and the terminal 200 may be directly or indirectly connected via wired or wireless communication, which is not limited in the embodiments of this specification.

[0041] The multimedia information bit rate determination method in the embodiments of this specification is mainly used to reasonably allocate the bit rates of various multimedia frames and their coding blocks in the multimedia information during the multimedia information encoding process, determine the bit rate of each coding block, and complete the bit rate determination of the multimedia information to improve the quality of the multimedia information and the data transmission speed.

[0042] The following describes a method for determining a multimedia information bit rate according to an embodiment of the present specification. Figure 2 This is a flow chart of a method for determining the multimedia information bit rate provided by an embodiment of this specification. This specification provides method operation steps such as the embodiment or flow chart, but may include more or fewer operation steps based on conventional or non-creative labor. The order of steps listed in the embodiment is only one way of executing the steps among many steps, and does not represent the only execution order. When the actual system or server product is executed, the method sequence shown in the embodiment or the accompanying drawings may be executed or executed in parallel (for example, in a parallel processor or multi-threaded processing environment). The method can be applied to terminal devices such as computers, tablet computers, and smart phones. Of course, it can also be applied to servers according to actual needs, and the embodiments of this specification do not specifically limit this. Specifically, Figure 2 As shown, the method may include:

[0043] S202: Perform motion estimation on a target frame and a reference frame of the target frame in the multimedia information to be processed, and obtain motion estimation results corresponding to each coding block in the target frame; wherein the target frame includes a plurality of tree coding units, and each tree coding unit includes a plurality of coding blocks.

[0044] In the specific implementation process, the multimedia information to be processed can be understood as multimedia information that needs to be encoded, such as video or audio. The multimedia information to be processed in the embodiments of this specification is mainly video. Of course, it can also be selected according to actual needs, and the embodiments of this specification do not make specific limitations. The multimedia information to be processed may include multiple multimedia frames, each of which may include multiple tree coding units, namely CTUs (coding tree units), and each CTU may include multiple coding blocks, wherein the coding block may be understood as the smallest unit of multimedia information, such as a 16×16 coding block. Generally, a frame of video image may be composed of one or more slices (a slice may be understood as a strip), and a slice may be divided into multiple CTU structures, and a CTU may be divided into multiple CUs (coding units), and a CU may be divided into multiple PUs (Prediction Units), and so on. The video frame is cut, and the coding block may be understood as the smallest coding unit in multimedia information (such as video). That is, if the multimedia information to be processed is a video, the video may include multiple video frames, each video frame may include multiple CTUs, and each CTU may include multiple coding blocks.

[0045] When encoding the multimedia information to be processed, the multimedia frames in the multimedia information to be processed can be used as target frames in sequence, such as: first selecting the first multimedia frame as the target frame, first determining the bit rate of the first multimedia frame, then selecting the second multimedia frame as the target frame, determining the bit rate of the second multimedia frame, and so on, until the bit rate of each frame in the multimedia information to be processed is determined. After determining the target frame, motion estimation can be performed on the target frame and the reference frame, and the motion estimation results corresponding to each coding block in the target frame can be calculated. Among them, the reference frame can be understood as a multimedia frame in the multimedia information to be processed that may have an impact on the target frame, such as: the multimedia frame adjacent to the target frame in the multimedia information to be processed can be used as a reference frame, or the multimedia frame other than the target frame in the multimedia information to be processed is a reference frame of the multi-dimensional target frame. A target frame can correspond to one or more reference frames, and the specific selection method of the reference frame can be determined according to actual needs, and the embodiments of this specification do not make specific limitations. When the motion estimation calculation is performed on the target frame and the reference frame, the motion estimation results of each coding block in the target frame and each reference frame can be calculated.

[0046] Motion estimation is a technology widely used in multimedia information encoding and processing (such as video encoding and video processing). The main idea of ​​motion estimation can be understood as dividing multimedia frames (such as video frames) into non-overlapping blocks, assuming that the motion trends of all pixels in the blocks are the same, and then searching for matching blocks in the corresponding reference frames for each block according to the block matching criteria, and obtaining motion vectors through matching blocks and current blocks. The motion estimation algorithm based on block matching finds the best motion vector by searching the pixel domain between two frames according to certain matching criteria. When compressing multimedia information, the current block can be completely restored by simply saving the motion vector and residual data. The specific process of motion estimation for the target frame and the reference frame in the embodiments of this specification can be selected according to actual needs, and the embodiments of this specification do not make specific limitations.

[0047] In some embodiments of the present specification, performing motion estimation on a target frame and each reference frame in the multimedia information to be processed to obtain a motion estimation result corresponding to each coding block in the target frame includes:

[0048] According to the hierarchical relationship of each multimedia frame of the multimedia information to be processed, a multimedia frame having an influence relationship on the target frame is determined, and the multimedia frame having an influence relationship on the target frame is used as a reference frame of the target frame;

[0049] Motion estimation is performed on the target frame and the reference frame to obtain motion estimation results corresponding to each coding block in the target frame.

[0050] In a specific implementation process, generally, there is a certain hierarchical relationship between various multimedia frames in multimedia information. When encoding, generally, high-level multimedia frames need to refer to low-level multimedia frames for encoding. Figure 3 This is a schematic diagram of the frame structure of Gop8 in an embodiment of this specification. Gop (Group of Pictures) can be understood as a group of continuous images, consisting of an I frame (i.e., key frame) and multiple B (bidirectional predictive interpolation coded frames) / P (forward predictive coded frames), which is the basic unit of codec access. Generally, Gop can be understood as the interval between two I frames, strictly speaking, the interval between two IDR frames. Figure 3 As shown, Gop8 can be understood as an image group consisting of 0-8 consecutive frames. In the frame structure of Gop8, each frame is symmetrically distributed. Figure 3 Each vertical line in the image can represent a frame, and the height of the lower end of the vertical line can be understood as the hierarchical relationship between the frames, such as Figure 3 As shown, generally, the first and last frames, i.e. frames 0 and 8, are the lowest level, generally referred to as layer 0, the middle frame, i.e. frame 4, is layer 1, frames 2 and 6 are layer 2, and frames 1, 3, 5, and 7 are layer 3.

[0051] When performing motion estimation, a multimedia frame that has a direct impact on the target frame can be obtained as a reference frame of the target frame based on the hierarchical relationship of each multimedia frame in the multimedia information to be processed. Generally, a high-level multimedia frame will refer to its adjacent low-level multimedia frame, so it can be considered that the low-level multimedia frame adjacent to the high-level multimedia frame has an impact relationship with the high-level multimedia frame, and similarly, the high-level also has an impact relationship with the low-level multimedia frame adjacent to it. For example: Figure 3 In the frame structure of Gop8, the first frame will refer to frames 0 and 2, and similarly, the second frame will refer to frames 0 and 4. When performing motion estimation, the reference frames of frame 1 and frame 2 will be superimposed to indicate that frames 0 and 4 will have an indirect impact on frame 1. In other words, frames 0, 2, and 4 can be used as reference frames for frame 1. In addition, frame 4 will refer to frame 8, and frame 8 can also be used as a reference frame for frame 1. By analogy, frames that have a certain indirect impact relationship with frame 1 can also be selected as reference frames for frame 1. According to actual usage needs, multimedia frames that have a direct or indirect impact relationship with the target frame can be selected as reference frames for the target frame.

[0052] When determining the target frame and the reference frame, the multimedia information to be processed can also be segmented first, such as: dividing the multimedia information to be processed into multiple groups according to a preset segmentation size, performing motion estimation calculations between the multimedia frames in each group, and after the motion estimation calculations within each group are completed, motion estimation calculations can also be performed between the groups. The specific calculation method is not specifically limited in the embodiments of this specification. Generally, when multimedia information is segmented, the preset segmentation size can be larger than the size of a Gop in the multimedia information. The specific segmentation size can be set according to actual needs, and the embodiments of this specification do not specifically limit it.

[0053] After determining the reference frame of the target frame, motion estimation can be performed on the target frame and the reference frame, and the motion estimation results between each coding block in the target frame and each reference frame can be calculated. Among them, each reference frame has an impact on the target frame, so each coding block in the target frame corresponds to a motion estimation result with each reference frame, and the average value of the motion estimation results between a coding block and each reference frame can be used as the motion estimation result corresponding to the coding block. For example: In a scene example, the 0th frame in a video is used as the target frame, and the 1st, 2nd, 4th, and 8th frames are used as the reference frames of the 0th frame. The motion estimation results of the 0th frame and the 1st, 2nd, 4th, and 8th frames are calculated respectively, and the average value mv_cost_avg of the i-th 16x16 block (i.e., the i-th coding block) in the 0th frame can be used as the motion estimation result corresponding to the i-th 16x16 block in the 0th frame. The motion estimation result corresponding to the i-th 16x16 block can be expressed as:

[0054]

[0055] Among them, mv_cost 1-0 (i) can represent the cost value of the motion estimation of frame 1 with reference to frame 0, that is, the motion estimation result of frame 1 for the i-th 16x16 block in frame 0; mv_cost 2-0 (i) can represent the cost value of the motion estimation of the second frame with reference to the zero frame, that is, the motion estimation result of the second frame for the i-th 16x16 block in the zero frame; mv_cost 4-0 (i) can represent the cost value of the motion estimation of the 4th frame with reference to the 0th frame, that is, the motion estimation result of the 4th frame for the i-th 16x16 block in the 0th frame; mv_cost 8-0 (i) may represent the cost value of the motion estimation of the 8th frame with reference to the 0th frame, that is, the motion estimation result of the 8th frame for the i-th 16x16 block in the 0th frame.

[0056] Of course, according to actual needs, the median of the motion estimation results of the coding blocks of each reference frame and the target frame can also be selected as the motion estimation result corresponding to the coding block, or other methods can be used to calculate the motion estimation results between each reference frame and the coding block. The embodiments of this specification do not make specific limitations.

[0057] The embodiments of this specification determine the reference frames that affect the target frame based on the hierarchical relationship between each multimedia frame in the multimedia information, and then perform motion estimation on the target frame and the reference frame, accurately calculate the complexity between each multimedia frame in the multimedia information, thereby laying a data foundation for the subsequent accurate classification of CTUs and improving the accuracy of bit rate determination.

[0058] S204: Classify each coding block according to the motion estimation result corresponding to each coding block, and determine the block category of each coding block. The block category includes: static coding block and dynamic coding block.

[0059] In the specific implementation process, after performing motion estimation on the target frame and the reference frame of the target frame and obtaining the motion estimation results corresponding to each coding block in the target frame, each coding block can be divided into a static coding block or a dynamic coding block according to the motion estimation results of each coding block, that is, the block category corresponding to each coding block is marked. In the embodiment of this specification, the multimedia information is generally a video, and the objects in the video may exist in two states, static and dynamic, and the bit rates required for static and dynamic scenes are likely to be different. Generally, static scenes may require higher bit rates. Motion estimation can estimate the direction and number of pixels of the displacement of the moving object in the multimedia information from the previous frame to the current frame, that is, to obtain the motion vector. It can be seen that the motion estimation results can characterize the displacement of the objects in each coding block in the target frame to a certain extent. In the embodiment of this specification, based on the motion estimation results, the coding blocks in the multimedia frame are divided into static and dynamic, which lays a data foundation for the subsequent more reasonable allocation of bit rates.

[0060] In some embodiments of the present specification, each coding block is classified according to the motion estimation result corresponding to each coding block to determine the block category of each coding block, including:

[0061] If the motion estimation result of the coding block is less than the static block threshold, determining the block category of the coding block as a static coding block;

[0062] If the motion estimation result of the coding block is greater than the dynamic block threshold, the block category of the coding block is determined to be a dynamic coding block.

[0063] In the specific implementation process, a static block threshold and a dynamic block threshold can be pre-set. When the motion estimation result corresponding to a coding block is less than the static block threshold, it can be considered that the displacement of the corresponding object in the coding block may be very small, and it can be determined that the coding block belongs to a static coding block, that is, the block category of the coding block is a static coding block. When the motion estimation result corresponding to a coding block is greater than the dynamic block threshold, it can be considered that the displacement of the corresponding object in the coding block may be relatively large, and it can be determined that the coding block belongs to a dynamic coding block, that is, the block category of the coding block is a dynamic coding block.

[0064] The embodiments of this specification compare the motion estimation results of each coding block with the preset static block threshold and dynamic block threshold, and can quickly and accurately divide each coding block into a static coding block or a dynamic coding block, thereby improving the data processing efficiency of determining the multimedia information bit rate.

[0065] S206: Classify each tree coding unit in the target frame according to the block category of the coding block in each tree coding unit, and determine the unit category of each tree coding unit, where the unit category includes: static tree coding unit and dynamic tree coding unit.

[0066] In the specific implementation process, after determining the block category corresponding to each coding block in the target frame, the tree coding unit, i.e., CTU, can be statically and dynamically classified. Referring to the records of the above embodiments, it can be known that a CTU can contain multiple coding blocks, and the category of each CTU can be determined according to the block category of the coding block in each CTU. For example, if the proportion or number of static coding blocks in a CTU is greater than a preset threshold, the CTU can be considered to be a static CTU, i.e., a static tree coding unit. Of course, other methods can also be used to determine the category of each CTU. For example, if a CTU contains dynamic coding blocks, the CTU is considered to be a dynamic CTU, i.e., a dynamic tree coding unit. The specific classification method of CTU can be set and adjusted according to actual needs, and this specification does not make specific limitations.

[0067] In some embodiments of the present specification, according to the block category of the coding block in each tree coding unit, each tree coding unit in the target frame is classified to determine the unit category of each tree coding unit, including:

[0068] If the proportion of the coding blocks in the tree coding unit being static coding blocks is greater than a preset proportion, the unit category of the tree coding unit is determined to be a static tree coding unit, otherwise, the unit category of the tree coding unit is determined to be a dynamic tree coding unit.

[0069] In a specific implementation process, a preset ratio may be pre-set, and when the ratio of static coding blocks in a CTU is greater than the preset ratio, the CTU may be considered as a static CTU, otherwise, the CTU may be considered as a dynamic CTU. The specific value of the preset ratio may be set according to actual needs, such as 1 / 2 or 1 / 3, etc., and is not specifically limited in the embodiments of this specification.

[0070] The embodiments of this specification classify CTUs based on the ratio of static coding blocks and dynamic coding blocks in a CTU. When the ratio of static coding blocks in a CTU is greater than a preset ratio, it can be considered that the displacement corresponding to the object in the CTU is more likely to be small, that is, the CTU can be classified as a static CTU. Otherwise, it can be considered that the displacement corresponding to the object in the CTU may be relatively large, that is, the CTU can be classified as a dynamic CTU. Based on this, the CTU in the multimedia information can be quickly divided into static CTU or dynamic CTU. Based on the category of CTU, the bit rate of the coding blocks therein can be adjusted in different ways to achieve a reasonable allocation of bit rates for different static and dynamic scenes.

[0071] S208: Adjust the quantization parameters of the static coding blocks in the static tree coding units and the quantization parameters of the dynamic coding blocks in the dynamic tree coding units to determine new quantization parameters of the coding blocks in each tree coding unit.

[0072] In the specific implementation process, after the CTU is classified into static and dynamic, the quantization parameter QP (Quantizer Parameter) of the static coding block or dynamic coding block in each CTU in the target frame can be adjusted respectively. QP reflects the compression of spatial details. The smaller the QP value, the finer the quantization, the higher the image quality, and the longer the generated bit stream. In other words, when the QP is small, most of the details will be retained. When the QP is increased, some details are lost, the bit rate is reduced, but the image distortion is enhanced and the quality is reduced. It can be seen that QP has a close relationship with the bit rate. The bit rate can be adjusted by adjusting the QP value. QP is generally inversely proportional to the bit rate. After the static CTU and the dynamic CTU are divided based on the motion estimation results of the coding block, usually, the static coding block in the static CTU has a greater impact on the static CTU, and other coding blocks in the static CTU have a certain interference with the static CTU, while the dynamic coding block in the dynamic CTU has a greater impact on the dynamic CTU, and other coding blocks in the dynamic CTU have a certain interference with the dynamic CTU. In the embodiment of the present specification, when adjusting the QP of the coding block in the CTU, the QP value of the static coding block in the static CTU can be adjusted, while the dynamic CTU only adjusts the QP value of the dynamic coding block therein, which can improve the encoding quality of the entire static CTU and the dynamic CTU, thereby achieving a reasonable distribution of the bit rates of static scenes and dynamic scenes.

[0073] S210: Determine a bit rate corresponding to each coding block based on a new quantization parameter of each coding block.

[0074] In the specific implementation process, referring to the records of the above embodiments, it can be known that the quantization parameter has a direct impact on the bit rate. After determining the new quantization parameter of each coding block, the bit rate corresponding to each coding block can be determined, and then the bit rate of the target frame can be determined. According to the scheme provided in the embodiments of this specification, the bit rate of the coding block in each multimedia frame in the multimedia information to be processed can be determined, and then the bit rate of the multimedia information can be determined.

[0075] The method for determining the bit rate of multimedia information provided in the embodiment of this specification performs block-level motion estimation on the target frame and its reference frame in the multimedia information to be processed, and calculates the motion estimation results between each coding block in the target frame and the reference frame. Based on the motion estimation results corresponding to the coding blocks, each coding block in the target frame is classified to determine whether each coding block is a static coding block or a dynamic coding block. According to the category of the coding block, the CTU in the target frame is classified, and the CTU is divided into a static CTU and a dynamic CTU, and then the quantization parameter of the static coding block in the static CTU and the quantization parameter QP of the dynamic coding block in the dynamic CTU are adjusted, thereby improving the encoding quality of the entire static CTU and the dynamic CTU. By reasonably adjusting the QP value of the coding block, the automatic adjustment of the bit rate of the coding block is realized, and according to the content of the multimedia information, the bit rate of the static and dynamic scenes is reasonably allocated, ensuring that the overall bit rate of the entire multimedia information is reasonable, thereby improving the quality of the multimedia information and the data transmission speed.

[0076] In some embodiments of the present specification, adjusting the quantization parameters of static coding blocks in the static tree coding unit and the quantization parameters of dynamic coding blocks in the dynamic tree coding unit includes:

[0077] reducing the quantization parameter of the static coding block in the static tree coding unit;

[0078] The quantization parameters of the dynamic coding blocks in the dynamic tree coding unit are increased.

[0079] In the specific implementation process, when adjusting the QP value of the coding block in the static CTU and the dynamic CTU, the QP value of the static coding block in the static CTU can be reduced, while the QP value of the dynamic coding block in the dynamic CTU can be increased. Because the QP value is inversely proportional to the bit rate, such an adjustment can increase the bit rate of the static coding block in the static CTU and reduce the bit rate of the dynamic coding block in the dynamic CTU. Compared with the dynamic coding block, the correlation between the static coding blocks of the previous and next multimedia frames will be stronger, while the correlation between the dynamic coding blocks will be weaker. In other words, compared with the dynamic coding block, the static coding block is more important. Increasing the bit rate of the static coding block in the static CTU can improve the quality of the multimedia information corresponding to the static coding block. If the current static coding block is well coded, the coding block in the subsequent multimedia frame can save the bit rate. The dynamic coding block has a relatively small impact on the subsequent multimedia frames and does not need to spend too much bit rate. Through the method in the embodiment of this specification, the reasonable distribution of the bit rate of the static scene and the dynamic scene can be guaranteed, and the coding quality of the entire multimedia information can be improved.

[0080] In some embodiments of the present specification, adjusting the quantization parameters of static coding blocks in the static tree coding unit and the quantization parameters of dynamic coding blocks in the dynamic tree coding unit includes:

[0081] Multiplying a preset static compensation value weight by a quantization parameter compensation value of a quantization parameter of a dynamic coding block in a dynamic tree coding unit to obtain a new quantization parameter compensation value of a static coding block in a static tree coding unit; the static compensation value weight is less than zero;

[0082] Multiplying a preset dynamic compensation value weight by a quantization parameter compensation value of a quantization parameter of a dynamic coding block in a dynamic tree coding unit to obtain a new quantization parameter compensation value of the dynamic coding block in the dynamic tree coding unit; the dynamic compensation value weight is greater than zero;

[0083] According to the new quantization parameter compensation value of the static coding block in the static tree coding unit and the new quantization parameter compensation value of the dynamic coding block in the dynamic tree coding unit, the new quantization parameter of the coding block in each tree coding unit is determined respectively.

[0084] In the specific implementation process, generally, each coding block will correspond to a QP value and a QP compensation value, that is, a quantization parameter compensation value. The quantization parameter compensation value can be understood as a correction to the QP value. When adjusting the QP value of the coding block in the static CTU and the dynamic CTU, the quantization parameter compensation value in the coding block can be adjusted to achieve the purpose of adjusting the QP value. Specifically, the static compensation value weight and the dynamic compensation value weight can be set first, and the quantization parameter compensation value of the static coding block in the static CTU can be adjusted by using the preset static compensation value weight, and the quantization parameter compensation value of the dynamic coding block in the dynamic CTU can be adjusted by using the preset dynamic compensation value. For example: the quantization parameter compensation value of the static coding block in the static CTU can be multiplied by the static compensation value weight to obtain a new quantization parameter compensation value corresponding to the static coding block. Similarly, the quantization parameter compensation value of the dynamic coding block in the dynamic CTU can be multiplied by the dynamic compensation value weight to obtain a new quantization parameter compensation value corresponding to the dynamic coding block. Of course, according to actual needs, other operations can be performed on the static compensation value weight and the dynamic compensation value weight and the quantization parameter compensation value of the corresponding coding block to adjust the quantization parameter compensation value of the corresponding coding block, such as: the quantization parameter compensation value of the static coding block in the static CTU can be added with the static compensation value weight to obtain a new quantization parameter compensation value corresponding to the static coding block. Similarly, the quantization parameter compensation value of the dynamic coding block in the dynamic CTU can be added with the dynamic compensation value weight to obtain a new quantization parameter compensation value corresponding to the dynamic coding block. The embodiments of this specification do not specifically limit the specific method of adjusting the quantization parameter compensation value of the coding block based on the compensation value weight.

[0085] It should be noted that, usually, the weight of the static compensation value is less than zero, and the weight of the dynamic compensation value is greater than zero, so that based on the compensation value weight, the quantization parameter compensation value of the static coding block in the static CTU can be adjusted to a negative number, and the quantization parameter compensation value of the dynamic coding block in the dynamic CTU can be adjusted to a positive number. Subsequently, based on the new quantization parameter compensation value of the coding block obtained after the adjustment, the quantization parameter of the static coding block in the static CTU can be reduced, and the quantization parameter of the dynamic coding block in the dynamic CTU can be increased, so as to achieve reasonable adjustment of the quantization parameter in static and dynamic scenarios, and then achieve reasonable allocation of bit rate in static and dynamic scenarios.

[0086] Among them, the specific values ​​of the static compensation value weight and the dynamic compensation value weight can be set and adjusted according to actual needs, such as: the static compensation value weight can be set between [-1, -0.5], and the dynamic compensation value weight can be set between [0.5, 1]. Of course, the static compensation value weight and the dynamic compensation value weight can also be set to other values ​​according to actual needs, and the embodiments of this specification do not make specific limitations.

[0087] The embodiments of this specification adjust the quantization parameter compensation values ​​of the static coding blocks and the dynamic coding blocks in the static CTU and the dynamic CTU respectively by setting the static compensation value weight and the dynamic compensation value weight, so as to achieve indirect adjustment of the quantization parameter, and will not significantly change the quantization parameter of the coding block, thereby ensuring the smooth adjustment of the quantization parameter of the coding block, thereby ensuring the rationality of the bit rate allocation of the coding block, and improving the encoding quality of multimedia information.

[0088] In some embodiments of the present specification, according to the new quantization parameter compensation value of the static coding block in the static tree coding unit and the new quantization parameter compensation value of the dynamic coding block in the dynamic tree coding unit, the new quantization parameter of the coding block in each tree coding unit is determined respectively, including:

[0089] The sum of the new quantization parameter compensation value of the static coding block in the static tree coding unit and the quantization parameter of the static coding block is used as the new quantization parameter of the static coding block;

[0090] The sum of the new quantization parameter compensation value of the static coding block in the dynamic tree coding unit and the quantization parameter of the dynamic coding block is used as the new quantization parameter of the dynamic coding block.

[0091] In a specific implementation process, after obtaining a new quantization parameter compensation value of a static coding block in a static CTU based on the compensation value weight, the obtained new quantization parameter compensation value can be added to the quantization parameter in the static coding block to obtain a new quantization parameter of the static coding block. Similarly, after obtaining a new quantization parameter compensation value of a dynamic coding block in a dynamic CTU based on the compensation value weight, the obtained new quantization parameter compensation value can be added to the quantization parameter in the dynamic coding block to obtain a new quantization parameter of the dynamic coding block.

[0092] By adjusting the quantization parameter compensation value of the coding block based on the compensation value weight, and then adding the obtained new quantization parameter compensation value to the quantization parameter of the coding block, the new quantization parameter of the coding block can be quickly obtained, and the quantization parameter of the coding block can be quickly adjusted, thereby realizing automatic adjustment of the coding block bit rate, thereby improving the speed of determining the multimedia information bit rate.

[0093] Figure 4 This is a schematic diagram of the principle flow of determining the video bit rate in a scenario example of this specification, such as Figure 4 As shown, in a scenario example, taking video as multimedia information, the process of determining the bit rate of multimedia information in the embodiment of this specification may include the following process:

[0094] First, the video content is estimated based on motion. Figure 3 Taking the Gop8 frame structure shown in the figure as an example, the motion estimation results of the 0th frame (i.e., the target frame) and the 1st, 2nd, 4th, and 8th frames (i.e., the reference frames) are calculated respectively, and the mean value mv_cost_avg of the i-th 16x16 block (i.e., the coding block) 0 in the 0th frame is obtained, that is, the motion estimation result. The calculation method is shown in the above formula (1).

[0095] Each 16x16 block is classified based on the motion estimation result. The classification basis is shown in formula (2) and formula (3), where thres_static can represent the static block threshold, thres_move can represent the dynamic block threshold, static and move represent static coding blocks and dynamic coding blocks respectively, and Label(i) represents the block category of the i-th 16x16 block.

[0096] Label(i)=static if mv_cost_avg(i) <thres_static (2)

[0097] Label(i)=move if mv_cost_avg(i)> thres_move (3)

[0098] Each CTU is then classified according to the following principle: if the proportion of static 16x16 blocks in the CTU exceeds 1 / 2, the CTU block is classified as a static CTU; if the proportion of dynamic 16x16 blocks in the CTU exceeds 1 / 2, the CTU block is classified as a dynamic CTU.

[0099] For a static CTU, a new delta_qp_static (i.e., quantization parameter compensation value) is updated for the 16x16 block belonging to the static coding block category in the CTU. Similarly, for a dynamic CTU, a new delta_qp_move is updated for the 16x16 block belonging to the dynamic coding block category in the CTU, as shown in formula (4) and formula (5):

[0100] delta_qp_static=weight_static×delta_qp (4)

[0101] delta_qp_move=weight_move×delta_qp (5)

[0102] Among them, weight_static is the static compensation value weight, which can be between [-1, -0.5], weight_move is the dynamic compensation value weight, which can be between [0.5, 1]. delta_qp represents the original quantization parameter compensation value of the 16x16 block.

[0103] Based on the updated quantization parameter compensation value of the coding block, the quantization parameter of the corresponding coding block is adjusted to obtain new quantization parameters corresponding to each coding block. Based on the new quantization parameters, the bit rate of each coding block can be determined, thereby realizing the determination of block-level bit rate in the video.

[0104] It has been verified that, using the multimedia information bit rate determination method provided in the embodiment of this specification, in the MSU (Super-Resolution for Video Compression, a data set for super-resolution tasks) dataset, under the bit rate control of crf (Constant Rate Factor, a constant quality encoding method), the use of this scheme can bring about 0.5% BSQ-rate (a new video coding evaluation criterion) benefits in the case of Gop8; it can bring about 0.3% BSQ-rate benefits in the case of Gop16; it can bring about 0.2% BSQ-rate benefits in the case of Gop32.

[0105] Based on the multimedia information bit rate determination method described above, one or more embodiments of this specification also provide a terminal and a server for multimedia information bit rate determination processing. The terminal and the server may include a device (including a distributed system), software (application), module, component, server, terminal, etc. using the method described in the embodiment of this specification and a device combined with necessary implementation hardware. Based on the same innovative concept, the device in one or more embodiments provided in the embodiment of this specification is as described in the following embodiment. Since the implementation scheme and method of the device to solve the problem are similar, the implementation of the specific device in the embodiment of this specification can refer to the implementation of the aforementioned method, and the repetitions will not be repeated. As used below, the term "unit" or "module" can implement a combination of software and / or hardware of predetermined functions. Although the device described in the following embodiments is preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceived.

[0106] It can be seen from the technical solutions provided in the above embodiments of this specification that the embodiments of this specification also provide a device for determining a multimedia information bit rate. Figure 5 is a schematic diagram of the structure of a multimedia information bit rate determination device provided in an embodiment of this specification, such as Figure 5 As shown, the above device comprises:

[0107] The motion estimation module 510 is used to perform motion estimation on a target frame in the multimedia information to be processed and a reference frame of the target frame to obtain motion estimation results corresponding to each coding block in the target frame; wherein the target frame includes a plurality of tree coding units, and each tree coding unit includes a plurality of coding blocks;

[0108] A block classification module 520 is used to classify each coding block according to the motion estimation result corresponding to each coding block, and determine the block category of each coding block, wherein the block category includes: static coding block and dynamic coding block;

[0109] The tree coding unit classification module 530 is used to classify each tree coding unit in the target frame according to the block category of the coding block in each tree coding unit, and determine the unit category of each tree coding unit, wherein the unit category includes: static tree coding unit and dynamic tree coding unit;

[0110] The quantization parameter adjustment module 540 is used to adjust the quantization parameters of the static coding blocks in the static tree coding unit and the quantization parameters of the dynamic coding blocks in the dynamic tree coding unit to determine new quantization parameters of the coding blocks in each tree coding unit;

[0111] The bit rate determination module 550 is used to determine the bit rate corresponding to each coding block based on the new quantization parameter of each coding block.

[0112] In some embodiments of this specification, the block classification module 520 is specifically used to:

[0113] If the motion estimation result of the coding block is less than the static block threshold, determining that the block category of the coding block is a static coding block;

[0114] If the motion estimation result of the coding block is greater than the dynamic block threshold, it is determined that the block category of the coding block is a dynamic coding block.

[0115] In some embodiments of this specification, the tree coding unit classification module 530 is specifically used to:

[0116] If the proportion of the coding blocks in the tree coding unit being static coding blocks is greater than a preset proportion, the unit category of the tree coding unit is determined to be a static tree coding unit; otherwise, the unit category of the tree coding unit is determined to be a dynamic tree coding unit.

[0117] In some embodiments of this specification, the quantization parameter adjustment module 540 is specifically used to:

[0118] reducing the quantization parameter of the static coding block in the static tree coding unit;

[0119] The quantization parameters of the dynamic coding blocks in the dynamic tree coding unit are increased.

[0120] In some embodiments of this specification, the quantization parameter adjustment module 540 is specifically used to:

[0121] Multiplying a preset static compensation value weight by a quantization parameter compensation value of a quantization parameter of a static coding block in the static tree coding unit to obtain a new quantization parameter compensation value of the static coding block in the static tree coding unit; the static compensation value weight is less than zero;

[0122] multiplying a preset dynamic compensation value weight by a quantization parameter compensation value of a quantization parameter of a dynamic coding block in the dynamic tree coding unit to obtain a new quantization parameter compensation value of the dynamic coding block in the dynamic tree coding unit; the dynamic compensation value weight is greater than zero;

[0123] According to the new quantization parameter compensation value of the static coding block in the static tree coding unit and the new quantization parameter compensation value of the dynamic coding block in the dynamic tree coding unit, the new quantization parameter of the coding block in each tree coding unit is determined respectively.

[0124] In some embodiments of this specification, the quantization parameter adjustment module 540 is specifically used to:

[0125] Taking the sum of a new quantization parameter compensation value of a static coding block in the static tree coding unit and the quantization parameter of the static coding block as a new quantization parameter of the static coding block;

[0126] The sum of the new quantization parameter compensation value of the static coding block in the dynamic tree coding unit and the quantization parameter of the dynamic coding block is used as the new quantization parameter of the dynamic coding block.

[0127] In some embodiments of this specification, the motion estimation module 510 is specifically used for:

[0128] Determining a multimedia frame that has an impact on the target frame according to a hierarchical relationship of each multimedia frame of the multimedia information to be processed, and using the multimedia frame that has an impact on the target frame as a reference frame of the target frame;

[0129] Motion estimation is performed on the target frame and the reference frame to obtain motion estimation results corresponding to each coding block in the target frame.

[0130] Regarding the device in the above embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment of the method, and will not be elaborated in detail here. The device in the above embodiment may also include other implementation methods according to the description of the method embodiment, and the specific implementation method can refer to the description of the relevant method embodiment, which will not be repeated here one by one.

[0131] Figure 6 is a block diagram of an electronic device for determining a multimedia information bit rate provided by an embodiment of this specification. The electronic device may be a terminal, and its internal structure diagram may be as shown in FIG. Figure 6 As shown. The electronic device includes a processor, a memory, a network interface, a display screen and an input device connected via a system bus. Among them, the processor of the electronic device is used to provide computing and control capabilities. The memory of the electronic device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the electronic device is used to communicate with an external terminal via a network connection. When the computer program is executed by the processor, a method for determining a multimedia information bit rate is implemented. The display screen of the electronic device can be a liquid crystal display screen or an electronic ink display screen, and the input device of the electronic device can be a touch layer covering the display screen, or a key, trackball or touchpad provided on the housing of the electronic device, or an external keyboard, touchpad or mouse, etc.

[0132] Figure 7 is a block diagram of another electronic device for determining multimedia information bit rate provided by an embodiment of this specification. The electronic device may be a server, and its internal structure diagram may be as shown in FIG. Figure 7As shown. The electronic device includes a processor, a memory and a network interface connected through a system bus. Among them, the processor of the electronic device is used to provide computing and control capabilities. The memory of the electronic device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the electronic device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a method for determining a multimedia information bit rate is implemented.

[0133] Those skilled in the art will understand that Figure 6 or Figure 7 The structure shown in the figure is merely a block diagram of a portion of the structure related to the embodiment scheme of this specification, and does not constitute a limitation on the electronic device to which the embodiment scheme of this specification is applied. The specific electronic device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0134] In an exemplary embodiment, an electronic device is also provided, including: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to execute the instructions to implement the method for determining a multimedia information bit rate as in the embodiment of this specification.

[0135] In an exemplary embodiment, a computer-readable storage medium is also provided. When instructions in the storage medium are executed by a processor of an electronic device, the electronic device can execute the method for determining a multimedia information bit rate in the embodiment of this specification.

[0136] In an exemplary embodiment, a computer program product or a computer program is also provided, the computer program product or the computer program includes a computer instruction, and the computer instruction is stored in a computer-readable storage medium. The processor of the computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the multimedia information bit rate determination method provided in the above various optional implementations.

[0137] It is understandable that in the specific implementation of this specification, user-related data is involved. When the above embodiments of this specification are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.

[0138] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this specification can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0139] Those skilled in the art will readily appreciate other implementations of the embodiments of the present specification after considering the specification and practicing the invention disclosed herein. The present specification is intended to cover any variations, uses, or adaptations of the embodiments of the present specification, which follow the general principles of the embodiments of the present specification and include common knowledge or customary technical means in the art that are not disclosed in the embodiments of the present specification. The description and embodiments are to be considered merely as exemplary, and the true scope and spirit of the embodiments of the present specification are indicated by the following claims.

[0140] It should be understood that the embodiments of the present specification are not limited to the precise structures described above and shown in the drawings, and various modifications and changes may be made without departing from the scope thereof. The scope of the embodiments of the present specification is limited only by the appended claims.

Claims

1. A method for determining a multimedia information bit rate, characterized in that: The method comprises: Performing motion estimation on a target frame in the multimedia information to be processed and a reference frame of the target frame to obtain motion estimation results corresponding to each coding block in the target frame; wherein the target frame includes a plurality of tree coding units, and each tree coding unit includes a plurality of coding blocks; Classifying each coding block according to the motion estimation result corresponding to each coding block, and determining the block category of each coding block, wherein the block category includes: static coding block and dynamic coding block; Classifying each tree coding unit in the target frame according to the block category of the coding block in each tree coding unit, and determining the unit category of each tree coding unit, wherein the unit category includes: a static tree coding unit and a dynamic tree coding unit; Adjusting the quantization parameters of the static coding blocks in the static tree coding units and the quantization parameters of the dynamic coding blocks in the dynamic tree coding units to determine new quantization parameters of the coding blocks in each tree coding unit; The bit rate corresponding to each coding block is determined based on the new quantization parameter of each coding block.

2. The method according to claim 1, characterized in that The classifying each coding block according to the motion estimation result corresponding to each coding block to determine the block category of each coding block includes: If the motion estimation result of the coding block is less than the static block threshold, determining that the block category of the coding block is a static coding block; If the motion estimation result of the coding block is greater than the dynamic block threshold, it is determined that the block category of the coding block is a dynamic coding block.

3. The method according to claim 1, characterized in that: The classifying each tree coding unit in the target frame according to the block category of the coding block in each tree coding unit to determine the unit category of each tree coding unit includes: If the proportion of the coding blocks in the tree coding unit being static coding blocks is greater than a preset proportion, the unit category of the tree coding unit is determined to be a static tree coding unit; otherwise, the unit category of the tree coding unit is determined to be a dynamic tree coding unit.

4. The method according to claim 1, characterized in that: The adjusting of the quantization parameters of the static coding blocks in the static tree coding unit and the quantization parameters of the dynamic coding blocks in the dynamic tree coding unit includes: reducing the quantization parameter of the static coding block in the static tree coding unit; Increase the quantization parameter of the dynamic coding block in the dynamic tree coding unit.

5. The method according to claim 1, characterized in that The adjusting of the quantization parameters of the static coding blocks in the static tree coding unit and the quantization parameters of the dynamic coding blocks in the dynamic tree coding unit includes: Multiplying a preset static compensation value weight by a quantization parameter compensation value of a quantization parameter of a static coding block in the static tree coding unit to obtain a new quantization parameter compensation value of the static coding block in the static tree coding unit; the static compensation value weight is less than zero; multiplying a preset dynamic compensation value weight by a quantization parameter compensation value of a quantization parameter of a dynamic coding block in the dynamic tree coding unit to obtain a new quantization parameter compensation value of the dynamic coding block in the dynamic tree coding unit; the dynamic compensation value weight is greater than zero; According to the new quantization parameter compensation value of the static coding block in the static tree coding unit and the new quantization parameter compensation value of the dynamic coding block in the dynamic tree coding unit, the new quantization parameter of the coding block in each tree coding unit is determined respectively.

6. The method according to claim 5, characterized in that The determining of new quantization parameters of coding blocks in each tree coding unit respectively according to the new quantization parameter compensation value of the static coding block in the static tree coding unit and the new quantization parameter compensation value of the dynamic coding block in the dynamic tree coding unit includes: Taking the sum of a new quantization parameter compensation value of a static coding block in the static tree coding unit and the quantization parameter of the static coding block as a new quantization parameter of the static coding block; The sum of the new quantization parameter compensation value of the static coding block in the dynamic tree coding unit and the quantization parameter of the dynamic coding block is used as the new quantization parameter of the dynamic coding block.

7. The method according to claim 1, characterized in that The performing motion estimation on the target frame in the multimedia information to be processed and the reference frame of the target frame to obtain the motion estimation results corresponding to each coding block in the target frame includes: Determining a multimedia frame that has an impact on the target frame according to a hierarchical relationship of each multimedia frame of the multimedia information to be processed, and using the multimedia frame that has an impact on the target frame as a reference frame of the target frame; Motion estimation is performed on the target frame and the reference frame to obtain motion estimation results corresponding to each coding block in the target frame.

8. A device for determining a multimedia information bit rate, characterized in that: The device comprises: A motion estimation module, configured to perform motion estimation on a target frame in the multimedia information to be processed and a reference frame of the target frame, and obtain motion estimation results corresponding to each coding block in the target frame; wherein the target frame includes a plurality of tree coding units, and each tree coding unit includes a plurality of coding blocks; A block classification module, used to classify each coding block according to the motion estimation result corresponding to each coding block, and determine the block category of each coding block, wherein the block category includes: static coding block and dynamic coding block; A tree coding unit classification module, used to classify each tree coding unit in the target frame according to the block category of the coding block in each tree coding unit, and determine the unit category of each tree coding unit, wherein the unit category includes: static tree coding unit and dynamic tree coding unit; A quantization parameter adjustment module, used to adjust the quantization parameters of the static coding blocks in the static tree coding unit and the quantization parameters of the dynamic coding blocks in the dynamic tree coding unit, and determine new quantization parameters of the coding blocks in each tree coding unit; The bit rate determination module is used to determine the bit rate corresponding to each coding block based on the new quantization parameter of each coding block.

9. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the method for determining the multimedia information bit rate as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the method for determining a multimedia information bit rate as claimed in any one of claims 1 to 7.

Images