Video coding method and device, electronic equipment, storage medium and program product

Abstract

The embodiment of the invention provides a video coding method and device, electronic equipment, a storage medium and a program product, and relates to the technical fields of video coding and decoding, cloud technologies and the like. The method comprises the following steps: determining a target prediction mode type corresponding to a to-be-coded block in a plurality of prediction mode types based on an angle prediction mode corresponding to the to-be-coded block on which intra-frame prediction is currently to be executed, the plurality of prediction mode types respectively corresponding to different coding block reconstruction mode selection processes, the selection of the reconstruction mode corresponding to the ISP division in the specific direction is skipped in the selection process of the reconstruction mode of each coding block; based on a coding block reconstruction mode selection process corresponding to the target prediction mode type, determining a reconstruction mode corresponding to the to-be-coded block; according to the embodiment of the invention, the method can reduce the calculation complexity in the selection process of the reconstruction mode of the coding block, saves the calculation resources, and achieves the effects of reducing the complexity of a video coding process and accelerating the coding process.

Description

Technical Field

[0001] The present disclosure relates to technical fields such as video coding and decoding, cloud technology, etc. Specifically, the present disclosure relates to a video coding method, device, electronic device, storage medium and program product. Background Art

[0002] ISP (Intra Sub-Partitions) is a coding tool introduced in the intra-frame prediction part of video coding. Conventional encoders typically determine the reconstruction method for a coding block by iterating through three methods: encoding without ISP, using ISP horizontal partitioning, and using ISP vertical partitioning. The rate-distortion performance of these three methods is then compared. The encoding process ultimately retains the method with the best rate-distortion performance. While this method maximizes the encoder's rate-distortion performance, it is computationally very complex. Summary of the Invention

[0003] The purpose of the embodiments of the present disclosure is to solve the problem of high complexity in the video encoding process.

[0004] According to one aspect of an embodiment of the present disclosure, a video encoding method is provided, the method comprising:

[0005] Based on the angular prediction mode corresponding to the block to be coded for the current intra-frame prediction, a target prediction mode type corresponding to the block to be coded is determined from multiple prediction mode types. The multiple prediction mode types correspond to different coding block reconstruction method selection processes. In each coding block reconstruction method selection process, selection of a reconstruction method corresponding to ISP partitioning in a specific direction is skipped;

[0006] Determining a reconstruction method corresponding to the block to be coded based on a coding block reconstruction method selection process corresponding to the target prediction mode type;

[0007] The reconstruction result corresponding to the determined reconstruction method is saved.

[0008] In an optional embodiment, the multiple prediction mode types include a first prediction mode type and a second prediction mode type, the angle prediction mode corresponding to the first prediction mode type tends to a horizontal prediction direction, and the angle prediction mode corresponding to the second prediction mode type tends to a vertical prediction direction;

[0009] The coding block reconstruction method selection process corresponding to the first prediction mode type and the second prediction mode type skips the selection of the reconstruction method corresponding to the ISP division in the same direction.

[0010] In an optional implementation, if the target prediction mode type is the first prediction mode type, determining a reconstruction mode corresponding to the to-be-encoded block based on a coding block reconstruction mode selection process corresponding to the target prediction mode type includes:

[0011] Determine a first rate distortion cost corresponding to a reconstruction method that does not use ISP partitioning;

[0012] Determine the second rate-distortion cost corresponding to the reconstruction method using ISP vertical partitioning;

[0013] The reconstruction mode corresponding to the smaller rate-distortion cost between the first rate-distortion cost and the second rate-distortion cost is determined as the reconstruction mode corresponding to the to-be-coded block.

[0014] In an optional implementation, if the target prediction mode type is the second prediction mode type, determining a reconstruction mode corresponding to the to-be-encoded block based on a coding block reconstruction mode selection process corresponding to the target prediction mode type includes:

[0015] Determine the third rate distortion cost corresponding to the reconstruction method without ISP partitioning;

[0016] Determine the fourth rate distortion cost corresponding to the reconstruction method using ISP horizontal partitioning;

[0017] The reconstruction mode corresponding to the smaller rate-distortion cost between the third rate-distortion cost and the fourth rate-distortion cost is determined as the reconstruction mode corresponding to the to-be-coded block.

[0018] In an optional embodiment, the multiple prediction mode types include a third prediction mode type and a fourth prediction mode type, the angle prediction mode corresponding to the third prediction mode type is biased towards a horizontal prediction direction, and the angle prediction mode corresponding to the fourth prediction mode type is biased towards a vertical prediction direction;

[0019] Among them, in the coding block reconstruction method selection process corresponding to the third prediction mode type and the fourth prediction mode type, when the rate-distortion cost corresponding to the reconstruction method without using ISP division is less than a predetermined multiple of the rate-distortion cost corresponding to the reconstruction method using ISP division, the selection of the reconstruction method of the biased direction ISP division is skipped.

[0020] In an optional implementation, if the target prediction mode type is the third prediction mode type, determining a reconstruction mode corresponding to the to-be-encoded block based on a coding block reconstruction mode selection process corresponding to the target prediction mode type includes:

[0021] Determine the fifth rate distortion cost corresponding to the reconstruction method without ISP partitioning;

[0022] Determine the sixth rate distortion cost corresponding to the reconstruction method using ISP vertical partitioning;

[0023] determining whether the fifth rate-distortion cost is less than a predetermined multiple of the sixth rate-distortion cost;

[0024] If not, determine the seventh rate distortion cost corresponding to the reconstruction method using ISP horizontal division;

[0025] If yes, determining the seventh rate-distortion cost as a first value, the first value being greater than the fifth rate-distortion cost and / or the sixth rate-distortion cost;

[0026] The reconstruction mode corresponding to the smaller rate-distortion cost among the fifth rate-distortion cost, the sixth rate-distortion cost, and the seventh rate-distortion cost is determined as the reconstruction mode corresponding to the block to be encoded.

[0027] In an optional implementation, if the target prediction mode type is the fourth prediction mode type, determining a reconstruction mode corresponding to the to-be-encoded block based on a coding block reconstruction mode selection process corresponding to the target prediction mode type includes:

[0028] Determine the eighth rate distortion cost corresponding to the reconstruction method without ISP partitioning;

[0029] Determine the ninth rate distortion cost corresponding to the reconstruction method using ISP horizontal partitioning;

[0030] determining whether the eighth rate-distortion cost is less than a predetermined multiple of the ninth rate-distortion cost;

[0031] If not, determine the tenth rate-distortion cost corresponding to the reconstruction method using ISP vertical partitioning;

[0032] If so, determining the tenth rate-distortion cost as a second value, the second value being greater than the eighth rate-distortion cost and / or the ninth rate-distortion cost;

[0033] The reconstruction mode corresponding to the smaller rate-distortion cost among the eighth rate-distortion cost, the ninth rate-distortion cost, and the tenth rate-distortion cost is determined as the reconstruction mode corresponding to the block to be encoded.

[0034] In an optional embodiment, the multiple prediction mode types further include a fifth prediction mode type, and the fifth prediction mode type corresponds to a non-directional prediction mode;

[0035] If the target prediction mode type is the fifth prediction mode type, determining a reconstruction mode corresponding to the to-be-encoded block based on a coding block reconstruction mode selection process corresponding to the target prediction mode type includes:

[0036] Determine the eleventh rate-distortion cost corresponding to the reconstruction method without ISP partitioning;

[0037] Determine the 12th rate distortion cost corresponding to the reconstruction method using ISP horizontal partitioning;

[0038] Determine the 13th rate-distortion cost corresponding to the reconstruction method using ISP vertical partitioning;

[0039] The reconstruction mode corresponding to the smaller rate-distortion cost among the eleventh rate-distortion cost, the twelfth rate-distortion cost, and the thirteenth rate-distortion cost is determined as the reconstruction mode corresponding to the block to be encoded.

[0040] In an optional embodiment, the first prediction mode type includes angle prediction modes with mode numbers 14 to 22; and / or,

[0041] The second prediction mode type includes angular prediction modes with mode numbers 46 to 54.

[0042] In an optional embodiment, the third prediction mode type includes angle prediction modes with mode numbers 2 to 13 and 23 to 34; and / or,

[0043] The fourth prediction mode type includes angle prediction modes with mode numbers 35 to 45 and 55 to 66.

[0044] In an optional implementation, the fifth prediction mode type includes a DC prediction mode and a planar prediction mode.

[0045] According to another aspect of the embodiments of the present disclosure, a video encoding apparatus is provided, the apparatus including:

[0046] A prediction mode type determination module is used to determine a target prediction mode type corresponding to a block to be coded from multiple prediction mode types based on the angular prediction mode corresponding to the block to be coded for the current intra-frame prediction. The multiple prediction mode types correspond to different coding block reconstruction method selection processes. In each coding block reconstruction method selection process, the selection of a reconstruction method corresponding to the ISP partitioning in a specific direction is skipped.

[0047] A reconstruction method determination module is used to determine a reconstruction method corresponding to the block to be coded based on a coding block reconstruction method selection process corresponding to a target prediction mode type;

[0048] The saving module is used to save the reconstruction result corresponding to the determined reconstruction method.

[0049] In an optional embodiment, the multiple prediction mode types include a first prediction mode type and a second prediction mode type, the angle prediction mode corresponding to the first prediction mode type tends to a horizontal prediction direction, and the angle prediction mode corresponding to the second prediction mode type tends to a vertical prediction direction;

[0050] The coding block reconstruction method selection process corresponding to the first prediction mode type and the second prediction mode type skips the selection of the reconstruction method corresponding to the ISP division in the same direction.

[0051] In an optional implementation, if the target prediction mode type is the first prediction mode type, the reconstruction mode determination module, when determining the reconstruction mode corresponding to the to-be-encoded block based on the encoding block reconstruction mode selection process corresponding to the target prediction mode type, is specifically configured to:

[0052] Determine a first rate distortion cost corresponding to a reconstruction method that does not use ISP partitioning;

[0053] Determine the second rate-distortion cost corresponding to the reconstruction method using ISP vertical partitioning;

[0054] The reconstruction mode corresponding to the smaller rate-distortion cost between the first rate-distortion cost and the second rate-distortion cost is determined as the reconstruction mode corresponding to the to-be-coded block.

[0055] In an optional implementation, if the target prediction mode type is the second prediction mode type, the reconstruction mode determination module, when used to determine the reconstruction mode corresponding to the to-be-encoded block based on the encoding block reconstruction mode selection process corresponding to the target prediction mode type, is specifically configured to:

[0056] Determine the third rate distortion cost corresponding to the reconstruction method without ISP partitioning;

[0057] Determine the fourth rate distortion cost corresponding to the reconstruction method using ISP horizontal partitioning;

[0058] The reconstruction mode corresponding to the smaller rate-distortion cost between the third rate-distortion cost and the fourth rate-distortion cost is determined as the reconstruction mode corresponding to the to-be-coded block.

[0059] In an optional embodiment, the multiple prediction mode types include a third prediction mode type and a fourth prediction mode type, the angle prediction mode corresponding to the third prediction mode type is biased towards a horizontal prediction direction, and the angle prediction mode corresponding to the fourth prediction mode type is biased towards a vertical prediction direction;

[0060] Among them, in the coding block reconstruction method selection process corresponding to the third prediction mode type and the fourth prediction mode type, when the rate-distortion cost corresponding to the reconstruction method without using ISP division is less than a predetermined multiple of the rate-distortion cost corresponding to the reconstruction method using ISP division, the selection of the reconstruction method of the biased direction ISP division is skipped.

[0061] In an optional implementation, if the target prediction mode type is the third prediction mode type, the reconstruction mode determination module, when determining the reconstruction mode corresponding to the to-be-encoded block based on the encoding block reconstruction mode selection process corresponding to the target prediction mode type, is specifically configured to:

[0062] Determine the fifth rate distortion cost corresponding to the reconstruction method without ISP partitioning;

[0063] Determine the sixth rate distortion cost corresponding to the reconstruction method using ISP vertical partitioning;

[0064] determining whether the fifth rate-distortion cost is less than a predetermined multiple of the sixth rate-distortion cost;

[0065] If not, determine the seventh rate distortion cost corresponding to the reconstruction method using ISP horizontal division;

[0066] If yes, determining the seventh rate-distortion cost as a first value, the first value being greater than the fifth rate-distortion cost and / or the sixth rate-distortion cost;

[0067] The reconstruction mode corresponding to the smaller rate-distortion cost among the fifth rate-distortion cost, the sixth rate-distortion cost, and the seventh rate-distortion cost is determined as the reconstruction mode corresponding to the block to be encoded.

[0068] In an optional implementation, if the target prediction mode type is the fourth prediction mode type, the reconstruction mode determination module, when used to determine the reconstruction mode corresponding to the to-be-encoded block based on the encoding block reconstruction mode selection process corresponding to the target prediction mode type, is specifically configured to:

[0069] Determine the eighth rate distortion cost corresponding to the reconstruction method without ISP partitioning;

[0070] Determine the ninth rate distortion cost corresponding to the reconstruction method using ISP horizontal partitioning;

[0071] determining whether the eighth rate-distortion cost is less than a predetermined multiple of the ninth rate-distortion cost;

[0072] If not, determine the tenth rate-distortion cost corresponding to the reconstruction method using ISP vertical partitioning;

[0073] If so, determining the tenth rate-distortion cost as a second value, the second value being greater than the eighth rate-distortion cost and / or the ninth rate-distortion cost;

[0074] The reconstruction mode corresponding to the smaller rate-distortion cost among the eighth rate-distortion cost, the ninth rate-distortion cost, and the tenth rate-distortion cost is determined as the reconstruction mode corresponding to the block to be encoded.

[0075] In an optional embodiment, the multiple prediction mode types further include a fifth prediction mode type, and the fifth prediction mode type corresponds to a non-directional prediction mode;

[0076] If the target prediction mode type is the fifth prediction mode type, determining a reconstruction mode corresponding to the to-be-encoded block based on a coding block reconstruction mode selection process corresponding to the target prediction mode type includes:

[0077] Determine the eleventh rate-distortion cost corresponding to the reconstruction method without ISP partitioning;

[0078] Determine the 12th rate distortion cost corresponding to the reconstruction method using ISP horizontal partitioning;

[0079] Determine the 13th rate-distortion cost corresponding to the reconstruction method using ISP vertical partitioning;

[0080] The reconstruction mode corresponding to the smaller rate-distortion cost among the eleventh rate-distortion cost, the twelfth rate-distortion cost, and the thirteenth rate-distortion cost is determined as the reconstruction mode corresponding to the block to be encoded.

[0081] In an optional embodiment, the first prediction mode type includes angle prediction modes with mode numbers 14 to 22; and / or,

[0082] The second prediction mode type includes angular prediction modes with mode numbers 46 to 54.

[0083] In an optional embodiment, the third prediction mode type includes angle prediction modes with mode numbers 2 to 13 and 23 to 34; and / or,

[0084] The fourth prediction mode type includes angle prediction modes with mode numbers 35 to 45 and 55 to 66.

[0085] In an optional implementation, the fifth prediction mode type includes a DC prediction mode and a planar prediction mode.

[0086] According to another aspect of an embodiment of the present disclosure, an electronic device is provided. The electronic device includes: a memory, a processor, and a computer program stored in the memory. The processor executes the computer program to implement the video encoding method provided by the embodiment of the present disclosure.

[0087] According to another aspect of the embodiments of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the video encoding method provided by the embodiments of the present disclosure is implemented.

[0088] According to another aspect of an embodiment of the present disclosure, a computer program product is provided, including a computer program, which implements the video encoding method provided by the embodiment of the present disclosure when the computer program is executed by a processor.

[0089] The video encoding method, apparatus, electronic device, storage medium and program product provided by the embodiments of the present disclosure determine the target prediction mode type corresponding to the block to be encoded from a plurality of prediction mode types based on the angle prediction mode corresponding to the block to be encoded for the current intra-frame prediction to be performed. The plurality of prediction mode types correspond to different coding block reconstruction method selection processes, and the selection of the reconstruction method corresponding to the ISP division in a specific direction is skipped in each coding block reconstruction method selection process; the reconstruction method corresponding to the block to be encoded is determined based on the coding block reconstruction method selection process corresponding to the target prediction mode type; and the reconstruction result corresponding to the determined reconstruction method is saved. That is, the embodiments of the present disclosure can skip the selection of the reconstruction method corresponding to the ISP division in a specific direction in the corresponding coding block reconstruction method selection process, thereby reducing the computational complexity in the coding block reconstruction method selection process and saving computing resources, thereby achieving the effect of reducing the complexity of the video encoding process and accelerating the encoding process. BRIEF DESCRIPTION OF THE DRAWINGS

[0090] Figure 1 A schematic diagram of a data processing system for a video encoding method according to an embodiment of the present disclosure;

[0091] Figure 2 A schematic diagram of a video encoding method according to an embodiment of the present disclosure;

[0092] Figure 3 A schematic diagram of various intra-frame prediction modes of VVC provided in an embodiment of the present disclosure;

[0093] Figure 4 A schematic diagram of a coding block reconstruction method selection process corresponding to a first prediction mode type and a second prediction mode type provided by an embodiment of the present disclosure;

[0094] Figure 5 A schematic diagram of a coding block reconstruction method selection process corresponding to a third prediction mode type and a fourth prediction mode type provided in an embodiment of the present disclosure;

[0095] Figure 6 A schematic diagram of a coding block reconstruction method selection process corresponding to a fifth prediction mode type provided in an embodiment of the present disclosure;

[0096] Figure 7 A schematic diagram of a complete coding block reconstruction method selection process provided by an embodiment of the present disclosure;

[0097] Figure 8a A schematic diagram of a reconstruction situation without using ISP provided in an embodiment of the present disclosure;

[0098] Figure 8b A schematic diagram of four-level ISP partitioning provided in an embodiment of the present disclosure;

[0099] Figure 8c A schematic diagram of a four-partition ISP vertical partitioning according to an embodiment of the present disclosure;

[0100] Figure 8d A schematic diagram of ISP level 2 partitioning provided in an embodiment of the present disclosure;

[0101] Figure 8e A schematic diagram of a vertical two-partition ISP provided in an embodiment of the present disclosure;

[0102] Figure 9 A schematic structural diagram of a video encoding device provided in an embodiment of the present disclosure;

[0103] Figure 10 A schematic structural diagram of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0104] The following describes embodiments of the present disclosure in conjunction with the accompanying drawings. It should be understood that the embodiments described below in conjunction with the accompanying drawings are exemplary descriptions for explaining the technical solutions of the embodiments of the present disclosure and do not constitute a limitation on the technical solutions of the embodiments of the present disclosure.

[0105] Those skilled in the art will understand that, unless otherwise stated, the singular forms "a", "an", and "the" used herein may also include plural forms. It should be further understood that the terms "including" and "comprising" used in the embodiments of the present disclosure mean that the corresponding features can be implemented as the presented features, information, data, steps, operations, elements and / or components, but do not exclude implementation as other features, information, data, steps, operations, elements, components and / or combinations thereof supported by the present technical field. It should be understood that when we say that an element is "connected" or "coupled" to another element, the element can be directly connected or coupled to the other element, or it can refer to the element and the other element establishing a connection relationship through an intermediate element. In addition, the "connection" or "coupling" used here can include wireless connection or wireless coupling. The term "and / or" used here indicates at least one of the items defined by the term, for example, "A and / or B" or "A, B" indicates implementation as "A", or implementation as "B", or implementation as "A and B".

[0106] In order to make the objectives, technical solutions and advantages of the present disclosure more clear, the embodiments of the present disclosure will be further described in detail below with reference to the accompanying drawings.

[0107] First, the technical terms involved in this disclosure are introduced and explained:

[0108] (1) H.266: Also known as VVC (Versatile Video Coding), it is the latest generation coding standard finalized in 2020. As the latest generation coding standard, H.266 / VVC has a bit rate of only about 50% of the previous generation standard HEVC (High Efficiency Video Coding) at the same subjective quality. It is of great help to the current massive video business data because the same quality video stream can use less storage space and less bandwidth.

[0109] (2) ISP: Intra Sub-Partitions, a coding tool supported by the H.266 / VVC coding standard, can be used in the intra prediction part. When ISP is not used, all pixels in a prediction block are predicted based on the reference pixels at the block boundary, which also leads to the problem that some pixels far from the boundary may have poor prediction effects (large residuals) due to weak correlation. The ISP processing method is to divide a prediction block into several sub-blocks for prediction. The reference pixel of each pixel is not necessarily the reference pixel at the boundary, but may also be a reconstructed pixel at the boundary of an adjacent sub-block. Since a reference pixel may use a reconstructed pixel closer to it as a reference pixel after using ISP, it can bring better prediction effects, obtain residuals closer to zero, and thus obtain better rate-distortion performance.

[0110] While H.266 / VVC reduces storage and bandwidth requirements, its encoding complexity increases several times. This is because the new standard introduces more complex encoding tools. For example, when using the ISP encoding tool, there's no intuitive basis for deciding whether to split a coding block into several sub-blocks for prediction and reconstruction, and which direction of division provides the best performance. This decision depends on both the coding block and the reference pixel distribution. The encoder typically tries various possible approaches sequentially and compares rate-distortion performance before making a final decision, which also introduces significant coding complexity.

[0111] Considering that high encoding complexity means more computing resources and longer encoding time, for low-latency services such as live streaming, high encoding complexity directly reduces the user experience. Therefore, it is very important to preserve the compression performance of H.266 as much as possible while reducing its encoding complexity.

[0112] Based on this, in order to solve the problem of high complexity of the VVC encoding process, the embodiment of the present disclosure provides a video encoding method, which can also be understood as a method for quickly determining the direction of intra-frame coding sub-block division. During the judgment process, according to the angle prediction mode and the principle of ISP, ISP encoding in certain directions can be skipped to achieve the effect of simplifying the encoding, thereby accelerating the encoding process and saving computing resources.

[0113] The following describes several exemplary embodiments to illustrate the technical solutions of the embodiments of the present disclosure and the technical effects produced by the technical solutions of the present disclosure. It should be noted that the following embodiments can refer to, draw on, or combine with each other, and the same terms, similar features, and similar implementation steps in different embodiments will not be repeated.

[0114] First, combine Figure 1 The data processing system suitable for implementing the video encoding method provided by the embodiment of the present disclosure is introduced. Figure 1 As shown, the data processing system 10 may include an encoding device 101 and a decoding device 102. The encoding device 101 may be a terminal or a server, and the decoding device 102 may be a terminal or a server. A communication connection may be established between the encoding device 101 and the decoding device 102. The terminal device may be a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart wearable device (such as a watch, glasses, etc.), a smart TV, a smart speaker, a car terminal, a personal digital assistant, a portable multimedia player, a navigation device, etc., but is not limited thereto. The server may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. For ease of explanation, the embodiments of the present disclosure do not distinguish between encoding devices and encoding terminals, and similarly do not distinguish between decoding devices and decoding terminals.

[0115] (1) For the encoding device 101:

[0116] The encoding device 101 can obtain data to be encoded, for example, through scene capture or device generation, but not limited to these. Scene capture of data to be encoded refers to obtaining data to be encoded by capturing a real visual scene using a capture device associated with the encoding device 101. The capture device is used to provide encoding device 101 with data acquisition services to be encoded. The capture device may include, but is not limited to, any of the following: a camera, a sensor, or a scanning device. Cameras may include standard cameras, stereo cameras, and light field cameras, while sensors may include lasers, radars, and scanning devices. A capture device associated with the encoding device 101 may refer to a hardware component within the encoding device 101, such as a terminal camera or sensor. It may also refer to a hardware device connected to the encoding device 101, such as a camera connected to a server. Device generation of data to be encoded refers to data to be encoded generated by the encoding device 101 for a target object.

[0117] After obtaining the data to be encoded, encoding device 101 can encode the data to obtain a code stream. Specifically, encoding device 101 can employ the technical solutions provided by the embodiments of the present disclosure during the encoding process. After encoding the compressed code stream of the data to be encoded, encoding device 101 transmits the code stream data to decoding device 102.

[0118] (2) For the decoding device 102:

[0119] After receiving the compressed code stream transmitted by the encoding device 101, the decoding device 102 can decode the compressed code stream and present the data before encoding based on the decoding result.

[0120] It can be understood that the data processing system described in the embodiment of the present disclosure is for the purpose of more clearly illustrating the technical solution of the embodiment of the present disclosure, and does not constitute a limitation on the technical solution provided by the embodiment of the present disclosure. With the evolution of the system architecture and the emergence of new business scenarios, the technical solution provided by the embodiment of the present disclosure is also applicable to similar technical problems.

[0121] Based on the relevant description of the data processing system, the video encoding method provided by the embodiment of the present disclosure is introduced in more detail below.

[0122] See also Figure 2 , is a video encoding method provided by an embodiment of the present disclosure, which can be executed by a computer device, which can be specifically Figure 1 The encoding device 101 in the data processing system 10 shown in FIG. 1 may optionally include an encoder. Figure 2 As shown, the method includes:

[0123] S201: Based on the angular prediction mode corresponding to the block to be coded for the current intra-frame prediction, a target prediction mode type corresponding to the block to be coded is determined from multiple prediction mode types. The multiple prediction mode types correspond to different coding block reconstruction mode selection processes. In each coding block reconstruction mode selection process, selection of a reconstruction mode corresponding to ISP partitioning in a specific direction is skipped.

[0124] In the embodiment of the present disclosure, the block to be encoded on which intra-frame prediction is currently to be performed refers to an image block on which intra-frame prediction is currently to be performed during the encoding process, and may also be referred to as a current block.

[0125] In the disclosed embodiments, there is no limitation on the specific method for obtaining / determining the blocks to be encoded, and any video encoding technology may be used. For example, each frame of the video stream to be encoded (or each frame after sampling / decimation) may be encoded sequentially or in parallel according to a predetermined strategy. The frame currently being encoded is the current frame, and the current frame may be divided into a number of coding blocks (CBs), which are then encoded sequentially according to a predetermined sequence.

[0126] In the embodiment of the present disclosure, the angular prediction mode is also called the directional prediction mode, which is used to adapt to textures in different directions in the video content. Figure 3 As shown in FIG, the intra-frame prediction modes that can use ISP include 65 angular prediction modes (mode numbers 2 to 66), a DC mode (mode number 1), and a planar mode (mode number 0), for a total of 67. It is understandable that the video coding method provided in the embodiment of the present disclosure can also be applied to other coding standards, such as HEVC, and the type and number of angular prediction modes can be based on the actual coding standard adopted, and the embodiment of the present disclosure does not limit them here.

[0127] In the embodiment of the present disclosure, the angular prediction modes that can be used for intra-frame prediction are divided into multiple prediction mode types, wherein, according to the intra-frame prediction direction and the ISP principle, the multiple prediction mode types correspond to different coding block reconstruction method selection processes, and the selection of the reconstruction method corresponding to the ISP division in a specific direction will be skipped in each coding block reconstruction method selection process, wherein, for different coding block reconstruction method selection processes, the ISP division in a specific direction may refer to ISP horizontal division or ISP vertical division, etc. That is, when determining the reconstruction method of a block to be coded, the embodiment of the present disclosure does not need to traverse the three methods of coding without using ISP, using ISP horizontal division, and using ISP vertical division, but accordingly skips the selection of one of the methods, so as to simplify the coding, thereby accelerating the coding process and saving computing resources.

[0128] For the embodiment of the present disclosure, based on the angle prediction mode corresponding to the block to be encoded for the current intra-frame prediction, it is possible to determine which prediction mode type the block to be encoded is divided into among multiple prediction mode types, which can be used as the target prediction mode type, and the corresponding encoding block reconstruction method selection process is selected for processing.

[0129] S202: Determine a reconstruction method corresponding to the block to be coded based on a coding block reconstruction method selection process corresponding to the target prediction mode type;

[0130] In the embodiment of the present disclosure, based on the coding block reconstruction method selection process corresponding to the target prediction mode type, after skipping the selection of the reconstruction method corresponding to the ISP division in a specific direction, the rate-distortion costs (RD cost) of the remaining reconstruction methods are compared, and finally the reconstruction method with the best rate-distortion performance is retained as the reconstruction method corresponding to the block to be coded.

[0131] S203: Save the reconstruction result corresponding to the determined reconstruction method.

[0132] In the embodiment of the present disclosure, the determined reconstruction method does not include the reconstruction method corresponding to the skipped ISP division in the specific direction, but the reliability of the selection can still be guaranteed.

[0133] The solution provided by the embodiments of the present disclosure can be applied to any application scenario with encoding requirements. For example, it can be a video that needs to be encoded in any application scenario, such as short videos, film and television videos, etc. The video can be real-time video, such as live video, online conference video, online call video, etc., or it can be non-real-time video, such as recorded video, video on a video website (such as a video in a video database of an application that provides video viewing services), etc.

[0134] The video encoding method provided by the embodiment of the present disclosure can skip the selection of the reconstruction method corresponding to the ISP division in a specific direction during the selection process of the corresponding coding block reconstruction method, thereby reducing the computational complexity in the selection process of the coding block reconstruction method and saving computing resources, thereby achieving the effect of reducing the complexity of the video encoding process and accelerating the encoding process.

[0135] The embodiment of the present disclosure provides a feasible implementation method, wherein the multiple prediction mode types include a first prediction mode type and a second prediction mode type. The angle prediction mode corresponding to the first prediction mode type tends to be in the horizontal prediction direction, and the angle prediction mode corresponding to the second prediction mode type tends to be in the vertical prediction direction. For example, see Figure 3Among the angular prediction modes, the distribution of prediction modes tending toward the horizontal direction and the vertical direction is more dense, while the distribution in other directions is more sparse. In the disclosed embodiment, the prediction modes with higher density in the horizontal direction and the vertical direction can be used as the first prediction mode type and the second prediction mode type, respectively.

[0136] In the embodiment of the present disclosure, the process of selecting the reconstruction method of the coding block corresponding to the first prediction mode type and the second prediction mode type skips the selection of the reconstruction method corresponding to the ISP division in the same direction.

[0137] This is because, for the angular prediction modes of the first prediction mode type and the second prediction mode type, their prediction directions are very close to horizontal or vertical, resulting in the use of almost the same reference pixels in a certain direction regardless of whether the prediction is divided into sub-blocks or not. Figure 3 Taking the 18th angle prediction mode (horizontal direction) in the example, when reconstructing without ISP and using ISP horizontal division, the reference pixels used for each pixel are exactly the same, both of which are reconstructed pixels at the vertical boundary of the block to be coded, so the residuals obtained by these two methods are exactly the same. However, since the use of ISP horizontal division requires encoding additional bits to indicate the use of ISP horizontal division, the encoder's final rate-distortion performance using ISP horizontal division is not as good as the rate-distortion performance without ISP division, and there is no need to try to encode ISP horizontal division, so the selection of ISP horizontal division can be skipped. Other angular prediction modes that tend to the horizontal direction and tend to the vertical direction are similar and will not be described in detail.

[0138] Therefore, in the embodiment of the present disclosure, for the angle prediction modes of the first prediction mode type and the second prediction mode type, the decision of the reconstruction method is simplified compared with the default method.

[0139] Specifically, if the target prediction mode type is the first prediction mode type, S202 may specifically include:

[0140] Determine a first rate distortion cost corresponding to a reconstruction method that does not use ISP partitioning;

[0141] Determine the second rate-distortion cost corresponding to the reconstruction method using ISP vertical partitioning;

[0142] The reconstruction mode corresponding to the smaller rate-distortion cost between the first rate-distortion cost and the second rate-distortion cost is determined as the reconstruction mode corresponding to the to-be-coded block.

[0143] That is, for the first prediction mode type, the prediction, reconstruction and comparison of the corresponding rate-distortion costs of the reconstruction method of the ISP level division are skipped.

[0144] If the target prediction mode type is the second prediction mode type, S202 may specifically include:

[0145] Determine the third rate distortion cost corresponding to the reconstruction method without ISP partitioning;

[0146] Determine the fourth rate distortion cost corresponding to the reconstruction method using ISP horizontal partitioning;

[0147] The reconstruction mode corresponding to the smaller rate-distortion cost between the third rate-distortion cost and the fourth rate-distortion cost is determined as the reconstruction mode corresponding to the to-be-coded block.

[0148] That is, for the second prediction mode type, the prediction, reconstruction and comparison of the corresponding rate-distortion cost of the reconstruction method of the ISP vertical division are skipped.

[0149] In one example, the coding block reconstruction method selection process corresponding to the first prediction mode type and the second prediction mode type can be as follows: Figure 4 For ease of description, in this example, the first prediction mode type and the second prediction mode type are referred to as Class B and Class C, respectively. The main process is as follows:

[0150] Do not use ISP to predict and reconstruct the block to be coded, record RD cost c0 (i.e., the first rate distortion cost or the third rate distortion cost), if the block to be coded belongs to class B, use ISP vertical division to predict and reconstruct the block to be coded, and record RD cost c1 (i.e., the second rate distortion cost), if the block to be coded does not belong to class B, that is, the block to be coded belongs to class C, use ISP horizontal division to predict and reconstruct the block to be coded, and record RD cost c1 (i.e., the fourth rate distortion cost), compare c0 and c1 (i.e., compare the first rate distortion cost and the second rate distortion cost, or compare the third rate distortion cost and the fourth rate distortion cost), save the reconstruction result with the smallest RD cost, and then end the selection of the reconstruction method for the block to be coded.

[0151] Those skilled in the art should understand that this example is only an illustrative description and does not constitute a limitation on the embodiments of the present disclosure. Appropriate changes based on this example may also be applicable to the present disclosure. For example, the judgment of Class B and Class C can be set before the step of predicting and reconstructing the block to be encoded without using ISP and recording the RD cost c0, or before judging whether the block to be encoded belongs to Class C, etc., so it should also be included in the scope of protection of the present disclosure.

[0152] The embodiment of the present disclosure also provides a feasible implementation method, wherein the multiple prediction mode types include a third prediction mode type and a fourth prediction mode type, wherein the angle prediction mode corresponding to the third prediction mode type is biased towards the horizontal prediction direction, and the angle prediction mode corresponding to the fourth prediction mode type is biased towards the vertical prediction direction. For example, see Figure 3The horizontally biased prediction mode and the vertically biased prediction mode refer to prediction modes whose prediction directions are between horizontal and vertical. In the disclosed embodiment, these prediction modes can be divided into a third prediction mode type and a fourth prediction mode type.

[0153] In the embodiment of the present disclosure, in the process of selecting the coding block reconstruction method corresponding to the third prediction mode type and the fourth prediction mode type, when the rate-distortion cost corresponding to the reconstruction method without using ISP division is less than a predetermined multiple of the rate-distortion cost corresponding to the reconstruction method using ISP division, the selection of the reconstruction method of the biased direction ISP division is skipped.

[0154] That is, according to the prediction direction and the difference between ISP partitioning and not using ISP partitioning, it is decided whether to skip the selection of the reconstruction method for ISP partitioning in the biased direction, so as to achieve the effect of reducing the computational complexity of the selection of the reconstruction method.

[0155] Specifically, the embodiment of the present disclosure provides a method for deciding on a fast prediction and reconstruction method. Only when the division of ISP in one direction has better rate-distortion performance than the method without ISP (the RD cost corresponding to the reconstruction method without ISP division is greater than or equal to a predetermined multiple of the RD cost corresponding to the reconstruction method using ISP division, for example, k times, k≥1), the encoder will try the division encoding of ISP in the other direction. Among them, the value of the predetermined multiple can be set by those skilled in the art according to actual conditions, and the embodiment of the present disclosure does not limit it here. Since the prediction direction of the third prediction mode type is biased towards the horizontal, based on the same principle as the first prediction mode type and the second prediction mode type, ISP vertical division encoding can be tried first. Similarly, the fourth prediction mode type gives priority to trying ISP horizontal division encoding.

[0156] Specifically, if the target prediction mode type is the third prediction mode type, S202 may specifically include:

[0157] Determine the fifth rate distortion cost corresponding to the reconstruction method without ISP partitioning;

[0158] Determine the sixth rate distortion cost corresponding to the reconstruction method using ISP vertical partitioning;

[0159] determining whether the fifth rate-distortion cost is less than a predetermined multiple of the sixth rate-distortion cost;

[0160] If not, determine the seventh rate distortion cost corresponding to the reconstruction method using ISP horizontal division;

[0161] If yes, determining the seventh rate-distortion cost as a first value, the first value being greater than the fifth rate-distortion cost and / or the sixth rate-distortion cost;

[0162] The reconstruction mode corresponding to the smaller rate-distortion cost among the fifth rate-distortion cost, the sixth rate-distortion cost, and the seventh rate-distortion cost is determined as the reconstruction mode corresponding to the block to be encoded.

[0163] That is, for the third prediction mode type, if the fifth rate distortion cost corresponding to the reconstruction method without ISP division is less than a predetermined multiple of the sixth rate distortion cost corresponding to the reconstruction method using ISP vertical division, the prediction and reconstruction of the reconstruction method using ISP horizontal division is skipped, and the seventh rate distortion cost is directly recorded as the first value to ensure that the reconstruction method using ISP horizontal division will not be selected.

[0164] Optionally, the first value can be a fixed preset value that is absolutely greater than the fifth rate distortion cost and the sixth rate distortion cost. Those skilled in the art set the first value according to actual conditions, and the embodiments of the present disclosure do not limit this. Alternatively, the first value can be the larger value of the fifth rate distortion cost and the sixth rate distortion cost. For example, if the fifth rate distortion cost is greater than the sixth rate distortion cost, the first value can be set to be the same as the fifth rate distortion cost, and the first value is greater than the sixth rate distortion cost. Conversely, if the fifth rate distortion cost is less than the sixth rate distortion cost, the first value can be set to be the same as the sixth rate distortion cost, and the first value is greater than the fifth rate distortion cost to ensure that the reconstruction method using ISP horizontal division will not be selected.

[0165] If the target prediction mode type is the fourth prediction mode type, S202 may specifically include:

[0166] Determine the eighth rate distortion cost corresponding to the reconstruction method without ISP partitioning;

[0167] Determine the ninth rate distortion cost corresponding to the reconstruction method using ISP horizontal partitioning;

[0168] determining whether the eighth rate-distortion cost is less than a predetermined multiple of the ninth rate-distortion cost;

[0169] If not, determine the tenth rate-distortion cost corresponding to the reconstruction method using ISP vertical partitioning;

[0170] If so, determining the tenth rate-distortion cost as a second value, the second value being greater than the eighth rate-distortion cost and / or the ninth rate-distortion cost;

[0171] The reconstruction mode corresponding to the smaller rate-distortion cost among the eighth rate-distortion cost, the ninth rate-distortion cost, and the tenth rate-distortion cost is determined as the reconstruction mode corresponding to the block to be encoded.

[0172] That is, for the fourth prediction mode type, if the eighth rate-distortion cost corresponding to the reconstruction method without ISP division is less than a predetermined multiple of the ninth rate-distortion cost corresponding to the reconstruction method using ISP horizontal division, the prediction and reconstruction of the reconstruction method using ISP vertical division is skipped, and the tenth rate-distortion cost is directly recorded as the second value to ensure that the reconstruction method using ISP vertical division will not be selected.

[0173] Optionally, the second value can be a fixed preset value that is absolutely greater than the eighth rate distortion cost and the ninth rate distortion cost. Those skilled in the art set the second value according to actual conditions, and the embodiments of the present disclosure do not limit this. Alternatively, the second value can be the larger value of the eighth rate distortion cost and the ninth rate distortion cost. For example, if the eighth rate distortion cost is greater than the ninth rate distortion cost, the second value can be set to be the same as the eighth rate distortion cost, then the second value is greater than the ninth rate distortion cost. Conversely, if the ninth rate distortion cost is greater than the eighth rate distortion cost, the second value can be set to be the same as the ninth rate distortion cost, then the second value is greater than the eighth rate distortion cost, to ensure that the reconstruction method using ISP vertical division will not be selected.

[0174] It should be noted that the first value and the second value may be the same or different, and those skilled in the art may set them according to actual conditions, which is not limited in the embodiments of the present disclosure.

[0175] In one example, the coding block reconstruction method selection process corresponding to the third prediction mode type and the fourth prediction mode type can be as follows: Figure 5 As shown, for ease of description, in this example, the third prediction mode type and the fourth prediction mode type are referred to as type D and type E respectively. The main process is as follows:

[0176] The block to be coded is not predicted and reconstructed using ISP, and the RD cost c0 (i.e., the fifth rate-distortion cost or the eighth rate-distortion cost) is recorded. If the block to be coded belongs to class D, the block to be coded is predicted and reconstructed using ISP vertical division, and the RD cost c1 (i.e., the sixth rate-distortion cost) is recorded. It is determined whether c0 is less than k*c1 (i.e., a predetermined multiple of c1). If c0≥k*c1, ISP horizontal division is used for prediction and reconstruction, and the RD cost c2 (i.e., the seventh rate-distortion cost) is recorded. If c0<k*c1, c2 (i.e., the seventh rate-distortion cost) is set to a first value (greater than c0 and / or c1, i.e., c2 is the maximum value of c0, c1, and c2). If the block to be coded does not belong to class D, that is, the block to be coded belongs to class E, the block to be coded is predicted and reconstructed using ISP horizontal partitioning, and the RD cost c1 (i.e., the ninth rate-distortion cost) is recorded. It is determined whether c0 is less than k*c1 (i.e., a predetermined multiple of c1). If c0 ≥ k*c1, ISP vertical partitioning is used for prediction and reconstruction, and the RD cost c2 (i.e., the tenth rate-distortion cost) is recorded. If c0 < k*c1, c2 (i.e., the tenth rate-distortion cost) is set to a second value (greater than the values ​​of c0 and c1, i.e., c2 is the maximum value of c0, c1, and c2). The sizes of c0, c1, and c2 are compared (i.e., the sizes of the fifth rate-distortion cost, the sixth rate-distortion cost, and the seventh rate-distortion cost, or the sizes of the eighth rate-distortion cost, the ninth rate-distortion cost, and the tenth rate-distortion cost) are compared, and the reconstruction result with the smallest RD cost is saved, thereby completing the selection of the reconstruction method for the block to be coded.

[0177] Those skilled in the art should understand that this example is only a schematic description and does not constitute a limitation on the embodiments of the present disclosure. Appropriate changes based on this example may also be applicable to the present disclosure. For example, the judgment of Class D and Class E can be set before the step of predicting and reconstructing the block to be encoded without using ISP and recording the RD cost c0, or before judging whether the block to be encoded belongs to Class E, etc., so it should also be included in the scope of protection of the present disclosure.

[0178] The embodiment of the present disclosure also provides a feasible implementation method, wherein the multiple prediction mode types further include a fifth prediction mode type, which corresponds to a non-directional prediction mode, for example Figure 3 DC mode and planar mode are shown, but not limited to.

[0179] For the fifth prediction mode type, pixel prediction is independent of direction. The reconstructed pixels at the upper and left boundaries of the current block to be coded will participate in the reconstruction of the pixels within the current block. The closer the reference pixel is to the pixel to be reconstructed, the better the reconstruction effect is likely to be. In the embodiment of the present disclosure, the reconstructed block size for the fifth prediction mode type is determined as follows:

[0180] If the target prediction mode type is the fifth prediction mode type, S202 may specifically include:

[0181] Determine the eleventh rate-distortion cost corresponding to the reconstruction method without ISP partitioning;

[0182] Determine the 12th rate distortion cost corresponding to the reconstruction method using ISP horizontal partitioning;

[0183] Determine the 13th rate-distortion cost corresponding to the reconstruction method using ISP vertical partitioning;

[0184] The reconstruction mode corresponding to the smaller rate-distortion cost among the eleventh rate-distortion cost, the twelfth rate-distortion cost, and the thirteenth rate-distortion cost is determined as the reconstruction mode corresponding to the block to be encoded.

[0185] In one example, the coding block reconstruction method selection process corresponding to the fifth prediction mode type can be as follows: Figure 6 For ease of description, the fifth prediction mode type is referred to as type A in this example. The main process is as follows:

[0186] The block to be coded is not predicted and reconstructed using ISP, and the RD cost c0 (i.e., the eleventh rate-distortion cost) is recorded. The block to be coded is predicted and reconstructed using ISP horizontal division, and the RD cost c1 (i.e., the twelfth rate-distortion cost) is recorded. The block to be coded is predicted and reconstructed using ISP vertical division, and the RD cost c2 (i.e., the thirteenth rate-distortion cost) is recorded. The sizes of c0, c1, and c2 are compared (i.e., the sizes of the eleventh rate-distortion cost, the twelfth rate-distortion cost, and the thirteenth rate-distortion cost are compared), and the reconstruction result with the smallest RD cost is saved, thereby ending the selection of the reconstruction method for the block to be coded.

[0187] Optionally, for H.266 / VVC, such as Figure 3 As shown, the first prediction mode type includes angle prediction modes with mode numbers 14 to 22, but is not limited thereto.

[0188] Optionally, for H.266 / VVC, such as Figure 3 As shown, the second prediction mode type includes angle prediction modes with mode numbers 46 to 54, but is not limited thereto.

[0189] Optionally, for H.266 / VVC, such as Figure 3 As shown, the third prediction mode type includes angle prediction modes with mode numbers 2 to 13 and 23 to 34, but is not limited thereto.

[0190] Optionally, for H.266 / VVC, such as Figure 3As shown, the fourth prediction mode type includes angle prediction modes with mode numbers 35 to 45 and 55 to 66, but is not limited thereto.

[0191] Optionally, for H.266 / VVC, such as Figure 3 As shown, for the angle prediction mode with mode number 34, it can belong to the third prediction mode type, or the fourth prediction mode type, or it can also adopt Figure 6 The coding block reconstruction method selection process shown is processed.

[0192] Optionally, for H.266 / VVC, such as Figure 3 As shown, the fifth prediction mode type includes a DC prediction mode and a planar prediction mode, but is not limited thereto.

[0193] Those skilled in the art should understand that the classification of prediction mode types is not limited to the above-mentioned classification methods. Appropriate changes based on these examples can also be applied to the present disclosure and should therefore be included in the scope of protection of the present disclosure.

[0194] Among them, which reference pixels each prediction mode corresponds to and what the various prediction mode numbers are are technical contents specified in the coding standard and will not be repeated here.

[0195] In an example, taking the 67 intra-frame prediction modes of H.266 / VVC as an example, the 67 modes can be divided into five categories, as shown in Table 1:

[0196] category Mode number A 0，1 B 14～22 C 46～54 D 2～13，23～34 E 35～45，55～66

[0197] Table 1

[0198] Among them, non-directional modes 0 and 1 are classified as Class A (i.e., the fifth prediction mode type). Modes tending to the horizontal direction and modes tending to the vertical direction are classified as Class B (i.e., the first prediction mode type) and Class C (i.e., the second prediction mode type). Modes that are biased towards the horizontal direction and modes that are biased towards the vertical direction are classified as Class D (i.e., the third prediction mode type) and Class E (i.e., the fourth prediction mode type).

[0199] In another example, for the five types of prediction modes after classification, the complete coding block reconstruction method selection process can be as follows: Figure 7 As shown, the main process is as follows:

[0200] Determine whether the block to be coded belongs to the A-type mode. If so, use the coding block reconstruction method selection process corresponding to the fifth prediction mode type (such as Figure 6 If not, continue to determine whether the block to be coded belongs to the B mode or the C mode. If so, use the coding block reconstruction method selection process corresponding to the first prediction mode type and the second prediction mode type (as shown in FIG. Figure 4If not, that means the block to be coded belongs to the D mode or the E mode, then the coding block reconstruction method selection process corresponding to the third prediction mode type and the fourth prediction mode type is used (as shown in FIG. Figure 5 By processing the block to be coded (as shown), the reconstruction method and reconstruction result of the block to be coded can be obtained, and the selection of the reconstruction method of the block to be coded can be ended.

[0201] Those skilled in the art should understand that the above examples are merely illustrative descriptions and do not constitute a limitation on the embodiments of the present disclosure. Appropriate changes based on these examples may also be applicable to the present disclosure. For example, the judgment of the five types of prediction mode types may not be limited to the above process, or the classification types may not be limited to five categories, etc., which should also be included in the scope of protection of the present disclosure.

[0202] The video encoding method provided by the embodiments of the present disclosure can effectively reduce the complexity ratio of ISP decision in the entire encoding process, thereby reducing encoding time and computing resource overhead, improving encoding efficiency, and the encoded bitstream complies with the VVC standard.

[0203] Furthermore, Figures 8a to 8e The following figure shows the possible reconstruction scenarios for intra-frame prediction. When ISP is not used, the block to be coded is predicted and reconstructed at its original size. When ISP is used, four possible scenarios are possible: horizontal four-partitioning, vertical four-partitioning, horizontal two-partitioning, and vertical two-partitioning.

[0204] In the embodiment of the present disclosure, when it is determined that the reconstruction method uses ISP partitioning (such as ISP horizontal partitioning or ISP horizontal partitioning), a two-partition or four-partitioning method can be further determined based on the size of the block to be encoded. As an example, the two-partitioning method can be applied to the case where the coding block size is 4×8 and 8×4. When the coding block size is used for other coding blocks, the corresponding four-partitioning method can be used, but the present invention is not limited thereto.

[0205] Based on at least one of the above embodiments, the present disclosure provides an example of a complete coding block reconstruction mode selection process, which may specifically include:

[0206] S7.1: Based on the prediction mode corresponding to the block to be coded for the current intra-frame prediction, determine a target prediction mode type corresponding to the block to be coded from multiple prediction mode types;

[0207] S7.2: If the target prediction mode type is the first prediction mode type, determine the first rate-distortion cost corresponding to the reconstruction method without using ISP partitioning; determine the second rate-distortion cost corresponding to the reconstruction method using ISP vertical partitioning; and determine the reconstruction method corresponding to the smaller rate-distortion cost between the first rate-distortion cost and the second rate-distortion cost as the reconstruction method corresponding to the block to be encoded.

[0208] S7.3: If the target prediction mode type is the second prediction mode type, determine the third rate-distortion cost corresponding to the reconstruction method without using ISP division; determine the fourth rate-distortion cost corresponding to the reconstruction method using ISP horizontal division; and determine the reconstruction method corresponding to the smaller rate-distortion cost between the third rate-distortion cost and the fourth rate-distortion cost as the reconstruction method corresponding to the block to be encoded.

[0209] S7.4: If the target prediction mode type is the third prediction mode type, determine the fifth rate-distortion cost corresponding to the reconstruction method without using ISP partitioning; determine the sixth rate-distortion cost corresponding to the reconstruction method using ISP vertical partitioning; judge whether the fifth rate-distortion cost is less than a predetermined multiple of the sixth rate-distortion cost; if not, determine the seventh rate-distortion cost corresponding to the reconstruction method using ISP horizontal partitioning; if so, determine the seventh rate-distortion cost as a first value, the first value being greater than the fifth rate-distortion cost and / or the sixth rate-distortion cost; determine the reconstruction method corresponding to the smaller rate-distortion cost among the fifth rate-distortion cost, the sixth rate-distortion cost and the seventh rate-distortion cost as the reconstruction method corresponding to the block to be encoded.

[0210] S7.5: If the target prediction mode type is the fourth prediction mode type, determine the eighth rate-distortion cost corresponding to the reconstruction method without using ISP partitioning; determine the ninth rate-distortion cost corresponding to the reconstruction method using ISP horizontal partitioning; judge whether the eighth rate-distortion cost is less than a predetermined multiple of the ninth rate-distortion cost; if not, determine the tenth rate-distortion cost corresponding to the reconstruction method using ISP vertical partitioning; if so, determine the tenth rate-distortion cost as a second value, the second value being greater than the eighth rate-distortion cost and / or the ninth rate-distortion cost; determine the reconstruction method corresponding to the smaller rate-distortion cost among the eighth rate-distortion cost, the ninth rate-distortion cost and the tenth rate-distortion cost as the reconstruction method corresponding to the block to be encoded.

[0211] S7.6: If the target prediction mode type is the fifth prediction mode type, determine the eleventh rate-distortion cost corresponding to the reconstruction method without using ISP partitioning; determine the twelfth rate-distortion cost corresponding to the reconstruction method using ISP horizontal partitioning; determine the thirteenth rate-distortion cost corresponding to the reconstruction method using ISP vertical partitioning; determine the reconstruction method corresponding to the smaller rate-distortion cost among the eleventh rate-distortion cost, the twelfth rate-distortion cost and the thirteenth rate-distortion cost as the reconstruction method corresponding to the block to be encoded.

[0212] S7.6: Save the reconstruction result corresponding to the determined reconstruction method.

[0213] The video encoding method provided by the embodiment of the present disclosure can reduce the computational complexity determined by the intra-frame prediction reconstruction method while basically maintaining the performance by selectively skipping ISP horizontal division or ISP vertical division.

[0214] In the embodiment of the present disclosure, the encoding device 101, in the process of encoding to obtain a compressed code stream of the data to be encoded, will mark the compressed code stream based on the selected reconstruction method. Correspondingly, after the decoding device 102 receives the compressed code stream transmitted by the encoding device 101, it can decode the compressed code stream according to the identifier and present the data before encoding based on the decoding result.

[0215] In order to better understand and illustrate the practical value of the solutions provided by the embodiments of the present disclosure, the optional implementation methods of the present disclosure are described below in conjunction with specific scenario examples.

[0216] Scenario 1: Multi-person online conference scenario. Participant A can trigger screen / desktop sharing on their user terminal's application interface, and other participants' user terminals can also see their screen content. For example, during a meeting, participant A can open a document on their terminal, and through screen sharing, all participants can see the document, facilitating communication and discussion.

[0217] Specifically, the system structure in this scenario may include an online conference server and a user terminal that is communicatively connected to the conference server. The user terminal may be any form of terminal that can watch videos, such as a user's mobile phone or computer, and the conference server may be any server that can provide users with applications including but not limited to online conference functions.

[0218] Assume that terminal 1 is the terminal of participant a who initiates screen sharing, and the application supports the video encoding method provided by the embodiment of the present disclosure. Optionally, in this application scenario, terminal 1 can be the encoding end, and other terminals can be decoding ends. Participant a can operate the document content displayed on its terminal 1, such as turning pages, marking, etc., and participants at other terminals can also see the document content after the operation. During the meeting, terminal 1 can encode the content displayed on terminal 1 by executing the encoding method provided by the embodiment of the present disclosure, generate a code stream, and send the code stream to the terminals of other participants through the conference server. The terminals of other participants can decode the received code stream and display the content displayed on terminal 1.

[0219] For the above scenario 1, what terminal 1 needs to encode and process mainly is the screen content. Terminal 1 can skip the selection of the reconstruction method corresponding to the ISP division in a specific direction by executing the solution provided by the embodiment of the present disclosure, so as to reduce the computational complexity determined by the intra-frame prediction reconstruction method, and perform encoding. The encoding result carries an identifier indicating the reconstruction method. After receiving the code stream, the terminals of other participants can use the reconstruction method indicated by the identifier to decode the code stream.

[0220] Scenario 2: Live or quasi-live scenarios. A quasi-live scenario refers to a scenario where the video to be encoded is similar to a live video stream. For example, the video stream to be encoded is a video stream captured by a camera, such as a video call scenario using a terminal camera. The following example uses a real-time video call scenario.

[0221] Specifically, the system structure in this scenario may include a server that provides an application program for video calling. This application program may be running on the first terminal of object 1 and the second terminal of object 2. Objects 1 and 2 can conduct a real-time video call through the video calling service provided by the application server. In this application scenario, each terminal participating in the video call serves as both an encoding terminal and a decoding terminal. The application program also supports the encoding scheme provided by the embodiments of the present disclosure. The video encoding method and decoding method must be deployed on both the first terminal and the second terminal. After the first and second terminals establish a video call through the application server, the first terminal captures the video of object 1 in real time and may use the video encoding method provided by the embodiments of the present disclosure to encode the video frames in the captured video. The generated bitstream is sent to the second terminal via the application server. The second terminal decodes the bitstream sent by the first terminal to obtain the video image of object 1 and displays it to object 2. Similarly, the second terminal encodes the video frames in the video stream captured by object 2 using the video encoding method provided by the embodiments of the present disclosure and sends it to the first terminal via the application server. The first terminal decodes the bitstream and presents the video image of object 2 to object 1.

[0222] For the above scenario 2, the video streams that need to be encoded are all video streams of natural content captured by the camera in real time. When encoding the video streams it has captured, each terminal can skip the selection of the reconstruction method corresponding to the ISP division in a specific direction by executing the solution provided by the embodiment of the present disclosure, so as to reduce the computational complexity determined by the intra-frame prediction reconstruction method and speed up the encoding efficiency, so that the other end can display the other party's video screen faster, thereby improving the usage perception.

[0223] Combination of multiple scenarios: For example, in an online conference application scenario, a participant performs screen sharing (such as sharing a document), and one or more participants simultaneously turn on the video screen display function. The participant's real-time video screen can be displayed above the shared document content in a small window or other manner. In this scenario, the video frame to be encoded contains both screen content and natural content captured by the camera in real time. At this time, some blocks to be encoded in a frame of image may be image blocks of natural content, and some may be image blocks of screen content. By adopting the solution provided by the embodiment of the present disclosure, the selection of the reconstruction method corresponding to the ISP division in a specific direction can be skipped to reduce the computational complexity determined by the intra-frame prediction reconstruction method, thereby ensuring coding performance and accelerating coding efficiency.

[0224] It should be noted that in the optional embodiments of the present disclosure, the object information and other related data involved, when the embodiments of the present disclosure are applied to specific products or technologies, need to obtain the permission or consent of the object, and the collection, use and processing of the relevant data need to comply with the relevant laws, regulations and standards of the relevant countries and regions. In other words, if the embodiments of the present disclosure involve data related to the object, it needs to be obtained through the authorization and consent of the object, the authorization and consent of the relevant departments, and in compliance with the relevant laws, regulations and standards of the country and region. If personal information is involved in the embodiments, the acquisition of all personal information needs to obtain the consent of the individual. If sensitive information is involved, the separate consent of the information subject needs to be obtained. The embodiments also need to be implemented with the authorization and consent of the object.

[0225] The video encoding and decoding processing technology disclosed herein can be implemented using cloud technology; for example, cloud servers can be used as decoding or encoding devices. Cloud technology refers to a hosting technology that unifies hardware, software, and network resources within a wide area network or local area network to enable data computing, storage, processing, and sharing.

[0226] The embodiments of the present disclosure may also be combined with cloud computing, cloud storage, database and other cloud technologies.

[0227] Among them, cloud computing is a computing model that distributes computing tasks on a resource pool composed of a large number of computers, enabling various application systems to obtain computing power, storage space and information services as needed. Cloud computing can provide powerful computing support for the point cloud encoding and decoding processes, which can greatly improve the geometric encoding and decoding efficiency of point clouds.

[0228] A database, in short, can be thought of as a digital filing cabinet—a place where electronic files are stored, allowing users to add, query, update, and delete data. A database is a collection of data stored in a specific way, shared by multiple users, with minimal redundancy, and independent of applications.

[0229] A database management system (DBMS) is a computer software system designed for managing databases, typically providing basic functions such as storage, retrieval, security, and backup. DBMSs can be categorized by the database model they support, such as relational or XML (Extensible Markup Language); by the type of computer they support, such as server clusters or mobile phones; by the query language used, such as SQL (Structured Query Language) or XQuery; by performance priorities, such as maximum scale or maximum speed; or by other classification methods. Regardless of the classification method used, some DBMSs can cross categories, for example, supporting multiple query languages ​​simultaneously.

[0230] Cloud storage is a new concept that has been extended and developed from the concept of cloud computing. A distributed cloud storage system (hereinafter referred to as storage system) refers to a storage system that uses cluster applications, grid technology, and distributed storage file systems to bring together a large number of different types of storage devices (storage devices are also called storage nodes) in the network through application software or application interfaces to work together and jointly provide external data storage and business access functions. Cloud storage can provide powerful storage support for the point cloud encoding and decoding stages, thereby reducing the data storage pressure of the point cloud during the encoding and decoding process, and thus improving data processing efficiency.

[0231] The present disclosure provides a video encoding device. Figure 9 As shown, the video encoding device 90 may include: a prediction mode type determination module 901, a reconstruction method determination module 902 and a storage module 903, wherein:

[0232] The prediction mode type determination module 901 is used to determine a target prediction mode type corresponding to a block to be coded from multiple prediction mode types based on the angular prediction mode corresponding to the block to be coded for the current intra-frame prediction. The multiple prediction mode types correspond to different coding block reconstruction method selection processes. In each coding block reconstruction method selection process, the selection of a reconstruction method corresponding to the ISP partitioning in a specific direction is skipped.

[0233] The reconstruction mode determination module 902 is used to determine the reconstruction mode corresponding to the block to be coded based on the coding block reconstruction mode selection process corresponding to the target prediction mode type;

[0234] The saving module 903 is used to save the reconstruction result corresponding to the determined reconstruction method.

[0235] In an optional embodiment, the multiple prediction mode types include a first prediction mode type and a second prediction mode type, the angle prediction mode corresponding to the first prediction mode type tends to a horizontal prediction direction, and the angle prediction mode corresponding to the second prediction mode type tends to a vertical prediction direction;

[0236] The coding block reconstruction method selection process corresponding to the first prediction mode type and the second prediction mode type skips the selection of the reconstruction method corresponding to the ISP division in the same direction.

[0237] In an optional implementation, if the target prediction mode type is the first prediction mode type, the reconstruction mode determination module 902, when used to determine the reconstruction mode corresponding to the to-be-encoded block based on the encoding block reconstruction mode selection process corresponding to the target prediction mode type, is specifically configured to:

[0238] Determine a first rate distortion cost corresponding to a reconstruction method that does not use ISP partitioning;

[0239] Determine the second rate-distortion cost corresponding to the reconstruction method using ISP vertical partitioning;

[0240] The reconstruction mode corresponding to the smaller rate-distortion cost between the first rate-distortion cost and the second rate-distortion cost is determined as the reconstruction mode corresponding to the to-be-coded block.

[0241] In an optional implementation, if the target prediction mode type is the second prediction mode type, the reconstruction mode determination module, when used to determine the reconstruction mode corresponding to the to-be-encoded block based on the encoding block reconstruction mode selection process corresponding to the target prediction mode type, is specifically configured to:

[0242] Determine the third rate distortion cost corresponding to the reconstruction method without ISP partitioning;

[0243] Determine the fourth rate distortion cost corresponding to the reconstruction method using ISP horizontal partitioning;

[0244] The reconstruction mode corresponding to the smaller rate-distortion cost between the third rate-distortion cost and the fourth rate-distortion cost is determined as the reconstruction mode corresponding to the to-be-coded block.

[0245] In an optional embodiment, the multiple prediction mode types include a third prediction mode type and a fourth prediction mode type, the angle prediction mode corresponding to the third prediction mode type is biased towards a horizontal prediction direction, and the angle prediction mode corresponding to the fourth prediction mode type is biased towards a vertical prediction direction;

[0246] Among them, in the coding block reconstruction method selection process corresponding to the third prediction mode type and the fourth prediction mode type, when the rate-distortion cost corresponding to the reconstruction method without using ISP division is less than a predetermined multiple of the rate-distortion cost corresponding to the reconstruction method using ISP division, the selection of the reconstruction method of the biased direction ISP division is skipped.

[0247] In an optional implementation, if the target prediction mode type is the third prediction mode type, the reconstruction mode determination module 902, when determining the reconstruction mode corresponding to the to-be-encoded block based on the encoding block reconstruction mode selection process corresponding to the target prediction mode type, is specifically configured to:

[0248] Determine the fifth rate distortion cost corresponding to the reconstruction method without ISP partitioning;

[0249] Determine the sixth rate distortion cost corresponding to the reconstruction method using ISP vertical partitioning;

[0250] determining whether the fifth rate-distortion cost is less than a predetermined multiple of the sixth rate-distortion cost;

[0251] If not, determine the seventh rate distortion cost corresponding to the reconstruction method using ISP horizontal division;

[0252] If yes, determining the seventh rate-distortion cost as a first value, the first value being greater than the fifth rate-distortion cost and / or the sixth rate-distortion cost;

[0253] The reconstruction mode corresponding to the smaller rate-distortion cost among the fifth rate-distortion cost, the sixth rate-distortion cost, and the seventh rate-distortion cost is determined as the reconstruction mode corresponding to the block to be encoded.

[0254] In an optional implementation, if the target prediction mode type is the fourth prediction mode type, the reconstruction mode determination module 902, when determining the reconstruction mode corresponding to the to-be-encoded block based on the encoding block reconstruction mode selection process corresponding to the target prediction mode type, is specifically configured to:

[0255] Determine the eighth rate distortion cost corresponding to the reconstruction method without ISP partitioning;

[0256] Determine the ninth rate distortion cost corresponding to the reconstruction method using ISP horizontal partitioning;

[0257] determining whether the eighth rate-distortion cost is less than a predetermined multiple of the ninth rate-distortion cost;

[0258] If not, determine the tenth rate-distortion cost corresponding to the reconstruction method using ISP vertical partitioning;

[0259] If so, determining the tenth rate-distortion cost as a second value, the second value being greater than the eighth rate-distortion cost and / or the ninth rate-distortion cost;

[0260] The reconstruction mode corresponding to the smaller rate-distortion cost among the eighth rate-distortion cost, the ninth rate-distortion cost, and the tenth rate-distortion cost is determined as the reconstruction mode corresponding to the block to be encoded.

[0261] In an optional embodiment, the multiple prediction mode types further include a fifth prediction mode type, and the fifth prediction mode type corresponds to a non-directional prediction mode;

[0262] If the target prediction mode type is the fifth prediction mode type, determining a reconstruction mode corresponding to the to-be-encoded block based on a coding block reconstruction mode selection process corresponding to the target prediction mode type includes:

[0263] Determine the eleventh rate-distortion cost corresponding to the reconstruction method without ISP partitioning;

[0264] Determine the 12th rate distortion cost corresponding to the reconstruction method using ISP horizontal partitioning;

[0265] Determine the 13th rate-distortion cost corresponding to the reconstruction method using ISP vertical partitioning;

[0266] The reconstruction mode corresponding to the smaller rate-distortion cost among the eleventh rate-distortion cost, the twelfth rate-distortion cost, and the thirteenth rate-distortion cost is determined as the reconstruction mode corresponding to the block to be encoded.

[0267] In an optional embodiment, the first prediction mode type includes angle prediction modes with mode numbers 14 to 22; and / or,

[0268] The second prediction mode type includes angular prediction modes with mode numbers 46 to 54.

[0269] In an optional embodiment, the third prediction mode type includes angle prediction modes with mode numbers 2 to 13 and 23 to 34; and / or,

[0270] The fourth prediction mode type includes angle prediction modes with mode numbers 35 to 45 and 55 to 66.

[0271] In an optional implementation, the fifth prediction mode type includes a DC prediction mode and a planar prediction mode.

[0272] The apparatus of the embodiments of the present disclosure can execute the methods provided by the embodiments of the present disclosure, and their implementation principles are similar and have corresponding technical effects. The actions performed by each module in the apparatus of each embodiment of the present disclosure correspond to the steps in the methods of each embodiment of the present disclosure. For detailed functional descriptions of each module of the apparatus, please refer to the descriptions of the corresponding methods shown above, and will not be repeated here.

[0273] In an embodiment of the present disclosure, an electronic device is provided, including a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the steps of the method provided in any optional embodiment of the present disclosure. Figure 1 The encoding device 101 in the data processing system 10 is shown.

[0274] In an alternative embodiment, an electronic device is provided, such as Figure 10 As shown, Figure 10 The electronic device 100 shown includes: a processor 101 and a memory 103. The processor 101 and the memory 103 are connected, for example, via a bus 102. Optionally, the electronic device 100 may further include a transceiver 104, which can be used for data exchange between the electronic device and other electronic devices, such as data transmission and / or data reception. It should be noted that in actual applications, the number of transceivers 104 is not limited to one, and the structure of the electronic device 100 does not constitute a limitation on the embodiments of the present disclosure.

[0275] The processor 101 may be a CPU (Central Processing Unit), a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the present disclosure. The processor 101 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

[0276] The bus 102 may include a path for transmitting information between the above components. The bus 102 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus. The bus 102 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 10 Only one thick line is used in the diagram, but this does not mean that there is only one bus or one type of bus.

[0277] The memory 103 can be a ROM (Read Only Memory) or other types of static storage devices that can store static information and instructions, a RAM (Random Access Memory) or other types of dynamic storage devices that can store information and instructions, or an EEPROM (Electrically Erasable Programmable Read Only Memory), a CD-ROM (Compact Disc Read Only Memory) or other optical disk storage, optical disk storage (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media, other magnetic storage devices, or any other medium that can be used to carry or store computer programs and can be read by a computer, without limitation herein.

[0278] The memory 103 is used to store the computer program for executing the embodiments of the present disclosure, and the execution is controlled by the processor 101. The processor 101 is used to execute the computer program stored in the memory 103 to implement the steps shown in the above method embodiments.

[0279] An embodiment of the present disclosure provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps and corresponding contents of the aforementioned method embodiment can be implemented.

[0280] The embodiments of the present disclosure further provide a computer program product, including a computer program, which can implement the steps and corresponding contents of the aforementioned method embodiments when executed by a processor.

[0281] It should be understood that, although the flowcharts of the embodiments of the present disclosure indicate the various operation steps by arrows, the order of implementation of these steps is not limited to the order indicated by the arrows. Unless otherwise clearly stated herein, in some implementation scenarios of the embodiments of the present disclosure, the implementation steps in each flowchart can be performed in other orders as required. In addition, some or all of the steps in each flowchart may include multiple sub-steps or multiple stages based on the actual implementation scenario. Some or all of these sub-steps or stages can be executed at the same time, and each sub-step or stage in these sub-steps or stages can also be executed at different times. In scenarios where the execution times are different, the order of execution of these sub-steps or stages can be flexibly configured as required, and the embodiments of the present disclosure do not limit this.

[0282] The above are only optional implementation methods for some implementation scenarios of the present disclosure. It should be pointed out that for ordinary technicians in this technical field, without departing from the technical concept of the solution of the present disclosure, other similar implementation methods based on the technical ideas of the present disclosure are also within the protection scope of the embodiments of the present disclosure.

Claims

1. A video encoding method, characterized in that: include: Based on the angular prediction mode corresponding to the block to be coded for the current intra-frame prediction, determining a target prediction mode type corresponding to the block to be coded from a plurality of prediction mode types, wherein the plurality of prediction mode types respectively correspond to different coding block reconstruction mode selection processes, and in each coding block reconstruction mode selection process, skipping the selection of a reconstruction mode corresponding to the intra-frame coding sub-block division (ISP) division in a specific direction; Determining a reconstruction method corresponding to the block to be encoded based on a coding block reconstruction method selection process corresponding to the target prediction mode type; The reconstruction result corresponding to the determined reconstruction method is saved.

2. The video encoding method according to claim 1, wherein: The multiple prediction mode types include a first prediction mode type and a second prediction mode type, the first prediction mode type corresponding to an angular prediction mode tends to a horizontal prediction direction, and the second prediction mode type corresponding to an angular prediction mode tends to a vertical prediction direction; The coding block reconstruction method selection process corresponding to the first prediction mode type and the second prediction mode type skips the selection of the reconstruction method corresponding to the ISP division in the same direction.

3. The video encoding method according to claim 2, wherein: If the target prediction mode type is the first prediction mode type, the process of selecting a coding block reconstruction mode corresponding to the target prediction mode type to determine a reconstruction mode corresponding to the to-be-coded block includes: Determine a first rate distortion cost corresponding to a reconstruction method that does not use ISP partitioning; Determine the second rate-distortion cost corresponding to the reconstruction method using ISP vertical partitioning; A reconstruction mode corresponding to a smaller rate-distortion cost between the first rate-distortion cost and the second rate-distortion cost is determined as the reconstruction mode corresponding to the block to be encoded.

4. The video encoding method according to claim 2, wherein: If the target prediction mode type is the second prediction mode type, the process of selecting a coding block reconstruction mode corresponding to the target prediction mode type to determine a reconstruction mode corresponding to the to-be-coded block includes: Determine the third rate distortion cost corresponding to the reconstruction method without ISP partitioning; Determine the fourth rate distortion cost corresponding to the reconstruction method using ISP horizontal partitioning; A reconstruction mode corresponding to a smaller rate-distortion cost between the third rate-distortion cost and the fourth rate-distortion cost is determined as the reconstruction mode corresponding to the block to be encoded.

5. The video encoding method according to claim 1, wherein: The multiple prediction mode types include a third prediction mode type and a fourth prediction mode type, the angle prediction mode corresponding to the third prediction mode type is biased towards a horizontal prediction direction, and the angle prediction mode corresponding to the fourth prediction mode type is biased towards a vertical prediction direction; Among them, in the coding block reconstruction method selection process corresponding to the third prediction mode type and the fourth prediction mode type, when the rate-distortion cost corresponding to the reconstruction method without using ISP division is less than a predetermined multiple of the rate-distortion cost corresponding to the reconstruction method using ISP division, the selection of the reconstruction method of the biased direction ISP division is skipped.

6. The video encoding method according to claim 5, wherein: If the target prediction mode type is the third prediction mode type, the process of selecting a coding block reconstruction mode corresponding to the target prediction mode type to determine a reconstruction mode corresponding to the to-be-coded block includes: Determine the fifth rate distortion cost corresponding to the reconstruction method without ISP partitioning; Determine the sixth rate distortion cost corresponding to the reconstruction method using ISP vertical partitioning; determining whether the fifth rate-distortion cost is less than the predetermined multiple of the sixth rate-distortion cost; If not, determine the seventh rate distortion cost corresponding to the reconstruction method using ISP horizontal division; If yes, determining the seventh rate-distortion cost as a first value, the first value being greater than the fifth rate-distortion cost and / or the sixth rate-distortion cost; A reconstruction mode corresponding to a smaller rate-distortion cost among the fifth rate-distortion cost, the sixth rate-distortion cost, and the seventh rate-distortion cost is determined as the reconstruction mode corresponding to the block to be encoded.

7. The video encoding method according to claim 5, wherein: If the target prediction mode type is the fourth prediction mode type, the process of selecting a coding block reconstruction mode corresponding to the target prediction mode type to determine a reconstruction mode corresponding to the to-be-coded block includes: Determine the eighth rate distortion cost corresponding to the reconstruction method without ISP partitioning; Determine the ninth rate distortion cost corresponding to the reconstruction method using ISP horizontal partitioning; determining whether the eighth rate-distortion cost is less than the predetermined multiple of the ninth rate-distortion cost; If not, determine the tenth rate-distortion cost corresponding to the reconstruction method using ISP vertical partitioning; If yes, determining the tenth rate-distortion cost as a second value, the second value being greater than the eighth rate-distortion cost and / or the ninth rate-distortion cost; A reconstruction mode corresponding to a smaller rate-distortion cost among the eighth rate-distortion cost, the ninth rate-distortion cost, and the tenth rate-distortion cost is determined as the reconstruction mode corresponding to the block to be encoded.

8. The video encoding method according to any one of claims 1 to 7, characterized in that: The plurality of prediction mode types further includes a fifth prediction mode type, the fifth prediction mode type corresponding to a non-directional prediction mode; If the target prediction mode type is the fifth prediction mode type, the process of selecting a coding block reconstruction mode corresponding to the target prediction mode type to determine a reconstruction mode corresponding to the to-be-coded block includes: Determine the eleventh rate-distortion cost corresponding to the reconstruction method without ISP partitioning; Determine the 12th rate distortion cost corresponding to the reconstruction method using ISP horizontal partitioning; Determine the 13th rate-distortion cost corresponding to the reconstruction method using ISP vertical partitioning; A reconstruction mode corresponding to a smaller rate-distortion cost among the eleventh rate-distortion cost, the twelfth rate-distortion cost, and the thirteenth rate-distortion cost is determined as the reconstruction mode corresponding to the block to be encoded.

9. The video encoding method according to any one of claims 1 to 4, characterized in that: The first prediction mode type includes angle prediction modes with mode numbers 14 to 22; and / or, The second prediction mode type includes angle prediction modes with mode numbers 46 to 54.

10. The video encoding method according to any one of claims 5 to 7, characterized in that: The third prediction mode type includes angle prediction modes with mode numbers 2 to 13 and 23 to 34; and / or, The fourth prediction mode type includes angle prediction modes with mode numbers 35 to 45 and 55 to 66.

11. The video encoding method according to claim 8, wherein: The fifth prediction mode type includes a DC prediction mode and a planar prediction mode.

12. A video encoding device, characterized in that: include: A prediction mode type determination module is configured to determine, based on the angular prediction mode corresponding to the block to be coded for intra-frame prediction, a target prediction mode type corresponding to the block to be coded from a plurality of prediction mode types, wherein the plurality of prediction mode types respectively correspond to different coding block reconstruction mode selection processes, and in each coding block reconstruction mode selection process, selection of a reconstruction mode corresponding to intra-frame coding sub-block division (ISP) division in a specific direction is skipped; A reconstruction mode determining module, configured to determine a reconstruction mode corresponding to the block to be encoded based on a coding block reconstruction mode selection process corresponding to the target prediction mode type; The saving module is used to save the reconstruction result corresponding to the determined reconstruction method.

13. An electronic device comprising a memory, a processor, and a computer program stored in the memory, wherein: The processor executes the computer program to implement the method according to any one of claims 1 to 11.

14. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 11 is implemented.

15. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 11 is implemented.

Images