Video processing method and device

The method uses a historical motion information candidate list to reduce dependencies between image blocks, enabling efficient and parallel processing in video coding frameworks.

JP7578355B2Active Publication Date: 2024-11-06SZ DJI TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2023133667
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-08-18
Publication Date
2024-11-06
Estimated Expiration
2038-12-29

AI Technical Summary

Technical Problem

Existing video coding frameworks face strong dependencies between image blocks during motion vector prediction, limiting parallel processing and efficiency in encoding and decoding.

Method used

A method and apparatus that utilize a historical motion information candidate list based on previously encoded or decoded image blocks to enable independent encoding and decoding of multiple image blocks, reducing dependencies and allowing parallel processing.

Benefits of technology

This approach allows for independent encoding and decoding of image blocks, enhancing processing efficiency and throughput by minimizing dependencies between blocks.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007578355000001
    Figure 0007578355000001
  • Figure 0007578355000002
    Figure 0007578355000002
  • Figure 0007578355000003
    Figure 0007578355000003
Patent Text Reader

Abstract

To provide a video processing method and device for encoding or decoding a plurality of image blocks independently.SOLUTION: A method includes the steps of: obtaining a historical motion information candidate list, the historical motion information candidate list being used for encoding or decoding each of a plurality of first image blocks included in a first region of a current frame, and the historical motion information candidate list being obtained based on motion information of encoded or decoded second image blocks other than image blocks included in the first region; and encoding or decoding each of the first image blocks according to the historical motion information candidate list. The historical motion information candidate list is not updated during encoding or decoding each of the first image blocks.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] Copyright Statement The subject matter disclosed in this patent document contains material that is subject to copyright protection. Such copyright is owned by the Copyright Owner. The Copyright Owner has no objection to the copying by anyone of this patent document or the disclosure of this patent as it appears in the Patent Office official records and dossier.

[0002] The present application relates to the field of image processing, and more particularly to a moving image processing method and apparatus. [Background technology]

[0003] Prediction is an important module in mainstream video coding frameworks, and prediction includes intraframe prediction and interframe prediction. Interframe prediction modes may include Advanced Motion Vector Prediction (AMVP) mode and Merge mode. In Merge mode, an MVP can be determined in a Motion Vector Prediction (MVP) candidate list, and the MVP can be directly determined as the MV, and the MVP and the reference frame index can be sent to the decoding side in the stream for decoding on the decoding side.

[0004] When constructing the MVP candidate list, a candidate HMVP may be selected from a history-based motion vector prediction (HMVP) candidate list to be set as a candidate MVP in the MVP candidate list.

[0005] Here, the HMVP candidate list is generated based on the motion information of the block that has already been coded or decoded. Specifically, when coding or decoding a block that has already been coded or decoded, the motion information of the block that has already been coded or decoded can be used to update the HMVP list of the block to be coded or decoded next, but this makes the dependency between image blocks stronger. Summary of the Invention [Problem to be solved by the invention]

[0006] SUMMARY OF THE DISCLOSURE The embodiments of the present application provide a video processing method and apparatus that overcomes the dependencies between image blocks and allows image blocks to be encoded or decoded independently. [Means for solving the problem]

[0007] In a first aspect, a video processing method is provided, which includes obtaining a historical motion information candidate list obtained based on motion information of a second image block, which is an already encoded or decoded image block other than an image block included in a first area in a current frame, used to encode or decode each of a plurality of first image blocks included in the first area, and encoding or decoding each of the first image blocks based on the historical motion information candidate list.

[0008] In a second aspect, a video processing method is provided, which includes: encoding or decoding at least one second image block in a second region of a current frame using a historical motion information candidate list; updating the historical motion information candidate list based on motion information after encoding or decoding at least a portion of the second image blocks in the second region to obtain the updated historical motion information candidate list; and encoding or decoding a plurality of first image blocks in a first region of the current frame using the updated historical motion information candidate list.

[0009] In a third aspect, a moving image processing device is provided, which includes an acquisition unit for acquiring a historical motion information candidate list acquired based on motion information of a second image block, which is an already encoded or decoded image block other than an image block included in a first area in a current frame, used for encoding or decoding each of a plurality of first image blocks included in the first area, and an encoding or decoding unit for encoding or decoding each of the first image blocks based on the historical motion information candidate list.

[0010] In a fourth aspect, a video processing device is provided, comprising: an encoding or decoding unit for encoding or decoding at least one second image block in a second region of a current frame using a history motion information candidate list; and an updating unit for updating the history motion information candidate list based on motion information after encoding or decoding at least a portion of the second image blocks in the second region to obtain the updated history motion information candidate list, wherein the encoding or decoding unit is further used to encode or decode a plurality of first image blocks in a first region of the current frame using the updated history motion information candidate list.

[0011] In a fifth aspect, there is provided a computer system comprising a memory for storing computer executable commands and a processor for accessing the memory and executing the computer executable commands to perform operations in a method of the first or second aspect.

[0012] In a sixth aspect, there is provided a computer storage medium having stored thereon program code operable to instruct the carrying out of a method of the first or second aspect above.

[0013] In a seventh aspect, there is provided a computer program product comprising program code operable to instruct the carrying out of a method of the first or second aspect above.

[0014] In an embodiment of the present application, a historical motion information candidate list can be constructed using motion information of a second image block that has already been encoded or decoded, and multiple first image blocks of a first region can be encoded or decoded using the constructed historical motion information candidate list, thereby overcoming the dependency of the multiple first image blocks and enabling the multiple first image blocks of the first region to continue to be encoded or decoded independently.

[0015] In order to more clearly describe the technical solutions in the embodiments of the present application, the drawings necessary for the description of the embodiments or prior art will be briefly described below. The drawings in the following description are only a part of the embodiments of the present application, and it is obvious to those skilled in the art that other drawings can be further obtained based on these drawings under the premise of not performing creative work. [Brief description of the drawings]

[0016] [Figure 1] FIG. 2 is an architecture diagram of a technical solution according to an embodiment of the present application; [Diagram 2] 1 is a schematic flow chart of a moving image processing method according to an embodiment of the present application; [Diagram 3] 1 is a schematic flow chart of a moving image processing method according to an embodiment of the present application; [Figure 4] FIG. 2 is a configuration diagram of an MER according to an embodiment of the present application. [Diagram 5] FIG. 2 is a schematic diagram of a moving image processing method according to an embodiment of the present application; [Figure 6] FIG. 1 is a schematic diagram of HMVP updating according to an embodiment of the present application. [Figure 7] FIG. 2 is a schematic diagram of adjacent blocks of an image block according to an embodiment of the present application; [Figure 8] FIG. 2 is a schematic diagram of spatial domain candidates for an image block according to an embodiment of the present application; [Figure 9] 1 is a schematic block diagram of a moving image processing device according to an embodiment of the present application; [Figure 10] 1 is a schematic block diagram of a moving image processing device according to an embodiment of the present application; [Figure 11] FIG. 1 is a schematic block diagram of a computer system according to an embodiment of the present application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] The technical solutions in the embodiments of the present application are described below in conjunction with the drawings in the embodiments of the present application, but it is clear that the described embodiments are only some of the embodiments of the present application, and do not include all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present application without creative labor are within the scope of protection of the present application.

[0018] Unless otherwise specified, all technical and scientific terms used in the examples of this application have the same meaning as commonly understood by those skilled in the art of this application. The terms used in this application are only for the purpose of describing specific examples and are not intended to limit the scope of this application.

[0019] FIG. 1 is an architecture diagram of a technical solution using an embodiment of the present application.

[0020] As shown in FIG. 1, the system 100 may receive data to be processed 102, process the data to be processed 102, and generate processed data 108. For example, the system 100 may receive data to be encoded, encode the data to be encoded, and generate encoded data, or the system 100 may receive data to be decoded, decode the data to be decoded, and generate decoded data. In some embodiments, the components in the system 100 may be implemented by one or more processors, which may be a processor in a computing device or a processor in a mobile device (e.g., a drone). The processor may be any type of processor, and the embodiments of the present invention are not limited in this regard. In some possible designs, the processor may include an encoder, a decoder, or a codec, and the like. The system 100 may further include one or more memories. The memory may be used to store commands and data, such as to implement the computer-executable commands, the data to be processed 102, the processed data 108, and the like, of the technical solutions of the embodiments of the present invention. The memory may be any type of memory, and the embodiments of the present invention are not limited in this regard.

[0021] The data to be encoded may include text, images, graphical objects, video sequences, audio, video, or any other data that requires encoding. In some situations, the data to be encoded may include sensing data from a sensor, which may be a visual sensor (e.g., camera, infrared sensor), microphone, proximity sensor (e.g., ultrasonic sensor, radar), location sensor, temperature sensor, touch sensor, etc. In some situations, the data to be encoded may include information from a user, such as biometric information, which may include facial features, fingerprint scans, retinal scans, voice prints, DNA sampling, etc.

[0022] Here, when encoding each image, the image can be first divided into a number of image blocks. In some embodiments, the image can be divided into a number of image blocks, which are called macroblocks or Largest Coding Units (LCUs) in some coding standards. The image blocks may have overlapping parts or no overlapping parts. The image can be divided into any number of image blocks. For example, the image can be divided into an m×n matrix of image blocks. The image blocks may have rectangular, square, circular or any other shape. The image blocks may have any dimensions, such as p×q pixels. In current video coding standards, the image can be first divided into a number of small blocks to encode the image with different resolutions. For H.264, the image blocks are called macroblocks and may have a size of 16×16 pixels, and for HEVC, the image blocks are called Largest Coding Units and may have a size of 64×64. Each image block may have at least one of different dimensions and shapes. Alternatively, two or more image blocks may have at least one of different dimensions and shapes. In some embodiments, an image block may be a portion including one macroblock or largest coding unit, rather than one macroblock or largest coding unit, or at least two complete macroblocks (or largest coding units), or at least one complete macroblock (or largest coding unit) and one macroblock (or largest coding unit), or at least two complete macroblocks (or largest coding units) and some macroblocks (or largest coding units). Thus, after an image is divided into a number of image blocks, each of these image blocks in the image data can be coded.

[0023] In the process of encoding, prediction can be performed on an image to remove redundancy. Different images in a video can adopt different prediction methods. Based on the prediction method adopted by an image, an image can be classified into an intraframe predicted image and an interframe predicted image, and the interframe predicted image includes a forward predicted image and a bidirectional predicted image. An I-image is an intraframe predicted image, also called a key frame. A P-image is a forward predicted image, and one P-image or I-image already encoded before it is adopted is used as a reference image. A B-image is a bidirectional predicted image, and an image before and after it is adopted as a reference image. In one embodiment, after encoding a plurality of images on the encoding side, a group of pictures (GOP) is generated one by one, and the GOP is a group of pictures consisting of one I-image and at least one of a plurality of B-images (or bidirectional predicted images) and P-images (or forward predicted images). The decoding side reads each GOP during playback, and after decoding, reads the screen and renders and displays it.

[0024] Here, when performing inter-frame prediction, for each image block, the most similar block in the reference frame (generally an already reconstructed frame in the time domain) is searched for and taken as the prediction block of the current image block. The relative displacement between the current block and the prediction block is the motion vector (MV).

[0025] Inter-frame prediction modes in the video coding standard may include AMVP mode and Merge mode.

[0026] For AMVP mode, the MVP is determined first, and after obtaining the MVP, the starting point of motion prediction can be determined based on the MVP, and motion search is performed near the starting point, and after the search is completed, the best MV is obtained. In order for the MV to determine the position of the reference block in the reference image, the current block is subtracted from the reference block to obtain the residual block, and the MVP is subtracted from the MV to obtain the motion vector difference (MVD). This MVD is transmitted to the decoding side via a stream.

[0027] For the merge mode, the MVP can be determined first, and the MVP can be directly determined as the MV. Here, in order to obtain the MVP, an MVP candidate list (merge candidate list) can be constructed first, and the MVP candidate list may include at least one candidate MVP, and each candidate MVP may have a corresponding index. After the encoding side selects an MVP from the MVP candidate list, the encoding side can write the MVP index into the stream, and the decoding side can find the MVP corresponding to the index from the MVP candidate list based on the index, and realize the decoding of the image block.

[0028] In order to more clearly understand the Merge mode, the operation flow for encoding using the Merge mode will now be described.

[0029] Step 1: Get a list of MVP candidates.

[0030] Step 2: Select the best MVP from the MVP candidate list and obtain the index of this MVP in the MVP candidate list.

[0031] Step 3: Let this MVP be the MV of the current block.

[0032] Step 4: Determine the position of the reference block in the reference image based on the MV.

[0033] Step 5, subtract the current block from the reference block to get the residual block.

[0034] Step 6: Send the residual data and the MVP index to the decoder.

[0035] It should be understood that the following flow is just one specific embodiment of the Merge mode, and the Merge mode may have further embodiments.

[0036] For example, Skip mode is a special case of Merge mode. After obtaining the MV by Merge mode, if the encoder determines that the current block and the reference block are essentially the same, it does not need to transmit residual data, and only needs to transmit the index of the MV, and may also transmit one marker, which indicates that the current block is directly derived from the reference block.

[0037] That is, the feature of the Merge mode is MV=MVP (MVD=0), and the Skip mode has another feature, namely, the reconstructed value rec=the predicted value pred (residual difference resi=0).

[0038] When constructing the MVP candidate list, a candidate HMVP can be selected from the HMVP candidate list and set as a candidate MVP in the MVP candidate list.

[0039] In the above-mentioned HMVP, when the encoding of one already encoded block is completed, the motion information of this already encoded block is used to update the HMVP list of the next block to be encoded, so there is a relatively strong dependency between image blocks.

[0040] In hardware implementations, the coding (e.g., motion prediction) processes of adjacent blocks can be parallelized to increase throughput, but when building the HMVP candidate list, such dependencies preclude parallel processing.

[0041] Therefore, the following technical means provided in the embodiments of the present application can overcome the dependency between image blocks.

[0042] It should be understood that the technical means of the embodiments of the present application are not limited to those using the above-mentioned Merge mode, and other encoding / decoding modes may be used, that is, any encoding / decoding mode that employs a historical motion information candidate list (e.g., an HMVP candidate list) in the encoding / decoding process can be applied.

[0043] The technical means of the embodiments of the present application can overcome dependencies between image blocks, thereby allowing them to be used in situations where image blocks are processed in parallel, but it should be understood that the present application can also be used in situations other than parallel processing, i.e., overcoming dependencies between image blocks can also be used for other purposes.

[0044] 2 is a schematic flowchart of a video processing method 200 according to an embodiment of the present application. The method 200 includes at least some of the following contents. Here, the following method 200 can be used on the encoding side or the decoding side.

[0045] In 210, a list of candidate historical motion information is obtained based on motion information of a second image block, which is an already encoded or decoded image block other than the image block included in the first region, used to encode or decode each of the first image blocks included in the first region in the current frame.

[0046] At 220, each of the first image blocks is coded or decoded respectively based on the historical motion information candidate list.

[0047] 3 is a schematic flowchart of a video processing method 300 according to an embodiment of the present application. The method 300 includes at least some of the following contents. Here, the following method 300 can be used on the encoding side or the decoding side.

[0048] At 310, at least one second image block in a second region of the current frame is encoded or decoded using the historical motion information candidate list.

[0049] At 320, the history motion information candidate list is updated based on motion information after encoding or decoding at least a portion of second image blocks in the second region to obtain the updated history motion information candidate list.

[0050] At 330, the updated historical motion information candidate list is used to encode or decode a plurality of first image blocks in a first region of the current frame.

[0051] In the above method 200 or 300, a historical motion information candidate list can be constructed using motion information of a second image block that has already been encoded or decoded, and multiple first image blocks in the first region can be encoded or decoded using the constructed historical motion information candidate list, thereby overcoming interdependencies between the multiple first image blocks and enabling the multiple first image blocks in the first region to continue to be encoded or decoded independently.

[0052] In order to more clearly understand the present application, specific embodiments of the present application will now be described. It should be understood that the following description can be applied to the methods 200 and 300 above.

[0053] In the embodiment of the present application, the history motion information candidate list may include at least one candidate history motion information, which can be selected to construct a motion information list, so that the encoding side or the decoding side can select the motion information of the current image block from the motion information list, where the candidate history motion information is obtained based on the motion information of the image block that has already been encoded or decoded.

[0054] Optionally, the motion information in the present embodiment may represent one or more combinations of a motion vector, a reference frame index value, a motion vector difference, and a motion vector prediction value.

[0055] The historical motion information candidate list in the embodiment of the present application may be an HMVP candidate list, which may selectively include at least one candidate MVP.

[0056] In the embodiment of the present application, the region (e.g., the first region or the second region) may be a Motion Estimation Region (MER). The MER may be a rectangular region or a non-rectangular region, for example, a non-rectangular region consisting of multiple squares or rectangles.

[0057] The encoding process of the image blocks within each region can be parallelized.

[0058] The size of each region in the embodiment of the present application may be the same or different. The regions may be square, rectangular, diamond, triangular, trapezoidal, or circular, etc.

[0059] In the embodiments of the present application, one region may belong to only one CTU, i.e., a region may not span CTUs, and one CTU may include one or more regions. Of course, one region may include one or more CTUs, or may include a non-integer number of CTUs, i.e., a certain CTU may belong to multiple regions.

[0060] In the present embodiment, each region may include one or more image blocks, and the size of each image block may be the same or different. The number of image blocks included in each region may be the same or different. The pixels of each region may not overlap.

[0061] The image block in the embodiment of the present application may be a coding unit (CU), and of course may be a prediction unit (PU), and the embodiment of the present application is not specifically limited thereto.

[0062] For example, in the four MERs, MER1, MER2, MER3 and MER4 shown in Figure 4, the sizes of the four MERs may be the same, and the number of image blocks included in each MER may be different, with MER1 including a total of four CUs, CU0, CU1, CU2 and CU3, MER2 including a total of five CUs, CU4, CU5, CU6, CU7 and CU8, MER3 including CU9, and MER4 including CU10, CU11 and CU12, and the sizes of each CU do not have to be exactly the same.

[0063] Optionally, in an embodiment of the present application, as shown in Fig. 5, the historical motion information candidate list can be updated using motion information of already coded or decoded image blocks of a previous region (second region), and the image blocks of a current region (first region) can be coded or decoded using the updated historical motion information candidate list. Furthermore, the historical motion information candidate list can be updated again using motion information of already coded or decoded image blocks of the current region, and can be used to code or decode image blocks of the next region.

[0064] Optionally, in an embodiment of the present application, when encoding or decoding different first image blocks for the first region, the candidate history motion information included in the history motion information candidate list to be adopted and the candidate history motion information have the same order in the history motion information candidate list.

[0065] In an example where the region is an MER, after the encoding or decoding of all image blocks in the current MER is completed, the historical motion information candidate list can be updated using motion information of the image blocks in the current MER to ensure that the historical motion information candidate list used for encoding or decoding a CU in the next MER is different from the historical motion information candidate list used in the current MER, and when encoding or decoding a CU in the next MER, the updated historical motion information candidate list is used to obtain a constructed motion information list.

[0066] For example, as shown in FIG. 4, after the encoding or decoding of all image blocks (CU0 to CU3) in MER1 is completed, the history motion information candidate list can be updated using the motion information of CU0 to CU3 before encoding or decoding image blocks in MER2, and after the updating of the history motion information candidate list is completed, in the process of encoding or decoding all image blocks (CU4 to CU8) in MER2, the history motion information candidate list used is not updated again, and the same history motion information candidate list is used for all. After the encoding or decoding of all image blocks (CU9) in MER3 is completed, before encoding or decoding image blocks in MER4, the history motion information candidate list needs to be updated using the motion information of CU9, and after the updating of the history motion information candidate list is completed, in the process of encoding or decoding all image blocks (CU10 to CU12) in MER4, the history motion information candidate list used is not updated again, and the same history motion information candidate list is used for all.

[0067] Optionally, in an embodiment of the present application, when constructing a motion information list using a historical motion information candidate list, a first-in, first-out principle may be adopted, i.e., the historical motion information added first is used to construct the previously selected motion information list.

[0068] Specifically, the first motion information (obtained based on the motion information of the image block already encoded or decoded in the second region) is added to the top of the history motion information candidate list. Here, the top refers to the position in the history motion information candidate list that is used to construct the motion information list selected first, and thus the history motion information added first to the history motion information candidate list can be preferentially selected and used to construct the motion information list.

[0069] Optionally, in an embodiment of the present application, the number of candidate historical motion information included in the historical motion information candidate list may be predetermined, i.e., the size of the historical motion information candidate list is fixed, for example, the number of candidate historical motion information included in the historical motion information candidate list may be fixed to 6.

[0070] In this way, by adding motion information of an image block that has already been encoded or decoded to the historical motion information candidate list, thereby increasing the number of candidate historical motion information contained in the historical motion information candidate list, it is possible to simultaneously delete the same number of candidate historical motion information from the historical motion information candidate list.

[0071] Here, when deleting the candidate history motion information from the history motion information candidate list, the deleted candidate history motion information may be a lower candidate history motion information in the history motion information candidate list, where the lower candidate history motion information refers to the candidate history motion information used in constructing the last selected motion information list.

[0072] Alternatively, other methods may be adopted to delete the candidate historical motion information from the historical motion information candidate list.

[0073] For example, if the candidate historical motion information added to the historical motion information candidate list is the same as the candidate historical motion information already existing in the historical motion information candidate list, the same candidate historical motion information can be deleted. Here, it can also be understood that the position of the same candidate historical motion information in the historical motion information candidate list is moved to a higher position in the historical motion information candidate list.

[0074] For example, as shown in FIG. 6, the HMVP candidate list before updating includes L pieces of candidate history motion information, and the candidate history motion information that needs to be added is HMVP 2 Check the HMVP candidate list and see if the same HMVP 2 It was found that there exists a HMVP. 2 can be moved to the top of the HMVP candidate list and the positions of other candidate history motion information can be adjusted accordingly. 2 In addition, the HMVPs in the HMVP candidate list before the update 2 It can also be understood as deleting.

[0075] It should be understood that the above-mentioned operations of deleting lower candidate history motion information and deleting the same candidate history motion information as the added candidate history motion information can exist simultaneously.

[0076] For example, if two candidate history motion information needs to be added, and one of the candidate history motion information is the same as a candidate history motion information in the list before the update, and the other candidate history motion information does not have the same candidate history motion information in the list before the update, then the same candidate history motion information can be deleted from the list and the lower candidate history motion information can be deleted so that the number of candidate history motion information added is the same as the number of candidate history motion information deleted.

[0077] Optionally, in an embodiment of the present application, in the process of updating the historical motion information candidate list each time, at least one of the number of candidate historical motion information added to the historical motion information candidate list and the number of candidate historical motion information deleted may be smaller than a predetermined value, and this predetermined value may be less than or equal to the number of candidate historical motion information allowed to be included in the historical motion information candidate list.

[0078] Optionally, in an embodiment of the present application, all of the motion information of already encoded or decoded image blocks in the second region may be used to update the historical motion information candidate list, or only a portion of the motion information of already encoded or decoded image blocks may be used to update the historical motion information candidate list.

[0079] Optionally, in an embodiment of the present application, the second image block used to update the historical motion information candidate list may be at least one of the image block last encoded or decoded in the second region or include an image block at a specified position in the second region.

[0080] Here, the image blocks at the specified positions in the second region include image blocks at at least one of the following positions:

[0081] The top left corner of the second area, the top right corner of the second area, the bottom left corner of the second area, the bottom right corner of the second area, and the center point of the second area.

[0082] Optionally, in an embodiment of the present application, second image blocks that can be used to update the historical motion information candidate list in the second region may be selected based on at least one of the position coordinates and encoding order of each second image block.

[0083] Here, at least one of the following is true: the priority level of the image block on the right side in the second region is higher than the priority level of the image block on the left side in the second region; or the priority level of the image block on the lower side in the second region is higher than the priority level of the image block on the upper side in the second region. Here, the above-mentioned lower side and upper side may be opposite positions, and do not necessarily have to be directly above or directly below. Or, the priority level of the motion information of the image block coded earlier is higher than the priority level of the image block coded later.

[0084] For example, as shown in FIG. 4, when MER2 is the current region (i.e., the first region), the priority levels of CU1 and CU3 in MER1 are higher than the priority levels of CU0 and CU2, and the priority level of CU3 is higher than the priority level of CU1.

[0085] In the embodiments of the present application, the priority level of each second image block in the second region can be determined based on at least one of the position coordinates and encoding order of the second image block, as well as other factors, and it should be understood that the embodiments of the present application are not specifically limited in this regard.

[0086] Optionally, in one embodiment of the present application, based on the number of historical motion information that needs to be updated each time, an already-encoded or decoded image block can be selected from the second region, and the motion information of the selected already-encoded or decoded image block can be used to update the historical motion information candidate list, where the number of historical motion information that needs to be updated can be equal to the number of the selected already-encoded or decoded image blocks.

[0087] For example, when two candidate historical motion information needs to be updated in the historical motion information candidate list, two image blocks that have already been encoded or decoded can be selected from the second area, the motion information of the selected two already encoded or decoded image blocks can be added to the historical motion information candidate list, and the two candidate historical motion information can be deleted.

[0088] Optionally, in another embodiment of the present application, the number of selected image blocks that have already been coded or decoded may be greater than the number of historical motion information that needs to be updated, and a weighting process may be performed on all or part of the motion information of the selected image blocks that have already been coded or decoded, so that the number of available historical motion information is equal to the number of candidate historical motion information that needs to be updated.

[0089] For example, if the number of historical motion information that needs to be updated in the historical motion information candidate list is one and the number of selected image blocks that have already been encoded or decoded is three, a weighting process can be performed on the motion information of the three already encoded or decoded image blocks to obtain one candidate historical motion information, add this candidate historical motion information to the historical motion information candidate list, and delete one candidate historical motion information from the historical motion information candidate list.

[0090] For example, if the number of pieces of historical motion information that need to be updated in the historical motion information candidate list is two and the number of selected image blocks that have already been encoded or decoded is three, a weighting process is performed on the motion information of two of the already encoded or decoded image blocks to obtain one candidate historical motion information, and this weighted candidate historical motion information and one unprocessed candidate historical motion information are added to the historical motion information candidate list, and two candidate historical motion information are deleted from the historical motion information candidate list.

[0091] Here, when weighting processing is performed on motion information of a plurality of image blocks that have already been coded or decoded, averaging processing may or may not be performed.

[0092] Here, the weighting of each motion information can be determined by at least one of the positional relationship between each already encoded or decoded image block and the first region and the encoding or decoding order of each already encoded or decoded image block.

[0093] For example, the priority level of motion information of an image block belonging to the second region, located to the left of the first region, is higher than the priority levels of motion information of the upper left and lower left image blocks.

[0094] For example, the priority level of motion information of an earlier coded image block is higher than the priority level of motion information of a later coded image block.

[0095] Optionally, in an embodiment of the present application, when multiple motion information needs to be added to a historical motion information candidate list, the multiple motion information may have priority levels, and motion information with a higher priority level is added in a top front position, and motion information with a lower priority level is added in a top rear position.

[0096] Here, the priority level of the motion information of the already coded or decoded image block can be determined according to the positional relationship between the already coded or decoded image block and the current region.

[0097] For example, the priority level of the motion information of the image block located to the left of the current region is higher than the priority level of the motion information of the top-left and bottom-left image blocks.

[0098] Optionally, in the embodiment of the present application, the image block that can be used to update the history motion information candidate list in the second region can be an image block in affine transformation motion compensation (affine) mode, where the affine mode is a field of affine motion (irregular motion such as enlargement / reduction, rotation, etc.) of the whole image block based on the motion information of the control points.

[0099] Optionally, in an embodiment of the present application, one or more second regions may be selected to update the historical motion information candidate list, and when one second region is selected to update the historical motion information candidate list, this one second region may be a region that was encoded or decoded one before the first region.

[0100] Optionally, in embodiments of the present application, the second regions and the first regions are arranged along the row direction of the image, or along the column direction of the image.

[0101] In other words, when updating the history motion information candidate list used in the current region, the adopted region needs to have the same row arrangement or the same column arrangement as the current region.

[0102] For example, as shown in Figure 4, MER1 can be used to update the HMVP candidate list and can be used to encode or decode MER2, MER3 can be used to update the HMVP candidate list and can be used to encode or decode MER4, and MER2 cannot be used to update the HMVP candidate list and cannot be used to encode or decode MER3.

[0103] Or, as shown in Figure 4, MER1 can be used to update the HMVP candidate list and can be used to encode or decode MER3, MER2 can be used to update the HMVP candidate list and can be used to encode or decode MER4, and MER3 cannot be used to update the HMVP candidate list and cannot be used to encode or decode MER2.

[0104] Optionally, in an embodiment of the present application, if the second region is the earliest encoded or decoded region in the row-wise or column-wise arrangement of the image, the HMVP candidate list used when encoding or decoding the second region is empty.

[0105] Specifically, the encoder may clear the historical motion information candidate list each time it completes encoding one row (or column), and the historical motion information candidate list is empty when encoding the next row (or column).

[0106] The row (or column) referred to here may include multiple regions, and after the encoding of the multiple regions of one row (column) is completed, the multiple regions of the next row (column) can be encoded, where the row (or column) coordinate ranges of each row (or column) are the same and the column (or row) coordinate ranges are different.

[0107] The above-mentioned rows or columns may be CTU rows or columns, where each CTU row or column includes at least one CTU, and each CTU includes at least one region.

[0108] In this case, when encoding of one CTU row or column is completed, the HMVP list can be cleared before encoding the next CTU row or column.

[0109] For example, as shown in Figure 4, when encoding a CU in MER1, if MER1 is the first MER in the current CTU row, the history motion information candidate list used by all image blocks in MER1 is empty, and if MER1 is not the first MER in the current CTU row, the history motion information candidate list used by all image blocks in MER1 is the history motion information candidate list after updating the motion information of the image block in the previous MER.

[0110] It should be understood that the embodiments of the present application are not limited to the above description, for example, the historical motion information candidate list is empty only when the first region of the current frame is encoded or decoded, and the historical motion information candidate lists of all other regions can be updated with the motion information of the image block of the previous region.

[0111] For example, as shown in Figure 4, when encoding a CU in MER1, if MER1 is the first MER in the current frame, the historical motion information candidate list used by all image blocks in MER1 is empty, and if MER1 is not the first MER in the current frame, the historical motion information candidate list used by all image blocks in MER1 is the historical motion information candidate list after updating the motion information of the image block in the previous MER.

[0112] Optionally, in an embodiment of the present application, when updating the historical motion information candidate list, historical motion information to be used for the update may be selected by pruning it against selectable candidate motion information in other lists with a higher priority level (i.e., the candidate motion information in this list is used in priority to construct the motion information list compared to the historical motion information candidate list).

[0113] Here, if the motion information list has already been constructed using other lists with higher priority levels, the historical motion information to be used for updating can be selected and compared with the existing candidate motion information in the motion information list.

[0114] If other candidate motion information with a higher priority level in the list (or candidate motion information already in the motion information list) differs from the historical motion information used for this selected update, this historical motion information can be added to this historical motion information candidate list.

[0115] If they are the same, the historical motion information may not be added to the historical motion information candidate list, and new historical motion information may be further selected and added to the historical motion information candidate list.

[0116] For example, motion information of an image block with a lower priority level in the second area may be selected and added to this historical motion information candidate list as historical motion information, or updated in this historical motion information candidate list, or a smaller number of candidate historical motion information may be updated.

[0117] Here, in order to reduce the number of comparisons described above and thereby reduce the resource costs of software and hardware, the number of comparisons may be limited.

[0118] The maximum number of comparisons can be determined by parameters such as the number of other candidate motion information with a higher priority level in the list (or the number of candidate motion information already in the motion information list) and the number of candidate historical motion information included in the historical motion information candidate list.

[0119] A specific limit for this maximum value L can be set as follows, for example. L=(N<=4)?M:(8-N) In the formula, L represents the number of comparisons, N represents the number of other candidate motion information with a higher priority level in the list (or candidate motion information already in the motion information list), and M represents the number of candidate historical motion information in the historical motion information candidate list.

[0120] The meaning of the above formula can be understood as follows: if N is less than or equal to 4, the number of comparisons is at most equal to M, and if N is greater than 4, the number of comparisons is at most 8-N.

[0121] Optionally, in the embodiment of the present application, the historical motion information candidate list may be stored in one storage space, and optionally, in this case, updating the historical motion information candidate list with motion information of at least one second image block included in a second region of the current frame is performed after encoding or decoding is completed in the second region.

[0122] Specifically, storing the above-mentioned historical motion information candidate list in one storage space can be understood as meaning that the number of historical motion information candidate lists may be one, and in this case, after completing the encoding or decoding of the previous area using this historical motion information candidate list, this historical motion information candidate list is updated using the motion information of the corresponding image block, and the updated historical motion information candidate list is used to encode or decode the image block of the current area, and after the encoding or decoding of the image block of the current area is completed, this historical motion information candidate list is updated again, and the updated historical motion information candidate list can be used for encoding or decoding the next area.

[0123] Optionally, in the embodiment of the present application, the above-mentioned history motion information candidate list may be stored in a first storage space and a second storage space other than the first storage space, respectively. At this time, the history motion information candidate list stored in one of the storage spaces can be used to encode or decode an image block of a second region, and in the process of encoding or decoding in the second region, the history motion information candidate list stored in the other storage space can be updated using the second image block of the second region that has already been encoded or decoded, thereby realizing the simultaneous progress of the encoding or decoding process and the history motion information candidate list.

[0124] For ease of understanding, two embodiments are provided below to describe how to use the history motion information candidate list when the history motion information candidate list is stored in the first storage space and the second storage space respectively.

[0125] EMBODIMENT 1 The history motion information candidate list is stored in a first storage space and a second storage space, and the second area performs encoding or decoding using the history motion information candidate list in the second storage space. In the encoding process or decoding process of the second area, the history motion information candidate list in the first storage space is updated using motion information of at least one second image block included in the second area. Each of the first image blocks is encoded or decoded based on the updated history motion information candidate list in the first storage space.

[0126] Furthermore, after the encoding or decoding of the second region is completed, the history motion information candidate list in the second storage space is updated using the updated history motion information candidate list in the first storage space. At least one third image block of a third region is encoded or decoded using the updated history motion information candidate list in the second storage space. Here, the history motion information candidate list in the second storage space is updated to make the updated history motion information candidate list in the second storage space the same as the updated history motion information candidate list in the first storage space.

[0127] Specifically, when encoding or decoding a first region, region 1 (the first region of the current frame or the current CTU row), the same history motion information candidate list (which may be empty) is stored in storage space A and storage space B, respectively, and this region 1 can be encoded or decoded using the history motion information candidate list in storage space A. Since the encoding or decoding of image blocks in region 1 is completed in a reverse order, the history motion information candidate list in storage space B can be updated using the motion information of the image block that has already been encoded or decoded. After the encoding or decoding process of region 1 is completed, the history motion information candidate list in storage space B may have already been updated, and at this time, the second region, region 2, can be encoded or decoded using the updated history motion information candidate list in storage space B, while the history motion information candidate list in storage space A can be updated using the updated history motion information candidate list in storage space B. After the history motion information candidate list in storage space A is updated based on the updated history motion information candidate list in storage space B, in the process of encoding or decoding area 2, the history motion information candidate list in storage space A can be updated again using the already encoded or decoded image block in area 2. After the encoding or decoding process of area 2 is completed, the history motion information candidate list in storage space A may have already been updated again, and the history motion information candidate list in storage space A can be used to encode or decode the image block in the third area, area 3, while the history motion information candidate list in storage space B can be updated again using the history motion information candidate list in storage space A. Subsequent operations can be sequentially inferred with reference to the previous description.

[0128] In this embodiment, the historical motion information candidate lists are stored in two storage spaces, and the historical motion information candidate lists in each storage space are used alternately for encoding or decoding a region, and in the encoding or decoding process of the region, a historical motion information candidate list that is not yet used can be updated (including updating the used historical motion information candidate list to this historical motion information candidate list that is not yet used, and updating the motion information of the image block that has already been encoded or decoded to this historical motion information candidate list that is not yet used), thereby realizing simultaneous updating of the historical motion information candidate list and encoding or decoding of the image block, and improving the efficiency of encoding or decoding.

[0129] EMBODIMENT 2 The history motion information candidate list is stored in a first storage space and a second storage space, respectively, and the second area performs encoding or decoding using the history motion information candidate list in the second storage space. In the encoding process or decoding process of the second area, the history motion information candidate list in the first storage space is updated using motion information of at least one second image block included in the second area. After the encoding or decoding of the second area is completed, the history motion information candidate list in the second storage space is updated using the updated history motion information candidate list in the first storage space. Each of the first image blocks is encoded or decoded based on the updated history motion information candidate list in the second storage space. Furthermore, in the encoding process or decoding process of the first area, the history motion information candidate list in the first storage space is updated again using motion information of at least one first image block included in the first area. After the encoding or decoding of the first region is completed, the history motion information candidate list in the second storage space is updated again using the history motion information candidate list updated again in the first storage space. At least one third image block of a third region is encoded or decoded based on the history motion information candidate list updated again in the second storage space, respectively. Here, the history motion information candidate list in the second storage space is updated to make the history motion information candidate list after update in the second storage space the same as the history motion information candidate list after update in the first storage space.

[0130] Specifically, when encoding or decoding a first region, region 1 (the first region of the current frame or the current CTU row), the same history motion information candidate list (the list may be empty) is stored in storage space A and storage space B, respectively, and this region 1 can be encoded or decoded using the history motion information candidate list in storage space A. Since the encoding or decoding of image blocks in region 1 is completed in a reverse order, the history motion information candidate list in storage space B can be updated using the motion information of image blocks that have already been encoded or decoded. After the encoding or decoding process of region 1 is completed, the history motion information candidate list in storage space B may have already been updated, and at this time, the history motion information candidate list in storage space B can be used to update the history motion information candidate list in storage space A, and the updated history motion information candidate list in storage space A can be obtained. In addition, the updated history motion information candidate list in storage space A is used to encode or decode a second region, region 2, and in the process of encoding or decoding region 2, the history motion information candidate list in storage space B is updated again. After the encoding or decoding process of area 2 is completed, the history motion information candidate list in storage space B may have already been updated again, at this time, the history motion information candidate list in storage space B can be used to update the history motion information candidate list in storage space A again, and area 3 can be encoded or decoded by updating the history motion information candidate list in storage space A again. The subsequent operations can be sequentially inferred from the above description.

[0131] In this embodiment, the history motion information candidate list is stored in two storage spaces, and the history motion information candidate list in one storage space is always used for encoding or decoding the region, and the history motion information candidate list in the other storage space is updated during the encoding or decoding process of the region. After encoding or decoding the region, the history motion information candidate list in the one storage space is updated using the updated history motion information candidate list in the other storage space. The time required to update the history motion information candidate list in the other storage space using the updated history motion information candidate list in one storage space is likely to be shorter than the time required to update the history motion information candidate list in the other storage space using the motion information of the image block, so in this embodiment, after the encoding or decoding of the region is completed, it is only necessary to update the history motion information candidate list in the other storage space using the updated history motion information candidate list in one storage space, and the time required for updating is relatively short, which can improve the efficiency of encoding or decoding.

[0132] How to update the history motion information candidate list has been described above. Next, how to perform encoding or decoding using the updated history motion information candidate list will be described.

[0133] Specifically, the updated historical motion information candidate list is used to generate a motion information list for each of the first image blocks in the first region, and motion information can be selected for each of the first image blocks using the motion information list generated for each of the first image blocks.

[0134] Here, on the encoding side, when selecting motion information from the motion information list, the first image block currently waiting to be encoded is matched with the image block corresponding to each motion information in the motion information list, the motion information corresponding to the image block with the smallest matching cost is selected as the selected motion information, and an index of the motion information is written to the stream.

[0135] The decoding side can employ the same method to construct a motion information list, read the motion information index from the stream, and select the motion information of the current image block directly from the motion information list based on this index, thereby further performing decoding using this motion information.

[0136] Next, how to construct the motion information list will be described using an example of Merge mode and the motion information list being an MVP candidate list.

[0137] Here, the configuration of the MVP candidate list may include at least some of the following (1) to (5).

[0138] Specifically, an MVP candidate list is constructed using the spatial domain candidate MV in (1), and if the number of candidate MVPs included in the MVP candidate list constructed at this time has not reached a predetermined number, the time domain candidate MV in (2) can be continued to be added to the MVP candidate list including the spatial domain candidate MV, and if the number of candidate MVPs included in the MVP candidate list constructed at this time has not reached a predetermined number, the pairwise candidate MV in (3) can be continued to be added to the MVP candidate list including the spatial domain candidate MV and the time domain candidate MV, and if the number of candidate MVPs included in the MVP candidate list constructed at this time has not reached a predetermined number, the HMVP in (4) can be continued to be added to the MVP candidate list including the spatial domain candidate MV, the time domain candidate MV, and the pairwise candidate MV, and if the number of candidate MVPs included in the MVP candidate list constructed at this time has not reached a predetermined number, the zero vector in (5) can be continued to be added to the MVP candidate list including the spatial domain candidate MV, the time domain candidate MV, the pairwise candidate MV, and the HMVP until the number of candidate MVPs in the MVP candidate list reaches a predetermined value.

[0139] Here, when adding any of the next candidates to the MVP candidate list, if the number of candidate MVPs included in this list has already reached a predetermined number, it is possible to stop adding the surplus elements to the MVP candidate list.

[0140] Next, each part that makes up the candidate MVP list will be described.

[0141] (1) Spatial region candidate MV Specifically, the MVs of the current image block and its spatially adjacent image blocks can be candidate MVPs that can be added to the MVP candidate list.

[0142] For example, as shown in FIG. 7, if the image block at the bottom left corner of the current image block is A0, the image block to the left is A1, the image block at the top left corner is B2, the image block at the top is B1, and the image block at the top right corner is B0, the order of candidate MVPs is A1→B1→B0→A0→B2, from highest to lowest, based on the priority level.

[0143] (2) Time domain candidate MV Specifically, the MVs of the current image block and its adjacent image blocks in the time domain can be candidate MVPs that can be added to the MVP candidate list.

[0144] Different from the spatial domain candidate MV, the temporal domain candidate MV can make corresponding scaling adjustment based on the temporal domain positional relationship between the current frame and the reference frame without directly using the motion information of the candidate block.

[0145] (3) Pairwise candidate MV Based on the candidate MVPs that already constitute the current MVP candidate list, we average them over predefined pairs to derive pairwise candidate MVs.

[0146] The predefined pairing schemes and orderings are (0,1), (0,2), (1,2), (0,3), (1,3), (2,3), where 0, 1, 2 and 3 respectively represent the first, second, third and fourth candidate MVPs existing in the HMVP candidate list, and each bracket represents the average over the MVP candidates within it.

[0147] (4) HMVP The MVs that have already encoded the image block can be employed to construct an HMVP candidate list, and the candidate HMVPs in the HMVP candidate list can be selected as candidate MVPs to be added to the MVP candidate list.

[0148] (5) Zero Vector If the number of MVP candidates in the MVP candidate list still does not reach a predetermined number when each of the items (1) to (4) is added to the MVP candidate list, the list can be filled with zero vectors until the number of candidate MVPs in the MVP candidate list reaches a predetermined value.

[0149] It should be understood that the above-described motion information list is merely a specific embodiment of the embodiment of the present application, and does not particularly limit the embodiment of the present application.

[0150] Optionally, in the embodiment of the present application, when constructing a spatial domain motion information candidate list, the motion information of image blocks in the same region may be avoided. Specifically, the image blocks corresponding to the motion information in the spatial domain motion information candidate list corresponding to each of the first image blocks do not belong to the first region.

[0151] For example, as shown in FIG. 8, for the first MER, all possible spatial domain candidate motion information of the image block CU0 (motion information of the image block in which the gray-filled blocks are located) can be obtained because all image blocks corresponding to the spatial domain candidate motion information are outside the MER in which CU0 is located. For the second MER, CU5, the spatial domain candidate motion information should originally include motion information of the image blocks corresponding to the three surrounding black-filled blocks and one white-filled block, but if the image block corresponding to the one white-filled block has not yet been coded and the image block corresponding to the three black-filled blocks belongs to the same MER as CU5, the spatial domain candidate motion information in CU5 may not include the motion information of these blocks. At this time, the spatial domain candidate motion information list of CU5 may be empty, and the motion information of the image blocks of other MERs may be selected as candidates for the spatial domain candidate motion information list. For CU9, the spatial domain candidate motion information should originally include motion information of image blocks corresponding to the surrounding two gray-filled blocks, one black-filled block, and two white-filled blocks, but since the image blocks corresponding to the white-filled blocks have not yet been coded and the image block corresponding to the one black-filled block belongs to the same MER as CU9, the spatial domain candidate motion information list of CU9 may include motion information of the image blocks corresponding to the two gray-filled blocks.

[0152] In an embodiment of the present application, a historical motion information candidate list can be constructed using motion information of a second image block that has already been encoded or decoded, and multiple first image blocks of a first region can be encoded or decoded using the constructed historical motion information candidate list, thereby overcoming the dependency of the multiple first image blocks and enabling the multiple first image blocks of the first region to continue to be encoded or decoded independently.

[0153] 9 is a schematic block diagram of a video processing apparatus 400 according to an embodiment of the present application. The apparatus 400 includes: an acquisition unit 410 and an encoding or decoding unit 420.

[0154] Here, the acquisition unit 410 is used to acquire a historical motion information candidate list acquired based on motion information of a second image block, which is an already encoded or decoded image block other than the image block included in the first area, used to encode or decode each of the first image blocks in a plurality of first image blocks included in the first area in the current frame, and the encoding or decoding unit 420 is used to encode or decode each of the first image blocks, respectively, based on the historical motion information candidate list.

[0155] Optionally, in this embodiment, the encoding or decoding unit 420 can be further used for:

[0156] The plurality of first image blocks are encoded or decoded in parallel based on the historical motion information candidate list.

[0157] Optionally, in an embodiment of the present application, when encoding or decoding different first image blocks, the candidate history motion information included in the history motion information candidate list to be adopted and the candidate history motion information have the same order in the history motion information candidate list.

[0158] Optionally, in the embodiment of the present application, the acquisition unit 410 can be further used for:

[0159] The historical motion information candidate list is updated using motion information of at least one second image block included in a second region of the current frame, and the updated historical motion information candidate list is used for encoding or decoding the multiple first image blocks.

[0160] Optionally, in an embodiment of the present application, the encoding or decoding process of the second region is faster than that of the first region, and image blocks of the second region are encoded or decoded using the historical motion information candidate list that has not yet been updated.

[0161] Optionally, in an embodiment of the present application, when updating the historical motion information candidate list, at least one of the following is true: the number of candidate historical motion information added to the historical motion information candidate list is less than a predetermined value, or the number of candidate historical motion information deleted from the historical motion information candidate list is less than a predetermined value.

[0162] Optionally, in the embodiment of the present application, the device 400 further includes a selection unit 430, which is used for: selecting the first and second inputs;

[0163] The at least one second image block is selected from the image blocks included in the second region based on position coordinates of the image blocks in the second region.

[0164] Optionally, in an embodiment of the present application, in the step of selecting the at least one second image block from the image blocks included in the second region, At least one of the following: the priority level of the image block on the right side in the second area is higher than the priority level of the image block on the left side in the second area, or the priority level of the image block on the lower side in the second area is higher than the priority level of the image block on the upper side in the second area.

[0165] Optionally, in an embodiment of the present application, the at least one second image block includes at least one of the last encoded or decoded image block in the second region or the image block at a specified position in the second region.

[0166] Optionally, in an embodiment of the present application, the image blocks at the specified positions in the second region include image blocks at at least one of the following positions:

[0167] The top left corner of the second area, the top right corner of the second area, the bottom left corner of the second area, the bottom right corner of the second area, and the center point of the second area.

[0168] Optionally, in the embodiment of the present application, the acquisition unit 410 can be further used for:

[0169] A weighting process is performed on the motion information of the plurality of second image blocks.

[0170] The weighted motion information is used to update the historical motion information candidate list.

[0171] Optionally, in embodiments of the present application, the first regions and the second regions are arranged along the row direction of the image, or along the column direction of the image.

[0172] Optionally, in an embodiment of the present application, the first region and the second region belong to the same coding tree unit CTU row or CTU column, each CTU row or CTU column includes at least one CTU, and each CTU includes at least one region.

[0173] Optionally, in an embodiment of the present application, if the second region is the region that was encoded or decoded earliest among the array along the row direction or the array along the column direction of the image, the historical motion information candidate list used when encoding or decoding the second region is empty.

[0174] Optionally, in an embodiment of the present application, the second region is a region that is encoded or decoded immediately before the first region.

[0175] Optionally, in the embodiment of the present application, the acquisition unit 410 can be further used for:

[0176] The first candidate historical motion information that needs to be added is added to the top of the historical motion information candidate list.

[0177] Optionally, in the embodiment of the present application, the acquisition unit 410 can be further used for:

[0178] The candidate history motion information at the end of the history motion information candidate list is deleted, or the candidate history motion information that is the same as the first candidate history motion information in the history motion information table is deleted.

[0179] Optionally, in an embodiment of the present application, the second image block is an image block of a non-affine transformation motion compensation mode.

[0180] Optionally, in this embodiment, the encoding or decoding unit 420 can be further used for:

[0181] The historical motion information candidate list is used to generate a motion information list for each of the first image blocks respectively.

[0182] The motion information list generated for each of the first image blocks is used to select motion information for each of the first image blocks.

[0183] Optionally, in this embodiment, the encoding or decoding unit 420 can be further used for:

[0184] The historical motion information candidate list and the spatial domain motion information candidate list corresponding to each of the first image blocks are used to generate a motion information list for each of the first image blocks, respectively.

[0185] The image blocks corresponding to the motion information in the spatial domain motion information candidate list corresponding to each of the first image blocks do not belong to the first domain.

[0186] Optionally, in an embodiment of the present application, the historical motion information candidate list is a historical based motion vector prediction HMVP candidate list.

[0187] Optionally, in an embodiment of the present application, the history motion information candidate list is stored in one storage space.

[0188] Optionally, in an embodiment of the present application, updating the historical motion information candidate list using motion information of at least one second image block included in a second region of the current frame is performed after encoding or decoding is completed in the second region.

[0189] Optionally, in an embodiment of the present application, the historical motion information candidate list is stored in a first storage space and a second storage space respectively, the second area performs encoding or decoding using the historical motion information candidate list in the second storage space, and the acquisition unit is further used for the following:

[0190] During the encoding or decoding process of the second region, the motion information of at least one second image block included in the second region is used to update the history motion information candidate list in the first storage space.

[0191] The encoding or decoding unit 420 is further used for:

[0192] respectively encoding or decoding each of the first image blocks based on the updated historical motion information candidate list in the first storage space;

[0193] Optionally, in the embodiment of the present application, the acquisition unit 410 can be further used for:

[0194] After the encoding or decoding of the second region is completed, the history motion information candidate list in the second storage space is updated using the updated history motion information candidate list in the first storage space.

[0195] Optionally, in the embodiment of the present application, the acquisition unit 410 can be further used for:

[0196] The history motion information candidate list in the second storage space is updated, and the history motion information candidate list after the update in the second storage space is made the same as the history motion information candidate list after the update in the first storage space.

[0197] Optionally, in an embodiment of the present application, the historical motion information candidate list is stored in a first storage space and a second storage space respectively, the second area performs encoding or decoding using the historical motion information candidate list in the second storage space, and the acquisition unit 410 is further used for the following:

[0198] During the encoding or decoding process of the second region, the motion information of at least one second image block included in the second region is used to update the history motion information candidate list in the first storage space.

[0199] After the encoding or decoding of the second region is completed, the history motion information candidate list in the second storage space is updated using the updated history motion information candidate list in the first storage space.

[0200] The encoding or decoding unit 420 is further used for:

[0201] respectively encoding or decoding each of the first image blocks based on the updated historical motion information candidate list in the second storage space;

[0202] Optionally, in the embodiment of the present application, the acquisition unit 410 can be further used for:

[0203] In the encoding or decoding process of the first region, the motion information of at least one first image block included in the first region is used to update the history motion information candidate list in the first storage space again.

[0204] After the encoding or decoding of the first region is completed, the history motion information candidate list in the second storage space is updated again using the history motion information candidate list updated again in the first storage space.

[0205] Optionally, in the embodiment of the present application, the acquisition unit 410 can be further used for:

[0206] The history motion information candidate list in the second storage space is updated, and the history motion information candidate list after the update in the second storage space is made the same as the history motion information candidate list after the update in the first storage space.

[0207] It should be understood that the video processing device 400 can implement the corresponding operations implemented by the encoding side or the decoding side in the above method embodiments, which will not be described again here for the sake of brevity.

[0208] 10 is a schematic block diagram of a video processing apparatus 500 according to an embodiment of the present application. The apparatus 500 includes an encoding or decoding unit 510 and an updating unit 520.

[0209] The encoding or decoding unit 510 is used for encoding or decoding at least one second image block in a second region of the current frame using the historical motion information candidate list.

[0210] The update unit 520 is used to update the historical motion information candidate list based on motion information after encoding or decoding at least a portion of the second image block in the second region, and obtain the updated historical motion information candidate list.

[0211] The encoding or decoding unit 510 is further used for encoding or decoding a plurality of first image blocks in a first region of the current frame using the updated historical motion information candidate list.

[0212] Optionally, in the present embodiment, the encoding or decoding unit 510 is further used for:

[0213] The updated historical motion information candidate list is used to encode or decode the first image blocks in parallel.

[0214] Optionally, in an embodiment of the present application, when encoding or decoding different first image blocks, the candidate history motion information included in the history motion information candidate list to be adopted and the candidate history motion information have the same order in the history motion information candidate list.

[0215] Optionally, in an embodiment of the present application, when updating the historical motion information candidate list, at least one of the following is true: the number of candidate historical motion information added to the historical motion information candidate list is less than a predetermined value, or the number of candidate historical motion information deleted from the historical motion information candidate list is less than a predetermined value.

[0216] Optionally, in the embodiment of the present application, the device 500 further includes a selection unit 530, which is used for: selecting the first and second inputs;

[0217] At least a portion of the second image blocks are selected from the image blocks included in the second region based on position coordinates of the image blocks in the second region.

[0218] Optionally, in an embodiment of the present application, in the step of selecting the at least some second image blocks from the image blocks included in the second region, At least one of the following: the priority level of the image block on the right side in the second area is higher than the priority level of the image block on the left side in the second area, or the priority level of the image block on the lower side in the second area is higher than the priority level of the image block on the upper side in the second area.

[0219] Optionally, in the present embodiment, the update unit 520 is further used for:

[0220] A weighting process is performed on the motion information of at least some of the second image blocks.

[0221] The weighted motion information is used to update the historical motion information candidate list.

[0222] Optionally, in embodiments of the present application, the second regions and the first regions are arranged along the row direction of the image, or along the column direction of the image.

[0223] Optionally, in an embodiment of the present application, the second region and the first region belong to the same coding tree unit CTU row or CTU column, each CTU row or CTU column includes at least one CTU, and each CTU includes at least one region.

[0224] Optionally, in an embodiment of the present application, if the second region is the region that was encoded or decoded earliest among the array along the row direction or the array along the column direction of the image, the historical motion information candidate list used when encoding or decoding the second region is empty.

[0225] Optionally, in an embodiment of the present application, the second region is a region that is encoded or decoded immediately before the first region.

[0226] Optionally, in the present embodiment, the update unit 520 is further used for:

[0227] The first candidate historical motion information that needs to be added is added to the top of the historical motion information candidate list.

[0228] Optionally, in the present embodiment, the update unit 520 is further used for:

[0229] The candidate history motion information at the end of the history motion information candidate list is deleted, or the candidate history motion information that is the same as the first candidate history motion information in the history motion information table is deleted.

[0230] Optionally, in an embodiment of the present application, the second image block is an image block of a non-affine transformation motion compensation mode.

[0231] Optionally, in the present embodiment, the encoding or decoding unit 510 is further used for:

[0232] The updated historical motion information candidate list is used to generate a motion information list for each first image block respectively.

[0233] The motion information list generated for each of the first image blocks is used to select motion information for each of the first image blocks.

[0234] Optionally, in the present embodiment, the encoding or decoding unit 510 is further used for:

[0235] The motion information list is generated for each of the first image blocks using the updated historical motion information candidate list and the spatial domain motion information candidate list corresponding to each of the first image blocks.

[0236] The image blocks corresponding to the motion information in the spatial domain motion information candidate list corresponding to each of the first image blocks do not belong to the first domain.

[0237] Optionally, in an embodiment of the present application, the historical motion information candidate list is a historical based motion vector prediction HMVP candidate list.

[0238] Optionally, in an embodiment of the present application, the at least some second image blocks include at least one of the last encoded or decoded image block in the second region or the image block at a specified position in the second region.

[0239] Optionally, in an embodiment of the present application, the image blocks at the specified positions in the second region include image blocks at at least one of the following positions:

[0240] The top left corner of the second area, the top right corner of the second area, the bottom left corner of the second area, the bottom right corner of the second area, and the center point of the second area.

[0241] Optionally, in an embodiment of the present application, the history motion information candidate list is stored in one storage space.

[0242] Optionally, in an embodiment of the present application, updating the historical motion information candidate list using motion information of at least a portion of a second image block included in a second region of the current frame is performed after encoding or decoding is completed in the second region.

[0243] Optionally, in an embodiment of the present application, the historical motion information candidate list is stored in a first storage space and a second storage space respectively, the second area performs encoding or decoding using the historical motion information candidate list in the second storage space, and the update unit is further used for the following:

[0244] During the encoding or decoding process of the second region, the motion information of at least a portion of the second image blocks included in the second region is used to update the history motion information candidate list in the first storage space.

[0245] The encoding or decoding unit 520 is further used for:

[0246] respectively encoding or decoding each of the first image blocks based on the updated historical motion information candidate list in the first storage space;

[0247] Optionally, in the present embodiment, the update unit 520 is further used for:

[0248] After the encoding or decoding of the second region is completed, the history motion information candidate list in the second storage space is updated using the updated history motion information candidate list in the first storage space.

[0249] Optionally, in the present embodiment, the update unit 520 is further used for:

[0250] The history motion information candidate list in the second storage space is updated, and the history motion information candidate list after the update in the second storage space is made the same as the history motion information candidate list after the update in the first storage space.

[0251] Optionally, in an embodiment of the present application, the historical motion information candidate list is stored in a first storage space and a second storage space respectively, and the second area performs encoding or decoding using the historical motion information candidate list in the second storage space, and the update unit 520 is further used for the following:

[0252] During the encoding or decoding process of the second region, the motion information of at least a portion of the second image blocks included in the second region is used to update the history motion information candidate list in the first storage space.

[0253] After the encoding or decoding of the second region is completed, the history motion information candidate list in the second storage space is updated using the updated history motion information candidate list in the first storage space.

[0254] The encoding or decoding unit 510 is further used to respectively encode or decode each of the first image blocks based on the updated historical motion information candidate list in the second storage space.

[0255] Optionally, in the present embodiment, the update unit 520 is further used for:

[0256] In the encoding or decoding process of the first region, the motion information of at least one first image block included in the first region is used to update the history motion information candidate list in the first storage space again.

[0257] After the encoding or decoding of the first region is completed, the history motion information candidate list in the second storage space is updated again using the history motion information candidate list updated again in the first storage space.

[0258] Optionally, in the present embodiment, the update unit 520 is further used for:

[0259] The history motion information candidate list in the second storage space is updated, and the history motion information candidate list after the update in the second storage space is made the same as the history motion information candidate list after the update in the first storage space.

[0260] It should be understood that the video processing device 500 can implement the corresponding operations implemented by the encoding side or the decoding side in the above method embodiments, which will not be described again here for the sake of brevity.

[0261] FIG. 11 illustrates a schematic block diagram of a computer system 600 according to an embodiment of the present application.

[0262] As shown in FIG. 11, the computer system 600 may include a processor 610 and may further include a memory 620 .

[0263] It should be understood that the computer system 600 may further include components typically included in other computer systems, such as an input / output device, a communication interface, etc., and the embodiments of the present application are not limited in this respect.

[0264] The memory 620 is used to store computer-executable instructions.

[0265] The memory 620 can be various types of memory, and may include, for example, a high-speed random access memory (RAM), and may further include a non-volatile memory, such as at least one hard disk memory, although embodiments of the present application are not limited in this respect.

[0266] A processor 610 is used to access the memory 620 and execute the computer-executable commands to perform operations in the methods for video processing of the embodiments of the present application described above.

[0267] The processor 610 may include a microprocessor, a Field-Programmable Gate Array (FPGA), a Central Processing unit (CPU), a Graphics Processing Unit (GPU), etc., although embodiments of the present application are not limited in this regard.

[0268] The device and computer system used for video processing in the embodiments of the present application may correspond to the executing entity of the method used for video processing in the embodiments of the present application, and the corresponding flow for realizing at least one of the above and other operations and functions of each module in the device and computer system used for video processing, respectively, will not be described again here for the sake of brevity.

[0269] The embodiments of the present application further provide an electronic device, which may include a device or computer system used for the video processing of the various embodiments of the present application described above.

[0270] The present embodiment further provides a computer storage medium having stored thereon program code that can be used to instruct the execution of the loop filter method of the present embodiment.

[0271] In the embodiments of the present application, it should be understood that the term "at least one" is merely a relation between related objects, and indicates that three kinds of relations may exist. For example, at least one of A and B can represent three kinds of situations: A exists alone, A and B exist simultaneously, and B exists alone. In addition, the symbol " / " in the present text generally indicates that the related objects before and after are in a kind of "or" relationship.

[0272] Those skilled in the art can recognize that the units and operation steps of each example described in the embodiments disclosed herein can be combined and realized by electronic hardware, computer software, or a combination of both, and in order to clearly explain the compatibility of hardware and software, the above description has already provided a general description of the configurations and steps of each example according to their functions. Whether these functions are implemented in hardware or software form depends on the specific application and design constraints of the technical solution. Those skilled in the art can realize the described functions in different ways for each specific application, but this kind of implementation should not be considered as departing from the scope of the present application.

[0273] Those skilled in the art can clearly understand that for the convenience and conciseness of description, the specific operation processes of the above-mentioned systems, devices and units may refer to the corresponding processes in the above-mentioned method embodiments and will not be described in detail here.

[0274] It should be understood that the disclosed system, device and method may be realized in other ways in some embodiments provided in the present application. For example, the above-mentioned device embodiments are merely schematic, and the distinction between the units is merely a distinction between logical functions, and may have other distinguishing ways in actual implementation, for example, multiple units or assemblies may be combined or integrated into another system, or some features may be omitted or not implemented. In addition, the shown or discussed couplings or direct couplings or communication connections between each other may be indirect couplings or communication connections of some interfaces, devices or units, and may be electrical, mechanical or other types of connections.

[0275] The units described as separate components may be physically separated or not, and the components shown as units may be physical units or not, i.e., located in one place or distributed across multiple network units. According to actual needs, some or all of the units may be selected to achieve the objectives of the technical means of the embodiments of the present application.

[0276] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist physically alone, or multiple units may be integrated into one unit. The integrated unit may be realized in the form of hardware or in the form of a software functional unit.

[0277] When the integrated unit is realized in the form of a software functional unit and sold or used as an independent product, it may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application may be realized in the form of a software product, either essentially or in part of the contribution to the prior art, or in whole or in part of the technical solution, and the computer software product may store a number of commands in a storage medium to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The storage medium includes various media capable of storing program code, such as a USB flash drive, a portable hard disk drive, a read-only memory (ROM), a random access memory (RAM), a floppy disk, or an optical disk.

[0278] The above content is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto, and any equivalent modifications or replacements that a person skilled in the art can easily think of within the technical scope disclosed in the present application are all within the scope of protection of the present application. Therefore, the scope of protection of the present application is based on the scope of protection of the claims. (Item 1) A video processing method, comprising: Obtaining a history motion information candidate list obtained based on motion information of a second image block, which is an already encoded or decoded image block other than the image block included in the first area and is used for encoding or decoding each of the first image blocks included in the first area in the current frame; and encoding or decoding each of the first image blocks based on the historical motion information candidate list, respectively. (Item 2) encoding or decoding each of the first image blocks respectively based on the historical motion information candidate list, 2. The method of claim 1, further comprising encoding or decoding the first image blocks in parallel based on the historical motion information candidate list. (Item 3) The method described in item 1 or 2, wherein when encoding or decoding different first image blocks, the candidate history motion information included in the history motion information candidate list to be adopted and the candidate history motion information are in the same order in the history motion information candidate list. (Item 4) The obtaining of the history motion information candidate list includes: A method according to any one of items 1 to 3, comprising updating the history motion information candidate list using motion information of at least one second image block included in a second region of the current frame, and using the updated history motion information candidate list for encoding or decoding the plurality of first image blocks. (Item 5) The method described in item 4, wherein the encoding or decoding process of the second region is faster than that of the first region, and image blocks of the second region are encoded or decoded using the historical motion information candidate list that has not yet been updated. (Item 6) The method described in item 4 or 5, wherein when updating the history motion information candidate list, at least one of the following occurs: the number of candidate history motion information added to the history motion information candidate list is less than a predetermined value; or the number of candidate history motion information deleted from the history motion information candidate list is less than a predetermined value. (Item 7) before updating the historical motion information candidate list with motion information of at least one second image block included in a second region of the current frame; 7. The method according to any one of items 4 to 6, further comprising selecting the at least one second image block from the image blocks included in the second region based on position coordinates of the image block of the second region. (Item 8) In the step of selecting the at least one second image block from the image blocks included in the second region, 8. The method according to item 7, wherein at least one of the priority level of the image block on the right side in the second region is higher than the priority level of the image block on the left side in the second region, or the priority level of the image block on the lower side in the second region is higher than the priority level of the image block on the upper side in the second region. (Item 9) 9. The method according to any one of items 4 to 8, wherein the at least one second image block includes at least one of an image block that was last encoded or decoded in the second region and an image block at a specified position in the second region. (Item 10) The image block at the specified position in the second region is 10. The method of claim 9, including an image block located at at least one of the top left corner of the second region, the top right corner of the second region, the bottom left corner of the second region, the bottom right corner of the second region, and the center point of the second region. (Item 11) Updating the historical motion information candidate list with motion information of at least one second image block included in a second region of the current frame includes: performing a weighting process on motion information of a plurality of the second image blocks; 11. The method according to any one of items 4 to 10, further comprising: updating the history motion information candidate list using the weighted motion information. (Item 12) 12. The method according to any one of items 4 to 11, wherein the first region and the second region are arranged along a row direction of an image or along a column direction of an image. (Item 13) Item 13. The method of item 12, wherein the first region and the second region belong to the same coding tree unit CTU row or CTU column, each CTU row or CTU column includes at least one CTU, and each CTU includes at least one region. (Item 14) The method according to item 12 or 13, wherein when the second region is the region that was encoded or decoded earliest among the array along the row direction or the array along the column direction of the image, the history motion information candidate list used when encoding or decoding the second region is empty. (Item 15) 15. The method according to any one of items 4 to 14, wherein the second region is an area that is encoded or decoded immediately before the first region. (Item 16) Updating the historical motion information candidate list includes: 16. The method according to any one of items 4 to 15, comprising adding a first candidate history motion information that needs to be added to a top position of the history motion information candidate list. (Item 17) Updating the historical motion information candidate list includes: The method of item 16, further comprising deleting candidate history motion information at the end of the history motion information candidate list or deleting candidate history motion information that is the same as the first candidate history motion information in the history motion information table. (Item 18) 18. The method according to any one of items 1 to 17, wherein the second image block is an image block of a non-affine transformation motion compensation mode. (Item 19) encoding or decoding each of the first image blocks using the historical motion information candidate list, respectively, generating a motion information list for each of the first image blocks using the historical motion information candidate list; 19. The method according to any one of items 1 to 18, further comprising: selecting motion information for each of the first image blocks using the motion information list generated for each of the first image blocks, respectively. (Item 20) generating a motion information list for each of the first image blocks using the historical motion information candidate list, generating a motion information list for each of the first image blocks using the historical motion information candidate list and a spatial domain motion information candidate list corresponding to each of the first image blocks; 20. The method according to item 19, wherein the image blocks corresponding to the motion information in the spatial domain motion information candidate list corresponding to each of the first image blocks do not belong to the first domain. (Item 21) 21. The method according to any one of items 1 to 20, wherein the historical motion information candidate list is a historical based motion vector prediction HMVP candidate list. (Item 22) 22. The method according to any one of items 1 to 21, wherein the history motion information candidate list is stored in one storage space. (Item 23) A method according to any one of items 1 to 22, wherein updating the historical motion information candidate list using motion information of at least one second image block included in a second region of the current frame is performed after encoding or decoding is completed in the second region. (Item 24) The historical motion information candidate list is stored in a first storage space and a second storage space, respectively, and the second region is encoded or decoded using the historical motion information candidate list in the second storage space; and updating the historical motion information candidate list using motion information of at least one second image block included in the second region of the current frame is performed. In the encoding or decoding process of the second region, updating the history motion information candidate list in the first storage space using motion information of at least one second image block included in the second region; encoding or decoding each of the first image blocks respectively based on the historical motion information candidate list, 18. The method according to any one of items 4 to 17, comprising encoding or decoding each of the first image blocks based on the updated history motion information candidate list in the first storage space. (Item 25) The method described in item 24, further comprising updating the historical motion information candidate list in the second storage space with the updated historical motion information candidate list in the first storage space after encoding or decoding of the second region is completed. (Item 26) Updating the history motion information candidate list in the second storage space using the updated history motion information candidate list in the first storage space includes: The method described in item 25, further comprising updating the historical motion information candidate list in the second storage space so that the updated historical motion information candidate list in the second storage space is the same as the updated historical motion information candidate list in the first storage space. (Item 27) The historical motion information candidate list is stored in a first storage space and a second storage space, respectively, and the second region is encoded or decoded using the historical motion information candidate list in the second storage space; and updating the historical motion information candidate list using motion information of at least one second image block included in the second region of the current frame is performed. In the encoding process or decoding process of the second region, updating the history motion information candidate list in the first storage space using motion information of at least one second image block included in the second region; After the encoding or decoding of the second region is completed, updating the history motion information candidate list in the second storage space with the updated history motion information candidate list in the first storage space; encoding or decoding each of the first image blocks based on the historical motion information candidate list, 18. The method according to any one of items 4 to 17, comprising encoding or decoding each of the first image blocks, respectively, based on the updated history motion information candidate list in the second storage space. (Item 28) In the encoding process or decoding process of the first region, updating the history motion information candidate list in the first storage space again using motion information of at least one first image block included in the first region; The method described in item 27, further comprising: after encoding or decoding of the first region is completed, re-updating the history motion information candidate list in the second storage space using the re-updated history motion information candidate list in the first storage space. (Item 29) Updating the history motion information candidate list in the second storage space using the updated history motion information candidate list in the first storage space includes: The method of item 27 or 28, comprising updating the historical motion information candidate list in the second storage space and making the updated historical motion information candidate list in the second storage space the same as the updated historical motion information candidate list in the first storage space. (Item 30) A video processing method, comprising: encoding or decoding at least one second image block in a second region of the current frame using the historical motion information candidate list; updating the history motion information candidate list based on motion information after encoding or decoding at least a part of the second image blocks in the second region, to obtain the updated history motion information candidate list; and encoding or decoding a plurality of first image blocks in a first region of the current frame using the updated historical motion information candidate list. (Item 31) encoding or decoding a plurality of first image blocks in a first region of the current frame using the updated historical motion information candidate list, Item 31. The method of item 30, comprising encoding or decoding the plurality of first image blocks in parallel using the updated historical motion information candidate list. (Item 32) The method described in item 30 or 31, wherein when encoding or decoding different first image blocks, the candidate history motion information included in the history motion information candidate list to be adopted and the candidate history motion information have the same order in the history motion information candidate list. (Item 33) A method according to any one of items 30 to 32, wherein when updating the history motion information candidate list, at least one of the following is true: the number of candidate history motion information added to the history motion information candidate list is smaller than a predetermined value; or the number of candidate history motion information deleted from the history motion information candidate list is smaller than a predetermined value. (Item 34) before updating the historical motion information candidate list, 34. The method according to any one of items 30 to 33, further comprising selecting the at least a portion of the second image blocks from the image blocks included in the second region based on position coordinates of the image blocks in the second region. (Item 35) In the step of selecting at least a portion of second image blocks from image blocks included in the second region, Item 35. The method according to item 34, wherein at least one of the priority level of the image block on the right side in the second region is higher than the priority level of the image block on the left side in the second region, or the priority level of the image block on the lower side in the second region is higher than the priority level of the image block on the upper side in the second region. (Item 36) Updating the historical motion information candidate list using motion information of at least a part of second image blocks included in the second region includes: performing a weighting process on motion information of at least a part of the second image blocks; 36. The method according to any one of items 30 to 35, further comprising: updating the history motion information candidate list using the weighted motion information. (Item 37) 37. The method according to any one of items 30 to 36, wherein the second region and the first region are arranged along a row direction of an image or along a column direction of an image. (Item 38) Item 38. The method of item 37, wherein the second region and the first region belong to the same coding tree unit CTU row or CTU column, each CTU row or CTU column includes at least one CTU, and each CTU includes at least one region. (Item 39) Item 39. The method according to item 37 or 38, wherein when the second region is the region that was encoded or decoded earliest among the array along the row direction or the array along the column direction of the image, the historical motion information candidate list used when encoding or decoding the second region is empty. (Item 40) 40. The method according to any one of items 30 to 39, wherein the second region is an area that is encoded or decoded immediately before the first region. (Item 41) Updating the historical motion information candidate list includes: 41. The method according to any one of items 30 to 40, comprising adding a first candidate history motion information that needs to be added to a top position of the history motion information candidate list. (Item 42) Updating the historical motion information candidate list includes: The method of item 41, further comprising deleting candidate history motion information at the end of the history motion information candidate list or deleting candidate history motion information that is the same as the first candidate history motion information in the history motion information table. (Item 43) 43. The method according to any one of items 30 to 42, wherein the second image block is an image block of a non-affine transformation motion compensation mode. (Item 44) encoding a plurality of first image blocks in a first region using the updated historical motion information candidate list, generating a motion information list for each first image block using the updated historical motion information candidate list; 44. A method according to any one of items 30 to 43, comprising selecting motion information for each of the first image blocks using the motion information list generated for each of the first image blocks, respectively. (Item 45) generating a motion information list for each of the first image blocks using the updated historical motion information candidate list, generating the motion information list for each of the first image blocks using the updated historical motion information candidate list and a spatial domain motion information candidate list corresponding to each of the first image blocks; Item 45. The method according to item 44, wherein the image blocks corresponding to the motion information in the spatial domain motion information candidate list corresponding to each of the first image blocks do not belong to the first domain. (Item 46) The method according to any one of Items 30 to 45, wherein the history motion information candidate list is a history-based motion vector prediction HMVP candidate list. (Item 47) 47. The method according to any one of items 30 to 46, wherein the at least some of the second image blocks include at least one of an image block that was last coded or decoded in the second region, or an image block at a specified position in the second region. (Item 48) The image block at the specified position in the second region is Item 48. The method of item 47, comprising an image block located at at least one of the top left corner of the second region, the top right corner of the second region, the bottom left corner of the second region, the bottom right corner of the second region, and the center point of the second region. (Item 49) 49. The method according to any one of items 30 to 48, wherein the history motion information candidate list is stored in one storage space. (Item 50) A method according to any one of items 30 to 49, wherein updating the historical motion information candidate list using motion information of at least a portion of the second image blocks included in a second region of the current frame is performed after encoding or decoding is completed in the second region. (Item 51) The history motion information candidate list is stored in a first storage space and a second storage space, respectively, and the second area performs encoding or decoding using the history motion information candidate list in the second storage space, and updates the history motion information candidate list based on motion information after encoding or decoding at least a part of a second image block in the second area. In the encoding process or decoding process of the second region, updating the history motion information candidate list in the first storage space using motion information of at least a part of the second image blocks included in the second region; encoding or decoding each of the first image blocks respectively based on the historical motion information candidate list, 49. The method according to any one of items 30 to 48, comprising encoding or decoding each of the first image blocks, respectively, based on the updated historical motion information candidate list in the first storage space. (Item 52) The method of item 51, further comprising updating the historical motion information candidate list in the second storage space with the updated historical motion information candidate list in the first storage space after encoding or decoding of the second region is completed. (Item 53) Updating the history motion information candidate list in the second storage space using the updated history motion information candidate list in the first storage space includes: The method of item 52, further comprising updating the historical motion information candidate list in the second storage space so that the updated historical motion information candidate list in the second storage space is the same as the updated historical motion information candidate list in the first storage space. (Item 54) The history motion information candidate list is stored in a first storage space and a second storage space, respectively, and the second area performs encoding or decoding using the history motion information candidate list in the second storage space, and updates the history motion information candidate list based on motion information after encoding or decoding at least a part of a second image block in the second area. In the encoding process or decoding process of the second region, updating the history motion information candidate list in the first storage space using motion information of at least a part of the second image blocks included in the second region; After the encoding or decoding of the second region is completed, updating the history motion information candidate list in the second storage space with the updated history motion information candidate list in the first storage space; encoding or decoding a plurality of first image blocks in a first region of the current frame using the updated historical motion information candidate list, 49. The method according to any one of items 30 to 48, comprising encoding or decoding each of the first image blocks, respectively, based on the updated historical motion information candidate list in the second storage space. (Item 55) In the encoding process or decoding process of the first region, updating the history motion information candidate list in the first storage space again using motion information of at least one first image block included in the first region; The method described in item 54, further comprising: after encoding or decoding of the first region is completed, re-updating the historical motion information candidate list in the second storage space using the re-updated historical motion information candidate list in the first storage space. (Item 56) Updating the history motion information candidate list in the second storage space using the updated history motion information candidate list in the first storage space includes: A method as described in item 54 or 55, comprising updating the historical motion information candidate list in the second storage space and making the updated historical motion information candidate list in the second storage space the same as the updated historical motion information candidate list in the first storage space. (Item 57) A video processing device, comprising: an acquisition unit for acquiring a history motion information candidate list acquired based on motion information of a second image block, which is an already encoded or decoded image block other than the image block included in the first area and is used for encoding or decoding each of a plurality of first image blocks included in a first area in a current frame; and an encoding or decoding unit for encoding or decoding each of the first image blocks, respectively, based on the history motion information candidate list. (Item 58) The encoding or decoding unit further comprises: Item 58. The apparatus according to item 57, used for encoding or decoding the plurality of first image blocks in parallel based on the historical motion information candidate list. (Item 59) An apparatus as described in item 57 or 58, wherein when encoding or decoding different first image blocks, the candidate history motion information included in the history motion information candidate list to be adopted and the candidate history motion information have the same order in the history motion information candidate list. (Item 60) The acquisition unit further comprises: An apparatus described in any one of items 57 to 59, which updates the history motion information candidate list using motion information of at least one second image block included in a second region of the current frame, and uses the updated history motion information candidate list for encoding or decoding the multiple first image blocks. (Item 61) The device described in item 60, wherein the encoding or decoding process of the second region is faster than that of the first region, and image blocks of the second region are encoded or decoded using the historical motion information candidate list that has not yet been updated. (Item 62) The device described in item 60 or 61, wherein when updating the historical motion information candidate list, at least one of the number of candidate historical motion information added to the historical motion information candidate list is smaller than a predetermined value or the number of candidate historical motion information deleted from the historical motion information candidate list is smaller than a predetermined value. (Item 63) Item 63. The apparatus according to any one of items 60 to 62, further comprising a selection unit for selecting the at least one second image block from the image blocks included in the second region based on position coordinates of the image blocks of the second region. (Item 64) In the step of selecting the at least one second image block from the image blocks included in the second region, Item 64. The device according to item 63, wherein at least one of the priority level of the image block on the right side in the second region is higher than the priority level of the image block on the left side in the second region, or the priority level of the image block on the bottom side in the second region is higher than the priority level of the image block on the top side in the second region. (Item 65) The device according to any one of items 60 to 64, wherein the at least one second image block includes at least one of an image block that was last encoded or decoded in the second region and an image block at a specified position in the second region. (Item 66) The image block at the specified position in the second region is Item 66. The apparatus of item 65, further comprising an image block located at at least one of the top left corner of the second region, the top right corner of the second region, the bottom left corner of the second region, the bottom right corner of the second region, and a center point of the second region. (Item 67) The acquisition unit further comprises: performing a weighting process on motion information of a plurality of the second image blocks; The device according to any one of items 60 to 66, which is used for updating the historical motion information candidate list using the motion information that has been weighted. (Item 68) 68. The device according to any one of items 60 to 67, wherein the first region and the second region are arranged along a row direction of an image or along a column direction of an image. (Item 69) The apparatus of item 68, wherein the first region and the second region belong to the same coding tree unit CTU row or CTU column, each CTU row or CTU column includes at least one CTU, and each CTU includes at least one region. (Item 70) The device described in item 68 or 69, wherein when the second region is the earliest encoded or decoded region in an array along the row direction or column direction of an image, the historical motion information candidate list used when encoding or decoding the second region is empty. (Item 71) The device according to any one of items 60 to 70, wherein the second region is an area that is encoded or decoded immediately before the first region. (Item 72) The acquisition unit further comprises: The device according to any one of items 60 to 71, which is used to add a first candidate history motion information that needs to be added to a higher position in the history motion information candidate list. (Item 73) The acquisition unit further comprises: The apparatus described in item 72, which is used to delete candidate historical motion information at the end of the historical motion information candidate list or to delete candidate historical motion information that is the same as the first candidate historical motion information in the historical motion information table. (Item 74) 74. The device according to any one of items 57 to 73, wherein the second image block is an image block of a mode other than an affine transformation motion compensation mode. (Item 75) The encoding or decoding unit further comprises: generating a motion information list for each of the first image blocks using the historical motion information candidate list; An apparatus described in any one of items 57 to 74, which is used for selecting motion information for each of the first image blocks using the motion information list generated for each of the first image blocks, respectively. (Item 76) The encoding or decoding unit further comprises: using the historical motion information candidate list and the spatial domain motion information candidate list corresponding to each of the first image blocks to generate a motion information list for each of the first image blocks, respectively; Item 76. The apparatus according to item 75, wherein the image blocks corresponding to the motion information in the spatial domain motion information candidate list corresponding to each of the first image blocks do not belong to the first domain. (Item 77) 77. The device according to any one of items 57 to 76, wherein the history motion information candidate list is a history-based motion vector prediction HMVP candidate list. (Item 78) The apparatus according to any one of items 57 to 77, wherein the history motion information candidate list is stored in one storage space. (Item 79) An apparatus according to any one of items 57 to 78, wherein updating the historical motion information candidate list using motion information of at least one second image block included in a second region of the current frame is performed after encoding or decoding is completed in the second region. (Item 80) The history motion information candidate list is stored in a first storage space and a second storage space, respectively, and the second area performs encoding or decoding using the history motion information candidate list in the second storage space, and the acquisition unit further comprises: During the encoding or decoding process of the second region, the motion information of at least one second image block included in the second region is used to update the history motion information candidate list in the first storage space; The encoding or decoding unit further comprises: An apparatus according to any one of items 60 to 73, used for encoding or decoding each of the first image blocks, respectively, based on the updated historical motion information candidate list in the first storage space. (Item 81) The acquisition unit further comprises: The apparatus described in item 80, which is used to update the historical motion information candidate list in the second storage space with the updated historical motion information candidate list in the first storage space after encoding or decoding of the second region is completed. (Item 82) The acquisition unit further comprises: The apparatus described in item 81, which is used to update the historical motion information candidate list in the second storage space and make the updated historical motion information candidate list in the second storage space the same as the updated historical motion information candidate list in the first storage space. (Item 83) The history motion information candidate list is stored in a first storage space and a second storage space, respectively, and the second area performs encoding or decoding using the history motion information candidate list in the second storage space, and the acquisition unit further comprises: In the encoding process or decoding process of the second region, updating the history motion information candidate list in the first storage space using motion information of at least one second image block included in the second region; after the encoding or decoding of the second region is completed, updating the history motion information candidate list in the second storage space with the updated history motion information candidate list in the first storage space; The encoding or decoding unit further comprises: The device described in any one of items 60 to 73, which is used for encoding or decoding each of the first image blocks based on the updated historical motion information candidate list in the second storage space. (Item 84) The acquisition unit further comprises: In the encoding process or decoding process of the first region, updating the history motion information candidate list in the first storage space again using motion information of at least one first image block included in the first region; The apparatus described in item 83, which is used for re-updating the historical motion information candidate list in the second storage space using the re-updated historical motion information candidate list in the first storage space after encoding or decoding of the first region is completed. (Item 85) The acquisition unit further comprises: An apparatus described in item 83 or 84, which is used to update the historical motion information candidate list in the second storage space and make the updated historical motion information candidate list in the second storage space the same as the updated historical motion information candidate list in the first storage space. (Item 86) A video processing device, comprising: An encoding or decoding unit and an update unit, The encoding or decoding unit is used to encode or decode at least one second image block in a second region of a current frame using a historical motion information candidate list; the update unit is used to update the history motion information candidate list based on motion information after encoding or decoding at least a part of the second image block in the second region, to obtain the updated history motion information candidate list; The video processing device, wherein the encoding or decoding unit is further used to encode or decode a plurality of first image blocks in a first region of the current frame using the updated historical motion information candidate list. (Item 87) The encoding or decoding unit further comprises: Item 87. The apparatus according to item 86, used to encode or decode the plurality of first image blocks in parallel using the updated historical motion information candidate list. (Item 88) An apparatus as described in item 86 or 87, wherein when encoding or decoding different first image blocks, the candidate history motion information included in the history motion information candidate list to be adopted and the candidate history motion information have the same order in the history motion information candidate list. (Item 89) An apparatus according to any one of items 86 to 88, wherein when updating the history motion information candidate list, at least one of the following occurs: the number of candidate history motion information added to the history motion information candidate list is smaller than a predetermined value; or the number of candidate history motion information deleted from the history motion information candidate list is smaller than a predetermined value. (Item 90) The device according to any one of items 86 to 89, further comprising a selection unit for selecting the at least a portion of the second image blocks from the image blocks included in the second region based on position coordinates of the image blocks of the second region. (Item 91) In the step of selecting at least a portion of second image blocks from image blocks included in the second region, The device described in item 90, wherein at least one of the priority level of the image block on the right side in the second region is higher than the priority level of the image block on the left side in the second region, or the priority level of the image block on the bottom side in the second region is higher than the priority level of the image block on the top side in the second region. (Item 92) The update unit further comprises: performing a weighting process on motion information of at least a part of the second image blocks; The device according to any one of items 86 to 91, which is used for updating the history motion information candidate list using the motion information that has been weighted. (Item 93) The device according to any one of items 86 to 92, wherein the second region and the first region are arranged along a row direction of an image or along a column direction of an image. (Item 94) The device described in item 93, wherein the second region and the first region belong to the same coding tree unit CTU row or CTU column, each CTU row or CTU column includes at least one CTU, and each CTU includes at least one region. (Item 95) The device described in item 93 or 94, wherein when the second region is the region that was encoded or decoded earliest among the array along the row direction or the array along the column direction of the image, the historical motion information candidate list used when encoding or decoding the second region is empty. (Item 96) 96. The device according to any one of items 86 to 95, wherein the second region is an area that is encoded or decoded immediately before the first region. (Item 97) The update unit further comprises: The device according to any one of items 86 to 96, which is used to add a first candidate history motion information that needs to be added to a higher position in the history motion information candidate list. (Item 98) The update unit further comprises: The apparatus described in item 97, which is used to delete candidate historical motion information at the end of the historical motion information candidate list or to delete candidate historical motion information that is the same as the first candidate historical motion information in the historical motion information table. (Item 99) Item 99. The device according to any one of items 86 to 98, wherein the second image block is an image block of a mode other than an affine transformation motion compensation mode. (Item 100) The encoding or decoding unit further comprises: generating a motion information list for each first image block using the updated historical motion information candidate list; An apparatus described in any one of items 86 to 99, used for selecting motion information for each of the first image blocks using the motion information list generated for each of the first image blocks, respectively. (Item 101) The encoding or decoding unit further comprises: using the updated historical motion information candidate list and a spatial domain motion information candidate list corresponding to each of the first image blocks to generate the motion information list for each of the first image blocks, respectively; The device according to any one of items 86 to 100, wherein an image block corresponding to motion information in a spatial domain motion information candidate list corresponding to each of the first image blocks does not belong to the first domain. (Item 102) The apparatus according to any one of items 86 to 101, wherein the history motion information candidate list is a history-based motion vector prediction HMVP candidate list. (Item 103) The device according to any one of items 86 to 102, wherein the at least some of the second image blocks include at least one of the last encoded or decoded image block in the second region and the image block at a specified position in the second region. (Item 104) The image block at the specified position in the second region is Item 104. The apparatus of item 103, further comprising an image block located at at least one of the top left corner of the second region, the top right corner of the second region, the bottom left corner of the second region, the bottom right corner of the second region, and a center point of the second region. (Item 105) The apparatus according to any one of items 86 to 104, wherein the history motion information candidate list is stored in one storage space. (Item 106) An apparatus according to any one of items 86 to 105, wherein updating the historical motion information candidate list using motion information of at least a portion of the second image blocks included in a second region of the current frame is performed after encoding or decoding is completed in the second region. (Item 107) The history motion information candidate list is stored in a first storage space and a second storage space, respectively, and the second area performs encoding or decoding using the history motion information candidate list in the second storage space, and the update unit further comprises: During the encoding or decoding process of the second region, the motion information of at least a part of the second image blocks included in the second region is used to update the history motion information candidate list in the first storage space; The encoding or decoding unit further comprises: An apparatus according to any one of items 86 to 104, used for encoding or decoding each of the first image blocks based on the updated history motion information candidate list in the first storage space. (Item 108) The update unit further comprises: The apparatus described in item 107, which is used to update the historical motion information candidate list in the second storage space with the updated historical motion information candidate list in the first storage space after encoding or decoding of the second region is completed. (Item 109) The update unit further comprises: The apparatus described in item 108, which is used to update the historical motion information candidate list in the second storage space and make the updated historical motion information candidate list in the second storage space the same as the updated historical motion information candidate list in the first storage space. (Item 110) The history motion information candidate list is stored in a first storage space and a second storage space, respectively, and the second area performs encoding or decoding using the history motion information candidate list in the second storage space, and the update unit further comprises: In the encoding process or decoding process of the second region, updating the history motion information candidate list in the first storage space using motion information of at least a part of the second image blocks included in the second region; after the encoding or decoding of the second region is completed, updating the history motion information candidate list in the second storage space with the updated history motion information candidate list in the first storage space; An apparatus described in any one of items 86 to 104, wherein the encoding or decoding unit is further used to encode or decode each of the first image blocks, respectively, based on the updated historical motion information candidate list in the second storage space. (Item 111) The update unit further comprises: In the encoding process or decoding process of the first region, updating the history motion information candidate list in the first storage space again using motion information of at least one first image block included in the first region; The apparatus described in item 110, which is used for re-updating the historical motion information candidate list in the second storage space using the re-updated historical motion information candidate list in the first storage space after encoding or decoding of the first region is completed. (Item 112) The update unit further comprises: An apparatus described in item 110 or 111, which is used to update the historical motion information candidate list in the second storage space and make the updated historical motion information candidate list in the second storage space the same as the updated historical motion information candidate list in the first storage space. (Item 113) A video processing device, comprising: A video processing device including a processor for processing the method according to any one of items 1 to 56. (Item 114) 1. A computer-readable storage medium, comprising: A computer-readable storage medium used to store code for causing a processor to execute the method according to any one of items 1 to 56.

Claims

1. A video processing method, comprising: obtaining a historical motion information candidate list, the historical motion information candidate list being used for encoding or decoding each of a plurality of first image blocks included in a first region of a current frame, the historical motion information candidate list being obtained based on motion information of a second image block that has already been encoded or decoded other than the image blocks included in the first region; encoding or decoding each of the plurality of first image blocks according to the historical motion information candidate list; During the process of encoding or decoding each of the plurality of first image blocks, the history motion information candidate list is not updated; The step of encoding or decoding each of the plurality of first image blocks according to the historical motion information candidate list includes: generating a motion information list for each of the first image blocks using the historical motion information candidate list, the historical motion information candidate list being a historical-based motion vector prediction (HMVP) candidate list, the motion information list being an MVP candidate list, and when generating the MVP candidate list, an HMVP candidate is selected from the HMVP candidate list as a candidate MVP in the MVP candidate list; selecting motion information for each of the plurality of first image blocks by using the generated motion information list for each of the plurality of first image blocks.

2. A video processing method, comprising: obtaining a historical motion information candidate list, the historical motion information candidate list being used for encoding or decoding each of a plurality of first image blocks included in a first region of a current frame, the historical motion information candidate list being obtained based on motion information of a second image block that has already been encoded or decoded other than the image blocks included in the first region; encoding or decoding each of the plurality of first image blocks according to the historical motion information candidate list; During the process of encoding or decoding each of the plurality of first image blocks, the history motion information candidate list is not updated; The moving image processing method, wherein the history motion information candidate list is updated after all of the plurality of first image blocks included in the first region are encoded or decoded.

3. A video processing method, comprising: obtaining a historical motion information candidate list, the historical motion information candidate list being used for encoding or decoding each of a plurality of first image blocks included in a first region of a current frame, the historical motion information candidate list being obtained based on motion information of a second image block that has already been encoded or decoded other than the image blocks included in the first region; encoding or decoding each of the plurality of first image blocks according to the historical motion information candidate list; During the process of encoding or decoding each of the plurality of first image blocks, the history motion information candidate list is not updated; The method of claim 1, wherein the historical motion information candidate list is updated only after a last image block in the first region is coded.

4. The method of claim 3 , wherein the last image block is the block in the bottom right corner of the first region.

5. A video processing method, comprising: obtaining a historical motion information candidate list, the historical motion information candidate list being used for encoding or decoding each of a plurality of first image blocks included in a first region of a current frame, the historical motion information candidate list being obtained based on motion information of a second image block that has already been encoded or decoded other than the image blocks included in the first region; encoding or decoding each of the plurality of first image blocks according to the historical motion information candidate list; During the process of encoding or decoding each of the plurality of first image blocks, the history motion information candidate list is not updated; A video processing method, wherein the history motion information candidate list is a history-based motion vector prediction (HMVP) candidate list, and the history motion information candidate list is not updated during the process of encoding or decoding all of the plurality of first image blocks included in the first region.

6. A video processing method, comprising: obtaining a historical motion information candidate list, the historical motion information candidate list being used for encoding or decoding each of a plurality of first image blocks included in a first region of a current frame, the historical motion information candidate list being obtained based on motion information of a second image block that has already been encoded or decoded other than the image blocks included in the first region; encoding or decoding each of the plurality of first image blocks according to the historical motion information candidate list; During the process of encoding or decoding each of the plurality of first image blocks, the history motion information candidate list is not updated; The step of obtaining the history motion information candidate list includes:

20. A method for processing moving images comprising: updating the historical motion information candidate list using the motion information of at least one of the second image blocks.

7. 7. The video processing method of claim 6, wherein the at least one of the one or more second image blocks includes an image block in the second region that was last encoded or decoded, and / or includes one or more image blocks at one or more specified positions in the second region.

8. 1. A method for generating a bitstream, comprising the steps of: obtaining a historical motion information candidate list, the historical motion information candidate list being used to encode each of a plurality of first image blocks included in a first region of a current frame, the historical motion information candidate list being obtained based on motion information of a second image block, which is an already encoded image block other than the image blocks included in the first region; encoding each of the plurality of first image blocks according to the historical motion information candidate list; encoding the current frame to obtain a bitstream; Including, During the process of encoding each of the plurality of first image blocks, the historical motion information candidate list is not updated; encoding or decoding each of the plurality of first image blocks according to the historical motion information candidate list, generating a motion information list for each of the first image blocks using the historical motion information candidate list, the historical motion information candidate list being a historical-based motion vector prediction (HMVP) candidate list, the motion information list being an MVP candidate list, and when generating the MVP candidate list, an HMVP candidate is selected from the HMVP candidate list as a candidate MVP in the MVP candidate list; selecting motion information for each of the first image blocks by using the generated motion information list for each of the first image blocks; or The step of obtaining the history motion information candidate list includes: updating the historical motion information candidate list with the motion information for at least one of the second image blocks.

9. A method for generating a bitstream, comprising the steps of: obtaining a historical motion information candidate list, the historical motion information candidate list being used to encode each of a plurality of first image blocks included in a first region of a current frame, the historical motion information candidate list being obtained based on motion information of a second image block, which is an already encoded image block other than the image blocks included in the first region; encoding each of the plurality of first image blocks according to the historical motion information candidate list; encoding the current frame to obtain a bitstream; Including, During the process of encoding each of the plurality of first image blocks, the historical motion information candidate list is not updated; The history motion information candidate list includes: The first image block is updated after all of the first image blocks included in the first region are encoded or decoded; or updated only after the last image block in the first region has been coded, or A method according to claim 1, wherein the historical motion information candidate list is a historical motion vector prediction (HMVP) candidate list, and the historical motion information candidate list is not updated during the process of encoding or decoding all of the plurality of first image blocks included in the first region.

10. A memory for storing instructions; A processor configured to carry out the video processing method according to any one of claims 1 to 7; A video processing device comprising:

Citation Information

Patent Citations

  • Resetting of look up table per slice / tile / LCU row

    WO2020003266A1

  • Method and apparatus for history-based motion vector prediction

    WO2020018297A1