Video encoding method, video encoding apparatus, and non-transitory computer-readable storage medium

Abstract

A method for video coding is provided. [Solution] The method includes obtaining a first reference image and a second reference image associated with a current prediction block; generating a first prediction L0 based on a first motion vector MV0 from the current prediction block to a reference block in the first reference image; generating a second prediction L1 based on a second motion vector MV1 from the current prediction block to a reference block in the second reference image; determining whether a bidirectional optical flow (BDOF) operation is applied; and calculating a dual prediction of the current prediction block based on the first prediction L0 and the second prediction L1 and the first gradient value and the second gradient value.

Description

[Technical Field]

[0001] This application is based on provisional application Ser. No. 62 / 790,421, filed January 9, 2019. All rights reserved, and the entire contents of which are incorporated herein by reference.

[0002] This application relates to video coding and compression. More specifically, this application relates to video coding and compression. Combined Inter and Intra Prediction (CIIP) Method for Decoding and equipment. [Background technology]

[0003] Various video coding techniques can be used to compress video data. The video coding is performed according to one or more video coding standards. For example, video coding standards include Versatile Video Coding (VVC), JEM (Joint Exploration Test Model), High Efficiency Video Coding (H.265 / HEVC), Advanced video coding (H.264 / AVC), Motion Picture Experts Group (MPEG) Video coding generally involves the encoding of a video image or sequence. Prediction methods that exploit redundancy present in the image stream (e.g., inter-prediction, intra-prediction, etc.) An important goal of video coding technology is to avoid or minimize video quality degradation. Compressing video data into a format that uses a lower bit rate while minimizing video loss And so. Summary of the Invention

[0004] Examples of the present disclosure provide methods for improving the efficiency of syntax signaling in merge-related modes. To provide.

[0005] According to an aspect of the present disclosure, a video encoding method includes: generating an inter prediction of a current coding block based on at least one motion vector from a current image to at least one reference image; generating an intra prediction of the current coding block based on an intra prediction mode; generating a final prediction of the current coding block by weighted averaging the inter prediction and the intra prediction; and specifying that the current coding block is to be treated as a unified mode when constructing a most probable mode (MPM) list of a neighboring coding block, regardless of a prediction mode of the neighboring coding block, wherein the unified mode is predefined as an inter mode, or the unified mode is predefined as an intra mode; Coding mode and prediction mode information Entropy encoded information indicating Place Including In response to identifying that the current coding block is treated in inter mode to construct the MPM list of the neighboring coding block, the intra prediction mode of the current coding block is not used for MPM-based intra mode prediction of the neighboring coding block, regardless of the prediction mode of the neighboring coding block; in response to identifying that the current coding block is treated in intra mode to construct the MPM list of the neighboring coding block, the intra prediction mode of the current coding block is used for MPM-based intra mode prediction of the neighboring coding block, regardless of the prediction mode of the neighboring coding block; and bidirectional optical flow (BDOF) operation is disabled for the current coding block. .

[0009] Both the foregoing general description and the following detailed description are exemplary and explanatory only and are not intended to limit the scope of the present disclosure. Please understand that this is not a guarantee. [Brief explanation of the drawings]

[0010] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate examples consistent with this disclosure. , together with the description, serve to explain the principles of the present disclosure. [Figure 1] FIG. 2 is a block diagram of an encoder according to an example of the present disclosure. [Figure 2] FIG. 2 is a block diagram of a decoder according to an example of the present disclosure. [Figure 3] 1 is a flowchart illustrating a method for generating a combined inter-and-intra prediction (CIIP) according to an example of the present disclosure. [Figure 4] 1 is a flowchart illustrating a method for generating a CIIP according to an example of the present disclosure. [Figure 5A] FIG. 10 illustrates a block partition in a multi-type tree structure according to an example of the present disclosure. [Figure 5B] FIG. 10 illustrates a block partition in a multi-type tree structure according to an example of the present disclosure. [Figure 5C] FIG. 10 illustrates a block partition in a multi-type tree structure according to an example of the present disclosure. [Figure 5D] FIG. 10 illustrates a block partition in a multi-type tree structure according to an example of the present disclosure. [Figure 5E] FIG. 10 illustrates a block partition in a multi-type tree structure according to an example of the present disclosure. [Figure 6A] FIG. 1 illustrates a combined inter and intra prediction (CIIP) according to an example of the present disclosure. [Figure 6B] FIG. 1 illustrates a combined inter and intra prediction (CIIP) according to an example of the present disclosure. [Figure 6C] FIG. 1 illustrates a combined inter and intra prediction (CIIP) according to an example of the present disclosure. [Figure 7A] 1 is a flowchart of an MPM candidate list generation process according to an example of the present disclosure. [Figure 7B] 1 is a flowchart of an MPM candidate list generation process according to an example of the present disclosure. [Figure 8] FIG. 1 illustrates a workflow of an existing CIIP design in VVC according to an example of the present disclosure. [Figure 9] FIG. 1 illustrates the workflow of the proposed CIIP method by removing BDOF, according to an example of the present disclosure. [Figure 10] FIG. 1 illustrates a workflow of a single-prediction-based CIIP that selects a prediction list based on POC distance, according to an example of the present disclosure. [Figure 11A] 10 is a flowchart of a method when enabling a CIIP block for MPM candidate list generation according to an example of the present disclosure. [Figure 11B]10 is a flowchart of a method for disabling a CIIP block for MPM candidate list generation according to an example of the present disclosure. [Figure 12] FIG. 1 illustrates a computing environment coupled with a user interface according to an example of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0011] Reference will now be made in detail to examples of the present disclosure, examples of which are illustrated in the accompanying drawings. Unless otherwise noted, the same numbers in different drawings represent the same or similar elements in the accompanying drawings. The embodiments described in the following description of examples of the present disclosure are consistent with the present disclosure. These do not represent all embodiments that may be consistent with the teachings of the present invention. Instead, they are provided in accordance with the appended claims. are merely examples of apparatus and methods consistent with aspects related to the present disclosure. do.

[0012] The terminology used in this disclosure is for the purpose of describing particular embodiments only. It is not intended to limit the present disclosure. As used herein, the singular forms "a," "an," and "the" are used unless the context clearly indicates otherwise. The term "and / or" as used herein is intended to include the plural, wherever possible. A word is any or all possible combinations of one or more of the related listed items. It should also be understood that the term "combination" is intended to mean and include "combination."

[0013] Here, terms such as "first," "second," and "third" may be used to describe various pieces of information. However, it should be understood that the information should not be limited by these terms. These terms are used only to distinguish one category of information from another. For example, the first information may be referred to as the second information without departing from the scope of this disclosure. Similarly, the second information can also be referred to as the first information. where the word "if" is used, it should be understood to mean "when" or "in the event of" or " may be understood to mean "at discretion."

[0014] The first version of the HEVC standard was completed in October 2013 and is the successor to the previous generation of HEVC. Approximately 50% bit rate reduction compared to the H.264 / MPEG AVC decoding standard The HEVC standard offers significant coding savings over its predecessor, or equivalent perceptual quality. Although it offers improvements in coding, adding coding tools to HEVC makes it superior. Based on this, there is evidence that VCEG and MPE can achieve high coding efficiency. Both G and G are new coding technologies for future video coding standards. We have begun investigating advanced technologies that will enable significant improvements in coding efficiency. In order to start a significant study on this, ITU-TVECG and ISO / IE C MPEG formed a Joint Video Exploration Team (JVET) One reference software, called the Joint Exploration Model (JEM), is the HEVC test model. By integrating some additional coding tools on top of Dell (HM), JVE It was maintained by T.

[0015] In October 2017, a joint call for proposals was made for video compression with capabilities beyond HEVC. The CfP was published by ITU-T and ISO / IEC. At 10 JVET meetings, 23 CfP responses were received and evaluated, approximately 40% faster than HEVC. Based on these evaluation results, JVET has decided to develop Versatile To develop a new generation video coding standard called e Video Coding (VVC) In the same month, a new project was launched to demonstrate a reference implementation of the VVC standard. , a single reference software code base called the VVC Test Model (VTM) has been established. was done.

[0016] Like HEVC, VVC is a block-based hybrid video coding framework. Figure 1 (explained below) shows a typical block-based A block diagram of a hybrid video coding system is given. The input video signal is divided into blocks (codes). In VTM-1.0, the C U can be up to 128x128 pixels, but is based only on the quadtree. Unlike HEVC, which divides blocks based on quad / binary / ternary, VVC To accommodate various local tree-based characteristics, a single coding tree unit is used. A CTU is divided into CUs. The concept of unit types has been removed, i.e., CU, prediction unit (PU) and transform unit The separation of the CU (TU) no longer exists in the VVC, instead each CU always has an additional partition. It is used as the basic unit for both prediction and transformation without any partitioning. Multi-type tree structure In this example, a CTU is first partitioned by a quad tree structure. Then, each quad The tree leaf nodes can be further partitioned into binary and ternary tree structures. As shown in Figures 5A, 5B, 5C, 5D, 5E (described below), ,respectively, quaternary partitioning, horizontal binary partitioning, and vertical binary partitioning. partitioning, horizontal three-way partitioning, and vertical three-way partitioning. There is a split type.

[0017] In FIG. 1 (described below), spatial and / or temporal prediction can be performed. Spatial prediction (or "intra prediction") is the prediction of a video sequence based on an already existing sequence in the same video image / slice. Pixels from the loaded samples of neighboring blocks (called reference samples) The current video block is predicted using spatial prediction. Reduces redundancy. Temporal prediction (also called "inter-prediction" or "motion-compensated prediction"). ) uses reconstructed pixels from already coded video images to Temporal prediction is a method for reducing the temporal redundancy inherent in video signals. The temporal prediction signal for a particular CU is typically the motion between the current CU and its temporal reference. The motion vectors are signaled by one or more motion vectors (MVs) that indicate the amount and direction of motion. Also, if multiple reference images are supported, one reference image index is This means that the temporal prediction signal comes from which reference picture in the reference picture store. After spatial and / or temporal prediction, the encoder The mode decision block in the The predicted block is then subtracted from the current video block to obtain the prediction residual. The difference is decorrelated using a transform and quantization.

[0018] The quantized residual coefficients are inversely quantized and inversely transformed to form a reconstructed residual, which is then The deblocking filter is added to the predicted block to form the reconstructed signal of the CU. Sample Adaptive Offset (SAO), Adaptive In-Loop Filter Further in-loop filtering, such as ALF, can be implemented by storing the reference image in a future image store. It can be applied to the reconstructed CU before it is used to code the video block. To form the output video bitstream, the coding mode (inter or in tra), prediction mode information, motion information, and quantized residual coefficients are all entropy- - sent to the coding unit, which then compresses and packs it to form a bitstream Form.

[0019] FIG. 2 (described below) shows a general block diagram of a block-based video decoder. The video bitstream is first entropy decoded by the entropy decoding unit. Coding mode and prediction information are stored in the spatial prediction unit (intra-coded the temporal prediction unit (if inter-coded) or the temporal prediction unit (if inter-coded) ) to form a prediction block. The residual transform coefficients are then sent to the inverse quantization unit. The prediction block and the residual are then sent to the inverse transform unit to reconstruct the residual block. The difference blocks are added together. The reconstructed blocks are stored in the reference image store. Before the reference image stream is processed, it can go through an additional in-loop filtering. The reconstructed video in the image is sent to drive a display device, It is also used to predict future video blocks.

[0020] Figure 1 shows a typical encoder 100. The encoder 100 receives a video input 110, Motion compensation 112, motion estimation 114, intra / inter mode decision 116, block prediction 140, adder 128, transform 130, quantization 132, prediction related information 142, intra prediction measurement 118, image buffer 120, inverse quantization 134, inverse transform 136, adder 126, memory 124, in-loop filter 122, entropy coding 138, and bitstream It has a stream 144.

[0021] Figure 2 shows a block diagram of a typical decoder 200. The decoder 200 receives a bitstream Ream 210, Entropy Decode 212, Inverse Quantization 214, Inverse Transform 216, Adder 2 18, intra / inter mode selection 220, intra prediction 222, memory 230, Loop filter 228, motion compensation 224, image buffer 226, prediction related information 234, and and a video output 232.

[0022] FIG. 3 illustrates an example for generating combined inter- and intra-prediction (CIIP) in accordance with the present disclosure. An exemplary method 300 is shown.

[0023] In step 310, the first and second reference images associated with the current prediction block are Get two reference images, where the first reference image is before the current image in display order, and the second The reference image is after the current image in display order.

[0024] In step 312, the current prediction block is converted to a reference block in the first reference image. Based on the first motion vector MV0, a ​​first prediction L0 is obtained.

[0025] In step 314, the current prediction block is converted to a reference block in the second reference image. A second prediction L1 is obtained based on the second motion vector MV1.

[0026] JPEG0007809014000001.jpg55161

[0027] JPEG0007809014000002.jpg32161

[0028] FIG. 4 illustrates an exemplary method for generating a CIIP according to the present disclosure. The method uses a single-prediction-based inter-prediction and an MPM-based inter-prediction to generate a CIIP. Intra prediction is included.

[0029] In step 410, the reference image list associated with the current prediction block is A reference image is acquired.

[0030] In step 412, a first motion vector is calculated from the current image to the first reference image. Based on this, an inter prediction is generated.

[0031] In step 414, the intra prediction mode associated with the current prediction block is Get it.

[0032] In step 416, based on the intra prediction, an intra prediction of the current prediction block is performed. Generate measurements.

[0033] In step 418, the current Generate a final prediction for the predicted block.

[0034] In step 420, the current prediction block is selected as the most likely mode (MPM). For the base intra-mode prediction, whether it is inter-mode or intra-mode Identify how the information will be treated.

[0035] FIG. 5A illustrates a block quaternary partition in a multi-type tree structure according to an example of the present disclosure. A diagram showing this division is shown.

[0036] FIG. 5B illustrates a block vertical binary partition in a multi-type tree structure according to an example of the present disclosure. A diagram showing the partition is shown.

[0037] FIG. 5C illustrates a block horizontal binary partition in a multi-type tree structure according to an example of the present disclosure. A diagram showing the partition is shown.

[0038] FIG. 5D illustrates a block vertical ternary pattern in a multi-type tree structure according to an example of the present disclosure. A diagram showing the partition is shown.

[0039] FIG. 5E illustrates a block horizontal ternary pattern in a multi-type tree structure according to an example of the present disclosure. A diagram showing the partition is shown.

[0040] Combined inter and intra prediction As shown in Figures 1 and 2, the inter and intra prediction methods are used in hybrid video coding. used in a loading scheme, where each PU is a Only allows you to choose between inter-prediction and intra-prediction to take advantage of correlations. However, as pointed out in previous literature, The residual signals generated by the inter- and intra-prediction blocks have very different characteristics. Therefore, if the two types of predictions can be efficiently combined, ,To reduce the energy of the prediction residual and improve the coding efficiency, another positive Furthermore, in natural video content, the motion of moving objects is predicted accurately. This can be complicated, for example, by removing old content (e.g., previously coded objects contained in the image) and new content (e.g., previously coded There may be areas that contain both the object and the image (objects that are excluded in the image). In such a scenario, both inter and intra predictions are performed on one of the current blocks. cannot provide an accurate forecast of

[0041] To further improve prediction efficiency, the VVC standard includes a merge mode for coding. Hybrid inter- and intra-prediction, which combines intra and inter prediction for a single CU. Specifically, for each merged CU, one additional flag is added. The signaling is used to indicate whether CIIP is enabled for the current CU. For the luminance component, CIIP supports the planar mode, DC mode, and horizontal Supports four frequently used intra modes, including color mode and vertical mode. For each component, DM (i.e., chroma) is the same intramodulation of the luminance component. The CI (reuse of existing CI) is always applied without any additional signaling. In the IP design, a weighted average is applied to the inter-prediction samples of one CIIP CU. and intra prediction samples are combined. Specifically, planar mode or DC mode is selected. If both are present, equal weights (i.e. 0.5) are applied. (i.e., either horizontal mode or vertical mode is applied.), the current CU is first four equally sized regions horizontally (for horizontal mode) or vertically (for vertical mode) It is divided into

[0042] JPEG0007809014000003.jpg60161

[0043] Furthermore, in the current VVC operation specification, the intra mode of one CIIP CU is the most Through the Most Probable Mode (MPM) mechanism, the CIIP CU Specifically, each CI can be used as a predictor to predict the trajectory. For an IP CU, if its adjacent block is also a CIIP CU, The intra-modes of the adjacent blocks are first divided into planar mode, DC mode, horizontal mode, and rounded to the nearest mode within the vertical mode, then the MPM candidate list for the current CU However, when configuring the MPM list for each intra-CU, its neighboring One of the blocks is considered unavailable if coded in CIIP mode. That is, the intra mode of one CIIP CU is the same as the intra mode of its neighboring intra CUs. Figures 7A and 7B (discussed below) are not allowed to predict the intramode. ,Compare the MPM list generation process of Intra-CU and CIIP CU.

[0044] JPEG0007809014000004.jpg72162

[0045] JPEG0007809014000005.jpg84163

[0046] JPEG0007809014000006.jpg137163

[0047] JPEG0007809014000007.jpg61163

[0048] Here, shift and o offset are 15-BD and 1≪(14-BD)+2·(1≪13 ) and the right shift value applied to combine the L0 and L1 prediction signals in dual prediction. and the offset value.

[0049] FIG. 6A is a diagram illustrating combined inter and intra prediction in horizontal mode according to an example of the present disclosure. show.

[0050] FIG. 6B is a diagram illustrating combined inter and intra prediction in vertical mode according to an example of the present disclosure. show.

[0051] FIG. 6C illustrates a combined inter and intra prediction of planar and DC modes according to an example of the present disclosure. A diagram showing the measurement is shown.

[0052] FIG. 7A illustrates a flowchart of an MPM candidate list generation process for intra-CUS according to an example of the present disclosure. A flow chart is shown.

[0053] FIG. 7B illustrates a flowchart of an MPM candidate list generation process for a CIIP CU according to an example of the present disclosure. A flow chart is shown.

[0054] Improvements to CIIP CIIP can improve the efficiency of conventional motion compensation prediction, but its design needs further refinement. Specifically, the existing CIIP design in VVC can be improved to The following problems have been identified in this disclosure:

[0055] First, as explained in the "Combined Inter and Intra Prediction" section, CIIP is To combine inter and intra prediction samples, each CIIP CU must The predicted signal must be generated using the neighboring samples generated by one CII. This means that decoding a P CU depends on the perfect reconstruction of its neighboring blocks. Due to this interdependence, in actual hardware implementation, CIIP is It must be performed during the reconstruction stage, where the constructed samples become available for intra prediction. The decoding of CUs in the reconstruction stage must be performed sequentially (i.e., one by one). Therefore, the calculation operations involved in the CIIP process (e.g., multiplication, addition, bit shifting) ) should not be too high to ensure sufficient throughput for real-time decoding. It is not possible to do so.

[0056] As mentioned in the "Bidirectional Optical Flow" section, BDOF is the forward and backward Two reference blocks from both backward time directions are used to generate one inter-coded This is enabled so that prediction quality improves when a given CU is predicted. As shown in the figure, in the current VVC, BDOF is also used for the inter-prediction sample in CIIP mode. Considering the additional complexity of BDOF, Such a design allows for hardware codec encoding / decoding when CIIP is enabled. Decoding throughput can be significantly reduced.

[0057] Second, in the current CIIP design, one CIIP CU is double-predicted. When referring to a merge candidate, generate motion compensated prediction signals for both lists L0 and L1. If one or more MVs are not integer precision, partial sampling is required. To interpolate the samples at the row positions, an additional interpolation process must be invoked. Such a process not only increases computational complexity but also requires more access from external memory. It also increases memory bandwidth when reference samples need to be accessed.

[0058] Then, as discussed in the "Combined Inter- and Intra-Prediction" section, the current CI In IP design, the intra mode of CIIP CU and the intra mode of intra CU are , are treated differently when constructing the MPM list of their neighbors. If one current CU is coded in CIIP mode, its neighboring A CIIP CU is considered intra, i.e., it is considered to be an intra-model of neighboring CIIP CUs. A node can be added to the MPM candidate list, provided that the current CU is in intra-mode. If the CIIP CU is coded in the same way as the CIIP CU, the adjacent CIIP CU is considered to be an inter- Intra-modes of neighboring CIIP CUs are excluded from the MPM candidate list. Such a non-uniform design is not ideal for the final version of the VVC standard. It's possible that this is not the case.

[0059] FIG. 8 illustrates a workflow of an existing CIIP design in a VVC according to an example of the present disclosure. A diagram showing the above is shown.

[0060] Simplifying CIIP This disclosure addresses the existing CIIP design to facilitate hardware codec implementation. Generally, the main aspects of the technology proposed in this disclosure are The report is summarized as follows:

[0061] First, to improve the CIIP coding / decoding throughput, It is proposed to exclude BDOF from the generation of inter prediction samples in the

[0062] Second, to reduce computational complexity and memory bandwidth consumption, we use a single CIIP. When a CU is double predicted (i.e., has both L0 and L1 MVs), For example, convert a block from bi-predictive to uni-predictive to generate inter-predicted samples. A method for doing this is proposed.

[0063] Then, the two methods consider intra-block MPM candidates when forming MPM candidates for neighboring blocks. It is proposed to harmonize the intra-modes of CU and CIIP.

[0064] CIIP without BDOF As pointed out in the "Problem Statement" section, BDOF is a When U is bi-predicted, it is used to generate inter-predicted samples for CIIP mode. Due to the additional complexity of BDOF, existing CIIP designs This can significantly reduce encoding / decoding throughput, especially in Time decoding can be difficult for VVC decoders. For a CU, its final predicted sample is divided into inter-predicted and intra-predicted samples. In other words, the improved prediction sample by BDOF is The pull is not directly used as a prediction signal for the CIIP CU. Compare with the measured CU (where BDOF is directly applied to generate the predicted samples) As a result, the corresponding improvement obtained from BDOF is less effective in the CIIP CU. Therefore, based on the above circumstances, when generating inter prediction samples in CIIP mode, It is proposed to disable BDOF in Fig. 9 (described below). The corresponding workflow of the proposed CIIP process is shown below.

[0065] FIG. 9 illustrates a proposed CIIP method by removing BDOF according to an example of the present disclosure. A diagram showing the workflow is shown below.

[0066] CIIP based on a single forecast As mentioned above, a merge candidate referenced by one CIIP CU is double predicted. Sometimes, both L0 and L1 prediction signals are generated to predict samples within a CU. In order to reduce the bandwidth and complexity of the interpolation, in one embodiment of the present disclosure, of inter-predicted samples generated using single prediction (even if The CIIP mode uses the sigma-based prediction to combine with the intra prediction samples. Specifically, when the current CIIP CU is single prediction, the inter prediction sample is otherwise (i.e., the current CU is not a double-predicted CU). In the case where the prediction is performed, the inter-prediction samples used by CIIP are Generated based on a single prediction from a list (L0 or L1). Select a prediction list. There are various methods that can be applied to the first method. For any CIIP block, always select the first prediction (i.e., list L0). It has been proposed that:

[0067] In the second method, for any CIIP block predicted by two reference images, , it is proposed to always select the second prediction (i.e., list L1). One adaptive method is to find the image with a small Picture Order Count (POC) distance from the current image. This is applied when the prediction list associated with the reference picture in Figure 10 (hereinafter (described in) is a single-prediction-based CIIP that selects a list of predictions based on POC distance. The workflow is shown.

[0068] Finally, the last method only works in CIIP mode if the current CU is single predicted. It is proposed to enable CII to further reduce overhead. The signaling of the enable / disable flag of P depends on the prediction direction of the current CIIP CU. If the current CU is uni-predicted, the CIIP flag is set in the bitstream. Signaled to indicate whether CIIP is enabled or disabled. In this case (when the CU is double predicted), the signaling of the CIIP flag is skipped and always is assumed to be false, meaning that CIIP is always disabled.

[0069] FIG. 10 illustrates a single predictor that selects a prediction list based on POC distance according to an example of the present disclosure. A diagram showing the workflow of measurement-based CIIP is shown.

[0070] Harmonizing Intra-CU and Intra-CIIP Modes for MPM Candidate List Construction As mentioned above, the current CIIP design is based on the intra-CU and intra-CIIP CU. Regarding how the modes are used to form the MPM candidate list of those neighboring blocks, Specifically, both the intra-CU and intra-CIIP CU modes can predict the intra mode of neighboring blocks coded in CIIP mode. However, if only the intra mode of the intra CU is used, the intra mode of the intra CU is predicted. Another unified design is to achieve two methods: Harmonize the usage of Intra-CU and Intra-CIIP modes for configuration and this section This is proposed in the session.

[0071] The first method treats the CIIP mode as an inter mode for MPM list configuration. Specifically, it is proposed that one CIIP CU or one intra-CU When generating any of the MPM lists, the adjacent blocks must be coded in CIIP mode. If the intra mode of the neighboring block is disabled, the intra mode of the neighboring block is marked as disabled. In this way, the MPM list is configured using the intra mode of the CIIP block. Conversely, in the second method, the CIIP mode is used for MPM list configuration. It is proposed to treat CII as an intra mode. In intra mode of PCU, both adjacent CIIP blocks and intra blocks Figures 11A and 11B (described below) show the two methods described above. 1 shows the MPM candidate list generation process when

[0072] Other embodiments of the present disclosure may be contemplated in light of the specification and practice of the present disclosure disclosed herein. This application, in accordance with its general principles, is based on what is known in the art and is readily apparent to those skilled in the art. Any modification, use, or deviation from the present disclosure that is within the scope of the present disclosure or customary practice is expressly excluded. The true scope and spirit of the present disclosure is intended to cover any application or adaptation thereof. It is intended that the specification and examples be considered exemplary only, as indicated by the following claims. It has been done.

[0073] The present disclosure is not limited to the specific examples described above and illustrated in the accompanying drawings, but rather to It is understood that various modifications and changes can be made without departing from the scope of the present invention. The scope of the present disclosure is intended to be limited only by the claims appended hereto. do.

[0074] FIG. 11A illustrates a block diagram of a CIIP block for MPM candidate list generation according to an example of the present disclosure. 1 shows a flowchart of an enabling method.

[0075] FIG. 11B illustrates a block diagram of a CIIP block for MPM candidate list generation according to an example of the present disclosure. 10 shows a flowchart of a method for disabling.

[0076] FIG. 12 illustrates a computing environment 1260 coupled with a user interface 1260. 10. The computing environment 1210 may be part of a data processing server. The computing environment 1210 includes a processor 1220, memory 1240, and I / O. 0 interface 1250.

[0077] The processor 1220 typically handles functions related to display, data acquisition, data communication, and image processing. The processor controls the overall operation of the computing environment 1210, including the operation of 1220 executes instructions for performing all or some of the steps of the above method. The processor 1220 may include one or more processors. 220 and other components. A processor is a central processing unit (CPU), a microprocessor, or a single-chip machine. It can be a processor, a GPU, etc.

[0078] The memory 1240 includes various components to support the operation of the computing environment 1210. It is configured to store various types of data. Examples of such data are computer instructions for any application or method operating in the video processing environment 1210, The memory 1240 may include any type of volatile or non-volatile memory. a static memory device, or a combination thereof, e.g., static random access memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM) , Erasable Programmable Read-Only Memory (EPROM), Programmable Read Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory This can be achieved using memory, magnetic disks or optical disks.

[0079] The I / O interface 1250 connects the processor 1220 to the keyboard, click-button, and Provides an interface between peripheral interface modules such as wheels and buttons The buttons include a home button, a start scan button, and a stop scan button. The I / O interface 1250 includes, but is not limited to, an encoder. and a decoder.

[0080] In one embodiment, in order to perform the above-described methods, A plurality of programs, such as those included in memory 1240, executable by processor 1220 of the A non-transitory computer-readable storage medium containing the program is also provided. Suitable computer readable storage media include ROM, RAM, CD-ROM, magnetic tape, floppy disks, It may be a disc, an optical data storage device, or the like.

[0081] The non-transitory computer-readable storage medium may be a computer having one or more processors. It stores multiple programs for execution by a computing device. When executed by one or more processors, the programs The operating device executes the above-described method for predicting behavior.

[0082] In one embodiment, the computing environment 1210 includes a , one or more application specific integrated circuits (ASICs), digital signal processors (DS P), Digital Signal Processing Devices (DSPD), Programmable Logic Devices (PL D), Field Programmable Gate Array (FPGA), Graphical Processing Graphics Processing Unit (GPU), Controller, Microcontroller, Microprocessor This can be realized by a computer or other electronic components.

Claims

1. generating an inter prediction for the current coding block based on at least one motion vector from the current image to each of the at least one reference image; generating an intra prediction of the current coding block based on an intra prediction mode; generating a final prediction of the current coding block by weighted averaging the inter prediction and the intra prediction; Specifying that the current coding block is treated as one unified mode when constructing a most probable mode (MPM) list of the neighboring coding blocks, regardless of the prediction modes of the neighboring coding blocks, wherein the unified mode is predefined as an inter mode, or the unified mode is predefined as an intra mode; and arranging entropy encoded information indicating coding mode and prediction mode information to be transmitted to a decoder; Including, In response to identifying that the current coding block is treated as an inter mode for constructing the MPM list of the neighboring coding block, the intra prediction mode of the current coding block is not used for MPM-based intra mode prediction of the neighboring coding block, regardless of the prediction mode of the neighboring coding block; In response to identifying that the current coding block is treated as an intra-mode block for constructing the MPM list of the neighboring coding block, the intra-prediction mode of the current coding block is used for MPM-based intra-mode prediction of the neighboring coding block, regardless of the prediction mode of the neighboring coding block; Bidirectional optical flow (BDOF) operations are disabled for the current coding block. Video encoding method.

2. 2. The method of claim 1, further comprising: in response to determining that the current coding block is predicted from one reference picture in a reference picture list L0, determining that the at least one reference picture includes the one reference picture in the reference picture list L0.

3. 2. The method of claim 1, further comprising: in response to determining that the current coding block is predicted from one reference picture in a reference picture list L1, determining that the at least one reference picture includes the one reference picture in the reference picture list L1.

4. 2. The method of claim 1, further comprising: in response to identifying that the current coding block is predicted from one first reference picture in reference picture list L0 and one second reference picture in reference picture list L1, identifying the at least one reference picture as including a reference picture having a smaller picture order count (POC) distance to the current picture.

5. The method of claim 1 , wherein the intra-prediction mode is INTRA_PLANAR.

6. A video encoding apparatus comprising one or more processors and one or more storages coupled to said one or more processors, said apparatus being configured to perform the method of any one of claims 1 to 5.

7. 1. A non-transitory computer-readable storage medium storing a plurality of programs for execution by a computing device having one or more processors, comprising:

6. A non-transitory computer-readable storage medium, wherein when the one or more processors execute the plurality of programs, the plurality of programs cause the computing device to perform the method of any one of claims 1 to 5 to generate a bitstream and store the bitstream on the non-transitory computer-readable storage medium.

Images