Encoding and decoding methods and devices

Abstract

This application provides an encoding / decoding method and apparatus, relating to the field of data compression. The decoding method includes: receiving an interleaved encoded image bitstream, the encoded image bitstream including multiple bitstream segments of a reference image and multiple display image bitstreams, wherein the bitstream segments of the reference image are ordered before the bitstream of a reference start image in the multiple display image bitstreams, and the reference start image includes the image of the first reference reference image among the multiple display images; performing a decoding operation on the encoded image bitstream, and obtaining a reconstructed reference image based on the operation result; and, if the currently processed display image bitstream is the bitstream of the reference start image of the currently obtained reconstructed reference image, using the currently obtained reconstructed reference image as the reference image, performing inter-frame prediction decoding on the display image bitstream. This application can accurately determine the reference image used for encoding and decoding display images, improving the encoding / decoding success rate of the codec.

Description

[0001] This application is a divisional application. The original application has the application number 202311131845.X and the original application date is September 1, 2023. The entire contents of the original application are incorporated herein by reference. Technical Field

[0002] This application relates to the field of data compression technology, and in particular to an encoding / decoding method and apparatus. Background Technology

[0003] With the widespread adoption of digital video applications (such as digital television broadcasting, video transmission over the internet, real-time video conferencing applications, video content storage, video content acquisition and editing systems, etc.), video encoding and decoding (video coding and video decoding) using codecs (encoders and decoders) are widely used. Video coding involves the encoder compressing the original video stream using a specific compression algorithm, resulting in a compressed video stream that is easier to store and transmit. Video decoding involves the decoder decoding the compressed video stream to obtain the original video stream.

[0004] In related technologies, an encoding and decoding scheme based on Cross Random Access Point Reference (CRR) images is provided. For example, an encoder encodes slices of multiple display images and their corresponding CRR images to obtain an encoded image bitstream and a reconstructed CRR image. The encoded image bitstream includes multiple interleaved CRR image bitstream segments and multiple display image bitstreams. The encoder can use the reconstructed CRR image corresponding to the current display image as a reference image to perform inter-frame predictive coding on the current display image to eliminate temporal redundancy. Correspondingly, the decoder decodes the encoded image bitstream to obtain the reconstructed CRR image and multiple display image bitstreams. The decoder can use the reconstructed CRR image corresponding to the current display image bitstream as a reference image to perform inter-frame predictive decoding on the current display image bitstream to eliminate temporal redundancy. Since the CRR image corresponds to multiple display images, and these multiple display images can include multiple cross-random access points (RAPs), the reconstructed CRR image can be used as a cross-RAP reference.

[0005] However, cross-RAP referencing means that the displayed image and the reconstructed CRR image that the displayed image references are relatively far apart. Thus, the reconstructed CRR image that the codec determines as the reference image for the displayed image may not actually be the reference image that the displayed image should use, leading to encoding / decoding failure. Summary of the Invention

[0006] This application provides an encoding / decoding method and apparatus that solves the problem of mismatch between reference images and display images in related technologies. It can accurately determine the reference image used for encoding and decoding the display image, thereby improving the encoding / decoding success rate of the codec.

[0007] In a first aspect, this application provides an encoding method, which includes: performing encoding operations on a cross-random access point reference CRR image and multiple display images corresponding to the CRR image to obtain an encoded image bitstream; and obtaining a reconstructed CRR image based on the encoding operations; and, if the currently processed display image is the reference enabled first image of the currently obtained reconstructed CRR image, performing inter-frame predictive coding on the display image using the currently obtained reconstructed CRR image as the reference image; wherein the encoded image bitstream includes: multiple CRR image bitstream segments interleaved and ordered, multiple display image bitstreams, and image information; the image information is used to indicate the reference enabled first image, which includes the first image in the display images that references the reconstructed CRR image.

[0008] In this embodiment of the application, when the encoder encounters a reference enabled first image for reconstructing a CRR image during inter-frame predictive coding, it determines the reconstructed CRR image of the reference enabled first image as the reference image. This ensures that there is a reference image that matches the display image when performing inter-frame predictive coding on the display image, avoiding coding failure caused by the mismatch between the reference image and the display image, and improving the coding success rate.

[0009] In one possible implementation, the reference image used for inter-frame predictive coding is stored in a designated buffer; when the currently processed display image is the reference enabled first image for the currently acquired reconstructed CRR image, the currently acquired reconstructed CRR image is used as the reference image, including: when the currently processed display image is the reference enabled first image for the currently acquired reconstructed CRR image, the designated buffer is updated using the currently acquired reconstructed CRR image.

[0010] In this embodiment, the reference image used for inter-frame predictive coding is stored in a designated buffer. The reference image can then be determined by updating the designated buffer using the currently acquired reconstructed CRR image, without the need for additional marking and recording information, making it more efficient.

[0011] In one possible implementation, the specified buffer is updated using the currently acquired reconstructed CRR image, including:

[0012] If a historical reconstructed CRR image is obtained from a specified buffer, the historical reconstructed CRR image in the specified buffer is replaced with the currently obtained reconstructed CRR image.

[0013] In this embodiment, if the encoder already contains a previously reconstructed CRR image, the previous reconstructed CRR image is replaced with a new one. This balances the ability to directly use the reconstructed image from the encoder for subsequent display images while improving update timeliness, thus achieving both accuracy and encoding efficiency.

[0014] In one possible implementation, the specified buffer is updated using the currently acquired reconstructed CRR image, including:

[0015] If no historical reconstructed CRR image is obtained from the specified buffer, the currently obtained reconstructed CRR image is stored in the specified buffer.

[0016] In this embodiment, if there is no reconstructed CRR image in the encoder, the currently obtained reconstructed CRR image can be directly moved into the buffer. An unused reconstructed CRR image means there is no longer a display image to use, so the buffer is empty and can be directly moved in, thereby expanding the applicable scenarios and further avoiding encoding failures.

[0017] In one possible implementation, after obtaining the reconstructed CRR image based on encoding operations, the method further includes:

[0018] When the currently processed display image is a non-reference enabled first image of the currently acquired reconstructed CRR image, the reconstructed CRR image used in the previous processed display image is used as the reference image for inter-frame predictive coding of the display image.

[0019] In this embodiment of the application, when the currently processed display image is a non-reference enabled first image of the currently acquired reconstructed CRR image, the reconstructed CRR image used by the previously processed display image is used as the reference image, thereby ensuring that the reference image can be accurately determined for long-distance multiple display images in cross-RAP scenes, and further improving the encoding success rate.

[0020] Secondly, this application provides a decoding method, which includes: receiving an encoded image bitstream, the encoded image bitstream including interleaved sorted cross-random access point reference CRR image bitstream segments, multiple display image bitstreams, quantity information, and image information; the image information is used to indicate a reference enabled first image, the reference enabled first image including the first image in the display images that references the reconstructed CRR image; performing a decoding operation on the encoded image bitstream, and obtaining a reconstructed CRR image based on the operation result; if the currently processed display image bitstream is the reference enabled first image bitstream of the currently obtained reconstructed CRR image, using the currently obtained reconstructed CRR image as a reference image, performing inter-frame prediction decoding on the display image bitstream.

[0021] In this embodiment of the application, when the decoder encounters a reference enabled first image bitstream for reconstructing a CRR image during inter-frame prediction decoding, it determines the reconstructed CRR image of the reference enabled first image bitstream as the reference image. This ensures that there is a reference image matching the display image when performing inter-frame prediction decoding on the display image bitstream, avoiding decoding failure caused by mismatch between the reference image and the display image bitstream, and improving the decoding success rate.

[0022] In one possible implementation, the encoded image bitstream also includes quantity information, which indicates n, where n is an integer greater than 1; the encoded image bitstream is decoded, and a reconstructed CRR image is obtained based on the result of the operation, including: if there are n CRR image bitstream segments in the encoded image bitstream, and the currently processed display image bitstream is determined to be the reference enabled first image bitstream of the currently obtained reconstructed CRR image according to the image information, the n CRR image bitstream segments are decoded to obtain the reconstructed CRR image.

[0023] In this embodiment, the decoder only acquires the reconstructed CRR image when it encounters a CRR image with the first image bitstream enabled. This ensures that the cached image is a CRR image bitstream segment, resulting in low caching cost and improved performance.

[0024] In one possible implementation, the encoded image bitstream also includes quantity information, which indicates n, where n is an integer greater than 1; the encoded image bitstream is decoded, and a reconstructed CRR image is obtained based on the result of the operation, including: if there are n CRR image bitstream segments in the encoded image bitstream, the n CRR image bitstream segments are decoded to obtain the reconstructed CRR image.

[0025] In this embodiment, the decoder receives the complete CRR slice bitstream and immediately acquires the reconstructed CRR image, which can then be used for decoding more promptly.

[0026] In one possible implementation, after decoding the encoded image bitstream and obtaining the reconstructed CRR image based on the operation result, the method further includes: if the currently processed display image bitstream is a non-reference enabled first image bitstream of the currently obtained reconstructed CRR image, using the reconstructed CRR image used in the previously processed display image bitstream as a reference image, and performing inter-frame prediction decoding on the display image bitstream.

[0027] In this embodiment of the application, if there is a display image bitstream of the previous reconstructed CRR image that is still in use, the process waits until the first image bitstream of the CRR image is received before using the currently acquired reconstructed CRR image as the reference image, thus ensuring that the display image bitstream of the previous reconstructed CRR image can be successfully decoded.

[0028] In one possible implementation, the reference image used for inter-frame predictive coding is stored in a designated buffer; using the currently acquired reconstructed CRR image as the reference image includes: updating the designated buffer using the currently acquired reconstructed CRR image when the currently processed display image bitstream is the reference first image bitstream of the currently acquired reconstructed CRR image.

[0029] In this embodiment, the reconstructed CRR image, which serves as a reference image, is stored in a designated buffer. The designated buffer is then updated using the currently acquired reconstructed CRR image. This method determines the reference image without requiring additional marking or information addition, making it more efficient.

[0030] Thirdly, this application provides an encoding apparatus, comprising: a reconstructed image acquisition module, configured to perform encoding operations on a cross-random access point reference image and multiple display images corresponding to the reference image to obtain an encoded image bitstream, and then acquire a reconstructed reference image based on the encoding operations; and a reference image determination module, configured to, when the currently processed display image is the reference start image of the currently acquired reconstructed reference image, use the currently acquired reconstructed reference image as the reference image and perform inter-frame predictive coding on the display image; wherein the encoded image bitstream includes: multiple interleaved and ordered reference image bitstream segments, multiple display image bitstreams, and image information; the image information is used to indicate the reference start image, and the reference start image includes the first image in the display images that references the reconstructed reference image.

[0031] In one possible implementation, the reference image used for inter-frame predictive coding is stored in a designated buffer; the reference image determination module is specifically used to update the designated buffer using the currently acquired reconstructed reference image when the currently processed display image is the reference enabled first image of the currently acquired reconstructed reference image.

[0032] In one possible implementation, the reference image determination module is specifically used to: replace the historical reconstruction reference image in the specified buffer with the currently acquired reconstruction reference image when a historical reconstruction reference image is obtained from a specified buffer.

[0033] In one possible implementation, the reference image determination module is specifically used to: store the currently acquired reconstructed reference image into the specified buffer if a historical reconstructed reference image is not obtained from the specified buffer.

[0034] In one possible implementation, the reference image determination module is further configured to: when the currently processed display image is a non-reference enabled first image of the currently acquired reconstructed reference image, use the reconstructed reference image used in the previous processed display image as the reference image to perform inter-frame predictive coding of the display image.

[0035] The third aspect and any implementation thereof correspond to the first aspect and any implementation thereof, respectively. The technical effects of the third aspect and any implementation thereof are similar to those of the first aspect and any implementation thereof, and will not be repeated here.

[0036] Fourthly, this application provides a decoding apparatus, comprising: a transceiver module for receiving an encoded image bitstream, the encoded image bitstream including interleaved, random access point reference image bitstream segments, multiple display image bitstreams, quantity information, and image information; the image information is used to indicate a reference enabled first image, the reference enabled first image including the first image in the display images that references the reconstructed reference image; and a decoding module for performing a decoding operation on the encoded image bitstream and, based on the operation result, obtaining a reconstructed reference image; and, when the currently processed display image bitstream is the reference enabled first image bitstream of the currently obtained reconstructed reference image, using the currently obtained reconstructed reference image as the reference image for inter-frame prediction decoding of the display image bitstream.

[0037] In one possible implementation, the encoded image bitstream also includes quantity information, which is used to indicate n, where n is an integer greater than 1; the decoding module is specifically used to: if there are n reference image bitstream segments in the encoded image bitstream, and if the currently processed display image bitstream is determined to be the reference enabled first image bitstream of the currently acquired reconstructed reference image based on the image information, decode the n reference image bitstream segments to obtain the reconstructed reference image.

[0038] In one possible implementation, the encoded image bitstream also includes quantity information, which is used to indicate n, where n is an integer greater than 1; the decoding module is specifically used to: if there are n reference image bitstream segments in the encoded image bitstream, decode the n reference image bitstream segments to obtain the reconstructed reference image.

[0039] In one possible implementation, the decoding module is further configured to: perform a decoding operation on the encoded image bitstream, and after obtaining a reconstructed reference image based on the operation result, if the currently processed display image bitstream is a non-reference enabled first image bitstream of the currently obtained reconstructed reference image, use the reconstructed reference image used in the previous processed display image bitstream as the reference image to perform inter-frame prediction decoding on the display image bitstream.

[0040] In one possible implementation, the reference image used for inter-frame predictive coding is stored in a designated buffer; the decoding module is specifically configured to: update the designated buffer using the currently acquired reconstructed reference image when the currently processed display image bitstream is the reference enabled first image bitstream of the currently acquired reconstructed reference image.

[0041] The fourth aspect and any two implementations thereof correspond to the second aspect and any two implementations thereof, respectively. The technical effects of the fourth aspect and any two implementations thereof can be found in the technical effects of the second aspect and any two implementations thereof mentioned above, and will not be repeated here.

[0042] Fifthly, this application provides an encoding apparatus, comprising: one or more processors; a memory for storing one or more computer programs or instructions; wherein when the one or more computer programs or instructions are executed by the one or more processors, the one or more processors implement the method as described in any one of the first aspects.

[0043] In a sixth aspect, this application provides a decoding apparatus, comprising: one or more processors; a memory for storing one or more computer programs or instructions; wherein when the one or more computer programs or instructions are executed by the one or more processors, the one or more processors implement the method as described in any one of the second aspects.

[0044] In a seventh aspect, this application provides an encoding apparatus, including a processor for performing the method as described in any one of the first aspects.

[0045] Eighthly, this application provides a decoding apparatus, including a processor for performing the method as described in any one of the second aspects.

[0046] Ninthly, this application provides an electronic device, including: a processing circuit and an interface circuit; wherein the interface circuit is used to couple with a memory external to an encoding / decoding device and to provide a communication interface for the processing circuit to access the memory; the processing circuit is used to execute program instructions in the memory to implement the method as described in any of the first to second aspects.

[0047] In practical implementation, the electronic device can be a chip, the input circuit can be an input pin, the output circuit can be an output pin, and the processing circuit can be a transistor, gate circuit, flip-flop, and various logic circuits. The input signal received by the input circuit can be received and input by, for example, but not limited to, a receiver, and the signal output by the output circuit can be output to, for example, but not limited to, a transmitter and transmitted by the transmitter. Furthermore, the input circuit and the output circuit can be the same circuit, which is used as the input circuit and the output circuit at different times. This application does not limit the specific implementation of the processor and various circuits.

[0048] In one implementation, the electronic device can be a wireless communication device, i.e., a computer device that supports wireless communication functionality. Specifically, the wireless communication device can be a terminal such as a smartphone, or a wireless access network device such as a base station. A system-on-a-chip (SoC) is also called a system-on-chip (SoC). Communication chips may include baseband processing chips and radio frequency (RF) processing chips. The baseband processing chip is sometimes referred to as a modem or baseband chip. The RF processing chip is sometimes referred to as an RF transceiver or RF chip. In physical implementation, some or all of the communication chips can be integrated within the SoC chip. For example, the baseband processing chip is integrated into the SoC chip, while the RF processing chip is not integrated with the SoC chip. The interface circuit can be the RF processing chip in the wireless communication device, and the processing circuit can be the baseband processing chip in the wireless communication device.

[0049] In another implementation, the electronic device can be a component of a wireless communication device, such as an integrated circuit product like a system-on-a-chip (SoC) or communication chip. The interface circuit can be an input / output interface, interface circuit, output circuit, input circuit, pins, or related circuits on the chip or chip system. The processor can also be represented as a processing circuit or logic circuit.

[0050] In a tenth aspect, this application provides a computer-readable storage medium storing program code, which, when executed by a processor, implements the method described in any one of the first to second aspects.

[0051] Eleventhly, this application provides a chip comprising: at least one processor. The at least one processor is configured to perform the method as described in any one of the first to second aspects.

[0052] Optionally, the chip also includes memory. At least one processor is used to execute code in the memory, and when the at least one processor executes the code, the chip implements the method as described in any one of the first to second aspects.

[0053] Alternatively, the chip described above can also be an integrated circuit.

[0054] In a twelfth aspect, this application provides a computer program product containing instructions that, when run on a computer, cause the computer to perform the method as described in any one of the first to second aspects. Attached Figure Description

[0055] Figure 1 An exemplary block diagram of a decoding system provided in this application embodiment;

[0056] Figure 2A schematic diagram of a video sequence provided in an embodiment of this application;

[0057] Figure 3 A flowchart illustrating an encoding method provided in an embodiment of this application;

[0058] Figure 4 A flowchart illustrating a decoding method provided in an embodiment of this application;

[0059] Figure 5 This application provides a schematic diagram of an encoding / decoding process.

[0060] Figure 6 This is a schematic diagram illustrating another encoding / decoding process provided in an embodiment of this application;

[0061] Figure 7 This is a schematic diagram illustrating another encoding / decoding process provided in an embodiment of this application;

[0062] Figure 8 This is a schematic diagram illustrating another encoding / decoding process provided in an embodiment of this application;

[0063] Figure 9 This is a schematic diagram illustrating another encoding / decoding process provided in an embodiment of this application;

[0064] Figure 10 This is a schematic diagram illustrating another encoding / decoding process provided in an embodiment of this application;

[0065] Figure 11 This is a schematic diagram illustrating another encoding / decoding process provided in an embodiment of this application;

[0066] Figure 12 This is a schematic diagram of another encoding / decoding process provided in an embodiment of this application. Detailed Implementation

[0067] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0068] The terms "first," "second," etc., used in the specification, embodiments, claims, and drawings of this application are for distinguishing purposes only and should not be construed as indicating or implying relative importance or order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion, such as including a series of steps or units. A method, system, product, or apparatus is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to these processes, methods, products, or apparatuses.

[0069] It should be understood that in this application, "at least one (item)" means one or more, and "more than" means two or more. "And / or" is used to describe the relationship between related objects, indicating that three relationships can exist. For example, "A and / or B" can represent three cases: only A exists, only B exists, and both A and B exist simultaneously, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one (item) of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one (item) of a, b, or c can represent: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.

[0070] Figure 1 This is an exemplary block diagram of a decoding system provided for embodiments of this application, such as a video decoding system 10 (or simply decoding system 10) that can utilize the technology of this application. The video encoder 20 (or simply encoder 20) and video decoder 30 (or simply decoder 30) in the video decoding system 10 represent devices, etc., that can be used to perform various technologies according to the various examples described in this application.

[0071] like Figure 1 As shown, the decoding system 10 includes a source device 12, which provides encoded image data 21, such as encoded images, to a destination device 14 for decoding the encoded image data 21.

[0072] The source device 12 includes an encoder 20, and optionally may include an image source 16, a preprocessor (or preprocessing unit) 18 such as an image preprocessor, and a communication interface (or communication unit) 22.

[0073] Image source 16 may include or may be any type of image capture device for capturing real-world images, and / or any type of image generation device, such as a computer graphics processor for generating computer animation images or any type of device for acquiring and / or providing real-world images, computer-generated images (e.g., screen content, virtual reality (VR) images, and / or any combination thereof (e.g., augmented reality (AR) images). Image source may be any type of memory or storage device storing any of the images described above.

[0074] To distinguish the processing performed by the preprocessor (or preprocessing unit) 18, the image (or image data) 17 may also be referred to as the raw image (or raw image data) 17.

[0075] The preprocessor 18 receives the raw image data 17 and preprocesses it to obtain a preprocessed image (or preprocessed image data) 19. For example, the preprocessing performed by the preprocessor 18 may include cropping, color format conversion (e.g., from RGB to YCbCr), color correction, or noise reduction. It is understood that the preprocessing unit 18 may be an optional component.

[0076] The video encoder (or encoder) 20 is used to receive preprocessed image data 19 and provide encoded image data 21.

[0077] The communication interface 22 in the source device 12 can be used to: receive encoded image data 21 and send encoded image data 21 (or other arbitrarily processed version) to another device such as the destination device 14 or any other device via the communication channel 13 for storage or direct reconstruction.

[0078] Source device 12 may also include a memory ( Figure 1 (Not shown), the memory can be used to store at least one of the following data: raw image data 17, preprocessed image (or preprocessed image data) 19, and encoded image data 21.

[0079] The target device 14 includes a decoder 30, and optionally may include a communication interface (or communication unit) 28, a post-processor (or post-processing unit) 32 and a display device 34.

[0080] The communication interface 28 in the destination device 14 is used to receive encoded image data 21 (or other processed versions) directly from the source device 12 or from any other source device such as a storage device, for example, the storage device is an encoded image data storage device, and to provide the encoded image data 21 to the decoder 30.

[0081] Communication interfaces 22 and 28 can be used to send or receive encoded image data (or encoded data 21) through a direct communication link between source device 12 and destination device 14, such as a direct wired or wireless connection, or through any type of network, such as a wired network, a wireless network or any combination thereof, any type of private network and public network or any combination thereof.

[0082] For example, the communication interface 22 can be used to encapsulate the encoded image data 21 into a suitable format such as a message, and / or process the encoded image data using any type of transmission encoding or processing, so as to transmit it on a communication link or communication network.

[0083] Communication interface 28 corresponds to communication interface 22. For example, it can be used to receive transmitted data and process the transmitted data using any type of corresponding transmission decoding or processing and / or decapsulation to obtain encoded image data 21.

[0084] Both communication interface 22 and communication interface 28 can be configured as follows: Figure 1 The arrow pointing from the source device 12 to the corresponding communication channel 13 of the destination device 14 indicates a one-way or two-way communication interface, which can be used to send and receive messages, establish connections, acknowledge and exchange any other information related to the communication link and / or data transmission, such as encoded image data transmission, etc.

[0085] The video decoder (or decoder) 30 is used to receive encoded image data 21 and provide decoded image data (or decoded image data) 31.

[0086] The post-processor 32 is used to post-process the decoded image data 31 (also known as the reconstructed image data) to obtain post-processed image data 33. The post-processing performed by the post-processing unit 32 may include, for example, color format conversion (e.g., from YCbCr to RGB), color adjustment, trimming or resampling, or any other processing to generate the decoded image data 31 for display by the display device 34, etc.

[0087] Display device 34 is used to receive post-processed image data 33 to display the image to a user or viewer. Display device 34 can be or includes any type of display for representing the reconstructed image, such as an integrated or external display screen or monitor. For example, the display screen may include a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a plasma display, a projector, a micro LED display, a liquid crystal on silicon (LCoS), a digital light processor (DLP), or any other type of display screen.

[0088] The destination device 14 may also include a memory ( Figure 1 (Not shown), the memory can be used to store at least one of the following data: encoded image data 21, decoded image data 31, and post-processed image data 33.

[0089] The decoding system 10 also includes a training engine 25, which is used to train the encoder 20 to process the input image or image region or image block to obtain a feature map of the input image or image region or image block, and to obtain an estimated probability distribution of the feature map and encode the feature map according to the estimated probability distribution.

[0090] The training engine 25 is also used to train the decoder 30 to obtain the estimated probability distribution of the bitstream, decode the bitstream according to the estimated probability distribution to obtain the feature map, and decode the feature map to reconstruct the reconstructed image.

[0091] although Figure 1 The source device 12 and destination device 14 are shown as independent devices, but device embodiments may also include both source device 12 and destination device 14, or the functions of both source device 12 and destination device 14, that is, simultaneously including source device 12 or its corresponding functions and destination device 14 or its corresponding functions. In these embodiments, source device 12 or its corresponding functions and destination device 14 or its corresponding functions may be implemented using the same hardware and / or software, or by separate hardware and / or software, or any combination thereof.

[0092] According to the description, Figure 1 The presence and (accurate) division of different units or functions in the source device 12 and / or destination device 14 shown may vary depending on the actual device and application, which is obvious to those skilled in the art.

[0093] Before describing the embodiments of this application, the terms and concepts used in the embodiments of this application will be explained first.

[0094] Reconstructed image: This refers to the lossy image obtained after decoding an encoded image bitstream, which can be displayed and played. It exists simultaneously at both the encoding and decoding ends, and the reconstructed images at both ends are identical. At the encoding end, the reconstructed image can be used as a reference image for inter-frame predictive coding of the image to be encoded. At the decoding end, the reconstructed image can be used as a reference image for inter-frame predictive decoding of the image bitstream to be decoded.

[0095] RAP: Random Access Point in video coding. A video bitstream encoded with at least one RAP is included. When random access occurs, the video bitstream before the RAP can be skipped, and decoding of the subsequent image bitstream can begin from the RAP, playing the reconstructed video image from the decoded output. From a video playback perspective, random access can be understood as dragging the player's progress bar to randomly jump between video streams (or local playback); or, when packet loss and a black screen occur during live streaming, the client will access the video stream at the next RAP to continue playback. RAPs are typically Intra-coded Picture (I) frames. I-frames only use information within the current frame for predictive coding to eliminate spatial information redundancy, without relying on other frames.

[0096] RAS: A RAS consists of all images from one RAP to the next. Images in a RAS are either predictive (P) frames or bi-directional interpolated prediction (B) frames. P or B frames require temporal prediction using the already encoded images to eliminate temporal redundancy.

[0097] For example, please refer to Figure 2 , Figure 2 This is a schematic diagram of a video sequence provided in an embodiment of this application. Figure 2 Eleven video frames, a1 to a11, are shown. A2, a6, and a10 are I-frames and form the RAP; all video frames between a2 and a6 are P-frames and constitute RAS1; and all video frames between a6 and a10 are P-frames and constitute RAS2. Figure 2 As can be seen, each P-frame needs to be encoded by referring to the previous m video frames, where m is an integer greater than 1. For example, a3 can be encoded by referring to a2, and a4 can be encoded by referring to a2 and / or a3.

[0098] CRR encoding: When encoding a video frame in a RAS, video frames in other RASs can be referenced for encoding.

[0099] In most videos (such as movies or television programs), many scenes appear alternately, and scenes displayed at different times may be similar. The interval between two adjacent similar scenes is usually relatively long. Therefore, two adjacent similar scenes may be within the same RAP but with a long interval, or their temporal correlation may span across RAPs. For example, video standards generally specify the length of the RAS (Rapid Availability) as 1 second or 2 seconds, and the interval between two adjacent similar scenes is usually close to the length of the RAS (e.g., 0.7 seconds) or greater than the length of the RAS (e.g., 3 seconds). Furthermore, in video scenarios such as security monitoring, similar scenes often appear for a relatively long time, so two similar scenes may also be within the same RAP but with a long interval, or their temporal correlation may span across RAPs.

[0100] This application provides an encoding and decoding method that can accurately determine the reference image and improve the success rate of video encoding and decoding when encoding and decoding videos with high scene repetition.

[0101] Please refer to Figure 3 , Figure 3 This is a flowchart illustrating an encoding method provided in an embodiment of this application. The method can be applied to an encoder and may include the following steps:

[0102] S301, after performing encoding operations on the cross-random access point reference CRR image and multiple display images corresponding to the CRR image to obtain an encoded image bit stream, the reconstructed CRR image is obtained based on the encoding operation.

[0103] For example, S301 above may specifically include the following processes 401 to 403 and optional implementation methods:

[0104] 401. Obtain the CRR images corresponding to multiple display images.

[0105] Multiple display images can be consecutive display images within a video sequence. The encoder can be set with a preset duration, dividing the video sequence into at least one video segment according to the preset duration, and acquiring a CRR image corresponding to each video segment. Multiple display images can form a single video segment. The preset duration can be longer than the current RAS length, for example, the preset duration can be 6s, 7s, or 10s. Correspondingly, multiple display images include multiple RAPs, each RAP can be a P-frame or a B-frame.

[0106] A reconstructed CRR image can serve as a reference image for multiple subsequent display images to be encoded. Optionally, any one of the multiple display images can be used as the CRR image corresponding to the multiple display images. Alternatively, multiple CRR images corresponding to the multiple display images can be constructed based on the multiple display images. This application does not limit the method of obtaining the CRR image.

[0107] 402. Encode the CRR image and multiple display images to obtain an encoded image bitstream. The encoded image bitstream includes n interleaved CRR image bitstream segments and multiple display image bitstreams, where n is an integer greater than 1.

[0108] The encoded image bitstream is a single-channel bitstream. When n CRR image bitstream segments are transmitted, the transmission order (i.e. the encoder output order) is always before the bitstream of the first display image that references that CRR image.

[0109] The CRR image is used to generate the reconstructed image, which can then serve as a reference image for inter-frame predictive coding of the display image to be encoded. The CRR image does not need to be displayed. After encoding a display image in a video sequence, a display image bitstream and a reconstructed display image are obtained. Therefore, in this embodiment, the reconstructed image includes two types: a reconstructed display image and a reconstructed CRR image.

[0110] The reference images for the displayed images include: the reconstructed displayed image and / or the currently active reconstructed CRR image. The currently active reconstructed CRR image can be stored in the encoder's buffer space, such as in the encoder's DPB. The currently active reconstructed CRR image refers to the reconstructed CRR image that is in effect at the moment of encoding operations on each of the multiple displayed images.

[0111] When encoding each of the multiple display images, at least one display image bitstream has already been encoded, and correspondingly, at least one reconstructed display image exists. Optionally, any number of reconstructed display images from all currently obtained reconstructed display images can be used as reference images for that display image. For example, the reference images for the display image include at least one reconstructed display image obtained from the encoding operation performed on the most recently output display image. For instance, when encoding the third display image among the multiple display images, the current encoding results in the first display image bitstream and the first reconstructed display image corresponding to the first display image, and the second display image bitstream and the second reconstructed display image corresponding to the second display image. Therefore, when encoding the third display image among the multiple display images, the first and second reconstructed display images can be used as reference images for the third display image.

[0112] The currently active reconstructed CRR image is obtained through encoding operations performed on the CRR image. Optionally, it can be obtained when encoding a group of CRR image bitstream segments. The group of CRR image bitstream segments can include: the latest n output CRR image bitstream segments, or the latest n output CRR image bitstream segments corresponding to the same CRR image. Here, "latest output" refers to the latest output at the moment the encoding operation on the display image is performed.

[0113] During the encoding process of the entire video sequence, there is no currently active reconstructed CRR image before the output of the nth CRR image bitstream segment. Therefore, for the display image bitstream output before the nth CRR image bitstream segment, the reference image used during encoding only includes the reconstructed display image.

[0114] Since n CRR image bitstream segments and multiple display image bitstreams are interleaved into one encoded image bitstream, the encoded image bitstream can be transmitted using existing transmission protocols and stored using existing file formats.

[0115] 403. Encode the preset syntax identifier into the encoded image bitstream. The preset syntax identifier includes at least one of the following: quantity information, image information, and position information. The quantity information indicates n, the image information indicates the target image, the bitstream of the target image is transmitted after n CRR image bitstream segments, and the position information indicates the position of the n CRR image bitstreams in the encoded image bitstream.

[0116] Encoding the preset syntax identifier into the encoded image bitstream can be done by directly adding the preset syntax identifier to the encoded image bitstream, or by adding it to the encoded image bitstream after encoding and compression. This application does not limit this.

[0117] Preset syntax identifiers are used by the decoder to determine if CRR slices are missing. These identifiers can be located in higher-level parameters of the encoded image bitstream, including at least one of the following: SPS, PPS, and image header. The SPS includes a set of global parameters for the video coding sequence, such as color space, the size (width and height) of each frame, and coding level. The PPS includes coding parameters for at least one frame, such as quantization matrix and filtering parameters. The image header includes coding parameters for a single frame, such as frame number.

[0118] For example, for SPS, there can be one SPS before every N CRR image bitstream segments, or one SPS before the entire bitstream. For PPS, there can be one PPS before every multiple bitstreams. For image headers, there can be an image header before the first CRR image bitstream segment, and a slice header or segment header before each of the other non-first CRR image bitstream segments.

[0119] Since the decoder parses higher-level parameters after receiving the bitstream, placing the preset syntax identifier within these parameters allows the decoder to quickly determine if any missing CRR image bitstream segments exist. This enables the decoder to respond promptly to transmission failures, enhancing the robustness of the encoding and decoding process.

[0120] The target image can be: the first display image that uses a CRR image as a reference image (the image header of this display image has a CRR image enable first image flag), the first display image that uses only a CRR image as a reference image, a display image whose bitstream is transmitted after n CRR image bitstream segments, or a CRR image whose bitstream is transmitted after n CRR image bitstream segments. Before transmitting the bitstream of the target image, the transmission of n CRR image bitstream segments needs to be completed. For example, assuming the target image is a CRR image, the bitstream segments of the previously acquired CRR image and the bitstream segments of the target image should not be interleaved during transmission; that is, the transmission of the bitstream segments of the target image should not be initiated before all the bitstream segments of the previously acquired CRR image have been encoded and transmitted. In other words, the target image can be used as a reference enable first image.

[0121] Image information may include: the frame number of the target image, the decoding sequence number of the bit stream of the target image, the difference between the frame numbers of the target image and the CRR image, or the difference between the decoding sequence numbers of the bit stream of the target image and the bit stream of the CRR image. This application does not limit this.

[0122] Location information can include a location identifier for each CRR image bitstream segment. The location identifier of a CRR image bitstream segment indicates where the next CRR image bitstream segment will be transmitted. The location identifier of a CRR image bitstream segment can be: a frame sequence number (referring to the frame sequence number of a display image bitstream preceding or following the CRR image bitstream segment), a decoding sequence number (referring to the decoding sequence number of a display image bitstream preceding or following the CRR image bitstream segment), the difference between the frame sequence number and the frame sequence number corresponding to the next CRR image bitstream segment, or the difference between the decoding sequence number and the decoding sequence number corresponding to the next CRR image bitstream segment, etc., as long as it indicates where the CRR image bitstream segment will be transmitted.

[0123] S302, if the currently processed display image is the reference enabled first image of the currently acquired reconstructed CRR image, the currently acquired reconstructed CRR image is used as the reference image to perform inter-frame prediction coding on the display image; wherein, the image information is used to indicate the reference enabled first image, and the reference enabled first image includes the first image in the display image that is referenced to the reconstructed CRR image.

[0124] Optionally, the preset syntax identifier may also include bitstream segment information, which is used to indicate the display image for each CRR image bitstream segment used as a reference image.

[0125] In this embodiment of the application, when the encoder encounters a reference enabled first image for reconstructing a CRR image during inter-frame predictive coding, it determines the reconstructed CRR image of the reference enabled first image as the reference image. This ensures that there is a reference image that matches the display image when performing inter-frame predictive coding on the display image, avoiding coding failure caused by the mismatch between the reference image and the display image, and improving the coding success rate.

[0126] Optionally, the reference image used for inter-frame predictive coding is stored in a specified buffer;

[0127] When the currently processed display image is used as the reference image for the currently acquired reconstructed CRR image, and the current reconstructed CRR image is used as the reference image, this can specifically include:

[0128] If the currently processed display image is the reference to the currently acquired reconstructed CRR image with the first image enabled, update the specified buffer using the currently acquired reconstructed CRR image.

[0129] For example, the encoder and decoder each have their own designated buffer, which may be, for example, a decoded picture buffer (DPB).

[0130] In this embodiment, the reference image used for inter-frame predictive coding is stored in a designated buffer. The reference image can then be determined by updating the designated buffer using the currently acquired reconstructed CRR image, without the need for additional marking and recording information, making it more efficient.

[0131] Optionally, the specified buffer can be updated using the currently acquired reconstructed CRR image, which may specifically include:

[0132] If a historical reconstructed CRR image is obtained from a specified buffer, the historical reconstructed CRR image in the specified buffer is replaced with the currently obtained reconstructed CRR image.

[0133] For example, when replacing a historical reconstructed CRR image in a specified buffer with a currently acquired reconstructed CRR image, the specific replacement method can be to overwrite the historical reconstructed CRR image, or to remove the historical reconstructed CRR image and then move in the historical reconstructed CRR image.

[0134] In this embodiment, if the encoder already contains a previously reconstructed CRR image, the previous reconstructed CRR image is replaced with a new one. This balances the ability to directly use the reconstructed image from the encoder for subsequent display images while improving update timeliness, thus achieving both accuracy and encoding efficiency.

[0135] Optionally, the specified buffer can be updated using the currently acquired reconstructed CRR image, which may specifically include:

[0136] If no historical reconstructed CRR image is obtained from the specified buffer, the currently obtained reconstructed CRR image is stored in the specified buffer.

[0137] In this embodiment, if there is no reconstructed CRR image in the encoder, the currently obtained reconstructed CRR image can be directly moved into the buffer. An unused reconstructed CRR image means there is no longer a display image to use, so the buffer is empty and can be directly moved in, thereby expanding the applicable scenarios and further avoiding encoding failures.

[0138] Optionally, after obtaining the reconstructed CRR image based on the encoding operation, the encoding method provided in this application embodiment may further include:

[0139] When the currently processed display image is a non-reference enabled first image of the currently acquired reconstructed CRR image, the reconstructed CRR image used in the previous processed display image is used as the reference image for inter-frame predictive coding of the display image.

[0140] In this embodiment of the application, when the currently processed display image is a non-reference enabled first image of the currently acquired reconstructed CRR image, the reconstructed CRR image used by the previously processed display image is used as the reference image, thereby ensuring that the reference image can be accurately determined for long-distance multiple display images in cross-RAP scenes, and further improving the encoding success rate.

[0141] For example, when the first image is enabled for encoding a CRR image, if a previous reconstructed CRR image already exists in the encoder, the previous reconstructed CRR image is removed from the current decoded image buffer, and the current reconstructed CRR image is moved into the decoded image buffer; otherwise, the reconstructed CRR image is directly moved into the decoded image buffer. It should be noted that after all CRR sub-images are encoded, subsequent encoded images may not immediately use the reconstructed CRR image as a reference, but instead continue to reference the previous reconstructed CRR image. In this case, the current reconstructed CRR image needs to be cached until a CRR image with the first image enabled is encountered, at which point the decoded image buffer is updated.

[0142] Please refer to Figure 4 , Figure 4This is a flowchart illustrating a decoding method provided in an embodiment of this application. The method can be applied to a decoder and may include the following steps:

[0143] S401, receive encoded image bitstream, the encoded image bitstream including interleaved sorted cross-random access point reference CRR image bitstream segments, multiple display image bitstreams, quantity information and image information; the image information is used to indicate the reference enabled first image, the reference enabled first image includes the first image in the display images that references the reconstructed CRR image.

[0144] S402, Decode the encoded image bitstream and obtain the reconstructed CRR image based on the operation result;

[0145] The above S401 to S402 may specifically include the following processes 501 to 505 and optional examples:

[0146] 501. Receive encoded image bitstream, which includes interleaved CRR image bitstream segments and display image bitstream.

[0147] 502. Decode the encoded image bitstream.

[0148] Each time a display image bitstream is decoded, a reconstructed display image is obtained. The reference images for the display image bitstream include the reconstructed display image and / or the currently active reconstructed CRR image. The currently active reconstructed CRR image can be stored in the decoder's buffer space, such as in the decoder's DPB.

[0149] The reference image used when decoding any display image bitstream in the encoded image bitstream is the same as the reference image used by the encoder when encoding the display image bitstream. Each display image bitstream may carry a reference image identifier, and the decoder determines the reference image of the display image bitstream based on the reference image identifier it carries when decoding the display image bitstream.

[0150] The reconstructed display image is obtained by decoding the previous display image bitstream; a display image bitstream is decoded to obtain a reconstructed display image.

[0151] The currently active reconstructed CRR image is obtained by decoding the previous CRR image bitstream segments. Optionally, the currently active reconstructed CRR image can be obtained by decoding a group of CRR image bitstream segments. The group of CRR image bitstream segments includes: the first n CRR image bitstream segments of the display image bitstream, or the first n CRR image bitstream segments of the display image bitstream corresponding to the same CRR image. During the decoding process of the encoded image bitstream corresponding to the entire video sequence, there is no currently active reconstructed CRR image before the decoding of the received nth CRR image bitstream segment is completed. Therefore, for the display image bitstream before the nth CRR image bitstream segment, the reference image used during decoding only includes the reconstructed display image.

[0152] 503. Obtain the preset syntax identifier from the encoded image bitstream.

[0153] The preset syntax identifier includes at least one of the following: quantity information, image information, and position information. The quantity information indicates n, the image information indicates the target image transmitted after n CRR image bitstream segments in the encoded image bitstream, and the position information indicates the position of the n CRR image bitstream segments in the encoded image bitstream.

[0154] When the preset syntax identifier only includes quantity information, the decoder parses the quantity information (indicating n) from the encoded image bitstream upon receiving the first CRR image bitstream segment. When the preset syntax identifier only includes image information, the decoder parses the image information (indicating the target image) from the encoded image bitstream upon receiving the first CRR image bitstream segment; all n CRR image bitstream segments must be received before the target image bitstream. When the preset syntax identifier only includes position information, the decoder parses the position information from the encoded image bitstream upon receiving the first CRR image bitstream segment.

[0155] 504. Based on the preset syntax identifier, determine whether there are n CRR image bitstream segments in the encoded image bitstream, where n CRR image bitstream segments correspond to one CRR image, and n is an integer greater than 1.

[0156] After parsing the quantity information from the encoded image bitstream, the decoder starts counting from the first CRR image bitstream segment received. That is, the counter starts counting when the first CRR image bitstream segment is received. Then, it begins receiving display image bitstream and CRR image bitstream segments, incrementing the counter by 1 for each received CRR image bitstream segment.

[0157] Upon receiving the target bitstream, if the number of received CRR image bitstream segments is n (i.e., the counter value is n), then it is determined that there are n CRR image bitstream segments in the encoded image bitstream, and the CRR image bitstream reception is successful. If the number of received CRR image bitstream segments is less than n, then it is determined that there are no n CRR image bitstream segments in the encoded image bitstream, and the CRR image bitstream reception fails.

[0158] The target bitstream is the display image bitstream and the reference image is a CRR image, or the preset syntax identifier also includes image information, and the target bitstream is the bitstream of the target image indicated by the image information.

[0159] The decoder can, upon successful reception of the CRR image bitstream segment corresponding to the previous CRR image, default to the next received CRR image bitstream segment as the first CRR image bitstream segment. Alternatively, if only the first CRR image bitstream segment in the encoded image bitstream has an image header, the decoder will use the CRR image bitstream segment after the image header as the first CRR image bitstream segment. Or, if the CRR image bitstream segments corresponding to a CRR image are transmitted sequentially, the decoder can use the CRR image bitstream segment with the smallest sequence number as the first CRR image bitstream segment.

[0160] After parsing the image information (indicating the target image) from the encoded image bitstream, the decoder decodes the encoded image bitstream. Upon receiving the target image bitstream, it determines the size of the reconstructed CRR image. The reconstructed CRR image is obtained by decoding the received CRR image bitstream segments. When the size of the reconstructed CRR image is equal to the size of the CRR image, it is determined that there are n CRR image bitstream segments in the encoded image bitstream, and the CRR image bitstream reception is successful. When the size of the reconstructed CRR image is smaller than the size of the CRR image, it is determined that there are not n CRR image bitstream segments in the encoded image bitstream, and the CRR image bitstream reception fails.

[0161] After parsing the position information from the encoded image bitstream, the decoder determines that there are n CRR image bitstream segments in the encoded image bitstream when a CRR image bitstream segment is received at each position indicated by the position information, and the CRR image bitstream reception is successful. If no CRR image bitstream segment is received at at least one position indicated by the position information, it is determined that there are no n CRR image bitstream segments in the encoded image bitstream, and the CRR image bitstream reception fails.

[0162] 505. If there are n CRR image bitstream segments in the encoded image bitstream, then continue to decode the encoded image bitstream to obtain the reconstructed display image.

[0163] If n CRR image bitstream segments are missing from the encoded image bitstream, the decoder can determine that the CRR image bitstream reception is incorrect, and transmission error handling can be performed. Transmission error handling includes: discarding or skipping the display image bitstream composed of the images decoded from the missing CRR image bitstream segments of the reference image, and requesting the encoder to retransmit the missing CRR image bitstream segments, etc., which are not limited in this embodiment.

[0164] In summary, the decoding method provided in this application performs a decoding operation on the received encoded image bitstream. The encoded image bitstream includes interleaved CRR image bitstream segments and a display image bitstream. A preset syntax identifier is obtained from the encoded image bitstream. Based on the preset syntax identifier of the encoded image bitstream, it is determined whether there are n CRR image bitstream segments in the encoded image bitstream. The n CRR image bitstream segments correspond to one CRR image. If there are n CRR image bitstream segments in the encoded image bitstream, the decoding operation on the encoded image bitstream continues to obtain a reconstructed display image. The reference image of the display image bitstream includes: the reconstructed display image and / or the currently effective reconstructed CRR image. The reconstructed display image is obtained by decoding the previous display image bitstream, and the currently effective reconstructed CRR image is obtained by decoding the previous CRR image bitstream segments. The currently active reconstructed CRR image can serve as a reference image for the current display image bitstream to be decoded. This reconstructed CRR image is obtained based on CRR image bitstream sub-segments, which are obtained at the encoding end based on the CRR image. Since the CRR image corresponds to multiple display images, and these display images can include multiple RAPs, cross-RAP referencing is possible. Furthermore, the n CRR image bitstream segments and multiple display image bitstreams are interleaved into a single bitstream and transmitted to the decoder. In this approach, all processes can be completed within the decoder, eliminating the need for system-level cooperation. This achieves cross-RAP referencing while simultaneously decoupling the decoder from the system layer.

[0165] Furthermore, based on the preset syntax identifier, it can determine whether there are missing CRR image bitstream segments, enabling the encoding / decoding layer and the system layer to cooperate better, thereby allowing the decoder to react to transmission faults in a timely manner and enhancing the robustness of the encoding / decoding process.

[0166] For example, please refer to Figure 5 , Figure 5 This is a schematic diagram of an encoding and decoding process provided in an embodiment of this application. The encoder encodes a CRR image and multiple display images to obtain an encoded image bitstream and sends the encoded image bitstream to the decoder. Figure 5The following example illustrates the process using three CRR image bitstream segments b1 to b3 (n=3) and five display image bitstreams c1 to c5. The decoder decodes each bitstream in the encoded image bitstream sequentially, resulting in five reconstructed display images c1′ to c5′ and a reconstructed CRR image. The five reconstructed display images are used for display, while the reconstructed CRR image serves only as a reference image when decoding the display image bitstream and is not used for display.

[0167] In one implementation, the CRR image can be first segmented into n CRR sub-images, and then the CRR sub-images can be encoded, including the following process:

[0168] 601. Obtain the CRR images corresponding to multiple display images.

[0169] This process can refer to the aforementioned process 401, and will not be repeated here in the embodiments of this application.

[0170] 602. Divide the CRR image into n CRR sub-images, where n is an integer greater than 1.

[0171] 603. Interweave n CRR sub-images among multiple display images to obtain the image sequence to be encoded.

[0172] In the sequence of images to be encoded, the last image is the display image, meaning that all CRR images are located before the last display image.

[0173] Optionally, one or more CRR sub-images can be interspersed between every two display images, as long as all n CRR sub-images are interleaved between multiple display images. This application embodiment does not limit the interleaving method.

[0174] 604. Perform encoding operations on the CRR sub-images and the display image in the image sequence to be encoded in sequence to obtain the encoded image bitstream.

[0175] The order of the displayed image bitstream in the encoded image bitstream is the same as the order of the corresponding displayed images in the image sequence to be encoded. The order of the CRR sub-image bitstream in the encoded image bitstream is the same as the order of the corresponding CRR sub-images in the image sequence to be encoded.

[0176] In this implementation, there are several encoding examples for generating the currently active reconstructed CRR image. These examples are explained below.

[0177] Encoding Example 1: After encoding each CRR sub-image, a CRR image bitstream segment and a reconstructed CRR sub-image are obtained. The encoder caches each reconstructed CRR sub-image, for example, in the encoder's DPB. When n reconstructed CRR sub-images are cached, they are concatenated to obtain the currently active reconstructed CRR image. If an active reconstructed CRR image exists before concatenating the n reconstructed CRR sub-images, the previously active reconstructed CRR image is removed from the cache when concatenating the n reconstructed CRR sub-images to obtain the currently active reconstructed CRR image. In this example, the CRR image bitstream segment group includes: the latest n output CRR image bitstream segments corresponding to the same CRR image.

[0178] Optionally, the first display image selected as the currently active reconstructed CRR image can be marked as the enabled first image of the currently active reconstructed CRR image.

[0179] Encoding Example 2, based on Encoding Example 1, when encoding the first CRR sub-image in the image sequence to be encoded begins, if a currently active reconstructed CRR image exists (referring to the reconstructed CRR image in effect at the moment encoding the first CRR sub-image in the image sequence to be encoded begins), then the currently active reconstructed CRR image is removed (removed from the cache space). When encoding a target display image among multiple display images, the reference image for the target display image includes the reconstructed display image, which includes the display image between the first and last CRR sub-images in the image sequence to be encoded. Since there is no active reconstructed CRR image when encoding the target display image, the reference image for the target display image only includes the reconstructed display image.

[0180] In this encoding example, when encoding the first CRR sub-image to the last CRR sub-image in the image sequence to be encoded, there is no need to cache the previous effective reconstructed CRR image, saving the cache space of one frame of image during this period.

[0181] Encoding Example 3: When encoding a CRR sub-image to obtain a reconstructed CRR sub-image, if a currently active reconstructed CRR image exists, the target region in the currently active reconstructed CRR image (referring to the reconstructed CRR image in effect at the moment the CRR sub-image is encoded to obtain the reconstructed CRR sub-image) is updated to the obtained reconstructed CRR sub-image, thus obtaining the currently active reconstructed CRR image. The positional relationship between the target region and the currently active reconstructed CRR image is the same as the target positional relationship, which is the positional relationship between the cached reconstructed CRR sub-image and the corresponding CRR image. In this example, the CRR image bitstream segment group includes: the latest n output CRR image bitstream segments.

[0182] In this encoding example, after obtaining a reconstructed CRR sub-image, the reconstructed CRR sub-image is not cached. Instead, the target region in the currently active reconstructed CRR image is directly replaced with the reconstructed CRR sub-image, which can save the cache occupied by the reconstructed CRR sub-image.

[0183] Encoding Example 4: The encoder buffers each output CRR image bitstream segment (e.g., buffered in the encoder's DPB). When n CRR image bitstream segments are buffered, each of the n buffered CRR image bitstream segments is decoded and reconstructed to obtain n reconstructed CRR sub-images. The n reconstructed CRR sub-images are then concatenated to obtain the currently active reconstructed CRR image. That is, the encoder's encoding operation for multiple display images and CRR images also includes the decoding and reconstruction of n CRR image bitstream segments. If an active reconstructed CRR image exists before the CRR image bitstream is decoded and reconstructed, the previously active reconstructed CRR image is removed from the buffer space when the CRR image bitstream is decoded and reconstructed to obtain the currently active reconstructed CRR image. In this example, the CRR image bitstream segment group includes: the latest n output CRR image bitstream segments corresponding to the same CRR image.

[0184] Optionally, the first image selected as the currently active reconstructed CRR image can be used as the display image for reference, and marked as the enabled first image of the currently active reconstructed CRR image, i.e., the reference enabled first image.

[0185] In this encoding example, CRR image bitstream segments are directly cached, and decoding and reconstruction are performed only after caching n CRR image bitstream segments to obtain the reconstructed CRR image, without needing to cache each reconstructed CRR sub-image. Since the cache space occupied by the CRR image bitstream segments is smaller than the cache space occupied by the reconstructed CRR sub-images, certain cache space can be saved.

[0186] In another implementation, the CRR image can be encoded first to obtain CRR image bitstream segments, and then the CRR image bitstream segments can be segmented, which may include the following process:

[0187] 701. Obtain the CRR images corresponding to multiple display images.

[0188] This process can refer to the aforementioned process 401, and will not be repeated here in the embodiments of this application.

[0189] 702. Encode the CRR image to obtain the CRR image bitstream.

[0190] 703. Segment the CRR image bitstream to obtain n CRR image bitstream segments, where n is an integer greater than 1.

[0191] 704. Encode multiple display images sequentially to obtain multiple display image bitstreams.

[0192] 705. Interweave n CRR image bitstream segments between multiple display image bitstreams to obtain an encoded image bitstream.

[0193] In the encoded image bitstream, the last image bitstream is the display image bitstream, meaning that all CRR image bitstreams are located before the last display image bitstream.

[0194] Optionally, one or more CRR image bitstream segments can be inserted between every two display image bitstreams, as long as all n CRR image bitstream segments are interleaved in multiple display image bitstreams. This application does not limit the interleaving method.

[0195] It should be noted that processes 704 and 705 can be executed simultaneously. The encoder can predetermine the order of each CRR image bitstream segment in the subsequent encoded image bitstream and determine the currently active reconstructed CRR image based on this order. Only when n CRR image bitstream segments are output can the reconstructed CRR image obtained during the encoding operation of the CRR image be used as the currently active reconstructed CRR image. That is, in the encoded image bitstream, when encoding the display image after the nth CRR image bitstream segment, the reconstructed CRR image obtained during the encoding operation of the CRR image can be used as a reference image for inter-frame predictive coding.

[0196] In this implementation, there are several examples of how to generate the currently active reconstructed CRR image. These examples are explained below.

[0197] In encoding example 5, after encoding the CRR image, the encoder obtains the target reconstructed CRR image and the CRR image bitstream. The encoder buffers the target reconstructed CRR image. When outputting the last CRR image bitstream segment out of n CRR image bitstream segments, the buffered target reconstructed CRR image is used as the currently effective reconstructed CRR image. In this example, the CRR image bitstream segment group includes the latest n CRR image bitstream segments corresponding to the same CRR image.

[0198] If an active reconstructed CRR image exists before the last CRR image bitstream segment in the output of n CRR image bitstream segments, then when the cached target reconstructed CRR image is used as the currently active reconstructed CRR image, the previously active reconstructed CRR image is removed from the cache space. Furthermore, in this case, an additional frame buffer is required to store the target reconstructed CRR image.

[0199] Optionally, the first display image selected as the currently active reconstructed CRR image can be marked as the enabled first image of the currently active reconstructed CRR image.

[0200] Encoding Example 6: The encoder can buffer the CRR image bitstream. When outputting the last CRR image bitstream segment out of n CRR image bitstream segments, the buffered CRR image bitstream is decoded and reconstructed to obtain the currently effective reconstructed CRR image. In this example, the CRR image bitstream segment group includes: the latest n CRR image bitstream segments corresponding to the same CRR image.

[0201] If a reconstructed CRR image exists before the cached CRR image bitstream is decoded and reconstructed, the previously active reconstructed CRR image is removed from the cache when the cached CRR image bitstream is decoded and reconstructed to obtain the currently active reconstructed CRR image. Furthermore, in this case, an additional cache is required to store the CRR image bitstream.

[0202] In this encoding example, the entire CRR image bitstream is stored before the last CRR image bitstream segment in the output of n CRR image bitstream segments, instead of storing the entire reconstructed CRR image. Since the buffer space occupied by the CRR image bitstream is smaller than that occupied by the reconstructed CRR image, some buffer space can be saved.

[0203] For different encoding examples, there are also different decoding examples on the decoding end. The following describes various decoding examples.

[0204] In decoding example 1, the decoder performs decoding operations sequentially according to the order of each bitstream in the encoded image bitstream. After decoding each received CRR image bitstream segment, it obtains and buffers the reconstructed CRR sub-image. If, according to the preset syntax identifier, there are n CRR image bitstream segments in the encoded image bitstream, then when there are n reconstructed CRR sub-images in the buffer, the n reconstructed CRR sub-images are concatenated to obtain the currently effective reconstructed CRR image. If there is an effective reconstructed CRR image before concatenating the n reconstructed CRR sub-images, then when concatenating the n reconstructed CRR sub-images to obtain the currently effective reconstructed CRR image, the previously effective reconstructed CRR image is removed from the buffer space. In this example, the CRR image bitstream segment group includes: the first n CRR image bitstream segments of the display image bitstream corresponding to the same CRR image.

[0205] The process of determining whether there are missing CRR image bitstream segments can be achieved through the quantity information in the preset syntax identifier, as described in the aforementioned embodiments. The embodiments in this application will not be repeated here.

[0206] Optionally, the first display image bitstream that selects the currently active reconstructed CRR image as the reference image can be marked as the enabled first image bitstream of the currently active reconstructed CRR image.

[0207] Decoding Example 2, based on Decoding Example 1, when decoding the first CRR image bitstream segment in the encoded image bitstream, if a currently active reconstructed CRR image exists (referring to the reconstructed CRR image in effect at the moment the decoding operation begins on the first CRR image bitstream segment in the encoded image bitstream), then the currently active reconstructed CRR image is removed (removed from the buffer space). When decoding the target display image bitstream in multiple display image bitstreams, the reference image of the target display image bitstream includes the reconstructed display image. The target display image bitstream includes the display image bitstream between the first and last CRR image bitstream segments in the encoded image bitstream. Since there is no active reconstructed CRR image when encoding the target display image bitstream, the reference image of the target display image bitstream only includes the reconstructed display image.

[0208] In this decoding example, when decoding the first CRR image bitstream segment to the last CRR image bitstream segment in the encoded image bitstream, there is no need to cache the previous effective reconstructed CRR image, saving the cache space of one frame of image during this period.

[0209] In decoding example 3, the decoder performs decoding operations sequentially according to the order of each bitstream in the encoded image bitstream. After decoding the received CRR image bitstream segments, a reconstructed CRR sub-image is obtained. If there are no lost CRR image bitstream segments at the current point (i.e., there are n CRR image bitstream segments in the encoded image bitstream), and a currently effective reconstructed CRR image exists, the target region in the currently effective reconstructed CRR image is updated to the obtained reconstructed CRR sub-image, resulting in the currently effective reconstructed CRR image. The positional relationship between the target region and the currently effective reconstructed CRR image is the same as the target positional relationship, which is the positional relationship between the cached reconstructed CRR sub-image and the corresponding CRR image. In this example, the CRR image bitstream segment group includes: the first n CRR image bitstream segments of the displayed image bitstream.

[0210] The process of determining whether there are missing CRR image bitstream segments can be achieved through the position information in the preset syntax identifier, as described in the aforementioned embodiments. The embodiments in this application will not be repeated here.

[0211] In this decoding example, after obtaining a reconstructed CRR sub-image, the reconstructed CRR sub-image is not cached. Instead, the target region in the currently active reconstructed CRR image is directly replaced with the reconstructed CRR sub-image, which can save the cache occupied by the reconstructed CRR sub-image.

[0212] In decoding example 4, when the decoder receives the first n-1 CRR image bitstream segments, it does not perform decoding immediately but buffers each received CRR image bitstream segment. Subsequently, if there are n CRR image bitstream segments in the encoded image bitstream, the reconstructed CRR image is used as the currently active reconstructed CRR image. The reconstructed CRR image is obtained by decoding each of the buffered n CRR image bitstream segments to obtain n reconstructed CRR sub-images, and then concatenating these n reconstructed CRR sub-images. In this example, the CRR image bitstream segment group includes: the first n CRR image bitstream segments of the display image bitstream corresponding to the same CRR image.

[0213] Optionally, the first display image bitstream that selects the currently active reconstructed CRR image as the reference image can be marked as the enabled first image bitstream of the currently active reconstructed CRR image.

[0214] The process of determining whether there are missing CRR image bitstream segments can be achieved through quantity information and / or image information in the preset syntax identifier, as described in the foregoing embodiments. The embodiments in this application will not be repeated here.

[0215] In decoding example 5, when the decoder receives the first n-1 CRR image bitstream segments, it does not perform decoding immediately but buffers each received CRR image bitstream segment. If there are n CRR image bitstream segments in the encoded image bitstream, the reconstructed CRR image is used as the currently active reconstructed CRR image. The reconstructed CRR image is obtained by concatenating the buffered n CRR image bitstream segments, and then decoding the concatenated CRR image bitstream. If there is an active reconstructed CRR image before decoding the CRR image bitstream, the previously active reconstructed CRR image is removed from the buffer when decoding the CRR image bitstream to obtain the currently active reconstructed CRR image. In this example, the CRR image bitstream segment group includes: the first n CRR image bitstream segments of the displayed image bitstream corresponding to the same CRR image.

[0216] The process of determining whether there are missing CRR image bitstream segments can be achieved through quantity information and / or image information in the preset syntax identifier, as described in the foregoing embodiments. The embodiments in this application will not be repeated here.

[0217] Optionally, the first display image bitstream that selects the currently effective reconstructed CRR image as the reference image can be marked as the enabled first image bitstream of the currently effective reconstructed CRR image, i.e., the reference enabled first image bitstream.

[0218] In decoding examples 4 and 5, CRR image bitstream segments are directly cached, and decoding is performed only after caching n CRR image bitstream segments to obtain the reconstructed CRR image, without needing to cache each reconstructed CRR sub-image. Since the cache space occupied by the CRR image bitstream segment is smaller than the cache space occupied by the reconstructed CRR sub-image, certain cache space can be saved.

[0219] The aforementioned encoding and decoding examples can be combined. The following description uses various combinations as examples to illustrate the encoding and decoding process. In the following encoding and decoding process, five display images d1 to d5 and one corresponding CRR image e are used as examples, and it is assumed that n = 3.

[0220] I. Encoding Example 1 and Decoding Example 1: Determining whether there is a missing CRR image bitstream segment through data information.

[0221] For example, please refer to Figure 6 , Figure 6This is a schematic diagram of another encoding / decoding process provided in an embodiment of this application. Referring to the aforementioned encoding example 1, the CRR image e is divided into three CRR sub-images e1 to e3. e1 is interspersed between d1 and d2, e2 is interspersed between d2 and d3, and e3 is interspersed between d3 and d4 to obtain the image sequence to be encoded. Then, the image sequence to be encoded is encoded. First, d1 is encoded. Since no new CRR image bitstream segment has been output at this time, the buffer space only stores the first reconstructed CRR image, and the currently effective reconstructed CRR image is the first reconstructed CRR image. A reference image is selected to encode d1 to obtain the display image bitstream d1′ and the reconstructed display image (…). Figure 6 (Not shown). Encode e1 to obtain the CRR image bitstream segment e1′ and the reconstructed CRR sub-image e1″, and buffer e1″.

[0222] Encoding operation is performed on d2. Since no three reconstructed CRR sub-images have been cached yet, the currently effective reconstructed CRR image is still the first reconstructed CRR image. The reference image is selected to encode d2, resulting in the display image bitstream d2′ and the reconstructed display image (…). Figure 6 (Not shown). Encode e2 to obtain the CRR image bitstream segment e2′ and the reconstructed CRR sub-image e2″, and buffer e2″.

[0223] Encoding operation is performed on d3. Since the three reconstructed CRR sub-images are not yet cached, the currently active reconstructed CRR image is still the first reconstructed CRR image. The reference image is selected to encode d3, resulting in the display image bitstream d3′ and the reconstructed display image (…). Figure 6 (Not shown). Encode e3 to obtain the CRR image bitstream segment e3′ and the reconstructed CRR sub-image e3″, and buffer e3″.

[0224] At this point, the cache space contains three reconstructed CRR sub-images e1″ to e3″. By concatenating e1″ to e3″, the second reconstructed CRR image e″ is obtained. The first reconstructed CRR image is then removed from the cache space. The currently active reconstructed CRR image is e″.

[0225] Encoding operation is performed on d4, and the currently effective reconstructed CRR image is e″. Encoding operation is performed on d4 using a reference image to obtain the display image bitstream d4′ and the reconstructed display image ( Figure 6 (Not shown). Encode d5; the currently active reconstructed CRR image is e″. Select a reference image and encode d5 to obtain the display image bitstream d5′ and the reconstructed display image (…). Figure 6 (Not shown). At this point, the encoded image bitstream is obtained.

[0226] Referring to the aforementioned decoding example 1, the decoder performs decoding operations sequentially according to the order of each bit stream in the encoded image bitstream. First, d1′ is decoded. Since no new CRR image bitstream segment has been decoded yet, the buffer only stores the first reconstructed CRR image; the currently active reconstructed CRR image is the first reconstructed CRR image. A reference image is selected to decode d1′ to obtain the reconstructed display image d1″. The reference image selected for decoding d1′ is the same as the reference image selected for encoding d1. e1′ is received and decoded to obtain and buffer e1″. e1′ is the first CRR image bitstream segment. The quantity information indicator 3 is parsed from the encoded image bitstream, and counting begins at 1.

[0227] Decoding d2′ is performed. Since the three reconstructed CRR sub-images are not yet cached, the currently active reconstructed CRR image is still the first reconstructed CRR image. A reference image is selected to decode d2′, resulting in the reconstructed display image d2″. The reference image selected for decoding d2′ is the same as the reference image selected for encoding d2. e2′ is received and decoded to obtain and cache e2″. The counter is incremented by 1, reaching 2.

[0228] Decoding d3′ is performed. Since no three reconstructed CRR sub-images have been cached yet, the currently active reconstructed CRR image is still the first reconstructed CRR image. A reference image is selected to decode d3′ to obtain the reconstructed display image d3″. The reference image selected for decoding d3′ is the same as the reference image selected for encoding d3. e3′ is received and decoded to obtain and cache e3″. The counter is incremented by 1 to reach 3.

[0229] Subsequently, d4′ was received. d4′ refers to the reconstructed CRR image e″ corresponding to e1″ to e3″. At this time, the number of CRR image bitstream segments received is 3. There are 3 CRR image bitstream segments in the encoded image bitstream. The CRR image bitstream was successfully received.

[0230] At this point, the cache space contains three reconstructed CRR sub-images e1″ to e3″. By concatenating e1″ to e3″, the second reconstructed CRR image e″ is obtained. The first reconstructed CRR image is then removed from the cache space. The currently active reconstructed CRR image is e″.

[0231] Decoding operation is performed on d4′, and the currently effective reconstructed CRR image is e″. A reference image is selected to decode d4′, resulting in the reconstructed display image d4″. The reference image selected for decoding d4′ is the same as the reference image selected for encoding d4. Decoding operation is performed on d5′, and the currently effective reconstructed CRR image is e″. A reference image is selected to decode d5′, resulting in the reconstructed display image d5″. The reference image selected for decoding d5′ is the same as the reference image selected for encoding d5.

[0232] II. Encoding Example 2 and Decoding Example 2: Determining whether there is a missing CRR image bitstream segment through data information.

[0233] For example, please refer to Figure 7 , Figure 7 This is a schematic diagram illustrating another encoding / decoding process provided in an embodiment of this application. Figure 7 The encoding and decoding process shown is similar to Figure 8 Similarly, the encoder side and Figure 8 The difference lies in that when encoding e1 begins, the first reconstructed CRR image is removed from the cache. When encoding d2, none of the three reconstructed CRR sub-images are cached yet, therefore no currently active reconstructed CRR image exists. Similarly, when encoding d3, none of the three reconstructed CRR sub-images are cached yet, therefore no currently active reconstructed CRR image exists.

[0234] decoder side and Figure 6 The difference lies in that when decoding e1′ begins, the first reconstructed CRR image is removed from the buffer. When decoding d2′, none of the three reconstructed CRR sub-images are buffered, therefore no currently active reconstructed CRR image exists. Similarly, when decoding d3′, none of the three reconstructed CRR sub-images are buffered, therefore no currently active reconstructed CRR image exists. Other procedures can be found in [reference needed]. Figure 6 The relevant descriptions are not repeated here in the embodiments of this application.

[0235] III. Encoding Example 3 and Decoding Example 3: Determining the presence of missing CRR image bitstream segments using location information.

[0236] For example, please refer to Figure 8 , Figure 8 This is a schematic diagram illustrating another encoding / decoding process provided in an embodiment of this application. The image sequence to be encoded can be referenced. Figure 6 The relevant descriptions are not repeated here in the embodiments of this application.

[0237] First, d1 is encoded, and the buffer space contains the currently active reconstructed CRR image. Then, a reference image is selected to encode d1, resulting in the display image bitstream d1′ and the reconstructed display image (…). Figure 8 (Not shown). Encode e1 to obtain the CRR image bitstream segment e1′ and the reconstructed CRR sub-image e1″. Update the target region in the currently active reconstructed CRR image to e1″ to obtain the currently active reconstructed CRR image.

[0238] Encoding operation is performed on d2, and the buffer space contains the currently effective reconstructed CRR image. A reference image is selected to encode d2, resulting in the display image bitstream d2′ and the reconstructed display image (…). Figure 8 (Not shown). Encode e2 to obtain the CRR image bitstream segment e2′ and the reconstructed CRR sub-image e2″. Update the target region in the currently active reconstructed CRR image to e2″ to obtain the currently active reconstructed CRR image.

[0239] Encoding operation is performed on d3, and the buffer space contains the currently effective reconstructed CRR image. A reference image is selected to encode d3, resulting in the display image bitstream d3′ and the reconstructed display image (…). Figure 8 (Not shown). Encode e3 to obtain the CRR image bitstream segment e3′ and the reconstructed CRR sub-image e3″. Update the target region in the currently active reconstructed CRR image to e3″ to obtain the currently active reconstructed CRR image.

[0240] Encoding operation is performed on d4, and the buffer space contains the currently effective reconstructed CRR image. A reference image is selected to encode d4, resulting in the display image bitstream d4′ and the reconstructed display image (…). Figure 8 (Not shown). The d5 bitstream is encoded, and the buffer space contains the currently active reconstructed CRR image. A reference image is selected to encode the d5 bitstream, resulting in the display image bitstream d5′ and the reconstructed display image (…). Figure 8 (Not shown). At this point, the encoded image bitstream is obtained.

[0241] Referring to the aforementioned decoding example 3, the decoder performs decoding operations sequentially according to the order of each bit stream in the encoded image bitstream. First, it decodes d1′, with the currently active reconstructed CRR image cached in the buffer space. A reference image is selected to decode d1′, resulting in the reconstructed display image d1″. The reference image selected for decoding d1′ is the same as the reference image selected for encoding d1. e1′ is received at the first position indicated by the position information, indicating that there are no missing CRR image bitstream segments in the encoded image bitstream up to the current time. e1′ is decoded to obtain e1″, and the target region in the currently active reconstructed CRR image is updated to e1″, thus obtaining the currently active reconstructed CRR image.

[0242] Decoding operation is performed on d2′, and the buffer space contains the currently effective reconstructed CRR image. A reference image is selected to decode d2′, resulting in the reconstructed display image d2″. The reference image selected for decoding d2′ is the same as the reference image selected for encoding d2. e2′ is received at the second position indicated by the position information, and there are no missing CRR image bitstream segments in the encoded image bitstream up to the current time. Decoding e2′ yields e2″, and the target region in the currently effective reconstructed CRR image is updated to e2″, resulting in the currently effective reconstructed CRR image.

[0243] Decoding operation is performed on d3′, and the buffer space contains the currently effective reconstructed CRR image. A reference image is selected to decode d3′, resulting in the reconstructed display image d3″. The reference image selected for decoding d3′ is the same as the reference image selected for encoding d3. e3′ is received at the third position indicated by the position information. As of the current moment, there are no missing CRR image bitstream segments in the encoded image bitstream; therefore, there are three CRR image bitstream segments in the encoded image bitstream. Decoding e3′ yields e3″, and the target region in the currently effective reconstructed CRR image is updated to e3″, resulting in the currently effective reconstructed CRR image.

[0244] Decoding operation is performed on d4′, and the buffer space contains the currently effective reconstructed CRR image. A reference image is selected to decode d4′ to obtain the reconstructed display image d4″. The reference image selected for decoding d4′ is the same as the reference image selected for encoding d4. Decoding operation is performed on d5′, and the buffer space contains the currently effective reconstructed CRR image. A reference image is selected to decode d5′ to obtain the reconstructed display image d5″. The reference image selected for decoding d5′ is the same as the reference image selected for encoding d5.

[0245] It should be noted that when updating the currently active reconstructed CRR image, the selected target region is related to the reconstructed CRR sub-image in the current cache space, and the target region is not fixed.

[0246] IV. Encoding Example 5 and Decoding Example 5: Determining the presence of missing CRR image bitstream segments using image information.

[0247] For example, please refer to Figure 9 , Figure 9 This is a schematic diagram illustrating another encoding / decoding process provided in an embodiment of this application. Referring to the aforementioned encoding example 5, the CRR image e is encoded to obtain the CRR image bitstream e′ and the target reconstructed CRR image e″, and e″ is buffered. The CRR image bitstream is segmented to obtain three CRR image bitstream segments e1′ to e3′.

[0248] First, d1 is encoded. Since e3′ has not yet been output, the currently active reconstructed CRR image is the first reconstructed CRR image. A reference image is then selected to encode d1, resulting in the display image bitstream d1′ and the reconstructed display image (…). Figure 9 (Not shown). Interleave e1′ after d1′ and output.

[0249] Encoding operation is performed on d2. Since e3′ has not yet been output, the currently active reconstructed CRR image is still the first reconstructed CRR image. Encoding operation is performed on d2 using the reference image to obtain the display image bitstream d2′ and the reconstructed display image (…). Figure 9 (Not shown). Insert e2′ after d2′ and output it.

[0250] Encoding operation is performed on d3. Since e3′ has not yet been output, the currently active reconstructed CRR image is still the first reconstructed CRR image. Encoding operation is performed on d3 using the reference image to obtain the display image bitstream d3′ and the reconstructed display image (…). Figure 9 (Not shown). Insert e3′ after d3′ and output it.

[0251] At this point, the last CRR image bitstream segment e3′ of the three CRR image bitstream segments is output. The first reconstructed CRR image is removed from the buffer space, and e″ is taken as the currently effective reconstructed CRR image.

[0252] Encoding operation is performed on d4, and the currently effective reconstructed CRR image is e″. Encoding operation is performed on d4 using a reference image to obtain the display image bitstream d4′ and the reconstructed display image ( Figure 9 (Not shown). Encode d5; the currently active reconstructed CRR image is e″. Select a reference image and encode d5 to obtain the display image bitstream d5′ and the reconstructed display image (…). Figure 9(Not shown). At this point, the encoded image bitstream is obtained.

[0253] Referring to the aforementioned decoding example 5, the decoder does not perform decoding operations immediately upon receiving the first n-1 CRR image bitstream segments. First, it decodes d1′. Since no new CRR image bitstream segments have been decoded yet, the buffer only stores the first reconstructed CRR image; the currently active reconstructed CRR image is the first reconstructed CRR image. A reference image is selected to decode d1′, resulting in the reconstructed display image d1″. The reference image selected for decoding d1′ is the same as the reference image selected for encoding d1. Next, the received e1′ is buffered.

[0254] Decoding operation is performed on d2′. Since the three reconstructed CRR sub-images have not yet been cached, the currently effective reconstructed CRR image is still the first reconstructed CRR image. A reference image is selected to decode d2′ to obtain the reconstructed display image d2″. The reference image selected for decoding d2′ is the same as the reference image selected for encoding d2. Then, the received e2′ is cached.

[0255] Decoding operation is performed on d3′. Since the three reconstructed CRR sub-images have not yet been cached, the currently effective reconstructed CRR image is still the first reconstructed CRR image. A reference image is selected to decode d3′ to obtain the reconstructed display image d3″. The reference image selected for decoding d3′ is the same as the reference image selected for encoding d3. Then, the received e3′ is cached.

[0256] Next, the target image bitstream d4′ is received. At this point, three CRR image bitstream segments e1′ to e3′ are buffered in the buffer space. These segments are then concatenated. The concatenated CRR image bitstream is decoded to obtain the second reconstructed CRR image e″. The size of e″ is equal to the size of e, therefore the encoded image bitstream contains n CRR image bitstream segments, and the CRR image bitstream reception is successful. Simultaneously, the first reconstructed CRR image is removed from the buffer space. The currently active reconstructed CRR image is e″.

[0257] Decoding operation is performed on d4′, and the currently effective reconstructed CRR image is e″. A reference image is selected to decode d4′, resulting in the reconstructed display image d4″. The reference image selected for decoding d4′ is the same as the reference image selected for encoding d4. Decoding operation is performed on d5′, and the currently effective reconstructed CRR image is e″. A reference image is selected to decode d5′, resulting in the reconstructed display image d5″. The reference image selected for decoding d5′ is the same as the reference image selected for encoding d5.

[0258] V. Encoding Example 1 combined with Decoding Example 4: Determining whether there is a missing CRR image bitstream segment using image information.

[0259] For example, please refer to Figure 10 , Figure 10 This is a schematic diagram of another encoding / decoding process provided in an embodiment of this application. Figure 10 For a description of the encoder's encoding process, please refer to [the relevant documentation / reference]. Figure 8 .

[0260] Figure 10 The decoding process shown is similar to Figure 11 Similarly, the decoder side and Figure 11 The difference lies in that when three CRR image bitstream segments e1′ to e3′ are cached in the buffer space, each segment is decoded to obtain reconstructed CRR sub-images e1″ to e3″, and then concatenated to obtain the second reconstructed CRR image e″. Simultaneously, the first reconstructed CRR image is removed from the buffer space. The currently active reconstructed CRR image is e″. Further descriptions of the decoder's decoding process can be found in [reference needed]. Figure 11 The relevant descriptions are not repeated here in the embodiments of this application.

[0261] VI. Encoding Example 4 and Decoding Example 4: Determining the presence of missing CRR image bitstream segments using image information.

[0262] For example, please refer to Figure 11 , Figure 11 This is a schematic diagram illustrating another encoding / decoding process provided in an embodiment of this application. The image sequence to be encoded can be referenced. Figure 6 The relevant descriptions are not repeated here in the embodiments of this application.

[0263] Referring to the aforementioned encoding example 4, d1 is first encoded. Since no new CRR image bitstream segment has been output yet, the buffer only stores the first reconstructed CRR image, and the currently active reconstructed CRR image is the first reconstructed CRR image. A reference image is selected to encode d1, resulting in the display image bitstream d1′ and the reconstructed display image (…). Figure 11 (Not shown). Encode e1 to obtain and buffer the CRR image bitstream segment e1′.

[0264] Encoding operation is performed on d2. Since no three reconstructed CRR sub-images have been cached yet, the currently effective reconstructed CRR image is still the first reconstructed CRR image. The reference image is selected to encode d2, resulting in the display image bitstream d2′ and the reconstructed display image (…). Figure 11 (Not shown). Encode e2 to obtain and buffer the CRR image bitstream segment e2′.

[0265] Encoding operation is performed on d3. Since the three reconstructed CRR sub-images have not yet been cached, the currently active reconstructed CRR image is still the first reconstructed CRR image. Encoding operation is performed on d3 using the reference image to obtain the display image bitstream d3′ and the reconstructed display image (…). Figure 11 (Not shown). Encode e3 to obtain and buffer the CRR image bitstream segment e3′.

[0266] At this point, the buffer space contains three CRR image bitstream segments e1′ to e3′. Each segment is decoded and reconstructed to obtain reconstructed CRR sub-images e1″ to e3″. These segments are then concatenated to obtain the second reconstructed CRR image e″. The first reconstructed CRR image is removed from the buffer space; the currently active reconstructed CRR image is e″.

[0267] Encoding operation is performed on d4, and the currently effective reconstructed CRR image is e″. Encoding operation is performed on d4 using a reference image to obtain the display image bitstream d4′ and the reconstructed display image ( Figure 9 (Not shown). Encode d5; the currently active reconstructed CRR image is e″. Select a reference image and encode d5 to obtain the display image bitstream d5′ and the reconstructed display image (…). Figure 9 (Not shown). At this point, the encoded image bitstream is obtained.

[0268] Figure 11 For a description of the decoding process of the decoder, please refer to [the relevant documentation / reference]. Figure 10 The embodiments of this application will not be described in detail here.

[0269] VII. Encoding Example 6 combined with Decoding Example 4: Determining whether there is a missing CRR image bitstream segment using image information.

[0270] For example, please refer to Figure 12 , Figure 12 This is a schematic diagram of another encoding / decoding process provided in an embodiment of this application. Figure 12 The encoding process shown is the same as Figure 11 Similarly, the encoder side and Figure 11 The difference is that after obtaining the CRR image bitstream e′, e′ is buffered first. When the last CRR image bitstream segment e3′ of the three CRR image bitstream segments is output, the first reconstructed CRR image is removed from the buffer space, and the buffered e′ is decoded and reconstructed to obtain the second reconstructed CRR image e″. The currently effective reconstructed CRR image is e″.

[0271] Figure 12 For a description of the decoding process of the decoder, please refer to [the relevant documentation / reference]. Figure 10 The embodiments of this application will not be described in detail here.

[0272] The order of the methods provided in the embodiments of this application can be adjusted appropriately, and the process can also be added or removed as appropriate. Any variations that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the protection scope of this application, and the embodiments of this application do not limit this.

[0273] S403, when the currently processed display image bitstream is the reference enabled first image bitstream of the currently acquired reconstructed CRR image, the currently acquired reconstructed CRR image is used as the reference image to perform inter-frame prediction decoding of the display image bitstream.

[0274] In this embodiment of the application, when the decoder encounters a reference enabled first image bitstream for reconstructing a CRR image during inter-frame prediction decoding, it determines the reconstructed CRR image of the reference enabled first image bitstream as the reference image. This ensures that there is a reference image matching the display image when performing inter-frame prediction decoding on the display image bitstream, avoiding decoding failure caused by mismatch between the reference image and the display image bitstream, and improving the decoding success rate.

[0275] Optionally, the encoded image bitstream also includes quantity information, which indicates n, where n is an integer greater than 1;

[0276] Decoding the encoded image bitstream and obtaining the reconstructed CRR image based on the result includes:

[0277] If there are n CRR image bitstream segments in the encoded image bitstream, and the currently processed display image bitstream is determined to be the reference first image bitstream for the currently acquired reconstructed CRR image based on the image information, the n CRR image bitstream segments are decoded to obtain the reconstructed CRR image.

[0278] In this embodiment, the decoder only acquires the reconstructed CRR image when it encounters a CRR image with the first image bitstream enabled. This ensures that the cached image is a CRR image bitstream segment, resulting in low caching cost and improved performance.

[0279] Optionally, the encoded image bitstream also includes quantity information, which indicates n, where n is an integer greater than 1;

[0280] Decoding the encoded image bitstream and obtaining the reconstructed CRR image based on the result includes:

[0281] If there are n CRR image bitstream segments in the encoded image bitstream, the reconstructed CRR image is obtained by decoding the n CRR image bitstream segments.

[0282] In this embodiment, the decoder receives the complete CRR slice bitstream and immediately acquires the reconstructed CRR image, which can then be used for decoding more promptly.

[0283] Optionally, after decoding the encoded image bitstream and obtaining the reconstructed CRR image based on the result of the decoding operation, the method further includes:

[0284] When the currently processed display image bitstream is a non-reference enabled first image bitstream of the currently acquired reconstructed CRR image, the reconstructed CRR image used in the previous processed display image bitstream is used as the reference image for inter-frame prediction decoding of the display image bitstream.

[0285] In this embodiment of the application, if there is a display image bitstream of the previous reconstructed CRR image that is still in use, the process waits until the first image bitstream of the CRR image is received before using the currently acquired reconstructed CRR image as the reference image, thus ensuring that the display image bitstream of the previous reconstructed CRR image can be successfully decoded.

[0286] For example, after obtaining the current reconstructed CRR image, if there is still a display image bitstream referencing the previous reconstructed CRR image, then the CRR image bitstream slice (including all bitstream slices of the CRR image and their corresponding sequence parameter sets, image parameter sets, image headers, etc.) is temporarily stored until the first image bitstream of the CRR image is received, at which point the CRR image bitstream is decoded to obtain the current reconstructed CRR image. Then, the decoded image buffer is updated, removing the previous reconstructed CRR image from the current decoded image buffer (if it exists), and moving the current reconstructed CRR image into the decoded image buffer.

[0287] Optionally, the reference image used for inter-frame predictive coding is stored in a specified buffer;

[0288] Using the currently acquired reconstructed CRR image as a reference image, including:

[0289] If the currently processed display image bitstream is the reference first image bitstream of the currently acquired reconstructed CRR image, update the specified buffer using the currently acquired reconstructed CRR image.

[0290] Similar to the encoder, updating a specified buffer with the currently acquired reconstructed CRR image can be done by directly storing the image in the specified buffer or replacing a historical reconstructed CRR image in the specified buffer.

[0291] In this embodiment, the reconstructed CRR image, which serves as a reference image, is stored in a designated buffer. The designated buffer is then updated using the currently acquired reconstructed CRR image. This method determines the reference image without requiring additional marking or information addition, making it more efficient.

[0292] For example, after obtaining the current reconstructed CRR image, if there is a display image bitstream that references the previous reconstructed CRR image, the current reconstructed CRR image is temporarily stored, for example, in a cache, until the first image bitstream is enabled when the CRR image is received. Then, the decoding image buffer is updated, for example, the previous reconstructed CRR image is removed from the current decoding image buffer, and the current reconstructed CRR image is moved into the decoding image buffer.

[0293] The foregoing primarily describes the encoding and decoding methods provided in this application from the perspective of the device. It is understood that, in order to achieve the above functions, the device includes corresponding hardware structures and / or software modules for executing each function. Those skilled in the art should readily recognize that, based on the algorithm steps of the examples described in conjunction with the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0294] This application embodiment can divide the device into functional modules according to the above method example. For example, each function can be divided into its own functional module, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware or as a software functional module. It should be noted that the module division in this application embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods.

[0295] According to the method provided in the embodiments of this application, this application also provides a computer program product, which includes computer program code. When the computer program code is run on a computer, it causes the computer to execute any of the methods described in the embodiments of this application.

[0296] This application also provides a computer-readable storage medium. All or part of the processes in the above method embodiments can be executed by a computer or a device with encoding / decoding capabilities, using computer programs or instructions to control related hardware. The computer program or set of instructions can be stored in the aforementioned computer-readable storage medium. When executed, the computer program or set of instructions can include the processes described in the above method embodiments. The computer-readable storage medium can be an internal storage unit of the control terminal in any of the foregoing embodiments, such as a hard disk or memory of the control terminal. The aforementioned computer-readable storage medium can also be an external storage device of the control terminal, such as a plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc., equipped on the control terminal. Further, the aforementioned computer-readable storage medium can include both the internal storage unit of the control terminal and external storage devices. The aforementioned computer-readable storage medium is used to store the aforementioned computer program or instructions, as well as other programs and data required by the control terminal. The aforementioned computer-readable storage medium can also be used to temporarily store data that has been output or will be output.

[0297] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0298] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the device described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0299] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0300] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0301] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0302] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, ROM, RAM, magnetic disks, or optical disks.

[0303] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A decoding method, comprising: The method includes: Receive an interleaved encoded image bitstream, the encoded image bitstream comprising multiple bitstream segments of a cross-random access point reference CRR image and multiple display images bitstreams, wherein the bitstream segments of the cross-random access point reference CRR image are ordered before the bitstream of the reference enabled first image corresponding to the cross-random access point reference CRR image in the multiple display image bitstreams, and the reference enabled first image includes the first image among the multiple display images that references the cross-random access point reference CRR image; The encoded image bitstream is decoded, and a reconstructed reference image is obtained based on the result of the operation. When the bitstream of the currently processed display image is the bitstream of the reference enabled first image corresponding to the currently acquired reconstructed reference image, the currently acquired reconstructed reference image is used as the reference image to perform inter-frame prediction decoding of the bitstream of the display image.

2. The method according to claim 1, characterized in that, The encoded image bitstream also includes quantity information, which is used to indicate n. The n bitstream segments of the Cross-Random Access Point Reference (CRR) image correspond to one Cross-Random Access Point Reference (CRR) image, where n is an integer greater than 1. The step of decoding the encoded image bitstream and obtaining a reconstructed reference image based on the result includes: If the encoded image bitstream contains n bitstream segments of the cross-random access point reference CRR image, the n bitstream segments of the cross-random access point reference CRR image are decoded before the bitstream of the processed display image is the bitstream of the reference enabled first image corresponding to the currently acquired reconstructed reference image, to obtain the reconstructed reference image.

3. The method according to claim 1, characterized in that, The encoded image bitstream also includes quantity information, which is used to indicate n. The n bitstream segments of the Cross-Random Access Point Reference (CRR) image correspond to one Cross-Random Access Point Reference (CRR) image, where n is an integer greater than 1. The step of decoding the encoded image bitstream and obtaining a reconstructed reference image based on the result includes: If the encoded image bitstream contains n bitstream segments of the cross-random access point reference CRR image, the n bitstream segments of the cross-random access point reference CRR image are decoded to obtain the reconstructed reference image.

4. The method according to any one of claims 1-3, characterized in that, After performing the decoding operation on the encoded image bitstream and obtaining the reconstructed reference image based on the operation result, the method further includes: If the bitstream of the currently processed display image is the bitstream of the display image using the previous reconstructed reference image, then until the bitstream of the reference enabled first image corresponding to the currently acquired reconstructed reference image is received, the currently acquired reconstructed reference image is used as the reference image for inter-frame prediction decoding of the display image bitstream.

5. The method according to any one of claims 1-3, characterized in that, The step of using the currently acquired reconstructed reference image as the reference image includes: If the bitstream of the currently processed display image is the bitstream of the reference enabled first image corresponding to the currently acquired reconstructed reference image, the specified buffer is updated using the currently acquired reconstructed reference image.

6. An encoding method, characterized in that, The method includes: After encoding the cross-random access point reference CRR image and the multiple display images corresponding to the cross-random access point reference CRR image to obtain an interleaved encoded image bitstream, a reconstructed reference image is obtained based on the encoding operation. When the currently processed display image is the reference start image corresponding to the currently acquired reconstructed reference image, the currently acquired reconstructed reference image is used as the reference image for inter-frame predictive coding of the display image. The encoded image bitstream includes: multiple bitstream segments of a cross-random access point reference CRR image and multiple display images bitstreams; the bitstream sequence of the multiple bitstream segments of the cross-random access point reference CRR image precedes the bitstream of the reference enabled first image corresponding to the cross-random access point reference CRR image in the multiple display image bitstreams, and the reference enabled first image includes the first image among the multiple display images that references the cross-random access point reference CRR image.

7. The method according to claim 6, characterized in that, The reference image used for the inter-frame predictive coding is stored in a designated buffer; When the currently processed display image is the reference enabled first image corresponding to the currently acquired reconstructed reference image, using the currently acquired reconstructed reference image as the reference image includes: If the currently processed display image is the reference enabled first image corresponding to the currently acquired reconstructed reference image, the specified buffer is updated using the currently acquired reconstructed reference image.

8. The method according to claim 7, characterized in that, Updating the specified buffer using the currently acquired reconstructed reference image includes: If a historical reconstruction reference image is obtained from the designated buffer, the historical reconstruction reference image in the designated buffer is replaced with the currently obtained reconstruction reference image.

9. The method according to claim 7, characterized in that, Updating the specified buffer using the currently acquired reconstructed reference image includes: If no historical reconstruction reference image is obtained from the designated buffer, the currently obtained reconstruction reference image is stored in the designated buffer.

10. The method according to any one of claims 6-9, characterized in that, After obtaining the reconstructed reference image based on the encoding operation, the method further includes: If the currently processed display image is a display image using the previous reconstructed reference image, the process continues until the reference start image corresponding to the currently acquired reconstructed reference image is processed. Then, the currently acquired reconstructed reference image is used as the reference image for inter-frame predictive coding of the display image.

11. A decoding device, characterized in that, The device includes: The transceiver module is used to receive an interleaved encoded image bitstream, the encoded image bitstream including multiple bitstream segments of a cross-random access point reference CRR image and multiple display image bitstreams, the bitstream segments of the cross-random access point reference CRR image being ordered before the bitstream of the reference enabled first image corresponding to the cross-random access point reference CRR image in the multiple display image bitstreams, the reference enabled first image including the first image among the multiple display images that references the cross-random access point reference CRR image; The decoding module is used to perform decoding operations on the encoded image bitstream and obtain a reconstructed reference image based on the operation result. When the bitstream of the currently processed display image is the bitstream of the reference enabled first image corresponding to the currently obtained reconstructed reference image, the currently obtained reconstructed reference image is used as the reference image to perform inter-frame prediction decoding on the bitstream of the display image.

12. The apparatus according to claim 11, characterized in that, The encoded image bitstream also includes quantity information, which is used to indicate n. The n bitstream segments of the Cross-Random Access Point Reference (CRR) image correspond to one Cross-Random Access Point Reference (CRR) image, where n is an integer greater than 1. The decoding module is specifically used for: If the encoded image bitstream contains n bitstream segments of the cross-random access point reference CRR image, the n bitstream segments of the cross-random access point reference CRR image are decoded before the bitstream of the processed display image is the bitstream of the reference enabled first image corresponding to the currently acquired reconstructed reference image, to obtain the reconstructed reference image.

13. The apparatus according to claim 11, characterized in that, The encoded image bitstream also includes quantity information, which is used to indicate n. The n bitstream segments of the Cross-Random Access Point Reference (CRR) image correspond to one Cross-Random Access Point Reference (CRR) image, where n is an integer greater than 1. The step of decoding the encoded image bitstream and obtaining a reconstructed reference image based on the result includes: If the encoded image bitstream contains n bitstream segments of the cross-random access point reference CRR image, the n bitstream segments of the cross-random access point reference CRR image are decoded to obtain the reconstructed reference image.

14. The apparatus according to any one of claims 11-13, characterized in that, The decoding module is also used for After performing the decoding operation on the encoded image bitstream and obtaining the reconstructed reference image based on the operation result, if the bitstream of the currently processed display image is the bitstream of the display image using the previous reconstructed reference image, the process continues until the bitstream of the reference enabled first image corresponding to the currently obtained reconstructed reference image is received. Then, the currently obtained reconstructed reference image is used as the reference image for inter-frame prediction decoding of the display image bitstream.

15. The apparatus according to any one of claims 11-13, characterized in that, The decoding module is specifically used for: If the bitstream of the currently processed display image is the bitstream of the reference enabled first image corresponding to the currently acquired reconstructed reference image, the specified buffer is updated using the currently acquired reconstructed reference image.

16. An encoding device, characterized in that, The device includes: The reconstructed image acquisition module is used to perform encoding operations on the cross-random access point reference CRR image and multiple display images corresponding to the cross-random access point reference CRR image to obtain an interleaved encoded image bitstream, and then acquire the reconstructed reference image based on the encoding operations. The reference image determination module is used to perform inter-frame predictive coding of the display image by using the currently acquired reconstructed reference image as the reference image when the currently processed display image is the reference enabled first image corresponding to the currently acquired reconstructed reference image. The encoded image bitstream includes: multiple bitstream segments of a cross-random access point reference CRR image and multiple display images bitstreams; the bitstream sequence of the multiple bitstream segments of the cross-random access point reference CRR image precedes the bitstream of the reference enabled first image corresponding to the cross-random access point reference CRR image in the multiple display image bitstreams, and the reference enabled first image includes the first image among the multiple display images that references the cross-random access point reference CRR image.

17. The apparatus according to claim 16, characterized in that, The reference image used for the inter-frame predictive coding is stored in a designated buffer; The reference image determination module is specifically used for: If the currently processed display image is the reference enabled first image corresponding to the currently acquired reconstructed reference image, the specified buffer is updated using the currently acquired reconstructed reference image.

18. The apparatus according to claim 17, characterized in that, The reference image determination module is specifically used for: If a historical reconstruction reference image is obtained from the designated buffer, the historical reconstruction reference image in the designated buffer is replaced with the currently obtained reconstruction reference image.

19. The apparatus according to claim 17, characterized in that, The reference image determination module is specifically used for: If no historical reconstruction reference image is obtained from the designated buffer, the currently obtained reconstruction reference image is stored in the designated buffer.

20. The apparatus according to any one of claims 16-19, characterized in that, The reference image determination module is further configured to: Based on the encoding operation, after obtaining the reconstructed reference image, if the currently processed display image is a display image using the previous reconstructed reference image, the process continues until the reference start image corresponding to the currently obtained reconstructed reference image is processed. Then, the currently obtained reconstructed reference image is used as the reference image to perform inter-frame predictive coding on the display image.

21. An electronic device, characterized in that, include: Processor and memory; The processor and the memory are connected; The memory is used to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the method as described in any one of claims 1 to 10.

22. A computer-readable storage medium, characterized in that, The method includes a computer program, characterized in that, when the computer program is run on an electronic device, it causes the electronic device to perform the method as described in any one of claims 1 to 10.

23. A chip, characterized in that, It includes a processing circuit and an interface circuit; the interface circuit is used to couple with a memory outside the encoding / decoding device and to provide a communication interface for the processing circuit to access the memory, the processing circuit is used to execute program instructions in the memory, causing the chip to perform the method according to any one of claims 1 to 10.

24. A computer program product, characterized in that, The method includes a computer program that, when executed by an electronic device, causes the electronic device to perform the method described in any one of claims 1 to 10.

Images