Data processing method and apparatus, storage medium, and program product

Abstract

A data processing method and apparatus, a storage medium, and a program product. The method comprises: receiving SEI processing order indication information, the SEI processing order indication information being used to indicate a processing order of a plurality of SEI messages; on the basis of the SEI processing order indication information, dividing the processing order of the plurality of SEI messages into zero or more processing order sub-chains; and, on the basis of the SEI processing order indication information and processability of each SEI message, determining SEI messages to be processed in the zero or more processing order sub-chains, the processability of the SEI message being used to indicate whether the SEI message supports being processed.

Description

Data processing methods, devices, storage media and software products

[0001] This disclosure claims priority to Chinese patent application No. 202510022448.1, filed on January 6, 2025, the entire contents of which are incorporated herein by reference. Technical Field

[0002] This disclosure relates to the field of communication technology, and in particular to a data processing method, apparatus, storage medium, and program product. Background Technology

[0003] When processing supplemental enhancement information (SEI) messages, the decoding system needs to process them according to the order of the SEI messages. However, the decoding system has limited capabilities and may not be able to process all SEI messages. Furthermore, some unprocessable SEI messages may cause the processing order of other SEI messages to be abandoned. Therefore, it is possible that some SEI messages are not processed in the preferred order or that the processing order of already processed SEI messages is abandoned, thereby reducing the quality of the decoded image. Summary of the Invention

[0004] On one hand, a data processing method is provided, comprising: receiving supplementary enhancement information SEI processing order indication information, the SEI processing order indication information being used to indicate the processing order of multiple SEI messages; dividing the processing order of the multiple SEI messages into zero or more processing order sub-chains according to the SEI processing order indication information; determining the SEI messages to be processed in the zero or more processing order sub-chains according to the SEI processing order indication information and the processability of each SEI message, the processability of the SEI message being used to indicate whether the SEI message supports being processed.

[0005] On the other hand, a data processing method is provided, comprising: sending SEI processing order indication information, wherein the SEI processing order indication information is used to indicate the processing order of multiple SEI messages, so that the decoding system divides the processing order of the multiple SEI messages into zero or more processing order sub-chains, and determines the SEI messages to be processed in the zero or more processing order sub-chains; the SEI messages to be processed in the zero or more processing order sub-chains are determined based on the SEI processing order indication information and the processability of each SEI message; the processability of the SEI message is used to indicate whether the SEI message supports being processed.

[0006] In another aspect, a data processing apparatus is provided, comprising: a receiving unit and a processing unit; the receiving unit is configured to receive supplementary enhancement information SEI processing order indication information, the SEI processing order indication information being used to indicate the processing order of multiple SEI messages; the processing unit is configured to divide the processing order of the multiple SEI messages into zero or more processing order sub-chains according to the SEI processing order indication information; the processing unit is further configured to determine the SEI messages to be processed in the zero or more processing order sub-chains according to the SEI processing order indication information and the processability of each SEI message, the processability of the SEI message being used to indicate whether the SEI message supports being processed.

[0007] In another aspect, a data processing apparatus is provided, comprising: a sending unit; the sending unit being configured to send SEI processing order indication information, the SEI processing order indication information being used to indicate the processing order of multiple SEI messages, such that a decoding system divides the processing order of the multiple SEI messages into zero or more processing order sub-chains, and determines the SEI messages to be processed in the zero or more processing order sub-chains; the SEI messages to be processed in the zero or more processing order sub-chains are determined based on the SEI processing order indication information and the processability of each SEI message; the processability of the SEI message is used to indicate whether the SEI message supports being processed.

[0008] In another aspect, a communication device is provided, comprising: a memory and a processor; the memory and the processor are coupled; the memory is used to store a computer program; and the processor implements the above-described data processing method when executing the computer program.

[0009] In another aspect, a computer-readable storage medium is provided, including a non-transitory computer-readable storage medium on which computer program instructions are stored, which, when executed by a processor, implement the above-described data processing method.

[0010] In another aspect, a computer program product is provided, which includes computer program instructions that, when executed by a processor, implement the aforementioned data processing method. Attached Figure Description

[0011] To more clearly illustrate the technical solutions in this disclosure, the accompanying drawings used in some embodiments of this disclosure will be briefly described below. Obviously, the drawings described below are merely drawings of some embodiments of this disclosure, and those skilled in the art can obtain other drawings based on these drawings.

[0012] Figure 1 is an architecture diagram of a communication system according to some embodiments.

[0013] Figure 2 is a flowchart illustrating a data processing method according to some embodiments.

[0014] Figure 3 is a flowchart of a partitioning process order subchain according to some embodiments.

[0015] Figure 4 is a flowchart of determining a SEI message to be processed according to some embodiments.

[0016] Figure 5 is a flowchart of another partitioning process subchain according to some embodiments.

[0017] Figure 6 is a flowchart of a process order subchain based on SEI message processing conditions according to some embodiments.

[0018] Figure 7 is a flowchart of another data processing method according to some embodiments.

[0019] Figure 8 is a block diagram of a communication device according to some embodiments.

[0020] Figure 9 is a block diagram of another communication device according to some embodiments.

[0021] Figure 10 is a block diagram of another communication device according to some embodiments. Detailed Implementation

[0022] The technical solutions of this disclosure will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this disclosure, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this disclosure without creative effort are within the scope of protection of this disclosure.

[0023] It should be noted that, in this disclosure, the words "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplarily" or "for example" in this disclosure should not be construed as being more preferred or advantageous than other embodiments or designs. Specifically, the use of the words "exemplarily" or "for example" is intended to present the relevant concepts in a specific manner.

[0024] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature.

[0025] In the description of this disclosure, unless otherwise stated, " / " means "or," for example, A / B can mean A or B. "And / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. Furthermore, "at least one" means one or more, and "more than one" means two or more.

[0026] When transmitting streaming data such as audio, video, and images, a series of bits can be transmitted via a bitstream. The bitstream can be transmitted between an encoder (also called an encoding system) and a decoder (also called a decoding system). The encoder compresses the streaming data into a bitstream through the encoding process, and the decoder reconstructs the streaming data from the bitstream through the decoding process. To ensure that the compressed bitstream of streaming data (such as video images) can be correctly decoded by different decoders, encoding and decoding standards are typically used.

[0027] In some codec standards, the bitstream is a series of bits in the form of a network abstract layer (NAL) unit stream or a byte stream, forming one or more access unit (AU) sequences of coded video sequences (CVS). Furthermore, codec standards can assist the decoder in decoding by adding SEI messages to the bitstream. For example, adding SEI messages to the bitstream allows the decoder to assist in decoding, display, or other related processes.

[0028] SEI messages have different payload types. As the number of SEI message payload types increases, different processing orders for multiple SEI messages may lead to differences in the quality of the final video image. Therefore, the decoder needs to process SEI messages according to the preferred processing order of different types (i.e., payload types); otherwise, the quality of the final decoded video image may be reduced, thus degrading the user experience.

[0029] In one possible implementation, to enable the decoder to process according to a specific SEI message processing order, the encoder can send a new SEI message payload type: the SEI processing order (SPO) SEI message. The SPO message (also known as the SPOSEI message) indicates the preferred processing order among multiple SEI messages, helping the decoder apply these SEI messages to the decoded video image in the preferred processing order to obtain the best image quality.

[0030] The SPOSEI message includes the syntax elements po_sei_importance_flag[i] and po_sei_processing_degree_flag[i]. When the SPOSEI message only includes the syntax element po_sei_importance_flag[i], the semantic information corresponding to po_sei_importance_flag[i] indicates the importance of the i-th SEI message. For example, if the importance flag of the i-th SEI message is false (i.e., po_sei_importance_flag[i] = 0), then the SEI message is considered unimportant. If the decoder cannot interpret (or does not support or cannot process) the function indicated by the SEI message, then only the processing order of that SEI message is ignored, without affecting the processing order of other SEI messages indicated by the SPOSEI message. Conversely, if the importance flag of the i-th SEI message is true (i.e., po_sei_importance_flag[i] = 1), then the SEI message is considered important. If the decoder cannot interpret (or does not support or cannot process) the function indicated by the SEI message, then the processing order of all SEI messages indicated by the SPOSEI message should be ignored.

[0031] When the SPO message includes the syntax elements po_sei_importance_flag[i] and po_sei_processing_degree_flag[i], the po_sei_processing_degree_flag[i] indicates that if the decoder cannot process the SEI message for which po_sei_importance_flag[i] equals 1, the decoder can continue processing all SEI messages before the i-th SEI message and ignore the i-th SEI message and all SEI messages processed after it. If both po_sei_importance_flag[i] and po_sei_processing_degree_flag[i] equal 1, the decoder should still ignore all SEI messages indicated by the entire SPO message.

[0032] For example, the following are some parameters in a SEI processing order SEI message (hereinafter also referred to as a processing order SEI message):

[0033] Here, `po_sei_wrapping_flag` indicates whether the SEI message is wrapped. `po_sei_importance_flag[i]` indicates the importance of the SEI message. `po_sei_processing_degree_flag[i]` indicates the processing degree of the SEI message. `po_sei_payload_type[i]` indicates the payload type of the SEI message. `po_sei_prefix_flag[i]` indicates the prefix flag.

[0034] To further enhance and improve the functionality of processing sequential SEI messages, the concept of processing sequence subchains is introduced. This involves dividing the processing sequence of multiple SEI messages indicated by the SPO message into multiple subchains. Specific flag combinations (po_sei_importance_flag and po_sei_processing_degree_flag) represent the start and end of each subchain, allowing for better control over the multiple processing stages within the processing sequence. For example, when po_sei_importance_flag[i] = 1 and po_sei_processing_degree_flag[i] = 0 for the i-th SEI message, it indicates that it belongs to a specific processing subchain. When po_sei_importance_flag[j] = 0 and po_sei_processing_degree_flag[j] = 1 for the j-th SEI message, it indicates the end of a subchain. If the decoder cannot support certain processing stages within a subchain, that subchain will be skipped, ensuring the rationality and integrity of the entire processing chain.

[0035] As shown in Table 1, Table 1 illustrates the processing rules corresponding to the value combinations of po_sei_importance_flag[j] and po_sei_processing_degree_flag[j] in the traditional method. The value combinations of po_sei_importance_flag[j] and po_sei_processing_degree_flag[j] can be 00, 01, 10, and 11, and each combination corresponds to a processing rule for the SEI message.

[0036] Table 1

[0037] It should be noted that, since multiple SEI messages may contain SEI messages that the decoder cannot support or may contain subchains that are ignored according to the above processing rules, the SEI messages in the PoSeiList processed by the decoder may include only one or more SEI messages indicated by the SPO message, or there may be no SEI messages at all.

[0038] In summary, when processing SEI messages, the decoding system needs to process them according to their order. However, the decoding system has limited capabilities and may not be able to process all SEI messages. Furthermore, some unprocessable SEI messages may cause the processing order of other SEI messages to be abandoned. Therefore, it is possible that some SEI messages are not processed in the preferred order, or that the processing order of already processed SEI messages is abandoned, thereby reducing the quality of the decoded image.

[0039] To address this, this disclosure provides a data processing method whereby a decoding system can divide the processing order of multiple SEI messages into zero or more processing order sub-chains based on SEI processing order indication information. Subsequently, the decoding system can determine the unprocessed SEI messages among the multiple SEI messages based on the SEI processing order indication information and the processability of each SEI message. The decoding system can determine whether an SEI message supports processing by the decoding system based on its processability, and whether the SEI message will cause other SEI messages in the processing chain to be ignored based on the SEI processing order indication information, thereby identifying the unprocessed SEI messages among the multiple SEI messages. In this way, the decoding system can determine the unprocessed SEI messages corresponding to the SEI processing order indication information before starting to process the SEI messages. The decoding system can execute or process the unprocessed SEI messages sequentially according to their processing order among the multiple SEI messages, thus improving decoding quality. Furthermore, it can avoid the situation where already processed SEI messages are discarded, thereby improving decoding efficiency.

[0040] The data processing method provided in this disclosure can be applied to systems with various communication standards. For example, the systems to which the data processing provided in this disclosure is applicable include, but are not limited to, long-term evolution (LTE) systems, various versions based on LTE evolution, 5G systems, future mobile communication networks (such as 6G networks), or multiple converged communication systems. Furthermore, the data processing method provided in this disclosure can also be applied to future-oriented communication systems.

[0041] For example, the above data processing method can be applied to the communication system shown in FIG1. ​​As shown in FIG1, the communication system includes a decoding system 101 and an encoding system 102.

[0042] The decoding system 101 and the encoding system 102 are communicatively connected. The decoding system 101 can be a decoder, such as a terminal device, and the encoding system 102 can be an encoder, such as a base station device. Figure 1 illustrates this using the example of the decoding system 101 as a terminal and the encoding system 102 as a base station.

[0043] In some embodiments, the decoding system 101 may receive SEI processing order indication information sent by the encoding system 102. Then, the decoding system 101 may divide the processing order of multiple SEI messages into zero or more processing order sub-chains based on the SEI processing order indication information. Subsequently, the decoding system 101 may determine the SEI messages to be processed based on the SEI message processing order indication information and the processability of each SEI message. In this way, the decoding system 101 can determine all the SEI messages to be processed before starting to process them, ensuring that the SEI messages to be processed are processed by the decoding system in the order indicated by the SEI processing order indication information, thereby improving decoding quality. Furthermore, it can avoid the situation where the order of already processed SEI messages is ignored, thus improving decoding efficiency.

[0044] In some embodiments, the terminal can be a device with wireless transceiver capabilities, which can be deployed on land, including indoors or outdoors, handheld, wearable, or vehicle-mounted; it can also be deployed on water (such as on ships); and it can also be deployed in the air (e.g., on airplanes, balloons, and satellites). The terminal can be a mobile phone, tablet computer, computer with wireless transceiver capabilities, virtual reality (VR) terminal, augmented reality (AR) terminal, wireless terminal in industrial control, wireless terminal in self-driving, wireless terminal in remote medical care, wireless terminal in smart grid, wireless terminal in transportation safety, wireless terminal in smart city, wireless terminal in smart home, etc. The embodiments of this application do not limit the application scenarios. The term "terminal" can sometimes also refer to a user, user equipment (UE), access terminal, UE unit, UE station, mobile station, mobile station, remote station, remote terminal, mobile device, UE terminal, wireless communication device, UE agent, or UE device, etc., but the embodiments of this application do not limit this to these terms.

[0045] In some embodiments, the base station may be a base station in Long Term Evolution (LTE), Long Term Evolution Advanced (LTEA), or an evolved Node B (eNB or eNodeB), a base station device in a 5G network, or a base station in a future communication system. The base station may include various macro base stations, micro base stations, femtocell base stations, wireless remote extensions, reconfigurable intelligent surfaces (RISs), routers, wireless fidelity (WIFI) devices, or various network-side devices such as primary cells and secondary cells.

[0046] It should be noted that Figure 1 is only an exemplary framework diagram. The number of devices included in Figure 1 and the names of each device are not limited. In addition to the devices shown in Figure 1, the communication system may also include other devices, such as relay nodes.

[0047] The application scenarios of the embodiments disclosed herein are not limited. The system architecture and business scenarios described in the embodiments of this disclosure are for the purpose of more clearly illustrating the technical solutions of the embodiments of this disclosure, and do not constitute a limitation on the technical solutions provided by the embodiments of this disclosure. As those skilled in the art will know, with the evolution of network architecture and the emergence of new business scenarios, the technical solutions provided by the embodiments of this disclosure are also applicable to similar technical problems.

[0048] The data processing method provided in the embodiments of this disclosure will now be described in detail with reference to the accompanying drawings.

[0049] The data processing method provided in this embodiment can be applied to the decoding system 101 in the communication system shown in FIG1. ​​FIG2 shows a flowchart of a data processing method, which includes S201, S202 and S203.

[0050] In S201, the SEI processing sequence indication information is received.

[0051] Here, SEI processing order indication information is used to indicate the processing order of multiple SEI messages. SEI processing order indication information can be a SPOSEI message, a processing order nesting (PON) SEI message, or other messages indicating the processing order of SEI messages. SEI processing order indication information can include a preferred processing order of multiple SEI messages. It should be understood that the processing order of multiple SEI messages can also be referred to as a processing order chain, a processing chain, or a processing order sequence, etc.

[0052] In some embodiments, the SEI processing order indication information may be: high-level semantic information, indication information indicating the SEI processing order through file encapsulation of the bitstream, or indication information indicating the SEI processing order through the parameter set corresponding to the bitstream.

[0053] In S202, based on the SEI processing order indication information, the processing order of multiple SEI messages is divided into zero or more processing order sub-chains.

[0054] Here, the processing order subchain can also be called a subchain, processing subchain, or message subchain. Dividing into zero processing order subchains can be understood as adding all multiple SEI messages to the same processing order chain, resulting in one processing order chain; it can also be understood as not dividing the processing order of multiple SEI messages into processing order subchains, thus obtaining zero processing order subchains; in this case, the zero processing order subchains are the same as the processing order chain. Alternatively, it can be understood as adding all SEI messages to a special processing order subchain, resulting in a preset processing order subchain.

[0055] In some embodiments, SEI processing order indication information is used to indicate the categories of multiple SEI messages. For example, different categories of SEI messages can serve as the start, end, or intermediate stage of an SEI message. Therefore, the decoding system can further divide the processing order of multiple SEI messages into zero or more processing order sub-chains based on their categories. This allows the decoding system to exercise more granular control over each processing order sub-chain, thereby reducing the interference between SEI messages.

[0056] For example, the category of each SEI message can be indicated by the third field in the SEI processing order indication information, that is, each SEI message corresponds to a third field (also called the message importance index: po_sei_importance_idx). For example, the third field includes an importance flag (po_sei_importance_flag[i]) and a processing level flag (po_sei_processing_order[i]), that is, the third field consists of two flags, and one SEI message corresponds to one importance flag and one processing level flag. Alternatively, the third field can be one of the importance flag and the processing level flag, that is, the semantic information of the importance flag or the processing level flag is redefined to indicate the category of each SEI message. For example, if there are four categories of SEI messages, namely the first category, the second category, the third category, and the fourth category, then the value range of the third field can be 0, 1, 2, and 3. po_sei_importance_idx[i] = 0 indicates that the i-th SEI message is a first category SEI message. As shown in Table 2, Table 2 illustrates an importantness identifier and a processing level identifier that indicate the SEI message category. The value combinations of the importantness identifier and the processing level identifier can include 00, 01, 10, and 11, with each value combination corresponding to a category of SEI message.

[0057] Table 2

[0058] In other embodiments, SEI processing order indication information is used to indicate the processing order subchain to which each SEI message belongs, or to determine the processing order subchain to which each SEI message belongs based on the fourth and / or fifth fields in the SEI processing order indication information.

[0059] SEI processing sequence indication information includes a fourth field. The first value of the fourth field indicates that an SEI message is the first processing stage of a processing sequence subchain, and the second value of the fourth field indicates that an SEI message is not the first processing stage of a processing sequence subchain. Here, the fourth field can also be called the subchain start identifier, used to indicate whether an SEI message is a subchain of a processing sequence.

[0060] SEI processing sequence indication information includes a fifth field. The first value of the fifth field indicates that an SEI message is the final processing stage of a processing sequence subchain, and the second value indicates that an SEI message is not the final processing stage of a processing sequence subchain. The fifth field can also be called a subchain end identifier, used to indicate whether an SEI message is the last processing stage of a processing sequence subchain.

[0061] S203. Based on the SEI processing order indication information and the processability of each SEI message, determine the SEI messages to be processed in zero or more processing order subchains.

[0062] Here, the processability of an SEI message indicates whether it supports being processed. For example, there can be zero, one, or multiple SEI messages to be processed. Regardless of the order of the processing order subchains, the decoding system processes the SEI messages in the order they appear in the processing order of the multiple SEI messages.

[0063] It should be understood that processability can also be interpreted as whether the SEI message can be processed normally by the decoding system, or whether the decoding system can correctly understand the payload type of the SEI message, or whether the decoding system supports the function indicated by the SEI message. For example, the decoding system's inability to interpret or support the SEI message is equivalent to the decoding system's inability to interpret or support the payload type of the SEI message, or the decoding system's inability to interpret or support the function corresponding to the payload type of the SEI message. The decoding system's inability to interpret, support, or apply the SEI message is also equivalent to the decoding system's inability to correctly process the SEI message.

[0064] Due to the limited processing capabilities of the decoding system, it may be unable to process (or unable to support processing) some SEI messages, meaning these SEI messages may be ignored, discarded, or not processed. Furthermore, these SEI messages may also cause other SEI messages within a set of multiple SEI messages, or the processing order of other SEI messages, to be ignored, discarded, or not processed. For example, if the second SEI message cannot be processed normally by the decoding system, the processing order of other SEI messages within a set of multiple SEI messages will also be ignored. However, in traditional methods, when the decoding system determines that the second SEI message also cannot be processed, it needs to ignore the 0th and 1st SEI messages. That is, the decoding system either does not process the 0th and 1st messages or cannot process the 0th and 1st messages in the preferred order indicated by the SEI processing order information, thereby reducing the quality of the decoded image. In addition, this method avoids situations where already processed SEI messages are determined to be in an order that needs to be ignored, thus improving processing efficiency.

[0065] It should be noted that when processing multiple pending SEI messages, they can be processed in the order they appear in the processing order chain mentioned above.

[0066] In some embodiments, when determining the SEI messages to be processed, the decoding system can determine the SEI message processing result in each processing order subchain based on the category and processability of each SEI message. The SEI message processing result includes information on whether each SEI message was processed normally, ignored, or supported for processing by the decoding system. For example, if an SEI message supports normal processing by the decoding system, the result indicating that the SEI message can be processed normally can be added to the SEI message processing result; if an SEI message does not support normal processing or is ignored, the result indicating that the SEI message cannot be processed normally can be added to the SEI message processing result.

[0067] After determining the SEI message processing result, an SEI message processing list can be determined based on that result. The SEI message processing list includes pending SEI messages. This list can be represented as PoSeiList. Determining the SEI message processing order indication information based on the SEI message processing result of each sub-chain means adding the pending SEI messages from each sub-chain that need processing to the PoSeiList in a non-decreasing processing order. It should be noted that ignoring an SEI message means not adding it to the SEI message processing list. It should be understood that if multiple SEI messages cannot be processed normally or are all ignored, the SEI message processing list will be empty.

[0068] The following will describe the method for determining the processing order subchain in S202 above.

[0069] Method 1: Determine zero or more processing order subchains based on subchain derivation rules.

[0070] Referring to Figure 2 and as shown in Figure 3, in the above S202, dividing the processing order of multiple SEI messages into zero or more processing order sub-chains according to the SEI processing order indication information specifically includes:

[0071] In S301, the subchain derivation rules corresponding to multiple SEI messages are determined based on the categories of multiple SEI messages.

[0072] Here, one type of SEI message corresponds to one subchain derivation rule.

[0073] Since each type of SEI message corresponds to a specific subchain derivation rule, the types of multiple SEI messages can be obtained based on the SEI processing order indication information. Then, the subchain derivation rule corresponding to each SEI message can be determined based on the types of multiple SEI messages.

[0074] In S302, based on the sub-chain derivation rules corresponding to each SEI message in multiple SEI messages, zero or more processing order sub-chains are determined.

[0075] Since the subchain derivation rule corresponding to each SEI message can be used to indicate the processing order subchain to which the SEI message belongs, the decoding system can determine zero or more processing order subchains based on the subchain derivation rule corresponding to each SEI message.

[0076] Here, SEI messages can be categorized into four types: Category 1, Category 2, Category 3, and Category 4.

[0077] The subchain derivation rules for the first category include: SEI messages of the first category belong to a preset processing order subchain, or SEI messages of the first category belong to a processing order subchain.

[0078] The subchain derivation rules for the second category include: SEI messages of the second category belong to a processing order subchain, or, SEI messages of the second category belong to the first SEI message or the first processing stage of a processing order subchain.

[0079] The rules for deriving subchains of the third category include: SEI messages of the third category belong to the last SEI message or the last processing stage of a processing order subchain, or SEI messages of the third category belong to a processing order subchain.

[0080] The subchain derivation rules for the fourth category include: SEI messages of the fourth category belong to a processing order subchain.

[0081] It should be noted that "SEI message belongs to a processing order subchain" means that the SEI message belongs to a specific processing order subchain. "SEI message belongs to a preset processing order subchain" means that the SEI message belongs to a processing order subchain with a preset index, such as the processing order subchain with subchain index 0. The processing order subchain with subchain index 0 can be considered a special type of processing order subchain, consisting of all SEI messages that do not belong to any processing order subchain. In other words, the aforementioned zero processing order subchains can also be understood as the preset processing order subchain.

[0082] Method 2: SEI processing order indication information is used to indicate the sub-chain index of the processing order for each SEI message.

[0083] In some embodiments, the SEI processing order indication information includes a first field, which indicates the processing order subchain index of each SEI message among multiple SEI messages. Thus, the decoding system can determine the processing order subchain to which each SEI message belongs based on the first field in the SEI processing order indication information, thereby obtaining multiple processing order subchains.

[0084] The second field can be po_sei_subchain_idx[i], which indicates the subchain index of the processing order of the i-th SEI message. When po_sei_subchain_idx[i] is 0, it means that the processing subchain index to which the SEI message belongs is 0, indicating that it does not belong to any processing subchain or belongs to a preset processing subchain. For example, po_sei_subchain_idx[i] is set to 0 for the SEI message of the first category mentioned above. When po_sei_subchain_idx[i] is 1, it means that the processing subchain index to which the SEI message belongs is 2.

[0085] For example, the following are the parameters in the processing order of SEI messages containing different payload types that include the second field:

[0086] Here, po_sei_subchain_idx[i] represents the index of the subchain in the processing order of this SEI message, po_sei_wrapping_flag represents whether a wrapping flag is used, po_sei_importance_flag[i] represents the importance flag of the SEI message, po_sei_processing_degree_flag[i] represents the processing degree flag of the SEI message, po_sei_payload_type[i] represents the payload type of the SEI message, and po_sei_prefix_flag[i] represents the prefix flag.

[0087] For example, as shown in Table 3, each SEI message corresponds to a second field, which indicates the processing order subchain corresponding to the SEI message.

[0088] Table 3

[0089] Method 3: SEI processing order indication information is used to determine the start and / or end identifiers of the sub-chain corresponding to each SEI message. The start identifier indicates whether the SEI message is the first processing stage of a processing order sub-chain, and the end identifier indicates whether the SEI message is the last processing stage of a processing order sub-chain. When the start identifier of an SEI message is true, it indicates that the SEI message is the first SEI message in a sub-chain; when the start identifier is false, it indicates that the SEI message is not the first SEI message in a sub-chain. When the end identifier of an SEI message is true, it indicates that the SEI message is the last SEI message in a sub-chain; when the end identifier is false, it indicates that the SEI message is not the last SEI message in a sub-chain.

[0090] When the SEI processing order indication information contains a sub-chain start identifier and a sub-chain end identifier, multiple SEI messages in the SEI processing order indication information are evaluated sequentially in a non-decreasing processing order. The SEI message with the first true sub-chain start identifier, the SEI message with the first true sub-chain end identifier, and messages whose processing order is between these two messages belong to the same sub-chain. Similarly, the SEI message with the second true sub-chain start identifier, the SEI message with the second true sub-chain end identifier, and messages whose processing order is between these two messages belong to another sub-chain. This process continues until all SEI messages in the SEI processing order indication information have been evaluated.

[0091] When the SEI processing order indication information only contains a sub-chain start identifier, multiple SEI messages in the SEI processing order indication information are judged sequentially in a non-decreasing processing order. The first target SEI message with the first sub-chain start identifier being true indicates the beginning stage of the first sub-chain. The second target SEI message whose processing order is before the SEI message with the second sub-chain start identifier being true indicates the end stage of the first sub-chain. The first and second target SEI messages and the SEI messages whose processing order is between the above two messages belong to the same sub-chain. This process continues until the last SEI message in the SEI processing order indication information has been judged.

[0092] When the SEI processing order indication information only contains a sub-chain end identifier, the multiple SEI messages in the SEI processing order indication information are judged sequentially in a non-decreasing processing order. The first SEI message in the multiple SEI messages indicates the start stage of the first sub-chain, and the first ending SEI message with a true first sub-chain end identifier indicates the end stage of the first sub-chain. The first SEI message, the first ending SEI message, and the SEI messages whose processing order is between the two messages belong to the first sub-chain. The first target SEI message after the SEI message with a true first sub-chain end identifier indicates the start stage of the second sub-chain, and the second ending SEI message with a true second sub-chain end identifier indicates the end stage of the second sub-chain. The first target SEI message, the second ending SEI message, and the SEI messages whose processing order is between the two messages belong to the second sub-chain. This process continues until the last SEI message in the SEI processing order indication information has been judged.

[0093] Method 4: SEI processing order indication information is used to indicate whether each SEI message belongs to the first type of processing order subchain or the second type of processing order subchain.

[0094] In some embodiments, the SEI processing order indication information includes a second field, wherein a first value of the second field is used to indicate that an SEI message belongs to a first type of processing order subchain, and a second value of the second field is used to indicate that an SEI message belongs to a second type of processing order subchain.

[0095] Here, at least one SEI message corresponding to the second field with a value of the first value belongs to a first-type processing order subchain; multiple SEI messages corresponding to the second field with consecutive values ​​of the second value belong to a second-type processing order subchain, or one SEI message corresponding to the second field with a value of the second value belongs to a second-type processing order subchain; the values ​​of the second field corresponding to adjacent SEI messages of an SEI message are both the first value; the first-type processing order subchain is a preset processing order subchain, and the second-type processing order subchain is a subchain other than the preset processing order subchain among multiple processing order subchains.

[0096] The second field can be used to indicate whether each SEI message belongs to a first-type or second-type processing order subchain. The first-type processing order subchain is the aforementioned preset processing order subchain, and there is only one such subchain. This means that multiple SEI messages within the preset processing order subchain can be consecutive or non-consecutive. The second-type processing order subchain is any subchain other than the preset processing order subchain. There can be one or more such subchains. SEI messages within the second-type processing order subchain include multiple consecutive SEI messages or one non-consecutive SEI message (i.e., the SEI message whose second field value is the first value corresponding to adjacent SEI messages).

[0097] The decoding system can identify at least one SEI message with a second field value of the second value as a second type of processing order subchain, and add at least one SEI message with a second field value of the first value among multiple SEI messages to the first type of processing order subchain.

[0098] For example, po_sei_subchain_flag[i] (i.e., the second field mentioned above, also known as the subchain identifier) ​​can be used to indicate whether the i-th SEI message belongs to the first type of processing order subchain or the second type of processing order subchain, thereby deriving the subchain index of the i-th SEI message. When po_sei_subchain_flag[i] is 0, it indicates that the message does not belong to a subchain or the subchain index is 0 (i.e., the preset processing order subchain), that is, it belongs to the first type of processing order subchain; when po_sei_subchain_flag[i] is 1, it indicates that the message belongs to a certain processing subchain (i.e., the second type of processing order subchain). In some embodiments of this disclosure, the second field can also reuse po_sei_wrapping_flag[i] in the traditional SPO SEI message, thereby reducing codeword overhead.

[0099] After receiving the SEI processing order indication information, the decoding system can sequentially determine the sub-chain index of each SEI message in the SEI processing order indication information according to the non-decreasing order of the processing order of multiple SEI messages. In the processing order of multiple SEI messages, the first SEI message with a second field value of 1 indicates the beginning of the first processing order sub-chain, until the second SEI message with a second field value of 0 indicates the end of the first sub-chain; that is, the second SEI message and subsequent SEI messages no longer belong to the first processing order sub-chain. Similarly, the third SEI message with a second field value of 1 indicates the beginning of the second processing order sub-chain, until the fourth SEI message with a second field value of 0 indicates the end of the second processing order sub-chain; that is, the fourth SEI message and subsequent SEI messages no longer belong to the second processing order sub-chain. All SEI messages with a second field value of 0 in the SEI processing order indication information belong to a preset processing order sub-chain, and their sub-chain index is set to 0, which can also be understood as not belonging to any processing order sub-chain. As shown in Table 4, SEI messages 0-3 out of the 7 SEI messages belong to the first processing order subchain. SEI messages 6-7 belong to the second processing order subchain. SEI messages 4-5 belong to the preset processing order subchain. For example, when dividing the processing order subchains, the category of the SEI message can be determined according to the method in Method 1, or it can be left undefined.

[0100] Table 4

[0101] The above describes the method for determining the processing order subchain. The following will describe the method for determining the SEI message to be processed in S203 above.

[0102] Referring to Figure 3 and as shown in Figure 4, in the above S203, the SEI messages to be processed in zero or more processing order sub-chains are determined according to the SEI processing order indication information and the processability of each SEI message, specifically including S401 and S402.

[0103] In S401, message processing rules corresponding to multiple SEI messages are determined based on the categories of multiple SEI messages.

[0104] Here, a message processing rule corresponds to a type of SEI message. The message processing rule is used to determine the SEI messages to be processed. The message processing rule for an SEI message can be the processing order of which (or which) SEI messages among multiple SEI messages to ignore when the decoding system does not support processing that SEI message.

[0105] In S402, based on the message processing rules and processability of each SEI message in multiple SEI messages, the SEI messages to be processed in zero or more processing order subchains are determined.

[0106] The decoding system can determine whether an SEI message should be ignored based on the message processing rules and processability corresponding to each SEI message. Furthermore, for some categories of SEI messages, ignoring that category will also cause other SEI messages to be ignored. Therefore, the decoding system can determine zero, one, or more unprocessed SEI messages from a pool of SEI messages based on whether the decoding system supports processing SEI messages and the corresponding message processing rules.

[0107] It should be noted that ignoring an SEI message can also be referred to as discarding or abandoning it. This means the processing order of the SEI message is ignored, and the decoding system no longer processes it according to the order indicated by the SEI processing order information; in other words, the SEI message is not added to the SEI message processing list. In some cases, the SEI message may not be processed at all.

[0108] Here, SEI messages can be categorized into Category 1, Category 2, Category 3, and Category 4.

[0109] The multiple SEI messages are categorized into a first category. The message processing rules for the SEI messages in the first category are as follows: if the decoding system does not support processing SEI messages of the first category, the multiple SEI messages are ignored; or, if the decoding system does not support processing SEI messages of the first category and the SEI messages of the first category belong to a processing order subchain, the processing order subchain to which the SEI messages of the first category belong is ignored.

[0110] The SEI messages are categorized into several types, including a second type. The message processing rules for this second type of SEI message are as follows: if the decoding system does not support processing second-type SEI messages, SEI messages processed after those in the second type and SEI messages in the second type are ignored. In other words, all SEI messages processed before those in the second type and supported by the decoding system are added to the SEI message processing list in the order they are processed.

[0111] Alternatively, if the decoding system does not support processing SEI messages of the second category, the processing order subchain to which the SEI messages of the second category belong is ignored.

[0112] Alternatively, if the decoding system does not support processing SEI messages of the second category, the SEI messages of the second category and the SEI messages of the first preset category in the processing order subchain to which the SEI messages of the second category belong are ignored.

[0113] Alternatively, if the decoding system does not support processing SEI messages of the second category, the SEI messages of the second preset category in the processing order subchain to which the SEI messages of the second category belong are ignored.

[0114] Alternatively, if a second-category SEI message belongs to a preset processing order subchain, and the decoding system does not support processing second-category SEI messages, then the second-category SEI messages and subsequent SEI messages in the multiple SEI messages are ignored. That is, SEI messages whose processing order precedes the second-category SEI messages and which the decoding system can process are added to the SEI message processing list sequentially according to their processing order.

[0115] The categories of SEI messages include a third category. The message processing rules for the third category of SEI messages are as follows: if the decoding system does not support the third category of SEI messages, the third category of SEI messages are ignored.

[0116] Alternatively, if the decoding system does not support SEI messages of the third category, the SEI messages between the third category SEI messages and the target SEI message are ignored, and the target SEI message is the SEI message that meets the preset conditions in the processing order subchain to which the third category SEI message belongs.

[0117] Alternatively, if the decoding system does not support SEI messages of the third category, the processing order subchain to which the SEI message of the third category belongs is ignored.

[0118] Multiple SEI message categories include a fourth category, and the message processing rules for SEI messages in the fourth category include:

[0119] If the decoding system does not support SEI messages of category 4, then SEI messages of category 4 are ignored.

[0120] Here, the preset conditions may include: the SEI message of the fourth preset category that is closest in order to the SEI message of the third category.

[0121] It should be noted that in traditional techniques, the second category of SEI messages can be determined by `po_sei_importance_flag[i] = 0` and `po_sei_processing_degree_flag[i] = 1`, and the corresponding processing rule is to ignore the processing order subchain to which this second category of SEI message belongs. Since `po_sei_importance_flag[i] = 0` indicates that the SEI message is not important, it can simply be ignored if the second category of SEI message cannot be processed. However, in traditional techniques, the entire processing order subchain is ignored, which reduces the decoding quality.

[0122] In this case, if the second category of SEI messages in this embodiment cannot be processed, it is not necessary to ignore all SEI messages in the entire processing sequence subchain (e.g., the SEI messages of the second category and the SEI messages after the second category are ignored), thereby reducing the impact on decoding and improving decoding quality.

[0123] In some embodiments, the subchain derivation rules and message processing rules corresponding to each type of SEI message are pre-set or indicated by the encoding system. Each type of SEI message corresponds to one subchain derivation rule and one message processing rule as described above. The following description will use a combination of subchain derivation rules and message processing rules as an example.

[0124] Example 1, as shown in Table 5, illustrates a subchain derivation rule and message processing rule combination, which can be obtained for each type of SEI message.

[0125] Table 5

[0126] Here, a subchain index of 0 or not belonging to any subchain indicates that the SEI messages of that category belong to the preset processing order subchain according to the subchain derivation rule corresponding to the first category mentioned above. The entire processing chain corresponding to the SEI processing order indication information in the message processing rule means that multiple SEI messages indicated by the SEI processing order message in the message processing rule corresponding to the first category mentioned above are ignored, i.e., no longer processed.

[0127] In the second category, "belonging to a certain subchain" means belonging to any processing order subchain in the subchain derivation rules of the second category mentioned above. "The decoding system no longer applies the SEI message and all subsequent SEI messages in the subchain to which the SEI message belongs" in the message processing rules means that SEI messages processed after the SEI messages in the second category and SEI messages in the second category are ignored in the message processing rules of the second category mentioned above.

[0128] The SEI message in the third category indicates the end of a sub-chain. According to the sub-chain derivation rules for the third category mentioned above, the SEI message of the third category belongs to the last SEI message in a processing order sub-chain. Excluding the SEI message from the processing chain in the message processing rules means that the SEI message of the third category in the message processing rules for the third category mentioned above is ignored.

[0129] In the fourth category, "belonging to a certain subchain" means that the message belongs to any processing order subchain in the subchain derivation rules of the fourth category mentioned above. "Excluding the SEI message from the processing chain" in the message processing rules means that SEI messages of the fourth category are ignored in the message processing rules of the fourth category mentioned above.

[0130] It should be understood that the processing chain refers to the processing order of the multiple SEI messages mentioned above. "No longer applicable" means that the decoding system cannot support, interpret, process, or does not support processing it.

[0131] In some embodiments, the subchain derivation rules and message processing rules corresponding to each type of SEI message can also be called processing rules. The decoding system can determine the SEI message to be processed based on the processing rules.

[0132] As shown in Table 6, Table 6 illustrates the first processing rule, which is a combination of the sub-chain derivation rules and message processing rules in Table 5.

[0133] Table 6

[0134] For example, when the processing rule is the first processing rule, taking multiple SEI messages as an example of 7 SEI messages, as shown in Table 7, Table 7 shows a schematic table of different SEI message categories.

[0135] Table 7

[0136] According to the first processing rule in the table above, since the SEI message of the third category is the end of a sub-chain, the three SEI messages with processing order 0, 1, and 2 form the first processing order sub-chain, and the SEI messages with processing order 3, 4, and 5 form the second processing order sub-chain. Since the SEI message with processing order 6 is of the first category, this SEI message does not belong to any sub-chain or its corresponding sub-chain index is 0. The processing order sub-chains of the seven SEI messages are shown in Table 8.

[0137] Table 8

[0138] The first processing order subchain contains three SEI messages: SEI messages of the second category, SEI messages of the third category, and SEI messages of the fourth category. The message processing rule for SEI messages of the second category is: if the decoding system cannot interpret or does not support the SEI message, the decoding system will not apply the SEI message and all subsequent SEI messages in the subchain to which it belongs. Therefore, if a SEI message of the second category with a processing order of 0 cannot be correctly processed by the decoding system, the decoding system will not apply the SEI message and all subsequent SEI messages in the subchain to which it belongs; that is, the decoding system will not apply any SEI message from the first processing order subchain.

[0139] If a second-category SEI message with a processing order of 1 cannot be correctly processed by the decoding system, the decoding system will no longer apply that SEI message and all subsequent SEI messages in the sub-chain to which it belongs. That is, the SEI messages to be processed in the first processing order sub-chain only include SEI messages with a processing order of 0. For the sake of convenience in the following explanation, in this embodiment, the SEI messages to be processed in the first processing order sub-chain only include second-category SEI messages with a processing order of 0.

[0140] Similarly, the second processing order subchain also contains three SEI messages: Category 2, Category 4, and Category 3 SEI messages. The message processing rules for Category 2 SEI messages can be found in the description of the first processing order subchain. Assuming that the Category 2 SEI messages in the second processing order subchain can be correctly processed by the decoding system, the SEI messages to be processed in this subchain include Category 2 SEI messages with processing order 3. Since the Category 3 and Category 4 SEI messages cannot be correctly processed by the decoding system, the decoding system simply ignores these SEI messages.

[0141] If the SEI message of category 4 with processing order 4 can be correctly processed by the decoding system, then the SEI messages to be processed in the second processing order subchain include the SEI messages of category 2 with processing order 3 and the SEI messages of category 4 with processing order 4. If the SEI message of category 3 with processing order 5 cannot be correctly processed by the decoding system, then the decoding system ignores this SEI message. That is, the SEI messages to be processed in the second processing order subchain only include the SEI messages of category 2 with processing order 3 and the SEI messages of category 4 with processing order 4.

[0142] Furthermore, SEI messages with a processing order of 6 belong to the first category of SEI messages. They do not belong to any sub-chain or the index of that sub-chain is 0 (i.e., the preset processing order sub-chain). Since the message processing rule for the first category of SEI messages is: if the decoding system cannot interpret or does not support the SEI message, the decoding system will no longer apply the entire processing chain corresponding to the SEI processing order indication information. Therefore, if a first-category SEI message with a processing order of 6 cannot be correctly processed by the decoding system, the decoding system will no longer apply the entire processing chain to which the SEI message belongs; that is, the SEI message processing order list corresponding to the SEI processing order indication information is empty at this time. Conversely, if a first-category SEI message with a processing order of 6 can be correctly processed by the decoding system, the decoding system adds it to the corresponding SEI message processing order list according to the processing order. That is, the SEI message processing order list corresponding to the processing order indication information at this time is: SEI messages with a processing order of 0, second-category SEI messages with a processing order of 3, fourth-category SEI messages with a processing order of 4, and first-category SEI messages with a processing order of 6.

[0143] Example 2, as shown in Table 9, illustrates a second processing rule composed of sub-chain derivation rules and message processing rules.

[0144] Table 9

[0145] Here, the processing rules corresponding to the first, second, and fourth categories in the second processing rule are the same as those described in the first processing rule above, and will not be repeated here. In the processing rule corresponding to the third category, the decoding system no longer executes all SEI messages between the third category SEI message and the nearest second category SEI message in the processing subchain. This means that SEI messages between the third category SEI message and the target SEI message in the message processing rule corresponding to the third category are ignored. The target SEI message is the SEI message in the processing order subchain to which the third category SEI message belongs that meets a preset condition. In this case, the preset condition may include: the SEI message of the fourth preset category that is sequentially closest to the third category SEI message. The fourth preset category is the second category.

[0146] If multiple SEI messages are as shown in Table 7, and the first processing order subchain contains three SEI messages—a second-category SEI message, a third-category SEI message, and a third-category SEI message—assuming that the second-category SEI messages with processing orders 0 and 1 can be correctly processed by the decoding system, while the third-category SEI message with processing order 2 cannot be correctly processed, then according to the processing rules corresponding to the third-category SEI message, the decoding system will no longer execute all SEI messages between the third-category message and the nearest second-category message in the processing subchain. That is, the decoding system will no longer execute the third-category SEI message with processing order 2 and the second-category SEI message with processing order 1. Therefore, the SEI messages to be processed in the first processing order subchain only include the second-category SEI message with processing order 0.

[0147] Similarly, the second processing order subchain contains three SEI messages: Category 2, Category 4, and Category 3 SEI messages. Assuming that Category 2 (processing order 3) and Category 4 (processing order 4) SEI messages in the second processing order subchain can be correctly processed by the decoding system, but Category 3 (processing order 5) SEI messages cannot be correctly processed, according to the processing rules corresponding to Category 3 SEI messages, the decoding system will no longer execute all SEI messages between Category 3 SEI messages and their nearest Category 2 SEI messages in the processing subchain. That is, the decoding system will no longer execute any messages between Category 3 SEI messages (processing order 5) and Category 2 SEI messages (processing order 3). Therefore, the SEI message processing result of the second processing order subchain does not include any SEI messages.

[0148] Example 3, as shown in Table 10, illustrates a third processing rule composed of sub-chain derivation rules and message processing rules.

[0149] Table 10

[0150] Here, the SEI message of the second category in the processing rules indicates the start of a subchain, meaning that the SEI message of the second category in the subchain derivation rules of the second category belongs to the first SEI message of a processing order subchain.

[0151] If multiple SEI messages are as shown in Table 7, then according to the third processing rule in Table 10, since the second category of SEI messages is used to indicate the start of a subchain, as shown in Table 11, the SEI message with processing order 0 is the first processing order subchain, the SEI messages with processing order 1 and 2 are the second processing order subchain, and the SEI messages with processing order 3, 4, and 5 are the third processing order subchain. Because the SEI message with processing order 6 is of the first category, this SEI message does not belong to any subchain, and its corresponding subchain index is 0, which is the preset processing order subchain.

[0152] Table 11

[0153] If a Category 2 or Category 3 SEI message cannot be correctly processed by the decoding system (i.e., the decoding system cannot interpret or does not support the SEI message), the entire subchain to which that SEI message belongs will no longer be applied. Therefore, in this example, if a Category 2 SEI message with processing order 0 cannot be correctly processed by the decoding system, the decoding system will no longer apply the first processing order subchain, meaning the SEI message processing result of the first processing order subchain is empty (i.e., there are zero unprocessed SEI messages in this processing order subchain). Similarly, if either a Category 2 SEI message with processing order 1 or a Category 3 SEI message with processing order 2 cannot be correctly processed by the decoding system, the decoding system will no longer apply the second processing order subchain, meaning the SEI message processing result of the second processing order subchain is empty. If either a Category 2 SEI message with processing order 3 or a Category 3 SEI message with processing order 5 cannot be correctly processed by the decoding system, the decoding system will no longer apply the third processing order subchain, meaning the SEI message processing result of the third processing order subchain is empty.

[0154] Example 4, as shown in Table 12, illustrates a fourth processing rule composed of subchain derivation rules and message processing rules.

[0155] Table 12

[0156] Here, the first preset category is the fourth category. "No longer applying this SEI message and all fourth-category SEI messages in its sub-chain" means that the SEI messages of the second category in the message processing rules corresponding to the second category, and the SEI messages of the first preset category in the processing order sub-chain to which the second-category SEI messages belong, are ignored. In this case, the second and fourth categories have a dependency relationship.

[0157] If multiple SEI messages are as shown in Table 7, and the first category SEI message with processing order 6 cannot be correctly processed by the decoding system, the processing of the processing order indication information is immediately terminated. That is, the decoding system no longer applies the entire processing chain corresponding to the SEI processing order indication information or sets the SEI message processing order list corresponding to the processing order indication information to empty.

[0158] If multiple SEI messages are as shown in Table 7, according to the fourth processing rule corresponding to the SEI message category in Table 11, since the second category SEI indicates the beginning of a sub-chain, as shown in Table 13, the second category SEI message with processing order 0 is the first processing order sub-chain, the two SEI messages with processing orders 1 and 2 are the second processing order sub-chain, and the SEI messages with processing orders 3, 4, and 5 are the third processing order sub-chain. Because the SEI message with processing order 6 is of the first category, this SEI message does not belong to any sub-chain, and its corresponding sub-chain index is 0.

[0159] Table 13

[0160] The first processing order subchain contains only the second category SEI message with a processing order of 0. If the payload type corresponding to this SEI message can be correctly processed by the decoding system, the processing result of the SEI message corresponding to the first processing order subchain includes the second category SEI message with a processing order of 0. If the message type corresponding to this SEI message cannot be correctly processed by the decoding system, the processing result of the SEI message corresponding to the first processing order subchain is empty according to the message processing rules corresponding to the second category SEI message. For the convenience of subsequent explanations, it is assumed here that the processing result of the SEI message corresponding to the first processing order subchain includes the second category SEI message with a processing order of 0.

[0161] The second processing order subchain contains the second category SEI message with processing order 1 and the third category SEI message with processing order 2. If the second category SEI message with processing order 1 can be correctly processed by the decoding system, and the third category SEI message with processing order 2 cannot be correctly processed by the decoding system, then according to the fourth processing rule, if the third category SEI message cannot be correctly processed by the decoding system, the third category SEI message is ignored. Therefore, the SEI message processing result corresponding to the second processing order subchain includes the second category SEI message with processing order 1.

[0162] The third processing order subchain contains SEI messages of the second category (processing order 3), SEI messages of the fourth category (processing order 4), and SEI messages of the third category (processing order 5). If the SEI message of the second category (processing order 3) cannot be correctly processed by the decoding system, according to the fourth processing rule, this SEI message and all fourth category messages in its subchain will no longer be applied; therefore, the decoding system will no longer apply the SEI message of the second category (processing order 3) or the SEI message of the fourth category (processing order 4). If the SEI message of the third category (processing order 5) can be correctly processed by the decoding system, then the SEI message processing result corresponding to the third processing order subchain only includes the SEI message of the third category (processing order 5).

[0163] The final SEI message processing order list includes: second-category SEI messages with processing order 0, second-category SEI messages with processing order 1, third-category SEI messages with processing order 5, and first-category SEI messages with processing order 6. Further, after determining the SEI message processing order list, the decoding system will sequentially apply the SEI messages in the SEI message processing order list, arranged in a non-decreasing processing order, to the decoded image associated with the SEI processing order indication information; these are the SEI messages to be processed.

[0164] Example 5, as shown in Table 14, illustrates a fifth processing rule composed of subchain derivation rules and message processing rules.

[0165] Table 14

[0166] It should be noted that the fifth processing rule can be combined with the second field in Method 2 above. In this case, the decoding system does not need to determine the processing order subchain through the subchain derivation rule, but rather through the second field. In this case, the second category of SEI messages can belong to either the first category of processing order subchain or the second category of processing order subchain. That is, the second category of SEI messages can belong to a processing order subchain (a subchain other than the preset processing order subchain), or they can belong to the preset processing order subchain or the subchain with subchain index 0, or they can be understood as not belonging to any subchain.

[0167] "No longer applying the SEI message and all fourth-category messages in its sub-chain" means that SEI messages of the second preset category in the processing order sub-chain to which the SEI message of the second category belongs in the message processing rules corresponding to the second category are ignored. In this case, the second preset category is the fourth category.

[0168] The subchain index corresponding to the second category SEI message with a processing order of 0 is 0. If this SEI message cannot be correctly processed by the decoding system, according to the fifth processing rule, the decoding system needs to ignore this SEI message and its subsequent SEI messages, that is, terminate the derivation of the SEI message processing order list corresponding to the SEI processing order indication information. Here, it is assumed that the second category SEI message with a processing order of 0 can be correctly processed by the decoding system. The rest of the process is the same as in Example 4, that is: the processing result of the SEI message corresponding to the first processing order subchain refers to the explanation in Example 4 for determining the second processing order subchain and the corresponding SEI message processing result.

[0169] In this example, the system further determines the processing order of the first category SEI message (processing order 6). If the first category SEI message with processing order 6 cannot be correctly processed by the decoding system, the decoding system will no longer apply the entire processing chain to which this SEI message belongs, and will set the SEI message processing order list corresponding to the processing order indication information to empty. Conversely, if the first category SEI message with processing order 6 can be correctly processed by the decoding system, the decoding system will add it to the corresponding SEI message processing order list according to the processing order. Here, it is assumed that the first category SEI message with processing order 6 can be correctly processed by the decoding system. Therefore, the SEI messages in the final SEI message processing order list obtained in this example also include: the second category SEI message with processing order 0, the second category SEI message with processing order 1, the third category SEI message with processing order 5, and the first category SEI message with processing order 6.

[0170] It should be noted that, according to the method in Example 4, the decoding system can first determine whether the processing order of the multiple SEI messages indicated by the SEI processing order indication message includes first-category SEI messages. When first-category SEI messages are included, the decoding system first determines that all first-category SEI messages can be processed correctly before further processing other SEI messages or SEI message sub-chains; otherwise, it directly terminates the processing flow of the SEI message processing chain indicated by the SPOSEI message.

[0171] The above are various examples of how subchain derivation rules and message processing rules constitute the processing rules for different categories of SEI messages. These are merely illustrative descriptions; the processing rules for different categories of SEI messages can also be other combinations of subchain derivation rules and message processing rules.

[0172] In some embodiments, referring to FIG2 and as shown in FIG5, in the above S202, dividing the processing order of multiple SEI messages into zero or more processing order sub-chains according to the SEI processing order indication information specifically includes: S501.

[0173] In S501, based on SEI message processing conditions and SEI processing order indication information, the processing order of multiple SEI messages is divided into zero or more processing order sub-chains.

[0174] Here, the SEI message processing conditions include at least one of the following: SEI messages of the third preset category are not included among the multiple SEI messages; or SEI messages of the third preset category among the multiple SEI messages are supported for processing. In some embodiments of this disclosure, SEI messages of the third preset category are ignored when they are not supported for processing by the decoding system, such as SEI messages of the first category. The following description will use the third preset category as an example of the first category.

[0175] In other words, the decoding system only determines the processing order subchain if SEI messages of the third preset category among multiple SEI messages are supported for processing, or if SEI messages of the third preset category are not included. This avoids the decoding system determining that multiple SEI messages are ignored after identifying zero or more processing order subchains, thus preventing redundant operations and improving the processing efficiency of the decoding system.

[0176] For example, before dividing the processing order of multiple SEI messages into zero or more processing order sub-chains based on SEI processing order indication information, the processability of key SEI messages (i.e., the aforementioned third preset category) in the processing order sub-chains can be determined first. If there are unprocessable key SEI messages, the SEI message processing result of the processing order sub-chain is determined according to the processing rules corresponding to the category of the key SEI message. Key category SEI messages can be at least one of the first category SEI messages, the second category SEI messages, and the third category SEI messages.

[0177] In some embodiments, as shown in FIG6, step one is to receive SEI processing sequence indication information.

[0178] Step 2: Determine whether the multiple SEI messages contain SEI messages of the first category.

[0179] Step 3: If SEI messages of category 1 are included, determine whether they can be processed. If they cannot be processed, terminate the subsequent steps; that is, all SEI messages are ignored.

[0180] Step 4: If SEI messages of the first category can be processed or if SEI messages of the first category are not included in the multiple SEI messages, determine zero or more processing order subchains based on the categories of the multiple SEI messages.

[0181] Step 5: Determine the SEI message processing result for each processing sequence subchain based on the category and processability of the SEI messages in the processing sequence subchain.

[0182] Step 6: Determine the SEI message processing order list corresponding to the SEI processing order indication information based on the SEI message processing results.

[0183] It should be noted that the embodiments disclosed herein do not limit the specific method for determining the SEI message processing list corresponding to the SEI processing order indication information based on the SEI message processing results of each processing order subchain. It can be that, following a non-decreasing processing order, each processing result corresponding to a processing order subchain is added to the SEI message processing list corresponding to the SEI processing order indication information, until all SEI messages that should be processed have been added to the SEI message processing list corresponding to the SEI processing order indication information. Alternatively, it can be a non-decreasing processing order where, after determining the processing result corresponding to each processing order subchain, all processing results are sequentially added to the SEI message processing list corresponding to the processing order indication information.

[0184] The final SEI message processing list should contain all SEI messages that the decoding system should execute, and the processing order of all SEI messages should be non-decreasing. This prevents situations where other SEI messages are processed only to be abandoned due to the unavailability of any first-category SEI message, thus improving processing efficiency.

[0185] In some embodiments, in the above examples, it can be determined whether a first category of SEI messages exists among the multiple SEI messages before dividing the multiple processing order subchains. Furthermore, if it is determined that a first category of SEI messages supports processing, it is not necessary to determine whether processing of that first category of SEI messages is supported in the subsequent process of determining the SEI messages to be processed.

[0186] The data processing method provided in this disclosure can be applied to the encoding system 102 in the communication system shown in FIG1. ​​FIG7 shows a flowchart of another data processing method, which includes the following S701.

[0187] In S701, SEI processing order indication information is sent. SEI processing order indication information is used to indicate the processing order of multiple SEI messages, so that the decoding system divides the processing order of multiple SEI messages into zero or more processing order sub-chains and determines the SEI messages to be processed in the zero or more processing order sub-chains.

[0188] Here, the SEI messages to be processed in zero or more processing order subchains are determined based on SEI processing order indication information and the processability of each SEI message; the processability of an SEI message is used to indicate whether an SEI message supports being processed.

[0189] Due to the limited processing capabilities of the decoding system, it may be unable to process (or unable to support processing) some SEI messages, meaning these SEI messages may be ignored, discarded, or not processed. Furthermore, these SEI messages may also cause other SEI messages within a set of multiple SEI messages, or the processing order of other SEI messages, to be ignored, discarded, or not processed. For example, if the second SEI message cannot be processed normally by the decoding system, the processing order of other SEI messages within a set of multiple SEI messages will also be ignored. However, in traditional methods, when the decoding system determines that the second SEI message also cannot be processed, it needs to ignore the 0th and 1st SEI messages. That is, the decoding system either does not process the 0th and 1st messages or cannot process the 0th and 1st messages in the preferred order indicated by the SEI processing order information, thereby reducing the quality of the decoded image. In addition, this method avoids situations where already processed SEI messages are determined to be in an order that needs to be ignored, thus improving processing efficiency.

[0190] In some embodiments, the encoding system may also determine the processing order and rules for multiple SEI messages associated with a video image. Then, SEI processing order indication information is determined based on the processing order and rules. Here, the SEI processing order indication information is used to indicate the category of the multiple SEI messages.

[0191] Multiple SEI messages associated with a video image refer to applying the information carried in multiple SEI messages to the decoding, display, or other related processes of the encoded video image. Multiple SEI messages are multiple different SEI messages, including but not limited to: SEI messages with different payload types, SEI messages with the same payload type but not identical message content, or SEI messages with different message categories, etc.

[0192] The encoding system can determine the processing order of multiple SEI messages associated with a video image based on the payload type of the SEI message, the information carried in the SEI message, the quality of the decoded and reconstructed image, the configuration file, and the terminal application settings.

[0193] Assuming that the preferred processing order of the seven SEI messages applied to the video image is determined in this embodiment of the disclosure, namely: SEI message A with processing order 0, SEI message B with processing order 1, SEI message C with processing order 2, SEI message D with processing order 3, SEI message E with processing order 4, SEI message F with processing order 5, and SEI message G with processing order 6.

[0194] The processing rules include at least one message processing rule corresponding to a message category and / or at least one sub-chain derivation rule corresponding to a message category. The processing rules can be any processing rule mentioned by the decoding system, or any combination of multiple processing rules.

[0195] The message processing rules within the processing rules are used to determine how to handle the message processing order list corresponding to the SEI processing order indication message when the decoding system cannot correctly process an SEI message of a certain message category. Furthermore, when an SEI message belongs to a processing order sub-chain, the message processing rules can also be used to determine the SEI message processing result based on the message category of the SEI message.

[0196] The subchain derivation rule in the processing rules is used to deduce whether each SEI message in the multiple SEI messages belongs to a certain subchain and to determine the subchain index of the processing order corresponding to each SEI message.

[0197] Taking the first processing rule on the decoding system side as an example, the first category of SEI messages and the second category of SEI messages are first determined according to the first processing rule of SEI messages. Here, the first category of SEI messages includes: SEI message G with a processing order of 6; the second category of SEI messages includes: SEI message A with a processing order of 0, SEI message B with a processing order of 1, and SEI message D with a processing order of 3.

[0198] Furthermore, as shown in Table 15, the encoding system determines the processing order subchain to which the above 7 SEI messages belong.

[0199] Table 15

[0200] According to the sub-chain derivation rule in the first processing rule, the encoding system sets the SEI message C with processing order 2 as the third category to indicate the end of the first processing order sub-chain, and sets the SEI message F with processing order 5 as the third category to indicate the end of the second processing order sub-chain.

[0201] In some embodiments, the SEI message category can be determined by a third field (po_sei_importance_idx) or by a combination of values ​​for two flags (po_sei_importance_flag and po_sei_processing_degree_flag). Therefore, the message category of each SEI message included in the SEI processing order indication information can be represented as shown in Tables 16 and 17. Here, poIdx[i] represents the order index information of the SEI message with processing order i in the SEI processing order indication message, i.e., po_sei_processing_order[poIdx[i]] = i.

[0202] Table 16

[0203] Table 17

[0204] In some embodiments, the SEI processing order indication message may also include one or more of the following information: the number of associated SEI messages, the type of associated SEI messages, the SEI message processing order subchain identifier, the SEI message processing order subchain index, and the SEI message encapsulation identifier.

[0205] In some embodiments, the encoding system may add the SEI processing order indication message to the encoded video stream and send it together with the decoding system, or send the SEI processing order indication message as a separate stream to the decoding system, or send the SEI processing order indication message to the decoding system in any other way.

[0206] It should be noted that other descriptions of the SEI processing order indication information can be found in the description on the decoding system side, and will not be repeated here in the embodiments disclosed herein.

[0207] It is understood that, in order to achieve the above-mentioned functions, the data processing apparatus includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should readily recognize that, based on the algorithmic steps of the examples described in conjunction with the embodiments of this disclosure, this disclosure can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this disclosure.

[0208] This disclosure embodiment can divide the data processing device into functional modules according to the above method embodiment. For example, each function can be divided into a separate functional module, or two or more functions can be integrated into one functional module. The integrated module can be implemented in hardware or software. It should be noted that the module division in this disclosure embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods. The following description uses the example of dividing each functional module according to each function.

[0209] Figure 8 is a schematic diagram of a communication device provided in an embodiment of this disclosure. The communication device can execute the data processing method provided in the above-described method embodiments. As shown in Figure 8, the communication device includes a receiving unit 801 and a processing unit 802.

[0210] The receiving unit 801 is used to receive supplementary enhancement information SEI processing order indication information, wherein the SEI processing order indication information is used to indicate the processing order of multiple SEI messages;

[0211] Processing unit 802 is used to divide the processing order of the plurality of SEI messages into zero or more processing order sub-chains according to the SEI processing order indication information.

[0212] The processing unit 802 is further configured to determine the SEI messages to be processed in the zero or more processing order sub-chains based on the SEI processing order indication information and the processability of each SEI message. The processability of the SEI message is used to indicate whether the SEI message supports being processed. Whether the SEI message supports being processed includes, but is not limited to, whether the payload type of the SEI message can be understood by the decoding system or whether the function indicated by the SEI message can be supported by the decoding system.

[0213] In some embodiments, SEI processing order indication information is used to indicate the category of each SEI message among the plurality of SEI messages.

[0214] In some embodiments, the processing unit 802 is specifically configured to: determine the message processing rules corresponding to the plurality of SEI messages based on the categories of the plurality of SEI messages;

[0215] Based on the message processing rules and processability of each SEI message among the multiple SEI messages, determine the SEI messages to be processed in the zero or more processing order sub-chains.

[0216] In some embodiments, the plurality of SEI messages include SEI messages of a first category, and the message processing rules corresponding to the first category of SEI messages include: if the decoding system does not support processing the first category of SEI messages, the plurality of SEI messages are ignored;

[0217] Alternatively, if the decoding system does not support processing the first type of SEI messages and the first type of SEI messages belong to a processing order subchain, the processing order subchain to which the first type of SEI messages belong is ignored.

[0218] In some embodiments, the plurality of SEI messages include SEI messages of a second category, and the message processing rules corresponding to the SEI messages of the second category include: when the decoding system does not support processing the SEI messages of the second category, the SEI messages to be processed include SEI messages that are processed before the SEI messages of the second category and that are supported by the decoding system.

[0219] Alternatively, if the decoding system does not support processing the second type of SEI messages, the processing order subchain to which the second type of SEI messages belong is ignored;

[0220] Alternatively, if the decoding system does not support processing SEI messages of the second category, the SEI messages of the second category and the SEI messages of the first preset category in the processing order subchain to which the SEI messages of the second category belong are ignored;

[0221] Alternatively, if the decoding system does not support processing the second category of SEI messages, the second preset category of SEI messages in the processing order subchain to which the second category of SEI messages belong is ignored;

[0222] Alternatively, if the SEI messages of the second category belong to a preset processing order subchain and the decoding system does not support processing the SEI messages of the second category, the SEI messages to be processed include SEI messages whose processing order is before the SEI messages of the second category among the plurality of SEI messages and which are supported by the decoding system, and SEI messages after the SEI messages of the second category are ignored.

[0223] In some embodiments, the plurality of SEI messages include a third category of SEI messages, and the message processing rules corresponding to the third category of SEI messages include: if the decoding system does not support the third category of SEI messages, the third category of SEI messages are ignored;

[0224] Alternatively, if the decoding system does not support the third category of SEI messages, the SEI messages between the third category of SEI messages and the target SEI message are ignored. The target SEI message is the SEI message that meets the preset conditions in the processing order subchain to which the third category of SEI messages belong.

[0225] Alternatively, if the decoding system does not support the third category of SEI messages, the processing order subchain to which the third category of SEI messages belong is ignored.

[0226] In some embodiments, the plurality of SEI messages include a fourth category of SEI messages, and the message processing rules corresponding to the fourth category of SEI messages include:

[0227] If the decoding system does not support the fourth category of SEI messages, the fourth category of SEI messages is ignored.

[0228] In some embodiments, the processing unit 802 is specifically configured to: determine the sub-chain derivation rules corresponding to the plurality of SEI messages based on the categories of the plurality of SEI messages;

[0229] Based on the sub-chain derivation rules corresponding to each SEI message in the plurality of SEI messages, the zero or more processing order sub-chains are determined.

[0230] In some embodiments, the plurality of SEI messages include SEI messages of a first category, wherein the subchain derivation rules of the first category include: the SEI messages of the first category belong to a preset processing order subchain, or the SEI messages of the first category belong to a processing order subchain.

[0231] In some embodiments, the plurality of SEI messages include a second category of SEI messages, the subchain derivation rule of the second category including: the second category of SEI messages belongs to a processing order subchain, or the second category of SEI messages belongs to the first SEI message of a processing order subchain.

[0232] In some embodiments, the plurality of SEI messages include SEI messages of a third category, wherein the subchain derivation rules of the third category include: the SEI messages of the third category belong to the last SEI message of a processing order subchain, or the SEI messages of the third category belong to a processing order subchain.

[0233] In some embodiments, the plurality of SEI messages include a fourth category of SEI messages, wherein the subchain derivation rule for the fourth category includes: the fourth category of SEI messages belongs to a processing order subchain.

[0234] In some embodiments, the SEI processing order indication information includes a first field, which is used to indicate the processing order subchain index of each SEI message among the plurality of SEI messages.

[0235] In some embodiments, the SEI processing order indication information includes a second field, wherein a first value of the second field is used to indicate that an SEI message belongs to a first type of processing order subchain, and a second value of the second field is used to indicate that an SEI message belongs to a second type of processing order subchain;

[0236] Specifically, at least one SEI message corresponding to a second field with a value of the first value belongs to a first type of processing order subchain; multiple SEI messages corresponding to a second field with consecutive values ​​of the second value belong to a second type of processing order subchain, or, one SEI message corresponding to a second field with a value of the second value belongs to a second type of processing order subchain; the values ​​of the second field corresponding to adjacent SEI messages of the one SEI message are all the first value; the first type of processing order subchain is a preset processing order subchain, and the second type of processing order subchain is a subchain other than the preset processing order subchain among the multiple processing order subchains.

[0237] In some embodiments, the SEI processing sequence indication information includes a fourth field, wherein a first value of the fourth field is used to indicate that an SEI message is the first processing stage of a processing sequence subchain, and a second value of the fourth field is used to indicate that an SEI message is not the first processing stage of a processing sequence subchain.

[0238] In some embodiments, the SEI processing sequence indication information includes a fifth field, wherein a first value of the fifth field is used to indicate that an SEI message is the final processing stage of a processing sequence subchain, and a second value of the fifth field is used to indicate that an SEI message is not the final processing stage of a processing sequence subchain.

[0239] In some embodiments, the SEI processing order indication information includes a third field, which indicates the category of each SEI message among the plurality of SEI messages.

[0240] In some embodiments, the third field includes an importance identifier and a processing level identifier.

[0241] In some embodiments, the processing unit 802 is specifically configured to: divide the processing order of the plurality of SEI messages into the zero or more processing order sub-chains based on the SEI message processing conditions and the SEI processing order indication information;

[0242] The SEI message processing conditions include at least one of the following: none of the plurality of SEI messages include a third preset category of SEI messages, or the third preset category of SEI messages among the plurality of SEI messages supports being processed.

[0243] Figure 9 is a schematic diagram of another communication device provided in an embodiment of this disclosure. The communication device can execute the data processing method provided in the above-described method embodiments. As shown in Figure 9, the communication device includes: a transmitting unit 901.

[0244] The sending unit 901 is used to send SEI processing order indication information, which indicates the processing order of multiple SEI messages, so that the decoding system divides the processing order of the multiple SEI messages into zero or more processing order sub-chains and determines the SEI messages to be processed in the zero or more processing order sub-chains; the SEI messages to be processed in the zero or more processing order sub-chains are determined based on the SEI processing order indication information and the processability of each SEI message; the processability of the SEI message is used to indicate whether the SEI message supports being processed.

[0245] In some embodiments, the SEI processing order indication information is used to indicate the category of each SEI message among the plurality of SEI messages.

[0246] In some embodiments, a type of SEI message corresponds to a message processing rule.

[0247] In some embodiments, the plurality of SEI messages include a first category of SEI messages, and the message processing rules corresponding to the first category of SEI messages include: if the decoding system does not support processing the first category of SEI messages, the plurality of SEI messages are ignored.

[0248] In some embodiments, the plurality of SEI messages include SEI messages of a second category, and the message processing rules corresponding to the SEI messages of the second category include: when the decoding system does not support processing the SEI messages of the second category, the SEI messages to be processed include SEI messages that are processed before the SEI messages of the second category and that are supported by the decoding system.

[0249] Alternatively, if the decoding system does not support processing the second type of SEI messages, the processing order subchain to which the second type of SEI messages belong is ignored;

[0250] Alternatively, if the decoding system does not support processing SEI messages of the second category, the SEI messages of the second category and the SEI messages of the first preset category in the processing order subchain to which the SEI messages of the second category belong are ignored;

[0251] Alternatively, if the decoding system does not support processing the second category of SEI messages, the second preset category of SEI messages in the processing order subchain to which the second category of SEI messages belong is ignored;

[0252] Alternatively, if the SEI messages of the second category belong to a preset processing order subchain and the decoding system does not support processing the SEI messages of the second category, the SEI messages to be processed include SEI messages whose processing order is before the SEI messages of the second category among the plurality of SEI messages and which are supported by the decoding system, and SEI messages after the SEI messages of the second category are ignored.

[0253] In some embodiments, the plurality of SEI messages include a third category of SEI messages, and the message processing rules corresponding to the third category of SEI messages include: if the decoding system does not support the third category of SEI messages, the third category of SEI messages are ignored;

[0254] Alternatively, if the decoding system does not support the third category of SEI messages, the SEI messages between the third category of SEI messages and the target SEI message are ignored. The target SEI message is the SEI message that meets the preset conditions in the processing order subchain to which the third category of SEI messages belong.

[0255] Alternatively, if the decoding system does not support the third category of SEI messages, the processing order subchain to which the third category of SEI messages belong is ignored.

[0256] In some embodiments, the plurality of SEI messages include a fourth category of SEI messages, and the message processing rules corresponding to the fourth category of SEI messages include:

[0257] If the decoding system does not support the fourth category of SEI messages, the fourth category of SEI messages is ignored.

[0258] In some embodiments, a type of SEI message corresponds to a subchain derivation rule.

[0259] In some embodiments, the plurality of SEI messages include SEI messages of a first category, wherein the subchain derivation rules of the first category include: the SEI messages of the first category belong to a preset processing order subchain, or the SEI messages of the first category belong to a processing order subchain.

[0260] In some embodiments, the plurality of SEI messages include a second category of SEI messages, the subchain derivation rule of the second category including: the second category of SEI messages belongs to a processing order subchain, or the second category of SEI messages belongs to the first SEI message of a processing order subchain.

[0261] In some embodiments, the plurality of SEI messages include a third category of SEI messages, wherein the subchain derivation rule for the third category includes: the third category of SEI messages belongs to the last SEI message of a processing order subchain.

[0262] In some embodiments, the plurality of SEI messages include a fourth category of SEI messages, wherein the subchain derivation rule for the fourth category includes: the fourth category of SEI messages belongs to a processing order subchain.

[0263] In some embodiments, the SEI processing order indication information includes a first field, which is used to indicate the processing order subchain index of each SEI message among the plurality of SEI messages.

[0264] In some embodiments, the SEI processing order indication information includes a second field, wherein a first value of the second field is used to indicate that an SEI message belongs to a first type of processing order subchain, and a second value of the second field is used to indicate that an SEI message belongs to a second type of processing order subchain;

[0265] Specifically, at least one SEI message corresponding to a second field with a value of the first value belongs to a first type of processing order subchain; multiple SEI messages corresponding to a second field with consecutive values ​​of the second value belong to a second type of processing order subchain, or, one SEI message corresponding to a second field with a value of the second value belongs to a second type of processing order subchain; the values ​​of the second field corresponding to adjacent SEI messages of the one SEI message are all the first value; the first type of processing order subchain is a preset processing order subchain, and the second type of processing order subchain is a subchain other than the preset processing order subchain among the multiple processing order subchains.

[0266] In some embodiments, the SEI processing sequence indication information includes a fourth field, wherein a first value of the fourth field is used to indicate that an SEI message is the first processing stage of a processing sequence subchain, and a second value of the fourth field is used to indicate that an SEI message is not the first processing stage of a processing sequence subchain.

[0267] In some embodiments, the SEI processing sequence indication information includes a fifth field, wherein a first value of the fifth field is used to indicate that an SEI message is the final processing stage of a processing sequence subchain, and a second value of the fifth field is used to indicate that an SEI message is not the final processing stage of a processing sequence subchain.

[0268] In some embodiments, the SEI processing order indication information includes a third field, which indicates the category of each SEI message among the plurality of SEI messages.

[0269] In some embodiments, the third field includes an importance identifier and a processing level identifier.

[0270] In the case of implementing the functions of the integrated modules described above in hardware, this disclosure provides another possible structure for the communication device involved in the above embodiments. As shown in FIG10, the communication device 100 includes: a processor 1002 and a bus 1004. For example, the communication device may also include a memory 1001; for example, the communication device may also include a communication interface 1003.

[0271] Processor 1002 may implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with embodiments of this disclosure. Processor 1002 may be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with embodiments of this disclosure. Processor 1002 may also be a combination of functions implementing computation, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.

[0272] Communication interface 1003 is used to connect with other devices via a communication network. This communication network can be Ethernet, wireless access network, wireless local area network (WLAN), etc.

[0273] The memory 1001 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, or electrically erasable programmable read-only memory (EEPROM), disk storage medium or other magnetic storage device, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but is not limited thereto.

[0274] In one possible implementation, the memory 1001 can exist independently of the processor 1002. The memory 1001 can be connected to the processor 1002 via a bus 1004 and is used to store instructions or program code. When the processor 1002 calls and executes the instructions or program code stored in the memory 1001, it can implement the data processing method provided in the embodiments of this disclosure.

[0275] In another possible implementation, the memory 1001 can also be integrated with the processor 1002.

[0276] Bus 1004 can be an extended industry standard architecture (EISA) bus, etc. Bus 1004 can be divided into address bus, data bus, control bus, etc. For ease of illustration, only one thick line is used to represent it in Figure 10, but this does not mean that there is only one bus or one type of bus.

[0277] Some embodiments of this disclosure provide a computer-readable storage medium (e.g., a non-transitory computer-readable storage medium) storing computer program instructions that, when executed on a computer, cause the computer to perform a data processing method as described in any of the above embodiments.

[0278] For example, the computer-readable storage media described above may include, but are not limited to: magnetic storage devices (e.g., hard disks, floppy disks, or magnetic tapes), optical disks (e.g., compact disks (CDs), digital versatile disks (DVDs), etc.), smart cards, and flash memory devices (e.g., erasable programmable read-only memory (EPROMs), cards, sticks, or key drives, etc.). The various computer-readable storage media described in this disclosure may represent one or more devices and / or other machine-readable storage media for storing information. The term "machine-readable storage medium" may include, but is not limited to, wireless channels and various other media capable of storing, containing, and / or carrying instructions and / or data.

[0279] This disclosure provides a computer program product containing instructions that, when run on a computer, cause the computer to perform the data processing method described in any of the above embodiments. The above descriptions are merely specific implementations of this disclosure, but the scope of protection of this disclosure is not limited thereto. Any variations or substitutions within the technical scope disclosed in this disclosure should be covered within the scope of protection of this disclosure. Therefore, the scope of protection of this disclosure should be determined by the scope of the claims.

Claims

1. A data processing method, wherein, The method includes: Receive supplementary enhancement information SEI processing order indication information, which is used to indicate the processing order of multiple SEI messages; Based on the SEI processing order indication information, the processing order of the multiple SEI messages is divided into zero or more processing order sub-chains; Based on the SEI processing order indication information and the processability of each SEI message, the SEI messages to be processed in the zero or more processing order sub-chains are determined, and the processability of the SEI message is used to indicate whether the SEI message supports being processed.

2. The method according to claim 1, characterized in that... in, The SEI processing order indication information is used to indicate the category of each SEI message among the plurality of SEI messages.

3. The method according to claim 2, wherein, One type of SEI message corresponds to one message processing rule; determining the SEI messages to be processed in the zero or more processing order sub-chains based on the SEI processing order indication information and the processability of each SEI message includes: The message processing rules corresponding to the multiple SEI messages are determined based on their categories. Based on the message processing rules and processability of each SEI message among the multiple SEI messages, determine the SEI messages to be processed in the zero or more processing order sub-chains.

4. The method according to claim 3, wherein, The plurality of SEI messages include SEI messages of a first category, and the message processing rules corresponding to the first category of SEI messages include: if the decoding system does not support processing the first category of SEI messages, the plurality of SEI messages are ignored; Alternatively, if the decoding system does not support processing the first type of SEI messages and the first type of SEI messages belong to a processing order subchain, the processing order subchain to which the first type of SEI messages belong is ignored.

5. The method according to claim 3, wherein, The plurality of SEI messages include SEI messages of the second category. The message processing rules corresponding to the SEI messages of the second category include: when the decoding system does not support processing the SEI messages of the second category, the SEI messages to be processed include SEI messages that are processed before the SEI messages of the second category and that are supported by the decoding system. Alternatively, if the decoding system does not support processing the second type of SEI messages, the processing order subchain to which the second type of SEI messages belong is ignored; Alternatively, if the decoding system does not support processing SEI messages of the second category, the SEI messages of the second category and the SEI messages of the first preset category in the processing order subchain to which the SEI messages of the second category belong are ignored; Alternatively, if the decoding system does not support processing the second category of SEI messages, the second preset category of SEI messages in the processing order subchain to which the second category of SEI messages belong is ignored; Alternatively, if the SEI messages of the second category belong to a preset processing order subchain and the decoding system does not support processing the SEI messages of the second category, the SEI messages to be processed include SEI messages that are processed before the SEI messages of the second category and that are supported by the decoding system.

6. The method according to claim 3, wherein, The plurality of SEI messages include a third category of SEI messages, and the message processing rules corresponding to the third category of SEI messages include: if the decoding system does not support the third category of SEI messages, the third category of SEI messages are ignored; Alternatively, if the decoding system does not support the third category of SEI messages, the SEI messages between the third category of SEI messages and the target SEI message are ignored. The target SEI message is the SEI message that meets the preset conditions in the processing order subchain to which the third category of SEI messages belong. Alternatively, if the decoding system does not support the third category of SEI messages, the processing order subchain to which the third category of SEI messages belong is ignored.

7. The method according to claim 3, wherein, The multiple SEI messages include a fourth category of SEI messages, and the message processing rules corresponding to the fourth category of SEI messages include: If the decoding system does not support the fourth category of SEI messages, the fourth category of SEI messages is ignored.

8. The method according to claim 2, wherein, One type of SEI message corresponds to one subchain derivation rule. The step of dividing the processing order of the multiple SEI messages into zero or more processing order subchains based on the SEI processing order indication information includes: The subchain derivation rules corresponding to the multiple SEI messages are determined based on their categories. Based on the sub-chain derivation rules corresponding to each SEI message in the plurality of SEI messages, the zero or more processing order sub-chains are determined.

9. The method according to claim 8, wherein, The plurality of SEI messages include SEI messages of a first category, and the subchain derivation rules of the first category include: the SEI messages of the first category belong to a preset processing order subchain, or the SEI messages of the first category belong to a processing order subchain.

10. The method according to claim 8, wherein, The plurality of SEI messages include a second category of SEI messages, and the subchain derivation rules for the second category include: the second category of SEI messages belongs to a processing order subchain, or the second category of SEI messages belongs to the first SEI message of a processing order subchain.

11. The method according to claim 8, wherein, The plurality of SEI messages include SEI messages of a third category, and the subchain derivation rules of the third category include: the SEI messages of the third category belong to the last SEI message of a processing order subchain, or the SEI messages of the third category belong to a processing order subchain.

12. The method according to claim 8, wherein, The multiple SEI messages include a fourth category of SEI messages, and the subchain derivation rule for the fourth category is that the SEI messages of the fourth category belong to a processing order subchain.

13. The method according to claim 1, wherein, The SEI processing order indication information includes a first field, which is used to indicate the sub-chain index of the processing order of each SEI message in the plurality of SEI messages.

14. The method according to claim 1, wherein, The SEI processing order indication information includes a second field. The first value of the second field is used to indicate that an SEI message belongs to a first type of processing order subchain, and the second value of the second field is used to indicate that an SEI message belongs to a second type of processing order subchain. Specifically, at least one SEI message corresponding to a second field with a value of the first value belongs to a first type of processing order subchain; multiple SEI messages corresponding to a second field with consecutive values ​​of the second value belong to a second type of processing order subchain, or, one SEI message corresponding to a second field with a value of the second value belongs to a second type of processing order subchain; the values ​​of the second field corresponding to adjacent SEI messages of the one SEI message are all the first value; the first type of processing order subchain is a preset processing order subchain, and the second type of processing order subchain is a subchain other than the preset processing order subchain among the multiple processing order subchains.

15. The method according to claim 2, wherein, The SEI processing order indication information includes a third field, which is used to indicate the category of each SEI message among the plurality of SEI messages.

16. The method according to claim 15, wherein, The third field includes an importance indicator and a processing level indicator.

17. The method according to claim 1, wherein, The SEI processing sequence indication information includes a fourth field. The first value of the fourth field is used to indicate that an SEI message is the first processing stage of a processing sequence subchain, and the second value of the fourth field is used to indicate that an SEI message is not the first processing stage of a processing sequence subchain.

18. The method according to claim 1, wherein, The SEI processing order indication information includes a fifth field. The first value of the fifth field is used to indicate that an SEI message is the final processing stage of a processing order subchain, and the second value of the fifth field is used to indicate that an SEI message is not the final processing stage of a processing order subchain.

19. The method according to claim 1, wherein, The step of dividing the processing order of the multiple SEI messages into zero or more processing order sub-chains according to the SEI processing order indication information includes: Based on the SEI message processing conditions and the SEI processing order indication information, the processing order of the multiple SEI messages is divided into zero or more processing order sub-chains; The SEI message processing conditions include at least one of the following: none of the plurality of SEI messages include a third preset category of SEI messages, or the third preset category of SEI messages among the plurality of SEI messages supports being processed.

20. A data processing method, wherein, The method includes: SEI processing order indication information is sent, which is used to indicate the processing order of multiple SEI messages, so that the decoding system divides the processing order of the multiple SEI messages into zero or more processing order sub-chains, and determines the SEI messages to be processed in the zero or more processing order sub-chains; the SEI messages to be processed in the zero or more processing order sub-chains are determined based on the SEI processing order indication information and the processability of each SEI message; the processability of the SEI message is used to indicate whether the SEI message supports being processed.

21. The method according to claim 20, wherein, The SEI processing order indication information is used to indicate the category of each SEI message among the plurality of SEI messages.

22. The method according to claim 21, wherein, One type of SEI message corresponds to one message processing rule.

23. The method according to claim 22, wherein, The plurality of SEI messages include SEI messages of a first category, and the message processing rules corresponding to the first category of SEI messages include: if the decoding system does not support processing the first category of SEI messages, the plurality of SEI messages are ignored; Alternatively, if the decoding system does not support processing the first type of SEI messages and the first type of SEI messages belong to a processing order subchain, the processing order subchain to which the first type of SEI messages belong is ignored.

24. The method according to claim 22, wherein, The plurality of SEI messages include SEI messages of the second category. The message processing rules corresponding to the SEI messages of the second category include: when the decoding system does not support processing the SEI messages of the second category, the SEI messages to be processed include SEI messages that are processed before the SEI messages of the second category and that are supported by the decoding system. Alternatively, if the decoding system does not support processing the second type of SEI messages, the processing order subchain to which the second type of SEI messages belong is ignored; Alternatively, if the decoding system does not support processing SEI messages of the second category, the SEI messages of the second category and the SEI messages of the first preset category in the processing order subchain to which the SEI messages of the second category belong are ignored; Alternatively, if the decoding system does not support processing the second category of SEI messages, the second preset category of SEI messages in the processing order subchain to which the second category of SEI messages belong is ignored; Alternatively, if the SEI messages of the second category belong to a preset processing order subchain and the decoding system does not support processing the SEI messages of the second category, the SEI messages of the second category and the SEI messages following the SEI messages of the second category are ignored.

25. The method according to claim 22, wherein, The plurality of SEI messages include a third category of SEI messages, and the message processing rules corresponding to the third category of SEI messages include: if the decoding system does not support the third category of SEI messages, the third category of SEI messages are ignored; Alternatively, if the decoding system does not support the third category of SEI messages, the SEI messages between the third category of SEI messages and the target SEI message are ignored. The target SEI message is the SEI message that meets the preset conditions in the processing order subchain to which the third category of SEI messages belong. Alternatively, if the decoding system does not support the third category of SEI messages, the processing order subchain to which the third category of SEI messages belong is ignored.

26. The method according to claim 22, wherein, The multiple SEI messages are categorized into a fourth category, and the message processing rules corresponding to the SEI messages in the fourth category include: If the decoding system does not support the fourth category of SEI messages, the fourth category of SEI messages is ignored.

27. The method according to claim 21, wherein, One type of SEI message corresponds to one subchain derivation rule.

28. The method according to claim 27, wherein, The plurality of SEI messages include SEI messages of a first category, and the subchain derivation rules of the first category include: the SEI messages of the first category belong to a preset processing order subchain, or the SEI messages of the first category belong to a processing order subchain.

29. The method according to claim 27, wherein, The plurality of SEI messages include a second category of SEI messages, and the subchain derivation rules for the second category include: the second category of SEI messages belongs to a processing order subchain, or the second category of SEI messages belongs to the first SEI message of a processing order subchain.

30. The method according to claim 27, wherein, The plurality of SEI messages include a third category of SEI messages, and the subchain derivation rule for the third category is that the third category of SEI messages belongs to the last SEI message of a processing order subchain.

31. The method according to claim 25, wherein, The multiple SEI messages include a fourth category of SEI messages, and the subchain derivation rule for the fourth category is that the SEI messages of the fourth category belong to a processing order subchain.

32. A communication device, comprising: Memory and processor; The memory and the processor are coupled; The memory is used to store instructions that the processor can execute; When the processor executes the instructions, it performs the method as described in any one of claims 1-31.

33. A computer-readable storage medium, wherein, The computer-readable storage medium includes a non-transitory computer-readable storage medium on which computer instructions are stored, which, when executed on a computer, cause the computer to perform the method as described in any one of claims 1-31.

34. A computer program product, wherein, The computer program product includes computing technology program instructions that, when executed by a processor, implement the method as described in any one of claims 1-31.

Images