Message processing type indication method, communication apparatus and storage medium

Abstract

Provided in the present disclosure are a message processing type indication method, a communication apparatus and a storage medium. The method is applied to a second node, and comprises: receiving a first supplemental enhancement information (SEI) message; acquiring processing type indication information of the first SEI message; and determining a processing type of the first SEI message on the basis of the processing type indication information.

Description

Indication method of message processing type, communication device and storage medium

[0001] The present application claims priority to the Chinese patent application No. 202411046034.4, filed on July 31, 2024, the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0002] The present disclosure relates to the field of communication, and in particular, to an indication method of message processing type, a communication device and a storage medium. BACKGROUND

[0003] In the field of digital video coding, bitstream is a series of bits used to transmit video image data. The encoder compresses the video image data through the encoding process to form a bitstream, so as to reduce the data volume and improve the transmission efficiency. The decoder recovers and reconstructs the video image data from the received bitstream through the decoding process. In this process, the supplemental enhancement information (SEI) message as part of the bitstream is an important auxiliary message. The SEI message can play an auxiliary role in decoding, display or other related processes by providing additional data or instructions, thereby enhancing the quality of video content and user experience. SUMMARY

[0004] The present disclosure provides an indication method of message processing type, a communication device and a storage medium.

[0005] In a first aspect, an indication method of message processing type is provided, applied to a first node. The method comprises: obtaining a first supplemental enhancement information (SEI) message; determining a processing type of the first SEI message; generating processing type indication information of the first SEI message based on the processing type; and sending the processing type indication information to a second node.

[0006] In a second aspect, an indication method of message processing type is provided, applied to a second node. The method comprises: receiving a first SEI message; obtaining processing type indication information of the first SEI message; and determining a processing type of the first SEI message based on the processing type indication information.

[0007] In a third aspect, an indication device of message processing type is provided, applied to a first node. The device comprises an obtaining module, a determining module, a generating module and a sending module.

[0008] The obtaining module is configured to obtain a first SEI message.

[0009] The determination module is used to determine the processing type of the first SEI message.

[0010] The generation module is used to generate processing type indication information for the first SEI message based on the processing type.

[0011] The sending module is used to send processing type indication information to the second node.

[0012] Fourthly, a message processing type indication device is provided, applied to a second node. The device includes a receiving module, an acquisition module, and a determining module.

[0013] The receiving module is used to receive the first SEI message.

[0014] The acquisition module is used to obtain the processing type indication information of the first SEI message.

[0015] The determination module is used to determine the processing type of the first SEI message based on the processing type indication information.

[0016] Fifthly, a communication device is provided. The communication device includes a memory and a processor. The memory and the processor are coupled; the memory stores instructions executable by the processor; when the processor executes the instructions, it implements the aforementioned message processing type instruction method.

[0017] Sixthly, a computer-readable storage medium is provided. The computer-readable storage medium stores computer program instructions. When the computer program instructions are executed on an electronic device, the electronic device performs the aforementioned message processing type of instruction method.

[0018] In a seventh aspect, a computer program product is provided. The computer program product includes computer program instructions. When the computer program instructions are executed on an electronic device, the electronic device performs the aforementioned message processing type instruction method. Attached Figure Description

[0019] To more clearly illustrate the technical solutions in this disclosure, the accompanying drawings used in some embodiments of this disclosure will be briefly introduced below. However, the accompanying drawings described below are only drawings of some embodiments of this disclosure, and those skilled in the art can obtain other drawings based on these drawings.

[0020] Figure 1 is a schematic diagram of a communication system according to some embodiments;

[0021] Figure 2 is a flowchart of a message processing type indication method according to some embodiments;

[0022] Figure 3 is a flowchart of an indication method for another message processing type according to some embodiments;

[0023] Figure 4 is a flowchart of another message processing type indication method according to some embodiments;

[0024] Figure 5 is a flowchart of an indication method for another message processing type according to some embodiments;

[0025] Figure 6 is a flowchart of an indication method for another message processing type according to some embodiments;

[0026] Figure 7 is a flowchart of another message processing type indication method according to some embodiments;

[0027] Figure 8 is a flowchart of an indication method for another message processing type according to some embodiments;

[0028] Figure 9 is a flowchart of an indication method for another message processing type according to some embodiments;

[0029] Figure 10 is a flowchart of an indication method for another message processing type according to some embodiments;

[0030] Figure 11 is a flowchart of an indication method for another message processing type according to some embodiments;

[0031] Figure 12 is a block diagram of a message processing type indication device according to some embodiments;

[0032] Figure 13 is a block diagram of an indication device for another type of message processing according to some embodiments;

[0033] Figure 14 is a block diagram of a communication device according to some embodiments. Detailed Implementation

[0034] The technical solutions of this disclosure will now be clearly and completely described with reference to the accompanying drawings. However, the described embodiments are only some embodiments of this disclosure, and not all embodiments. Based on the embodiments of this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure.

[0035] It should be noted that in this disclosure, the words "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplarily" or "for example" in this disclosure should not be construed as being more preferred or advantageous than other embodiments or designs. Specifically, the use of the words "exemplarily" or "for example" is intended to present the relevant concepts by way of example.

[0036] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature.

[0037] In the description of this disclosure, unless otherwise stated, " / " means "or," for example, A / B can mean A or B. "And / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist; for example, A and / or B can represent three cases: only A, only B, and A and B. Furthermore, "at least one" means one or more, and "more than" means two or more.

[0038] To facilitate understanding, we will first briefly introduce some of the relevant concepts involved in the embodiments of this disclosure.

[0039] 1. Bitstream.

[0040] A bitstream is a series of bits used to transmit video image data. The bitstream can be transmitted between an encoder and a decoder. The encoder compresses video image data into a bitstream through an encoding process, and the decoder recovers and reconstructs the video image data from the bitstream through a decoding process. To ensure that the bitstream formed after video image data compression and encoding by the encoder can be correctly decoded by different decoders, standards organizations typically develop corresponding video codec standards to guide the encoding process of the encoder and the decoding process of the decoder. In the H.26x series of video codec standards developed by the Joint Video Expert Team (JVET) of the International Telecommunication Union-telecommunication Standardization Sector (ITU-T) and the International Organization for Standardization / International Electrotechnical Commission (ISO / IEC), the bitstream is a series of bits in the form of a Network Abstract Layer (NAL) Unit Stream or Byte Stream, forming a sequence of Access Units (AUs) for one or more Coding Video Sequences (CVS).

[0041] 2. Supplemental Enhancement Information (SEI) message.

[0042] SEI messages are a feature of the H.26x series of video codec standards. They provide a way to add information to the video stream (or video image stream), and their main purpose is to play an auxiliary role in decoding, display or other related processes.

[0043] The above is an introduction to some of the concepts involved in some embodiments of this disclosure, which will not be repeated below.

[0044] The methods provided in some embodiments of this disclosure can be applied to scenarios where multiple communication systems coexist. These communication systems can be fourth-generation (4G) communication systems, fifth-generation (5G) communication systems, wireless Fidelity (Wi-Fi) systems, third-generation partnership project (3GPP) related communication systems, future evolution communication systems (such as sixth-generation (6G) communication systems), or systems integrating multiple systems, etc., and this disclosure does not limit them.

[0045] In some embodiments of this disclosure, the network architecture of a communication network (including but not limited to 3G, 4G, 5G, and future mobile communication networks) may include at least a first node and a second node. In this embodiment, the first node may be a device for encoding a video stream (e.g., including but not limited to an encoder), and the second node may be a device for decoding a video stream (e.g., including but not limited to a decoder).

[0046] For example, taking the first node as an encoder and the second node as a decoder, as shown in Figure 1, a communication system provided in some embodiments of this disclosure includes an encoder 110 and a decoder 120. The encoder 110 and the decoder 120 are communicatively connected.

[0047] In some embodiments, there may be one or more encoders 110 and one or more decoders 120. This disclosure does not limit the number of encoders 110 and decoders 120.

[0048] Encoder 110 is used to compress and encode video image data to obtain the bitstream corresponding to the video image data, and then send the bitstream to decoder 120.

[0049] In some embodiments, encoder 110 adds SEI messages to the bitstream so that decoder 120 can perform related operations on the video image data to be decoded based on the SEI messages.

[0050] In some embodiments, encoder 110 may also indicate the processing type of the SEI message when transmitting the bitstream, so that decoder 120 can correctly process the SEI message based on the processing type of the SEI message. For example, encoder 110 may determine the processing type corresponding to the SEI message based on the actual use of the SEI message for the video image data, and indicate the processing type of the SEI message when transmitting the bitstream.

[0051] In some embodiments, encoder 110 may further determine the processing type of the SEI message if it is determined that the SEI message is a composite type SEI message, and add processing type indication information indicating the processing type of the SEI message to the bitstream.

[0052] For example, encoder 110 adds processing type indication information of the SEI message to the bitstream, including: encoder 110 adding processing type indication information to the SEI message; or, encoder 110 adding processing type indication information to the processing order message corresponding to the SEI message; or, encoder 110 adding processing type indication information to both the SEI message and the processing order message corresponding to the SEI message. For example, the processing order message includes at least one of: SEI Processing Order (SPO) SEI message or Processing Order Nesting (PON) SEI message.

[0053] Decoder 120 is used to receive the bitstream sent by encoder 110, decode the bitstream, and then obtain video image data.

[0054] In some embodiments, the bitstream includes an SEI message and processing type indication information indicating the processing type of the SEI message. Decoder 120 can determine the processing type indication information of the SEI message and determine the processing type of the SEI message based on the processing type indication information; alternatively, in the case of a composite type SEI message, decoder 120 determines the processing type indication information of the SEI message and determines the processing type of the SEI message based on the processing type indication information.

[0055] In some embodiments, the processing type indication information is located in at least one of the SEI message or the processing order message corresponding to the SEI message.

[0056] It should be noted that the above scenarios are for the purpose of more clearly illustrating the technical solutions of some embodiments of this disclosure, and do not constitute a limitation on the technical solutions provided by some embodiments of this disclosure. Those skilled in the art will understand that, with the evolution of system architecture and the emergence of new business scenarios, the technical solutions provided by some embodiments of this disclosure are also applicable to similar technical problems.

[0057] In communication systems, as the number of SEI message types defined in related technologies increases, the different processing orders of different types of SEI messages can lead to varying qualities of the final decoded video image or different video viewing experiences for users. To address this issue, related technologies propose adding a new SEI message type: the processing order message. The processing order message can indicate the processing order among multiple SEI messages of the same or different types. Processing order messages include at least one of SEI Processing Order (SPO) SEI messages or Processing Order Nesting (PON) SEI messages. Related technologies also add a processing flag (po_sei_process_flag) to the processing order message to indicate whether the SEI message corresponding to the processing flag involves a processing operation. For example, if po_sei_process_flag[i] = 1 for the i-th SEI message in the SPO message, then the i-th SEI message is of the Process type, and the decoder needs to perform corresponding operations on the video image data according to the SEI message of this Process type. Conversely, if the po_sei_process_flag[i] of the i-th SEI message in the SPOSEI message is 0, then the i-th SEI message is of property type. The decoder can obtain information about manipulating the video image data based on the property type SEI message. However, the decoder does not directly process the video image data by processing this SEI message. Property type SEI messages typically need to be used in conjunction with at least one process type SEI message to achieve the desired processing effect on the decoded image.

[0058] However, in practical applications, most SEI messages are processed in a single way, that is, an SEI message is either of type property or type process. Only a portion of SEI messages are composite types. Therefore, it is unnecessary to add indication information to all SEI messages. If indication information is added to all SEI messages to indicate their processing type, the indication method is not flexible enough, which may increase the redundancy of the bitstream, thereby affecting the encoding efficiency and causing a waste of bandwidth resources.

[0059] To address the aforementioned issues, some embodiments of this disclosure provide a method for indicating message processing types, which at least solves the problem that in related technologies, it is common practice to add indication information to all SEI messages to indicate their processing type. This method is not flexible enough, may increase redundancy in the bitstream, thereby affecting encoding efficiency and wasting bandwidth resources.

[0060] Figure 2 is a flowchart of a message processing type indication method according to some embodiments. As shown in Figure 2, the message processing type indication method provided in some embodiments of this disclosure is applied to a first node, including the following steps (S101-S104):

[0061] In S101, the first SEI message is obtained.

[0062] In some embodiments, when the first node needs to send video image data to the second node, it can determine the corresponding first SEI message based on the video image data to be encoded.

[0063] Based on the actual use of SEI messages for video image data, the first node determines the processing type corresponding to the SEI message and indicates the processing type of the SEI message when sending the bitstream.

[0064] In S102, the processing type of the first SEI message is determined.

[0065] In some embodiments, step S102 may include: determining the processing type of the first SEI message if the first SEI message is a composite type SEI message.

[0066] Understandably, the first node can first determine whether the first SEI message is a composite type SEI message, and if it is determined that the first SEI message is a composite type SEI message, it can determine the processing type of the first SEI message based on the actual use of the first SEI message for video image data.

[0067] In some embodiments, when the first SEI message is a composite type SEI message, the first SEI message satisfies at least one of the following a1 to a6:

[0068] a1. The type information corresponding to the first SEI message indicates that the first SEI message is a composite type SEI message.

[0069] a2. The first SEI message includes a first preset identifier, which is used to indicate that the first SEI message is a composite type SEI message.

[0070] a3. The processing order message corresponding to the first SEI message contains the first preset identifier.

[0071] In some embodiments, when a first preset identifier exists, the first node can determine that the first SEI message is a composite type SEI message based on the first preset identifier corresponding to the first SEI message. For example, the first preset identifier can be included in the first SEI message or in a processing order message that indicates the processing order of the first SEI message.

[0072] a4. Processing sequential messages includes the second SEI message.

[0073] a5. The processing order message includes a second SEI message, and the processing order of the second SEI message is the same as that of the first SEI message.

[0074] For example, if the first SEI message is located in an SPOSEI message or a PON SEI message, and the SPOSEI message or PON SEI message contains a second SEI message, and the processing order of the second SEI message is the same as the processing order of the first SEI message, then the first SEI message is a composite type SEI message.

[0075] a6. The pre-configuration information indicates that the first SEI message is a composite type SEI message.

[0076] For example, the pre-configuration information can be a pre-configured list of composite SEI messages. If the pre-configured list of composite SEI messages includes a first SEI message, then the first SEI message is a composite SEI message.

[0077] It is understood that the methods provided in some embodiments of this disclosure have diverse conditions for identifying composite types of SEI messages, which enhances the adaptability and identification accuracy of some embodiments of this disclosure to different types of SEI messages, and ensures that SEI messages can be correctly identified and processed in various situations.

[0078] In some embodiments, the type information includes at least one of the following: payload type and the name of the first SEI message. That is, the type information can be any one or more of the name of the first SEI message and the payload type.

[0079] In some embodiments, the type of an SEI message can be determined based on the payload type. For example, if the payload type is 213, it indicates that the SEI message is an SPOSEI message. If the payload type is 214, it indicates that the SEI message is a PON SEI message.

[0080] It is understood that the methods provided in some embodiments of this disclosure provide richer information for the identification of SEI messages by incorporating the payload type and the name of the SEI message into the type information, which can adapt to different SEI message types and enhance the adaptability of the method.

[0081] In some embodiments, when the type information indicates that the first SEI message is a composite type SEI message, the type information satisfies at least one of the following b1 to b3:

[0082] b1. The SEI message list for composite types contains type information.

[0083] For example, if the type information of the first SEI message is included in the list of composite type SEI messages, then the first SEI message is a composite type SEI message.

[0084] b2. The SEI message list for any processing type does not contain type information.

[0085] For example, if the type information of the first SEI message is not included in the SEI message list for any processing type, the first SEI message is a composite type SEI message. For example, if the processing type of the SEI message includes both property and process types, and the type information of the first SEI message is neither included in the property type list nor in the process type list, then the first SEI message is determined to be a composite type SEI message.

[0086] b3. The SEI message list for at least two processing types contains type information.

[0087] For example, if the type information of the first SEI message is included in the SEI message list of more than one processing type, the first SEI message is a composite type SEI message. For example, if the type information of the first SEI message is included in both the property type list and the process type list, then the first SEI message can also be determined to be a composite type SEI message.

[0088] It is understood that the methods provided in some embodiments of this disclosure refine the identification method for determining that the first SEI message is a composite type SEI message based on type information, thereby improving the accuracy of determining that the first SEI message is a composite type SEI message based on type information, and thus improving the stability of the processing type indication.

[0089] In S103, processing type indication information for the first SEI message is generated based on the processing type.

[0090] In some embodiments, different message types may correspond to different processing types. The first node determines the processing type of the first SEI message based on its message type, and can then generate processing type indication information for the first SEI message based on the processing type. For example, if the first SEI message is a composite type SEI message, the first node can generate processing type indication information corresponding to the composite type based on the composite type.

[0091] In some embodiments, processing type indication information is located in at least one of the first SEI message or the processing order message corresponding to the first SEI message. The processing order message is used to indicate the processing order of at least two SEI messages, including the first SEI message. For example, the processing order message includes at least one of a SPOSEI message or a PON SEI message.

[0092] It should be noted that the location of the processing type indication information described above is merely an example given in some embodiments of this disclosure. In actual implementation, other methods may exist to indicate the processing type of SEI messages. For example, the indication could be placed in the file encapsulation of the bitstream, or based on the parameter set corresponding to the bitstream. This disclosure does not limit this approach.

[0093] It is understood that in the methods provided in some embodiments of this disclosure, the encoding position of the processing type indication information is relatively flexible; that is, the processing type indication information can be located in either the first SEI message or the processing sequence message. The first node can select the optimal encoding method based on the actual application scenario, thereby improving encoding efficiency and bandwidth utilization.

[0094] In some embodiments, the processing type indication information includes a processing type identifier. For example, the processing type identifier can be either `process_type_flag` or `process_flag`. For example, the processing type identifier can be a Boolean identifier or an enumerated identifier.

[0095] In some embodiments, the processing type identifier is located in at least one of the first SEI message or the processing sequence message corresponding to the first SEI message.

[0096] In some embodiments, the processing type indication information includes a preset syntax element, and the processing type corresponding to the preset syntax element is the processing type of the first SEI message. That is, the preset syntax element can correspond to a certain processing type in the composite type, and the processing type of the first SEI message can be determined based on the preset syntax element.

[0097] It is understood that in some embodiments of this disclosure, the processing type indication information may include both a processing type identifier and a preset syntax element. That is, the processing type indication information may indicate the processing type of the first SEI message in different forms, which increases the flexibility of indicating the processing type of the first SEI message and improves the recognition efficiency of the second node for the processing type of the first SEI message, thereby improving the reliability and decoding efficiency of the method.

[0098] In S104, a processing type indication message is sent to the second node.

[0099] In some embodiments, the first node encodes the video image data, and after obtaining the bitstream, it can add the processing type indication information of the first SEI message to the bitstream and send the bitstream to the second node.

[0100] It is understandable that not all SEI messages require additional processing type information. If an SEI message is not a composite type, its processing type can be determined by its message type (e.g., Payload Type). In this case, the message type can be considered as the generated processing type indication information, since the SEI message itself contains the message type, thus eliminating the need for additional indication information. Compared to related technologies that typically add processing type identifiers to all SEI messages to indicate their processing type, potentially increasing bitstream redundancy and affecting encoding efficiency while wasting bandwidth resources, the method provided in some embodiments of this disclosure, when determining that the first SEI message is a composite type, determines the processing type of the SEI message and generates processing type indication information for the first SEI message. This reduces bitstream redundancy, improves encoding efficiency, and reduces bandwidth resource waste. Furthermore, the method provided in some embodiments of this disclosure, by sending processing type indication information to the second node, ensures that the second node can accurately identify the processing type of the first SEI message, avoiding processing errors caused by ambiguous types and improving the decoding quality and efficiency of the second node.

[0101] In some embodiments, as shown in FIG3, the above step S103 may include: step S201 and step S202.

[0102] In S201, the first value corresponding to the processing type is determined.

[0103] In some embodiments, the first value of the processing type indicator information is different for different processing types. For example, when the processing type of the first SEI message (assuming the first SEI message is the i-th SEI message in the processing sequence message) is process type, the first value of the processing type indicator information po_sei_process_flag[i] in the processing sequence message is 1; when the processing type of the first SEI message (assuming the first SEI message is the i-th SEI message in the processing sequence message) is property type, the first value of the processing type indicator information po_sei_process_flag[i] is 0.

[0104] In S202, based on the first value, processing type indication information is generated in the processing sequence message.

[0105] In one example, the message structure for processing sequential messages is shown in Table 1 below.

[0106] Table 1

[0107] sei_processing_order indicates that the processing order message is a SPOSEI message, payloadSize is the payload, po_id and po_num_sei_messages_minus2 are syntax elements in the processing order message, complex_type_msg indicates a complex type SEI message, and po_sei_process_flag[i] is the processing type indicator information.

[0108] As shown in Table 1 above, when the `complex_type_msg` condition is true, meaning the i-th SEI message is a complex type message, the processing type indicator `po_sei_process_flag[i]` can indicate the processing type of the i-th SEI message. For example, when `po_sei_process_flag[i]` is 1, the processing type of the i-th SEI message is `process`; when `po_sei_process_flag[i]` is 0, the processing type of the i-th SEI message is `property`. Based on the first value, the first node can generate the processing type indicator and its corresponding value in the message structure of the processing sequence message. When the `complex_type_msg` condition is not true, meaning the i-th SEI message is not a complex type message, the processing type indicator can be indicated by a preset syntax element in the i-th SEI message or by the message type of the i-th SEI message.

[0109] It should be noted that Table 1 above uses the SPOSEI message as an example to illustrate the message structure for processing sequential messages, but the above message structure example and processing method are also applicable to PON SEI messages, and will not be repeated here.

[0110] In another example, the message structure for processing sequential messages is shown in Table 2 below.

[0111] Table 2

[0112] sei_processing_order indicates that the processing order message is an SPOSEI message, payloadSize is the payload, po_id and po_num_sei_messages_minus2 are syntax elements in the processing order message, complex_type_msg indicates a complex type SEI message, and po_sei_process_type[i] is the processing type indicator information.

[0113] As shown in Table 2 above, when the condition `complex_type_msg` is true, i.e., the i-th SEI message is a complex type message, the processing type indicator information `po_sei_process_type[i]` can indicate the processing type of the i-th SEI message. Based on the first value, the first node can generate the processing type indicator information and its corresponding value in the message structure of the processing sequence message.

[0114] It should be noted that Table 2 above uses the SPOSEI message as an example to illustrate the message structure for processing sequential messages, but the above message structure example and processing method are also applicable to PON SEI messages, and will not be repeated here.

[0115] For example, the correspondence between the values ​​of the processing type indicator information po_sei_process_type[i] and the processing type can be shown in Table 3 below.

[0116] Table 3

[0117] As shown in Table 3 above, different values ​​of po_sei_process_type[i] correspond to different processing types. Table 3 is only an example of the correspondence between the value of the processing type indication information po_sei_process_type[i] and the processing type given in some embodiments of this disclosure. In actual applications, the correspondence between the value of the processing type indication information po_sei_process_type[i] and the processing type may also be different based on different actual needs. This disclosure does not limit this.

[0118] It is understood that in the methods provided in some embodiments of this disclosure, by determining the value of the processing type indication information and generating the processing type indication information in the processing order message, the second node can sequentially parse the processing type indication information after receiving the processing order message, thereby ensuring that the second node correctly processes the first SEI message.

[0119] In some embodiments, as shown in FIG4, the above step S103 may include: step S301 and step S302.

[0120] In S301, the second value corresponding to the processing type is determined.

[0121] In some embodiments, the second value of the processing type indicator information is different for different processing types. For example, when the processing type of the first SEI message is process, the second value of the processing type indicator information sei_process_flag in the first SEI message is 1; when the processing type of the first SEI message is property, the second value of the processing type indicator information sei_process_flag[i] is 0.

[0122] In S302, based on the second value, processing type indication information is generated in the first SEI message.

[0123] In one example, the message structure of the first SEI message (taking the film grain characteristics SEI message as an example) is shown in Table 4 below.

[0124] Table 4

[0125] The first SEI message's message type (Payload Type) is "film grain characteristic," and its payload size is the actual payload. The processing type indicator information `fg_sei_process_flag` in the first SEI message indicates the processing type of this film grain characteristic type. For example, when `fg_sei_process_flag` is 1, the processing type of this film grain characteristic type first SEI message is "process"; when `fg_sei_process_flag` is 0, the processing type is "property." Based on this second value, the first node can generate the processing type indicator information and its corresponding value within the message structure of the first SEI message.

[0126] It should be noted that the above description only uses the film_grain_charactersitic SEI message as an example to illustrate the processing type indication information. In actual implementation, the film_grain_charactersitic SEI message can be any processing type SEI message that has been defined in the relevant technology or will be defined in the future, or it can be any composite type SEI message.

[0127] It should be noted that the above embodiments are merely examples of the correspondence between the value of the processing type indicator information fg_sei_process_flag and the processing type. In practical applications, the correspondence between the value of the processing type indicator information fg_sei_process_flag and the processing type may also be different based on different actual needs, and this disclosure does not limit this.

[0128] In each example, process_flag can be replaced with process_type.

[0129] It is understood that in the methods provided in some embodiments of this disclosure, by determining the value of the processing type indication information and generating the processing type indication information in the first SEI message, it is helpful for the second node to sequentially parse the processing type indication information after receiving the processing order message, thereby ensuring that the second node correctly processes the first SEI message.

[0130] Furthermore, in the methods provided in some embodiments of this disclosure, the processing type indication information can be included in the first SEI message, which reduces the dependence on the processing order message, reduces the complexity of the second node's message processing, accelerates the decoding speed of the second node, and improves the real-time processing capability of the second node.

[0131] Figure 5 is a flowchart of a message processing type indication method according to some embodiments. As shown in Figure 5, the message processing type indication method provided in some embodiments of this disclosure is applied to a second node, including the following steps (S401-S403):

[0132] In S401, the first SEI message is received.

[0133] In some embodiments, the second node can receive a bitstream sent by the first node, the bitstream containing a first SEI message, and the second node can process the video image data based on the first SEI message.

[0134] In S402, the processing type indication information of the first SEI message is obtained.

[0135] In some embodiments, step S402 may include: if it is confirmed that the first SEI message is a composite type SEI message, obtaining the processing type indication information of the first SEI message.

[0136] In some embodiments, the processing type indication information is located in at least one of the first SEI message or the processing order message corresponding to the first SEI message; the processing order message is used to indicate the processing order of at least two SEI messages, including the first SEI message.

[0137] It is understood that in the methods provided in some embodiments of this disclosure, the encoding position of the processing type indication information is relatively flexible. That is, the processing type indication information can be located in the first SEI message or in the processing sequence message. The first node can select the optimal encoding method based on the actual application scenario, thereby improving encoding efficiency and bandwidth utilization.

[0138] In some embodiments, the processing type indication information is at least one of a processing type identifier or a preset syntax element; the processing type corresponding to the preset syntax element is the processing type of the first SEI message.

[0139] It is understood that in some embodiments of this disclosure, the processing type indication information may include both a processing type identifier and a preset syntax element. That is, the processing type indication information may indicate the processing type of the first SEI message in different forms, which increases the flexibility of indicating the processing type of the first SEI message and improves the recognition efficiency of the second node for the processing type of the first SEI message, thereby improving the reliability and decoding efficiency of the method.

[0140] In some embodiments, when the first SEI message is a composite type SEI message, the first SEI message satisfies at least one of the following:

[0141] The type information corresponding to the first SEI message indicates that the first SEI message is a composite type SEI message;

[0142] The first SEI message includes a first preset identifier, which is used to indicate that the first SEI message is a composite type SEI message;

[0143] The processing order message corresponding to the first SEI message contains a first preset identifier;

[0144] The processing sequence message includes a second SEI message;

[0145] The processing order message includes a second SEI message, and the processing order of the second SEI message is the same as that of the first SEI message; or

[0146] The pre-configuration information indicates that the first SEI message is a composite type SEI message.

[0147] In some embodiments, the content of the processing type indication information can be referred to the description in step S102 above, and will not be repeated here.

[0148] In some embodiments, when the type information indicates that the first SEI message is a composite type SEI message, the type information satisfies at least one of the following:

[0149] The SEI message list for composite types contains type information;

[0150] The SEI message list for any processing type does not contain type information; or

[0151] The SEI message list for at least two processing types contains type information.

[0152] In some embodiments, the type information includes at least one of the following: payload type, name of the first SEI message.

[0153] In some embodiments, the content of the type information can be referred to the description in step S102 above, and will not be repeated here.

[0154] In S403, the processing type of the first SEI message is determined based on the processing type indication information.

[0155] In some examples, when the processing type indication information is a processing type identifier, the second node can determine the processing type of the first SEI message based on the value of the processing type identifier.

[0156] In other examples, when the processing type indicator information is a preset syntax element, the second node can determine the processing type of the first SEI message based on the processing type corresponding to the preset syntax element.

[0157] It is understandable that not all SEI messages require additional processing type information. If an SEI message is not a composite type, its processing type can be determined by the message type (e.g., Payload Type). In this case, the message type can be considered as the generated processing type indication information, since the SEI message itself contains the message type, and therefore no additional indication information is needed. In the methods provided in some embodiments of this disclosure, the second node receives the first SEI message and, if it determines that the first SEI message is a composite type SEI message, obtains the processing type indication information of the first SEI message. This simplifies the decoding logic of the second node and reduces the complexity and computational burden when processing messages. Furthermore, by determining the processing type of the first SEI message based on the processing type indication information, the second node can ensure that it correctly processes composite type first SEI messages, avoiding processing errors caused by ambiguity in the type, and improving the decoding quality and efficiency of the second node.

[0158] In some embodiments, when the processing type indication information is located in the processing order message, as shown in FIG6, the above step S403 may include: step S501 and step S502.

[0159] In S501, the first value corresponding to the processing type indication information in the processing sequence message is determined.

[0160] In some embodiments, the second node may determine the processing type indication information in the processing sequence message and the first value corresponding to the processing type indication information based on the message structure of the processing sequence message.

[0161] In S502, the processing type of the first SEI message is determined based on the first value.

[0162] In some embodiments, the first value of the processing type indication information is different for different processing types. For example, if the first value of the processing type indication information in the processing sequence message is 1, then the processing type of the first SEI message can be of type process; if the first value of the processing type indication information in the processing sequence message is 0, then the processing type of the first SEI message can be of type property.

[0163] It should be noted that the above correspondence between the first value and the processing type is only an example given in some embodiments of this disclosure. In actual implementation, the correspondence between the first value and the processing type may be different based on different actual needs and designs. This disclosure does not limit this.

[0164] It is understood that in the methods provided in some embodiments of this disclosure, the second node determines the value of the processing type indication information, which helps the second node determine the processing type of the first SEI message based on the value of the processing type indication information, thereby ensuring that the second node correctly processes the first SEI message.

[0165] In some embodiments, when the processing type indication information is located in the first SEI message, as shown in FIG7, the above step S403 may include: step S601 and step S602.

[0166] In S601, the second value corresponding to the processing type indication information in the first SEI message is determined.

[0167] In some embodiments, the second node may determine the processing type indication information in the first SEI message and the second value corresponding to the processing type indication information based on the message structure of the first SEI message.

[0168] In S602, the processing type of the first SEI message is determined based on the second value.

[0169] In some embodiments, the second value of the processing type indication information is different for different processing types. For example, if the second value of the processing type indication information in the first SEI message is 1, the processing type of the first SEI message can be the process type; if the second value of the processing type indication information in the first SEI message is 0, the processing type of the first SEI message can be the property type.

[0170] It should be noted that the above-mentioned correspondence between the second value and the processing type is only an example given in some embodiments of this disclosure. In actual implementation, the correspondence between the second value and the processing type may be different based on different actual needs and designs, and this disclosure does not limit it.

[0171] It is understood that in the methods provided in some embodiments of this disclosure, the second node determines the value of the processing type indication information, which helps the second node determine the processing type of the first SEI message based on the value of the processing type indication information, thereby ensuring that the second node correctly processes the first SEI message.

[0172] Furthermore, in the methods provided in some embodiments of this disclosure, the processing type indication information can be included in the first SEI message, which reduces the dependence on the processing order message, reduces the complexity of the second node's message processing, accelerates the decoding speed of the second node, and improves the real-time processing capability of the second node.

[0173] In some embodiments, when the processing type indication information is located in the processing order message, as shown in FIG8, the above step S403 may include: step S701.

[0174] In S701, when processing sequential messages including SEI messages of composite types, the processing type of the first SEI message is determined based on the processing type indication information.

[0175] In some embodiments, when the processing sequence message includes a second preset identifier and the value of the second preset identifier is a third value, the processing sequence message includes a composite type SEI message.

[0176] For example, the message structure for processing sequential messages is shown in Table 5 below.

[0177] Table 5

[0178] As shown in Table 5 above, `sei_processing_order` indicates that the processing order message is an SPOSEI message, `payloadSize` is the payload, `po_id` and `po_num_sei_messages_minus2` are syntax elements in the processing order message, and the second preset flag `po_complex_sei_present_flag` can indicate whether there are composite type SEI messages among the SEI messages included in the processing order message. For example, when the value of the second preset flag `po_complex_sei_present_flag` is the third value, the processing order message includes composite type SEI messages. For example, the third value can be 1, that is, if the third value of the second preset flag `po_complex_sei_present_flag` is 1, it indicates that there are composite type SEI messages; if the third value is 0, it indicates that there are no composite type SEI messages.

[0179] In some embodiments, when processing sequential messages including SEI messages of composite types, the second node can determine the processing type of the i-th SEI message (e.g., the i-th SEI message is the first SEI message) based on the processing type indication information po_sei_process_flag[i]. For example, when the value of po_sei_process_flag[i] is 1, the processing type of the i-th SEI message is of type process; when the value of po_sei_process_flag[i] is 0, the processing type of the i-th SEI message is of type property.

[0180] It should be noted that Table 5 above is only an example. In actual implementation, the second node (decoder) receives the data generated by the first node (encoder).

[0181] In some embodiments, referring to the above embodiments, po_sei_process_flag[i] can also be replaced with po_sei_process_type[i].

[0182] In some embodiments, the message structure for processing sequential messages may also be as shown in Table 6 below.

[0183] Table 6

[0184] In the message structure of the processing order messages shown in Table 6 above, the if condition has been expanded to include `complex_type_msg`. That is, the processing type (po_sei_process_type[i]) of the i-th SEI message will only be set if both `po_complex_sei_present_flag` and the i-th SEI message are `complex_type_msg`. Here, `complex_type_msg` represents a complex type SEI message.

[0185] As shown in Table 6 above, `sei_processing_order` indicates that the processing order message is an SPOSEI message, `payloadSize` is the payload, `po_id` and `po_num_sei_messages_minus2` are syntax elements in the processing order message, and the second preset flag `po_complex_sei_present_flag` can indicate whether there are composite type SEI messages among the SEI messages included in the processing order message. For example, when the value of the second preset flag `po_complex_sei_present_flag` is the third value, the processing order message includes composite type SEI messages. For example, the third value can be 1, that is, if the third value of the second preset flag `po_complex_sei_present_flag` is 1, it indicates that there are composite type SEI messages; if the third value is 0, it indicates that there are no composite type SEI messages.

[0186] In some embodiments, when processing sequential messages including SEI messages of composite types, the second node can determine the processing type of the i-th SEI message (e.g., the i-th SEI message is the first SEI message) based on the processing type indication information po_sei_process_type[i]. For example, when the value of po_sei_process_type[i] is 1, the processing type of the i-th SEI message is of type process; when the value of po_sei_process_type[i] is 0, the processing type of the i-th SEI message is of type property.

[0187] In some embodiments, referring to the above embodiments, po_sei_process_type[i] can also be replaced with po_sei_process_flag[i].

[0188] For ease of understanding, the following examples further illustrate the message processing type indication methods provided in some embodiments of this disclosure.

[0189] Example 1: A message processing type indication method on the decoder side, applied to an apparatus for decoding a video stream. For example, as shown in Figure 9, the method includes the following steps (Sa1~Sa4):

[0190] In step Sa1, the SEI message is obtained.

[0191] For example, the decoder can obtain SEI messages and the type information corresponding to the SEI messages from the bitstream sent by the encoder.

[0192] In step Sa2, the SEI message is determined to be a composite type SEI message.

[0193] In step Sa3, the processing type indication information of the SEI message is determined.

[0194] In step Sa4, the processing type of the SEI message is determined based on the processing type indication information.

[0195] In one example, when the processing type indication information includes a processing type identifier, the decoder can determine the processing type of the SEI message based on the processing type corresponding to the processing type identifier.

[0196] In another example, when the processing type identifier includes a preset syntax element, the decoder can also determine the processing type of the SEI message based on the processing type corresponding to the preset syntax element.

[0197] Example 2: A method for indicating the message processing type on the decoder side, applied to an apparatus for decoding a video stream. For example, as shown in Figure 10, the method includes the following steps (Sb1~Sb5):

[0198] In step Sb1, the processing order message corresponding to the SEI message is determined.

[0199] In step Sb2, it is determined that the processing sequence message contains a composite type SEI message.

[0200] In some embodiments, when at least one composite type SEI message exists among the SEI messages contained in the processing sequence message, it can be determined that the processing sequence message contains a composite type SEI message.

[0201] In step Sb3, the composite type SEI message in the processing sequence message is determined.

[0202] In step Sb4, the processing type of the composite SEI message is determined.

[0203] In step Sb5, the processing order of the composite type of SEI message is determined based on the processing type of the composite type of SEI message.

[0204] In some embodiments, when a processing order message contains at least two SEI messages with the same processing order, and the SEI messages with the same processing order include a composite type SEI message, if the composite type SEI message is of type process and the other SEI message with the same processing order has a processing type of property, then the processing order of the composite type SEI message is placed after the other SEI message with the same processing order. That is, when a processing order message contains at least two SEI messages with the same processing order, the SEI message of type property is processed first.

[0205] Example 3: A method for indicating a message processing type on the encoder side, applied to an apparatus for encoding a video stream. For example, as shown in Figure 11, the method includes the following steps (Sc1~Sc3):

[0206] In step Sc1, the SEI message and its processing type are determined.

[0207] In some embodiments, the encoder may first determine that the SEI message is a composite type SEI message, and then further determine its corresponding processing type.

[0208] In step Sc2, the processing type indication information of the SEI message is determined based on the processing type.

[0209] In step Sc3, the processing type indication information of the SEI message is added to the bitstream.

[0210] In some embodiments, adding processing type indication information to the bitstream can be done by including the processing type indication information in the SEI message or by including the processing type indication information in the processing order message (SPOSEI message or PON SEI message) corresponding to the SEI message.

[0211] It is understandable that, compared to the related technologies that add processing type indication information to all types of SEI messages, which may lead to bitstream redundancy, affect encoding and decoding efficiency, and affect bandwidth utilization, the method provided in some embodiments of this disclosure only adds processing type indication information to composite SEI messages when it is determined that the SEI message is a composite type SEI message. This reduces bitstream redundancy, improves encoding and decoding efficiency, and improves bandwidth utilization.

[0212] The foregoing primarily describes the solutions of some embodiments of this disclosure from a methodological perspective. It is understood that, in order to achieve the aforementioned functions, the message processing type indication device includes at least one of the hardware structures and software modules corresponding to the execution of each function. Those skilled in the art should readily recognize that, in conjunction with the units and algorithm steps of the various examples described in the embodiments disclosed herein, some embodiments of this disclosure can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of some embodiments of this disclosure.

[0213] Some embodiments of this disclosure can divide the message processing type indication device into functional modules according to the above method embodiments. For example, each function can be divided into a separate functional module, or two or more functions can be integrated into one functional module. The integrated module can be implemented in hardware or software. It should be noted that the module division in some embodiments of this disclosure is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods. The following description uses the example of dividing each functional module according to each function.

[0214] Figure 12 is a block diagram of a message processing type indication device according to some embodiments. This message processing type indication device is applied to a first node and can execute the message processing type indication method provided in the above-described method embodiments. As shown in Figure 12, the message processing type indication device 200 includes: an acquisition module 201, a determination module 202, a generation module 203, and a sending module 204.

[0215] The acquisition module 201 is used to acquire the first SEI message.

[0216] The determination module 202 is used to determine the processing type of the first SEI message.

[0217] The generation module 203 is used to generate processing type indication information for the first SEI message based on the processing type.

[0218] The sending module 204 is used to send processing type indication information to the second node.

[0219] In some embodiments, the determining module 202 is configured to determine the processing type of the first SEI message when the first SEI message is a composite type SEI message.

[0220] In some embodiments, the processing type indication information is located in at least one of the first SEI message or the processing order message corresponding to the first SEI message; the processing order message is used to indicate the processing order of at least two SEI messages, including the first SEI message.

[0221] In some embodiments, the processing type indication information includes at least one of a processing type identifier or a preset syntax element; the processing type corresponding to the preset syntax element is the processing type of the first SEI message.

[0222] In some embodiments, the generation module 203 is used to determine a first value corresponding to the processing type; and based on the first value, to generate processing type indication information in the processing sequence message.

[0223] In some embodiments, the generation module 203 is used to determine a second value corresponding to the processing type; and based on the second value, to generate processing type indication information in the first SEI message.

[0224] In some embodiments, when the first SEI message is a composite type SEI message, the first SEI message satisfies at least one of the following:

[0225] The type information corresponding to the first SEI message indicates that the first SEI message is a composite type SEI message;

[0226] The first SEI message includes a first preset identifier, which is used to indicate that the first SEI message is a composite type SEI message;

[0227] The processing order message corresponding to the first SEI message contains a first preset identifier;

[0228] The processing sequence message includes a second SEI message;

[0229] The processing order message includes a second SEI message, and the processing order of the second SEI message is the same as that of the first SEI message; or

[0230] The pre-configuration information indicates that the first SEI message is a composite type SEI message.

[0231] In some embodiments, when the type information indicates that the first SEI message is a composite type SEI message, the type information satisfies at least one of the following:

[0232] The SEI message list for composite types contains type information;

[0233] The SEI message list for any processing type does not contain type information; or

[0234] The SEI message list for at least two processing types contains type information.

[0235] In some embodiments, the type information includes at least one of the following: payload type, name of the first SEI message.

[0236] Figure 13 is a block diagram of an indication device for another message processing type according to some embodiments. This indication device for the message processing type is applied to a second node and can execute the message processing type indication method provided in the above method embodiments. As shown in Figure 13, the message processing type indication device 300 includes: a receiving module 301, an acquisition module 302, and a determining module 303.

[0237] The receiving module 301 is used to receive the first SEI message.

[0238] The acquisition module 302 is used to acquire the processing type indication information of the first SEI message.

[0239] The determination module 303 is used to determine the processing type of the first SEI message based on the processing type indication information.

[0240] In some embodiments, the acquisition module 302 is configured to acquire processing type indication information of the first SEI message when it is determined that the first SEI message is a composite type SEI message.

[0241] In some embodiments, the processing type indication information is located in at least one of the first SEI message or the processing order message corresponding to the first SEI message; the processing order message is used to indicate the processing order of at least two SEI messages, including the first SEI message.

[0242] In some embodiments, the processing type indication information is at least one of a processing type identifier or a preset syntax element; the processing type corresponding to the preset syntax element is the processing type of the first SEI message.

[0243] In some embodiments, when the processing type indication information is located in the processing sequence message, the determining module 303 is used to determine a first value corresponding to the processing type indication information in the processing sequence message; and based on the first value, to determine the processing type of the first SEI message.

[0244] In some embodiments, when the processing type indication information is located in the first SEI message, the determining module 303 is used to determine a second value corresponding to the processing type indication information in the first SEI message based on the processing type indication information; and to determine the processing type of the first SEI message based on the second value.

[0245] In some embodiments, when the processing type indication information is located in the processing sequence message, the determining module 303 is used to determine the processing type of the first SEI message based on the processing type indication information when the processing sequence message includes a composite type SEI message.

[0246] In some embodiments, when the processing sequence message includes a second preset identifier and the value of the second preset identifier is a third value, the processing sequence message includes a composite type SEI message.

[0247] In some embodiments, when the first SEI message is a composite type SEI message, the first SEI message satisfies at least one of the following:

[0248] The type information corresponding to the first SEI message indicates that the first SEI message is a composite type SEI message;

[0249] The first SEI message includes a first preset identifier, which is used to indicate that the first SEI message is a composite type SEI message;

[0250] The processing order message corresponding to the first SEI message contains a first preset identifier;

[0251] The processing sequence message includes a second SEI message;

[0252] The processing order message includes a second SEI message, and the processing order of the second SEI message is the same as that of the first SEI message; or

[0253] The pre-configuration information indicates that the first SEI message is a composite type SEI message.

[0254] In some embodiments, when the type information indicates that the first SEI message is a composite type SEI message, the type information satisfies at least one of the following:

[0255] The SEI message list for composite types contains type information;

[0256] The SEI message list for any processing type does not contain type information; or

[0257] The SEI message list for at least two processing types contains type information.

[0258] In some embodiments, the type information includes at least one of the following: payload type, name of the first SEI message.

[0259] In the case of implementing the functions of the integrated modules described above in hardware, some embodiments of this disclosure provide a block diagram of the communication device involved in the above embodiments. As shown in FIG14, the communication device 400 includes: a processor 402 and a bus 404. For example, the communication device 400 may also include a memory 401; for example, the communication device 400 may also include a communication interface 403.

[0260] Processor 402 may implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with some embodiments of this disclosure. Processor 402 may be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. Processor 402 may implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with some embodiments of this disclosure. Processor 402 may also be a combination that implements computing functions, such as including one or more microprocessor combinations, a combination of a digital signal processor (DSP) and a microprocessor, etc.

[0261] Communication interface 403 is used to connect to other devices via a communication network. This communication network can be Ethernet, wireless access network, wireless local area network (WLAN), etc.

[0262] The memory 401 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, or electrically erasable programmable read-only memory (EEPROM), disk storage media or other magnetic storage devices, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but is not limited thereto.

[0263] In some embodiments, the memory 401 may exist independently of the processor 402. The memory 401 may be connected to the processor 402 via a bus 404 and is used to store instructions or program code. When the processor 402 calls and executes the instructions or program code stored in the memory 401, it can implement the message processing type indication method provided in some embodiments of this disclosure.

[0264] In some embodiments, the memory 401 may also be integrated with the processor 402. The bus 404 may be an Extended Industry Standard Architecture (EISA) bus, etc. The bus 404 can be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is used in Figure 14, but this does not indicate that there is only one bus or one type of bus.

[0265] Some embodiments of this disclosure provide a computer-readable storage medium (e.g., a non-transitory computer-readable storage medium) storing computer program instructions that, when executed on a computer, cause the computer to perform a message processing type instruction method as described in any of the above embodiments.

[0266] For example, the aforementioned computer-readable storage media may include, but are not limited to: magnetic storage devices (e.g., hard disks, floppy disks, or magnetic tapes), optical disks (e.g., compact disks (CDs), digital versatile disks (DVDs), etc.), smart cards, and flash memory devices (e.g., erasable programmable read-only memory (EPROMs), cards, sticks, or key drives, etc.). The various computer-readable storage media described in this disclosure may represent at least one of one or more devices or other machine-readable storage media for storing information. The term "machine-readable storage medium" may include, but is not limited to, wireless channels and various other media capable of storing, containing, and / or carrying at least one of instructions or data.

[0267] This disclosure provides a computer program product containing instructions that, when run on a computer, cause the computer to perform a message processing type instruction method according to any of the above embodiments.

[0268] The above are merely specific embodiments of this disclosure, but the scope of protection of this disclosure is not limited thereto. Any changes or substitutions within the technical scope disclosed in this disclosure should be included within the scope of protection of this disclosure. Therefore, the scope of protection of this disclosure should be determined by the scope of the claims.

Claims

1. A method for indicating a message processing type, applied to a first node, the method comprising: Obtain the first Supplemental Enhancement Information (SEI) message; Determine the processing type of the first SEI message; Based on the processing type, generate processing type indication information for the first SEI message; as well as Send the processing type indication information to the second node.

2. The method according to claim 1, wherein, Determining the processing type of the first SEI message includes: If the first SEI message is a composite type SEI message, determine the processing type of the first SEI message.

3. The method according to claim 1, wherein, The processing type indication information is located in at least one of the first SEI message or the processing order message corresponding to the first SEI message; the processing order message is used to indicate the processing order of at least two SEI messages, including the first SEI message.

4. The method according to claim 3, wherein, The processing type indication information includes at least one of a processing type identifier or a preset syntax element; the processing type corresponding to the preset syntax element is the processing type of the first SEI message.

5. The method according to claim 3, wherein, The step of generating processing type indication information for the first SEI message based on the processing type includes: Determine the first value corresponding to the processing type; and Based on the first value, the processing type indication information is generated in the processing order message.

6. The method according to claim 3, wherein, The step of generating processing type indication information for the first SEI message based on the processing type includes: Determine the second value corresponding to the processing type; and Based on the second value, the processing type indication information is generated in the first SEI message.

7. The method according to claim 2, wherein, When the first SEI message is a composite type SEI message, the first SEI message satisfies at least one of the following: The type information corresponding to the first SEI message indicates that the first SEI message is a composite type SEI message; The first SEI message includes a first preset identifier, which is used to indicate that the first SEI message is a composite type SEI message; The processing order message corresponding to the first SEI message includes the first preset identifier; The processing order message includes a second SEI message; The processing order message includes the second SEI message, and the processing order of the second SEI message is the same as that of the first SEI message; or The pre-configuration information indicates that the first SEI message is a composite type SEI message.

8. The method according to claim 7, wherein, When the type information indicates that the first SEI message is an SEI message of the composite type, the type information satisfies at least one of the following: The SEI message list for composite types contains the type information; The SEI message list for any processing type does not contain the type information; or The SEI message list for at least two processing types contains the type information.

9. The method according to claim 7, wherein, The type information includes at least one of the following: payload type, and the name of the first SEI message.

10. A method for indicating a message processing type, applied to a second node, the method comprising: Receive the first SEI message; Obtain the processing type indication information of the first SEI message; as well as Based on the processing type indication information, the processing type of the first SEI message is determined.

11. The method according to claim 10, wherein, The step of obtaining the processing type indication information of the first SEI message includes: If it is determined that the first SEI message is a composite type SEI message, the processing type indication information of the first SEI message is obtained.

12. The method according to claim 10, wherein, The processing type indication information is located in at least one of the first SEI message or the processing order message corresponding to the first SEI message; the processing order message is used to indicate the processing order of at least two SEI messages, including the first SEI message.

13. The method according to claim 12, wherein, The processing type indication information is at least one of a processing type identifier or a preset syntax element; the processing type corresponding to the preset syntax element is the processing type of the first SEI message.

14. The method according to claim 12, wherein, When the processing type indication information is located in the processing order message, determining the processing type of the first SEI message based on the processing type indication information includes: Determine the first value corresponding to the processing type indication information in the processing sequence message; and Based on the first value, the processing type of the first SEI message is determined.

15. The method according to claim 12, wherein, When the processing type indication information is located in the first SEI message, determining the processing type of the first SEI message based on the processing type indication information includes: Determine the second value corresponding to the processing type indication information in the first SEI message; and Based on the second value, the processing type of the first SEI message is determined.

16. The method according to claim 12, wherein, When the processing type indication information is located in the processing order message, determining the processing type of the first SEI message based on the processing type indication information includes: In the case where the processing order message includes a composite type SEI message, the processing type of the first SEI message is determined based on the processing type indication information.

17. The method according to claim 16, wherein, When the processing order message contains a second preset identifier, and the value of the second preset identifier is a third value, the processing order message includes the composite type SEI message.

18. The method according to claim 11, wherein, When the first SEI message is a composite type SEI message, the first SEI message satisfies at least one of the following: The type information corresponding to the first SEI message indicates that the first SEI message is a composite type SEI message; The first SEI message includes a first preset identifier, which is used to indicate that the first SEI message is a composite type SEI message; The processing order message corresponding to the first SEI message includes the first preset identifier; The processing order message includes a second SEI message; The processing order message includes the second SEI message, and the processing order of the second SEI message is the same as that of the first SEI message; or The pre-configuration information indicates that the first SEI message is a composite type SEI message.

19. The method according to claim 18, wherein, When the type information indicates that the first SEI message is an SEI message of the composite type, the type information satisfies at least one of the following: The type information is included in the SEI message list for composite types; The SEI message list for any processing type does not contain the type information; or The SEI message list for at least two processing types contains the type information.

20. The method according to claim 18, wherein, The type information includes at least one of the following: payload type, and the name of the first SEI message.

21. A communication device, comprising: Memory and processor; The memory and the processor are coupled; The memory is used to store instructions that can be executed by the processor; When the processor executes the instructions, it performs the method according to any one of claims 1 to 20.

22. A computer-readable storage medium, wherein, The computer-readable storage medium stores computer program instructions that, when executed on an electronic device, cause the electronic device to perform the method according to any one of claims 1 to 20.

23. A computer program product, wherein, The computer program product includes computer program instructions that, when executed on an electronic device, perform the method according to any one of claims 1 to 20.

Images