Point cloud processing method and device, computer equipment and storage medium

By introducing decoding instructions into the point cloud code stream, the attribute encoding mode and quantization parameters of point cloud frames and point cloud slices are optimized, and the problem of low point cloud decoding performance is solved, achieving a more efficient decoding process.

CN119071499APending Publication Date: 2024-12-03TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202310643886.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-31
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

In the prior art, the decoding performance of point clouds is low, mainly due to the large amount of attribute information, which makes it difficult to efficiently decode.

Method used

By introducing decoding indication information into the point cloud code stream, including attribute existence flag fields, cross-type attribute prediction parameters, attribute encoding order fields, etc., it is used to indicate the attribute encoding mode and quantization parameters of the point cloud frame or point cloud slice, and optimize the decoding. process.

Benefits of technology

The decoding performance of point cloud is improved, and the decoding process is optimized through precise decoding instructions information, reducing computing pressure and resource consumption.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119071499A_ABST
    Figure CN119071499A_ABST
Patent Text Reader

Abstract

The invention provides a point cloud processing method and device, computer equipment and a storage medium. The point cloud processing method comprises the following steps: acquiring a point cloud code stream in a point cloud decoding stage; the point cloud code stream comprises decoding indication information, the decoding indication information is used for performing decoding indication on different types of data in the point cloud, and the different types of data comprise at least one of point cloud frames and point cloud pieces; and decoding the point cloud according to the decoding indication information. The point cloud processing method comprises the following steps: in a point cloud coding stage, generating decoding indication information, and coding the decoding indication information into a point cloud code stream; the decoding indication information is used for performing decoding indication on different types of data in the point cloud; and sending the point cloud code stream to a decoding device, so that the decoding device decodes the point cloud according to the decoding indication information. According to the embodiment of the invention, the decoding performance of the point cloud can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a point cloud processing method, a point cloud processing device, a computer equipment, and a computer-readable storage medium. Background Art

[0002] With the continuous development of science and technology, it is now possible to obtain a large number of high-precision point clouds at a low cost and in a short period of time. The point cloud can include multiple points, and each point in the point cloud has geometric information and attribute information. In order to improve the transmission efficiency of the point cloud, it is usually necessary to encode the point cloud before transmitting it; specifically, after the encoder encodes the geometric information and attribute information of each point in the point cloud, it can transmit the encoded point cloud to the decoding end, and the decoding end can decode the encoded point cloud to reconstruct the geometric information and attribute information of each point in the point cloud. Usually, the amount of attribute information of each point in the point cloud is large, and a large amount of attribute information causes pressure in the decoding process, making the decoding performance of the point cloud not high. Therefore, how to improve the decoding performance of the point cloud has become a current research hotspot. Summary of the invention

[0003] The embodiments of the present application provide a point cloud processing method, apparatus, computer equipment, and storage medium, which can improve the decoding performance of point clouds.

[0004] On the one hand, an embodiment of the present application provides a point cloud processing method, the point cloud processing method comprising:

[0005] Obtaining a point cloud code stream; the point cloud code stream includes decoding indication information, the decoding indication information is used to indicate decoding of different types of data in the point cloud, and the different types of data include at least one of the following: a point cloud frame and a point cloud slice;

[0006] Decode the point cloud according to the decoding instructions.

[0007] Accordingly, an embodiment of the present application provides a point cloud processing device, the point cloud processing device comprising:

[0008] An acquisition unit is used to acquire a point cloud code stream; the point cloud code stream includes decoding indication information, and the decoding indication information is used to indicate decoding of different types of data in the point cloud, and the different types of data include at least one of the following: a point cloud frame and a point cloud slice;

[0009] The processing unit is used to decode the point cloud according to the decoding instruction information.

[0010] In one implementation, the point cloud includes multiple point cloud frames, the decoding indication information sets the attribute header of the point cloud frame, and the decoding indication information is used to perform attribute decoding indication on the point cloud frame.

[0011] In one implementation, the decoding indication information includes attribute existence flag fields under N attribute types, where N is an integer greater than or equal to 2; the attribute existence flag field under any attribute type is used to indicate the existence of attribute encoding of the point cloud frame under the corresponding attribute type;

[0012] If the attribute existence flag field under any attribute type is the first value, it means that the attribute code under the corresponding attribute type does not exist in the point cloud frame;

[0013] If the attribute existence flag field under any attribute type is the second value, it means that the attribute code under the corresponding attribute type exists in the point cloud frame.

[0014] In one implementation, if the attribute existence flag field of at least two attribute types among the N attribute types is a second value, and the point cloud frame allows cross-type attribute prediction, the decoding indication information further includes a cross-type attribute prediction parameter;

[0015] The cross-type attribute prediction parameter is used to provide attribute decoding instructions for the point cloud frame regarding the cross-type attribute prediction.

[0016] In one implementation, the decoding indication information further includes an attribute coding order field, and the attribute coding order field is used to determine a first-coded attribute type of the point cloud frame and a later-coded attribute type of the point cloud frame;

[0017] The cross-type attribute prediction parameters include cross-type attribute prediction parameters of the post-encoded attribute type.

[0018] In an implementation manner, when there are multiple attribute information in the post-encoded attribute type, the cross-type attribute prediction parameter includes the cross-type attribute prediction parameter of each attribute information under the post-encoded attribute type.

[0019] In one implementation, the decoding indication information further includes an index flag field for cross-attribute type prediction, which is used to indicate the attribute information index value under the first-predicted attribute type used when the second-predicted attribute type performs cross-attribute type prediction.

[0020] In one implementation, the cross-type attribute prediction parameter is indicated by using an attribute type index field and an attribute information index field under the attribute type.

[0021] In one implementation, if the attribute existence flag field under the target attribute type among the N attribute types is a second value, the decoding indication information further includes a frame attribute quantization parameter control field under the target attribute type;

[0022] The frame attribute quantization parameter control field under the target attribute type is used to control the attribute quantization parameter of the point cloud frame under the target attribute type, and the attribute quantization parameter under the target attribute type is used to perform attribute decoding instructions on the point cloud frame regarding the attribute quantization under the target attribute type;

[0023] When the target attribute type is the reflectance attribute, the attribute quantization parameter control field under the target attribute type includes the reflectance attribute quantization parameter offset; when the target attribute type is the color attribute, the attribute quantization parameter control field under the target attribute type includes any one of the following: color attribute quantization parameter offset, attribute quantization parameter offset of each color component.

[0024] In one implementation, the decoding indication information includes an attribute space conversion flag field, and the attribute space conversion flag field is used to indicate the conversion status of the attribute space of the point cloud frame;

[0025] If the attribute space conversion flag field is the first value, it means that the point cloud frame has not been converted to the attribute space;

[0026] If the attribute space conversion flag field is the second value, it means that the point cloud frame undergoes attribute space conversion.

[0027] In one implementation, the attribute space is a color space, and if the attribute space conversion flag field is a second value, the decoding indication information further includes a frame attribute quantization parameter control field;

[0028] The frame attribute quantization parameter control field is used to control the attribute quantization parameter of the point cloud frame. The attribute quantization parameter of the point cloud frame is used to perform attribute decoding instructions on the attribute quantization of the point cloud frame.

[0029] The frame attribute quantization parameter control field includes any of the following: color attribute quantization parameter offset, attribute quantization parameter offset of each color component.

[0030] In one implementation, if the attribute space conversion flag field is a first value, the decoding indication information further includes an attribute residual multiple prediction field;

[0031] The attribute residual multiple prediction field is used to indicate whether the point cloud frame allows multiple predictions of attribute residuals.

[0032] In one implementation, if the attribute space conversion flag field is a first value, the decoding indication information further includes a transform residual layer flag field;

[0033] The transformation residual layer flag field is used to control the use of attribute residual compensation in the point cloud frame when the point cloud frame uses the attribute encoding mode of the multi-layer transformation algorithm.

[0034] In one implementation, the decoding indication information includes an attribute coding mode flag field, and the attribute coding mode flag field is used to indicate the attribute coding mode of the point cloud frame;

[0035] The decoding indication information further includes an attribute type index field, and the attribute type index field is used to indicate the attribute type of the point cloud frame;

[0036] The syntax elements in the attribute header of the point cloud frame are organized and classified based on the attribute coding mode flag field and / or the attribute type index field.

[0037] In one implementation, the point cloud includes multiple point cloud frames, and the decoding indication information is set in the frame header of the point cloud frame, and the decoding indication information is used to indicate decoding of the point cloud frame.

[0038] In one implementation, the decoding indication information includes a frame point number flag field; the frame point number flag field is used to indicate the number of points to be decoded contained in the point cloud frame.

[0039] In one implementation, the frame point count flag field includes a frame point count high-order flag field and a frame point count low-order flag field; the frame point count high-order flag field is used to indicate the high-order information of the number of points to be decoded contained in the point cloud frame, and the frame point count low-order flag field is used to indicate the low-order information of the number of points to be decoded contained in the point cloud frame;

[0040] The number of points to be decoded contained in the point cloud frame is determined based on the high-bit information and the low-bit information.

[0041] In one implementation, the decoding indication information includes a frame slice number flag field; the frame slice number flag field is used to indicate the number of point cloud slices contained in the point cloud frame.

[0042] In one implementation, the point cloud includes multiple point cloud frames, the point cloud frames include multiple point cloud slices, the decoding indication information is set in the header of the point cloud slice, and the decoding indication information is used to indicate the decoding of the point cloud slice.

[0043] In one implementation, the slice header includes a geometric slice header, and the decoding indication information includes a slice point number flag field; the slice point number flag field is used to indicate the number of points to be decoded contained in the point cloud slice.

[0044] In one implementation, the slice point number flag field includes a slice point number high-order flag field and a slice point number low-order flag field; the slice point number high-order flag field is used to indicate the high-order information of the number of points to be decoded contained in the point cloud slice, and the slice point number low-order flag field is used to indicate the low-order information of the number of points to be decoded contained in the point cloud slice;

[0045] The number of points to be decoded contained in the point cloud is determined based on the high-bit information and the low-bit information.

[0046] In one implementation, the slice header includes an attribute slice header, the decoding indication information includes a slice attribute quantization parameter control field, the slice attribute quantization parameter control field is used to control the attribute quantization parameter of the point cloud slice, and the attribute quantization parameter of the point cloud slice is used to perform attribute decoding indication on the attribute quantization of the point cloud slice;

[0047] The slice attribute quantization parameter control field includes: a slice reflectance attribute quantization parameter control field and a slice color attribute quantization parameter control field; or, the slice attribute quantization parameter control field includes: a slice reflectance attribute quantization parameter control field and a slice color component attribute quantization parameter control field.

[0048] On the other hand, an embodiment of the present application provides a point cloud processing method, the point cloud processing method comprising:

[0049] Generate decoding indication information, and encode the decoding indication information into the point cloud code stream; the decoding indication information is used to provide decoding instructions for different types of data in the point cloud, and the different types of data include at least one of the following: point cloud frames and point cloud slices;

[0050] The point cloud code stream is sent to the decoding device so that the decoding device decodes the point cloud according to the decoding instruction information.

[0051] Accordingly, an embodiment of the present application provides a point cloud processing device, the point cloud processing device comprising:

[0052] A processing unit, configured to generate decoding indication information and encode the decoding indication information into a point cloud code stream; the decoding indication information is used to provide decoding indications for different types of data in the point cloud, and the different types of data include at least one of the following: a point cloud frame and a point cloud slice;

[0053] The communication unit is used to send the point cloud code stream to the decoding device so that the decoding device decodes the point cloud according to the decoding instruction information.

[0054] In one implementation, the point cloud includes multiple point cloud frames, and the decoding indication information is encoded into the attribute header of the point cloud frame, and the decoding indication information is used to perform attribute decoding indication on the point cloud frame.

[0055] In one implementation, the decoding indication information includes attribute existence flag fields under N attribute types, where N is an integer greater than or equal to 2; the attribute existence flag field under any attribute type is used to indicate the existence of attribute encoding of the point cloud frame under the corresponding attribute type; the processing unit is used to generate the decoding indication information, specifically to perform the following steps:

[0056] If the attribute code under any attribute type does not exist in the point cloud frame, the attribute existence flag field under the corresponding attribute type is set to the first value;

[0057] If attribute codes under any attribute type exist in the point cloud frame, the attribute existence flag field under the corresponding attribute type is set to the second value.

[0058] In one implementation, the processing unit is further configured to perform the following steps:

[0059] If the attribute existence flag field of at least two attribute types in the N attribute types is set to the second value, and the point cloud frame allows cross-type attribute prediction, then add a cross-type attribute prediction parameter to the decoding indication information;

[0060] The cross-type attribute prediction parameter is used to provide attribute decoding instructions for the point cloud frame regarding the cross-type attribute prediction.

[0061] In one implementation, the decoding indication information further includes an attribute coding order field, and the attribute coding order field is used to indicate a first-coded attribute type of the point cloud frame and a later-coded attribute type of the point cloud frame;

[0062] The cross-type attribute prediction parameters include cross-type attribute prediction parameters of the post-encoded attribute type.

[0063] In an implementation manner, when there are multiple attribute information in the post-encoded attribute type, the cross-type attribute prediction parameter includes the cross-type attribute prediction parameter of each attribute information under the post-encoded attribute type.

[0064] In one implementation, the decoding indication information further includes an index flag field for cross-attribute type prediction, which is used to indicate the attribute information index value under the first-predicted attribute type used when the second-predicted attribute type performs cross-attribute type prediction.

[0065] In one implementation, the cross-type attribute prediction parameter is indicated by using an attribute type index field and an attribute information index field under the attribute type.

[0066] In one implementation, the processing unit is further configured to perform the following steps:

[0067] If the attribute existence flag field under the target attribute type among the N attribute types is set to the second value, then the frame attribute quantization parameter control field under the target attribute type is added to the decoding indication information;

[0068] The frame attribute quantization parameter control field under the target attribute type is used to control the attribute quantization parameter of the point cloud frame under the target attribute type, and the attribute quantization parameter under the target attribute type is used to perform attribute decoding instructions on the point cloud frame regarding the attribute quantization under the target attribute type;

[0069] When the target attribute type is the reflectance attribute, the attribute quantization parameter control field under the target attribute type includes the reflectance attribute quantization parameter offset; when the target attribute type is the color attribute, the attribute quantization parameter control field under the target attribute type includes any one of the following: color attribute quantization parameter offset, attribute quantization parameter offset of each color component.

[0070] In one implementation, the decoding indication information includes an attribute space conversion flag field, and the attribute space conversion flag field is used to indicate the conversion status of the attribute space of the point cloud frame; the processing unit is used to generate the decoding indication information, specifically to perform the following steps:

[0071] If the point cloud frame has not been converted to an attribute space, the attribute space conversion flag field is set to a first value;

[0072] If the point cloud frame is subjected to attribute space conversion, the attribute space conversion flag field is set to the second value.

[0073] In one implementation, the attribute space is a color space; and the processing unit is further configured to perform the following steps:

[0074] If the attribute space conversion flag field is set to the second value, a frame attribute quantization parameter control field is added to the decoding indication information;

[0075] The frame attribute quantization parameter control field is used to control the attribute quantization parameter of the point cloud frame. The attribute quantization parameter of the point cloud frame is used to perform attribute decoding instructions on the attribute quantization of the point cloud frame.

[0076] The frame attribute quantization control field includes any of the following: color attribute quantization parameter offset, attribute quantization parameter offset of each color component.

[0077] In one implementation, the processing unit is further configured to perform the following steps:

[0078] If the attribute space conversion flag field is set to the first value, then adding the attribute residual multiple prediction field to the decoding indication information;

[0079] The attribute residual multiple prediction field is used to indicate whether the point cloud frame allows multiple predictions of attribute residuals.

[0080] In one implementation, the processing unit is further configured to perform the following steps:

[0081] If the attribute space conversion flag field is set to the first value, a transform residual layer flag field is added to the decoding indication information;

[0082] The transformation residual layer flag field is used to control the use of attribute residual compensation in the point cloud frame when the point cloud frame uses the attribute encoding mode of the multi-layer transformation algorithm.

[0083] In one implementation, the processing unit is used to generate the decoding indication information, and is specifically used to perform the following steps:

[0084] Add an attribute coding mode flag field in the decoding indication information, where the attribute coding mode flag field is used to indicate the attribute coding mode of the point cloud frame;

[0085] An attribute type index field is also added to the decoding indication information, and the attribute type index field is used to indicate the attribute type of the point cloud frame;

[0086] The syntax elements in the attribute header of the point cloud frame are organized based on the attribute coding mode flag field and / or the attribute type index field.

[0087] In one implementation, the point cloud includes multiple point cloud frames, and the decoding indication information is encoded into the frame header of the point cloud frame, and the decoding indication information is used to indicate decoding of the point cloud frame.

[0088] In one implementation, the decoding indication information includes a frame point number flag field; the processing unit is used to generate the decoding indication information, specifically to perform the following steps:

[0089] Identify the number of points to be encoded contained in the point cloud frame;

[0090] Set the frame point count flag field to the number of points to be encoded.

[0091] In one implementation, the frame point number flag field includes a frame point number high flag field and a frame point number low flag field; the processing unit is used to set the frame point number flag field to the number of points to be encoded, specifically to perform the following steps:

[0092] Split the number of points to be encoded into high-order information and low-order information;

[0093] The frame point count high flag field is set to high-order information, and the frame point count low flag field is set to low-order information.

[0094] In one implementation, the decoding indication information includes a frame number flag field; and the processing unit is used to generate the decoding indication information, specifically to perform the following steps:

[0095] Identify the number of point cloud pieces contained in the point cloud frame;

[0096] Set the Frame Slice Flag field to the number of point cloud slices.

[0097] In one implementation, the point cloud includes multiple point cloud frames, the point cloud frames include multiple point cloud slices, the decoding indication information is encoded into the slice header of the point cloud slice, and the decoding indication information is used to indicate the decoding of the point cloud slice.

[0098] In one implementation, the slice header includes a geometric slice header, and the decoding indication information includes a slice point number flag field; the processing unit is used to generate the decoding indication information, specifically to perform the following steps:

[0099] Identify the number of points to be encoded contained in the point cloud;

[0100] Set the Slice Point Count field to the number of points to be encoded.

[0101] In one implementation, the chip point number flag field includes a chip point number high-order flag field and a chip point number low-order flag field; the processing unit is used to set the chip point number flag field to the number of points to be encoded, specifically to perform the following steps:

[0102] Split the points to be encoded into high-order information and low-order information;

[0103] The high-order flag field of the number of slice points is set to high-order information, and the low-order flag field of the number of slice points is set to low-order information.

[0104] In one implementation, the slice header includes an attribute slice header; and the processing unit is used to generate the decoding indication information, specifically to perform the following steps:

[0105] Adding a slice attribute quantization parameter control field in the decoding indication information, the slice attribute quantization parameter control field is used to control the attribute quantization parameter of the point cloud slice, and the attribute quantization parameter of the point cloud slice is used to perform attribute decoding indication on the attribute quantization of the point cloud slice;

[0106] The slice attribute quantization parameter control field includes: a slice reflectance attribute quantization parameter control field and a slice color attribute quantization parameter control field; or, the slice attribute quantization parameter control field includes: a slice reflectance attribute quantization parameter control field and a slice color component attribute quantization parameter control field.

[0107] Accordingly, an embodiment of the present application provides a computer device, the computer device comprising:

[0108] a processor suitable for implementing a computer program;

[0109] Computer-readable storage medium, the computer-readable storage medium stores a computer program, and the computer program is suitable for being loaded by a processor and executing the above-mentioned point cloud processing method.

[0110] Accordingly, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is read and executed by a processor of a computer device, the computer device executes the above-mentioned point cloud processing method.

[0111] Accordingly, an embodiment of the present application provides a computer program product or a computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the above-mentioned point cloud processing method.

[0112] In an embodiment of the present application, the decoding indication information in the point cloud code stream can be used to provide decoding instructions for different types of data in the point cloud, and the different types of data include at least one of the following: point cloud frames and point cloud slices. Thus, based on the decoding indication effect of the decoding indication information on different types of data in the point cloud, the point cloud is decoded according to the decoding indication information, thereby improving the decoding performance of the point cloud. BRIEF DESCRIPTION OF THE DRAWINGS

[0113] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0114] Figure 1 It is a schematic diagram of a coding framework of a point cloud coding provided in an embodiment of the present application;

[0115] Figure 2 It is a schematic diagram of the architecture of a point cloud processing system provided in an embodiment of the present application;

[0116] Figure 3 It is a flowchart of a point cloud processing method provided in an embodiment of the present application;

[0117] Figure 4 It is a flowchart of another point cloud processing method provided in an embodiment of the present application;

[0118] Figure 5 is a structural schematic diagram of a point cloud processing device provided in an embodiment of the present application;

[0119] Figure 6 is a structural schematic diagram of another point cloud processing device provided in an embodiment of the present application;

[0120] Figure 7 It is a structural diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0121] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0122] In order to more clearly understand the technical solution provided by the embodiments of the present application, the basic concepts involved in the embodiments of the present application are first introduced here:

[0123] (1) Point Cloud. A point cloud is a set of irregularly distributed discrete points in space that express the spatial structure and surface properties of a three-dimensional object or scene. Point clouds can be divided into different categories according to different classification standards. For example, according to the way point clouds are acquired, they can be divided into dense point clouds and sparse point clouds. For example, according to the time series type of point clouds, they can be divided into static point clouds and dynamic point clouds.

[0124] (2) Point Cloud Data. The geometric information and attribute information of each point in the point cloud together constitute the point cloud data. Geometric information can also be called three-dimensional position information. The geometric information of a point in the point cloud refers to the spatial coordinates (x, y, z) of the point, which can include the coordinate values ​​of the point in each coordinate axis direction of the three-dimensional coordinate system, for example, the coordinate value x in the X-axis direction, the coordinate value y in the Y-axis direction, and the coordinate value z in the Z-axis direction. The attribute information of a point in the point cloud may include at least one of the following: color information, material information, laser reflection intensity information (also called reflectivity); usually, each point in the point cloud has the same amount of attribute information. For example, each point in the point cloud can have two kinds of attribute information: color information and laser reflection intensity. For another example, each point in the point cloud can have three kinds of attribute information: color information, material information, and laser reflection intensity information.

[0125] (3) Point Cloud Compression (PCC). Point cloud coding refers to the process of encoding the geometric information and attribute information of each point in the point cloud to obtain a compressed code stream (also called a point cloud code stream). Point cloud coding can include two main processes: geometric information encoding and attribute information encoding. The current mainstream point cloud coding technology can be divided into point cloud coding based on geometry and point cloud coding based on projection according to different types of point clouds. Here, G-PCC (Geometry-Based Point Cloud Compression) in MPEG (Moving Picture Expert Group, an international audio and video coding standard) and AVS-PCC, a point cloud coding standard in AVS (Audio Video Coding Standard, China's national video coding standard) are used as examples for introduction.

[0126] The coding frameworks of G-PCC and AVS-PCC are roughly the same. Taking G-PCC as an example, Figure 1 The coding framework of G-PCC is shown, which can be divided into the geometric information coding process and the attribute information coding process. In the geometric information coding process, the geometric information of each point in the point cloud is encoded to obtain a geometric bit stream; in the attribute information coding process, the attribute information of each point in the point cloud is encoded to obtain an attribute bit stream; the geometric bit stream and the attribute bit stream together constitute the compressed code stream of the point cloud.

[0127] For the geometric information encoding process, the main operations and processing can be described as follows:

[0128] ① Pre-Processing: It can include coordinate transformation and voxelization. Through scaling and translation operations, the point cloud data in the three-dimensional space is converted into integer form, and its minimum geometric position is moved to the coordinate origin.

[0129] ② Geometric coding: Geometric coding can include two modes, namely, octree-based geometric coding (Octree) and triangle-based geometric coding (Trisoup). These two coding modes can be used under different conditions. Among them:

[0130] Octree-based geometric coding: Octree is a tree data structure that evenly divides the pre-set bounding box in three-dimensional space. Each node has eight child nodes. By using "1" and "0" to indicate whether each child node of the octree is occupied or not, the occupancy code information (Occupancy Code) is obtained as the code stream of the point cloud geometry information.

[0131] Geometric coding based on triangular representation: Divide the point cloud into blocks of a certain size, locate the intersection points of the point cloud surface at the edge of the block and construct triangles. The geometric information is compressed by encoding the intersection points.

[0132] ③ Geometry Quantization: The degree of quantization is usually determined by the quantization parameter (QP). The larger the QP value, the larger the range of coefficients will be quantized to the same output, which usually results in greater distortion and a lower bit rate. On the contrary, the smaller the QP value, the smaller the range of coefficients will be quantized to the same output, which usually results in less distortion and a higher bit rate.

[0133] ④ Geometry Entropy Encoding: Statistical compression encoding is performed on the occupancy code information of the octree, and finally a binary (0 or 1) compressed code stream is output. Statistical coding is a lossless coding method that can effectively reduce the bit rate required to express the same signal. The commonly used statistical coding method is context-based binary arithmetic coding (Content Adaptive Binary Arithmetic Coding, CABAC).

[0134] For the attribute information encoding process, the main operations and processing can be seen in the following description:

[0135] ① Attribute recoloring: In the case of lossy coding, after the geometric coordinate information is encoded, the encoder needs to decode and reconstruct the geometric information, that is, restore the geometric information of each point in the point cloud. Find the attribute information corresponding to one or more neighboring points in the original point cloud as the attribute information of the reconstructed point.

[0136] ② Attribute information processing: Attribute information processing can include three attribute encoding modes, namely, attribute prediction (Prediction), attribute transformation (Transform), and attribute prediction transformation (Prediction & Transform). These three attribute encoding modes can be used under different conditions. Among them:

[0137] Attribute prediction: According to information such as distance or spatial relationship, the neighbor prediction points of the point to be encoded are determined among the encoded points. Based on the set criteria, the attribute prediction information of the point to be encoded is calculated according to the attribute information of the neighbor prediction points. The difference between the actual attribute information and the predicted attribute information of the point to be encoded is calculated as the attribute residual information, and the attribute residual information is quantized and entropy encoded.

[0138] Attribute transformation: using DCT (Discrete Cosine Transform) and Haar (Haar Transform) and other transformation methods, the attribute information is grouped and transformed to obtain transformation coefficients, and the transformation coefficients are quantized and entropy encoded.

[0139] Attribute prediction transformation: The preceding steps are the same as attribute prediction. After obtaining the attribute residual information of the point to be encoded, the attribute residual information of the point to be encoded is transformed using a transformation algorithm to obtain transformation coefficients, and then the transformation coefficients are quantized and entropy encoded.

[0140] ③Attribute Quantization: The degree of quantization is usually determined by the quantization parameter. The transform coefficients and / or attribute residual information obtained by attribute information processing are quantized, and the quantized results are entropy coded. For example, in attribute prediction, the quantized attribute residual information is entropy coded; in attribute transformation and attribute prediction transformation, the quantized transform coefficients are entropy coded.

[0141] ④ Attribute Entropy Coding: The quantized attribute residual information and / or transform coefficients are generally compressed using entropy coding methods such as Run Length Coding and Arithmetic Coding. The corresponding attribute coding mode, quantization parameters and other information are also encoded using entropy encoders.

[0142] (4) Point cloud decoding. Point cloud decoding refers to the process of decoding the compressed bitstream obtained by point cloud encoding to reconstruct the point cloud; in detail, the geometric bitstream in the compressed bitstream is parsed to reconstruct the geometric information of each point in the point cloud, and the attribute bitstream in the compressed bitstream is parsed to reconstruct the attribute information of each point in the point cloud. Here is a detailed introduction to the point cloud decoding process in attribute prediction mode and attribute prediction transformation mode:

[0143] In the attribute prediction mode, the quantized attribute residual information of the point to be decoded can be obtained from the attribute bit stream through entropy decoding, and the quantized attribute residual information can be dequantized to obtain the attribute residual information of the point to be decoded; the neighbor prediction points of the point to be decoded are determined among the decoded points according to information such as distance or spatial relationship, and the attribute prediction information of the point to be decoded is calculated according to the attribute reconstruction information of the neighbor prediction points based on the set criteria; then, the attribute information of the point to be decoded (which can be called attribute reconstruction information) can be reconstructed according to the attribute residual information of the point to be decoded and the attribute prediction information of the point to be decoded.

[0144] In the attribute prediction transformation mode, the quantized transformation coefficients of the point to be decoded can be obtained from the attribute bit stream through entropy decoding, the quantized transformation coefficients can be dequantized to obtain the transformation coefficients, and the transformation coefficients can be inversely transformed to obtain the attribute residual information of the point to be decoded; according to information such as distance or spatial relationship, the neighbor prediction points of the point to be decoded are determined among the decoded points, and based on the set criteria, the attribute prediction information of the point to be decoded is calculated according to the attribute reconstruction information of the neighbor prediction points; then, the attribute information of the point to be decoded (which can be called attribute reconstruction information) can be reconstructed according to the attribute residual information of the point to be decoded and the attribute prediction information of the point to be decoded.

[0145] Based on the introduction of the above basic concepts, the embodiment of the present application proposes a point cloud processing method. In the point cloud attribute decoding stage, the point cloud code stream obtained by the point cloud processing method may include decoding indication information, and the decoding indication information may be used to indicate decoding of different types of data in the point cloud, and the point cloud may be decoded according to the decoding indication information; in the point cloud attribute encoding stage, the point cloud processing method may generate decoding indication information, encode the decoding indication information into the point cloud code stream, and then send the point cloud code stream to a decoding device, so that the decoding device decodes the point cloud according to the decoding indication information. Based on the decoding indication effect of the decoding indication information on different types of data in the point cloud, the point cloud processing method decodes the point cloud according to the decoding indication information, which can improve the decoding performance of the point cloud.

[0146] In the following, in conjunction with the accompanying drawings, a point cloud processing system suitable for implementing the point cloud processing method provided in an embodiment of the present application is introduced.

[0147] like Figure 2 As shown, the point cloud processing system may include an encoding device 201 and a decoding device 202. The encoding device 201 may be a terminal or a server, and the decoding device 202 may be a terminal or a server. A direct communication connection may be established between the encoding device 201 and the decoding device 202 by wired communication, or an indirect communication connection may be established by wireless communication. Among them, the terminal may be a smart phone, a tablet computer, a laptop computer, a desktop computer, an intelligent voice interaction device, a smart watch, a vehicle terminal, a smart home appliance, and an aircraft, etc., but is not limited thereto. The server may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms.

[0148] (1) For the encoding device 201:

[0149] The encoding device 201 can obtain point cloud data (i.e., geometric information and attribute information of each point in the point cloud), and the point cloud data can be obtained by scene capture or device generation. Scene capture point cloud data refers to point cloud data obtained by collecting real-world visual scenes through the capture device associated with the encoding device 201; wherein, the capture device is used to provide point cloud data acquisition services for the encoding device 201, and the capture device may include but is not limited to any of the following: camera equipment, sensor equipment, and scanning equipment; wherein, the camera equipment may include ordinary cameras, stereo cameras, and light field cameras, etc., the sensor equipment may include laser equipment, radar equipment, etc., and the scanning equipment may include three-dimensional laser scanning equipment, etc.; the capture device associated with the encoding device 201 may refer to a hardware component set in the encoding device 201, for example, the capture device is a camera, sensor, etc. of the terminal, and the capture device associated with the encoding device 201 may also refer to a hardware device connected to the encoding device 201, such as a camera connected to a server, etc. Device generation point cloud data refers to the point cloud data generated by the encoding device 201 according to virtual objects (for example, virtual three-dimensional objects and virtual three-dimensional scenes obtained through three-dimensional modeling, etc.).

[0150] The encoding device 201 can encode the geometric information and attribute information of each point in the point cloud to obtain a point cloud code stream, and the encoding device 201 can transmit the encoded point cloud code stream to the decoding device 202. In particular, during the point cloud encoding process, the encoding device 201 can generate decoding indication information, encode the decoding indication information into the point cloud code stream (including the geometric bit stream and the attribute bit stream), and send the point cloud code stream to the decoding device 202. The decoding indication information can be used to indicate the decoding of different types of data in the point cloud, so that the decoding device 202 can decode the point cloud based on the decoding indication information for different types of data in the point cloud, which can improve the decoding performance of the point cloud.

[0151] (2) For the decoding device 202:

[0152] After receiving the point cloud code stream (including the attribute bit stream and the geometry bit stream) transmitted by the encoding device 201, the decoding device 202 can decode the point cloud code stream and reconstruct the geometry information (which can be called geometry reconstruction information) and attribute information (which can be called attribute reconstruction information) of each point in the point cloud. In particular, during the point cloud decoding process, the decoding device 202 can decode the point cloud based on the decoding indication information in the point cloud code stream for different types of data in the point cloud, thereby improving the decoding performance of the point cloud.

[0153] It can be understood that the point cloud processing system described in the embodiment of the present application is to more clearly illustrate the technical solution of the embodiment of the present application, and does not constitute a limitation on the technical solution provided in the embodiment of the present application. Ordinary technicians in this field can know that with the evolution of the system architecture and the emergence of new business scenarios, the technical solution provided in the embodiment of the present application is also applicable to similar technical problems.

[0154] The point cloud processing method provided in the embodiment of the present application is described in more detail below with reference to the accompanying drawings.

[0155] The present application embodiment provides a point cloud processing method, which mainly introduces the point cloud decoding process. The point cloud processing method can be executed by a computer device, which can be the decoding device 202 in the above-mentioned point cloud processing system. Figure 3 As shown, the point cloud processing method may include but is not limited to the following steps S301-S302:

[0156] S301, obtaining a point cloud code stream; the point cloud code stream includes decoding indication information, and the decoding indication information is used to indicate decoding of different types of data in the point cloud, and the different types of data include at least one of the following: a point cloud frame and a point cloud slice.

[0157] The point cloud code stream may include decoding indication information, which can be used to indicate decoding of different types of data in the point cloud. Specifically, the point cloud decoding information can be set in the attribute header, frame header, and slice header; the decoding indication information set in the attribute header can be used to indicate attribute decoding of the point cloud frame in the point cloud; the decoding indication information set in the frame header can be used to indicate decoding of the point cloud frame in the point cloud; the decoding indication information set in the slice header can be used to indicate decoding of the point cloud slice in the point cloud. The decoding indication information set in the attribute header, frame header, and slice header are introduced below:

[0158] 1. Decoding instructions set in the attribute header:

[0159] The point cloud may include multiple point cloud frames, and the decoding instruction information may be set in the attribute header of the point cloud frame. The decoding instruction information set in the attribute header of the point cloud frame may be used to indicate the attribute decoding of the point cloud frame. Before introducing the decoding instruction information set in the attribute header, the syntax elements of the general attribute header are introduced here. The syntax elements of the general attribute header are as shown in Table 1:

[0160] Table 1

[0161]

[0162]

[0163]

[0164]

[0165] The following is an explanation of the syntax elements in the general attribute header shown in Table 1 above:

[0166] Attribute Present Flag field (attributePresentFlag[attrIdx]): a binary variable. A value of '1' indicates that the point cloud code stream contains the attrIdx attribute code (i.e., the attribute code under the attribute type with the attribute index attrIdx); a value of '0' indicates that the point cloud code stream does not contain the attrIdx attribute code. attrIdx represents the attribute index, which is an integer between 0 and 15. Its meaning is explained in Table 2 below:

[0167] Table 2

[0168] attrIdx Attribute description 0 Color 1 Reflectance 2..15 reserve

[0169] Attribute data number minus one field (attribute_data_num_set_minus1[attrIdx]): unsigned integer. Adding 1 indicates the number of attribute multi-data sets supported by the attribute identified by the attribute index attrIdx in the point cloud code stream. This is a number between 0 and 127. When attribute_data_num_set_minus1[attrIdx] does not appear in the point cloud, its default value is -1.

[0170] Attribute information enable flag field (multi_set_flag[attrIdx]): a binary variable. A value of '1' indicates that the attribute identified by the attribute index attrIdx can support the use of multiple sets of attribute information; a value of '0' indicates that the attribute identified by the attribute index attrIdx can support the use of multiple sets of attribute information, and the attribute data can only use one set of attribute information. When multi_set_flag[attrIdx] does not appear in the codestream, its default value is zero.

[0171] Attribute information number minus one field (attribute_info_num_set_minus1[attrIdx]): unsigned integer. Adding 1 indicates the number of attribute information supported by the attribute identified by the attribute index attrIdx in the point cloud codestream. This is a number between 0 and 127. When attribute_info_num_set_minus1[attrIdx] does not appear in the codestream, its default value is -1.

[0172] Attribute coding mode flag field (transform): unsigned integer between 0 and 2. Used to control the attribute coding mode. When the value is '0', the attribute is coded using the attribute prediction mode; when the value is '1', the attribute is coded using the multi-layer transform mode; when the value is '2', the attribute is coded using the attribute prediction transform mode.

[0173] Attribute transformation precision value (kFracBits): unsigned integer. Used to indicate the shift precision of fixed-point operations during attribute transformation.

[0174] Attribute transform coefficient quantization parameter difference field (attrTransformQpDelta): unsigned integer. Used to represent the difference with the attribute residual quantization parameter. Attribute transform coefficient quantization parameter attrTransformQp = attrQuantParam + attrTransformQpDelta.

[0175] Attribute transformation point number field (attrTransformNumPoints): unsigned integer. Used to indicate the number of points for attribute transformation, i.e., use the wavelet transformation of attrTransformNumPoints points. attrTransformNumPoints = 0 means that all points in the slice are used for wavelet transformation.

[0176] The maximum number of neighbor points to search for logarithm minus seven fields (maxNumOfNeighbour_log2_minus7): unsigned integer. Used to derive the variable maxNumOfNeighbour, which represents the maximum number of encoded neighbors that can be used for searching to control the search range of neighbor candidate points and the number of points cached by the hardware during attribute prediction. maxNumOfNeighbour is obtained by the following formula maxNumOfNeighbour = 2 (maxNumOfNeighbor_log2_minus7+7) , maxNumOfNeighbour_log2_minus7 is an integer between 0 and 3.

[0177] Attribute residual secondary prediction field (cross_component_pred): a binary variable. A value of '1' indicates that attribute residual secondary prediction is allowed; a value of '0' indicates that attribute residual secondary prediction is not allowed.

[0178] Residual coding order switch field (orderSwitch): a binary variable. A value of '1' indicates that the residual coding order is UYV / GRB order; a value of '0' indicates that the residual coding order is YUV / RGB order.

[0179] Chroma channel Cb quantization parameter offset field (chromaQpOffsetCb): signed integer. Used to control the Cb channel quantization parameter, the value range is -16 to 16. If chromaQpOffsetCb does not exist in the attribute header, the value of chromaQpOffsetCb is 0. That is, choramQpCb = Clip3 (minQP, maxQP, attribute_qp + chromaQpOffsetCb). Note that the quantization parameter of the luminance channel is lumaQp = attribute_qp, the minimum supported quantization parameter is minQP = 0, and the maximum supported quantization parameter is maxQP = 63.

[0180] Chroma channel Cr quantization parameter offset field (chromaQpOffsetCr): signed integer. Used to control the Cr channel quantization parameter, the value range is -16 to 16. If chromaQpOffsetCr does not exist in the attribute header, the value of chromaQpOffsetCr is 0. That is, choramQpCr = Clip3 (minQP, maxQP, attribute_qp + chromaQpOffsetCr). Note that the quantization parameter of the luminance channel is lumaQp = attribute_qp, the minimum supported quantization parameter is minQP = 0, and the maximum supported quantization parameter is maxQP = 63.

[0181] Nearest neighbor prediction parameter 1 field (nearestPredParam1): unsigned integer. Used to control the threshold of the nearest neighbor prediction.

[0182] Nearest neighbor prediction parameter 2 field (nearestPredParam2): unsigned integer. Used to control the threshold of nearest neighbor prediction. The threshold of nearest neighbor prediction is expressed as attrQuantParam*nearestPredParam1+nearestPredParam2.

[0183] Spatial bias coefficient field (axisBias): unsigned integer. Used to control the offset in the Z direction in the calculation of attribute prediction information.

[0184] Output Bit Depth Minus 1: unsigned integer. Used to control the output bit depth. This value is between 0 and 15. Output Bit Depth = outputBitDepthMinus1 + 1. If this syntax element is not in the bitstream, the default value is zero.

[0185] LoD layer number field (numOflevelOfDetail): unsigned integer. Used to control the number of LOD layers divided during attribute prediction. In a codestream conforming to this section, numOflevelOfDetail shall not be greater than 32.

[0186] Maximum number of neighbor points selected for prediction field (maxNumOfPredictNeighbours): unsigned integer. Used to limit the number of neighbor points selected for attribute prediction. maxNumOfPredictNeighbours in the point cloud code stream should not be greater than 16.

[0187] LoD intra-layer prediction flag field (intraLodFlag): a binary variable. It is used to control whether to enable intra-layer prediction. When the value is '1', intra-layer prediction is enabled, and when the value is '0', intra-layer prediction is disabled.

[0188] Parity-based attribute information flag field (parityBasedLevelCodingEnable): a binary variable. It is used to control whether to enable the encoding of parity-based attribute residuals or transform coefficients. The value is '1' to enable it, and the value is '0' to disable it.

[0189] Color reordering mode field (colorReorderMode): unsigned integer. Used to indicate the reordering mode currently selected for color information. '0' indicates the original point cloud input order, '1' indicates Hilbert reordering, and '2' indicates Morton reordering.

[0190] Reflectivity reordering mode field (reflReorderMode): unsigned integer. Used to indicate the reordering mode selected for the current reflectivity information. '0' indicates the original point cloud input order, '1' indicates Hilbert reordering, and '2' indicates Morton reordering.

[0191] Maximum cache limit parameter field (log2maxNumofCoeffMinus8): unsigned integer between 0 and 16. The maximum cache limit parameter maxNumofCoeff of the transform coefficient is calculated by the following formula: maxNumofCoeff=1<<(log2maxNumofCoeffMinus8+8). When log2maxNumofCoeffMinue8 does not appear in the bitstream, maxNumofCoeff defaults to 1.

[0192] Maximum delay limit parameter field (log2coeffLengthControlMinus8): unsigned integer. Used to limit the maximum number of delays of transform parameters in attribute transform coding. The specific maximum delay point number is calculated as maxLatency=maxNumofCoeff*(1<<(log2coeffLengthControlMinus8+8)). The maximum value of maxLatency is 131072.

[0193] Attribute encoding order field (attrEncodeOrder): a binary variable. It is used to control the encoding order of attributes when the point cloud contains multiple attribute types. A value of '0' means encoding color first, then encoding reflectivity; a value of '1' means encoding reflectivity first, then encoding color.

[0194] Adaptive Exponential Golomb Coding Sliding Window Size field (log2_golomb_group_size): unsigned integer. Represents the logarithmic value of the adaptive exponential Golomb coding sliding window size of the attribute prediction residual or transform coefficient. The adaptive exponential Golomb coding sliding window size is expressed as: golomb_sliding_window_size=2 log2 _golomb_group_size .

[0195] Cross-type attribute prediction field (crossAttrTypePred): a binary variable. A value of '1' indicates that cross-type attribute prediction is allowed; a value of '0' indicates that cross-type attribute prediction is not allowed.

[0196] Cross-type attribute prediction weight parameter 1 (crossAttrTypePredParam1): 15-bit unsigned integer. Used to control the weight parameter 1 for calculating the geometric information distance and attribute information distance in cross-type attribute prediction.

[0197] Cross-type attribute prediction weight parameter 2 (crossAttrTypePredParam2): 21-bit unsigned integer. Used to control the weight parameter 2 for calculating the geometric information distance and attribute information distance in cross-type attribute prediction.

[0198] Reflectivity group prediction flag field (refGroupPred): a binary variable. It is used to control whether to enable the reflectivity group prediction mode of the prediction transformation. When the value is '1', the group prediction is enabled, and when the value is '0', the group prediction is disabled.

[0199] Color initial prediction transform ratio (colorInitPredTransRatio): signed integer. Used in the multi-layer transform algorithm of attribute compression (transform=1), controls the size of the initial distance threshold used for color when building the prediction transform tree.

[0200] refInitPredTransRatio: signed integer. Used in the multi-layer transform algorithm of attribute compression (transform=1), controls the size of the initial distance threshold used for reflectivity when building the prediction transform tree.

[0201] Transform residual layer flag field (transResLayer): binary variable. Used in the multi-layer transform algorithm for attribute compression (transform=1), controls whether to use attribute residual compensation. When transResLayer=1, attribute residual compensation is used; transResLayer=0 does not use attribute residual compensation.

[0202] Color Golomb order (ColorGolombNum): unsigned integer between 0 and 8. It is used to indicate the K-order Golomb order K=ColorGolombNum used when decoding the current color prediction residual or transform coefficient.

[0203] Reflectivity Index Golomb order (RefGolombNum): unsigned integer between 0 and 8. It is used to indicate the K-order Index Golomb order K = RefGolombNum used when decoding the current reflectivity prediction residual or transform coefficient.

[0204] The decoding mode flag field of the current coefficient to be decoded (coeffEncodeModeFlag): a binary variable. A value of '1' indicates that the point cloud attribute transformation coefficient is decoded according to the first decoding mode; a value of '0' indicates that the point cloud attribute transformation coefficient is decoded according to the second decoding mode.

[0205] Point cloud adaptive quantization tool flag field (colorQPAdjustFlag): a binary variable. A value of '0' means turning off the point cloud adaptive quantization tool; a value of '1' means turning on the point cloud adaptive quantization tool.

[0206] The ratio of the number of points before and after point cloud geometry quantization (colorQPAdjustScalar): unsigned integer. Used to calculate the distance threshold of the point cloud adaptive quantization tool.

[0207] Prediction accuracy value of reflectivity attribute (predFixedPointFracBit): unsigned integer. Used to indicate the shift accuracy of fixed-point operation in predicting reflectivity attribute. predFixedPointFracBit=0 means that fixed-point operation is not used.

[0208] Attribute value change statistics window size (log2_pred_dist_weight_group_size): unsigned integer. Used to control the size of the attribute value change statistics window. The calculation of the window size is N = 2 log2_pred_dist_weight_group_size .

[0209] The above content introduces the syntax elements of the general attribute header of the point cloud frame. The following introduces the decoding indication information set in the attribute header of the point cloud frame:

[0210] (1) Decoding instructions for cross-type attribute prediction:

[0211] The decoding indication information may include attribute presence flag fields (attributePresentFlag[attrIdx]) under N attribute types, where N represents the number of attribute indexes (attrIdx), and N is an integer greater than or equal to 2; the attribute presence flag field under any attribute type is used to indicate the existence of attribute encoding under the corresponding attribute type in the point cloud frame; if the attribute presence flag field under any attribute type is a first value (for example, the first value may be 0), it may indicate that the attribute encoding under the corresponding attribute type does not exist in the point cloud frame; if the attribute presence flag field under any attribute type is a second value (for example, the second value may be 1), it may indicate that the attribute encoding under the corresponding attribute type exists in the point cloud frame. For example, attrIdx=0 indicates the color attribute type, attrIdx=1 indicates the reflectivity attribute type, attributePresentFlag[0]=0 indicates that the attribute code of the color attribute type does not exist in the point cloud frame, attributePresentFlag[0]=1 indicates that the attribute code of the color attribute type exists in the point cloud frame, attributePresentFlag[1]=0 indicates that the attribute code of the reflectivity attribute type does not exist in the point cloud frame, and attributePresentFlag[1]=1 indicates that the attribute code of the reflectivity attribute type exists in the point cloud frame. If the attribute existence flag field under at least two attribute types among the N attribute types is the second value (i.e., the attribute code of at least two attribute types among the N attribute types exists in the point cloud frame), and the point cloud frame allows cross-type attribute prediction, the decoding indication information also includes cross-type attribute prediction parameters (including cross-type attribute prediction weight parameter 1 (crossAttrTypePredParam1) and cross-type attribute prediction weight parameter 2 (crossAttrTypePredParam2)). That is to say, the attribute existence flag field under N attribute types can be parsed first, and after determining that the attribute existence flag field under at least two attribute types in the N attribute types is the second value, and the point cloud frame allows cross-type attribute prediction, the cross-type attribute prediction parameter is parsed, and the cross-type attribute prediction parameter is used to perform attribute decoding instructions on the point cloud frame regarding cross-type attribute prediction. Specifically, it can be reflected in the attribute header shown in Table 3 and Table 4 below:

[0212] Table 3

[0213]

[0214]

[0215] The parsing process of the decoding indication information in the attribute header shown in Table 3 above is as follows: first parse the attribute presence flag fields under N attribute types, and when it is determined that the attribute presence flag fields under at least two attribute types among the N attribute types are the second value (for example, attributePresentFlag[0]=1&&attributePresentFlag[1]=1), parse the cross-type attribute prediction field (crossAttrTypePred); if the cross-type attribute prediction field is the second value (crossAttrTypePred=1), it can indicate that the point cloud frame allows cross-type attribute prediction, and then parse the cross-type attribute prediction parameters (crossAttrTypePredParam1 and crossAttrTypePredParam2). In this case, by default, the corresponding cross-type attribute prediction parameters are used only when the post-prediction attribute type performs attribute prediction.

[0216] Table 4

[0217]

[0218]

[0219]

[0220]

[0221] The parsing process of the decoding indication information in the attribute header shown in Table 4 above is as follows: after parsing the attribute presence flag fields under N attribute types, when it is determined that the attribute presence flag fields under at least two attribute types among the N attribute types are the second value (for example, attributePresentFlag[0]=1&&attributePre sentFlag[1]=1), parse the cross-type attribute prediction field (crossAttrTypePred); if the cross-type attribute prediction field is the second value (crossAttrTypePred=1), it can indicate that the point cloud frame allows cross-type attribute prediction, and then parse the cross-type attribute prediction parameters (crossAttrTypePredParam1 and crossAttrTypePredParam2). In this case, by default, the corresponding cross-type attribute prediction parameters are used only when the post-prediction attribute type performs attribute prediction.

[0222] In one implementation, the decoding indication information may further include an attribute encoding order field (attrEncodeOrder), which may be used to indicate the first-encoded attribute type of the point cloud frame and the second-encoded attribute type of the point cloud frame; for example, attrEncodeOrder=0 indicates that the first-encoded attribute type is a color attribute type and the second-encoded attribute type is a reflectivity attribute type, and attrEncodeOrder=1 indicates that the first-encoded attribute type is a reflectivity attribute type and the second-encoded attribute type is a color attribute type. In this case, the cross-type attribute prediction parameter may include the cross-type attribute prediction parameter of the second-encoded attribute type. That is, after determining that the attribute existence flag field under at least two attribute types in the N attribute types is the second value and the point cloud frame allows cross-type attribute prediction, the attribute encoding order field may be parsed to determine the first-encoded attribute type and the second-encoded attribute type of the point cloud frame, and the corresponding cross-type attribute prediction parameter may be used when the second-encoded attribute type is used for attribute prediction. This may be specifically embodied in the attribute header shown in Table 5 below:

[0223] Table 5

[0224]

[0225]

[0226] The parsing process of the decoding indication information in the attribute header shown in Table 5 above is as follows: after parsing and determining that the point cloud frame allows cross-type attribute prediction, the attribute encoding order field (attrEncodeOrder) can be parsed. If attrEncodeOrder=0, it can be determined that the first encoded attribute type is the reflection attribute type, and the second encoded attribute type is the reflectivity attribute type. The cross-type attribute prediction parameters (crossAttrTypePredParam1 and crossAttrTypePredParam2) of the reflectivity attribute type can be parsed.

[0227] In one implementation, the decoding indication information may also include an index flag field (crossAttrPredictorIndex) for cross-attribute type prediction, and the index flag field for cross-attribute type prediction may be used to indicate the attribute information index value under the first predicted attribute type used when the later predicted attribute type performs cross-attribute type prediction. That is, after determining that the attribute existence flag field under at least two attribute types in the N attribute types is the second value through analysis, and the point cloud frame allows cross-type attribute prediction, the index flag field (crossAttrPredictorIndex) for cross-attribute type prediction may be analyzed to determine the attribute information index value under the first predicted attribute type used when the later predicted attribute type performs cross-attribute type prediction. For example, in this case, the cross-type attribute prediction field of the first predicted attribute type is the first value (crossAttrType Pred=0), indicating that the point cloud frame does not allow cross-attribute type prediction, and the cross-type attribute prediction field of the later predicted attribute type is the second value (crossAttrTypePred=1), indicating that the point cloud frame allows cross-attribute type prediction. For example, the attribute type is first predicted as the color attribute type, and then the attribute type is predicted as the reflectance attribute type. When performing cross-type attribute prediction on the reflectance attribute, the index flag field (crossAttrPredictorIndex) of the cross-attribute type prediction can be parsed to determine which color component under the color attribute type is used for cross-type attribute prediction. This can be specifically reflected in the attribute header shown in Table 6 below:

[0228] Table 6

[0229]

[0230]

[0231] In one implementation, the cross-type attribute prediction parameter may be indicated by the attribute type index field (attrIdx) and the attribute information index field under the attribute type, and the attribute type index field (attrId x) and the attribute information index field under the attribute type may indicate which attribute type the cross-type attribute prediction parameter is, and which attribute information under the attribute type is the cross-type attribute prediction parameter used when performing cross-type attribute prediction. Specifically, it may be embodied in the attribute header shown in Table 7 below:

[0232] Table 7

[0233]

[0234]

[0235] As shown in the attribute header in Table 7 above, crossAttrTypePredParam1[attrIdx][i] indicates that the cross-type attribute prediction parameter (crossAttrTypePredParam1) is the cross-type attribute prediction parameter of the i-th attribute information under the attrIdx-th attribute type. Similarly, crossAttrTypePredParam2[attrIdx][i] indicates that the cross-type attribute prediction parameter (crossAttrTypePredParam2) is the cross-type attribute prediction parameter of the i-th attribute information under the attrIdx-th attribute type. It should be noted that the cross-type attribute prediction parameter is indicated by the attribute type index field (attrIdx) and the attribute information index field under the attribute type, and can be combined with any of the attribute headers shown in Tables 1 to 6 above.

[0236] In one implementation, when there are multiple attribute information in the post-encoded attribute type, the cross-type attribute prediction parameter may include the cross-type attribute prediction parameter of each attribute information under the post-encoded attribute type; that is, after parsing and determining that the attribute existence flag field under at least two attribute types in the N attribute types is the second value, and the point cloud frame allows cross-type attribute prediction, if there are multiple attribute information in the post-encoded attribute type, the cross-type attribute prediction parameter of each attribute information under the post-encoded attribute type may be parsed in turn. Specifically, it may be embodied in the attribute header shown in Table 8 below:

[0237] Table 8:

[0238]

[0239]

[0240] The parsing process of the decoding indication information in the attribute header shown in Table 8 is as follows: after parsing and determining that the point cloud frame allows cross-type attribute prediction, the attribute encoding order field (attrEncodeOrder) can be parsed. If attrEncodeOrder=1, it can be determined that the first encoded attribute type is the reflectivity attribute type, and the second encoded attribute type is the color attribute type. attribute_info_num_set_minus1[! attrEncodeOrder]+1 indicates the number of attribute information included in the color attribute type, and the cross-type attribute prediction parameters (crossAttrTypePredParam1 and crossAttrTypePredParam2) under each attribute information included in the color attribute type can be parsed in turn.

[0241] (2) Decoding instructions for color space conversion:

[0242] The decoding indication information may include an attribute space conversion flag field (colorSpaceTransferFlag), which can be used to indicate the conversion of the attribute space of the point cloud frame; if the attribute space conversion flag field is a first value (for example, the first value may be 0), it may indicate that the point cloud frame has not undergone attribute space conversion; if the attribute space conversion flag field is a second value (for example, the second value may be 1), it may indicate that the point cloud frame has undergone attribute space conversion, for example, the point cloud frame has undergone conversion from a first color space (RGB color space) to a second color space (YUV color space).

[0243] In one implementation, the attribute space is a color space, and if the attribute space conversion flag field is a second value (colorSpaceTransferFlag=1), the decoding indication information may also include a frame attribute quantization parameter control field; that is, the frame attribute quantization parameter control field may be parsed after the attribute space conversion flag field is parsed as the second value. The frame attribute quantization parameter control field may be used to control the attribute quantization parameters of the point cloud frame, and the attribute quantization parameters of the point cloud frame may be used to perform attribute decoding instructions on the attribute quantization of the point cloud frame; the frame attribute quantization parameter control field includes any of the following: color attribute quantization parameter offset, attribute quantization parameter offset of each color component. Specifically, it may be embodied in the following code 1:

[0244] if(colorSpaceTransferFlag){

[0245] chromaQpOffsetCb[i]

[0246] chromaQpOffsetCr[i]

[0247] }

[0248] As shown in the above code 1, the attribute space conversion flag field (colorSpaceTransferFlag) can be parsed. If colorSpaceTransferFlag=1, it can indicate that the point cloud frame is converted to an attribute space, and the frame attribute quantization parameter control field can be parsed, which can specifically refer to the frame attribute quantization parameter control field of the converted attribute space. In the above code 1, the frame attribute quantization parameter control field can include the frame color chroma Cb attribute quantization parameter offset (chromaQpOffsetCb) and the frame color chroma Cr attribute quantization parameter offset (chromaQpOffsetCr); the frame color chroma Cb attribute quantization parameter offset (chromaQpOffsetCb) is a signed integer, which can be used to control the Cb component quantization parameter of the frame-level color attribute, and the value range is -16 to 16; the frame color chroma Cr attribute quantization parameter offset (chromaQpOffset Cr) is a signed integer, which can be used to control the Cr component quantization parameter of the frame-level color attribute, and the value range is -16 to 16.

[0249] In one implementation, if the attribute space conversion flag field is the first value (colorSpaceTransferFlag=0), the decoding indication information may also include an attribute residual multiple prediction field (cross_component_Pred); that is, after parsing the attribute space conversion flag field as the first value, the attribute residual multiple prediction field may be parsed. The attribute residual multiple prediction field may be used to indicate whether the point cloud frame allows multiple predictions of the attribute residual. Specifically, it may be embodied in the following code 2:

[0250] if(!colorSpaceTransferFlag){

[0251] cross_component_Pred[i]

[0252] }

[0253] As shown in the above code 2, the attribute space conversion flag field (colorSpaceTransferFlag) can be parsed first. If colorSpaceTransferFlag = 0, it can indicate that the point cloud has not been converted to the attribute space, and the attribute residual multiple prediction field (cross_component_Pred) can be parsed. The attribute residual multiple prediction field (cross_component_Pred) can specifically be the attribute residual secondary prediction field, which is a binary variable. The value of '1' indicates that the attribute residual secondary prediction is allowed, and the value of '0' indicates that the attribute residual secondary prediction is not allowed.

[0254] In one implementation, if the attribute space conversion flag field is the first value (colorSpaceTransferFlag = 0), the decoding indication information may also include a transform residual layer flag field (transResLayer); that is, after parsing the attribute space conversion flag field as the first value, the transform residual layer flag field (transResLayer) may be parsed. The transform residual layer flag field may be used to control the use of attribute residual compensation by the point cloud frame when the point cloud frame uses the attribute encoding mode of the multi-layer transform algorithm. Specifically, it may be embodied in the following code 3:

[0255] if(!colorSpaceTransferFlag){

[0256] transResLayer[attrIdx][i]

[0257] }

[0258] As shown in the above code 3, the attribute space conversion flag field (colorSpaceTransferFlag) can be parsed first. If colorSpaceTransferFlag = 0, it can indicate that the point cloud has not been converted to the attribute space. The transform residual layer flag field (transResLayer) can be parsed. The transform residual layer flag field (transResLayer) is a binary variable and can be used in the multi-layer transformation algorithm of attribute compression (transform = 1) to control whether to use attribute residual compensation. When transResLayer = 1, it indicates that attribute residual compensation is used. When transResLayer = 0, it indicates that attribute residual compensation is not used.

[0259] (3) Decoding indication information about attribute coding mode and attribute index:

[0260] The decoding indication information may include an attribute coding mode flag field (transform), which may be used to indicate the attribute coding mode of the point cloud frame. The attribute coding mode flag field (transform) is an unsigned integer between 0 and 2. When transform=0, it may indicate that the attribute coding mode of the point cloud frame is an attribute prediction mode. When transform=1, it may indicate that the attribute coding mode of the point cloud frame is an attribute transformation mode (e.g., a multi-layer transformation mode). When transform=2, it may indicate that the attribute coding mode of the point cloud frame is an attribute prediction transformation mode.

[0261] The decoding indication information may also include an attribute type index field (attrIdx), which may be used to indicate the attribute type of the point cloud frame. The attribute type index field (attrIdx) is an unsigned integer. When attrIdx=0, it may indicate that the attribute type of the point cloud frame is a color attribute type. When attrIdx=1, it may indicate that the attribute type of the point cloud frame is a reflectivity attribute type.

[0262] The syntax elements in the attribute header of the point cloud frame can be organized based on the attribute coding mode field and / or the attribute type index field. Specifically, it can be embodied in the attribute header shown in Table 4 above and the attribute header shown in Table 9 below:

[0263] Table 9

[0264]

[0265]

[0266]

[0267]

[0268] As shown in the above Table 9, the attribute header: attrIdx==0 indicates the 0th attribute type (ie, color type); transform[attrIdx][i]==0 indicates that the attribute coding mode of the i-th attribute information under the attrIdx-th attribute type is the attribute prediction coding mode.

[0269] (4) Decoding indication information about attribute quantization parameters:

[0270] As described above, the decoding indication information may include attribute presence flag fields (attributePresentFlag[attrIdx]) under N attribute types, where N represents the number of attribute indexes (attrIdx), and N is an integer greater than or equal to 2; the attribute presence flag field under any attribute type can be used to indicate the existence of attribute encoding under the corresponding attribute type in the point cloud frame; if the attribute presence flag field under any attribute type is a first value (for example, the first value may be 0), it may indicate that the attribute encoding under the corresponding attribute type does not exist in the point cloud frame; if the attribute presence flag field under any attribute type is a second value (for example, the second value may be 1), it may indicate that the attribute encoding under the corresponding attribute type exists in the point cloud frame. For example, attrIdx=0 indicates the color attribute type, attrIdx=1 indicates the reflectivity attribute type, attributePresentFlag[0]=0 indicates that the attribute code of the color attribute type does not exist in the point cloud frame, attributePresentFlag[0]=1 indicates that the attribute code of the color attribute type exists in the point cloud frame, attributePresentFlag[1]=0 indicates that the attribute code of the reflectivity attribute type does not exist in the point cloud frame, and attributePresentFlag[1]=1 indicates that the attribute code of the reflectivity attribute type exists in the point cloud frame.

[0271] If the attribute existence flag field under the target attribute type among the N attribute types is a second value, the decoding indication information may also include a frame attribute quantization parameter control field under the target attribute type; the frame attribute quantization parameter control field under the target attribute type may be used to control the attribute quantization parameters of the point cloud frame under the target attribute type, and the attribute quantization parameters under the target attribute type may be used to perform attribute decoding indications on the point cloud frame regarding the attribute quantization under the target attribute type.

[0272] When the target attribute type is a reflectivity attribute, the attribute quantization parameter control field under the target attribute type may include a reflectivity attribute quantization parameter offset field, which may be specifically embodied in the following code 4:

[0273] if (attributePresentFlag[1]) {

[0274] reflQpOffset[i]

[0275] }

[0276] As shown in the above code 4, the attribute presence flag field (attributePresentFlag[1]) under the reflectivity attribute type can be parsed first. If attributePresentFlag[1]=1, it can indicate that the attribute encoding under the reflectivity attribute type exists in the point cloud frame, and the reflectivity attribute quantization parameter offset (reflQpOf fset) can be parsed. The reflectivity attribute quantization parameter offset (reflQpOffset) is a signed integer that can be used to control the attribute quantization parameter of the frame-level reflectivity attribute.

[0277] When the target attribute type is a color attribute, the attribute quantization parameter control field under the target attribute type may include any of the following: a color attribute quantization parameter offset, an attribute quantization parameter offset of each color component.

[0278] Specifically, it can be shown in the following code 5 or code 6:

[0279] Code 5:

[0280] if (attributePresentFlag[0]) {

[0281] colorQpOffset[i]

[0282] }

[0283] As shown in the above code 5, the attribute presence flag field (attributePresentFlag[0]) under the color attribute type can be parsed first. If attributePresentFlag[0]=1, it can indicate that the attribute encoding under the color attribute type exists in the point cloud frame, and the color attribute quantization parameter offset (colorQpOffset) can be parsed. The color attribute quantization parameter offset (colorQpOffset) is a signed integer, which can be used to control the attribute quantization parameter of the frame-level color attribute, and can synchronously control each color component under the color attribute, and can be designed as a three-component parameter.

[0284] Code 6:

[0285] if (attributePresentFlag[0]) {

[0286] LumaQPOffset[i]

[0287] chromaCbQPoffset[i]

[0288] chromaCrQPoffset[i]

[0289] }

[0290] As shown in the above code 6, the attribute presence flag field (attributePresentFlag[0]) under the color attribute type can be parsed first. If attributePresentFlag[0]=1, it can indicate that the attribute encoding under the color attribute type exists in the point cloud frame, and the attribute quantization parameter offset of each color component can be parsed. The attribute quantization parameter offset of each color component may include: frame color brightness attribute quantization parameter offset (LumaQPOffset), frame color chroma Cb attribute quantization parameter offset (chromaCbQPoffset), and frame color chroma Cr attribute quantization parameter offset (chromaCrQPoffset). The frame color brightness attribute quantization parameter offset (LumaQPOffset) is a signed integer, which can be used to control the brightness component quantization parameter of the frame-level color attribute, and the value range is -32 to 32; the frame color chroma Cb attribute quantization parameter offset (chromaCbQPoffset) is a signed integer, which can be used to control the Cb component quantization parameter of the frame-level color attribute, and the value range is -32 to 32; the frame color chroma Cr attribute quantization parameter offset (chromaCrQPoffset) is a signed integer, which can be used to control the Cr component quantization parameter of the slice-level color attribute, and the value range is -32 to 32.

[0291] 2. Decoding indication information set in the frame header:

[0292] The point cloud may include multiple point cloud frames, and the decoding indication information may be set in the frame header of the point cloud frame. The decoding indication information set in the frame header of the point cloud frame may be used to indicate the decoding of the point cloud frame. The decoding indication information in the frame header is introduced below in conjunction with the syntax elements of the frame header. An exemplary syntax element of the frame header may be shown in Table 10 below:

[0293] Table 10

[0294]

[0295]

[0296] The syntax elements in the frame header shown in Table 10 above are explained below:

[0297] Frame number field (frame_idx): This field indicates the number of the point cloud frame in the point cloud sequence. The value range of the point cloud frame number is 0 to 65535. The number of each point cloud frame is the number of the previous point cloud frame plus 1, and the first point cloud frame number is 0. When the number of a point cloud frame reaches 65535, the number of the next point cloud frame is reset to 0.

[0298] The number of point cloud slices in a frame minus one field (frame_num_slice_minus_one): The value of this field is the number of point cloud slices in a point cloud frame minus one.

[0299] Timestamp flag field (timestamp_flag): a binary variable. A value of '0' indicates that the point cloud frame does not contain timestamp information; a value of '1' indicates that the point cloud frame contains timestamp information.

[0300] Timestamp field (timestamp): indicates UTC (Universal Time Coordinated).

[0301] Frame point number upper flag field (geom_num_points_upper): 16-bit number. Indicates the upper 16 bits of the number of points to be decoded (32-bit unsigned integer) contained in the point cloud frame after possible geometric quantization and deduplication.

[0302] Frame point number low flag field (geom_num_points_lower): 16-bit number. Indicates the lower 16 bits of the number of points to be decoded (32-bit unsigned integer) contained in the point cloud frame after possible geometric quantization and deduplication.

[0303] Based on the above Table 10, it can be known that the decoding indication information set in the frame header of the point cloud frame may include a frame point number flag field, and the frame point number flag field may be used to indicate the number of points to be decoded contained in the point cloud frame (specifically, the number of points to be decoded contained in the point cloud frame after possible geometric quantization and deduplication, and the number of points to be decoded is a 32-bit unsigned integer). In more detail, the frame point number flag field may include a frame point number upper flag field (geom_num_points_upper) and a frame point number lower flag field (geom_num_points_lower); the frame point number upper flag field may be used to indicate the high-order information of the number of points to be decoded contained in the point cloud frame (specifically, the upper 16 bits of the 32-bit unsigned integer of the number of points to be decoded contained in the point cloud frame after possible geometric quantization and deduplication), and the frame point number lower flag field may be used to indicate the low-order information of the number of points to be decoded contained in the point cloud frame (specifically, the lower 16 bits of the 32-bit unsigned integer of the number of points to be decoded contained in the point cloud frame after possible geometric quantization and deduplication). The number of points to be decoded contained in the point cloud frame may be determined based on the high-order information and the low-order information, and the specific determination method is: the number of points to be decoded contained in the point cloud frame (geom_num_points) = (geom_num_points_upper) << 16 + geom_num_points_lower.

[0304] In addition, the decoding indication information set in the frame header of the point cloud frame may also include a frame slice number flag field (i.e., the number of point cloud slices in the frame minus one field (frame_num_slice_minus_one)). The frame slice number flag field can be used to indicate the number of point cloud slices contained in the point cloud frame. The number of point cloud slices is calculated as: number of point cloud slices = frame_num_slice_minus_one+1.

[0305] 3. Decoding instruction information set in the slice header:

[0306] The point cloud may include multiple point cloud frames, and the point cloud frame may include multiple point cloud slices. The decoding indication information may be set in the header of the point cloud slice, and the decoding indication information set in the header of the point cloud slice may be used to provide decoding instructions for the point cloud slice; the header may include a geometric header and an attribute header, and the decoding indication information may be set in the geometric header and the attribute header.

[0307] (1) The decoding indication information in the geometry slice header is introduced below in combination with the syntax elements of the geometry slice header. An exemplary syntax element of the geometry slice header can be seen in the following Table 11:

[0308] Table 11

[0309]

[0310] The syntax elements in the geometry slice header shown in Table 11 above are explained below:

[0311] Slice ID (slice_id): unsigned integer, indicating the slice ID.

[0312] Slice_num_points_upper field: unsigned integer. Indicates the upper 16 bits of the number of points to be decoded contained in the point cloud slice (32-bit unsigned integer).

[0313] Slice_num_points_lower field: unsigned integer. Indicates the lower 16 bits of the number of points to be decoded contained in the point cloud slice (32-bit unsigned integer).

[0314] Based on the above Table 11, it can be seen that the decoding indication information set in the geometric slice header of the point cloud slice may include a slice point number flag field, and the slice point number flag field can be used to indicate the number of points to be decoded contained in the point cloud slice (32-bit unsigned integer). In more detail, the slice point number flag field includes a slice point number high-order flag field (i.e., the high-order part of the number of points contained in the slice field (slice_num_points_upper)) and a slice point number low-order flag field (i.e., the low-order part of the number of points contained in the slice field (slice_num_points_lower)); the slice point number high-order flag field (sl ice_num_points_upper) can be used to indicate the high-order information of the number of points to be decoded contained in the point cloud slice (specifically, the high 16 bits of the number of points to be decoded contained in the point cloud slice (32-bit unsigned integer)), and the slice point number low-order flag field (slice_num_points_lower) can be used to indicate the low-order information of the number of points to be decoded contained in the point cloud slice (specifically, the low 16 bits of the number of points to be decoded contained in the point cloud slice (32-bit unsigned integer)). The number of points to be decoded contained in the point cloud slice can be determined based on the high-bit information and the low-bit information. The specific determination method is: the number of points to be decoded contained in the point cloud slice (slice_num_points) = ((slice_num_points_upper<<16)+slice_num_points_lower).

[0315] (2) The decoding indication information in the attribute slice header is introduced below in combination with the syntax elements of the attribute slice header. An exemplary syntax element of the attribute slice header can be seen in the following Table 12:

[0316] Table 12

[0317]

[0318] The syntax elements in the attribute slice header shown in Table 12 above are explained below:

[0319] Slice ID (slice_id): unsigned integer, indicating the slice ID.

[0320] Slice reflectivity attribute quantization parameter offset (sliceReflQPoffset): signed integer. Attribute quantization parameter used to control slice-level reflectivity attribute, with a value range of -32 to 32.

[0321] Slice Color Brightness Attribute Quantization Parameter Offset (sliceColorQPoffset): Signed integer. Attribute quantization parameter used to control slice-level color attributes, with a value range of -32 to 32.

[0322] Another exemplary syntax element of the attribute slice header can be seen in the following Table 13:

[0323] Table 13

[0324]

[0325]

[0326] The syntax elements in the attribute slice header shown in Table 13 above are explained below:

[0327] Slice ID (slice_id): unsigned integer, indicating the slice ID.

[0328] Slice reflectivity attribute quantization parameter offset (sliceReflQPoffset): signed integer. Attribute quantization parameter used to control slice-level reflectivity attribute, with a value range of -32 to 32.

[0329] Slice color luminance attribute quantization parameter offset (sliceLumaQPoffset): signed integer. Used to control the quantization parameter of the luminance component of the slice-level color attribute, with a value range of -32 to 32.

[0330] SliceChromaCbQPoffset: signed integer. Used to control the Cb component quantization parameter of slice-level color attributes, with a value range of -32 to 32.

[0331] SliceChromaCrQPoffset: signed integer. Used to control the quantization parameter of the Cr component of the slice-level color attribute, with a value range of -32 to 32.

[0332] Based on the above Tables 12 and 13, it can be seen that the decoding indication information set in the attribute slice header of the point cloud slice may include a slice attribute quantization parameter control field, and the slice attribute quantization parameter control field can be used to control the attribute quantization parameters of the point cloud slice, and the attribute quantization parameters of the point cloud slice can be used to perform attribute decoding instructions on attribute quantization for the point cloud slice. Among them, the slice attribute quantization parameter control field may include: a slice reflectance attribute quantization parameter control field (i.e., a slice reflectance attribute quantization parameter offset (sliceReflQPoffset)) and a slice color attribute quantization parameter control field (i.e., a slice color luminance attribute quantization parameter offset (sliceColor QPoffset)); or, the slice attribute quantization parameter control field may include: a slice reflectance attribute quantization parameter control field (i.e., a slice reflectance attribute quantization parameter offset (sliceReflQPoffset)) and a slice color component attribute quantization parameter control field (i.e., a slice color luminance attribute quantization parameter offset (sliceLumaQPoffset), a slice color chroma Cb attribute quantization parameter offset (sliceChromaCbQPoffset), and a slice color chroma Cr attribute quantization parameter offset (sliceChromaCrQPoffset)).

[0333] S302: Decode the point cloud according to the decoding instruction information.

[0334] After acquiring the point cloud code stream, the point cloud can be decoded according to the decoding instruction information in the point cloud code stream. More specifically, when the decoding instruction information is set in the attribute header of the point cloud frame, the attribute decoding of the point cloud frame can be performed according to the decoding instruction information set in the attribute header of the point cloud frame; when the decoding instruction information is set in the frame header of the point cloud frame, the point cloud frame can be decoded according to the decoding instruction information set in the frame header of the point cloud frame; when the decoding instruction information is set in the header of the point cloud slice, the point cloud slice can be decoded according to the decoding instruction information set in the header of the point cloud slice.

[0335] In an embodiment of the present application, the decoding indication information in the point cloud code stream can be used to provide decoding instructions for different types of data in the point cloud, and the different types of data include at least one of the following: point cloud frames and point cloud slices. Thus, based on the decoding indication effect of the decoding indication information on different types of data in the point cloud, the point cloud is decoded according to the decoding indication information, thereby improving the decoding performance of the point cloud.

[0336] The present application embodiment provides a point cloud processing method, which mainly introduces the point cloud encoding process. The point cloud processing method can be executed by a computer device, which can be the encoding device 201 in the above-mentioned point cloud processing system. Figure 4As shown, the point cloud processing method may include but is not limited to the following steps S401-S402:

[0337] S401, generate decoding indication information, and encode the decoding indication information into the point cloud code stream; the decoding indication information is used to provide decoding instructions for different types of data in the point cloud, and the different types of data include at least one of the following: point cloud frames and point cloud slices.

[0338] Decoding indication information can be used to indicate decoding of different types of data in the point cloud, and decoding indication information can be encoded into the attribute header, frame header, and slice header of the point cloud code stream. Specifically, the decoding indication information encoded into the attribute header can be used to indicate attribute decoding of the point cloud frame in the point cloud; the decoding indication information encoded into the frame header can be used to indicate decoding of the point cloud frame in the point cloud; the decoding indication information encoded into the slice header can be used to indicate decoding of the point cloud slice in the point cloud. The following is an introduction to the generation process of the decoding indication information in the encoding attribute header, frame header, and slice header:

[0339] 1. Decoding instructions encoded into the attribute header:

[0340] The point cloud may include multiple point cloud frames, and the decoding indication information may be encoded into the attribute header of the point cloud frame. The decoding indication information encoded into the attribute header of the point cloud frame is used to perform attribute decoding indication on the point cloud frame.

[0341] (1) Decoding instructions for cross-type attribute prediction:

[0342] The decoding indication information may include attribute presence flag fields (attributePresentFlag[attrIdx]) under N attribute types, where N represents the number of attribute indexes (attrIdx) and N is an integer greater than or equal to 2; the attribute presence flag field under any attribute type is used to indicate the existence of attribute encoding under the corresponding attribute type in the point cloud frame. Generating the decoding indication information may specifically include: if the attribute encoding under any attribute type does not exist in the point cloud frame, the attribute presence flag field under the corresponding attribute type may be set to a first value (for example, the first value may be 0); if the attribute encoding under any attribute type exists in the point cloud frame, the attribute presence flag field under the corresponding attribute type may be set to a second value (for example, the second value may be 1). For example, attrIdx=0 indicates the color attribute type, and attrIdx=1 indicates the reflectivity attribute type; if there is no attribute encoding of the color attribute type in the point cloud frame, attributePresentFlag[0]=0; if there is an attribute encoding of the color attribute type in the point cloud frame, attributePresentFlag[0]=1; if there is no attribute encoding of the reflectivity attribute type in the point cloud frame, attributePresentFlag[1]=0; if there is an attribute encoding of the reflectivity attribute type in the point cloud frame, attributePresentFlag[1]=1. If the attribute presence flag field under at least two attribute types among the N attribute types is set to the second value, and the point cloud frame allows cross-type attribute prediction, a cross-type attribute prediction parameter can be added to the decoding indication information; wherein the cross-type attribute prediction parameter can be used to perform attribute decoding indication on the point cloud frame regarding cross-type attribute prediction; specifically, when the attribute presence flag field under at least two attribute types among the N attribute types is set to the second value (for example, attributePresentFlag[0]=1&&attributePresentFlag[1]=1), if it is recognized that the point cloud frame allows cross-type attribute prediction, a cross-type attribute prediction field (crossAttrTypePred) can be added to the decoding indication information, and the cross-type attribute prediction field can be set to the second value (crossAttrTypePred=1), and then, cross-type attribute prediction parameters (crossAttrTypePredParam1 and crossAttrTypePredParam2) can be added to the decoding indication information.

[0343] In one implementation, the decoding indication information may further include an attribute encoding order field, and the attribute encoding order field may be used to indicate the first-encoded attribute type of the point cloud frame and the post-encoded attribute type of the point cloud frame; the cross-type attribute prediction parameter may include the cross-type attribute prediction parameter of the post-encoded attribute type. Specifically, after the cross-type attribute prediction field (crossAttrTypePred) is included in the decoding indication information and the cross-type attribute prediction field is set to a second value (crossAttrTypePred=1), the attribute encoding order field (attrEncodeOrder) may be added to the decoding indication information, and the value of the attribute encoding order field (attrEncodeOrder) may be determined according to the first-encoded attribute type of the point cloud frame and the post-encoded attribute type of the point cloud frame, and then, according to the post-encoded attribute type of the point cloud frame, the cross-type attribute prediction parameter of the post-encoded attribute type of the point cloud frame may be added to the decoding indication information.

[0344] In one implementation, the decoding indication information may further include a cross-attribute type prediction index flag field (crossAttrPredictorIndex), which may be used to indicate the attribute information index value under the first-predicted attribute type used when the second-predicted attribute type performs cross-attribute type prediction.

[0345] In one implementation, the cross-type attribute prediction parameter may be indicated using an attribute type index field (attrIdx) and an attribute information index field under the attribute type. The attribute type index field (attrId x) and the attribute information index field under the attribute type may indicate which attribute type the cross-type attribute prediction parameter is, and which attribute information under the attribute type is the cross-type attribute prediction parameter used when performing cross-type attribute prediction.

[0346] In one implementation, when there are multiple attribute information of the post-encoded attribute type, the cross-type attribute prediction parameter may include the cross-type attribute prediction parameter of each attribute information under the post-encoded attribute type. Specifically, after the cross-type attribute prediction field (crossAttrTypePred) is set to the second value (crossAttrTypePred=1) in the decoding indication information, the cross-type attribute prediction parameter of each attribute information under the post-encoded attribute type may be added in the decoding indication information.

[0347] (2) Decoding instructions for color space conversion:

[0348] The decoding indication information may include an attribute space conversion flag field (colorSpaceTransferFlag), and the attribute space conversion flag field may be used to indicate the conversion status of the attribute space of the point cloud frame; generating the decoding indication information may specifically include: if the point cloud frame has not undergone attribute space conversion, the attribute space conversion flag field may be set to a first value (colorSpaceTransferFlag=0); if the point cloud frame has undergone attribute space conversion, the attribute space conversion flag field may be set to a second value (colorSpaceTransferFl ag=1).

[0349] In one implementation, the attribute space is a color space; if the attribute space conversion flag field is set to the second value (colorSpaceTransferFlag=1), a frame attribute quantization parameter control field may be added to the decoding indication information; the frame attribute quantization parameter control field may be used to control the attribute quantization parameters of the point cloud frame, and the attribute quantization parameters of the point cloud frame may be used to perform attribute decoding instructions on attribute quantization of the point cloud frame. The frame attribute quantization control field may include any of the following: a color attribute quantization parameter offset, an attribute quantization parameter offset of each color component.

[0350] In one implementation, if the attribute space conversion flag field is set to the first value (colorSpaceTransferFlag=0), the attribute residual multiple prediction field (cross_component_Pred) can be added to the decoding indication information; the attribute residual multiple prediction field can be used to indicate whether the point cloud frame allows multiple prediction of attribute residuals.

[0351] In one implementation, if the attribute space conversion flag field is set to the first value (colorSpaceTransferFlag=0), the transform residual layer flag field (transResLayer) can be added to the decoding indication information; the transform residual layer flag field can be used to control the use of attribute residual compensation in the point cloud frame when the point cloud frame uses the attribute encoding mode of the multi-layer transformation algorithm.

[0352] (3) Decoding indication information about attribute coding mode and attribute index:

[0353] An attribute coding mode flag field is added to the decoding indication information, and the attribute coding mode flag field can be used to indicate the attribute coding mode of the point cloud frame. Also, an attribute type index field is added to the decoding indication information, and the attribute type index field can be used to indicate the attribute type of the point cloud frame.

[0354] The syntax elements in the attribute header of the point cloud frame can be organized based on the attribute coding mode field and / or the attribute type index field.

[0355] (4) Decoding indication information about attribute quantization parameters:

[0356] As described above, the decoding indication information may include attribute presence flag fields (attributePresentFlag[attrIdx]) under N attribute types, where N represents the number of attribute indexes (attrIdx), and N is an integer greater than or equal to 2; the attribute presence flag field under any attribute type is used to indicate the existence of attribute encoding under the corresponding attribute type in the point cloud frame. Generating the decoding indication information may specifically include: if the attribute encoding under any attribute type does not exist in the point cloud frame, the attribute presence flag field under the corresponding attribute type may be set to a first value (for example, the first value may be 0); if the attribute encoding under any attribute type exists in the point cloud frame, the attribute presence flag field under the corresponding attribute type may be set to a second value (for example, the second value may be 1). For example, attrIdx=0 indicates the color attribute type, and attrIdx=1 indicates the reflectivity attribute type; if there is no attribute encoding of the color attribute type in the point cloud frame, attributePresentFlag[0]=0; if there is an attribute encoding of the color attribute type in the point cloud frame, attributePresentFlag[0]=1; if there is no attribute encoding of the reflectivity attribute type in the point cloud frame, attributePresentFlag[1]=0; if there is an attribute encoding of the reflectivity attribute type in the point cloud frame, attributePresentFlag[1]=1.

[0357] If the attribute existence flag field under the target attribute type in the N attribute types is set to the second value, the frame attribute quantization parameter control field under the target attribute type can be added to the decoding indication information; the frame attribute quantization parameter control field under the target attribute type can be used to control the attribute quantization parameter of the point cloud frame under the target attribute type, and the attribute quantization parameter under the target attribute type can be used to perform attribute decoding indication on the point cloud frame about the attribute quantization under the target attribute type. When the target attribute type is a reflectivity attribute, the attribute quantization parameter control field under the target attribute type may include a reflectivity attribute quantization parameter offset (reflQpOffset); when the target attribute type is a color attribute, the attribute quantization parameter control field under the target attribute type may include any of the following: a color attribute quantization parameter offset (colorQpOffset), an attribute quantization parameter offset of each color component (frame color brightness attribute quantization parameter offset (LumaQPOffset), frame color chroma Cb attribute quantization parameter offset (chromaCbQPoffset), and frame color chroma Cr attribute quantization parameter offset (chromaCrQPoffset)).

[0358] 2. Decoding instructions encoded into the frame header:

[0359] The point cloud may include multiple point cloud frames, and the decoding indication information may be encoded into the frame header of the point cloud frame. The decoding indication information encoded into the frame header of the point cloud frame is used to indicate decoding of the point cloud frame.

[0360] The decoding indication information may include a frame point number flag field; generating the decoding indication information may specifically include: identifying the number of points to be encoded contained in the point cloud frame; setting the frame point number flag field to the number of points to be encoded. In more detail, the frame point number flag field may include a frame point number upper flag field (geom_num_points_upper) and a frame point number lower flag field (geom_num_points_lower); setting the frame point number flag field to the number of points to be encoded may specifically include: splitting the number of points to be encoded into upper information and lower information; setting the frame point number upper flag field to the upper information, and setting the frame point number lower flag field to the lower information.

[0361] In addition, the decoding indication information also includes a frame slice number flag field (frame_num_slice_minus_one); generating the decoding indication information may specifically include: identifying the number of point cloud slices contained in the point cloud frame; and setting the frame slice number flag field to the number of point cloud slices.

[0362] 3. Decoding instructions encoded into the slice header:

[0363] The point cloud may include multiple point cloud frames, and the point cloud frame may include multiple point cloud slices. The decoding indication information may be encoded in the header of the point cloud slice, and the decoding indication information encoded in the header of the point cloud slice may be used to indicate the decoding of the point cloud slice; the header may include a geometric header and an attribute header, and the decoding indication information may be encoded in the geometric header and the attribute header.

[0364] (1) Decoding instructions encoded in the geometry header:

[0365] The decoding indication information may include a slice point number flag field; generating the decoding indication information may specifically include: identifying the number of points to be encoded contained in the point cloud slice; setting the number flag field to the number of points to be encoded. Specifically, the slice point number flag field may include a slice point number upper flag field (slice_num_points_upper) and a slice point number lower flag field (slice_num_points_lower); setting the slice point number flag field to the number of points to be encoded may specifically include: splitting the number of points to be encoded into upper information and lower information; setting the slice point number upper flag field to the upper information, and setting the slice point number lower flag field to the lower information.

[0366] (2) Decoding instructions encoded in the attribute slice header:

[0367] For the decoding indication information in the attribute slice header, generating the decoding indication information may specifically include: adding a slice attribute quantization parameter control field in the decoding indication information, the slice attribute quantization parameter control field may be used to control the attribute quantization parameter of the point cloud slice, and the attribute quantization parameter of the point cloud slice may be used to perform attribute decoding indication on the attribute quantization of the point cloud slice. The slice attribute quantization parameter control field may include: a slice reflectance attribute quantization parameter control field (sliceReflQPoffset) and a slice color attribute quantization parameter control field (sliceColorQPoffset); or, the slice attribute quantization parameter control field includes: a slice reflectance attribute quantization parameter control field (sliceReflQPoffset) and a slice color component attribute quantization parameter control field (sliceLu maQPoffset, sliceChromaCbQPoffset, and sliceChromaCrQPoffset).

[0368] S402, sending the point cloud code stream to a decoding device, so that the decoding device decodes the point cloud according to the decoding instruction information.

[0369] In an embodiment of the present application, the decoding indication information in the point cloud code stream can be used to provide decoding instructions for different types of data in the point cloud, and the different types of data include at least one of the following: point cloud frames and point cloud slices. Thus, based on the decoding indication effect of the decoding indication information on different types of data in the point cloud, the point cloud is decoded according to the decoding indication information, thereby improving the decoding performance of the point cloud.

[0370] The method of the embodiment of the present application is described in detail above. In order to facilitate better implementation of the above scheme of the embodiment of the present application, the device of the embodiment of the present application is provided below accordingly.

[0371] See also Figure 5 , Figure 5 It is a structural schematic diagram of a point cloud processing device provided in an embodiment of the present application. The point cloud processing device can be set in the computer device provided in the embodiment of the present application, and the computer device can be the decoding device mentioned in the full text. Figure 5 The point cloud processing device shown may be a computer program (including program code) running in a computer device, and the point cloud processing device may be used to execute Figure 3 Some or all of the steps in the method embodiment shown. Figure 5 , the point cloud processing device may include the following units:

[0372] The acquisition unit 501 is used to acquire a point cloud code stream; the point cloud code stream includes decoding indication information, and the decoding indication information is used to indicate decoding of different types of data in the point cloud, and the different types of data include at least one of the following: a point cloud frame and a point cloud slice;

[0373] The processing unit 502 is used to decode the point cloud according to the decoding instruction information.

[0374] In one implementation, the point cloud includes multiple point cloud frames, the decoding indication information sets the attribute header of the point cloud frame, and the decoding indication information is used to perform attribute decoding indication on the point cloud frame.

[0375] In one implementation, the decoding indication information includes attribute existence flag fields under N attribute types, where N is an integer greater than or equal to 2; the attribute existence flag field under any attribute type is used to indicate the existence of attribute encoding of the point cloud frame under the corresponding attribute type;

[0376] If the attribute existence flag field under any attribute type is the first value, it means that the attribute code under the corresponding attribute type does not exist in the point cloud frame;

[0377] If the attribute existence flag field under any attribute type is the second value, it means that the attribute code under the corresponding attribute type exists in the point cloud frame.

[0378] In one implementation, if the attribute existence flag field of at least two attribute types among the N attribute types is a second value, and the point cloud frame allows cross-type attribute prediction, the decoding indication information further includes a cross-type attribute prediction parameter;

[0379] The cross-type attribute prediction parameter is used to provide attribute decoding instructions for the point cloud frame regarding the cross-type attribute prediction.

[0380] In one implementation, the decoding indication information further includes an attribute coding order field, and the attribute coding order field is used to determine a first-coded attribute type of the point cloud frame and a later-coded attribute type of the point cloud frame;

[0381] The cross-type attribute prediction parameters include cross-type attribute prediction parameters of the post-encoded attribute type.

[0382] In an implementation manner, when there are multiple attribute information in the post-encoded attribute type, the cross-type attribute prediction parameter includes the cross-type attribute prediction parameter of each attribute information under the post-encoded attribute type.

[0383] In one implementation, the decoding indication information further includes an index flag field for cross-attribute type prediction, which is used to indicate the attribute information index value under the first-predicted attribute type used when the second-predicted attribute type performs cross-attribute type prediction.

[0384] In one implementation, the cross-type attribute prediction parameter is indicated by using an attribute type index field and an attribute information index field under the attribute type.

[0385] In one implementation, if the attribute existence flag field under the target attribute type among the N attribute types is a second value, the decoding indication information further includes a frame attribute quantization parameter control field under the target attribute type;

[0386] The frame attribute quantization parameter control field under the target attribute type is used to control the attribute quantization parameter of the point cloud frame under the target attribute type, and the attribute quantization parameter under the target attribute type is used to perform attribute decoding instructions on the point cloud frame regarding the attribute quantization under the target attribute type;

[0387] When the target attribute type is the reflectance attribute, the attribute quantization parameter control field under the target attribute type includes the reflectance attribute quantization parameter offset; when the target attribute type is the color attribute, the attribute quantization parameter control field under the target attribute type includes any one of the following: color attribute quantization parameter offset, attribute quantization parameter offset of each color component.

[0388] In one implementation, the decoding indication information includes an attribute space conversion flag field, and the attribute space conversion flag field is used to indicate the conversion status of the attribute space of the point cloud frame;

[0389] If the attribute space conversion flag field is the first value, it means that the point cloud frame has not been converted to the attribute space;

[0390] If the attribute space conversion flag field is the second value, it means that the point cloud frame undergoes attribute space conversion.

[0391] In one implementation, the attribute space is a color space, and if the attribute space conversion flag field is a second value, the decoding indication information further includes a frame attribute quantization parameter control field;

[0392] The frame attribute quantization parameter control field is used to control the attribute quantization parameter of the point cloud frame. The attribute quantization parameter of the point cloud frame is used to perform attribute decoding instructions on the attribute quantization of the point cloud frame.

[0393] The frame attribute quantization parameter control field includes any of the following: color attribute quantization parameter offset, attribute quantization parameter offset of each color component.

[0394] In one implementation, if the attribute space conversion flag field is a first value, the decoding indication information further includes an attribute residual multiple prediction field;

[0395] The attribute residual multiple prediction field is used to indicate whether the point cloud frame allows multiple predictions of attribute residuals.

[0396] In one implementation, if the attribute space conversion flag field is a first value, the decoding indication information further includes a transform residual layer flag field;

[0397] The transformation residual layer flag field is used to control the use of attribute residual compensation in the point cloud frame when the point cloud frame uses the attribute encoding mode of the multi-layer transformation algorithm.

[0398] In one implementation, the decoding indication information includes an attribute coding mode flag field, and the attribute coding mode flag field is used to indicate the attribute coding mode of the point cloud frame;

[0399] The decoding indication information further includes an attribute type index field, and the attribute type index field is used to indicate the attribute type of the point cloud frame;

[0400] The syntax elements in the attribute header of the point cloud frame are organized and classified based on the attribute coding mode flag field and / or the attribute type index field.

[0401] In one implementation, the point cloud includes multiple point cloud frames, and the decoding indication information is set in the frame header of the point cloud frame, and the decoding indication information is used to indicate decoding of the point cloud frame.

[0402] In one implementation, the decoding indication information includes a frame point number flag field; the frame point number flag field is used to indicate the number of points to be decoded contained in the point cloud frame.

[0403] In one implementation, the frame point count flag field includes a frame point count high-order flag field and a frame point count low-order flag field; the frame point count high-order flag field is used to indicate the high-order information of the number of points to be decoded contained in the point cloud frame, and the frame point count low-order flag field is used to indicate the low-order information of the number of points to be decoded contained in the point cloud frame;

[0404] The number of points to be decoded contained in the point cloud frame is determined based on the high-bit information and the low-bit information.

[0405] In one implementation, the decoding indication information includes a frame slice number flag field; the frame slice number flag field is used to indicate the number of point cloud slices contained in the point cloud frame.

[0406] In one implementation, the point cloud includes multiple point cloud frames, the point cloud frames include multiple point cloud slices, the decoding indication information is set in the header of the point cloud slice, and the decoding indication information is used to indicate the decoding of the point cloud slice.

[0407] In one implementation, the slice header includes a geometric slice header, and the decoding indication information includes a slice point number flag field; the slice point number flag field is used to indicate the number of points to be decoded contained in the point cloud slice.

[0408] In one implementation, the slice point number flag field includes a slice point number high-order flag field and a slice point number low-order flag field; the slice point number high-order flag field is used to indicate the high-order information of the number of points to be decoded contained in the point cloud slice, and the slice point number low-order flag field is used to indicate the low-order information of the number of points to be decoded contained in the point cloud slice;

[0409] The number of points to be decoded contained in the point cloud is determined based on the high-bit information and the low-bit information.

[0410] In one implementation, the slice header includes an attribute slice header, the decoding indication information includes a slice attribute quantization parameter control field, the slice attribute quantization parameter control field is used to control the attribute quantization parameter of the point cloud slice, and the attribute quantization parameter of the point cloud slice is used to perform attribute decoding indication on the attribute quantization of the point cloud slice;

[0411] The slice attribute quantization parameter control field includes: a slice reflectance attribute quantization parameter control field and a slice color attribute quantization parameter control field; or, the slice attribute quantization parameter control field includes: a slice reflectance attribute quantization parameter control field and a slice color component attribute quantization parameter control field.

[0412] According to another embodiment of the present application, Figure 5The various units in the point cloud processing device shown can be individually or completely combined into one or several other units, or one (some) of the units can be further divided into multiple functionally smaller units, which can achieve the same operation without affecting the realization of the technical effects of the embodiments of the present application. The above-mentioned units are divided based on logical functions. In actual applications, the function of one unit can also be implemented by multiple units, or the functions of multiple units can be implemented by one unit. In other embodiments of the present application, the point cloud processing device may also include other units. In actual applications, these functions can also be implemented with the assistance of other units, and can be implemented by the collaboration of multiple units.

[0413] According to another embodiment of the present application, the program can be executed by running on a general computing device such as a computer including a central processing unit (CPU), a random access memory medium (RAM), a read-only memory medium (ROM), and other processing elements and storage elements. Figure 3 A computer program (including program code) for each step involved in part or all of the method shown in the figure is used to construct a computer program (including program code) for each step involved in part or all of the method shown in the figure. Figure 5 The point cloud processing device shown in the embodiment of the present application is used to implement the point cloud processing method of the present application. The computer program can be recorded on a computer-readable storage medium, for example, and loaded into the above-mentioned computing device through the computer-readable storage medium and run therein.

[0414] In an embodiment of the present application, the decoding indication information in the point cloud code stream can be used to provide decoding instructions for different types of data in the point cloud, and the different types of data include at least one of the following: point cloud frames and point cloud slices. Thus, based on the decoding indication effect of the decoding indication information on different types of data in the point cloud, the point cloud is decoded according to the decoding indication information, thereby improving the decoding performance of the point cloud.

[0415] See also Figure 6 , Figure 6 It is a structural schematic diagram of a point cloud processing device provided in an embodiment of the present application. The point cloud processing device can be set in the computer device provided in the embodiment of the present application, and the computer device can be the encoding device mentioned in the full text. Figure 6 The point cloud processing device shown may be a computer program (including program code) running in a computer device, and the point cloud processing device may be used to execute Figure 4 Some or all of the steps in the method embodiment shown. Figure 6 , the point cloud processing device may include the following units:

[0416] The processing unit 601 is used to generate decoding indication information and encode the decoding indication information into the point cloud code stream; the decoding indication information is used to perform decoding indication on different types of data in the point cloud, and the different types of data include at least one of the following: point cloud frames and point cloud slices;

[0417] The communication unit 602 is used to send the point cloud code stream to the decoding device so that the decoding device decodes the point cloud according to the decoding instruction information.

[0418] According to another embodiment of the present application, Figure 6 The various units in the point cloud processing device shown can be individually or completely combined into one or several other units, or one (some) of the units can be further divided into multiple functionally smaller units, which can achieve the same operation without affecting the realization of the technical effects of the embodiments of the present application. The above-mentioned units are divided based on logical functions. In actual applications, the function of one unit can also be implemented by multiple units, or the functions of multiple units can be implemented by one unit. In other embodiments of the present application, the point cloud processing device may also include other units. In actual applications, these functions can also be implemented with the assistance of other units, and can be implemented by the collaboration of multiple units.

[0419] According to another embodiment of the present application, the program can be executed by running on a general computing device such as a computer including a central processing unit (CPU), a random access memory medium (RAM), a read-only memory medium (ROM), and other processing elements and storage elements. Figure 4 A computer program (including program code) for each step involved in part or all of the method shown in the figure is used to construct a computer program (including program code) for each step involved in part or all of the method shown in the figure. Figure 6 The point cloud processing device shown in the embodiment of the present application is used to implement the point cloud processing method of the present application. The computer program can be recorded on a computer-readable storage medium, for example, and loaded into the above-mentioned computing device through the computer-readable storage medium and run therein.

[0420] In an embodiment of the present application, the decoding indication information in the point cloud code stream can be used to provide decoding instructions for different types of data in the point cloud, and the different types of data include at least one of the following: point cloud frames and point cloud slices. Thus, based on the decoding indication effect of the decoding indication information on different types of data in the point cloud, the point cloud is decoded according to the decoding indication information, thereby improving the decoding performance of the point cloud.

[0421] Based on the above method and device embodiments, the present application embodiment provides a computer device. Figure 6 , Figure 6 It is a structural diagram of a computer device provided in an embodiment of the present application. Figure 7The computer device shown includes at least a processor 701, an input interface 702, an output interface 703, and a computer-readable storage medium 704. The processor 701, the input interface 702, the output interface 703, and the computer-readable storage medium 704 may be connected via a bus or other means.

[0422] The computer-readable storage medium 704 may be stored in a memory of a computer device. The computer-readable storage medium 704 is used to store a computer program. The computer program includes computer instructions. The processor 701 is used to execute the program instructions stored in the computer-readable storage medium 704. The processor 701 (or CPU (Central Processing Unit)) is the computing core and control core of the computer device, which is suitable for implementing one or more computer instructions, and is specifically suitable for loading and executing one or more computer instructions to implement a corresponding method flow or a corresponding function.

[0423] The embodiment of the present application also provides a computer-readable storage medium (Memory), which is a memory device in a computer device for storing programs and data. It is understandable that the computer-readable storage medium here can include both built-in storage media in the computer device and, of course, extended storage media supported by the computer device. The computer-readable storage medium provides a storage space that stores the operating system of the computer device. In addition, one or more computer instructions suitable for being loaded and executed by the processor are also stored in the storage space. These computer instructions can be one or more computer programs (including program codes). It should be noted that the computer-readable storage medium here can be a high-speed RAM memory, or a non-volatile memory (Non-VolatileMemory), such as at least one disk storage; optionally, it can also be at least one computer-readable storage medium located away from the aforementioned processor.

[0424] In some embodiments, the computer device may be a decoding device, and the computer device may load and execute one or more computer instructions stored in the computer-readable storage medium 704 by the processor 701 to implement the above-mentioned Figure 3 In a specific implementation, the computer instructions in the computer-readable storage medium 704 are loaded by the processor 701 and execute the following steps:

[0425] Obtaining a point cloud code stream; the point cloud code stream includes decoding indication information, the decoding indication information is used to indicate decoding of different types of data in the point cloud, and the different types of data include at least one of the following: a point cloud frame and a point cloud slice;

[0426] Decode the point cloud according to the decoding instructions.

[0427] In one implementation, the point cloud includes multiple point cloud frames, the decoding indication information sets the attribute header of the point cloud frame, and the decoding indication information is used to perform attribute decoding indication on the point cloud frame.

[0428] In one implementation, the decoding indication information includes attribute existence flag fields under N attribute types, where N is an integer greater than or equal to 2; the attribute existence flag field under any attribute type is used to indicate the existence of attribute encoding of the point cloud frame under the corresponding attribute type;

[0429] If the attribute existence flag field under any attribute type is the first value, it means that the attribute code under the corresponding attribute type does not exist in the point cloud frame;

[0430] If the attribute existence flag field under any attribute type is the second value, it means that the attribute code under the corresponding attribute type exists in the point cloud frame.

[0431] In one implementation, if the attribute existence flag field of at least two attribute types among the N attribute types is a second value, and the point cloud frame allows cross-type attribute prediction, the decoding indication information further includes a cross-type attribute prediction parameter;

[0432] The cross-type attribute prediction parameter is used to provide attribute decoding instructions for the point cloud frame regarding the cross-type attribute prediction.

[0433] In one implementation, the decoding indication information further includes an attribute coding order field, and the attribute coding order field is used to determine a first-coded attribute type of the point cloud frame and a later-coded attribute type of the point cloud frame;

[0434] The cross-type attribute prediction parameters include cross-type attribute prediction parameters of the post-encoded attribute type.

[0435] In an implementation manner, when there are multiple attribute information in the post-encoded attribute type, the cross-type attribute prediction parameter includes the cross-type attribute prediction parameter of each attribute information under the post-encoded attribute type.

[0436] In one implementation, the decoding indication information further includes an index flag field for cross-attribute type prediction, which is used to indicate the attribute information index value under the first-predicted attribute type used when the second-predicted attribute type performs cross-attribute type prediction.

[0437] In one implementation, the cross-type attribute prediction parameter is indicated by using an attribute type index field and an attribute information index field under the attribute type.

[0438] In one implementation, if the attribute existence flag field under the target attribute type among the N attribute types is a second value, the decoding indication information further includes a frame attribute quantization parameter control field under the target attribute type;

[0439] The frame attribute quantization parameter control field under the target attribute type is used to control the attribute quantization parameter of the point cloud frame under the target attribute type, and the attribute quantization parameter under the target attribute type is used to perform attribute decoding instructions on the point cloud frame regarding the attribute quantization under the target attribute type;

[0440] When the target attribute type is the reflectance attribute, the attribute quantization parameter control field under the target attribute type includes the reflectance attribute quantization parameter offset; when the target attribute type is the color attribute, the attribute quantization parameter control field under the target attribute type includes any one of the following: color attribute quantization parameter offset, attribute quantization parameter offset of each color component.

[0441] In one implementation, the decoding indication information includes an attribute space conversion flag field, and the attribute space conversion flag field is used to indicate the conversion status of the attribute space of the point cloud frame;

[0442] If the attribute space conversion flag field is the first value, it means that the point cloud frame has not been converted to the attribute space;

[0443] If the attribute space conversion flag field is the second value, it means that the point cloud frame undergoes attribute space conversion.

[0444] In one implementation, the attribute space is a color space, and if the attribute space conversion flag field is a second value, the decoding indication information further includes a frame attribute quantization parameter control field;

[0445] The frame attribute quantization parameter control field is used to control the attribute quantization parameter of the point cloud frame. The attribute quantization parameter of the point cloud frame is used to perform attribute decoding instructions on the attribute quantization of the point cloud frame.

[0446] The frame attribute quantization parameter control field includes any of the following: color attribute quantization parameter offset, attribute quantization parameter offset of each color component.

[0447] In one implementation, if the attribute space conversion flag field is a first value, the decoding indication information further includes an attribute residual multiple prediction field;

[0448] The attribute residual multiple prediction field is used to indicate whether the point cloud frame allows multiple predictions of attribute residuals.

[0449] In one implementation, if the attribute space conversion flag field is a first value, the decoding indication information further includes a transform residual layer flag field;

[0450] The transformation residual layer flag field is used to control the use of attribute residual compensation in the point cloud frame when the point cloud frame uses the attribute encoding mode of the multi-layer transformation algorithm.

[0451] In one implementation, the decoding indication information includes an attribute coding mode flag field, and the attribute coding mode flag field is used to indicate the attribute coding mode of the point cloud frame;

[0452] The decoding indication information further includes an attribute type index field, and the attribute type index field is used to indicate the attribute type of the point cloud frame;

[0453] The syntax elements in the attribute header of the point cloud frame are organized and classified based on the attribute coding mode flag field and / or the attribute type index field.

[0454] In one implementation, the point cloud includes multiple point cloud frames, and the decoding indication information is set in the frame header of the point cloud frame, and the decoding indication information is used to indicate decoding of the point cloud frame.

[0455] In one implementation, the decoding indication information includes a frame point number flag field; the frame point number flag field is used to indicate the number of points to be decoded contained in the point cloud frame.

[0456] In one implementation, the frame point count flag field includes a frame point count high-order flag field and a frame point count low-order flag field; the frame point count high-order flag field is used to indicate the high-order information of the number of points to be decoded contained in the point cloud frame, and the frame point count low-order flag field is used to indicate the low-order information of the number of points to be decoded contained in the point cloud frame;

[0457] The number of points to be decoded contained in the point cloud frame is determined based on the high-bit information and the low-bit information.

[0458] In one implementation, the decoding indication information includes a frame slice number flag field; the frame slice number flag field is used to indicate the number of point cloud slices contained in the point cloud frame.

[0459] In one implementation, the point cloud includes multiple point cloud frames, the point cloud frames include multiple point cloud slices, the decoding indication information is set in the header of the point cloud slice, and the decoding indication information is used to indicate the decoding of the point cloud slice.

[0460] In one implementation, the slice header includes a geometric slice header, and the decoding indication information includes a slice point number flag field; the slice point number flag field is used to indicate the number of points to be decoded contained in the point cloud slice.

[0461] In one implementation, the slice point number flag field includes a slice point number high-order flag field and a slice point number low-order flag field; the slice point number high-order flag field is used to indicate the high-order information of the number of points to be decoded contained in the point cloud slice, and the slice point number low-order flag field is used to indicate the low-order information of the number of points to be decoded contained in the point cloud slice;

[0462] The number of points to be decoded contained in the point cloud is determined based on the high-bit information and the low-bit information.

[0463] In one implementation, the slice header includes an attribute slice header, the decoding indication information includes a slice attribute quantization parameter control field, the slice attribute quantization parameter control field is used to control the attribute quantization parameter of the point cloud slice, and the attribute quantization parameter of the point cloud slice is used to perform attribute decoding indication on the attribute quantization of the point cloud slice;

[0464] The slice attribute quantization parameter control field includes: a slice reflectance attribute quantization parameter control field and a slice color attribute quantization parameter control field; or, the slice attribute quantization parameter control field includes: a slice reflectance attribute quantization parameter control field and a slice color component attribute quantization parameter control field.

[0465] In other embodiments, the computer device may be a decoding device, and the processor 701 may load and execute one or more computer instructions stored in the computer-readable storage medium 704 to implement the above-mentioned Figure 4 In a specific implementation, the computer instructions in the computer-readable storage medium 704 are loaded by the processor 701 and execute the following steps:

[0466] Generate decoding indication information, and encode the decoding indication information into the point cloud code stream; the decoding indication information is used to provide decoding instructions for different types of data in the point cloud, and the different types of data include at least one of the following: point cloud frames and point cloud slices;

[0467] The point cloud code stream is sent to the decoding device so that the decoding device decodes the point cloud according to the decoding instruction information.

[0468] According to one aspect of the present application, a computer program product or a computer program is provided, the computer program product or the computer program comprising computer instructions, the computer instructions being stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the point cloud processing method provided in the above-mentioned various optional manners.

[0469] In an embodiment of the present application, the decoding indication information in the point cloud code stream can be used to provide decoding instructions for different types of data in the point cloud, and the different types of data include at least one of the following: point cloud frames and point cloud slices. Thus, based on the decoding indication effect of the decoding indication information on different types of data in the point cloud, the point cloud is decoded according to the decoding indication information, thereby improving the decoding performance of the point cloud.

[0470] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A point cloud processing method, characterized in that: include: Acquire a point cloud code stream; the point cloud code stream includes decoding indication information, the decoding indication information is used to indicate decoding of different types of data in the point cloud, the different types of data include at least one of the following: a point cloud frame and a point cloud slice; The point cloud is decoded according to the decoding instruction information.

2. The method according to claim 1, characterized in that The point cloud includes multiple point cloud frames, the decoding indication information is set in the attribute header of the point cloud frame, and the decoding indication information is used to indicate attribute decoding of the point cloud frame.

3. The method according to claim 2, characterized in that The decoding indication information includes attribute existence flag fields under N attribute types, where N is an integer greater than or equal to 2; the attribute existence flag field under any attribute type is used to indicate the existence of attribute encoding of the point cloud frame under the corresponding attribute type; If the attribute existence flag field under any attribute type is the first value, it means that the attribute code under the corresponding attribute type does not exist in the point cloud frame; If the attribute existence flag field under any attribute type is the second value, it means that the attribute code under the corresponding attribute type exists in the point cloud frame.

4. The method according to claim 3, characterized in that If the attribute existence flag field of at least two attribute types in the N attribute types is a second value, and the point cloud frame allows cross-type attribute prediction, the decoding indication information further includes a cross-type attribute prediction parameter; The cross-type attribute prediction parameter is used to perform attribute decoding instructions on the point cloud frame regarding cross-type attribute prediction.

5. The method according to claim 4, characterized in that The decoding indication information further includes an attribute coding order field, and the attribute coding order field is used to determine a first-coded attribute type of the point cloud frame and a later-coded attribute type of the point cloud frame; The cross-type attribute prediction parameter includes a cross-type attribute prediction parameter of the post-encoded attribute type.

6. The method according to claim 5, characterized in that When there are multiple attribute information in the post-encoded attribute type, the cross-type attribute prediction parameter includes the cross-type attribute prediction parameter of each attribute information under the post-encoded attribute type.

7. The method according to claim 4, characterized in that The decoding indication information further includes an index flag field for cross-attribute type prediction, and the index flag field for cross-attribute type prediction is used to indicate an attribute information index value under a first-predicted attribute type used when a second-predicted attribute type performs cross-attribute type prediction.

8. The method according to claim 4, characterized in that The cross-type attribute prediction parameter is indicated by using an attribute type index field and an attribute information index field under the attribute type.

9. The method according to claim 3, characterized in that If the attribute existence flag field under the target attribute type in the N attribute types is a second value, the decoding indication information further includes a frame attribute quantization parameter control field under the target attribute type; The frame attribute quantization parameter control field under the target attribute type is used to control the attribute quantization parameter of the point cloud frame under the target attribute type, and the attribute quantization parameter under the target attribute type is used to perform attribute decoding instructions on the point cloud frame regarding the attribute quantization under the target attribute type; When the target attribute type is a reflectance attribute, the attribute quantization parameter control field under the target attribute type includes a reflectance attribute quantization parameter offset; when the target attribute type is a color attribute, the attribute quantization parameter control field under the target attribute type includes any one of the following: a color attribute quantization parameter offset, an attribute quantization parameter offset of each color component.

10. The method according to claim 2, characterized in that The decoding indication information includes an attribute space conversion flag field, and the attribute space conversion flag field is used to indicate the conversion status of the attribute space of the point cloud frame; If the attribute space conversion flag field is a first value, it indicates that the point cloud frame has not been converted in attribute space; If the attribute space conversion flag field is a second value, it indicates that the point cloud frame undergoes attribute space conversion.

11. The method according to claim 10, characterized in that The attribute space is a color space, and if the attribute space conversion flag field is a second value, the decoding indication information further includes a frame attribute quantization parameter control field; The frame attribute quantization parameter control field is used to control the attribute quantization parameter of the point cloud frame, and the attribute quantization parameter of the point cloud frame is used to perform attribute decoding instructions on attribute quantization of the point cloud frame; The frame attribute quantization parameter control field includes any one of the following: a color attribute quantization parameter offset, and an attribute quantization parameter offset of each color component.

12. The method according to claim 10, characterized in that If the attribute space conversion flag field is a first value, the decoding indication information further includes an attribute residual multiple prediction field; The attribute residual multiple prediction field is used to indicate whether the point cloud frame allows multiple predictions of attribute residuals.

13. The method according to claim 10, characterized in that If the attribute space conversion flag field is a first value, the decoding indication information further includes a transformation residual layer flag field; The transformation residual layer flag field is used to control the use of attribute residual compensation by the point cloud frame when the point cloud frame uses the attribute encoding mode of the multi-layer transformation algorithm.

14. The method according to claim 2, characterized in that The decoding indication information includes an attribute coding mode flag field, and the attribute coding mode flag field is used to indicate the attribute coding mode of the point cloud frame; The decoding indication information further includes an attribute type index field, where the attribute type index field is used to indicate the attribute type of the point cloud frame; The syntax elements in the attribute header of the point cloud frame are classified and organized based on the attribute coding mode flag field and / or the attribute type index field.

15. The method according to claim 1, wherein: The point cloud includes multiple point cloud frames, the decoding indication information is set in the frame header of the point cloud frame, and the decoding indication information is used to indicate decoding of the point cloud frame.

16. The method according to claim 15, characterized in that The decoding indication information includes a frame point number flag field; the frame point number flag field is used to indicate the number of points to be decoded contained in the point cloud frame.

17. The method according to claim 16, characterized in that The frame point count flag field includes a frame point count high-order flag field and a frame point count low-order flag field; the frame point count high-order flag field is used to indicate the high-order information of the number of points to be decoded contained in the point cloud frame, and the frame point count low-order flag field is used to indicate the low-order information of the number of points to be decoded contained in the point cloud frame; The number of points to be decoded contained in the point cloud frame is determined according to the high-bit information and the low-bit information.

18. The method according to claim 15, characterized in that The decoding indication information includes a frame slice number flag field; the frame slice number flag field is used to indicate the number of point cloud slices contained in the point cloud frame.

19. The method according to claim 1, wherein: The point cloud includes multiple point cloud frames, the point cloud frames include multiple point cloud slices, the decoding indication information is set in the slice header of the point cloud slice, and the decoding indication information is used to indicate decoding of the point cloud slice.

20. The method of claim 19, wherein: The slice header includes a geometric slice header, and the decoding indication information includes a slice point number flag field; the slice point number flag field is used to indicate the number of points to be decoded contained in the point cloud slice.

21. The method of claim 20, wherein: The slice point number flag field includes a slice point number high-order flag field and a slice point number low-order flag field; the slice point number high-order flag field is used to indicate the high-order information of the number of points to be decoded contained in the point cloud slice, and the slice point number low-order flag field is used to indicate the low-order information of the number of points to be decoded contained in the point cloud slice; The number of points to be decoded contained in the point cloud piece is determined according to the high-bit information and the low-bit information.

22. The method of claim 19, wherein: The slice header includes an attribute slice header, the decoding indication information includes a slice attribute quantization parameter control field, the slice attribute quantization parameter control field is used to control the attribute quantization parameter of the point cloud slice, and the attribute quantization parameter of the point cloud slice is used to perform attribute decoding indication on attribute quantization of the point cloud slice; The slice attribute quantization parameter control field includes: a slice reflectance attribute quantization parameter control field and a slice color attribute quantization parameter control field; or, the slice attribute quantization parameter control field includes: a slice reflectance attribute quantization parameter control field and a slice color component attribute quantization parameter control field.

23. A point cloud processing method, characterized in that: include: Generate decoding indication information, and encode the decoding indication information into a point cloud code stream; The decoding indication information is used to indicate decoding of different types of data in the point cloud, and the different types of data include at least one of the following: a point cloud frame and a point cloud slice; The point cloud code stream is sent to a decoding device so that the decoding device decodes the point cloud according to the decoding instruction information.

24. A point cloud processing device, characterized in that: include: An acquisition unit is used to acquire a point cloud code stream; the point cloud code stream includes decoding indication information, and the decoding indication information is used to indicate decoding of different types of data in the point cloud, and the different types of data include at least one of the following: a point cloud frame and a point cloud slice; A processing unit is used to decode the point cloud according to the decoding indication information.

25. A point cloud processing device, characterized in that: include: A processing unit, configured to generate the decoding indication information and encode the decoding indication information into a point cloud code stream; The decoding indication information is used to indicate decoding of different types of data in the point cloud, and the different types of data include at least one of the following: a point cloud frame and a point cloud slice; A communication unit is used to send the point cloud code stream to a decoding device so that the decoding device decodes the point cloud according to the decoding instruction information.

26. A computer device, characterized in that: The computer device comprises: a processor suitable for implementing a computer program; A computer-readable storage medium storing a computer program, wherein the computer program is suitable for being loaded by the processor and executing the point cloud processing method according to any one of claims 1 to 22, or executing the point cloud processing method according to any one of claim 23.

27. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and the computer program is suitable for being loaded by a processor and executing the point cloud processing method according to any one of claims 1 to 22, or executing the point cloud processing method according to any one of claim 23.

Citation Information

Cited By

  • Point cloud attribute decoding method and point cloud attribute coding method

    CN116601672A

  • Method, apparatus, and medium for point cloud coding

    WO2026200827A1