Point cloud processing method and apparatus, computer device, and storage medium
By introducing decoding instructions into the point cloud code stream, the problem of low point cloud decoding performance is solved, efficient decoding of point cloud frames and point cloud slices is achieved, and data reconstruction efficiency is improved.
Patent Information
- Application Number
- PCT/CN2024/091165
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-31
- Filing Date
- 2024-05-06
- Publication Date
- 2024-12-05
AI Technical Summary
In the prior art, the decoding performance of point clouds is low, mainly due to a large amount of attribute information, which leads to high pressure in the decoding process, and the existing encoding technology is difficult to effectively improve the decoding efficiency.
By introducing decoding instructions information into the point cloud code stream, it is used to indicate different types of data (such as point cloud frames and point cloud slices) for decoding, and generate and encode the decoding instructions information into the point cloud code stream, so that the decoding device can use it according to These indicators are efficiently decoded.
The decoding performance of point cloud is improved, and the pressure on the decoding device is reduced by optimizing the decoding process, and the efficiency of data reconstruction is improved.
Smart Images

Figure CN2024091165_05122024_PF_FP_ABST
Abstract
Description
Point cloud processing method, device, computer equipment, and storage medium
[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on May 31, 2023, with application number 2023106438860 and application name “Point cloud processing method, device, computer equipment, and storage medium”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of computer technology, and in particular to a point cloud processing method, apparatus, computer equipment, and storage medium. Background Art
[0003] With the continuous development of science and technology, it is now possible to obtain a large number of high-precision point clouds at a low cost and in a short period of time. The point cloud can include multiple points, and each point in the point cloud has geometric information and attribute information. In order to improve the transmission efficiency of the point cloud, it is usually necessary to encode the point cloud before transmitting it; specifically, after the encoding end encodes the geometric information and attribute information of each point in the point cloud, the encoded point cloud can be transmitted to the decoding end, and the decoding end can decode the encoded point cloud to reconstruct the geometric information and attribute information of each point in the point cloud. Under normal circumstances, the amount of attribute information of each point in the point cloud is large. The large amount of attribute information creates pressure in the decoding process, resulting in low decoding performance of the point cloud. Therefore, how to improve the decoding performance of point clouds has become a current research hotspot.
[0004] Summary of the Invention
[0005] The embodiments of the present application provide a point cloud processing method, apparatus, computer equipment, and storage medium, which can improve the decoding performance of point clouds.
[0006] In one aspect, an embodiment of the present application provides a point cloud processing method, the point cloud processing method comprising:
[0007] Obtaining a point cloud code stream; the point cloud code stream includes decoding instruction information, the decoding instruction information being used to indicate decoding of different types of data in the point cloud, the different types of data including at least one of the following: a point cloud frame and a point cloud slice;
[0008] Decode the point cloud according to the decoding instructions.
[0009] Accordingly, an embodiment of the present application provides a point cloud processing device, which includes:
[0010] An acquisition unit is configured to acquire a point cloud code stream, wherein the point cloud code stream includes decoding instruction information, and the decoding instruction information is configured to indicate decoding of different types of data in the point cloud, wherein the different types of data include at least one of the following: a point cloud frame and a point cloud slice;
[0011] The processing unit is used to decode the point cloud according to the decoding instruction information.
[0012] On the other hand, an embodiment of the present application provides a point cloud processing method, which includes:
[0013] Generate decoding instruction information and encode the decoding instruction information into the point cloud code stream; the decoding instruction information is used to provide decoding instructions for different types of data in the point cloud, and the different types of data include at least one of the following: point cloud frames and point cloud slices;
[0014] The point cloud code stream is sent to the decoding device so that the decoding device decodes the point cloud according to the decoding instruction information.
[0015] Accordingly, an embodiment of the present application provides a point cloud processing device, which includes:
[0016] a processing unit, configured to generate decoding instruction information and encode the decoding instruction information into a point cloud code stream; the decoding instruction information is used to provide decoding instructions for different types of data in the point cloud, the different types of data including at least one of the following: a point cloud frame and a point cloud slice;
[0017] The communication unit is used to send the point cloud code stream to the decoding device so that the decoding device decodes the point cloud according to the decoding instruction information.
[0018] Accordingly, an embodiment of the present application provides a computer program product, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the above-described point cloud processing method.
[0019] In an embodiment of the present application, the decoding indication information in the point cloud code stream can be used to provide decoding instructions for different types of data in the point cloud. The different types of data include at least one of the following: point cloud frames and point cloud slices. Thus, based on the decoding indication effect of the decoding indication information on different types of data in the point cloud, the point cloud is decoded according to the decoding indication information, which can improve the decoding performance of the point cloud. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] FIG1 is a schematic diagram of a coding framework for point cloud coding provided in an embodiment of the present application;
[0021] FIG2 is a schematic diagram of the architecture of a point cloud processing system provided in an embodiment of the present application;
[0022] FIG3 is a flow chart of a point cloud processing method provided in an embodiment of the present application;
[0023] FIG4 is a flow chart of another point cloud processing method provided in an embodiment of the present application;
[0024] FIG5 is a schematic structural diagram of a point cloud processing device provided in an embodiment of the present application;
[0025] FIG6 is a schematic structural diagram of another point cloud processing device provided in an embodiment of the present application;
[0026] FIG7 is a schematic structural diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0027] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.
[0028] In order to more clearly understand the technical solutions provided by the embodiments of the present application, the basic concepts involved in the embodiments of the present application are first introduced here:
[0029] (1) Point Cloud. A point cloud is a set of irregularly distributed discrete points in space that express the spatial structure and surface properties of a three-dimensional object or scene. Point clouds can be divided into different categories based on different classification criteria. For example, based on the acquisition method of the point cloud, they can be divided into dense point clouds and sparse point clouds. For another example, based on the time series type of the point cloud, they can be divided into static point clouds and dynamic point clouds.
[0030] (2) Point Cloud Data. The geometric information and attribute information of each point in the point cloud together constitute point cloud data. Geometric information can also be called three-dimensional position information. The geometric information of a point in the point cloud refers to the spatial coordinates (x, y, z) of the point, which can include the coordinate values of the point in each coordinate axis direction of the three-dimensional coordinate system, for example, the coordinate value x in the X-axis direction, the coordinate value y in the Y-axis direction, and the coordinate value z in the Z-axis direction. The attribute information of a point in the point cloud can include at least one of the following: color information, material information, laser reflection intensity information (also called reflectivity); usually, each point in the point cloud has the same amount of attribute information. For example, each point in the point cloud can have two types of attribute information: color information and laser reflection intensity. For another example, each point in the point cloud can have three types of attribute information: color information, material information, and laser reflection intensity information.
[0031] (3) Point Cloud Compression (PCC). Point cloud coding refers to the process of encoding the geometric information and attribute information of each point in the point cloud to obtain a compressed code stream (also called a point cloud code stream). Point cloud coding can include two main processes: geometric information encoding and attribute information encoding. The current mainstream point cloud coding technology can be divided into geometric structure-based point cloud coding and projection-based point cloud coding according to different types of point clouds. Here, G-PCC (Geometry-Based Point Cloud Compression) in MPEG (Moving Picture Expert Group, international audio and video coding standard) and AVS-PCC in AVS (Audio Video Coding Standard, China's national video coding standard) are used as examples to introduce them.
[0032] The coding frameworks of G-PCC and AVS-PCC are roughly the same. Figure 1 shows the G-PCC coding framework, taking G-PCC as an example. It can be divided into the geometry information encoding process and the attribute information encoding process. In the geometry information encoding process, the geometry information of each point in the point cloud is encoded to obtain a geometry bitstream. In the attribute information encoding process, the attribute information of each point in the point cloud is encoded to obtain an attribute bitstream. Together, the geometry bitstream and the attribute bitstream constitute the compressed bitstream of the point cloud.
[0033] For the geometric information encoding process, the main operations and processing can be seen in the following description:
[0034] ① Pre-processing: This can include coordinate transformation and voxelization. Through scaling and translation operations, the point cloud data in 3D space is converted into integer form and its minimum geometric position is moved to the coordinate origin.
[0035] ② Geometric coding: Geometric coding can include two modes, namely octree-based geometric coding (Octree) and triangle-based geometric coding (Trisoup). These two coding modes can be used under different conditions. Among them:
[0036] Octree-based geometric coding: An octree is a tree-like data structure that evenly divides a predefined bounding box in three-dimensional space, with each node having eight children. By indicating whether each child node in the octree is occupied using "1" or "0," an occupancy code is generated as the code stream of the point cloud geometry information.
[0037] Geometric encoding based on triangulation: Divide the point cloud into blocks of a certain size, locate the intersection points of the point cloud surface at the edge of the block and construct triangles. By encoding the intersection points, geometric information is compressed.
[0038] ③ Geometry Quantization: The degree of quantization fineness is usually determined by the quantization parameter (QP). A larger QP value means that coefficients with a larger value range will be quantized into the same output, which usually results in greater distortion and a lower bit rate. Conversely, a smaller QP value means that coefficients with a smaller value range will be quantized into the same output, which usually results in less distortion and a corresponding higher bit rate.
[0039] ④ Geometry Entropy Encoding: Statistical compression encoding is performed on the octtree's occupancy code information, ultimately outputting a binary (0 or 1) compressed bitstream. Statistical coding is a lossless encoding method that can effectively reduce the bitrate required to express the same signal. A commonly used statistical coding method is context-adaptive binary arithmetic coding (CABAC).
[0040] For the attribute information encoding process, the main operations and processing can be found in the following description:
[0041] 1. Attribute Recoloring: In lossy encoding, after encoding the geometric coordinates, the encoder needs to decode and reconstruct the geometry, i.e., restore the geometry of each point in the point cloud. The attribute information corresponding to one or more neighboring points in the original point cloud is searched and used as the attribute information for the reconstructed point.
[0042] ② Attribute information processing: Attribute information processing can include three attribute encoding modes, namely attribute prediction (Prediction), attribute transformation (Transform), and attribute prediction transformation (Prediction & Transform). These three attribute encoding modes can be used under different conditions.
[0043] in:
[0044] Attribute prediction: Based on information such as distance or spatial relationships, neighbor prediction points of the point to be coded are determined from among the already coded points. Based on the set criteria, the attribute prediction information of the point to be coded is calculated based on the attribute information of the neighbor prediction points. The difference between the actual attribute information of the point to be coded and the predicted attribute information is calculated as the attribute residual information, which is then quantized and entropy coded.
[0045] Attribute transformation: Using transformation methods such as DCT (Discrete Cosine Transform) and Haar (Haar Transform), attribute information is grouped and transformed to obtain transformation coefficients, which are then quantized and entropy-coded.
[0046] Attribute prediction transformation: The preceding steps are the same as attribute prediction. After obtaining the attribute residual information of the point to be encoded, the attribute residual information of the point to be encoded is transformed using a transformation algorithm to obtain transformation coefficients, which are then quantized and entropy coded.
[0047] ③ Attribute Quantization: The degree of quantization is usually determined by the quantization parameter. The transform coefficients and / or attribute residual information obtained from attribute information processing are quantized and entropy coded. For example, in attribute prediction, entropy coding is performed on the quantized attribute residual information; in attribute transformation and attribute prediction transformation, entropy coding is performed on the quantized transform coefficients.
[0048] 4. Attribute Entropy Coding: Quantized attribute residual information and / or transform coefficients are typically compressed using entropy coding methods such as run-length coding and arithmetic coding. The corresponding attribute coding mode, quantization parameters, and other information are also encoded using an entropy encoder.
[0049] (4) Point cloud decoding. Point cloud decoding refers to the process of decoding the compressed code stream obtained by point cloud encoding to reconstruct the point cloud. Specifically, the geometric bit stream in the compressed code stream is parsed to reconstruct the geometric information of each point in the point cloud, and the attribute bit stream in the compressed code stream is parsed to reconstruct the attribute information of each point in the point cloud. Here is a detailed introduction to the point cloud decoding process in attribute prediction mode and attribute prediction transformation mode:
[0050] In the attribute prediction mode, the quantized attribute residual information of the point to be decoded can be obtained from the attribute bit stream through entropy decoding, and the quantized attribute residual information can be dequantized to obtain the attribute residual information of the point to be decoded; according to information such as distance or spatial relationship, the neighbor prediction points of the point to be decoded are determined among the decoded points, and based on the set criteria, the attribute prediction information of the point to be decoded is calculated according to the attribute reconstruction information of the neighbor prediction points; the attribute information of the point to be decoded (which can be called attribute reconstruction information) can be reconstructed based on the attribute residual information of the point to be decoded and the attribute prediction information of the point to be decoded.
[0051] In the attribute prediction transformation mode, the quantized transformation coefficients of the point to be decoded can be obtained from the attribute bit stream through entropy decoding, the quantized transformation coefficients are inversely quantized to obtain the transformation coefficients, and the transformation coefficients are inversely transformed to obtain the attribute residual information of the point to be decoded; according to information such as distance or spatial relationship, the neighbor prediction points of the point to be decoded are determined among the decoded points, and based on the set criteria, the attribute prediction information of the point to be decoded is calculated according to the attribute reconstruction information of the neighbor prediction points; the attribute information of the point to be decoded (which can be called attribute reconstruction information) can be reconstructed according to the attribute residual information of the point to be decoded and the attribute prediction information of the point to be decoded.
[0052] Based on the introduction of the above basic concepts, an embodiment of the present application proposes a point cloud processing method. In the point cloud attribute decoding stage, the point cloud code stream obtained by this point cloud processing method may include decoding instruction information. The decoding instruction information can be used to provide decoding instructions for different types of data in the point cloud, and the point cloud can be decoded according to the decoding instruction information. In the point cloud attribute encoding stage, this point cloud processing method can generate decoding instruction information, encode the decoding instruction information into the point cloud code stream, and send the point cloud code stream to a decoding device so that the decoding device decodes the point cloud according to the decoding instruction information. Based on the decoding instruction information's role in providing decoding instructions for different types of data in the point cloud, this point cloud processing method can improve the decoding performance of the point cloud by decoding the point cloud according to the decoding instruction information.
[0053] The following introduces a point cloud processing system suitable for implementing the point cloud processing method provided in the embodiment of the present application in conjunction with the accompanying drawings.
[0054] As shown in FIG2 , the point cloud processing system may include an encoding device 201 and a decoding device 202. The encoding device 201 may be a terminal or a server, and the decoding device 202 may be a terminal or a server. A direct communication connection may be established between the encoding device 201 and the decoding device 202 via wired communication, or an indirect communication connection may be established via wireless communication. The terminal may be a smart phone, a tablet computer, a laptop computer, a desktop computer, an intelligent voice interaction device, a smart watch, a vehicle-mounted terminal, a smart home appliance, an aircraft, etc., but is not limited thereto. The server may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. It may also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms.
[0055] (1) For the encoding device 201:
[0056] The encoding device 201 can acquire point cloud data (i.e., the geometric and attribute information of each point in the point cloud). Point cloud data can be acquired through scene capture or device generation. Scene capture point cloud data refers to point cloud data obtained by capturing a real-world visual scene using a capture device associated with the encoding device 201. The capture device is used to provide point cloud data acquisition services for the encoding device 201. The capture device may include, but is not limited to, any of the following: a camera, a sensor, and a scanning device. Cameras may include ordinary cameras, stereo cameras, and light field cameras, etc., sensor devices may include laser devices, radar devices, etc., and scanning devices may include 3D laser scanning devices, etc. The capture device associated with the encoding device 201 may refer to a hardware component provided in the encoding device 201, such as a terminal camera or sensor, etc. The capture device associated with the encoding device 201 may also refer to a hardware device connected to the encoding device 201, such as a camera connected to a server. Device-generated point cloud data refers to point cloud data generated by the encoding device 201 based on virtual objects (e.g., virtual 3D objects and virtual 3D scenes obtained through 3D modeling).
[0057] The encoding device 201 can encode the geometric information and attribute information of each point in the point cloud to obtain a point cloud code stream. The encoding device 201 can transmit the encoded point cloud code stream to the decoding device 202. In particular, during the point cloud encoding process, the encoding device 201 can generate decoding instruction information, encode the decoding instruction information into the point cloud code stream (including the geometry bit stream and the attribute bit stream), and send the point cloud code stream to the decoding device 202. The decoding instruction information can be used to indicate the decoding of different types of data in the point cloud. The decoding device 202 can decode the point cloud based on the decoding instruction information for different types of data in the point cloud, thereby improving the decoding performance of the point cloud.
[0058] (2) For the decoding device 202:
[0059] After receiving the point cloud code stream (including the attribute bit stream and the geometry bit stream) transmitted by the encoding device 201, the decoding device 202 can decode the point cloud code stream and reconstruct the geometric information (which can be called geometric reconstruction information) and attribute information (which can be called attribute reconstruction information) of each point in the point cloud. In particular, during the point cloud decoding process, the decoding device 202 can decode the point cloud based on the decoding indication information in the point cloud code stream for different types of data in the point cloud, thereby improving the decoding performance of the point cloud.
[0060] It can be understood that the point cloud processing system described in the embodiment of the present application is for the purpose of more clearly illustrating the technical solution of the embodiment of the present application, and does not constitute a limitation on the technical solution provided by the embodiment of the present application. Ordinary technicians in this field can know that with the evolution of the system architecture and the emergence of new business scenarios, the technical solution provided by the embodiment of the present application is also applicable to similar technical problems.
[0061] The point cloud processing method provided in the embodiment of the present application is described in more detail below with reference to the accompanying drawings.
[0062] This embodiment of the present application provides a point cloud processing method, which mainly introduces the point cloud decoding process. The point cloud processing method can be executed by a computer device, which can be the decoding device 202 in the above-mentioned point cloud processing system. As shown in Figure 3, the point cloud processing method can include but is not limited to the following steps S301-S302:
[0063] S301, obtaining a point cloud code stream; the point cloud code stream includes decoding instruction information, and the decoding instruction information is used to indicate decoding of different types of data in the point cloud, and the different types of data include at least one of the following: a point cloud frame and a point cloud slice.
[0064] The point cloud code stream may include decoding instruction information, which can be used to indicate the decoding of different types of data in the point cloud. Specifically, the point cloud decoding information can be set in the attribute header, frame header, and slice header; the decoding instruction information set in the attribute header can be used to indicate the attribute decoding of the point cloud frame in the point cloud; the decoding instruction information set in the frame header can be used to indicate the decoding of the point cloud frame in the point cloud; and the decoding instruction information set in the slice header can be used to indicate the decoding of the point cloud slice in the point cloud. The decoding instruction information set in the attribute header, frame header, and slice header are introduced below:
[0065] 1. Decoding instructions set in the attribute header:
[0066] A point cloud may include multiple point cloud frames, and decoding instruction information may be set in the attribute header of the point cloud frame. The attribute header includes a set of parameters required for decoding the attribute information of the point cloud. The decoding instruction information set in the attribute header of the point cloud frame may be used to indicate attribute decoding of the point cloud frame. Instructing attribute decoding of the point cloud frame means indicating the attribute information of each point in the decoded point cloud frame. Before introducing the decoding instruction information set in the attribute header, the syntax elements of the general attribute header are first introduced. The syntax elements of the general attribute header are as shown in Table 1 below:
[0067] Table 1
[0068] The following explains the syntax elements in the general attribute header shown in Table 1 above:
[0069] Attribute Present Flag field (attributePresentFlag[attrIdx]): A binary variable. A value of '1' indicates that the point cloud codestream contains the attribute code of attrIdx (i.e., the attribute code of the attribute type with the attribute index attrIdx); a value of '0' indicates that the point cloud codestream does not contain the attribute code of attrIdx. attrIdx represents the attribute index and is an integer between 0 and 15. Its meaning is explained in Table 2 below:
[0070] Table 2
[0071] Attribute data number minus one field (attribute_data_num_set_minus1[attrIdx]): An unsigned integer. Adding 1 indicates the number of attribute multi-datasets supported by the attribute identified by the attribute index attrIdx in the point cloud stream. This is a number between 0 and 127. When attribute_data_num_set_minus1[attrIdx] is not present in the point cloud, its default value is -1.
[0072] Attribute Information Enable Flag field (multi_set_flag[attrIdx]): A binary variable. A value of '1' indicates that the attribute identified by the attribute index attrIdx can support the use of multiple sets of attribute information; a value of '0' indicates that the attribute identified by the attribute index attrIdx can support the use of multiple sets of attribute information, and only one set of attribute information can be used for the attribute data. When multi_set_flag[attrIdx] is not present in the codestream, its default value is zero.
[0073] Attribute Information Number Minus One field (attribute_info_num_set_minus1[attrIdx]): An unsigned integer. 1 plus one indicates the number of attribute information supported by the attribute identified by the attribute index attrIdx in the point cloud codestream. This is a number between 0 and 127. When attribute_info_num_set_minus1[attrIdx] is not present in the codestream, its default value is -1.
[0074] Attribute Coding Mode Flag (transform): An unsigned integer between 0 and 2. This field controls the attribute coding mode. A value of '0' specifies the attribute coding mode to be used for attribute prediction; a value of '1' specifies the attribute coding mode to be used for attribute coding; and a value of '2' specifies the attribute coding mode to be used for attribute prediction transform.
[0075] Attribute transformation precision value (kFracBits): Unsigned integer. Used to indicate the shift precision of fixed-point operations during attribute transformation.
[0076] Attribute transform coefficient quantization parameter difference field (attrTransformQpDelta): Unsigned integer. Used to represent the difference from the attribute residual quantization parameter. Attribute transform coefficient quantization parameter attrTransformQp = attrQuantParam + attrTransformQpDelta.
[0077] Attribute Transformation Points (attrTransformNumPoints): An unsigned integer representing the number of attribute transformation points, i.e., the wavelet transform using attrTransformNumPoints points. AttrTransformNumPoints = 0 means that all points in the slice are used for the wavelet transform.
[0078] The maximum number of neighbors to search for, minus seven (maxNumOfNeighbour_log2_minus7) is an unsigned integer. This is used to derive the variable maxNumOfNeighbour, which represents the maximum number of encoded neighbors that can be searched. This controls the search range for candidate neighbor points and the number of points cached by the hardware during attribute prediction. maxNumOfNeighbour is calculated using the following formula: maxNumOfNeighbour = 2(maxNumOfNeighbor_log2_minus7 + 7), where maxNumOfNeighbour_log2_minus7 is an integer between 0 and 3.
[0079] Attribute residual secondary prediction field (cross_component_pred): A binary variable. A value of '1' indicates that attribute residual secondary prediction is allowed; a value of '0' indicates that attribute residual secondary prediction is not allowed.
[0080] Residual coding order switch field (orderSwitch): A binary variable. A value of '1' indicates that the residual coding order is UYV / GRB order; a value of '0' indicates that the residual coding order is YUV / RGB order.
[0081] Chroma channel Cb quantization parameter offset field (chromaQpOffsetCb): A signed integer. Used to control the Cb channel quantization parameter, with a value range of -16 to 16. If chromaQpOffsetCb does not exist in the attribute header, the value of chromaQpOffsetCb is 0. That is, chromaQpCb = Clip3(minQP, maxQP, attribute_qp + chromaQpOffsetCb). Note that the quantization parameter of the luma channel is lumaQp = attribute_qp. The minimum supported quantization parameter is minQP = 0, and the maximum supported quantization parameter is maxQP = 63.
[0082] Chroma channel chroma quantization parameter offset field (chromaQpOffsetCr): A signed integer. This field controls the chroma channel quantization parameter, with a value range of -16 to 16. If chromaQpOffsetCr does not exist in the attribute header, the value of chromaQpOffsetCr is 0. That is, choramQpCr = Clip3(minQP, maxQP, attribute_qp + chromaQpOffsetCr). Note that the quantization parameter for the luma channel is lumaQp = attribute_qp, with the minimum supported quantization parameter being minQP = 0 and the maximum supported quantization parameter being maxQP = 63.
[0083] Nearest neighbor prediction parameter 1 field (nearestPredParam1): Unsigned integer. Used to control the threshold of the nearest neighbor prediction.
[0084] Nearest Neighbor Prediction Parameter 2 (nearestPredParam2): An unsigned integer. This field controls the threshold for nearest neighbor prediction. The nearest neighbor prediction threshold is expressed as attrQuantParam*nearestPredParam1+nearestPredParam2.
[0085] Spatial bias coefficient field (axisBias): unsigned integer. Used to control the offset in the Z direction in the calculation of attribute prediction information.
[0086] Output Bit Depth Minus 1: An unsigned integer that controls the output bit depth. This value must be between 0 and 15. Output Bit Depth = outputBitDepthMinus1 + 1. If this syntax element is not present in the codestream, the default value is zero.
[0087] Number of Levels of Detail (LOD) field (numOflevelOfDetail): An unsigned integer. This field controls the number of LOD levels used for attribute prediction. In codestreams conforming to this standard, numOflevelOfDetail should not be greater than 32.
[0088] The maximum number of neighbors selected for prediction field (maxNumOfPredictNeighbours) is an unsigned integer. This field is used to limit the number of neighbor points selected for attribute prediction. The value of maxNumOfPredictNeighbours in the point cloud stream should not be greater than 16.
[0089] Intra-LoD prediction flag field (intraLodFlag): A binary variable used to control whether to enable intra-layer prediction. A value of '1' enables intra-layer prediction, and a value of '0' disables intra-layer prediction.
[0090] Parity-based attribute information flag field (parityBasedLevelCodingEnable): A binary variable that controls whether to enable parity-based attribute residual or transform coefficient coding. A value of '1' enables it, and a value of '0' disables it.
[0091] Color reordering mode field (colorReorderMode): Unsigned integer. Used to indicate the reordering mode currently selected for color information. '0' indicates the original point cloud input order, '1' indicates Hilbert reordering, and '2' indicates Morton reordering.
[0092] Reflectivity reordering mode field (reflReorderMode): Unsigned integer. Used to indicate the reordering mode currently selected for reflectivity information. '0' indicates the original point cloud input order, '1' indicates Hilbert reordering, and '2' indicates Morton reordering.
[0093] Maximum Buffer Limit Parameter Field (log2maxNumofCoeffMinus8): An unsigned integer between 0 and 16. The maximum buffer limit parameter for transform coefficients, maxNumofCoeff, is calculated as follows: maxNumofCoeff = 1 << (log2maxNumofCoeffMinus8 + 8). When log2maxNumofCoeffMinus8 is not present in the bitstream, maxNumofCoeff defaults to 1.
[0094] Maximum Latency Limit Parameter field (log2coeffLengthControlMinus8): An unsigned integer. Used to limit the maximum number of delays for transform parameters in attribute transform coding. The maximum delay point count is calculated as maxLatency = maxNumofCoeff * (1 << (log2coeffLengthControlMinus8 + 8)). The maximum value of maxLatency is 131072.
[0095] Attribute encoding order field (attrEncodeOrder): A binary variable. This field controls the order in which attributes are encoded when the point cloud contains multiple attribute types. A value of '0' indicates that color is encoded first, followed by reflectance; a value of '1' indicates that reflectance is encoded first, followed by color.
[0096] Adaptive Exponential Golomb Coding Sliding Window Size field (log2_golomb_group_size): Unsigned integer. Indicates the logarithm of the adaptive exponential Golomb coding sliding window size for attribute prediction residuals or transform coefficients. The adaptive exponential Golomb coding sliding window size is expressed as: golomb_sliding_window_size = 2log2_golomb_group_size.
[0097] Cross-type attribute prediction field (crossAttrTypePred): A binary variable. A value of '1' indicates that cross-type attribute prediction is allowed; a value of '0' indicates that cross-type attribute prediction is not allowed. Cross-type attribute prediction refers to the interdependence of different attribute types for attribute prediction. For example, a later-predicted attribute type uses the first-predicted attribute type for attribute prediction.
[0098] Cross-type attribute prediction weight parameter 1 (crossAttrTypePredParam1): A 15-bit unsigned integer. This parameter controls the weight parameter 1 used to calculate the geometric distance and attribute distance in cross-type attribute prediction.
[0099] Cross-type attribute prediction weight parameter 2 (crossAttrTypePredParam2): A 21-bit unsigned integer. This parameter controls the weight parameter 2 used to calculate the geometric distance and attribute distance in cross-type attribute prediction.
[0100] Reflectance group prediction flag field (refGroupPred): A binary variable used to control whether to enable the reflectance group prediction mode of the prediction transform. A value of '1' enables group prediction, and a value of '0' disables group prediction.
[0101] Color Initial Prediction Transform Ratio (colorInitPredTransRatio): A signed integer. Used in the multi-layer transform algorithm for attribute compression (transform=1), this controls the initial distance threshold used for color when building the prediction transform tree.
[0102] refInitPredTransRatio: Signed integer. Used in the multi-layer transform algorithm for attribute compression (transform=1), controls the size of the initial distance threshold used for reflectivity when building the prediction transform tree.
[0103] Transform Residual Layer Flag (transResLayer): A binary variable. Used in attribute compression multi-layer transform algorithms (transform = 1), this field controls whether attribute residual compensation is used. When transResLayer = 1, attribute residual compensation is used; when transResLayer = 0, attribute residual compensation is disabled.
[0104] Color Golomb order (ColorGolombNum): unsigned integer between 0 and 8. It is used to indicate the K-order Golomb order K = ColorGolombNum used when decoding the current color prediction residual or transform coefficient.
[0105] Reflectivity Index Golomb order (RefGolombNum): unsigned integer between 0 and 8. It is used to indicate the K-order Index Golomb order K = RefGolombNum used when decoding the current reflectivity prediction residual or transform coefficient.
[0106] CoeffEncodeModeFlag: A binary variable. A value of 1 indicates that the point cloud attribute transform coefficients are decoded according to the first decoding mode; a value of 0 indicates that the point cloud attribute transform coefficients are decoded according to the second decoding mode.
[0107] ColorQPAdjustFlag: A binary variable. A value of '0' turns off the colorQPAdjustFlag; a value of '1' turns on the colorQPAdjustFlag.
[0108] Ratio of the number of points before and after point cloud geometry quantization (colorQPAdjustScalar): Unsigned integer. Used to calculate the distance threshold for the point cloud adaptive quantization tool.
[0109] Reflectance property prediction precision value (predFixedPointFracBit): Unsigned integer. Used to indicate the shift precision of fixed-point operation during reflectance property prediction. predFixedPointFracBit=0 means that fixed-point operation is not used.
[0110] Attribute value change statistics window size (log2_pred_dist_weight_group_size): Unsigned integer. Used to control the size of the attribute value change statistics window. The window size is calculated as N = 2log2_pred_dist_weight_group_size.
[0111] The above content introduces the syntax elements of the general attribute header of the point cloud frame. The following describes the decoding instructions set in the attribute header of the point cloud frame:
[0112] (1) Decoding instructions for cross-type attribute prediction:
[0113] The decoding indication information may include attribute presence flag fields (attributePresentFlag[attrIdx]) under N attribute types, where N represents the number of attribute indexes (attrIdx), and N is an integer greater than or equal to 2; the attribute presence flag field under any attribute type is used to indicate the existence of attribute encoding under the corresponding attribute type in the point cloud frame; if the attribute presence flag field under any attribute type is a first value (for example, the first value may be 0), it may indicate that the attribute encoding under the corresponding attribute type does not exist in the point cloud frame; if the attribute presence flag field under any attribute type is a second value (for example, the second value may be 1), it may indicate that the attribute encoding under the corresponding attribute type exists in the point cloud frame. For example, attrIdx=0 indicates a color attribute type, attrIdx=1 indicates a reflectivity attribute type, attributePresentFlag[0]=0 indicates that the attribute encoding of the color attribute type does not exist in the point cloud frame, attributePresentFlag[0]=1 indicates that the attribute encoding of the color attribute type exists in the point cloud frame, attributePresentFlag[1]=0 indicates that the attribute encoding of the reflectivity attribute type does not exist in the point cloud frame, and attributePresentFlag[1]=1 indicates that the attribute encoding of the reflectivity attribute type exists in the point cloud frame. If the attribute presence flag field of at least two attribute types among the N attribute types is the second value (i.e., the attribute encoding of at least two attribute types among the N attribute types exists in the point cloud frame), and the point cloud frame allows cross-type attribute prediction, the decoding indication information also includes cross-type attribute prediction parameters (including cross-type attribute prediction weight parameter 1 (crossAttrTypePredParam1) and cross-type attribute prediction weight parameter 2 (crossAttrTypePredParam2)). That is, the attribute presence flag fields under N attribute types can be parsed first. After determining that the attribute presence flag fields under at least two attribute types in the N attribute types are the second value and the point cloud frame allows cross-type attribute prediction, the cross-type attribute prediction parameters can be parsed. The cross-type attribute prediction parameters are used to indicate attribute decoding for cross-type attribute prediction on the point cloud frame. This can be specifically reflected in the attribute header shown in Tables 3 and 4 below:
[0114] Table 3
[0115] The parsing process of the decoding indication information in the attribute header shown in Table 3 above is: first parse the attribute presence flag field under N attribute types, and when it is determined that the attribute presence flag field under at least two attribute types in the N attribute types is the second value (for example, attributePresentFlag[0]=1&&attributePresentFlag[1]=1), parse the cross-type attribute prediction field (crossAttrTypePred); if the cross-type attribute prediction field is the second value (crossAttrTypePred=1), it can be indicated that the point cloud frame allows cross-type attribute prediction, and then parse the cross-type attribute prediction parameters (crossAttrTypePredParam1 and crossAttrTypePredParam2). In this case, by default, the corresponding cross-type attribute prediction parameters are used only when the attribute prediction is performed on the post-prediction attribute type.
[0116] Table 4
[0117] The parsing process of the decoding indication information in the attribute header shown in Table 4 above is as follows: after parsing the attribute presence flag fields under N attribute types, when it is determined that the attribute presence flag fields under at least two attribute types among the N attribute types are the second value (for example, attributePresentFlag[0]=1&&attributePresentFlag[1]=1), the cross-type attribute prediction field (crossAttrTypePred) is parsed; if the cross-type attribute prediction field is the second value (crossAttrTypePred=1), it can be indicated that the point cloud frame allows cross-type attribute prediction, and then the cross-type attribute prediction parameters (crossAttrTypePredParam1 and crossAttrTypePredParam2) are parsed. In this case, the corresponding cross-type attribute prediction parameters are used by default only when the attribute prediction is performed on the post-prediction attribute type.
[0118] In one implementation, the decoding indication information may further include an attribute encoding order field (attrEncodeOrder), which may be used to indicate the first-encoded attribute type of the point cloud frame and the second-encoded attribute type of the point cloud frame; for example, attrEncodeOrder=0 indicates that the first-encoded attribute type is the color attribute type and the second-encoded attribute type is the reflectivity attribute type, and attrEncodeOrder=1 indicates that the first-encoded attribute type is the reflectivity attribute type and the second-encoded attribute type is the color attribute type. In this case, the cross-type attribute prediction parameter may include the cross-type attribute prediction parameter of the second-encoded attribute type. That is, after determining that the attribute existence flag field under at least two attribute types in the N attribute types is the second value and the point cloud frame allows cross-type attribute prediction, the attribute encoding order field may be parsed to determine the first-encoded attribute type and the second-encoded attribute type of the point cloud frame, and the corresponding cross-type attribute prediction parameter may be used when performing attribute prediction on the second-encoded attribute type. This may be specifically reflected in the attribute header shown in Table 5 below:
[0119] Table 5
[0120] The parsing process of the decoding indication information in the attribute header shown in Table 5 above is as follows: after determining that the point cloud frame allows cross-type attribute prediction, the attribute encoding order field (attrEncodeOrder) can be parsed. If attrEncodeOrder=0, it can be determined that the first-encoded attribute type is the reflection attribute type and the second-encoded attribute type is the reflectivity attribute type. The cross-type attribute prediction parameters (crossAttrTypePredParam1 and crossAttrTypePredParam2) of the reflectivity attribute type can be parsed.
[0121] In one implementation, the decoding indication information may further include an index flag field (crossAttrPredictorIndex) for cross-type attribute prediction, and the index flag field for cross-type attribute prediction may be used to indicate the attribute information index value under the first predicted attribute type used when the later predicted attribute type performs cross-type attribute prediction. That is, after determining that the attribute existence flag field under at least two attribute types in the N attribute types is the second value, and the point cloud frame allows cross-type attribute prediction, the index flag field (crossAttrPredictorIndex) for cross-type attribute prediction may be parsed to determine the attribute information index value under the first predicted attribute type used when the later predicted attribute type performs cross-type attribute prediction. For example, in this case, the cross-type attribute prediction field of the first predicted attribute type is the first value (crossAttrTypePred=0), indicating that the point cloud frame does not allow cross-type attribute prediction, and the cross-type attribute prediction field of the later predicted attribute type is the second value (crossAttrTypePred=1), indicating that the point cloud frame allows cross-type attribute prediction. For example, if the attribute type is first predicted as a color attribute type and then predicted as a reflectance attribute type, when performing cross-attribute prediction on the reflectance attribute, the index flag field (crossAttrPredictorIndex) of the cross-attribute prediction can be parsed to determine which color component under the color attribute type is used for cross-attribute prediction. This can be specifically reflected in the attribute header shown in Table 6 below:
[0122] Table 6
[0123] In one implementation, the cross-type attribute prediction parameter can be indicated using the attribute type index field (attrIdx) and the attribute information index field under the attribute type. The attribute type index field (attrIdx) and the attribute information index field under the attribute type can indicate which attribute type the cross-type attribute prediction parameter belongs to, and which attribute information under the attribute type is used when performing cross-type attribute prediction. This can be specifically reflected in the attribute header shown in Table 7 below:
[0124] Table 7
[0125] As shown in the attribute header of Table 7 above, crossAttrTypePredParam1[attrIdx][i] indicates that the cross-type attribute prediction parameter (crossAttrTypePredParam1) is the cross-type attribute prediction parameter of the i-th attribute information under the attrIdx-th attribute type. Similarly, crossAttrTypePredParam2[attrIdx][i] indicates that the cross-type attribute prediction parameter (crossAttrTypePredParam2) is the cross-type attribute prediction parameter of the i-th attribute information under the attrIdx-th attribute type. It should be noted that the cross-type attribute prediction parameter is indicated by the attribute type index field (attrIdx) and the attribute information index field under the attribute type, and can be combined with any of the attribute headers shown in Tables 1 to 6 above.
[0126] In one implementation, when there are multiple attribute information in a post-encoded attribute type, the cross-type attribute prediction parameter may include the cross-type attribute prediction parameter for each attribute information in the post-encoded attribute type; that is, after determining that the attribute presence flag field in at least two attribute types among the N attribute types is the second value, and the point cloud frame allows cross-type attribute prediction, if there are multiple attribute information in the post-encoded attribute type, the cross-type attribute prediction parameter for each attribute information in the post-encoded attribute type may be parsed in sequence. This may be specifically reflected in the attribute header shown in Table 8 below:
[0127] Table 8
[0128] The parsing process of the decoding indication information in the attribute header shown in Table 8 above is as follows: after determining that the point cloud frame allows cross-type attribute prediction, the attribute encoding order field (attrEncodeOrder) can be parsed. If attrEncodeOrder=1, it can be determined that the attribute type encoded first is the reflectance attribute type and the attribute type encoded later is the color attribute type. attribute_info_num_set_minus1[!attrEncodeOrder]+1 indicates the number of attribute information included in the color attribute type. The cross-type attribute prediction parameters (crossAttrTypePredParam1 and crossAttrTypePredParam2) under each attribute information included in the color attribute type can be parsed in turn.
[0129] (2) Decoding instructions for color space conversion:
[0130] The decoding indication information may include an attribute space conversion flag field (colorSpaceTransferFlag), which can be used to indicate the conversion of the attribute space of the point cloud frame; if the attribute space conversion flag field is a first value (for example, the first value can be 0), it can indicate that the point cloud frame has not undergone attribute space conversion; if the attribute space conversion flag field is a second value (for example, the second value can be 1), it can indicate that the point cloud frame has undergone attribute space conversion, for example, the point cloud frame has undergone conversion from the first color space (RGB color space) to the second color space (YUV color space).
[0131] In one implementation, the attribute space is a color space. If the attribute space conversion flag field is a second value (colorSpaceTransferFlag=1), the decoding indication information may further include a frame attribute quantization parameter control field; that is, after parsing the attribute space conversion flag field to be the second value, the frame attribute quantization parameter control field may be parsed. The frame attribute quantization parameter control field may be used to control the attribute quantization parameters of the point cloud frame, and the attribute quantization parameters of the point cloud frame may be used to perform attribute decoding instructions on the attribute quantization of the point cloud frame; the frame attribute quantization parameter control field includes any one of the following: color attribute quantization parameter offset, attribute quantization parameter offset of each color component. Specifically, it may be embodied in the following code 1:
[0132] As shown in the above code 1, the attribute space conversion flag field (colorSpaceTransferFlag) can be parsed. If colorSpaceTransferFlag=1, it can indicate that the point cloud frame undergoes attribute space conversion, and the frame attribute quantization parameter control field can be parsed, specifically referring to the frame attribute quantization parameter control field of the converted attribute space. In the above code 1, the frame attribute quantization parameter control field can include the frame color chroma Cb attribute quantization parameter offset (chromaQpOffsetCb) and the frame color chroma Cr attribute quantization parameter offset (chromaQpOffsetCr); the frame color chroma Cb attribute quantization parameter offset (chromaQpOffsetCb) is a signed integer that can be used to control the Cb component quantization parameter of the frame-level color attribute, with a value range of -16 to 16; the frame color chroma Cr attribute quantization parameter offset (chromaQpOffsetCr) is a signed integer that can be used to control the Cr component quantization parameter of the frame-level color attribute, with a value range of -16 to 16.
[0133] In one implementation, if the attribute space conversion flag field is the first value (colorSpaceTransferFlag=0), the decoding indication information may further include an attribute residual multiple prediction field (cross_component_Pred); that is, after parsing the attribute space conversion flag field to be the first value, the attribute residual multiple prediction field may be parsed. The attribute residual multiple prediction field may be used to indicate whether the point cloud frame allows multiple predictions of the attribute residual. This may be specifically embodied in the following code 2:
[0134] if(!colorSpaceTransferFlag){
[0135] cross_component_Pred[i]
[0136] }
[0137] As shown in Code 2 above, the attribute space conversion flag field (colorSpaceTransferFlag) can be parsed first. If colorSpaceTransferFlag = 0, it can indicate that the point cloud has not been converted to the attribute space, and the attribute residual multiple prediction field (cross_component_Pred) can be parsed. The attribute residual multiple prediction field (cross_component_Pred) can specifically be the attribute residual secondary prediction field. This field is a binary variable. A value of '1' indicates that attribute residual secondary prediction is allowed, and a value of '0' indicates that attribute residual secondary prediction is not allowed.
[0138] In one implementation, if the attribute space conversion flag field is the first value (colorSpaceTransferFlag=0), the decoding indication information may further include a transform residual layer flag field (transResLayer); that is, after parsing the attribute space conversion flag field as the first value, the transform residual layer flag field (transResLayer) may be parsed. The transform residual layer flag field may be used to control the use of attribute residual compensation by the point cloud frame when the point cloud frame uses the attribute coding mode of the multi-layer transform algorithm. This may be specifically embodied in the following code 3:
[0139] if(!colorSpaceTransferFlag){
[0140] transResLayer[attrIdx][i]
[0141] }
[0142] As shown in Code 3 above, the attribute space conversion flag field (colorSpaceTransferFlag) can be parsed first. If colorSpaceTransferFlag = 0, it can indicate that the point cloud has not been converted to the attribute space, and the transform residual layer flag field (transResLayer) can be parsed. The transform residual layer flag field (transResLayer) is a binary variable that can be used in the multi-layer transform algorithm of attribute compression (transform = 1) to control whether to use attribute residual compensation. When transResLayer = 1, it indicates that attribute residual compensation is used. When transResLayer = 0, it indicates that attribute residual compensation is not used.
[0143] (3) Decoding instructions for attribute coding modes and attribute indexes:
[0144] The decoding indication information may include an attribute coding mode flag field (transform), which may be used to indicate the attribute coding mode of the point cloud frame. The attribute coding mode flag field (transform) is an unsigned integer between 0 and 2. When transform=0, it may indicate that the attribute coding mode of the point cloud frame is the attribute prediction mode. When transform=1, it may indicate that the attribute coding mode of the point cloud frame is the attribute transformation mode (for example, a multi-layer transformation mode). When transform=2, it may indicate that the attribute coding mode of the point cloud frame is the attribute prediction transformation mode.
[0145] The decoding indication information may also include an attribute type index field (attrIdx), which may be used to indicate the attribute type of the point cloud frame. The attribute type index field (attrIdx) is an unsigned integer. When attrIdx=0, it may indicate that the attribute type of the point cloud frame is a color attribute type. When attrIdx=1, it may indicate that the attribute type of the point cloud frame is a reflectivity attribute type.
[0146] The syntax elements in the attribute header of the point cloud frame can be organized based on the attribute coding mode field and / or the attribute type index field. Specifically, it can be reflected in the attribute header shown in Table 4 above and the attribute header shown in Table 9 below:
[0147] Table 9
[0148] As shown in the attribute header of Table 9 above: attrIdx==0 indicates the 0th attribute type (ie, color type); transform[attrIdx][i]==0 indicates that the attribute coding mode of the i-th attribute information under the attrIdx-th attribute type is the attribute prediction coding mode.
[0149] (4) Decoding indication information about attribute quantization parameters:
[0150] As described above, the decoding indication information may include attribute presence flag fields (attributePresentFlag[attrIdx]) under N attribute types, where N represents the number of attribute indexes (attrIdx), and N is an integer greater than or equal to 2; the attribute presence flag field under any attribute type may be used to indicate the presence of attribute encoding under the corresponding attribute type in the point cloud frame; if the attribute presence flag field under any attribute type is a first value (for example, the first value may be 0), it may indicate that the attribute encoding under the corresponding attribute type does not exist in the point cloud frame; if the attribute presence flag field under any attribute type is a second value (for example, the second value may be 1), it may indicate that the attribute encoding under the corresponding attribute type exists in the point cloud frame. For example, attrIdx=0 indicates the color attribute type, attrIdx=1 indicates the reflectivity attribute type, attributePresentFlag[0]=0 indicates that the attribute code of the color attribute type does not exist in the point cloud frame, attributePresentFlag[0]=1 indicates that the attribute code of the color attribute type exists in the point cloud frame, attributePresentFlag[1]=0 indicates that the attribute code of the reflectivity attribute type does not exist in the point cloud frame, and attributePresentFlag[1]=1 indicates that the attribute code of the reflectivity attribute type exists in the point cloud frame.
[0151] If the attribute existence flag field under the target attribute type among the N attribute types is a second value, the decoding indication information may also include a frame attribute quantization parameter control field under the target attribute type; the frame attribute quantization parameter control field under the target attribute type can be used to control the attribute quantization parameters of the point cloud frame under the target attribute type, and the attribute quantization parameters under the target attribute type can be used to perform attribute decoding instructions on the point cloud frame regarding the attribute quantization under the target attribute type.
[0152] When the target attribute type is the reflectivity attribute, the attribute quantization parameter control field under the target attribute type may include a reflectivity attribute quantization parameter offset field, which may be specifically embodied in the following code 4:
[0153] if(attributePresentFlag[1]){
[0154] reflQpOffset[i]
[0155] }
[0156] As shown in Code 4 above, the attribute presence flag field (attributePresentFlag[1]) under the reflectivity attribute type can be parsed first. If attributePresentFlag[1] = 1, it can indicate that the attribute encoding under the reflectivity attribute type exists in the point cloud frame, and the reflectivity attribute quantization parameter offset (reflQpOffset) can be parsed. The reflectivity attribute quantization parameter offset (reflQpOffset) is a signed integer that can be used to control the attribute quantization parameter of the frame-level reflectivity attribute.
[0157] When the target attribute type is a color attribute, the attribute quantization parameter control field under the target attribute type may include any of the following: a color attribute quantization parameter offset, and an attribute quantization parameter offset of each color component.
[0158] Specifically, it can be shown in the following code 5 or code 6:
[0159] Code 5:
[0160] if(attributePresentFlag[0]){
[0161] colorQpOffset[i]
[0162] }
[0163] As shown in Code 5 above, the attribute presence flag field (attributePresentFlag[0]) under the color attribute type can be parsed first. If attributePresentFlag[0] = 1, it can indicate that the attribute encoding under the color attribute type exists in the point cloud frame, and the color attribute quantization parameter offset (colorQpOffset) can be parsed. The color attribute quantization parameter offset (colorQpOffset) is a signed integer that can be used to control the attribute quantization parameter of the frame-level color attribute, and can synchronously control each color component under the color attribute, and can be designed as a three-component parameter.
[0164] Code 6:
[0165] if(attributePresentFlag[0]){
[0166] LumaQPOffset[i]
[0167] chromaCbQPoffset[i]
[0168] chromaCrQPoffset[i]
[0169] }
[0170] As shown in Code 6 above, the attribute presence flag field (attributePresentFlag[0]) under the color attribute type can be parsed first. If attributePresentFlag[0]=1, it can indicate that the attribute encoding under the color attribute type exists in the point cloud frame, and the attribute quantization parameter offset of each color component can be parsed. The attribute quantization parameter offset of each color component can include: frame color luminance attribute quantization parameter offset (LumaQPOffset), frame color chroma Cb attribute quantization parameter offset (chromaCbQPoffset), and frame color chroma Cr attribute quantization parameter offset (chromaCrQPoffset). The frame color luminance attribute quantization parameter offset (LumaQPOffset) is a signed integer, which can be used to control the luminance component quantization parameter of the frame-level color attribute, and the value range is -32 to 32; the frame color chroma Cb attribute quantization parameter offset (chromaCbQPoffset) is a signed integer, which can be used to control the Cb component quantization parameter of the frame-level color attribute, and the value range is -32 to 32; the frame color chroma Cr attribute quantization parameter offset (chromaCrQPoffset) is a signed integer, which can be used to control the Cr component quantization parameter of the slice-level color attribute, and the value range is -32 to 32.
[0171] 2. Decoding instruction information set in the frame header:
[0172] The point cloud may include multiple point cloud frames. The decoding indication information may be set in the frame header of the point cloud frame. The frame header includes a set of parameters required for decoding the point cloud frame. The decoding indication information set in the frame header of the point cloud frame can be used to indicate the decoding of the point cloud frame. The following describes the decoding indication information in the frame header in conjunction with the syntax elements of the frame header. An exemplary syntax element of the frame header can be seen in Table 10 below:
[0173] Table 10
[0174] The following explains the syntax elements in the frame header shown in Table 10 above:
[0175] Frame number field (frame_idx): This field indicates the sequence number of the point cloud frame in the point cloud sequence. The value range of the point cloud frame number is 0 to 65535. The sequence number of each point cloud frame is 1 plus the sequence number of the previous point cloud frame. The first point cloud frame number is 0. When the sequence number of a point cloud frame reaches 65535, the sequence number of the next point cloud frame is reset to 0.
[0176] The number of point cloud slices in a frame minus one field (frame_num_slice_minus_one): The value of this field is the number of point cloud slices in a point cloud frame minus one.
[0177] Timestamp flag field (timestamp_flag): A binary variable. A value of '0' indicates that the point cloud frame does not contain timestamp information; a value of '1' indicates that the point cloud frame contains timestamp information.
[0178] Timestamp field (timestamp): indicates UTC (Universal Time Coordinated).
[0179] Frame point number high flag field (geom_num_points_upper): 16-bit value. Indicates the upper 16 bits of the number of points to be decoded (32-bit unsigned integer) contained in the point cloud frame after possible geometric quantization and deduplication.
[0180] Frame point number low flag field (geom_num_points_lower): 16-bit value. Indicates the lower 16 bits of the number of points to be decoded (32-bit unsigned integer) contained in the point cloud frame after possible geometric quantization and deduplication.
[0181] Based on Table 10 above, it can be seen that the decoding indication information set in the frame header of the point cloud frame may include a frame point number flag field, which may be used to indicate the number of points to be decoded contained in the point cloud frame (specifically, the number of points to be decoded contained in the point cloud frame after possible geometric quantization and deduplication, and the number of points to be decoded is a 32-bit unsigned integer). In more detail, the frame point number flag field may include a frame point number upper flag field (geom_num_points_upper) and a frame point number lower flag field (geom_num_points_lower); the frame point number upper flag field may be used to indicate the upper information of the number of points to be decoded contained in the point cloud frame (specifically, the upper 16 bits of the 32-bit unsigned integer of the number of points to be decoded contained in the point cloud frame after possible geometric quantization and deduplication), and the frame point number lower flag field may be used to indicate the lower information of the number of points to be decoded contained in the point cloud frame (specifically, the lower 16 bits of the 32-bit unsigned integer of the number of points to be decoded contained in the point cloud frame after possible geometric quantization and deduplication). The number of points to be decoded contained in the point cloud frame can be determined based on the high-bit information and the low-bit information. The specific determination method is: the number of points to be decoded contained in the point cloud frame (geom_num_points) = (geom_num_points_upper) << 16 + geom_num_points_lower.
[0182] In addition, the decoding indication information set in the frame header of the point cloud frame can also include a frame slice number flag field (that is, the number of point cloud slices in the frame minus one field (frame_num_slice_minus_one)). The frame slice number flag field can be used to indicate the number of point cloud slices contained in the point cloud frame. The number of point cloud slices is calculated as: number of point cloud slices = frame_num_slice_minus_one+1.
[0183] 3. Decoding instructions set in the slice header:
[0184] The point cloud may include multiple point cloud frames, and the point cloud frame may include multiple point cloud slices. The decoding indication information may be set in the slice header of the point cloud slice, and the slice header includes the parameter set required for decoding the point cloud slice. The decoding indication information set in the slice header of the point cloud slice can be used to indicate the decoding of the point cloud slice; the slice header may include a geometric slice header and an attribute slice header. The decoding indication information may be set in the geometric slice header and the attribute slice header, and the geometric slice header includes the parameter set required for decoding the geometric information of the point cloud slice, and the attribute header includes the parameter set required for decoding the attribute information of the point cloud slice.
[0185] (1) The decoding indication information in the geometry slice header is introduced below in conjunction with the syntax elements of the geometry slice header. An exemplary syntax element of the geometry slice header can be found in Table 11 below:
[0186] Table 11
[0187] The syntax elements in the geometry slice header shown in Table 11 are explained below:
[0188] Slice ID (slice_id): Unsigned integer. Indicates the slice ID.
[0189] Slice_num_points_upper: unsigned integer. Indicates the upper 16 bits of the number of points to be decoded contained in the point cloud slice (32-bit unsigned integer).
[0190] Slice_num_points_lower: unsigned integer. Indicates the lower 16 bits of the number of points to be decoded contained in the point cloud slice (32-bit unsigned integer).
[0191] Based on the above Table 11, it can be seen that the decoding indication information set in the geometry slice header of the point cloud slice can include a slice point number flag field, which can be used to indicate the number of points to be decoded contained in the point cloud slice (32-bit unsigned integer). In more detail, the slice point number flag field includes a slice point number high-order flag field (i.e., the high-order part of the number of points contained in the slice field (slice_num_points_upper)) and a slice point number low-order flag field (i.e., the low-order part of the number of points contained in the slice field (slice_num_points_lower)); the slice point number high-order flag field (slice_num_points_upper) can be used to indicate the high-order information of the number of points to be decoded contained in the point cloud slice (specifically, the upper 16 bits of the number of points to be decoded contained in the point cloud slice (32-bit unsigned integer)), and the slice point number low-order flag field (slice_num_points_lower) can be used to indicate the low-order information of the number of points to be decoded contained in the point cloud slice (specifically, the lower 16 bits of the number of points to be decoded contained in the point cloud slice (32-bit unsigned integer)). The number of points to be decoded contained in the point cloud slice can be determined based on the high-bit information and the low-bit information. The specific determination method is: the number of points to be decoded contained in the point cloud slice (slice_num_points) = ((slice_num_points_upper<<16)+slice_num_points_lower).
[0192] (2) The following describes the decoding indication information in the attribute slice header in conjunction with the syntax elements of the attribute slice header. An exemplary syntax element of the attribute slice header can be found in Table 12 below:
[0193] Table 12
[0194] The following explains the syntax elements in the attribute slice header shown in Table 12 above:
[0195] Slice ID (slice_id): Unsigned integer. Indicates the slice ID.
[0196] SliceReflQPoffset: A signed integer that controls the slice-level reflectivity attribute quantization parameter, with a value range of -32 to 32.
[0197] Slice Color Brightness Quantization Parameter Offset (sliceColorQPoffset): A signed integer that controls the slice-level color attribute quantization parameter, with a value range of -32 to 32.
[0198] Another exemplary syntax element of the attribute slice header can be seen in Table 13 below:
[0199] Table 13
[0200] The following explains the syntax elements in the attribute slice header shown in Table 13 above:
[0201] Slice ID (slice_id): Unsigned integer. Indicates the slice ID.
[0202] SliceReflQPoffset: A signed integer that controls the slice-level reflectivity attribute quantization parameter, with a value range of -32 to 32.
[0203] Slice Luma Quantization Parameter Offset (sliceLumaQPoffset): A signed integer that controls the quantization parameter of the luminance component of slice-level color attributes. The value range is -32 to 32.
[0204] SliceChromaCbQPoffset: A signed integer that controls the quantization parameter of the Cb component of the slice-level color attribute, with a value range of -32 to 32.
[0205] SliceChromaCrQPoffset: A signed integer that controls the quantization parameter of the Cr component of the slice-level color attribute, with a value range of -32 to 32.
[0206] Based on Tables 12 and 13 above, it can be seen that the decoding indication information set in the attribute slice header of the point cloud slice may include a slice attribute quantization parameter control field, and the slice attribute quantization parameter control field can be used to control the attribute quantization parameters of the point cloud slice, and the attribute quantization parameters of the point cloud slice can be used to perform attribute decoding instructions on attribute quantization of the point cloud slice. Among them, the slice attribute quantization parameter control field may include: the slice reflectance attribute quantization parameter control field (i.e., the slice reflectance attribute quantization parameter offset (sliceReflQPoffset)) and the slice color attribute quantization parameter control field (i.e., the slice color luminance attribute quantization parameter offset (sliceColorQPoffset)); or, the slice attribute quantization parameter control field may include: the slice reflectance attribute quantization parameter control field (i.e., the slice reflectance attribute quantization parameter offset (sliceReflQPoffset)) and the slice color component attribute quantization parameter control field (i.e., the slice color luminance attribute quantization parameter offset (sliceLumaQPoffset), the slice color chroma Cb attribute quantization parameter offset (sliceChromaCbQPoffset), and the slice color chroma Cr attribute quantization parameter offset (sliceChromaCrQPoffset)).
[0207] S302: Decode the point cloud according to the decoding instruction information.
[0208] After acquiring the point cloud code stream, the point cloud can be decoded according to the decoding instruction information in the point cloud code stream. More specifically, when the decoding instruction information is set in the attribute header of the point cloud frame, the attribute decoding of the point cloud frame can be performed according to the decoding instruction information set in the attribute header of the point cloud frame; when the decoding instruction information is set in the frame header of the point cloud frame, the point cloud frame can be decoded according to the decoding instruction information set in the frame header of the point cloud frame; when the decoding instruction information is set in the slice header of the point cloud slice, the point cloud slice can be decoded according to the decoding instruction information set in the slice header of the point cloud slice.
[0209] In an embodiment of the present application, the decoding indication information in the point cloud code stream can be used to provide decoding instructions for different types of data in the point cloud. The different types of data include at least one of the following: point cloud frames and point cloud slices. Thus, based on the decoding indication effect of the decoding indication information on different types of data in the point cloud, the point cloud is decoded according to the decoding indication information, which can improve the decoding performance of the point cloud.
[0210] The present invention provides a point cloud processing method, which mainly introduces the point cloud encoding process. The point cloud processing method can be executed by a computer device, which can be the encoding device 201 in the above-mentioned point cloud processing system. As shown in Figure 4, the point cloud processing method can include but is not limited to the following steps S401-S402:
[0211] S401, generate decoding indication information, and encode the decoding indication information into the point cloud code stream; the decoding indication information is used to provide decoding instructions for different types of data in the point cloud, and the different types of data include at least one of the following: point cloud frames and point cloud slices.
[0212] Decoding instruction information can be used to indicate the decoding of different types of data in the point cloud. The decoding instruction information can be encoded into the attribute header, frame header, and slice header of the point cloud code stream. Specifically, the decoding instruction information encoded into the attribute header can be used to indicate the attribute decoding of the point cloud frame in the point cloud; the decoding instruction information encoded into the frame header can be used to indicate the decoding of the point cloud frame in the point cloud; and the decoding instruction information encoded into the slice header can be used to indicate the decoding of the point cloud slice in the point cloud. The following describes the generation process of the decoding instruction information in the encoding attribute header, frame header, and slice header respectively:
[0213] 1. Decoding instructions encoded into the attribute header:
[0214] The point cloud may include multiple point cloud frames, and the decoding indication information may be encoded into the attribute header of the point cloud frame. The decoding indication information encoded into the attribute header of the point cloud frame is used to indicate attribute decoding of the point cloud frame.
[0215] (1) Decoding instructions for cross-type attribute prediction:
[0216] The decoding indication information may include attribute presence flag fields (attributePresentFlag[attrIdx]) under N attribute types, where N represents the number of attribute indexes (attrIdx) and is an integer greater than or equal to 2; the attribute presence flag field under any attribute type is used to indicate the presence of attribute encoding under the corresponding attribute type in the point cloud frame. Generating the decoding indication information may specifically include: if the attribute encoding under any attribute type does not exist in the point cloud frame, the attribute presence flag field under the corresponding attribute type may be set to a first value (for example, the first value may be 0); if the attribute encoding under any attribute type exists in the point cloud frame, the attribute presence flag field under the corresponding attribute type may be set to a second value (for example, the second value may be 1). For example, attrIdx=0 indicates the color attribute type, and attrIdx=1 indicates the reflectivity attribute type; if the attribute code of the color attribute type does not exist in the point cloud frame, attributePresentFlag[0]=0; if the attribute code of the color attribute type exists in the point cloud frame, attributePresentFlag[0]=1; if the attribute code of the reflectivity attribute type does not exist in the point cloud frame, attributePresentFlag[1]=0; if the attribute code of the reflectivity attribute type exists in the point cloud frame, attributePresentFlag[1]=1. If the attribute presence flag field under at least two attribute types among N attribute types is set to the second value, and the point cloud frame allows cross-type attribute prediction, the cross-type attribute prediction parameter can be added to the decoding indication information; wherein, the cross-type attribute prediction parameter can be used to perform attribute decoding instructions on the point cloud frame regarding cross-type attribute prediction; specifically, when the attribute presence flag field under at least two attribute types among N attribute types is set to the second value (for example, attributePresentFlag[0]=1&&attributePresentFlag[1]=1), if it is recognized that the point cloud frame allows cross-type attribute prediction, the cross-type attribute prediction field (crossAttrTypePred) can be added to the decoding indication information, and the cross-type attribute prediction field is set to the second value (crossAttrTypePred=1), then the cross-type attribute prediction parameters (crossAttrTypePredParam1 and crossAttrTypePredParam2) can be added to the decoding indication information.
[0217] In one implementation, the decoding indication information may further include an attribute encoding order field, and the attribute encoding order field may be used to indicate the pre-encoded attribute type of the point cloud frame and the post-encoded attribute type of the point cloud frame; the cross-type attribute prediction parameter may include a cross-type attribute prediction parameter of the post-encoded attribute type. Specifically, after the cross-type attribute prediction field (crossAttrTypePred) is included in the decoding indication information and the cross-type attribute prediction field is set to a second value (crossAttrTypePred=1), the attribute encoding order field (attrEncodeOrder) may be added to the decoding indication information, and the value of the attribute encoding order field (attrEncodeOrder) may be determined based on the pre-encoded attribute type of the point cloud frame and the post-encoded attribute type of the point cloud frame. The cross-type attribute prediction parameter of the post-encoded attribute type of the point cloud frame may be added to the decoding indication information based on the post-encoded attribute type of the point cloud frame.
[0218] In one implementation, the decoding indication information may further include an index flag field for cross-type attribute prediction (crossAttrPredictorIndex), which may be used to indicate the attribute information index value under the first-predicted attribute type used when the second-predicted attribute type performs cross-type attribute prediction.
[0219] In one implementation, the cross-type attribute prediction parameter can be indicated using the attribute type index field (attrIdx) and the attribute information index field under the attribute type. The attribute type index field (attrIdx) and the attribute information index field under the attribute type can indicate which attribute type the cross-type attribute prediction parameter is, and which attribute information under the attribute type is used as the cross-type attribute prediction parameter when performing cross-type attribute prediction.
[0220] In one implementation, when there are multiple attribute information of the post-encoded attribute type, the cross-type attribute prediction parameter may include the cross-type attribute prediction parameter of each attribute information under the post-encoded attribute type. Specifically, after the cross-type attribute prediction field (crossAttrTypePred) is included in the decoding indication information and the cross-type attribute prediction field is set to the second value (crossAttrTypePred=1), the cross-type attribute prediction parameter of each attribute information under the post-encoded attribute type may be added to the decoding indication information.
[0221] (2) Decoding instructions for color space conversion:
[0222] The decoding indication information may include an attribute space conversion flag field (colorSpaceTransferFlag), which may be used to indicate the conversion status of the attribute space of the point cloud frame; generating the decoding indication information may specifically include: if the point cloud frame has not undergone attribute space conversion, the attribute space conversion flag field may be set to a first value (colorSpaceTransferFlag=0); if the point cloud frame has undergone attribute space conversion, the attribute space conversion flag field may be set to a second value (colorSpaceTransferFlag=1).
[0223] In one implementation, the attribute space is a color space; if the attribute space conversion flag field is set to the second value (colorSpaceTransferFlag=1), a frame attribute quantization parameter control field can be added to the decoding indication information; the frame attribute quantization parameter control field can be used to control the attribute quantization parameters of the point cloud frame, and the attribute quantization parameters of the point cloud frame can be used to perform attribute decoding instructions on attribute quantization of the point cloud frame. The frame attribute quantization control field can include any of the following: a color attribute quantization parameter offset, and an attribute quantization parameter offset for each color component.
[0224] In one implementation, if the attribute space conversion flag field is set to the first value (colorSpaceTransferFlag=0), the attribute residual multiple prediction field (cross_component_Pred) can be added to the decoding indication information; the attribute residual multiple prediction field can be used to indicate whether the point cloud frame allows multiple prediction of attribute residuals.
[0225] In one implementation, if the attribute space conversion flag field is set to the first value (colorSpaceTransferFlag=0), the transform residual layer flag field (transResLayer) can be added to the decoding indication information; the transform residual layer flag field can be used to control the use of attribute residual compensation in the point cloud frame when the point cloud frame uses the attribute encoding mode of the multi-layer transform algorithm.
[0226] (3) Decoding instructions for attribute coding modes and attribute indexes:
[0227] An attribute coding mode flag field is added to the decoding indication information to indicate the attribute coding mode of the point cloud frame. An attribute type index field is also added to the decoding indication information to indicate the attribute type of the point cloud frame.
[0228] The syntax elements in the attribute header of the point cloud frame can be organized based on the attribute encoding mode field and / or the attribute type index field.
[0229] (4) Decoding indication information about attribute quantization parameters:
[0230] As described above, the decoding indication information may include attribute presence flag fields (attributePresentFlag[attrIdx]) under N attribute types, where N represents the number of attribute indexes (attrIdx) and is an integer greater than or equal to 2; the attribute presence flag field under any attribute type is used to indicate the presence of attribute encoding under the corresponding attribute type in the point cloud frame. Generating the decoding indication information may specifically include: if the attribute encoding under any attribute type does not exist in the point cloud frame, the attribute presence flag field under the corresponding attribute type may be set to a first value (for example, the first value may be 0); if the attribute encoding under any attribute type exists in the point cloud frame, the attribute presence flag field under the corresponding attribute type may be set to a second value (for example, the second value may be 1). For example, attrIdx=0 indicates the color attribute type, and attrIdx=1 indicates the reflectivity attribute type; if the attribute code of the color attribute type does not exist in the point cloud frame, attributePresentFlag[0]=0; if the attribute code of the color attribute type exists in the point cloud frame, attributePresentFlag[0]=1; if the attribute code of the reflectivity attribute type does not exist in the point cloud frame, attributePresentFlag[1]=0; if the attribute code of the reflectivity attribute type exists in the point cloud frame, attributePresentFlag[1]=1.
[0231] If the attribute existence flag field under the target attribute type among the N attribute types is set to the second value, the frame attribute quantization parameter control field under the target attribute type can be added to the decoding indication information; the frame attribute quantization parameter control field under the target attribute type can be used to control the attribute quantization parameter of the point cloud frame under the target attribute type, and the attribute quantization parameter under the target attribute type can be used to perform attribute decoding instructions on the point cloud frame regarding the attribute quantization under the target attribute type. When the target attribute type is the reflectivity attribute, the attribute quantization parameter control field under the target attribute type may include a reflectivity attribute quantization parameter offset (reflQpOffset); when the target attribute type is the color attribute, the attribute quantization parameter control field under the target attribute type may include any of the following: color attribute quantization parameter offset (colorQpOffset), attribute quantization parameter offsets of each color component (frame color luminance attribute quantization parameter offset (LumaQPOffset), frame color chroma Cb attribute quantization parameter offset (chromaCbQPoffset), and frame color chroma Cr attribute quantization parameter offset (chromaCrQPoffset)).
[0232] 2. Decoding instructions encoded into the frame header:
[0233] The point cloud may include multiple point cloud frames, and the decoding indication information may be encoded into the frame header of the point cloud frame. The decoding indication information encoded into the frame header of the point cloud frame is used to indicate decoding of the point cloud frame.
[0234] The decoding indication information may include a frame point number flag field; generating the decoding indication information may specifically include: identifying the number of points to be encoded contained in the point cloud frame; and setting the frame point number flag field to the number of points to be encoded. In more detail, the frame point number flag field may include a frame point number upper flag field (geom_num_points_upper) and a frame point number lower flag field (geom_num_points_lower); setting the frame point number flag field to the number of points to be encoded may specifically include: splitting the number of points to be encoded into upper-order information and lower-order information; setting the frame point number upper-order flag field to the upper-order information, and setting the frame point number lower-order flag field to the lower-order information.
[0235] In addition, the decoding indication information also includes a frame slice number flag field (frame_num_slice_minus_one); generating the decoding indication information may specifically include: identifying the number of point cloud slices contained in the point cloud frame; and setting the frame slice number flag field to the number of point cloud slices.
[0236] 3. Decoding instructions encoded into the slice header:
[0237] The point cloud may include multiple point cloud frames, and the point cloud frame may include multiple point cloud slices. The decoding indication information may be encoded into the header of the point cloud slice, and the decoding indication information encoded into the header of the point cloud slice may be used to indicate the decoding of the point cloud slice; the header may include a geometric header and an attribute header, and the decoding indication information may be encoded into the geometric header and the attribute header.
[0238] (1) Decoding instructions encoded into the geometry slice header:
[0239] The decoding indication information may include a slice point number flag field; generating the decoding indication information may specifically include: identifying the number of points to be encoded contained in the point cloud slice; and setting the number flag field to the number of points to be encoded. Specifically, the slice point number flag field may include a slice point number upper flag field (slice_num_points_upper) and a slice point number lower flag field (slice_num_points_lower); setting the slice point number flag field to the number of points to be encoded may specifically include: splitting the number of points to be encoded into upper information and lower information; setting the slice point number upper flag field to the upper information, and setting the slice point number lower flag field to the lower information.
[0240] (2) Decoding instructions encoded into the attribute slice header:
[0241] For the decoding indication information in the attribute slice header, generating the decoding indication information may specifically include: adding a slice attribute quantization parameter control field in the decoding indication information, the slice attribute quantization parameter control field can be used to control the attribute quantization parameters of the point cloud slice, and the attribute quantization parameters of the point cloud slice can be used to perform attribute decoding instructions on the attribute quantization of the point cloud slice. The slice attribute quantization parameter control field may include: a slice reflectance attribute quantization parameter control field (sliceReflQPoffset) and a slice color attribute quantization parameter control field (sliceColorQPoffset); or, the slice attribute quantization parameter control field includes: a slice reflectance attribute quantization parameter control field (sliceReflQPoffset) and a slice color component attribute quantization parameter control field (sliceLumaQPoffset, sliceChromaCbQPoffset, and sliceChromaCrQPoffset).
[0242] S402: Send the point cloud code stream to a decoding device so that the decoding device decodes the point cloud according to the decoding instruction information.
[0243] In an embodiment of the present application, the decoding indication information in the point cloud code stream can be used to provide decoding instructions for different types of data in the point cloud. The different types of data include at least one of the following: point cloud frames and point cloud slices. Thus, based on the decoding indication effect of the decoding indication information on different types of data in the point cloud, the point cloud is decoded according to the decoding indication information, which can improve the decoding performance of the point cloud.
[0244] The above describes in detail the method of the embodiment of the present application. In order to facilitate better implementation of the above scheme of the embodiment of the present application, the device of the embodiment of the present application is provided below accordingly.
[0245] Please refer to Figure 5, which is a schematic diagram of the structure of a point cloud processing device provided in an embodiment of the present application. The point cloud processing device can be set in the computer device provided in an embodiment of the present application, and the computer device can be the decoding device mentioned throughout the text. The point cloud processing device shown in Figure 5 can be a computer program (including program code) running on the computer device. The point cloud processing device can be used to perform some or all of the steps in the method embodiment shown in Figure 3. Referring to Figure 5, the point cloud processing device can include the following units:
[0246] An acquisition unit 501 is configured to acquire a point cloud code stream; the point cloud code stream includes decoding instruction information, and the decoding instruction information is used to indicate decoding of different types of data in the point cloud, where the different types of data include at least one of the following: a point cloud frame and a point cloud slice;
[0247] The processing unit 502 is configured to decode the point cloud according to the decoding instruction information.
[0248] In one implementation, the point cloud includes multiple point cloud frames, the decoding indication information sets the attribute header of the point cloud frame, and the decoding indication information is used to indicate attribute decoding of the point cloud frame.
[0249] In one implementation, the decoding indication information includes attribute presence flag fields under N attribute types, where N is an integer greater than or equal to 2; the attribute presence flag field under any attribute type is used to indicate the presence of attribute encoding under the corresponding attribute type in the point cloud frame;
[0250] If the attribute existence flag field under any attribute type is the first value, it means that the attribute code under the corresponding attribute type does not exist in the point cloud frame;
[0251] If the attribute existence flag field under any attribute type is the second value, it means that the attribute code under the corresponding attribute type exists in the point cloud frame.
[0252] In one implementation, if the attribute presence flag field of at least two attribute types among the N attribute types is the second value, and the point cloud frame allows cross-type attribute prediction, the decoding indication information further includes a cross-type attribute prediction parameter;
[0253] The cross-type attribute prediction parameter is used to indicate attribute decoding of the point cloud frame regarding cross-type attribute prediction.
[0254] In one implementation, the decoding indication information further includes an attribute coding order field, where the attribute coding order field is used to determine a first-coded attribute type of the point cloud frame and a later-coded attribute type of the point cloud frame;
[0255] The cross-type attribute prediction parameters include cross-type attribute prediction parameters of the post-encoded attribute type.
[0256] In one implementation, when a post-encoded attribute type contains multiple attribute information, the cross-type attribute prediction parameter includes a cross-type attribute prediction parameter of each attribute information under the post-encoded attribute type.
[0257] In one implementation, the decoding indication information further includes an index flag field for cross-type attribute prediction, which is used to indicate the attribute information index value under the first-prediction attribute type used when the second-prediction attribute type performs cross-type attribute prediction.
[0258] In one implementation, the cross-type attribute prediction parameter is indicated by an attribute type index field and an attribute information index field under the attribute type.
[0259] In one implementation, if the attribute presence flag field under the target attribute type among the N attribute types is a second value, the decoding indication information further includes a frame attribute quantization parameter control field under the target attribute type;
[0260] The frame attribute quantization parameter control field under the target attribute type is used to control the attribute quantization parameter of the point cloud frame under the target attribute type. The attribute quantization parameter under the target attribute type is used to perform attribute decoding instructions on the point cloud frame regarding the attribute quantization under the target attribute type.
[0261] When the target attribute type is the reflectance attribute, the attribute quantization parameter control field under the target attribute type includes the reflectance attribute quantization parameter offset; when the target attribute type is the color attribute, the attribute quantization parameter control field under the target attribute type includes any one of the following: color attribute quantization parameter offset, attribute quantization parameter offset of each color component.
[0262] In one implementation, the decoding indication information includes an attribute space conversion flag field, and the attribute space conversion flag field is used to indicate the conversion status of the attribute space of the point cloud frame;
[0263] If the attribute space conversion flag field is the first value, it means that the point cloud frame has not been converted into the attribute space;
[0264] If the attribute space conversion flag field is the second value, it means that the point cloud frame undergoes attribute space conversion.
[0265] In one implementation, the attribute space is a color space, and if the attribute space conversion flag field is a second value, the decoding indication information further includes a frame attribute quantization parameter control field;
[0266] The frame attribute quantization parameter control field is used to control the attribute quantization parameters of the point cloud frame. The attribute quantization parameters of the point cloud frame are used to indicate attribute decoding of the point cloud frame regarding attribute quantization.
[0267] The frame attribute quantization parameter control field includes any of the following: color attribute quantization parameter offset, attribute quantization parameter offset of each color component.
[0268] In one implementation, if the attribute space conversion flag field is a first value, the decoding indication information further includes an attribute residual multiple prediction field;
[0269] The attribute residual multiple prediction field is used to indicate whether the point cloud frame allows multiple predictions of attribute residuals.
[0270] In one implementation, if the attribute space conversion flag field is a first value, the decoding indication information further includes a transform residual layer flag field;
[0271] The transformation residual layer flag field is used to control the use of attribute residual compensation of the point cloud frame when the point cloud frame uses the attribute encoding mode of the multi-layer transformation algorithm.
[0272] In one implementation, the decoding indication information includes an attribute coding mode flag field, and the attribute coding mode flag field is used to indicate the attribute coding mode of the point cloud frame;
[0273] The decoding indication information further includes an attribute type index field, which is used to indicate the attribute type of the point cloud frame;
[0274] The syntax elements in the attribute header of the point cloud frame are classified and organized based on the attribute coding mode flag field and / or the attribute type index field.
[0275] In one implementation, the point cloud includes multiple point cloud frames, and the decoding indication information is set in the frame header of the point cloud frame, and the decoding indication information is used to indicate decoding of the point cloud frame.
[0276] In one implementation, the decoding indication information includes a frame point number flag field; the frame point number flag field is used to indicate the number of points to be decoded contained in the point cloud frame.
[0277] In one implementation, the frame point count flag field includes a frame point count high-order flag field and a frame point count low-order flag field; the frame point count high-order flag field is used to indicate the high-order information of the number of points to be decoded contained in the point cloud frame, and the frame point count low-order flag field is used to indicate the low-order information of the number of points to be decoded contained in the point cloud frame;
[0278] The number of points to be decoded contained in the point cloud frame is determined based on the high-bit information and the low-bit information.
[0279] In one implementation, the decoding indication information includes a frame slice number flag field; the frame slice number flag field is used to indicate the number of point cloud slices contained in the point cloud frame.
[0280] In one implementation, the point cloud includes multiple point cloud frames, the point cloud frames include multiple point cloud slices, the decoding indication information is set in the header of the point cloud slice, and the decoding indication information is used to indicate the decoding of the point cloud slice.
[0281] In one implementation, the slice header includes a geometric slice header, and the decoding indication information includes a slice point number flag field; the slice point number flag field is used to indicate the number of points to be decoded contained in the point cloud slice.
[0282] In one implementation, the slice point number flag field includes a slice point number high-order flag field and a slice point number low-order flag field; the slice point number high-order flag field is used to indicate the high-order information of the number of to-be-decoded points contained in the point cloud slice, and the slice point number low-order flag field is used to indicate the low-order information of the number of to-be-decoded points contained in the point cloud slice;
[0283] The number of points to be decoded contained in the point cloud is determined based on the high-bit information and the low-bit information.
[0284] In one implementation, the slice header includes an attribute slice header, the decoding indication information includes a slice attribute quantization parameter control field, the slice attribute quantization parameter control field is used to control the attribute quantization parameter of the point cloud slice, and the attribute quantization parameter of the point cloud slice is used to perform attribute decoding indication on the point cloud slice regarding attribute quantization;
[0285] The slice attribute quantization parameter control field includes: a slice reflectance attribute quantization parameter control field and a slice color attribute quantization parameter control field; or, the slice attribute quantization parameter control field includes: a slice reflectance attribute quantization parameter control field and a slice color component attribute quantization parameter control field.
[0286] According to another embodiment of the present application, the various units in the point cloud processing device shown in Figure 5 can be individually or completely merged into one or several other units to form a whole, or one (or some) of the units can be further divided into multiple functionally smaller units to form a whole, which can achieve the same operation without affecting the realization of the technical effects of the embodiments of the present application. The above-mentioned units are divided based on logical functions. In actual applications, the functions of one unit can also be implemented by multiple units, or the functions of multiple units can be implemented by one unit. In other embodiments of the present application, the point cloud processing device may also include other units. In actual applications, these functions can also be implemented with the assistance of other units, and can be implemented by the collaboration of multiple units.
[0287] According to another embodiment of the present application, a point cloud processing device as shown in FIG5 can be constructed, and the point cloud processing method of the embodiment of the present application can be implemented, by running a computer program (including program code) capable of executing some or all of the steps involved in the method shown in FIG3 on a general-purpose computing device, such as a computer, including processing elements and storage elements such as a central processing unit (CPU), a random access memory (RAM), and a read-only memory (ROM). The computer program can be recorded on, for example, a computer-readable storage medium, and loaded into the computing device via the computer-readable storage medium and executed therein.
[0288] In an embodiment of the present application, the decoding indication information in the point cloud code stream can be used to provide decoding instructions for different types of data in the point cloud. The different types of data include at least one of the following: point cloud frames and point cloud slices. Thus, based on the decoding indication effect of the decoding indication information on different types of data in the point cloud, the point cloud is decoded according to the decoding indication information, which can improve the decoding performance of the point cloud.
[0289] Please refer to Figure 6, which is a schematic diagram of the structure of a point cloud processing device provided in an embodiment of the present application. The point cloud processing device can be set in the computer device provided in the embodiment of the present application. The computer device can be the encoding device mentioned throughout the text. The point cloud processing device shown in Figure 6 can be a computer program (including program code) running on the computer device. The point cloud processing device can be used to perform some or all of the steps in the method embodiment shown in Figure 4. Referring to Figure 6, the point cloud processing device can include the following units:
[0290] The processing unit 601 is configured to generate decoding instruction information and encode the decoding instruction information into the point cloud code stream; the decoding instruction information is used to indicate decoding of different types of data in the point cloud, where the different types of data include at least one of the following: a point cloud frame and a point cloud slice;
[0291] The communication unit 602 is used to send the point cloud code stream to the decoding device so that the decoding device decodes the point cloud according to the decoding instruction information.
[0292] According to another embodiment of the present application, the various units in the point cloud processing device shown in Figure 6 can be individually or completely merged into one or several other units to form a structure, or one (or some) of the units can be further divided into multiple functionally smaller units to form a structure, which can achieve the same operation without affecting the realization of the technical effects of the embodiments of the present application. The above-mentioned units are divided based on logical functions. In actual applications, the functions of one unit can also be implemented by multiple units, or the functions of multiple units can be implemented by one unit. In other embodiments of the present application, the point cloud processing device may also include other units. In actual applications, these functions can also be assisted by other units to be implemented, and can be implemented by multiple units collaborating.
[0293] According to another embodiment of the present application, a point cloud processing device as shown in FIG. 6 can be constructed, and the point cloud processing method of the embodiment of the present application can be implemented, by running a computer program (including program code) capable of executing some or all of the steps involved in the method shown in FIG. 4 on a general-purpose computing device, such as a computer, including processing elements and storage elements such as a central processing unit (CPU), a random access memory (RAM), and a read-only memory (ROM). The computer program can be recorded on, for example, a computer-readable storage medium, and loaded into the computing device via the computer-readable storage medium and executed therein.
[0294] In an embodiment of the present application, the decoding indication information in the point cloud code stream can be used to provide decoding instructions for different types of data in the point cloud. The different types of data include at least one of the following: point cloud frames and point cloud slices. Thus, based on the decoding indication effect of the decoding indication information on different types of data in the point cloud, the point cloud is decoded according to the decoding indication information, which can improve the decoding performance of the point cloud.
[0295] Based on the above method and device embodiments, an embodiment of the present application provides a computer device. Please refer to Figure 6, which is a schematic diagram of the structure of a computer device provided in an embodiment of the present application. The computer device shown in Figure 7 includes at least a processor 701, an input interface 702, an output interface 703, and a computer-readable storage medium 704. The processor 701, input interface 702, output interface 703, and computer-readable storage medium 704 may be connected via a bus or other means.
[0296] Computer-readable storage medium 704 may be stored in a memory of a computer device. Computer-readable storage medium 704 is used to store a computer program, which includes computer instructions. Processor 701 is used to execute the program instructions stored in computer-readable storage medium 704. Processor 701 (or CPU (Central Processing Unit)) is the computing core and control core of the computer device. It is suitable for implementing one or more computer instructions, and is specifically suitable for loading and executing one or more computer instructions to implement a corresponding method flow or corresponding function.
[0297] The embodiment of the present application also provides a computer-readable storage medium (Memory), which is a memory device in a computer device for storing programs and data. It is understandable that the computer-readable storage medium here can include both built-in storage media in the computer device and, of course, extended storage media supported by the computer device. The computer-readable storage medium provides a storage space that stores the operating system of the computer device. In addition, one or more computer instructions suitable for being loaded and executed by the processor are also stored in the storage space. These computer instructions can be one or more computer programs (including program codes). It should be noted that the computer-readable storage medium here can be a high-speed RAM memory or a non-volatile memory (Non-Volatile Memory), such as at least one disk memory; optionally, it can also be at least one computer-readable storage medium located away from the aforementioned processor.
[0298] In some embodiments, the computer device may be a decoding device, and the processor 701 may load and execute one or more computer instructions stored in the computer-readable storage medium 704 to implement the corresponding steps of the point cloud processing method shown in FIG3 . In a specific implementation, the computer instructions in the computer-readable storage medium 704 are loaded by the processor 701 and execute the following steps:
[0299] Obtaining a point cloud code stream; the point cloud code stream includes decoding instruction information, the decoding instruction information being used to indicate decoding of different types of data in the point cloud, the different types of data including at least one of the following: a point cloud frame and a point cloud slice;
[0300] Decode the point cloud according to the decoding instructions.
[0301] In one implementation, the point cloud includes multiple point cloud frames, the decoding indication information sets the attribute header of the point cloud frame, and the decoding indication information is used to indicate attribute decoding of the point cloud frame.
[0302] In one implementation, the decoding indication information includes attribute presence flag fields under N attribute types, where N is an integer greater than or equal to 2; the attribute presence flag field under any attribute type is used to indicate the presence of attribute encoding under the corresponding attribute type in the point cloud frame;
[0303] If the attribute existence flag field under any attribute type is the first value, it means that the attribute code under the corresponding attribute type does not exist in the point cloud frame;
[0304] If the attribute existence flag field under any attribute type is the second value, it means that the attribute code under the corresponding attribute type exists in the point cloud frame.
[0305] In one implementation, if the attribute presence flag field of at least two attribute types among the N attribute types is the second value, and the point cloud frame allows cross-type attribute prediction, the decoding indication information further includes a cross-type attribute prediction parameter;
[0306] The cross-type attribute prediction parameter is used to indicate attribute decoding of the point cloud frame regarding cross-type attribute prediction.
[0307] In one implementation, the decoding indication information further includes an attribute coding order field, where the attribute coding order field is used to determine a first-coded attribute type of the point cloud frame and a later-coded attribute type of the point cloud frame;
[0308] The cross-type attribute prediction parameters include cross-type attribute prediction parameters of the post-encoded attribute type.
[0309] In one implementation, when a post-encoded attribute type contains multiple attribute information, the cross-type attribute prediction parameter includes a cross-type attribute prediction parameter of each attribute information under the post-encoded attribute type.
[0310] In one implementation, the decoding indication information further includes an index flag field for cross-type attribute prediction, which is used to indicate the attribute information index value under the first-prediction attribute type used when the second-prediction attribute type performs cross-type attribute prediction.
[0311] In one implementation, the cross-type attribute prediction parameter is indicated by an attribute type index field and an attribute information index field under the attribute type.
[0312] In one implementation, if the attribute presence flag field under the target attribute type among the N attribute types is a second value, the decoding indication information further includes a frame attribute quantization parameter control field under the target attribute type;
[0313] The frame attribute quantization parameter control field under the target attribute type is used to control the attribute quantization parameter of the point cloud frame under the target attribute type. The attribute quantization parameter under the target attribute type is used to perform attribute decoding instructions on the point cloud frame regarding the attribute quantization under the target attribute type.
[0314] When the target attribute type is the reflectance attribute, the attribute quantization parameter control field under the target attribute type includes the reflectance attribute quantization parameter offset; when the target attribute type is the color attribute, the attribute quantization parameter control field under the target attribute type includes any one of the following: color attribute quantization parameter offset, attribute quantization parameter offset of each color component.
[0315] In one implementation, the decoding indication information includes an attribute space conversion flag field, and the attribute space conversion flag field is used to indicate the conversion status of the attribute space of the point cloud frame;
[0316] If the attribute space conversion flag field is the first value, it means that the point cloud frame has not been converted into the attribute space;
[0317] If the attribute space conversion flag field is the second value, it means that the point cloud frame undergoes attribute space conversion.
[0318] In one implementation, the attribute space is a color space, and if the attribute space conversion flag field is a second value, the decoding indication information further includes a frame attribute quantization parameter control field;
[0319] The frame attribute quantization parameter control field is used to control the attribute quantization parameters of the point cloud frame. The attribute quantization parameters of the point cloud frame are used to indicate attribute decoding of the point cloud frame regarding attribute quantization.
[0320] The frame attribute quantization parameter control field includes any of the following: color attribute quantization parameter offset, attribute quantization parameter offset of each color component.
[0321] In one implementation, if the attribute space conversion flag field is a first value, the decoding indication information further includes an attribute residual multiple prediction field;
[0322] The attribute residual multiple prediction field is used to indicate whether the point cloud frame allows multiple predictions of attribute residuals.
[0323] In one implementation, if the attribute space conversion flag field is a first value, the decoding indication information further includes a transform residual layer flag field;
[0324] The transformation residual layer flag field is used to control the use of attribute residual compensation of the point cloud frame when the point cloud frame uses the attribute encoding mode of the multi-layer transformation algorithm.
[0325] In one implementation, the decoding indication information includes an attribute coding mode flag field, and the attribute coding mode flag field is used to indicate the attribute coding mode of the point cloud frame;
[0326] The decoding indication information further includes an attribute type index field, which is used to indicate the attribute type of the point cloud frame;
[0327] The syntax elements in the attribute header of the point cloud frame are classified and organized based on the attribute coding mode flag field and / or the attribute type index field.
[0328] In one implementation, the point cloud includes multiple point cloud frames, and the decoding indication information is set in the frame header of the point cloud frame, and the decoding indication information is used to indicate decoding of the point cloud frame.
[0329] In one implementation, the decoding indication information includes a frame point number flag field; the frame point number flag field is used to indicate the number of points to be decoded contained in the point cloud frame.
[0330] In one implementation, the frame point count flag field includes a frame point count high-order flag field and a frame point count low-order flag field; the frame point count high-order flag field is used to indicate the high-order information of the number of points to be decoded contained in the point cloud frame, and the frame point count low-order flag field is used to indicate the low-order information of the number of points to be decoded contained in the point cloud frame;
[0331] The number of points to be decoded contained in the point cloud frame is determined based on the high-bit information and the low-bit information.
[0332] In one implementation, the decoding indication information includes a frame slice number flag field; the frame slice number flag field is used to indicate the number of point cloud slices contained in the point cloud frame.
[0333] In one implementation, the point cloud includes multiple point cloud frames, the point cloud frames include multiple point cloud slices, the decoding indication information is set in the header of the point cloud slice, and the decoding indication information is used to indicate the decoding of the point cloud slice.
[0334] In one implementation, the slice header includes a geometric slice header, and the decoding indication information includes a slice point number flag field; the slice point number flag field is used to indicate the number of points to be decoded contained in the point cloud slice.
[0335] In one implementation, the slice point number flag field includes a slice point number high-order flag field and a slice point number low-order flag field; the slice point number high-order flag field is used to indicate the high-order information of the number of to-be-decoded points contained in the point cloud slice, and the slice point number low-order flag field is used to indicate the low-order information of the number of to-be-decoded points contained in the point cloud slice;
[0336] The number of points to be decoded contained in the point cloud is determined based on the high-bit information and the low-bit information.
[0337] In one implementation, the slice header includes an attribute slice header, the decoding indication information includes a slice attribute quantization parameter control field, the slice attribute quantization parameter control field is used to control the attribute quantization parameter of the point cloud slice, and the attribute quantization parameter of the point cloud slice is used to perform attribute decoding indication on the point cloud slice regarding attribute quantization;
[0338] The slice attribute quantization parameter control field includes: a slice reflectance attribute quantization parameter control field and a slice color attribute quantization parameter control field; or, the slice attribute quantization parameter control field includes: a slice reflectance attribute quantization parameter control field and a slice color component attribute quantization parameter control field.
[0339] In other embodiments, the computer device may be a decoding device, and the processor 701 may load and execute one or more computer instructions stored in the computer-readable storage medium 704 to implement the corresponding steps of the point cloud processing method shown in FIG. 4 . In a specific implementation, the computer instructions in the computer-readable storage medium 704 are loaded by the processor 701 and executed as follows:
[0340] Generate decoding instruction information and encode the decoding instruction information into the point cloud code stream; the decoding instruction information is used to provide decoding instructions for different types of data in the point cloud, and the different types of data include at least one of the following: point cloud frames and point cloud slices;
[0341] The point cloud code stream is sent to the decoding device so that the decoding device decodes the point cloud according to the decoding instruction information.
[0342] In an embodiment of the present application, the decoding indication information in the point cloud code stream can be used to provide decoding instructions for different types of data in the point cloud. The different types of data include at least one of the following: point cloud frames and point cloud slices. Thus, based on the decoding indication effect of the decoding indication information on different types of data in the point cloud, the point cloud is decoded according to the decoding indication information, which can improve the decoding performance of the point cloud.
[0343] According to one aspect of the present application, a computer program product is provided, comprising computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the point cloud processing method provided in the various optional embodiments described above.
[0344] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.
Claims
1. A point cloud processing method, characterized in that: The method is performed by a decoding device, and the method includes: Acquire a point cloud code stream; the point cloud code stream includes decoding indication information, the decoding indication information is used to indicate decoding of different types of data in the point cloud, the different types of data include at least one of the following: a point cloud frame and a point cloud slice; The point cloud is decoded according to the decoding instruction information.
2. The method according to claim 1, characterized in that The point cloud includes multiple point cloud frames, the decoding indication information is set in the attribute header of the point cloud frame, and the decoding indication information is used to indicate attribute decoding of the point cloud frame.
3. The method according to claim 2, characterized in that The decoding indication information includes attribute existence flag fields under N attribute types, where N is an integer greater than or equal to 2; the attribute existence flag field under any attribute type is used to indicate the existence of attribute encoding of the point cloud frame under the corresponding attribute type; If the attribute existence flag field under any attribute type is the first value, it means that the attribute code under the corresponding attribute type does not exist in the point cloud frame; If the attribute existence flag field under any attribute type is the second value, it means that the attribute code under the corresponding attribute type exists in the point cloud frame.
4. The method according to claim 3, characterized in that If the attribute existence flag field of at least two attribute types in the N attribute types is a second value, and the point cloud frame allows cross-type attribute prediction, the decoding indication information further includes a cross-type attribute prediction parameter; The cross-type attribute prediction parameter is used to perform attribute decoding instructions on the point cloud frame regarding cross-type attribute prediction.
5. The method according to claim 4, characterized in that The decoding indication information further includes an attribute coding order field, and the attribute coding order field is used to determine a first-coded attribute type of the point cloud frame and a later-coded attribute type of the point cloud frame; The cross-type attribute prediction parameter includes a cross-type attribute prediction parameter of the post-encoded attribute type.
6. The method according to claim 5, characterized in that When there are multiple attribute information in the post-encoded attribute type, the cross-type attribute prediction parameter includes the cross-type attribute prediction parameter of each attribute information under the post-encoded attribute type.
7. The method according to claim 4, characterized in that The decoding indication information further includes the index flag field of the cross-type attribute prediction, and the index flag field of the cross-type attribute prediction is used to indicate the attribute information index value under the first-prediction attribute type used when the second-prediction attribute type performs cross-type attribute prediction.
8. The method according to claim 4, characterized in that The cross-type attribute prediction parameter is indicated by using an attribute type index field and an attribute information index field under the attribute type.
9. The method according to claim 3, characterized in that If the attribute existence flag field under the target attribute type in the N attribute types is a second value, the decoding indication information further includes a frame attribute quantization parameter control field under the target attribute type; The frame attribute quantization parameter control field under the target attribute type is used to control the attribute quantization parameter of the point cloud frame under the target attribute type, and the attribute quantization parameter under the target attribute type is used to perform attribute decoding instructions on the point cloud frame regarding the attribute quantization under the target attribute type; When the target attribute type is a reflectance attribute, the attribute quantization parameter control field under the target attribute type includes a reflectance attribute quantization parameter offset; when the target attribute type is a color attribute, the attribute quantization parameter control field under the target attribute type includes any one of the following: a color attribute quantization parameter offset, an attribute quantization parameter offset of each color component.
10. The method according to claim 2, characterized in that The decoding indication information includes an attribute space conversion flag field, and the attribute space conversion flag field is used to indicate the conversion status of the attribute space of the point cloud frame; If the attribute space conversion flag field is a first value, it indicates that the point cloud frame has not been converted in attribute space; If the attribute space conversion flag field is a second value, it indicates that the point cloud frame undergoes attribute space conversion.
11. The method according to claim 10, characterized in that The attribute space is a color space, and if the attribute space conversion flag field is a second value, the decoding indication information further includes a frame attribute quantization parameter control field; The frame attribute quantization parameter control field is used to control the attribute quantization parameter of the point cloud frame, and the attribute quantization parameter of the point cloud frame is used to perform attribute decoding instructions on attribute quantization of the point cloud frame; The frame attribute quantization parameter control field includes any one of the following: a color attribute quantization parameter offset, and an attribute quantization parameter offset of each color component.
12. The method according to claim 10, characterized in that If the attribute space conversion flag field is a first value, the decoding indication information further includes an attribute residual multiple prediction field; The attribute residual multiple prediction field is used to indicate whether the point cloud frame allows multiple predictions of attribute residuals.
13. The method according to claim 10, characterized in that If the attribute space conversion flag field is a first value, the decoding indication information further includes a transformation residual layer flag field; The transformation residual layer flag field is used to control the use of attribute residual compensation by the point cloud frame when the point cloud frame uses the attribute encoding mode of the multi-layer transformation algorithm.
14. The method according to claim 2, characterized in that The decoding indication information includes an attribute coding mode flag field, and the attribute coding mode flag field is used to indicate the attribute coding mode of the point cloud frame; The decoding indication information further includes an attribute type index field, where the attribute type index field is used to indicate the attribute type of the point cloud frame; The syntax elements in the attribute header of the point cloud frame are classified and organized based on the attribute coding mode flag field and / or the attribute type index field.
15. The method according to claim 1, wherein: The point cloud includes multiple point cloud frames, the decoding indication information is set in the frame header of the point cloud frame, and the decoding indication information is used to indicate decoding of the point cloud frame.
16. The method according to claim 15, characterized in that The decoding indication information includes a frame point number flag field; the frame point number flag field is used to indicate the number of points to be decoded contained in the point cloud frame.
17. The method according to claim 16, characterized in that The frame point count flag field includes a frame point count high-order flag field and a frame point count low-order flag field; the frame point count high-order flag field is used to indicate the high-order information of the number of points to be decoded contained in the point cloud frame, and the frame point count low-order flag field is used to indicate the low-order information of the number of points to be decoded contained in the point cloud frame; The number of points to be decoded contained in the point cloud frame is determined according to the high-bit information and the low-bit information.
18. The method according to claim 15, characterized in that The decoding indication information includes a frame slice number flag field; the frame slice number flag field is used to indicate the number of point cloud slices contained in the point cloud frame.
19. The method according to claim 1, wherein: The point cloud includes multiple point cloud frames, the point cloud frames include multiple point cloud slices, the decoding indication information is set in the slice header of the point cloud slice, and the decoding indication information is used to indicate decoding of the point cloud slice.
20. The method of claim 19, wherein: The slice header includes a geometric slice header, and the decoding indication information includes a slice point number flag field; the slice point number flag field is used to indicate the number of points to be decoded contained in the point cloud slice.
21. The method of claim 20, wherein: The slice point number flag field includes a slice point number high-order flag field and a slice point number low-order flag field; the slice point number high-order flag field is used to indicate the high-order information of the number of points to be decoded contained in the point cloud slice, and the slice point number low-order flag field is used to indicate the low-order information of the number of points to be decoded contained in the point cloud slice; The number of points to be decoded contained in the point cloud piece is determined according to the high-bit information and the low-bit information.
22. The method of claim 19, wherein: The slice header includes an attribute slice header, the decoding indication information includes a slice attribute quantization parameter control field, the slice attribute quantization parameter control field is used to control the attribute quantization parameter of the point cloud slice, and the attribute quantization parameter of the point cloud slice is used to perform attribute decoding indication on attribute quantization of the point cloud slice; The slice attribute quantization parameter control field includes: a slice reflectance attribute quantization parameter control field and a slice color attribute quantization parameter control field; or, the slice attribute quantization parameter control field includes: a slice reflectance attribute quantization parameter control field and a slice color component attribute quantization parameter control field.
23. A point cloud processing method, characterized in that: The method is performed by an encoding device, and the method includes: Generate decoding indication information, and encode the decoding indication information into the point cloud code stream; the decoding indication information is used to provide decoding instructions for different types of data in the point cloud, and the different types of data include at least one of the following: point cloud frames and point cloud slices; The point cloud code stream is sent to a decoding device so that the decoding device decodes the point cloud according to the decoding instruction information.
24. A point cloud processing device, characterized in that: include: An acquisition unit is used to acquire a point cloud code stream; the point cloud code stream includes decoding indication information, and the decoding indication information is used to indicate decoding of different types of data in the point cloud, and the different types of data include at least one of the following: a point cloud frame and a point cloud slice; A processing unit is used to decode the point cloud according to the decoding indication information.
25. A point cloud processing device, characterized in that: include: A processing unit, configured to generate the decoding indication information and encode the decoding indication information into a point cloud code stream; The decoding indication information is used to indicate decoding of different types of data in the point cloud, and the different types of data include at least one of the following: a point cloud frame and a point cloud slice; A communication unit is used to send the point cloud code stream to a decoding device so that the decoding device decodes the point cloud according to the decoding instruction information.
26. A computer device, characterized in that: The computer device comprises: a processor suitable for implementing a computer program; A computer-readable storage medium storing a computer program, wherein the computer program is suitable for being used by the processor The device loads and executes the point cloud processing method according to any one of claims 1 to 22, or executes the point cloud processing method according to any one of claim 23.
27. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and the computer program is suitable for being loaded by a processor and executing the point cloud processing method according to any one of claims 1 to 22, or executing the point cloud processing method according to any one of claim 23.
28. A computer program product, characterized in that The computer program product includes computer instructions, and when the computer instructions are executed by a processor, the point cloud processing method according to any one of claims 1 to 22 is implemented, or the point cloud processing method according to any one of claim 23 is implemented.
Citation Information
Patent Citations
Point cloud compression using non-orthogonal projection
CN111316331A
Point cloud coding and decoding method, device and system
CN114667728A
Data processing method and device, electronic equipment and storage medium
CN115484462A
Data processing method of point cloud media and related equipment
CN115866274A
Data processing method and device for point cloud media, equipment and medium
CN116781676A
